WO2021147122A1 - Human detection method and apparatus, terminal device, storage medium, and electronic device - Google Patents

Human detection method and apparatus, terminal device, storage medium, and electronic device Download PDF

Info

Publication number
WO2021147122A1
WO2021147122A1 PCT/CN2020/074286 CN2020074286W WO2021147122A1 WO 2021147122 A1 WO2021147122 A1 WO 2021147122A1 CN 2020074286 W CN2020074286 W CN 2020074286W WO 2021147122 A1 WO2021147122 A1 WO 2021147122A1
Authority
WO
WIPO (PCT)
Prior art keywords
target object
radar
human body
reflection area
position information
Prior art date
Application number
PCT/CN2020/074286
Other languages
French (fr)
Chinese (zh)
Inventor
郭思佳
刘成
郭冠出
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Publication of WO2021147122A1 publication Critical patent/WO2021147122A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications

Definitions

  • the present disclosure relates to the field of information processing technology, and in particular to a human body detection method, device, terminal device, computer-readable storage medium, and electronic equipment.
  • the radar can detect the distance and angle, but it is difficult to determine whether the detection object is a human body based on the distance and angle.
  • An embodiment of the first aspect of the present disclosure proposes a human body detection method, including: acquiring detection information of radars on a terminal device, where the number of the radars is multiple; and the detection information includes: target distance and radar signal reflection amount; target The distance is the distance between the radar signal reflection position and the radar; according to the detection information and the radar position information, the position information of the first target object and the front reflection area of the first target object are determined; The facing reflection area is the reflection area when the first target object is facing the radar; the first target object is the object located at the reflection position of the radar signal; according to the facing reflection area, the reflection area is determined State whether the first target object is a human body.
  • the method further includes: when the first target object is a human body, tracking the first target object in real time Target object, and obtain the detection information of the radar on the terminal device to determine the position information of the second target object; according to the position information of the second target object, determine whether the second target object is the hand of the first target object When the second target object is the hand of the first target object, track the second target object in real time, and determine the position of the hand according to the change in the position information of the second target object gesture.
  • the determining the position information of the first target object and the facing reflection area of the first target object according to the detection information and the position information of the radar includes: The target distance in the detection information of the radar, the position information of the radar, and the three-positioning algorithm are used to determine the position information of the first target object; the target distance in the detection information of the radar, the amount of reflection of the radar signal, And a preset reflectivity to determine the reflection area of the radar to the first target object; according to the reflection area of the radar to the first target object, the position information of the radar, and the first target object The location information to determine the facing reflection area.
  • the determining whether the first target object is a human body according to the facing reflection area includes: determining whether the facing reflection area is within a preset area threshold range, and Whether the stationary time of the first target object is greater than a first time threshold; if the facing reflection area is within a preset area threshold range, and the stationary time of the first target object is less than or equal to the first time threshold, it is determined
  • the first target object is a human body; if the facing reflection area is within a preset area threshold range, and the static time of the first target object is greater than the first time threshold, it is determined that the first target object is Non-human body; if the facing reflection area is outside the preset area threshold range, it is determined that the first target object is a non-human body.
  • the method further includes: in response to determining that the first target object is a human body, according to the facing reflection area, The reflection area determines the age stage of the human body.
  • the method in response to determining that the first target object is a human body, after determining the age stage of the human body according to the front reflection area, the method further includes: responding to determining the age stage of the human body For children, obtain the length of time the first target object looks at the terminal device; in response to the length of time being greater than a second time threshold, prompt the first target object to stop the gaze operation and perform timing; in response to the timing duration being greater than The third time threshold controls the display screen of the terminal device to stop the display operation.
  • the determining whether the second target object is the hand of the first target object according to the position information of the second target object includes: according to the position information of the second target object Position information and tracked position information of the first target object, determine the distance between the second target object and the first target object; determine the distance between the second target object and the first target object Whether the distance of is greater than a preset distance threshold; in response to the distance being less than or equal to the preset distance threshold, it is determined that the second target object is the hand of the first target object.
  • the method further includes: determining a control operation on the terminal device according to the gesture; controlling the terminal device according to the control operation, and It is determined that the control operation starts timing; in response to the timing duration being greater than the fourth time threshold, the detection information of the radar on the terminal device is reacquired, the position information of the second target object is determined, and the hand gesture is determined.
  • the radar is a millimeter wave radar.
  • An embodiment of the second aspect of the present disclosure proposes a human body detection device, including: an acquisition module for acquiring detection information of radar on a terminal device, the number of the radar is multiple; the detection information includes: target distance and radar The amount of signal reflection; the target distance is the distance between the radar signal reflection position and the radar; a determining module for determining the position information of the first target object according to the detection information and the position information of the radar, and The facing reflection area of the first target object; the facing reflection area is the reflection area when the first target object is facing the radar; the first target object is the reflection area of the radar signal Object; the determining module is also used to determine whether the first target object is a human body according to the facing reflection area.
  • the embodiment of the third aspect of the present disclosure proposes a terminal device, a terminal device body, a radar and a processor located in the terminal device body; the number of the radar is multiple; the processor is connected to the radar , Used to implement the human body detection method as described in the embodiment of the first aspect.
  • the embodiment of the fourth aspect of the present disclosure proposes a non-transitory computer-readable storage medium, and when the instructions in the storage medium are executed by a processor, the human body detection method as described above is realized.
  • An embodiment of the fifth aspect of the present disclosure proposes an electronic device that includes: a memory and a processor; the memory stores computer instructions, and when the computer instructions are executed by the processor, the implementation is as described above Human body detection method.
  • Fig. 1 is a schematic flowchart of a human body detection method according to an embodiment of the present disclosure
  • Figure 2 is a schematic diagram of the structure of multiple radars embedded in a terminal device
  • FIG. 3 is a schematic flowchart of a human body detection method according to another embodiment of the present disclosure.
  • FIG. 4 is a schematic flowchart of a human body detection method according to another embodiment of the present disclosure.
  • Figure 5 is a schematic diagram of the real-time tracking and monitoring hand structure
  • Fig. 6 is a schematic structural diagram of a human body detection device according to an embodiment of the present disclosure.
  • Fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure.
  • Fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
  • FIG. 1 is a schematic flowchart of a human body detection method provided by an embodiment of the disclosure.
  • the human body detection method includes the following steps:
  • Step 101 Obtain the detection information of the radar on the terminal device, the number of radars is multiple; the detection information includes: the target distance and the amount of radar signal reflection; the target distance is the distance between the radar signal reflection position and the radar.
  • the detection information of the radar may include, but is not limited to, the target distance and the amount of radar signal reflection.
  • the target distance can be understood as the distance between the radar signal reflection position and the radar; the radar signal reflection amount can be understood as the radar signal strength.
  • the amount of radar signal reflection can be jointly determined by the reflectivity of the target object to the radar, the reflection area and the distance between the target object and the radar.
  • the reflection area is determined by the area of the target object itself and the position relative to the radar. For example, if the target object is on the side of the radar, the reflection area relative to the position of the target object decreases when the position of the target object is on the front of the radar.
  • different target objects have different reflectivity to radar. In the case of the same reflectivity and the target distance is known, the reflection area is different, and the radar signal reflection amount obtained is different.
  • the reflectivity of the human body to the radar and the target distance are known, and the reflection area of the human body when it is on the front of the radar is greater than the reflection area when the human body is on the side of the radar. The amount of radar signal reflection at the side.
  • the radar may be a millimeter wave radar.
  • millimeter wave radar works in the millimeter wave band.
  • millimeter wave refers to the 30-300GHz frequency band (wavelength is 1-10mm).
  • the wavelength of millimeter wave is between centimeter wave and light wave, so millimeter wave has the advantages of microwave guidance and photoelectric guidance.
  • the millimeter waveguide seeker has the characteristics of small size, light weight and high spatial resolution.
  • optical seekers such as infrared, laser, and television
  • the millimeter waveguide seeker has a strong ability to penetrate fog, smoke, and dust, and has the characteristics of all-weather (except heavy rain).
  • millimeter-wave radar can penetrate plastics, ceramics and other materials without perforating and will not damage the appearance of the product itself.
  • the horizontal measurement angle is larger (up to 80 degrees) and the measurement distance is longer. The distance can be up to two meters when detecting the human body, and up to one meter when detecting hand gestures.
  • Step 102 Determine the position information of the first target object and the facing reflection area of the first target object according to the detection information and the position information of the radar; the facing reflection area is the reflection area when the first target object is facing the radar; A target object is an object located at the reflection position of the radar signal.
  • the position information of the first target object is determined according to the target distance in the detection information of the radar, the position information of the radar, and the three positioning algorithm; the position information of the first target object is determined according to the target distance in the detection information of the radar, the amount of radar signal reflection, and the preset Determine the reflection area of the radar to the first target object; determine the facing reflection area according to the reflection area of the radar to the first target object, the position information of the radar, and the position information of the first target object.
  • the first target object may be an object located at a radar signal reflection position.
  • the number of lightning is 3 as an example, such as radar A, B, C; the placement position of radar A, B, C s1, s2, s3, in order to prevent the radar A, B, C signal from each other
  • radar A, B, and C can be set to different working time slots.
  • radar A works in 1, 4, 7... time slots
  • radar B works in 2, 5, 8... time slots
  • radar C works in 3, 6, 9...
  • the sampling frequency is 10HZ, which can be detected according to radar
  • the information is obtained from radars A, B, C, and the distance from the target object at t n+1 , t n+2 , t n+3 is d1, d2, d3, according to the placement position of radar A, B, C
  • the distance between the radar and the target object is combined with the three positioning algorithm to determine the position s of the target object.
  • the position s of the target object can be obtained when the mean square value of
  • the reflection area of the radar to the target object can be obtained; further, according to the reflection area of the target object, radar A, B , The placement position of C and the position information of the target object can determine the reflection area of the target object facing the radar position.
  • the azimuth information of the radar and the target object can be obtained. For example, obtain the vertical line of radar A passing through the target object on the display screen of the terminal device, and use the vertical line as the normal; then, obtain the angle between the connecting line of radar A and the target object and the normal; in addition, in the present disclosure
  • the relationship between the reflection area of the radar facing the target object and the reflection area of the radar lateral (with an angle) target object can be obtained in advance. Therefore, it is known that the reflection area of the radar A on the target object is the same as that of the radar A.
  • the angle between the connecting line and the normal of the target object is converted by the relationship between the reflection area of the radar A facing the target object and the reflection area of the radar A side (with an angle) target object, and the target object can be obtained.
  • the reflection area of radar A in the same way, the reflection area of the target object facing radar B and radar C can be obtained; finally, the reflection area of the target object facing radar A, B, and C is averaged to determine The reflective area of the target object facing the radar position.
  • Step 103 Determine whether the first target object is a human body according to the facing reflection area.
  • the frontal reflection area can be compared with a preset area threshold. According to the comparison result and whether the stationary time of the target object is greater than the first time threshold, it is determined whether the target object is human body.
  • the specific implementation process is as follows:
  • Step 301 Determine whether the facing reflection area is within a preset area threshold, and whether the static time of the first target object is greater than the first time threshold.
  • Step 302 If the facing reflection area is within the preset area threshold range, and the static time of the first target object is less than or equal to the first time threshold, it is determined that the first target object is a human body.
  • Step 303 If the facing reflection area is within the preset area threshold range, and the static time of the first target object is greater than the first time threshold, it is determined that the first target object is a non-human body.
  • Step 304 If the facing reflection area is outside the preset area threshold range, it is determined that the first target object is a non-human body.
  • the frontal reflection area can be compared with the preset area threshold, and the stationary time of the target object with the first time threshold. If the frontal reflection area is within the threshold range of the preset area, and the target If the stationary time of the object is less than or equal to the first time threshold, it can be determined that the target object is a human body; if the facing reflection area is within the preset area threshold range, and the stationary time of the target object is greater than the first time threshold, the target can be determined The object is a non-human body; if the facing reflection area is outside the threshold range of the preset area, for example, the reflection area is greater than the upper limit of the preset area threshold or less than the lower limit of the preset area threshold, then the target object is determined to be non-human .
  • the radar based on the detection information, location information, and location information of the target object from the radar, it can be accurately determined whether the current target object is a human body based on the facing reflection area.
  • the age stage of the human body can be determined according to the front reflection area.
  • the age stage may include, but is not limited to, adults, children, and so on.
  • the higher the height of the target object the larger the corresponding front reflection area.
  • the front reflection area corresponding to the height of the target object can be compared with the front reflection area corresponding to the height of 1.2 meters.
  • the age stage of the target object is determined as an adult; when the height of the target object corresponds to the front reflection area is less than or equal to the front reflection area corresponding to the height of 1.2 meters In the case of area, the age of the target object is determined to be a child.
  • the length of time the child stares at the terminal device display screen can be obtained. If the length is greater than the second time threshold (e.g., 2 minutes), a prompt message appears on the terminal device display screen, prompting the child to stop the gaze operation and start timing. In response to the timing duration greater than the third time threshold (e.g., 1 minute), the child is still The gaze operation is not stopped. At this time, the display screen of the terminal device stops displaying the operation.
  • the second time threshold e.g. 2 minutes
  • the detection information of the radar can be used to determine the distance between the terminal display and the child.
  • a prompt appears on the terminal device display
  • the message prompts that the child is too close to the terminal display screen and starts timing.
  • the timing duration is greater than the third threshold, the child is still too close to the terminal display screen.
  • the terminal device display screen stops displaying operations.
  • the target object can be tracked in real time and determined according to radar detection information.
  • the hand of the target object, and then determine the gesture of the target object the specific implementation process is as follows:
  • Step 401 When the first target object is a human body, the first target object is tracked in real time, and the detection information of the radar on the terminal device is acquired, and the position information of the second target object is determined.
  • the first target object when the first target object is a human body, the first target object is tracked and detected in real time.
  • the second target object can be detected according to the placement position of the radar and the distance from the radar. The distance to determine the position information of the second target object.
  • the distance between the second target object and the first target object is within a preset range (such as , 20 cm), determine that the second target object is a human body part.
  • Step 402 Determine whether the second target object is the hand of the first target object according to the position information of the second target object.
  • the position information of the tracked first target object can be compared with the position information of the second target object, and the comparison result can be used as the distance between the second target object and the first target object;
  • the distance between the second target object and the first target object is compared with a preset distance threshold (for example, arm length).
  • a preset distance threshold for example, arm length
  • Step 403 When the second target object is the hand of the first target object, track the second target object in real time, and determine the hand gesture according to the change of the position information of the second target object.
  • the movement of the hand can be tracked and monitored in real time, and the user's three-dimensional gesture can be judged according to the three-positioning method.
  • the palm moves from left to right, it is judged as a rightward gesture; if it moves from right to left, it is judged as a leftward gesture; if the palm moves from top to bottom, it is judged as an upward gesture; if If the palm moves from bottom to top, it is judged as a downward gesture; if the palm moves from front to back, it is judged as a forward gesture; if the palm moves from back to front, it is judged as a backward gesture.
  • the control operation of the terminal device can be determined according to the gesture; when the terminal device is controlled according to the control operation, the timing is started, in response to the timing duration being greater than the fourth time Threshold, re-acquire the detection information of the radar on the terminal device, determine the position information of the second target object, and determine the hand gesture. That is, after the terminal device performs corresponding control according to the gesture, it responds to the next gesture instruction after at least the fourth time threshold after the control operation, and does not respond to the gesture given within the fourth time threshold.
  • the detection information of the radar on the terminal device is obtained, and the number of the radar is multiple; the detection information includes: the target distance and the radar signal reflection amount; the target distance is the radar signal reflection position and The distance between the radars; according to the detection information and the position information of the radar, the position information of the first target object and the front reflection area of the first target object are determined; the front reflection area is the first target object directly facing The reflection area at the time of the radar; the first target object is an object located at the reflection position of the radar signal; according to the facing reflection area, it is determined whether the first target object is a human body.
  • This method can accurately determine whether the current target object is a human body based on the detection information, position information and target object position information of the radar, and according to the frontal reflection area, and when the current target object is a human body, it can further confirm that the human body gesture is performed on the human machine. Interaction, while distinguishing the age stage of the human body, and protect the eyesight when the age stage is a child.
  • an embodiment of the present disclosure also provides a human body detection device, because the human body detection device provided by the embodiment of the present disclosure is different from the human body detection method provided by the above several embodiments.
  • the foregoing implementation of the human body detection method is also applicable to the human body detection device provided in this embodiment, and will not be described in detail in this embodiment.
  • Fig. 6 is a schematic structural diagram of a human body detection device according to an embodiment of the present disclosure. As shown in FIG. 6, the human body detection device includes: an acquisition module 610 and a determination module 620.
  • the acquisition module 610 is used to acquire the detection information of the radar on the terminal device, the number of radars is multiple; the detection information includes: the target distance and the amount of radar signal reflection; the target distance is the distance between the radar signal reflection position and the radar Distance; determining module 620, used to determine the position information of the first target object and the front reflection area of the first target object according to the detection information and the position information of the radar; the front reflection area is when the first target object is facing the radar The first target object is an object located at the reflection position of the radar signal; the determining module 620 is further configured to determine whether the first target object is a human body according to the facing reflection area.
  • the human body detection device of the embodiment of the present disclosure acquires the detection information of the radar on the terminal device, and the number of radars is multiple; the detection information includes: the target distance and the amount of radar signal reflection; the target distance is the distance between the radar signal reflection position and the radar Distance; determine the position information of the first target object and the front reflection area of the first target object according to the detection information and the position information of the radar; the front reflection area is the reflection area when the first target object is facing the radar; The first target object is the object at the reflection position of the radar signal; according to the facing reflection area, it is determined whether the first target object is a human body.
  • the device can realize the detection information, position information and position information of the target object through the radar.
  • the reflection area can accurately determine whether the current target object is a human body, and when the current target object is a human body, it can further confirm human body gestures for human-computer interaction, while distinguishing the age of the human body, and protect the eyesight when the age is a child .
  • the present disclosure also proposes a terminal device, as shown in FIG. 7, which is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure.
  • the terminal device 700 includes a terminal device body 710, a radar 720 and a processor 730 located in the terminal device body.
  • the number of radars is multiple; the processor 730 is connected to the radar 720 and is used to execute the human body detection method described in the above embodiment.
  • the present disclosure also proposes a non-transitory computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the above-mentioned human body detection method is realized.
  • FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
  • the electronic equipment includes:
  • the processor 1002 implements the human body detection method provided in the foregoing embodiment when executing the instruction.
  • the electronic equipment also includes:
  • the communication interface 1003 is used for communication between the memory 1001 and the processor 1002.
  • the memory 1001 is used to store computer instructions that can run on the processor 1002.
  • the memory 1001 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), for example, at least one disk memory.
  • the processor 1002 is configured to implement the human body detection method described in the foregoing embodiment when executing the program.
  • the bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. Wait.
  • ISA Industry Standard Architecture
  • PCI Peripheral Component
  • EISA Extended Industry Standard Architecture
  • the bus can be divided into an address bus, a data bus, a control bus, and so on. For ease of representation, only one thick line is used in Figure 8, but it does not mean that there is only one bus or one type of bus.
  • the memory 1001, the processor 1002, and the communication interface 1003 are integrated on a single chip, the memory 1001, the processor 1002, and the communication interface 1003 can communicate with each other through internal interfaces.
  • the processor 1002 may be a central processing unit (Central Processing Unit, referred to as CPU), or a specific integrated circuit (Application Specific Integrated Circuit, referred to as ASIC), or configured to implement one or more of the embodiments of the present disclosure integrated circuit.
  • CPU Central Processing Unit
  • ASIC Application Specific Integrated Circuit
  • first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include at least one of the features. In the description of the present disclosure, “plurality” means at least two, such as two, three, etc., unless otherwise specifically defined.
  • a "computer-readable medium” can be any device that can contain, store, communicate, propagate, or transmit a program for use by an instruction execution system, device, or device or in combination with these instruction execution systems, devices, or devices.
  • computer readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because it can be used, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable media if necessary. The program is processed in a manner to obtain the program electronically, and then stored in the computer memory.
  • each part of the present disclosure can be implemented by hardware, software, firmware, or a combination thereof.
  • multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system.
  • Discrete logic gate circuits with logic functions for data signals Logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate array (PGA), field programmable gate array (FPGA), etc.
  • a person of ordinary skill in the art can understand that all or part of the steps carried in the method of the foregoing embodiments can be implemented by a program instructing relevant hardware to complete.
  • the program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. When executed, it includes one of the steps of the method embodiment or a combination thereof.
  • the functional units in the various embodiments of the present disclosure may be integrated into one processor, or each unit may exist alone physically, or two or more units may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium.
  • the aforementioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

Provided are a human detection method and apparatus, a terminal device, a storage medium, and an electronic device. The method comprises: acquiring detection information of a radar on a terminal device, wherein a plurality of radars are provided, the detection information comprises a target distance and a radar signal reflection amount, and the target distance is the distance between a radar signal reflection position and the radar (101); determining position information of a first target object and a direct-facing reflection area of the first target object according to the detection information and the position information of the radar, wherein the direct-facing reflection area is a reflection area when the first target object is directly facing the radar, and the first target object is an object located at the radar signal reflection position (102); and determining, according to the direct-facing reflection area, whether the first target object is a human (103).

Description

人体检测方法、装置、终端设备、存储介质及电子设备Human body detection method, device, terminal equipment, storage medium and electronic equipment
相关申请的交叉引用Cross-references to related applications
本公开要求京东方科技集团股份有限公司于2020年01月20日提交的、申请名称为“人体检测方法、装置、终端设备、存储介质及电子设备”的、中国专利申请号“202010066140.4”的优先权。This disclosure requires the priority of the Chinese patent application number "202010066140.4" filed by BOE Technology Group Co., Ltd. on January 20, 2020, with the application titled "Human detection methods, devices, terminal equipment, storage media and electronic equipment" .
技术领域Technical field
本公开涉及信息处理技术领域,尤其涉及一种人体检测方法、装置、终端设备、计算机可读存储介质及电子设备。The present disclosure relates to the field of information processing technology, and in particular to a human body detection method, device, terminal device, computer-readable storage medium, and electronic equipment.
背景技术Background technique
随着智能化的发展,通过人机交互可实现用户与设备的信息交换。在终端设备上设置一个雷达,雷达能检测到距离以及角度,但根据距离以及角度难以确定检测对象是否为人体。With the development of intelligence, information exchange between users and devices can be realized through human-computer interaction. Set up a radar on the terminal device, the radar can detect the distance and angle, but it is difficult to determine whether the detection object is a human body based on the distance and angle.
发明内容Summary of the invention
本公开第一方面实施例提出了一种人体检测方法,包括:获取终端设备上雷达的检测信息,所述雷达的数量为多个;所述检测信息包括:目标距离以及雷达信号反射量;目标距离为雷达信号反射位置与所述雷达之间的距离;根据所述检测信息以及所述雷达的位置信息,确定第一目标对象的位置信息,以及所述第一目标对象的正对反射面积;所述正对反射面积为所述第一目标对象正 对所述雷达时的反射面积;所述第一目标对象为位于所述雷达信号反射位置的对象;根据所述正对反射面积,确定所述第一目标对象是否为人体。An embodiment of the first aspect of the present disclosure proposes a human body detection method, including: acquiring detection information of radars on a terminal device, where the number of the radars is multiple; and the detection information includes: target distance and radar signal reflection amount; target The distance is the distance between the radar signal reflection position and the radar; according to the detection information and the radar position information, the position information of the first target object and the front reflection area of the first target object are determined; The facing reflection area is the reflection area when the first target object is facing the radar; the first target object is the object located at the reflection position of the radar signal; according to the facing reflection area, the reflection area is determined State whether the first target object is a human body.
根据本公开的一个实施例,所述根据所述正对反射面积,确定所述第一目标对象是否为人体之后,还包括:在所述第一目标对象为人体时,实时跟踪所述第一目标对象,并获取终端设备上雷达的检测信息,确定第二目标对象的位置信息;根据所述第二目标对象的位置信息,确定所述第二目标对象是否为所述第一目标对象的手部;在所述第二目标对象为所述第一目标对象的手部时,实时跟踪所述第二目标对象,根据所述第二目标对象的位置信息的变化情况,确定所述手部的手势。According to an embodiment of the present disclosure, after determining whether the first target object is a human body according to the facing reflection area, the method further includes: when the first target object is a human body, tracking the first target object in real time Target object, and obtain the detection information of the radar on the terminal device to determine the position information of the second target object; according to the position information of the second target object, determine whether the second target object is the hand of the first target object When the second target object is the hand of the first target object, track the second target object in real time, and determine the position of the hand according to the change in the position information of the second target object gesture.
根据本公开的一个实施例,所述根据所述检测信息以及所述雷达的位置信息,确定第一目标对象的位置信息,以及所述第一目标对象的正对反射面积,包括:根据所述雷达的检测信息中的目标距离、所述雷达的位置信息以及三定位算法,确定所述第一目标对象的位置信息;根据所述雷达的检测信息中的目标距离、所述雷达信号反射量、以及预设的反射率,确定所述雷达对所述第一目标对象的反射面积;根据所述雷达对所述第一目标对象的反射面积、所述雷达的位置信息、所述第一目标对象的位置信息,确定所述正对反射面积。According to an embodiment of the present disclosure, the determining the position information of the first target object and the facing reflection area of the first target object according to the detection information and the position information of the radar includes: The target distance in the detection information of the radar, the position information of the radar, and the three-positioning algorithm are used to determine the position information of the first target object; the target distance in the detection information of the radar, the amount of reflection of the radar signal, And a preset reflectivity to determine the reflection area of the radar to the first target object; according to the reflection area of the radar to the first target object, the position information of the radar, and the first target object The location information to determine the facing reflection area.
根据本公开的一个实施例,所述根据所述正对反射面积,确定所述第一目标对象是否为人体,包括:判断所述正对反射面积是否位于预设的面积阈值范围内,以及所述第一目标对象的静止时间是否大于第一时间阈值;若所述正对反射面积位于预设的面积阈值范围内,且所述第一目标对象的静止时间小于等于第一时间阈值,则确定所述第一目标对象为人体;若所述正对反射面积位于预设的面积阈值范围内,且所述第一目标对象的静止时间大于第一时间阈值,则确定所述第一目标对象为非人体;若所述正对反射面积位于预设的面积阈值 范围外,则确定所述第一目标对象为非人体。According to an embodiment of the present disclosure, the determining whether the first target object is a human body according to the facing reflection area includes: determining whether the facing reflection area is within a preset area threshold range, and Whether the stationary time of the first target object is greater than a first time threshold; if the facing reflection area is within a preset area threshold range, and the stationary time of the first target object is less than or equal to the first time threshold, it is determined The first target object is a human body; if the facing reflection area is within a preset area threshold range, and the static time of the first target object is greater than the first time threshold, it is determined that the first target object is Non-human body; if the facing reflection area is outside the preset area threshold range, it is determined that the first target object is a non-human body.
根据本公开的一个实施例,所述根据所述正对反射面积,确定所述第一目标对象是否为人体之后,还包括:响应于确定所述第一目标对象为人体,根据所述正对反射面积确定所述人体的年龄阶段。According to an embodiment of the present disclosure, after determining whether the first target object is a human body according to the facing reflection area, the method further includes: in response to determining that the first target object is a human body, according to the facing reflection area, The reflection area determines the age stage of the human body.
根据本公开的一个实施例,所述响应于确定所述第一目标对象为人体,根据所述正对反射面积确定所述人体的年龄阶段之后,还包括:响应于确定所述人体的年龄阶段为儿童,获取所述第一目标对象注视所述终端设备的时间长度;响应于所述时间长度大于第二时间阈值,提示所述第一目标对象停止注视操作并进行计时;响应于计时时长大于第三时间阈值,控制所述终端设备的显示屏停止显示操作。According to an embodiment of the present disclosure, in response to determining that the first target object is a human body, after determining the age stage of the human body according to the front reflection area, the method further includes: responding to determining the age stage of the human body For children, obtain the length of time the first target object looks at the terminal device; in response to the length of time being greater than a second time threshold, prompt the first target object to stop the gaze operation and perform timing; in response to the timing duration being greater than The third time threshold controls the display screen of the terminal device to stop the display operation.
根据本公开的一个实施例,所述根据所述第二目标对象的位置信息,确定所述第二目标对象是否为所述第一目标对象的手部,包括:根据所述第二目标对象的位置信息以及跟踪的所述第一目标对象的位置信息,确定所述第二目标对象与所述第一目标对象之间的距离;判断所述第二目标对象与所述第一目标对象之间的距离是否大于预设距离阈值;响应于所述距离小于等于所述预设距离阈值,确定所述第二目标对象为所述第一目标对象的手部。According to an embodiment of the present disclosure, the determining whether the second target object is the hand of the first target object according to the position information of the second target object includes: according to the position information of the second target object Position information and tracked position information of the first target object, determine the distance between the second target object and the first target object; determine the distance between the second target object and the first target object Whether the distance of is greater than a preset distance threshold; in response to the distance being less than or equal to the preset distance threshold, it is determined that the second target object is the hand of the first target object.
根据本公开的一个实施例,确定所述手部的手势之后,还包括:根据所述手势,确定对所述终端设备的控制操作;根据所述控制操作对所述终端设备进行控制,并从确定所述控制操作开始进行计时;响应于计时时长大于第四时间阈值,重新获取终端设备上雷达的检测信息,确定第二目标对象的位置信息,确定所述手部的手势。According to an embodiment of the present disclosure, after determining the hand gesture, the method further includes: determining a control operation on the terminal device according to the gesture; controlling the terminal device according to the control operation, and It is determined that the control operation starts timing; in response to the timing duration being greater than the fourth time threshold, the detection information of the radar on the terminal device is reacquired, the position information of the second target object is determined, and the hand gesture is determined.
根据本公开的一个实施例,所述雷达为毫米波雷达。According to an embodiment of the present disclosure, the radar is a millimeter wave radar.
本公开第二方面实施例提出了一种人体检测装置,包括:获取模块,用于 获取终端设备上雷达的检测信息,所述雷达的数量为多个;所述检测信息包括:目标距离以及雷达信号反射量;所述目标距离为雷达信号反射位置与所述雷达之间的距离;确定模块,用于根据所述检测信息以及所述雷达的位置信息,确定第一目标对象的位置信息,以及所述第一目标对象的正对反射面积;所述正对反射面积为所述第一目标对象正对所述雷达时的反射面积;所述第一目标对象为位于所述雷达信号反射位置的对象;所述确定模块,还用于根据所述正对反射面积,确定所述第一目标对象是否为人体。An embodiment of the second aspect of the present disclosure proposes a human body detection device, including: an acquisition module for acquiring detection information of radar on a terminal device, the number of the radar is multiple; the detection information includes: target distance and radar The amount of signal reflection; the target distance is the distance between the radar signal reflection position and the radar; a determining module for determining the position information of the first target object according to the detection information and the position information of the radar, and The facing reflection area of the first target object; the facing reflection area is the reflection area when the first target object is facing the radar; the first target object is the reflection area of the radar signal Object; the determining module is also used to determine whether the first target object is a human body according to the facing reflection area.
本公开第三方面实施例提出了一种终端设备,终端设备本体,以及位于所述终端设备本体内的雷达和处理器;所述雷达的数量为多个;所述处理器与所述雷达连接,用于执行如第一方面实施例所述的人体检测方法。The embodiment of the third aspect of the present disclosure proposes a terminal device, a terminal device body, a radar and a processor located in the terminal device body; the number of the radar is multiple; the processor is connected to the radar , Used to implement the human body detection method as described in the embodiment of the first aspect.
本公开第四方面实施例提出了一种非临时性计算机可读存储介质,当所述存储介质中的指令被处理器执行时,实现如上所述的人体检测方法。The embodiment of the fourth aspect of the present disclosure proposes a non-transitory computer-readable storage medium, and when the instructions in the storage medium are executed by a processor, the human body detection method as described above is realized.
本公开第五方面实施例提出了一种电子设备,该电子设备包括:存储器,处理器;所述存储器中存储有计算机指令,当所述计算机指令被所述处理器执行时,实现如上所述的人体检测方法。An embodiment of the fifth aspect of the present disclosure proposes an electronic device that includes: a memory and a processor; the memory stores computer instructions, and when the computer instructions are executed by the processor, the implementation is as described above Human body detection method.
本公开附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本公开的实践了解到。The additional aspects and advantages of the present disclosure will be partially given in the following description, and some will become obvious from the following description, or be understood through the practice of the present disclosure.
附图说明Description of the drawings
本公开上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present disclosure will become obvious and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, in which:
图1为根据本公开一个实施例的人体检测方法的流程示意图;Fig. 1 is a schematic flowchart of a human body detection method according to an embodiment of the present disclosure;
图2为终端设备上嵌入多个雷达的结构示意图;Figure 2 is a schematic diagram of the structure of multiple radars embedded in a terminal device;
图3为根据本公开另一个实施例的人体检测方法的流程示意图;FIG. 3 is a schematic flowchart of a human body detection method according to another embodiment of the present disclosure;
图4为根据本公开又一个实施例的人体检测方法的流程示意图;4 is a schematic flowchart of a human body detection method according to another embodiment of the present disclosure;
图5为实时跟踪监测手部的结构示意图;Figure 5 is a schematic diagram of the real-time tracking and monitoring hand structure;
图6为根据本公开一个实施例的人体检测装置的结构示意图;Fig. 6 is a schematic structural diagram of a human body detection device according to an embodiment of the present disclosure;
图7为根据本公开一个实施例的终端设备的结构示意图;Fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure;
图8为根据本公开一个实施例的电子设备的结构示意图。Fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
具体实施方式Detailed ways
下面详细描述本公开的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本公开,而不能理解为对本公开的限制。The embodiments of the present disclosure are described in detail below. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals denote the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the present disclosure, but should not be construed as limiting the present disclosure.
下面参考附图描述本公开实施例的人体检测方法、装置、终端设备、计算机可读存储介质及电子设备。The following describes the human body detection method, device, terminal device, computer-readable storage medium, and electronic device of the embodiments of the present disclosure with reference to the accompanying drawings.
图1为本公开实施例提供的一种人体检测方法的流程示意图。FIG. 1 is a schematic flowchart of a human body detection method provided by an embodiment of the disclosure.
如图1所示,该人体检测方法包括以下步骤:As shown in Figure 1, the human body detection method includes the following steps:
步骤101,获取终端设备上雷达的检测信息,雷达的数量为多个;检测信息包括:目标距离以及雷达信号反射量;目标距离为雷达信号反射位置与雷达之间的距离。Step 101: Obtain the detection information of the radar on the terminal device, the number of radars is multiple; the detection information includes: the target distance and the amount of radar signal reflection; the target distance is the distance between the radar signal reflection position and the radar.
在本公开实施例中,如图2所示,可在终端设备显示屏上嵌入多个雷达,人体检测装置可获取终端设备上的雷达的检测信息。其中,雷达的检测信息可包括但不限于目标距离以及雷达信号反射量。其中,目标距离可理解为雷达信号反射位置与雷达之间的距离;雷达信号反射量可理解为雷达信号强度。In the embodiment of the present disclosure, as shown in FIG. 2, multiple radars can be embedded on the display screen of the terminal device, and the human body detection device can obtain the detection information of the radar on the terminal device. Among them, the detection information of the radar may include, but is not limited to, the target distance and the amount of radar signal reflection. Among them, the target distance can be understood as the distance between the radar signal reflection position and the radar; the radar signal reflection amount can be understood as the radar signal strength.
需要说明的是,雷达信号反射量可由目标对象对雷达的反射率、反射面积以及目标对象与雷达的距离共同决定。其中,反射面积由目标对象本身的面积和相对于雷达的所在位置决定。比如,目标对象在雷达的侧面,则反射面积相对于该目标对象的位置在雷达正面时减小。另外,不同的目标对象对雷达的反射率不同。在相同反射率和目标距离已知的情况下,反射面积不同,得到的雷达信号反射量不同。比如,人体对雷达的反射率及目标距离已知,人体在雷达的正面时的反射面积大于人体在雷达侧面时的反射面积,对应的,人体在雷达正面时的雷达信号反射量大于人体在雷达侧面时的雷达信号反射量。It should be noted that the amount of radar signal reflection can be jointly determined by the reflectivity of the target object to the radar, the reflection area and the distance between the target object and the radar. Among them, the reflection area is determined by the area of the target object itself and the position relative to the radar. For example, if the target object is on the side of the radar, the reflection area relative to the position of the target object decreases when the position of the target object is on the front of the radar. In addition, different target objects have different reflectivity to radar. In the case of the same reflectivity and the target distance is known, the reflection area is different, and the radar signal reflection amount obtained is different. For example, the reflectivity of the human body to the radar and the target distance are known, and the reflection area of the human body when it is on the front of the radar is greater than the reflection area when the human body is on the side of the radar. The amount of radar signal reflection at the side.
作为一种示例,雷达可为毫米波雷达。需要理解的是,毫米波雷达工作在毫米波段。通常毫米波是指30~300GHz频段(波长为1~10mm)。毫米波的波长介于厘米波和光波之间,因此毫米波兼有微波制导和光电制导的优点。同厘米波导引头相比,毫米波导引头具有体积小、质量轻和空间分辨率高的特点。与红外、激光、电视等光学导引头相比,毫米波导引头穿透雾、烟、灰尘的能力强,具有全天候(大雨天除外)全天时的特点。另外,毫米波导引头的抗干扰能力也优于其他微波导引头。毫米波雷达可穿透塑料、陶瓷等材料,不需打孔,不会破坏产品本身的外观,相较于红外传感器,水平测量角度更大(可达80度以上),测量距离也较远,检测人体时距离可达两米,检测手势时,距离可达一米。As an example, the radar may be a millimeter wave radar. What needs to be understood is that millimeter wave radar works in the millimeter wave band. Usually millimeter wave refers to the 30-300GHz frequency band (wavelength is 1-10mm). The wavelength of millimeter wave is between centimeter wave and light wave, so millimeter wave has the advantages of microwave guidance and photoelectric guidance. Compared with the centimeter waveguide seeker, the millimeter waveguide seeker has the characteristics of small size, light weight and high spatial resolution. Compared with optical seekers such as infrared, laser, and television, the millimeter waveguide seeker has a strong ability to penetrate fog, smoke, and dust, and has the characteristics of all-weather (except heavy rain). In addition, the anti-interference ability of the millimeter waveguide seeker is also better than other microwave seekers. Millimeter-wave radar can penetrate plastics, ceramics and other materials without perforating and will not damage the appearance of the product itself. Compared with infrared sensors, the horizontal measurement angle is larger (up to 80 degrees) and the measurement distance is longer. The distance can be up to two meters when detecting the human body, and up to one meter when detecting hand gestures.
步骤102,根据检测信息以及雷达的位置信息,确定第一目标对象的位置信息,以及第一目标对象的正对反射面积;正对反射面积为第一目标对象正对雷达时的反射面积;第一目标对象为位于雷达信号反射位置的对象。Step 102: Determine the position information of the first target object and the facing reflection area of the first target object according to the detection information and the position information of the radar; the facing reflection area is the reflection area when the first target object is facing the radar; A target object is an object located at the reflection position of the radar signal.
可选地,根据雷达的检测信息中的目标距离、雷达的位置信息以及三定位算法,确定第一目标对象的位置信息;根据雷达的检测信息中的目标距离、雷 达信号反射量、以及预设的反射率,确定雷达对第一目标对象的反射面积;根据雷达对第一目标对象的反射面积、雷达的位置信息以及第一目标对象的位置信息,确定正对反射面积。其中,需要说明的是,第一目标对象可为位于雷达信号反射位置的对象。Optionally, the position information of the first target object is determined according to the target distance in the detection information of the radar, the position information of the radar, and the three positioning algorithm; the position information of the first target object is determined according to the target distance in the detection information of the radar, the amount of radar signal reflection, and the preset Determine the reflection area of the radar to the first target object; determine the facing reflection area according to the reflection area of the radar to the first target object, the position information of the radar, and the position information of the first target object. Among them, it should be noted that the first target object may be an object located at a radar signal reflection position.
举例而言,以雷电的数量是3个为例,如,雷达A、B、C;雷达A、B、C的放置位置s1、s2、s3,为了防止雷达A、B、C信号之间相互干扰,可将雷达A、B、C设置不同的工作时槽。比如,雷达A工作在1、4、7…时槽,雷达B工作在2、5、8…时槽,雷达C工作在3、6、9…时槽,采样频率在10HZ,可根据雷达检测信息获得来自雷达A、B、C,并且在t n+1、t n+2、t n+3时刻的距离目标对象的距离为d1、d2、d3,根据雷达A、B、C的放置位置和雷达距离目标对象的距离,结合三定位算法,确定目标对象的位置s。比如,目标对象的位置s可通过|s-s1|-d1、|s-s2|-d2、|s-s3|-d3的均方值最小时以获取。另外,根据雷达的检测信息中的目标距离、雷达信号反射量、以及预设的反射率,,可获取雷达对该目标对象的反射面积;进一步地,根据目标对象的反射面积、雷达A、B、C的放置位置、目标对象的位置信息,可确定目标对象正对雷达位置的反射面积。 For example, the number of lightning is 3 as an example, such as radar A, B, C; the placement position of radar A, B, C s1, s2, s3, in order to prevent the radar A, B, C signal from each other For interference, radar A, B, and C can be set to different working time slots. For example, radar A works in 1, 4, 7... time slots, radar B works in 2, 5, 8... time slots, radar C works in 3, 6, 9... time slots, and the sampling frequency is 10HZ, which can be detected according to radar The information is obtained from radars A, B, C, and the distance from the target object at t n+1 , t n+2 , t n+3 is d1, d2, d3, according to the placement position of radar A, B, C The distance between the radar and the target object is combined with the three positioning algorithm to determine the position s of the target object. For example, the position s of the target object can be obtained when the mean square value of |s-s1|-d1, |s-s2|-d2, |s-s3|-d3 is the smallest. In addition, according to the target distance, radar signal reflection amount, and preset reflectivity in the detection information of the radar, the reflection area of the radar to the target object can be obtained; further, according to the reflection area of the target object, radar A, B , The placement position of C and the position information of the target object can determine the reflection area of the target object facing the radar position.
作为一种示例,在获得雷达A、B、C的放置位置以及目标对象的位置信息后,可获取雷达与目标对象的方位信息。比如,获取终端设备显示屏上雷达A通过目标对象的垂直线,并将该垂直线作为法线;接着,获取雷达A与目标对象的连接线与该法线的夹角;另外,在本公开实施例中,可预先获取雷达正对目标对象的反射面积与雷达侧向(有夹角)目标对象的反射面积之间的关系,因此,已知雷达A对该目标对象的反射面积与雷达A与目标对象的连接线与法线的夹角,通过雷达A正对目标对象的反射面积与雷达A侧向(有夹 角)目标对象的反射面积之间的关系换算,即可得到目标对象正对雷达A的反射面积;同理,可获取目标对象正对雷达B和正对雷达C的反射面积;最后,将目标对象正对雷达A、B、C的反射面积进行平均取值,即可确定目标对象正对雷达位置的反射面积。As an example, after obtaining the placement positions of the radars A, B, and C and the position information of the target object, the azimuth information of the radar and the target object can be obtained. For example, obtain the vertical line of radar A passing through the target object on the display screen of the terminal device, and use the vertical line as the normal; then, obtain the angle between the connecting line of radar A and the target object and the normal; in addition, in the present disclosure In the embodiment, the relationship between the reflection area of the radar facing the target object and the reflection area of the radar lateral (with an angle) target object can be obtained in advance. Therefore, it is known that the reflection area of the radar A on the target object is the same as that of the radar A. The angle between the connecting line and the normal of the target object is converted by the relationship between the reflection area of the radar A facing the target object and the reflection area of the radar A side (with an angle) target object, and the target object can be obtained. For the reflection area of radar A; in the same way, the reflection area of the target object facing radar B and radar C can be obtained; finally, the reflection area of the target object facing radar A, B, and C is averaged to determine The reflective area of the target object facing the radar position.
步骤103,根据正对反射面积,确定第一目标对象是否为人体。Step 103: Determine whether the first target object is a human body according to the facing reflection area.
可选地,如图3所示,可将正对反射面积与预设的面积阈值进行比对,通过比对结果并根据目标对象的静止时间是否大于第一时间阈值,进而确定目标对象是否为人体。具体实现过程如下:Optionally, as shown in FIG. 3, the frontal reflection area can be compared with a preset area threshold. According to the comparison result and whether the stationary time of the target object is greater than the first time threshold, it is determined whether the target object is human body. The specific implementation process is as follows:
步骤301,判断正对反射面积是否位于预设的面积阈值范围内,以及第一目标对象的静止时间是否大于第一时间阈值。Step 301: Determine whether the facing reflection area is within a preset area threshold, and whether the static time of the first target object is greater than the first time threshold.
步骤302,若正对反射面积位于预设的面积阈值范围内,且第一目标对象的静止时间小于等于第一时间阈值,则确定第一目标对象为人体。Step 302: If the facing reflection area is within the preset area threshold range, and the static time of the first target object is less than or equal to the first time threshold, it is determined that the first target object is a human body.
步骤303,若正对反射面积位于预设的面积阈值范围内,且第一目标对象的静止时间大于第一时间阈值,则确定第一目标对象为非人体。Step 303: If the facing reflection area is within the preset area threshold range, and the static time of the first target object is greater than the first time threshold, it is determined that the first target object is a non-human body.
步骤304,若正对反射面积位于预设的面积阈值范围外,则确定第一目标对象为非人体。Step 304: If the facing reflection area is outside the preset area threshold range, it is determined that the first target object is a non-human body.
在本公开实施例中,可将正对反射面积与预设的面积阈值、目标对象的静止时间与第一时间阈值进行比对,若正对反射面积位于预设面积的阈值范围内,并且目标对象的静止时间小于或等于第一时间阈值,可确定该目标对象为人体;若正对反射面积位于预设的面积阈值范围内,并且目标对象的静止时间大于第一时间阈值,则确定该目标对象为非人体;若正对反射面积位于预设面积的阈值范围外,比如,反射面积大于预设的面积的阈值的上限或者小于预设的面积的阈值的下限,则确定目标对象为非人体。In the embodiment of the present disclosure, the frontal reflection area can be compared with the preset area threshold, and the stationary time of the target object with the first time threshold. If the frontal reflection area is within the threshold range of the preset area, and the target If the stationary time of the object is less than or equal to the first time threshold, it can be determined that the target object is a human body; if the facing reflection area is within the preset area threshold range, and the stationary time of the target object is greater than the first time threshold, the target can be determined The object is a non-human body; if the facing reflection area is outside the threshold range of the preset area, for example, the reflection area is greater than the upper limit of the preset area threshold or less than the lower limit of the preset area threshold, then the target object is determined to be non-human .
综上,通过雷达的检测信息、位置信息和目标对象的位置信息,根据正对反射面积,可准确判断当前目标对象是否为人体。In summary, based on the detection information, location information, and location information of the target object from the radar, it can be accurately determined whether the current target object is a human body based on the facing reflection area.
为了使得人体检测装置更加智能化,在本公开实施例中,在确定目标对象为人体时,可根据正对反射面积确定人体的年龄阶段。其中,年龄阶段可包括但不限于成人、儿童等。比如,目标对象的身高越高,对应的正对反射面积越大,可将目标对象的身高对应的正对反射面积与1.2米身高对应的正对反射面积进行比对,当目标对象的身高对应的正对反射面积大于1.2米身高对应的正对反射面积时,将该目标对象的年龄阶段确定为成人;当目标对象的身高对应的正对反射面积小于或等于1.2米身高对应的正对反射面积时,将该目标对象的年龄阶段确定为儿童。In order to make the human body detection device more intelligent, in the embodiments of the present disclosure, when the target object is determined to be a human body, the age stage of the human body can be determined according to the front reflection area. Among them, the age stage may include, but is not limited to, adults, children, and so on. For example, the higher the height of the target object, the larger the corresponding front reflection area. The front reflection area corresponding to the height of the target object can be compared with the front reflection area corresponding to the height of 1.2 meters. When the height of the target object corresponds When the front reflection area of the target object is greater than the front reflection area corresponding to the height of 1.2 meters, the age stage of the target object is determined as an adult; when the height of the target object corresponds to the front reflection area is less than or equal to the front reflection area corresponding to the height of 1.2 meters In the case of area, the age of the target object is determined to be a child.
进一步地,为了防止儿童注视终端显示屏时间过长,保护儿童视力,作为一种示例,在响应于确定人体的年龄阶段为儿童,可获取儿童注视终端设备显示屏的时间长度,当响应于时间长度大于第二时间阈值(比如,2分钟),终端设备显示屏出现提示信息,提示儿童停止注视操作,并开始计时,响应于计时时长大于第三时间阈值时(比如,1分钟),儿童仍然没有停止注视操作,此时,终端设备的显示屏停止显示操作。作为另一种示例,在确定人体的年龄阶段为儿童时,可通过雷达的检测信息确定终端显示屏与儿童的距离,当儿童距离终端设备显示屏的距离过近时,终端设备显示屏出现提示信息,提示儿童距离终端显示屏距离过近,并开始计时,在计时时长大于第三阈值时,儿童距离终端显示屏距离仍然过近,此时,终端设备的显示屏停止显示操作。Further, in order to prevent children from staring at the terminal display screen for too long and protect children’s eyesight, as an example, in response to determining the age of the human body as a child, the length of time the child stares at the terminal device display screen can be obtained. If the length is greater than the second time threshold (e.g., 2 minutes), a prompt message appears on the terminal device display screen, prompting the child to stop the gaze operation and start timing. In response to the timing duration greater than the third time threshold (e.g., 1 minute), the child is still The gaze operation is not stopped. At this time, the display screen of the terminal device stops displaying the operation. As another example, when determining the age of the human body as a child, the detection information of the radar can be used to determine the distance between the terminal display and the child. When the child is too close to the terminal device display, a prompt appears on the terminal device display The message prompts that the child is too close to the terminal display screen and starts timing. When the timing duration is greater than the third threshold, the child is still too close to the terminal display screen. At this time, the terminal device display screen stops displaying operations.
为了更好地进行人机交互,在本公开实施例中,如图4所示,根据正对反射面积,确定第一目标对象为人体之后,可通过实时跟踪目标对象,并根据雷达检测信息确定目标对象的手部,进而确定目标对象的手势,具体实现过程如 下:In order to better perform human-computer interaction, in the embodiment of the present disclosure, as shown in FIG. 4, after the first target object is determined to be a human body according to the frontal reflection area, the target object can be tracked in real time and determined according to radar detection information. The hand of the target object, and then determine the gesture of the target object, the specific implementation process is as follows:
步骤401,在第一目标对象为人体时,实时跟踪第一目标对象,并获取终端设备上雷达的检测信息,确定第二目标对象的位置信息。Step 401: When the first target object is a human body, the first target object is tracked in real time, and the detection information of the radar on the terminal device is acquired, and the position information of the second target object is determined.
在本公开实施例中,在第一目标对象为人体时,对第一目标对象进行实时跟踪检测,在检测到第二目标对象时,可根据雷达的放置位置和雷达距离所述第二目标对象的距离,确定第二目标对象的位置信息。然后根据第二目标对象与第一目标对象的距离,确定第二目标对象是人体部位还是非人体部位,作为一种示例,第二目标对象与第一目标对象的距离在预设范围内(如,20厘米),确定第二目标对象是人体部位。In the embodiment of the present disclosure, when the first target object is a human body, the first target object is tracked and detected in real time. When the second target object is detected, the second target object can be detected according to the placement position of the radar and the distance from the radar. The distance to determine the position information of the second target object. Then, according to the distance between the second target object and the first target object, it is determined whether the second target object is a human body part or a non-human body part. As an example, the distance between the second target object and the first target object is within a preset range (such as , 20 cm), determine that the second target object is a human body part.
步骤402,根据第二目标对象的位置信息,确定第二目标对象是否为第一目标对象的手部。Step 402: Determine whether the second target object is the hand of the first target object according to the position information of the second target object.
可选地,根据第二目标对象的位置信息以及跟踪的第一目标对象的位置信息,确定第二目标对象与第一目标对象之间的距离;判断第二目标对象与第一目标对象之间的距离是否大于预设距离阈值;响应于距离小于等于预设距离阈值,确定第二目标对象为第一目标对象的手部。Optionally, determine the distance between the second target object and the first target object according to the position information of the second target object and the tracked position information of the first target object; determine the distance between the second target object and the first target object Whether the distance of is greater than the preset distance threshold; in response to the distance being less than or equal to the preset distance threshold, it is determined that the second target object is the hand of the first target object.
也就是说,可将跟踪的第一目标对象的位置信息与第二目标对象的位置信息进行比对,并将比对结果作为第二目标对象与第一目标对象之间的距离;接着,将第二目标对象与第一目标对象之间的距离与预设距离阈值(如,手臂长度)进行比对,在距离小于或等于预设距离阈值时,确定第二目标对象为第一目标对象的手部。In other words, the position information of the tracked first target object can be compared with the position information of the second target object, and the comparison result can be used as the distance between the second target object and the first target object; The distance between the second target object and the first target object is compared with a preset distance threshold (for example, arm length). When the distance is less than or equal to the preset distance threshold, the second target object is determined to be the first target object's distance. hand.
步骤403,在第二目标对象为第一目标对象的手部时,实时跟踪第二目标对象,根据第二目标对象的位置信息的变化情况,确定手部的手势。Step 403: When the second target object is the hand of the first target object, track the second target object in real time, and determine the hand gesture according to the change of the position information of the second target object.
在本公开实施例中,如图5所示,在确定第二目标对象为人体手部时,可 通过实时跟踪监测手部的运动,根据三定位法,可以判断用户的三维手势。作为一种示例,如果手掌从左向右移动,则判定为右向手势;如果从右向左移动,则判定为左向手势;如果手掌从上向下移动,则判定为上向手势;如果手掌从下向上移动,则判定为下向手势;如果手掌从前向后移动,则判定为前向手势;如果手掌从后向前移动,则判定为后向手势。In the embodiment of the present disclosure, as shown in FIG. 5, when it is determined that the second target object is a human hand, the movement of the hand can be tracked and monitored in real time, and the user's three-dimensional gesture can be judged according to the three-positioning method. As an example, if the palm moves from left to right, it is judged as a rightward gesture; if it moves from right to left, it is judged as a leftward gesture; if the palm moves from top to bottom, it is judged as an upward gesture; if If the palm moves from bottom to top, it is judged as a downward gesture; if the palm moves from front to back, it is judged as a forward gesture; if the palm moves from back to front, it is judged as a backward gesture.
为了防止手势回带时出现误判,在确定手势之后,可根据手势,确定对终端设备的控制操作;在根据控制操作对终端设备进行控制时,开始进行计时,响应于计时时长大于第四时间阈值,重新获取终端设备上雷达的检测信息,确定第二目标对象的位置信息,确定手部的手势。也就是说,终端设备根据该手势进行相应控制后,在该控制操作后至少间隔第四时间阈值后再响应下一个手势指令,对在第四时间阈值内给出的手势不进行响应。In order to prevent misjudgment when the gesture is brought back, after the gesture is determined, the control operation of the terminal device can be determined according to the gesture; when the terminal device is controlled according to the control operation, the timing is started, in response to the timing duration being greater than the fourth time Threshold, re-acquire the detection information of the radar on the terminal device, determine the position information of the second target object, and determine the hand gesture. That is, after the terminal device performs corresponding control according to the gesture, it responds to the next gesture instruction after at least the fourth time threshold after the control operation, and does not respond to the gesture given within the fourth time threshold.
本公开实施例的人体检测方法,通过获取终端设备上雷达的检测信息,所述雷达的数量为多个;所述检测信息包括:目标距离以及雷达信号反射量;目标距离为雷达信号反射位置与雷达之间的距离;根据检测信息以及雷达的位置信息,确定第一目标对象的位置信息,以及第一目标对象的正对反射面积;所述正对反射面积为所述第一目标对象正对所述雷达时的反射面积;第一目标对象为位于雷达信号反射位置的对象;根据正对反射面积,确定第一目标对象是否为人体。该方法通过雷达的检测信息、位置信息和目标对象的位置信息,根据正对反射面积,可准确判断当前目标对象是否为人体,并且在当前目标对象为人体时,可进一步确认人体手势进行人机交互,同时区分人体的年龄阶段,并在年龄阶段为儿童时,进行视力保护。According to the human body detection method of the embodiment of the present disclosure, the detection information of the radar on the terminal device is obtained, and the number of the radar is multiple; the detection information includes: the target distance and the radar signal reflection amount; the target distance is the radar signal reflection position and The distance between the radars; according to the detection information and the position information of the radar, the position information of the first target object and the front reflection area of the first target object are determined; the front reflection area is the first target object directly facing The reflection area at the time of the radar; the first target object is an object located at the reflection position of the radar signal; according to the facing reflection area, it is determined whether the first target object is a human body. This method can accurately determine whether the current target object is a human body based on the detection information, position information and target object position information of the radar, and according to the frontal reflection area, and when the current target object is a human body, it can further confirm that the human body gesture is performed on the human machine. Interaction, while distinguishing the age stage of the human body, and protect the eyesight when the age stage is a child.
与上述几种实施例提供的人体检测方法相对应,本公开的一种实施例还提供一种人体检测装置,由于本公开实施例提供的人体检测装置与上述几种实施 例提供的人体检测方法相对应,因此在前述对人体检测方法的实施方式也适用于本实施例提供的人体检测装置,在本实施例中不再详细描述。图6为根据本公开一个实施例的人体检测装置的结构示意图。如图6所示,该人体检测装置包括:获取模块610、确定模块620。Corresponding to the human body detection methods provided by the above several embodiments, an embodiment of the present disclosure also provides a human body detection device, because the human body detection device provided by the embodiment of the present disclosure is different from the human body detection method provided by the above several embodiments. Correspondingly, therefore, the foregoing implementation of the human body detection method is also applicable to the human body detection device provided in this embodiment, and will not be described in detail in this embodiment. Fig. 6 is a schematic structural diagram of a human body detection device according to an embodiment of the present disclosure. As shown in FIG. 6, the human body detection device includes: an acquisition module 610 and a determination module 620.
其中,获取模块610,用于获取终端设备上雷达的检测信息,雷达的数量为多个;检测信息包括:目标距离以及雷达信号反射量;目标距离为雷达信号反射位置与所述雷达之间的距离;确定模块620,用于根据检测信息以及雷达的位置信息,确定第一目标对象的位置信息,以及第一目标对象的正对反射面积;正对反射面积为第一目标对象正对雷达时的反射面积;第一目标对象为位于所述雷达信号反射位置的对象;确定模块620,还用于根据正对反射面积,确定第一目标对象是否为人体。Wherein, the acquisition module 610 is used to acquire the detection information of the radar on the terminal device, the number of radars is multiple; the detection information includes: the target distance and the amount of radar signal reflection; the target distance is the distance between the radar signal reflection position and the radar Distance; determining module 620, used to determine the position information of the first target object and the front reflection area of the first target object according to the detection information and the position information of the radar; the front reflection area is when the first target object is facing the radar The first target object is an object located at the reflection position of the radar signal; the determining module 620 is further configured to determine whether the first target object is a human body according to the facing reflection area.
本公开实施例的人体检测装置,通过获取终端设备上雷达的检测信息,雷达的数量为多个;检测信息包括:目标距离以及雷达信号反射量;目标距离为雷达信号反射位置与雷达之间的距离;根据检测信息以及雷达的位置信息,确定第一目标对象的位置信息,以及第一目标对象的正对反射面积;正对反射面积为所述第一目标对象正对雷达时的反射面积;第一目标对象为位于雷达信号反射位置的对象;根据正对反射面积,确定第一目标对象是否为人体,该装置可实现通过雷达的检测信息、位置信息和目标对象的位置信息,根据正对反射面积,可准确判断当前目标对象是否为人体,并且在当前目标对象为人体时,可进一步确认人体手势进行人机交互,同时区分人体的年龄阶段,并在年龄阶段为儿童时,进行视力保护。The human body detection device of the embodiment of the present disclosure acquires the detection information of the radar on the terminal device, and the number of radars is multiple; the detection information includes: the target distance and the amount of radar signal reflection; the target distance is the distance between the radar signal reflection position and the radar Distance; determine the position information of the first target object and the front reflection area of the first target object according to the detection information and the position information of the radar; the front reflection area is the reflection area when the first target object is facing the radar; The first target object is the object at the reflection position of the radar signal; according to the facing reflection area, it is determined whether the first target object is a human body. The device can realize the detection information, position information and position information of the target object through the radar. The reflection area can accurately determine whether the current target object is a human body, and when the current target object is a human body, it can further confirm human body gestures for human-computer interaction, while distinguishing the age of the human body, and protect the eyesight when the age is a child .
为了实现上述实施例,本公开还提出一种终端设备,如图7所示,图7为根据本公开一个实施例的终端设备结构示意图。该终端设备700包括:终端 设备本体710,以及位于终端设备本体内的雷达720和处理器730。In order to implement the above-mentioned embodiment, the present disclosure also proposes a terminal device, as shown in FIG. 7, which is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure. The terminal device 700 includes a terminal device body 710, a radar 720 and a processor 730 located in the terminal device body.
其中,雷达的数量为多个;处理器730与雷达720连接,用于执行如上实施例所述的人体检测方法。The number of radars is multiple; the processor 730 is connected to the radar 720 and is used to execute the human body detection method described in the above embodiment.
为了实现上述实施例,本公开还提出一种非临时性计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如上所述的人体检测方法。In order to implement the above-mentioned embodiments, the present disclosure also proposes a non-transitory computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the above-mentioned human body detection method is realized.
为了实现上述实施例,本公开还提出一种电子设备,如图8所示,图8为根据本公开一个实施例的电子设备结构示意图。该电子设备包括:In order to implement the above-mentioned embodiment, the present disclosure also proposes an electronic device, as shown in FIG. 8, which is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. The electronic equipment includes:
存储器1001、处理器1002及存储在存储器1001上并可在处理器1002上运行的计算机指令。The memory 1001, the processor 1002, and computer instructions that are stored on the memory 1001 and can run on the processor 1002.
处理器1002执行所述指令时实现上述实施例中提供的人体检测方法。The processor 1002 implements the human body detection method provided in the foregoing embodiment when executing the instruction.
进一步地,电子设备还包括:Further, the electronic equipment also includes:
通信接口1003,用于存储器1001和处理器1002之间的通信。The communication interface 1003 is used for communication between the memory 1001 and the processor 1002.
存储器1001,用于存放可在处理器1002上运行的计算机指令。The memory 1001 is used to store computer instructions that can run on the processor 1002.
存储器1001可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。The memory 1001 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), for example, at least one disk memory.
处理器1002,用于执行所述程序时实现上述实施例所述的人体检测方法。The processor 1002 is configured to implement the human body detection method described in the foregoing embodiment when executing the program.
如果存储器1001、处理器1002和通信接口1003独立实现,则通信接口1003、存储器1001和处理器1002可以通过总线相互连接并完成相互间的通信。所述总线可以是工业标准体系结构(Industry Standard Architecture,简称为ISA)总线、外部设备互连(Peripheral Component,简称为PCI)总线或扩展工业标准体系结构(Extended Industry Standard Architecture,简称为EISA)总线等。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示,图8中仅 用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。If the memory 1001, the processor 1002, and the communication interface 1003 are implemented independently, the communication interface 1003, the memory 1001, and the processor 1002 can be connected to each other through a bus and complete mutual communication. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. Wait. The bus can be divided into an address bus, a data bus, a control bus, and so on. For ease of representation, only one thick line is used in Figure 8, but it does not mean that there is only one bus or one type of bus.
可选的,在具体实现上,如果存储器1001、处理器1002及通信接口1003,集成在一块芯片上实现,则存储器1001、处理器1002及通信接口1003可以通过内部接口完成相互间的通信。Optionally, in specific implementation, if the memory 1001, the processor 1002, and the communication interface 1003 are integrated on a single chip, the memory 1001, the processor 1002, and the communication interface 1003 can communicate with each other through internal interfaces.
处理器1002可能是一个中央处理器(Central Processing Unit,简称为CPU),或者是特定集成电路(Application Specific Integrated Circuit,简称为ASIC),或者是被配置成实施本公开实施例的一个或多个集成电路。The processor 1002 may be a central processing unit (Central Processing Unit, referred to as CPU), or a specific integrated circuit (Application Specific Integrated Circuit, referred to as ASIC), or configured to implement one or more of the embodiments of the present disclosure integrated circuit.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本公开的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , Structures, materials, or characteristics are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples and the features of the different embodiments or examples described in this specification without contradicting each other.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本公开的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本公开的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式 或按相反的顺序,来执行功能,这应被本公开的实施例所属技术领域的技术人员所理解。Any process or method description in the flowchart or described in other ways herein can be understood as a module, segment or part of code that includes one or more executable instructions for implementing custom logic functions or steps of the process , And the scope of the preferred embodiments of the present disclosure includes additional implementations, which may not be in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved. This should It is understood by those skilled in the art to which the embodiments of the present disclosure belong.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行***、装置或设备(如基于计算机的***、包括处理器的***或其他可以从指令执行***、装置或设备取指令并执行指令的***)使用,或结合这些指令执行***、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行***、装置或设备或结合这些指令执行***、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowchart or described in other ways herein, for example, can be considered as a sequenced list of executable instructions for realizing logic functions, and can be embodied in any computer-readable medium, For use by instruction execution systems, devices, or equipment (such as computer-based systems, systems including processors, or other systems that can fetch and execute instructions from instruction execution systems, devices, or equipment), or combine these instruction execution systems, devices Or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transmit a program for use by an instruction execution system, device, or device or in combination with these instruction execution systems, devices, or devices. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because it can be used, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable media if necessary. The program is processed in a manner to obtain the program electronically, and then stored in the computer memory.
应当理解,本公开的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行***执行的软件或固件来实现。如,如果用硬件来实现和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA) 等。It should be understood that each part of the present disclosure can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: Discrete logic gate circuits with logic functions for data signals Logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate array (PGA), field programmable gate array (FPGA), etc.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。A person of ordinary skill in the art can understand that all or part of the steps carried in the method of the foregoing embodiments can be implemented by a program instructing relevant hardware to complete. The program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. When executed, it includes one of the steps of the method embodiment or a combination thereof.
此外,在本公开各个实施例中的各功能单元可以集成在一个处理器中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In addition, the functional units in the various embodiments of the present disclosure may be integrated into one processor, or each unit may exist alone physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium.
上述提到的存储介质可以是只读存储器,磁盘或光盘等。尽管上面已经示出和描述了本公开的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本公开的限制,本领域的普通技术人员在本公开的范围内可以对上述实施例进行变化、修改、替换和变型。The aforementioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above-mentioned embodiments are exemplary and should not be construed as limiting the present disclosure. Those of ordinary skill in the art can comment on the foregoing within the scope of the present disclosure. The embodiment undergoes changes, modifications, substitutions, and modifications.

Claims (13)

  1. 一种人体检测方法,包括:A human body detection method, including:
    获取终端设备上雷达的检测信息,所述雷达的数量为多个;所述检测信息包括:目标距离以及雷达信号反射量;所述目标距离为雷达信号反射位置与所述雷达之间的距离;Obtain the detection information of the radar on the terminal device, the number of the radar is multiple; the detection information includes: the target distance and the radar signal reflection amount; the target distance is the distance between the radar signal reflection position and the radar;
    根据所述检测信息以及所述雷达的位置信息,确定第一目标对象的位置信息,以及所述第一目标对象的正对反射面积;所述正对反射面积为所述第一目标对象正对所述雷达时的反射面积;所述第一目标对象为位于所述雷达信号反射位置的对象;According to the detection information and the position information of the radar, the position information of the first target object and the facing reflection area of the first target object are determined; the facing reflection area is the first target object facing directly The reflection area of the radar; the first target object is an object located at the reflection position of the radar signal;
    根据所述正对反射面积,确定所述第一目标对象是否为人体。According to the facing reflection area, it is determined whether the first target object is a human body.
  2. 根据权利要求1所述的方法,所述根据所述正对反射面积,确定所述第一目标对象是否为人体之后,还包括:The method according to claim 1, after determining whether the first target object is a human body according to the facing reflection area, the method further comprises:
    在所述第一目标对象为人体时,实时跟踪所述第一目标对象,并获取终端设备上雷达的检测信息,确定第二目标对象的位置信息;When the first target object is a human body, tracking the first target object in real time, and acquiring radar detection information on a terminal device to determine the position information of the second target object;
    根据所述第二目标对象的位置信息,确定所述第二目标对象是否为所述第一目标对象的手部;Determine whether the second target object is the hand of the first target object according to the position information of the second target object;
    在所述第二目标对象为所述第一目标对象的手部时,实时跟踪所述第二目标对象,根据所述第二目标对象的位置信息的变化情况,确定所述手部的手势。When the second target object is the hand of the first target object, the second target object is tracked in real time, and the gesture of the hand is determined according to the change of the position information of the second target object.
  3. 根据权利要求1所述的方法,所述根据所述检测信息以及所述雷达的位置信息,确定第一目标对象的位置信息,以及所述第一目标对象的正对反射面积,包括:The method according to claim 1, wherein the determining the position information of the first target object and the front reflection area of the first target object according to the detection information and the position information of the radar comprises:
    根据所述雷达的检测信息中的目标距离、所述雷达的位置信息以及三定位 算法,确定所述第一目标对象的位置信息;Determine the position information of the first target object according to the target distance in the detection information of the radar, the position information of the radar, and a three-positioning algorithm;
    根据所述雷达的检测信息中的目标距离、所述雷达信号反射量、以及预设的反射率,确定所述雷达对所述第一目标对象的反射面积;Determine the reflection area of the radar to the first target object according to the target distance in the detection information of the radar, the reflection amount of the radar signal, and the preset reflectivity;
    根据所述雷达对所述第一目标对象的反射面积、所述雷达的位置信息、所述第一目标对象的位置信息,确定所述正对反射面积。The facing reflection area is determined according to the reflection area of the radar to the first target object, the position information of the radar, and the position information of the first target object.
  4. 根据权利要求1所述的方法,所述根据所述正对反射面积,确定所述第一目标对象是否为人体,包括:The method according to claim 1, wherein the determining whether the first target object is a human body according to the facing reflection area comprises:
    判断所述正对反射面积是否位于预设的面积阈值范围内,以及所述第一目标对象的静止时间是否大于第一时间阈值;Judging whether the facing reflection area is within a preset area threshold range, and whether the static time of the first target object is greater than a first time threshold;
    若所述正对反射面积位于预设的面积阈值范围内,且所述第一目标对象的静止时间小于等于第一时间阈值,则确定所述第一目标对象为人体;If the facing reflection area is within the preset area threshold range, and the static time of the first target object is less than or equal to the first time threshold, determining that the first target object is a human body;
    若所述正对反射面积位于预设的面积阈值范围内,且所述第一目标对象的静止时间大于第一时间阈值,则确定所述第一目标对象为非人体;If the facing reflection area is within a preset area threshold range, and the static time of the first target object is greater than the first time threshold, determining that the first target object is a non-human body;
    若所述正对反射面积位于预设的面积阈值范围外,则确定所述第一目标对象为非人体。If the facing reflection area is outside the preset area threshold range, it is determined that the first target object is a non-human body.
  5. 根据权利要求1-4任一项所述的方法,所述根据所述正对反射面积,确定所述第一目标对象是否为人体之后,还包括:The method according to any one of claims 1-4, after determining whether the first target object is a human body according to the facing reflection area, the method further comprises:
    响应于确定所述第一目标对象为人体,根据所述正对反射面积确定所述人体的年龄阶段。In response to determining that the first target object is a human body, the age stage of the human body is determined according to the facing reflection area.
  6. 根据权利要求5所述的方法,所述响应于确定所述第一目标对象为人体,根据所述正对反射面积确定所述人体的年龄阶段之后,还包括:The method according to claim 5, wherein in response to determining that the first target object is a human body, after determining the age stage of the human body according to the facing reflection area, the method further comprises:
    响应于确定所述人体的年龄阶段为儿童,获取所述第一目标对象注视所述终端设备的时间长度;In response to determining that the age stage of the human body is a child, acquiring the length of time that the first target object looks at the terminal device;
    响应于所述时间长度大于第二时间阈值,提示所述第一目标对象停止注视操作并进行计时;In response to the time length being greater than the second time threshold, prompting the first target object to stop the gaze operation and timing;
    响应于计时时长大于第三时间阈值,控制所述终端设备的显示屏停止显示操作。In response to the timing duration being greater than the third time threshold, the display screen of the terminal device is controlled to stop the display operation.
  7. 根据权利要求2所述的方法,所述根据所述第二目标对象的位置信息,确定所述第二目标对象是否为所述第一目标对象的手部,包括:The method according to claim 2, wherein the determining whether the second target object is the hand of the first target object according to the position information of the second target object comprises:
    根据所述第二目标对象的位置信息以及跟踪的所述第一目标对象的位置信息,确定所述第二目标对象与所述第一目标对象之间的距离;Determine the distance between the second target object and the first target object according to the position information of the second target object and the tracked position information of the first target object;
    判断所述第二目标对象与所述第一目标对象之间的距离是否大于预设距离阈值;Judging whether the distance between the second target object and the first target object is greater than a preset distance threshold;
    响应于所述距离小于等于所述预设距离阈值,确定所述第二目标对象为所述第一目标对象的手部。In response to the distance being less than or equal to the preset distance threshold, it is determined that the second target object is the hand of the first target object.
  8. 根据权利要求2所述的方法,确定所述手部的手势之后,还包括:The method according to claim 2, after determining the hand gesture, further comprising:
    根据所述手势,确定对所述终端设备的控制操作;Determine a control operation on the terminal device according to the gesture;
    根据所述控制操作对所述终端设备进行控制,并从确定所述控制操作开始进行计时;响应于计时时长大于第四时间阈值,重新获取终端设备上雷达的检测信息,确定第二目标对象的位置信息,确定所述手部的手势。Control the terminal device according to the control operation, and start timing from the determination of the control operation; in response to the timing duration being greater than the fourth time threshold, reacquire the radar detection information on the terminal device to determine the second target object The position information determines the gesture of the hand.
  9. 根据权利要求1-8任一项所述的方法,所述雷达为毫米波雷达。The method according to any one of claims 1-8, wherein the radar is a millimeter wave radar.
  10. 一种人体检测装置,包括:A human body detection device includes:
    获取模块,用于获取终端设备上雷达的检测信息,所述雷达的数量为多个;所述检测信息包括:目标距离以及雷达信号反射量;所述目标距离为雷达信号反射位置与所述雷达之间的距离;The acquisition module is used to acquire the detection information of the radar on the terminal device, the number of the radar is multiple; the detection information includes: the target distance and the radar signal reflection amount; the target distance is the radar signal reflection position and the radar the distance between;
    确定模块,用于根据所述检测信息以及所述雷达的位置信息,确定第一目 标对象的位置信息,以及所述第一目标对象的正对反射面积;所述正对反射面积为所述第一目标对象正对所述雷达时的反射面积;所述第一目标对象为位于所述雷达信号反射位置的对象;The determining module is configured to determine the position information of the first target object and the facing reflection area of the first target object according to the detection information and the position information of the radar; the facing reflection area is the first The reflection area when a target object is directly facing the radar; the first target object is an object located at a reflection position of the radar signal;
    所述确定模块,还用于根据所述正对反射面积,确定所述第一目标对象是否为人体。The determining module is further configured to determine whether the first target object is a human body according to the facing reflection area.
  11. 一种终端设备,包括:A terminal device, including:
    终端设备本体,以及位于所述终端设备本体内的雷达和处理器;所述雷达的数量为多个;The terminal device body, and the radar and the processor located in the terminal device body; the number of the radar is multiple;
    所述处理器与所述雷达连接,用于执行如权利要求1-9中任一项所述的人体检测方法。The processor is connected to the radar, and is configured to execute the human body detection method according to any one of claims 1-9.
  12. 一种非临时性计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现如权利要求1-9中任一所述的人体检测方法。A non-temporary computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the human body detection method according to any one of claims 1-9 is realized.
  13. 一种电子设备,包括:存储器,处理器;所述存储器中存储有计算机指令,当所述计算机指令被所述处理器执行时,实现如权利要求1-9中任一所述的人体检测方法。An electronic device, comprising: a memory and a processor; the memory is stored with computer instructions, and when the computer instructions are executed by the processor, the human body detection method according to any one of claims 1-9 is implemented .
PCT/CN2020/074286 2020-01-20 2020-02-04 Human detection method and apparatus, terminal device, storage medium, and electronic device WO2021147122A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010066140.4 2020-01-20
CN202010066140.4A CN111308463B (en) 2020-01-20 2020-01-20 Human body detection method and device, terminal equipment, storage medium and electronic equipment

Publications (1)

Publication Number Publication Date
WO2021147122A1 true WO2021147122A1 (en) 2021-07-29

Family

ID=71156429

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/074286 WO2021147122A1 (en) 2020-01-20 2020-02-04 Human detection method and apparatus, terminal device, storage medium, and electronic device

Country Status (2)

Country Link
CN (1) CN111308463B (en)
WO (1) WO2021147122A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115092785A (en) * 2022-06-21 2022-09-23 无锡威孚高科技集团股份有限公司 Millimeter wave radar-based early warning method and system for children to enter and exit elevator car independently
WO2023246121A1 (en) * 2022-06-22 2023-12-28 青岛海尔空调器有限总公司 Indoor unit control method and device, and air conditioner

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111766576B (en) * 2020-06-29 2023-12-26 京东方科技集团股份有限公司 Conference personnel arrangement method based on millimeter wave radar detection and related equipment
CN112485779B (en) * 2020-11-13 2023-09-08 珠海格力电器股份有限公司 Radar power control method, radar power control device, electronic equipment and computer readable medium
CN112485782A (en) * 2020-11-24 2021-03-12 京东方科技集团股份有限公司 Sitting posture monitoring method and device, electronic equipment and readable storage medium
CN113687350B (en) * 2021-08-24 2024-04-05 杭州海康威视数字技术股份有限公司 Fall detection method and device, electronic equipment and storage medium
CN115059990A (en) * 2022-03-01 2022-09-16 北京小米移动软件有限公司 Air conditioner control method and device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102058411A (en) * 2010-10-27 2011-05-18 中国人民解放军第四军医大学 UVB based multi-channel radar life detection instrument
CN106231419A (en) * 2016-08-30 2016-12-14 北京小米移动软件有限公司 Operation performs method and device
CN109856617A (en) * 2019-01-24 2019-06-07 珠海格力电器股份有限公司 Image pickup method, device, processor and terminal based on microwave radar
US20190205903A1 (en) * 2014-02-25 2019-07-04 Nec Corporation Information-processing device, data analysis method, and recording medium
CN110290353A (en) * 2019-06-28 2019-09-27 Oppo广东移动通信有限公司 Monitoring method and device, electronic equipment and storage medium
CN110412378A (en) * 2019-07-30 2019-11-05 北京经纬恒润科技有限公司 Target object detection method and device

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPR301401A0 (en) * 2001-02-09 2001-03-08 Commonwealth Scientific And Industrial Research Organisation Lidar system and method
JP3730956B2 (en) * 2002-12-11 2006-01-05 本田技研工業株式会社 Axis adjusting device for transmitter / receiver for moving body
JP4258328B2 (en) * 2003-09-12 2009-04-30 オムロン株式会社 Two-frequency Doppler distance measuring device and detection system provided with the device
WO2007041295A2 (en) * 2005-09-30 2007-04-12 Irobot Corporation Companion robot for personal interaction
CN102190081B (en) * 2010-03-04 2013-09-04 南京航空航天大学 Vision-based fixed point robust control method for airship
CN102306285B (en) * 2011-08-15 2013-07-17 北京北大千方科技有限公司 Human shape recognition method
JP5929675B2 (en) * 2012-09-28 2016-06-08 株式会社デンソーウェーブ Laser radar equipment
JP6136524B2 (en) * 2013-04-23 2017-05-31 株式会社デンソー Radar apparatus and inspection system
KR102417610B1 (en) * 2016-03-03 2022-07-07 삼성전자주식회사 Method and apparatus for reading code using short range mmwave radar
JP6825835B2 (en) * 2016-07-07 2021-02-03 日本無線株式会社 Radar traffic measuring device and method
US10816658B2 (en) * 2016-09-07 2020-10-27 OmniPreSense Corporation Radar enabled weapon detection system
WO2018127789A1 (en) * 2017-01-03 2018-07-12 Innoviz Technologies Ltd. Lidar systems and methods for detection and classification of objects
CN107202987A (en) * 2017-05-31 2017-09-26 武汉大学 Intrusion target detects localization method and system
CN108710127B (en) * 2018-04-19 2020-10-30 上海鹰觉科技有限公司 Target detection and identification method and system under low-altitude and sea surface environments
CN108880701A (en) * 2018-05-14 2018-11-23 深圳市万普拉斯科技有限公司 Adjust the method, device and mobile terminal of antenna radiation performance
CN108919218A (en) * 2018-06-07 2018-11-30 北京邮电大学 A kind of contactless number of people in car and the method and device of position judgement
CN108888249A (en) * 2018-06-07 2018-11-27 北京邮电大学 A kind of method and device of the more people's vital sign monitorings of contactless car
CN109213162A (en) * 2018-09-01 2019-01-15 哈尔滨工程大学 A kind of autonomous berthing offshore method in unmanned surface vehicle pond combined of multi-sensor information
CN109709529A (en) * 2019-03-05 2019-05-03 深圳市镭神智能***有限公司 A kind of rotating prism and multi-line laser radar range-measurement system
CN109996175B (en) * 2019-05-15 2021-04-30 苏州矽典微智能科技有限公司 Indoor positioning system and method
CN110267192B (en) * 2019-05-24 2021-09-14 中国联合网络通信集团有限公司 Positioning method and device
CN110244298B (en) * 2019-07-26 2021-09-10 北京东方至远科技股份有限公司 InSAR data lifting rail combined landslide analysis method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102058411A (en) * 2010-10-27 2011-05-18 中国人民解放军第四军医大学 UVB based multi-channel radar life detection instrument
US20190205903A1 (en) * 2014-02-25 2019-07-04 Nec Corporation Information-processing device, data analysis method, and recording medium
CN106231419A (en) * 2016-08-30 2016-12-14 北京小米移动软件有限公司 Operation performs method and device
CN109856617A (en) * 2019-01-24 2019-06-07 珠海格力电器股份有限公司 Image pickup method, device, processor and terminal based on microwave radar
CN110290353A (en) * 2019-06-28 2019-09-27 Oppo广东移动通信有限公司 Monitoring method and device, electronic equipment and storage medium
CN110412378A (en) * 2019-07-30 2019-11-05 北京经纬恒润科技有限公司 Target object detection method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115092785A (en) * 2022-06-21 2022-09-23 无锡威孚高科技集团股份有限公司 Millimeter wave radar-based early warning method and system for children to enter and exit elevator car independently
WO2023246121A1 (en) * 2022-06-22 2023-12-28 青岛海尔空调器有限总公司 Indoor unit control method and device, and air conditioner

Also Published As

Publication number Publication date
CN111308463B (en) 2022-06-07
CN111308463A (en) 2020-06-19

Similar Documents

Publication Publication Date Title
WO2021147122A1 (en) Human detection method and apparatus, terminal device, storage medium, and electronic device
US10013056B2 (en) Dynamic eye tracking calibration
US9459694B2 (en) Cursor movement device
CN108958490B (en) Electronic device, gesture recognition method thereof and computer-readable storage medium
KR101850009B1 (en) Radar-based gesture recognition
WO2018036229A1 (en) Projection touch control method, device and equipment
US20150253428A1 (en) Determining positional information for an object in space
US20160274732A1 (en) Touchless user interfaces for electronic devices
WO2013063372A1 (en) Detecting object moving toward or away from a computing device
WO2017043056A1 (en) Driving assistance method and driving assistance device and program using same
CN113370911A (en) Pose adjusting method, device, equipment and medium of vehicle-mounted sensor
JP2022542413A (en) Projection method and projection system
CN107479710A (en) Smart mirror and its control method, device, equipment and storage medium
CN106557209A (en) The processing method of infrared touch panel touching signals, device and terminal device
CN109032354B (en) Electronic device, gesture recognition method thereof and computer-readable storage medium
CN113721232B (en) Target object detection method and device, electronic equipment and medium
US9652081B2 (en) Optical touch system, method of touch detection, and computer program product
US20210055792A1 (en) Method and electronic device for eye-tracking
CN105786165B (en) A kind of information processing method and electronic equipment
US20220308651A1 (en) Electronic device control method and device
CN113064806B (en) Control method and electronic equipment
CN204515684U (en) A kind of electronic equipment
CN117148313A (en) Data processing method, detection device and electronic equipment
CN115519586A (en) Cliff detection method for robot, and storage medium
CN116054805A (en) Laser foot-sensing switch

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20916164

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20916164

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27/03/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20916164

Country of ref document: EP

Kind code of ref document: A1