CN209823776U - Intelligent gesture recognition device - Google Patents

Abstract

The utility model discloses an intelligence gesture recognition device, include: the device comprises a controller, a display screen, sensor equipment, a test area, a steering engine, a voice playing module, a relay, a sound box, a fan and a power supply module; the power supply module is used for supplying power to the controller, the display screen, the steering engine, the sound and the fan; the controller is connected with the display screen; the sensor device includes: the controller is also connected with the steering engine, the voice playing module, the relay, the sound box and the fan; wherein: one end of the capacitance sensor is connected with the controller, and the other end of the capacitance sensor is connected with at least one metal plate of the test area. The utility model discloses can realize controlling intelligent house mode, intelligent kitchen mode and intelligent entertainment mode with gesture recognition, control the mode and prevent certain accident through gesture recognition.

Description

Intelligent gesture recognition device

Technical Field

The utility model relates to an intelligent home technical field, in particular to intelligence gesture recognition device.

Background

Since the 80 s in the 20 th century, 4-bit single-chip microcomputers appeared and developed at a rapid speed, experienced multiple development stages, became components frequently applied in the fields of mechanical automation control and various information detection with the advantages of strong performance, small occupied space, high reliability in work, low manufacturing cost, short use and development period and the like, and played more and more prominent roles in industrial production and life of people. Various products can be endowed with a new function only by using a singlechip, and modifiers 'intelligent' are added before the names of the products, such as an intelligent refrigerator, an intelligent microwave oven, an intelligent television and the like. After the beginning of the new technical revolution, the whole world moves from the atomic era to the information era, and when information is processed, people need to acquire real and reliable information from the outside world before that, but in the understanding of people, the information of the outside world is acquired through various senses of human beings, so that in the information era, people urgently need a method for expanding the senses of human beings, and at this moment, a sensor is born, which becomes a main method and means for acquiring information in production and substance production services of natural and substance data in activities and processes of researching natural phenomena and laws and creating social wealth, and can establish industries under knowledge and economic forms, thereby becoming a growth point of value creation, transformation and realization of the new century.

In the new period, the quality of life of people is continuously improved, and new specific desires or conditions are provided for high-tech electronic products, namely, the interaction between people and machines in life is more humanized, the machines are more intelligent, and the clothes, the eating and the housing are more comfortable. In addition, with the improvement of the pursuit of living standard, people demand clothes and eating and living for pursuing the quality of life instead of eating and living for people who have to wear clothes and living for people who have to eat and live for people. For the household life, the intelligent space is also very large.

SUMMERY OF THE UTILITY MODEL

An object of the utility model is to provide an intelligence gesture recognition device can realize the control to intelligent house mode, intelligent kitchen mode and intelligent entertainment mode with gesture recognition to and prevent some accident.

An embodiment of the utility model provides an intelligence gesture recognition device, include: the device comprises a controller, a display screen, sensor equipment, a test area, a steering engine, a voice playing module, a relay, a sound box, a fan and a power supply module; the power supply module is used for supplying power to the controller, the display screen, the steering engine, the sound and the fan;

the controller is connected with the display screen; the sensor device includes: a capacitance sensor, a temperature and humidity sensor, a gas sensor and a smoke sensor which are respectively connected with the controller

The controller is also connected with the steering engine, the voice playing module, the relay, the sound box and the fan;

wherein: one end of the capacitance sensor is connected with the controller, and the other end of the capacitance sensor is connected with at least one metal plate of the test area.

In one embodiment, the test area comprises 4 copper plates which are horizontally arranged and have different area sizes, and the 4 copper plates are respectively connected with the capacitance sensor.

In one embodiment, the controller is an STM32 single chip microcomputer.

In one embodiment, the display screen is an OLED display screen, an LCD display screen, or a liquid crystal display screen.

In one embodiment, the capacitive sensor is an FDC2214 sensor.

In one embodiment, the power module includes a rechargeable battery and a voltage regulator connected to the rechargeable battery.

The utility model has the advantages of, compare with prior art, the utility model provides a technical scheme establishes three kinds of modes of house, kitchen, the amusement of gesture recognition system for gesture recognition is closely associated with the intelligent industry that is popular earlier.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

The technical solution of the present invention is further described in detail by the accompanying drawings and examples.

Drawings

The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention, and together with the description serve to explain the invention and not to limit the invention. In the drawings:

fig. 1 is the utility model provides a schematic diagram of intelligent gesture recognition device.

Fig. 2 is the schematic diagram of the LM2596 adjustable voltage reduction module provided by the present invention.

Fig. 3 is a schematic diagram of an FDC2214 module provided by the present invention.

Fig. 4 is the utility model provides a temperature and humidity sensor module schematic diagram.

Fig. 5 is a schematic diagram of a bottom board DTH11 socket provided by the present invention.

Fig. 6 is a schematic diagram of an MQ-2 smoke gas sensor module provided in the present invention.

Fig. 7 is a schematic diagram of a TFT resistive touch panel provided in the present invention.

Fig. 8 is a circuit diagram of the voice external discharge circuit provided in the present invention.

Fig. 9 is a functional design flowchart provided in the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

An embodiment of the utility model provides an intelligence gesture recognition device, include: the device comprises a controller, a display screen, sensor equipment, a test area, a steering engine, a voice playing module, a relay, a sound box, a fan and a power supply module; the power supply module is used for supplying power to the controller, the display screen, the steering engine, the sound and the fan;

the controller is connected with the display screen; the sensor device includes: a capacitance sensor, a temperature and humidity sensor, a gas sensor and a smoke sensor which are respectively connected with the controller

The controller is also connected with the steering engine, the voice playing module, the relay, the sound box and the fan;

wherein: one end of the capacitance sensor is connected with the controller, and the other end of the capacitance sensor is connected with at least one metal plate of the test area.

Such as: the STM32F4VE master control system, LM2596 adjustable voltage reduction module circuit design, FDC2214 module, DHT11 temperature and humidity sensor module circuit design, MQ-2 smoke gas sensor module circuit design, PDI-6221MG-360 steering engine, TFT resistance touch screen, voice playing module, JQC-3FF-S-Z relay, gesture recognition algorithm and the like are deeply learned. For example, when a hand is placed in the test area to make a gesture, a corresponding function can be generated. The device can provide three modes.

In the first mode: if it is in "please select the mode you want. When the user is in the state, the hand is stroked by 1, and the system is actively switched into the intelligent home mode. In this mode, if the door is closed, stroking "3" will open the door, and stroking "3" again will result in closing the door; if the door is opened, the door is closed when the stroke is 3, and the door is opened when the stroke is 3; the stroke of "4" can report the current day air temperature of "cold today", "moderate today air temperature" or "hot today air"; stroking "5" will turn the dome light on, and stroking "5" again will turn the dome light off. The small ball lamp decoration is used to imitate household lamp.

In the second mode: if it is in "please select the mode you want. When the user is in the state, the user can stroke the hand to be 2, and the system can be actively switched into the mode of the intelligent kitchen. A dash of "3" opens 5051 the fan, again a dash of "3" closes 5051 the fan, 5051 the fan being a fan simulating an exhaust fan in a kitchen. In the kitchen, when the concentration of combustible gas exceeds the standard, the smoke alarm gives an alarm to remind, and the exhaust fan is actively opened. "

The third mode: if it is in "please select the mode you want. When the user is in the state, the user strokes the hand to '3', and the system is actively switched into an intelligent entertainment mode. In this mode, there are two games, i.e., "what punch guess" and "punch practice". Under the game of guessing what fist, the user name is firstly input, when the test area strokes to '0', '2' or '5', the system randomly draws one of '0', '2' or '5', and finally a score list is formed. Under the game of 'punching exercise', one of '0-5' is compared in a test area, and a number is spoken, so that the system randomly reads one of '0-5' and broadcasts a number by voice.

When in any of the three modes, the dash "1" jumps back "please select the mode you want. "state.

As shown in fig. 1, four copper plates with different sizes are built and placed, four channels of the FDC2214 gesture recognition sensor are used for collecting capacitance values of the four channels, whether the capacitance values exist or not is judged according to different placed gestures, and meanwhile, the shape of the gesture is judged in the interval of the capacitance. The multi-channel capacitance tester adopts multiple channels to collect required data for analysis, and due to the design of hardware, the capacitance calculated by hands at different positions of a test area cannot have errors.

1.2 selection and demonstration of modules

1.2.1 demonstration and selection of Power modules

The first scheme is as follows:

A12V power supply is formed by a battery box, and is used for directly supplying power to all parts of the system and reducing the voltage to all parts with low voltage requirements. The circuit is simple in structure, low in cost and poor in stability, and large interference current is easy to generate when the motor works and enters the control system to influence the normal operation of the system. Therefore, the required voltage can be flexibly adjusted by connecting a subsequent voltage stabilizing circuit, and the power supply is simple in structure, low in price and easy to obtain, but is too troublesome in charging and violates the intelligent and convenient principle.

Scheme II:

the lithium battery is used for providing 12V voltage as a voltage supply source, power is directly supplied to all parts of the system, and the voltage is reduced by the LM2596 adjustable voltage reduction module and then supplied to other parts or modules. "the operating voltage of the multiple batteries can reach twelve volts, three times that of the ordinary batteries. "[ 3] the actual specific energy achievable is about five hundred fifty-five Wh per kilogram, in other words the material is capable of a specific capacity of greater than or equal to one hundred fifty mAh per gram, i.e. of eighty-eight percent of its ideal value; the charging times can reach thousands of times; no public hazard and no memory effect.

In summary, lithium batteries have high voltage and specific energy, although the battery case is relatively inexpensive. The self-discharge is small, and the charging is rapid and convenient, so the project selects the scheme two.

1.2.2 demonstration and selection of control chips

The first scheme is as follows:

c51 single chip computer. The 51 single chip microcomputer is taken as a scheme, because the single chip microcomputer is the most common and widely used single chip microcomputer in the market and has low price.

Scheme II:

STM32 singlechip. The STM32 has the advantages of high speed, high performance, low cost and low energy consumption.

In conclusion, the 51-chip microcomputer is indeed advantageous in price, but the running speed of the STM32 is far higher than that of the 51-chip microcomputer. The interface performance is several times better than that of the 51 single chip microcomputer, and the power consumption of the STM32 is lower than that of the 51 single chip microcomputer. Considering the problems of complex programs, complex functions and the like, the selection of STM32 is most cost-effective.

1.2.3 demonstration and selection of display modules

The first scheme is as follows:

an OLED display module. The OLED module is low in price, low in power consumption, not prone to distortion, light and thin in material and capable of saving space. But has a shorter life than a general display module.

Scheme II:

TFTLCD display module. The module can support high-definition pictures, and is high in resolution and good in visual sense. The functions are also many, and videos can be played, files can be edited, and the like. But is relatively power consuming.

In summary, these two schemes do not have primary and secondary differences. The number of pins of the OLED display module is about 30, wiring of the OLED display module is troublesome if the OLED display module is selected, the DuPont wires are used a lot, attractive occupied space is damaged, and circuits can be influenced. The pins of the TFTLCD display module are 40 pins, but can be just matched with the selected STM32 single-chip microcomputer control chip, so that wiring troubles are omitted, the space is saved, and the appearance is attractive.

2. Hardware system design

2.1 STM32F4VE Master control System

And the singlechip microcontroller is based on a Cortex-M4 inner core. In order to meet the design requirements of clients, the system integrates the characteristics of high-level kernel systems, high-performance equipment systems, low energy consumption, low price and the like at home and abroad. Because it possesses extremely high performance, and a fairly innovative external hardware design. Therefore, STM32 has rapidly become popular and is leading to new electronic products.

Such as: the embodiment completes the gesture recognition system based on the UCOS and EMWIN graphical interfaces. Therefore, compared with a 51-chip microcomputer, the STM32 series of chip microcomputers are richer in resources and higher in speed, and are the best choice. The powerful internal memory space of the device can make the function operation more smooth.

2.2 DC-12300 lithium battery

The fan is a 5051 fan, needs a voltage as high as 12V, so that a battery which is small in internal resistance, large in capacity, high in voltage, large in specific energy, good in safety performance, high in stability, small in self-discharge, rapid and convenient to charge and capable of being cycled for many times is selected. The DC-12300 lithium battery is light in weight, does not occupy space, is convenient to use, can provide required voltage, and is matched with the LM2596 adjustable voltage reduction module to reduce and provide the voltage to partial components.

TABLE 1 DC-12300 lithium Battery parameters

Input voltage	12.6VDC
		Output voltage	12.0VDC
Capacity of battery	3000mAh
		Weight (D)	220.0G

2.3 LM2596 adjustable voltage-reducing module circuit design

Referring to fig. 2, a schematic diagram of an LM2596 adjustable voltage reduction module is shown, which is selected because the input voltage and the output voltage meet the requirements of the present embodiment. The output voltage provided by the DC-12300 lithium battery is reduced and then provided to partial components requiring input voltage below 12V, so that the circuit can output various voltages to different components for use. The following table shows the LM2596 adjustable buck module parameters.

TABLE 2 LM2596 Adjustable Voltage reduction Module parameters

Input voltage	3.0V to 40.0VDC
		Output voltage	1.5 to 35.0VDC

2.4 FDC2214 Module

FDC2214 is a detector using the principle of LC resonant circuit, mainly to obtain capacitance. The capacitive sensor has the advantages of extremely low consumption, low price and capability of detecting without contact. Most often used for gesture recognition and other applications. And the LC circuit end adopts the connection of an inductor and a capacitor to finish detection. Depending on the frequency of the capacitance used to be identified in the vicinity of the LC circuit. And using this frequency to calculate the capacitance value we need to acquire

The resolution of the module is 28 bits, and the temperature range is minus 40.0 degrees to plus 125.0 degrees. Can be used in most households.

FDC2214 was very dependent on input current stabilization during testing. In the gesture recognition process, if the hand is closer to the test area, the capacitance value is increased, and the surrounding environment interference is also increased, so that a hardware model device conforming to the gesture recognition needs to be designed, as shown in fig. 3.

2.5 DHT11 temperature and humidity sensor module circuit design

Referring to fig. 4-5, the DHT11 temperature and humidity sensor module is selected because the module has a humidity measurement range of 20.0% -95.0%, a humidity measurement error of ± 5.0%, and a temperature measurement error of ± 2.0 ℃ at 0.0-50.0 ℃. And the measuring range and the error of the module can meet the requirements of common families, and the price is relatively substantial. Referring to fig. 4, a schematic diagram of a temperature and humidity sensor module is shown, and a resistor is pulled up to prevent data from generating a serious error due to parasitic capacitance.

The module monitors indoor temperature and humidity in real time, feeds back the indoor temperature and humidity to the TFT resistance touch screen, can select the mode 1, and compares gestures in a test area to know the condition of the day, better controls the condition of clothing in the room, and the like.

2.6 MQ-2 smoke gas-sensitive sensor module circuit design

Referring to fig. 6, MQ2 smoke sensors are an important detector for home kitchen accidents prevention. It can identify a variety of gases that can be combusted. The principle is to change the concentration of the gas by changing the conductivity. Therefore, the module is selected for kitchen safety detection to achieve the function.

TABLE 3 MQ-2 Smoke gas sensor Module parameters

2.7 PDI-6221MG-360 steering engine

The PDI-6221MG-360 steering engine is selected to achieve the effect of controlling the door to be opened or closed through gestures. The steering engine can accomplish this function mainly because of the duty cycle of the PWM regulation and control. One part in the steering engine can rotate, and the door can be opened and closed by changing the angle of the steering engine through information transmission of the single chip microcomputer. 20.0ms (50.0Hz) is the fixed period of the standard PWM signal. Due to error, the pulse width distribution should theoretically be between 1.0ms and 2.0ms, whereas in practice the pulse width distribution should be between 0.5ms and 2.5 ms.

TABLE 4 PDI-6221MG-360 Rudder-related parameters

Operating voltage	4.8V to 6.6VDC
		Speed (4.8V)	0.18sec/60°
Speed (6.0V)	0.16sec/60
		Torsion (4.8V)	17.25kg/cm
Torsion (6.0V)	20.32kg/cm

Known by last table, the steering wheel operating voltage and the speed torsion of this model all accord with the utility model discloses a design demand can reach the effect of design original intention.

2.8 TFT resistance touch screen

TABLE 5 TFT resistive touch Screen parameters

Liquid crystal panel	True color TFT
		Driving IIC	ILI9341
Resolution ratio	320*240
		PIN foot	32pin (FSMC bus)
PIN pitch	2.54mm
		Connected type	Row nut

Referring to FIG. 7, a schematic diagram of a TFT resistive touch screen; the touch screen display screen can be matched with an STM32 single chip microcomputer relatively perfectly. The read gesture recognition data can be displayed; displaying the temperature and humidity in the current state; an entertainment mode can also be selected, and people input information in the sensing area and read the information on the screen.

2.9 Voice playing module

Table 6 Voice Play Module parameters

This module is used because it has nine direct trigger ports. The nine needle rows are A1-A9. The entertainment mode and the like are used for prompting, alarming and the like.

Referring to fig. 8, a circuit diagram of voice amplification is shown.

2.10 BOKESi Sound

The BOKESi sound box is selected, the seven-color four-lamp is arranged in the BOKESi sound box, the whole direction is uniformly distributed without multi-color alternate transformation, the BOKESi sound box is small, mini and portable, a large 45-millimeter seismic film is additionally arranged at the bottom of the BOKESi sound box, the sound quality is more vigorous, and a 3.5-millimeter audio connector is used.

And the volume is amplified by matching with a voice playing module.

2.11 JQC-3FF-S-Z relay

TABLE 7 JQC-3FF-S-Z Relay parameters

Insulation resistance	100mΩ500VDC
		Time of action	≤10ms
Time of release	≤5ms
		Coil temperature rise	≤60℃
Humidity	35％～85％RH
		Temperature of	-40℃～70℃

The relay can be used to control the single chip microcomputer to work under high current and high voltage such as lamp decorations, 5051 fan and the like. Therefore, the GPIO port is controlled, and a four-way relay is selected. Current, voltage convenient to drive hardware equipment accomplish the utility model discloses the function that realizes.

2.125051 Fan

This time, 5051 fan is adopted to simulate kitchen exhaust fan in home. The main reason is that only this type of product is currently able to meet the needs of the known market. The voltage only needs 12V, most of the rest needs 120V, and the required input voltage is difficult to achieve.

TABLE 85051 Fan parameters

3. Software system design

3.1 FDC2214 driver design

The first step is to initialize the FDC2214 module, firstly, the software IIC bus is initialized, then whether the ID is correct is detected, and then the register is initialized. In setting the FDC2214 register, there are the following steps. 1. According to the related data conversion interval. 2. The settling time before the transition. 3. The frequency is selected to be between 0.01 mhz and 10.0 mhz. 4. Error reporting is prohibited altogether. 5. And the channels 0, 1, 2 and 3 are selected to be the lowest setting with the frequency of ten megahertz greater than the oscillation frequency of the oscillation tank, and are multi-channel and four-channel. 6. In active mode, the INTB pin is set with the status register update using an internal oscillator as the reference frequency.

The second step is FDC _ I2C and read/write operations, first setting the FDC IIC delay function. A function is then written that yields the initial values for FDC 2214. An IIC start signal is generated. An IIC stop signal is generated. Waiting for an acknowledgement signal to arrive, etc.

3.2 gesture recognition Algorithm

After the gesture recognition device is built, an algorithm program corresponding to the gesture is written for the needed gesture. The principle of gesture recognition is that different areas of the barrier on the test area will generate different capacitance values. And acquiring a reasonable value range of each gesture according to the obtained capacitance value and the four paths of FDC2214 channels which are arranged in advance. For example, the fist covers a small area in the copper plate sensing area, and the capacitance range in the channel taken in the algorithm is relatively small. Based on the principle, a relatively stable gesture recognition algorithm can be designed.

3.3 touch Screen Programming

TABLE 8 touch Screen Programming procedure

3.4 display Screen Programming

The screen LCD is initialized to set the picture and text to be displayed.

3.5 functional design flow chart

Referring to fig. 9, a software process first initializes the FDC2214, the temperature and humidity sensor, the smoke sensor, the steering engine, and functions such as delay, timer, and serial port. And initializing the UCOS operating system and the ENWIN graphical interface. And establishing a starting task, distributing stack space of each task and preempting priority of the task. Then, the tasks are established, which are respectively: the method comprises an interface task, a touch screen task, a gesture recognition task and a mode selection task. And displaying various graphical window controls by utilizing the ENWIN graphical interface in the interface task. In the gesture recognition task, when the capacitance value is changed, the gesture is judged by using a gesture recognition algorithm. Then, a mode selection task is entered, the mode that is now required is selected, and the control function in the mode is completed. For example, the interface icon control also has a text box for viewing the temperature, the humidity and the smoke concentration in real time. The user can be reminded of the current temperature conditions and the current situation in the kitchen in a voice mode.

Finally, it should be noted that the above embodiments are only used for illustrating the technical solutions of the present invention and are not limited. Although the present invention has been described in detail with reference to the embodiments, those skilled in the art will understand that modifications and equivalent substitutions can be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention, and all of them shall fall within the scope of the claims of the present invention.

Claims (6)

1. An intelligent gesture recognition device, comprising: the device comprises a controller, a display screen, sensor equipment, a test area, a steering engine, a voice playing module, a relay, a sound box, a fan and a power supply module; the power supply module is used for supplying power to the controller, the display screen, the steering engine, the sound and the fan;

the controller is connected with the display screen; the sensor device includes: a capacitance sensor, a temperature and humidity sensor, a gas sensor and a smoke sensor which are respectively connected with the controller

The controller is also connected with the steering engine, the voice playing module, the relay, the sound box and the fan;

wherein: one end of the capacitance sensor is connected with the controller, and the other end of the capacitance sensor is connected with at least one metal plate of the test area.

2. The intelligent gesture recognition device of claim 1, wherein the test area comprises 4 copper plates which are horizontally arranged and have different areas, and the 4 copper plates are respectively connected with the capacitive sensor.

3. An intelligent gesture recognition device according to claim 1, wherein the controller is an STM32 single chip microcomputer.

4. The intelligent gesture recognition device of claim 1, wherein the display screen is an OLED display screen, an LCD display screen, or a liquid crystal display screen.

5. The intelligent gesture recognition device of claim 1, wherein the capacitive sensor is an FDC2214 sensor.

6. The intelligent gesture recognition device of claim 1, wherein the power module comprises a rechargeable battery and a voltage regulator connected to the rechargeable battery.