CN103295028A - Gesture operation control method, gesture operation control device and intelligent display terminal - Google Patents
Gesture operation control method, gesture operation control device and intelligent display terminal Download PDFInfo
- Publication number
- CN103295028A CN103295028A CN201310191402XA CN201310191402A CN103295028A CN 103295028 A CN103295028 A CN 103295028A CN 201310191402X A CN201310191402X A CN 201310191402XA CN 201310191402 A CN201310191402 A CN 201310191402A CN 103295028 A CN103295028 A CN 103295028A
- Authority
- CN
- China
- Prior art keywords
- operator
- image information
- gesture
- identity
- gesture operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a gesture operation control method, a gesture operation control device and an intelligent display terminal. The method includes: collecting operator image information; identifying the identity of an operator according to the operator image information, and acquiring identity information of the operator; and searching a preset distance matching table according to the identity information of the operator, acquiring an effective gesture operation distance of the operator relative to the terminal and reminding the operator. A gesture control system is capable of automatically reminding the effective distance of the operator relative to the intelligent display terminal, operator gesture action recognition precision of the gesture control system is improved, and operation injuries to the operator are avoided. Besides, a gesture recognition function table can be searched according to the acquired operator image information, corresponding functions of the terminal are adjusted correspondingly according to search results, and the purpose for control television functions through operator gestures is achieved.
Description
Technical field
The present invention relates to the intelligent distant control technical field, relate in particular to a kind of gesture operation control method, device and intelligent display terminal.
Background technology
Increasing electronic equipment for consumption has appearred in the propelling day by day along with global television digitization, for example Pad, DVD, digital television, sound equipment and air-conditioning etc.; And at various electronic equipments, various intelligent remote control systems have also appearred, and as the television set intelligently telepilot, air-conditioning remote control, mobile phone are as telepilot, and IPAD is as telechirics etc.
At present, the pattern of TV being carried out Remote mainly contains: the input of the telepilot of infrared television remote manipulator, similar mouse, adopt the telepilot handwriting input of handwriting pad etc., realize control to TV but above control model all needs the user to operate external unit.For the hommization that improves quality of the life and increase intelligence system, allow the convenient control intelligent terminal of user, the gesture control technology has appearred at present.
The characteristics of gesture control technology are that the hand motion (for example waving) by the operator is controlled terminal devices such as TV, for example, switching TV channel, adjusting volume etc., thereby saved the searching telepilot, the process of remote controller, the user is freed from the dependence to telepilot, wave and to realize control to TV.
But present gesture control technology is when the user carries out gesture motion, and television terminal can't be reminded the distance of remaining valid between user and the TV.Such as, the child of family or household, near excessively apart from TV when then occurring user's gesture operation easily if do not remind him whether the distance of current gesture control is correct, cause following two problems thus:
The first, cause the gesture identification system identification incorrect, for example: the user from camera too close to, camera can't get access to user's gesture picture, causes system can't correctly identify user's gesture;
The second, user's hand can touch TV, causes hand injured; For example: TV is placed on the cupboard in parlor, and child sees that parents do gesture motion, oneself goes imitation and since child from TV very close to, can pat on TV when brandishing with hand, cause hand injured etc.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of gesture operation control method, device and intelligent display terminal, is intended to promote the gesture control system to the accuracy of identification of gesture motion, avoids the user to cause the operation injury.
In order to achieve the above object, the present invention proposes a kind of gesture operation control method, comprising:
Acquisition operations person's image information;
According to described operator's image information identifying operation person's identity, obtain operator's identity information;
Search defaultly apart from matching list according to described operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.
Preferably, also comprise after the step of described acquisition operations person's image information:
Described operator's image information is carried out size intercepting, color conversion and/or denoising.
Preferably, the step of described identity information according to operator's image information identifying operation person comprises:
From described operator's image information, obtain operator's head image information;
Search default image library according to described operator's head image information, obtain operator's identity information.
Preferably, also comprise after the step of described acquisition operations person's image information:
Whether be operator's operational order according to the current gesture motion of described operator's image information decision operation person; If then execution in step is according to described operator's image information identifying operation person's identity information; Otherwise, do not deal with.
Whether preferably, described is that the step of operator's operational order comprises according to the current gesture motion of operator's image information decision operation person:
Adopt the mode of multiple target tracking to make up manikin;
Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification;
If the gesture feature data that current operator's image information is the operator judge that then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.
Preferably, the effective gesture operation of the relative terminal of the described operator of obtaining distance and remind operator's step after also comprise:
Search default gesture identification menu according to operator's image information, according to the corresponding corresponding function of terminal of adjusting of lookup result.
Preferably, also comprise before the step of described acquisition operations person's image information:
Dispose described apart from matching list and gesture identification menu.
The present invention also proposes a kind of gesture operation control device, comprising:
Acquisition module is used for acquisition operations person's image information;
Identification module is used for the identity according to described operator's image information identifying operation person, obtains operator's identity information;
Obtain prompting module, be used for searching according to described operator's identity information default apart from matching list, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.
Preferably, this device also comprises:
Processing module is used for described operator's image information is carried out size intercepting, color conversion and/or denoising.
Preferably, described identification module also is used for obtaining from described operator's image information operator's head image information; Search default image library according to described operator's head image information, obtain operator's identity information.
Preferably, this device also comprises:
Judge module, whether be used for according to the current gesture motion of described operator's image information decision operation person is operator's operational order; If, then by the identity information of described identification module according to described operator's image information identifying operation person; Otherwise, do not deal with.
Preferably, described judge module also is used for adopting the mode of multiple target tracking to make up manikin; Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification; If the gesture feature data that current operator's image information is the operator judge that then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.
Preferably, this device also comprises:
Execution module is used for searching default gesture identification menu according to operator's image information, according to the corresponding corresponding function of terminal of adjusting of lookup result.
Preferably, this device also comprises:
Configuration module, it is described apart from matching list and gesture identification menu to be used for configuration.
The present invention also proposes a kind of intelligent display terminal, comprises aforesaid device.
A kind of gesture operation control method, device and intelligent display terminal that the present invention proposes are by acquisition operations person's image information; Obtain operator's identity information according to operator's image information identifying operation person's identity; Search default apart from matching list according to operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and remind the operator, make the gesture control system can remind the coverage of the relative intelligent display terminal of operator automatically, not only promote the precision of gesture control system to the identification of operator's gesture motion, and avoided the operator to cause the operation injury.
Description of drawings
Fig. 1 is the schematic flow sheet of gesture operation control method first embodiment of the present invention;
Fig. 2 is the schematic flow sheet of gesture operation control method second embodiment of the present invention;
Fig. 3 is the schematic flow sheet of gesture operation control method the 3rd embodiment of the present invention;
Fig. 4 is the schematic flow sheet of gesture operation control method the 4th embodiment of the present invention;
Fig. 5 is the schematic flow sheet of gesture operation control method the 5th embodiment of the present invention;
Fig. 6 is the structural representation of gesture operation control device first embodiment of the present invention;
Fig. 7 is the structural representation of gesture operation control device second embodiment of the present invention;
Fig. 8 is the structural representation of gesture operation control device the 3rd embodiment of the present invention;
Fig. 9 is the structural representation of gesture operation control device the 4th embodiment of the present invention;
Figure 10 is the structural representation of gesture operation control device the 5th embodiment of the present invention.
In order to make technical scheme of the present invention clearer, clear, be described in further detail below in conjunction with accompanying drawing.
Embodiment
As shown in Figure 1, first embodiment of the invention proposes a kind of gesture operation control method, comprising:
Step S101, acquisition operations person's image information;
Present embodiment method running environment relates to the gesture control system of intelligent display terminal, and wherein said intelligent display terminal can be display devices such as intelligent television, and present embodiment illustrates with TV.
The operating software of above-mentioned gesture control system can be installed on TV, be used for identifying the operator of gesture operation in the face of the distance state of TV, and carry out corresponding analysis and adjust the correct distance of relative TV to remind the operator, be coverage, thereby realize the gesture control to the TV correlation function.
Acquisition operations person's image information at first.Operator's gesture operation of can waving to carry out before TV sends remote manipulation instruction to television system, and carry out corresponding function with the control TV and regulate, such as, regulate the size of television sound volume etc.
The gesture operation that TV gesture control system can be caught the operator by the camera of installing on TV, and obtain operator's image information, this operator's image information can comprise the image information of operator's head, shoulder and arm segment, can capture user's gesture motion thus.
Step S102 according to described operator's image information identifying operation person's identity, obtains operator's identity information;
TV gesture control system is therefrom obtained operator's header information after capturing operator's image information of operator, this header information and default image library are mated, to obtain operator's identity information.Should store corresponding header information according to different operator's identity in the default image library, such as, therefore grandfather, grandmother, father and mother, child's etc. header information is searched above-mentioned default image library according to the current header information of operator that captures and can be mated the identity information that recognizes the operator.
Step S103 searches defaultly apart from matching list according to described operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.
Present embodiment is set with separately the valid function distance of TV relatively for the operator of different identity in advance, such as, grandfather need stand in 1-2 rice distance and carry out gesture operation, etc., and with operator's identity information and separately the corresponding relation between the coverage be stored in one apart from the matching list, as shown in table 1 below.
Table 1
In use, the operator can according to the default option, dispose corresponding distance value voluntarily before carrying out gesture operation, also can adopt the recommendation reference value of system default, finish data are stored to after the configuration above-mentioned apart from the matching list.
After the operator carries out gesture operation and recognizes operator's identity, go to search that this is default apart from matching list according to described operator's identity information, therefrom coupling is obtained effective gesture operation distance of the relative terminal of operator, and this distance value is shown to the operator, can remind the operator with respect to the correct gesture operation distance of TV thus, after the operator sees the distance value that shows on the TV screen, if current distance does not meet the range of a signal requirement, can adjust own coverage with respect to TV screen.Such as, set grandfather and need stand in 1-2 rice distance and carry out gesture operation, if grandfather stands in outside 2 meters, then see the coverage of screen display after, grandfather adjusts this distance in the effective range of 1-2 rice, to improve the recognition accuracy that gesture operation moves.Again such as, the coverage of setting son is 1 meter, son is when carrying out gesture operation, then can be according to the coverage between the maintenance of TV screen prompting message and the TV screen, not only improve the recognition accuracy of gesture operation action, and avoided making hand touch TV close to excessively and causing hand injured from TV.
Present embodiment is by such scheme, operator's image information of acquisition operations person; According to operator's image information identifying operation person's identity, obtain operator's identity information; Search default apart from matching list according to operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and be shown to the operator, make the gesture control system can remind the coverage of the relative intelligent display terminal of operator automatically, not only promote the precision of gesture control system to the identification of operator's gesture motion, and avoided the operator to cause the operation injury.
As shown in Figure 2, second embodiment of the invention proposes a kind of gesture operation control method, on the basis of above-mentioned first embodiment, also comprises after above-mentioned steps S101:
Step S104 carries out size intercepting, color conversion and/or denoising to described operator's image information.
The difference of present embodiment and above-mentioned first embodiment is that present embodiment gesture control system also needs this operator's image information is handled accordingly after capturing operator's image information.
Particularly, after capturing operator's operation information, need analyze this information, such as operator's head and shoulder data being handled the calculation size of the size of setting operation person image for being fit to; This operator's image is carried out color conversion, such as RGB 24bit is treated to the 8bit GTG; Simultaneously, this image data is carried out denoising, disturb to remove.Wherein, the method for denoising can select for use low-pass filter to realize.
Present embodiment can improve the accuracy of operator's image information data by such scheme, thereby for subsequent gesture operation identification provides data source more accurately, has further promoted the precision of gesture control system to the identification of operator's gesture motion.
As shown in Figure 3, third embodiment of the invention proposes a kind of gesture operation control method, on the basis of above-mentioned second embodiment, also comprises after above-mentioned steps S104:
Whether step S105 is operator's operational order according to the current gesture motion of described operator's image information decision operation person; If, then enter step S102, otherwise, do not deal with, withdraw from flow process.
The difference of present embodiment and above-mentioned second embodiment is, present embodiment gesture control system is in the operator's image information that collects the operator and after carrying out respective handling, and whether also need this information is that operator's gesture operation instruction is judged.
Particularly, when judging, can be in the following ways:
At first adopt the mode of multiple target tracking to make up manikin;
Wherein, many orders tracking can use JPDA wave filter (JPDAF), many hypothesis to follow the tracks of (MHT) algorithm and dynamic multidigit allocation algorithm etc., and above-mentioned various algorithms can adopt existing ripe scheme, do not repeat them here.
Use multi-object tracking method, for these gesture motion objects find corresponding target separately, and set up manikin according to these track symbols for the effective target of operator's human body hand feature.
In multiobject manikin, all to corresponding space-time track should be arranged, effective target all has successional characteristics to each effective target, and different target has the different separately forms of expression respectively.For example the gesture object table reveals the span of motion.
Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification then; If the gesture feature data that current operator's image information is the operator, then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.
Present embodiment passes through such scheme, whether gesture operation that can the accurate recognition operator is the operational order that the operator need carry out, can effectively get rid of operator's maloperation thus, further promote the precision of gesture control system to the identification of operator's gesture motion.
As shown in Figure 4, fourth embodiment of the invention proposes a kind of gesture operation control method, on the basis of above-mentioned the 3rd embodiment, also comprises after above-mentioned steps S103:
Step S106 searches default gesture identification menu according to operator's image information, according to the corresponding corresponding function of terminal of adjusting of lookup result.
The difference of present embodiment and above-mentioned the 3rd embodiment is that present embodiment comprises that also system is according to the scheme of operator's the corresponding function of gesture operation adjustment.
Particularly, present embodiment has corresponding terminal regulatory function according to the different gesture operation coupling of operator in advance, and establish a gesture recognition function table with this corresponding relation, wave to represent adjusting television sound volume size such as horizontal direction, setting the expression of waving simultaneously left increases volume, and the expression of waving to the right reduces volume, after moving 20cm from left to right when gesture, for the volume adjustment increases a unit, etc.
TV gesture control system is when the gesture operation that identifies the operator is normal operational order, carry out calling of corresponding function, at first can remove to search default gesture identification menu according to the operator operator image information of obtaining, according to the corresponding corresponding function of terminal of adjusting of lookup result.Thereby realize the purpose by operator's gesture operation control TV functions.
As shown in Figure 5, fifth embodiment of the invention proposes a kind of gesture operation control method, on the basis of above-mentioned the 4th embodiment, also comprises before above-mentioned steps S101:
Step S100 disposes described apart from matching list and gesture identification menu.
The difference of present embodiment and above-mentioned the 4th embodiment is that present embodiment also comprises the described scheme apart from matching list and gesture identification menu of configuration.
Particularly, the operator can dispose apart from matching list and gesture identification menu according to the default option, such as TV gesture control system gesture operation prompting menu can be set, remind the function choosing-item of the correct distance range of operator and gesture correspondence by the mode of gesture operation prompting menu.
Present embodiment is by such scheme, and configuration is apart from matching list and gesture identification menu, and acquisition operations person's image information; According to operator's image information identifying operation person's identity, obtain operator's identity information; Search apart from matching list according to operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and be shown to the operator, make the gesture control system can remind the coverage of the relative intelligent display terminal of operator automatically, not only promote the precision of gesture control system to the identification of operator's gesture motion, and avoided the operator to cause the operation injury; Remove to search the gesture identification menu according to the operator operator image information of obtaining in addition, according to the corresponding corresponding function of terminal of adjusting of lookup result, realize the purpose by operator's gesture operation control TV functions.
As shown in Figure 6, first embodiment of the invention proposes a kind of gesture operation control device, comprising: acquisition module 201, identification module 202 and obtain prompting module 203, wherein:
Obtain display module 203, be used for searching according to described operator's identity information default apart from matching list, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.
Present embodiment gesture operation control device can be arranged on the intelligent display terminal, gesture control system as this intelligent display terminal, be used for identifying the operator of gesture operation in the face of the distance state of TV, and carry out corresponding analysis and adjust the correct distance of relative TV to remind the operator, be coverage, thereby realize the gesture control to the TV correlation function.
Wherein said intelligent display terminal can be display devices such as intelligent television, and present embodiment illustrates with TV.
TV gesture control system can be caught operator's gesture operation by the camera of installing on TV, and obtains operator's image information, and this image information can comprise the image information of operator's head, shoulder and arm segment.
TV gesture control system is therefrom obtained operator's header information by identification module 202 after capturing operator's image information, this header information and default image library are mated, to obtain operator's identity information.Should store corresponding header information according to different operator's identity in the default image library, such as, therefore grandfather, grandmother, father and mother, child's etc. header information is searched above-mentioned default image library according to the current header information of operator that captures and can be mated the identity information that recognizes the operator.
Present embodiment is set with separately the valid function distance of TV relatively for the operator of different identity in advance, such as, grandfather need stand in 1-2 rice distance and carry out gesture operation, etc., and with operator's identity information and separately the corresponding relation between the coverage be stored in one apart from the matching list, as above shown in the table 1.
In use, the operator can according to the default option, dispose corresponding distance value voluntarily before carrying out gesture operation, also can adopt the recommendation reference value of system default, finish data are stored to after the configuration above-mentioned apart from the matching list.
After the operator carries out gesture operation and recognizes operator's identity, obtain prompting module 203 and go to search that this is default apart from matching list according to described operator's identity information, therefrom coupling is obtained effective gesture operation distance of the relative terminal of operator, and this distance value is shown to the operator, can remind the operator with respect to the correct gesture operation distance of TV thus, after the operator sees the distance value that shows on the TV screen, if current distance does not meet the range of a signal requirement, can adjust own coverage with respect to TV screen.Such as, set grandfather and need stand in 1-2 rice distance and carry out gesture operation, if grandfather stands in outside 2 meters, then see the coverage of screen display after, grandfather adjusts this distance in the effective range of 1-2 rice, to improve the recognition accuracy that gesture operation moves.Again such as, the coverage of setting son is 1 meter, son is when carrying out gesture operation, then can be according to the coverage between the maintenance of TV screen prompting message and the TV screen, not only improve the recognition accuracy of gesture operation action, and avoided making hand touch TV close to excessively and causing hand injured from TV.
Present embodiment is by such scheme, acquisition operations person's image information; According to operator's image information identifying operation person's identity, obtain operator's identity information; Search default apart from matching list according to operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and be shown to the operator, make the gesture control system can remind the coverage of the relative intelligent display terminal of operator automatically, not only promote the precision of gesture control system to the identification of operator's gesture motion, and avoided the operator to cause the operation injury.
As shown in Figure 7, second embodiment of the invention proposes a kind of gesture operation control device, on the basis of above-mentioned first embodiment, also comprises:
The difference of present embodiment and above-mentioned first embodiment is that present embodiment gesture control system also needs this operator's image information is handled accordingly after capturing operator's image information.
Particularly, after capturing operator's image information, need analyze this information, such as operator's head and shoulder data being handled the calculation size of the size of setting operation person image for being fit to; This operator's image is carried out color conversion, such as RGB 24bit is treated to the 8bit GTG; Simultaneously, this image data is carried out denoising, disturb to remove.Wherein, the method for denoising can select for use low-pass filter to realize.
Present embodiment can improve the accuracy of operator's image information data by such scheme, thereby for subsequent gesture operation identification provides data source more accurately, has further promoted the precision of gesture control system to the identification of operator's gesture motion.
As shown in Figure 8, third embodiment of the invention proposes a kind of gesture operation control device, on the basis of above-mentioned second embodiment, also comprises:
The difference of present embodiment and above-mentioned second embodiment is, present embodiment gesture control system is after collecting operator's image information and carrying out respective handling, and whether also need this information is that operator's gesture operation instruction is judged.
Particularly, when judging, can be in the following ways:
At first adopt the mode of multiple target tracking to make up manikin;
Wherein, many orders tracking can use JPDA wave filter (JPDAF), many hypothesis to follow the tracks of (MHT) algorithm and dynamic multidigit allocation algorithm etc., and above-mentioned various algorithms can adopt existing ripe scheme, do not repeat them here.
Use multi-object tracking method, for these gesture motion objects find corresponding target separately, and set up manikin according to these track symbols for the effective target of operator's human body hand feature.
In multiobject manikin, all to corresponding space-time track should be arranged, effective target all has successional characteristics to each effective target, and different target has the different separately forms of expression respectively.For example the gesture object table reveals the span of motion.
Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification then; If the gesture feature data that current operator's image information is the operator, then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.
Present embodiment passes through such scheme, whether gesture operation that can the accurate recognition operator is the operational order that the operator need carry out, can effectively get rid of operator's maloperation thus, further promote the precision of gesture control system to the identification of operator's gesture motion.
As shown in Figure 9, fourth embodiment of the invention proposes a kind of gesture operation control device, on the basis of above-mentioned the 3rd embodiment, also comprises:
The difference of present embodiment and above-mentioned the 3rd embodiment is that present embodiment comprises that also system is according to the scheme of operator's the corresponding function of gesture operation adjustment.
Particularly, present embodiment has corresponding terminal regulatory function according to the different gesture operation coupling of operator in advance, and establish a gesture recognition function table with this corresponding relation, wave to represent adjusting television sound volume size such as horizontal direction, setting the expression of waving simultaneously left increases volume, and the expression of waving to the right reduces volume, after moving 20cm from left to right when gesture, for the volume adjustment increases a unit, etc.
TV gesture control system is when the gesture operation that identifies the operator is normal operational order, carry out calling of corresponding function, at first can remove to search default gesture identification menu according to the operator operator image information of obtaining, according to the corresponding corresponding function of terminal of adjusting of lookup result.Thereby realize the purpose by operator's gesture operation control TV functions.
As shown in figure 10, fifth embodiment of the invention proposes a kind of gesture operation control device, on the basis of above-mentioned the 4th embodiment, also comprises:
Configuration module 200, it is described apart from matching list and gesture identification menu to be used for configuration.
The difference of present embodiment and above-mentioned the 4th embodiment is that present embodiment also comprises the described scheme apart from matching list and gesture identification menu of configuration.
Particularly, the operator can dispose apart from matching list and gesture identification menu according to the default option, such as TV gesture control system gesture operation prompting menu can be set, remind the function choosing-item of the correct distance range of operator and gesture correspondence by the mode of gesture operation prompting menu.
Present embodiment is by such scheme, and configuration is apart from matching list and gesture identification menu, and acquisition operations person's image information; Obtain operator's identity information according to operator's image information identifying operation person's identity; Search apart from matching list according to operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and be shown to the operator, make the gesture control system can remind the coverage of the relative intelligent display terminal of operator automatically, not only promote the precision of gesture control system to the identification of operator's gesture motion, and avoided the operator to cause the operation injury; Remove to search the gesture identification menu according to operator's image information of obtaining in addition, according to the corresponding corresponding function of terminal of adjusting of lookup result, realize the purpose by operator's gesture operation control TV functions.
Need to prove that above-mentioned each functional module can be controlled by the CPU (microprocessor) of TV.
In addition, the present invention also proposes a kind of intelligent display terminal, and this intelligent display terminal comprises the device described in the above-mentioned any embodiment, and wherein, this intelligent display terminal can be display devices such as intelligent television.
Embodiment of the invention gesture operation control method, device and intelligent display terminal are by acquisition operations person's image information; Obtain operator's identity information according to operator's image information identifying operation person's identity; Search default apart from matching list according to operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and be shown to the operator, make the gesture control system can remind the coverage of the relative intelligent display terminal of operator automatically, not only promote the precision of gesture control system to the identification of operator's gesture motion, and avoided the operator to cause the operation injury; Remove to search the gesture identification menu according to operator's image information of obtaining in addition, according to the corresponding corresponding function of terminal of adjusting of lookup result, realize the purpose by operator's gesture operation control TV functions.
The above only is the preferred embodiments of the present invention; be not so limit claim of the present invention; every equivalent structure or flow process conversion that utilizes instructions of the present invention and accompanying drawing content to do; or directly or indirectly be used in other relevant technical field, all in like manner be included in the scope of patent protection of the present invention.
Claims (15)
1. a gesture operation control method is characterized in that, comprising:
Acquisition operations person's image information;
According to described operator's image information identifying operation person's identity, obtain operator's identity information;
Search defaultly apart from matching list according to described operator's identity information, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.
2. method according to claim 1 is characterized in that, also comprises after the step of described acquisition operations person's image information:
Described operator's image information is carried out size intercepting, color conversion and/or denoising.
3. method according to claim 1 is characterized in that, the step of described identity information according to operator's image information identifying operation person comprises:
From described operator's image information, obtain operator's head image information;
Search default image library according to described operator's head image information, obtain operator's identity information.
4. according to each described method among the claim 1-3, it is characterized in that, also comprise after the step of described acquisition operations person's image information:
Whether be operator's operational order according to the current gesture motion of described operator's image information decision operation person; If then execution in step is according to described operator's image information identifying operation person's identity information; Otherwise, do not deal with.
5. method according to claim 4 is characterized in that, whether described be that the step of operator's operational order comprises according to the current gesture motion of operator's image information decision operation person:
Adopt the mode of multiple target tracking to make up manikin;
Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification;
If the gesture feature data that current operator's image information is the operator judge that then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.
6. method according to claim 5 is characterized in that, effective gesture operation distance of the relative terminal of the described operator of obtaining also reminds operator's step also to comprise afterwards:
Search default gesture identification menu according to operator's image information, according to the corresponding corresponding function of terminal of adjusting of lookup result.
7. method according to claim 6 is characterized in that, also comprises before the step of described acquisition operations person's image information:
Dispose described apart from matching list and gesture identification menu.
8. a gesture operation control device is characterized in that, comprising:
Acquisition module is used for acquisition operations person's image information;
Identification module is used for the identity according to described operator's image information identifying operation person, obtains operator's identity information;
Obtain prompting module, be used for searching according to described operator's identity information default apart from matching list, obtain effective gesture operation distance of the relative terminal of operator and remind the operator.
9. device according to claim 8 is characterized in that, also comprises:
Processing module is used for described operator's image information is carried out size intercepting, color conversion and/or denoising.
10. device according to claim 8 is characterized in that, described identification module also is used for obtaining from described operator's image information operator's head image information; Search default image library according to described operator's head image information, obtain operator's identity information.
11. each described device is characterized in that according to Claim 8-10, also comprises:
Judge module, whether be used for according to the current gesture motion of described operator's image information decision operation person is operator's operational order; If, then by the identity information of described identification module according to described operator's image information identifying operation person; Otherwise, do not deal with.
12. device according to claim 11 is characterized in that, described judge module also is used for adopting the mode of multiple target tracking to make up manikin; Based on described manikin described operator's image information is carried out track differentiation and dynamic gesture identification; If the gesture feature data that current operator's image information is the operator judge that then current gesture motion is operator's operational order; Otherwise, be operator's maloperation.
13. device according to claim 11 is characterized in that, also comprises:
Execution module is used for searching default gesture identification menu according to operator's image information, according to the corresponding corresponding function of terminal of adjusting of lookup result.
14. device according to claim 13 is characterized in that, also comprises:
Configuration module, it is described apart from matching list and gesture identification menu to be used for configuration.
15. an intelligent display terminal is characterized in that, comprises each described device among the claim 8-14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310191402.XA CN103295028B (en) | 2013-05-21 | 2013-05-21 | gesture operation control method, device and intelligent display terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310191402.XA CN103295028B (en) | 2013-05-21 | 2013-05-21 | gesture operation control method, device and intelligent display terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103295028A true CN103295028A (en) | 2013-09-11 |
| CN103295028B CN103295028B (en) | 2018-09-04 |
Family
ID=49095855
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310191402.XA Active CN103295028B (en) | 2013-05-21 | 2013-05-21 | gesture operation control method, device and intelligent display terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103295028B (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104856729A (en) * | 2015-05-25 | 2015-08-26 | 无锡海斯凯尔医学技术有限公司 | Operating control method of elasticity detection equipment and elasticity detection equipment |
| CN105045140A (en) * | 2015-05-26 | 2015-11-11 | 深圳创维－Rgb电子有限公司 | Method and device for intelligently controlling controlled equipment |
| CN105700683A (en) * | 2016-01-12 | 2016-06-22 | 厦门施米德智能科技有限公司 | Intelligent window and control method thereof |
| WO2016155639A1 (en) * | 2015-04-01 | 2016-10-06 | 徐伟强 | Smart control device and system |
| CN106105247A (en) * | 2014-03-14 | 2016-11-09 | 三星电子株式会社 | Display device and control method thereof |
| CN106369737A (en) * | 2016-08-19 | 2017-02-01 | 珠海格力电器股份有限公司 | air conditioner control processing method and device |
| CN106462681A (en) * | 2014-06-10 | 2017-02-22 | 联发科技股份有限公司 | Electronic device controlling and user registration method |
| CN106648040A (en) * | 2015-11-02 | 2017-05-10 | 重庆邮电大学 | Terminal control method and device |
| WO2017101659A1 (en) * | 2015-12-16 | 2017-06-22 | 华为技术有限公司 | Control method and apparatus |
| CN107533519A (en) * | 2015-09-02 | 2018-01-02 | Nec平台株式会社 | Notify control device, notification control method and notification control program |
| CN107678287A (en) * | 2017-09-18 | 2018-02-09 | 广东美的制冷设备有限公司 | Apparatus control method, device and computer-readable recording medium |
| CN107908277A (en) * | 2017-09-30 | 2018-04-13 | 珠海格力电器股份有限公司 | Control device, equipment and control method |
| CN108021880A (en) * | 2017-11-30 | 2018-05-11 | 宁波高新区锦众信息科技有限公司 | A kind of intelligent home control system based on gesture identification |
| CN108460354A (en) * | 2018-03-09 | 2018-08-28 | 深圳臻迪信息技术有限公司 | Unmanned aerial vehicle (UAV) control method, apparatus, unmanned plane and system |
| WO2018161893A1 (en) * | 2017-03-06 | 2018-09-13 | 华为技术有限公司 | User identification method and device |
| CN111603072A (en) * | 2019-02-22 | 2020-09-01 | 合盈光电（深圳）有限公司 | Conditioning machine driven by gestures |
| CN111736693A (en) * | 2020-06-09 | 2020-10-02 | 海尔优家智能科技（北京）有限公司 | Gesture control method and device of intelligent equipment |
| CN112328087A (en) * | 2020-11-19 | 2021-02-05 | 成都金都超星天文设备有限公司 | Method for controlling planetarium by gestures and control system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010063788A (en) * | 1999-12-24 | 2001-07-09 | 오길록 | Method For Gesture Recognition Using Border-Centroid Distance Of Object |
| CN1917564A (en) * | 2006-08-24 | 2007-02-21 | 中山大学 | Device of controlling receiving destance and authority for digital TV set |
| US20080019589A1 (en) * | 2006-07-19 | 2008-01-24 | Ho Sub Yoon | Method and apparatus for recognizing gesture in image processing system |
| CN101437124A (en) * | 2008-12-17 | 2009-05-20 | 三星电子（中国）研发中心 | Method for processing dynamic gesture identification signal facing (to)television set control |
| CN102662460A (en) * | 2012-03-05 | 2012-09-12 | 清华大学 | Non-contact control device of mobile terminal and control method thereof |
-
2013
- 2013-05-21 CN CN201310191402.XA patent/CN103295028B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20010063788A (en) * | 1999-12-24 | 2001-07-09 | 오길록 | Method For Gesture Recognition Using Border-Centroid Distance Of Object |
| US20080019589A1 (en) * | 2006-07-19 | 2008-01-24 | Ho Sub Yoon | Method and apparatus for recognizing gesture in image processing system |
| CN1917564A (en) * | 2006-08-24 | 2007-02-21 | 中山大学 | Device of controlling receiving destance and authority for digital TV set |
| CN101437124A (en) * | 2008-12-17 | 2009-05-20 | 三星电子（中国）研发中心 | Method for processing dynamic gesture identification signal facing (to)television set control |
| CN102662460A (en) * | 2012-03-05 | 2012-09-12 | 清华大学 | Non-contact control device of mobile terminal and control method thereof |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106105247A (en) * | 2014-03-14 | 2016-11-09 | 三星电子株式会社 | Display device and control method thereof |
| CN106462681A (en) * | 2014-06-10 | 2017-02-22 | 联发科技股份有限公司 | Electronic device controlling and user registration method |
| WO2016155639A1 (en) * | 2015-04-01 | 2016-10-06 | 徐伟强 | Smart control device and system |
| CN104856729A (en) * | 2015-05-25 | 2015-08-26 | 无锡海斯凯尔医学技术有限公司 | Operating control method of elasticity detection equipment and elasticity detection equipment |
| CN105045140A (en) * | 2015-05-26 | 2015-11-11 | 深圳创维－Rgb电子有限公司 | Method and device for intelligently controlling controlled equipment |
| CN105045140B (en) * | 2015-05-26 | 2019-01-01 | 深圳创维－Rgb电子有限公司 | The method and apparatus of intelligent control controlled plant |
| WO2016187964A1 (en) * | 2015-05-26 | 2016-12-01 | 深圳创维－Rgb电子有限公司 | Method and apparatus for intelligently controlling controlled device |
| CN107533519A (en) * | 2015-09-02 | 2018-01-02 | Nec平台株式会社 | Notify control device, notification control method and notification control program |
| CN106648040B (en) * | 2015-11-02 | 2019-12-13 | 重庆邮电大学 | Terminal control method and device |
| CN106648040A (en) * | 2015-11-02 | 2017-05-10 | 重庆邮电大学 | Terminal control method and device |
| WO2017101659A1 (en) * | 2015-12-16 | 2017-06-22 | 华为技术有限公司 | Control method and apparatus |
| CN105700683A (en) * | 2016-01-12 | 2016-06-22 | 厦门施米德智能科技有限公司 | Intelligent window and control method thereof |
| CN106369737A (en) * | 2016-08-19 | 2017-02-01 | 珠海格力电器股份有限公司 | air conditioner control processing method and device |
| WO2018161893A1 (en) * | 2017-03-06 | 2018-09-13 | 华为技术有限公司 | User identification method and device |
| CN107678287A (en) * | 2017-09-18 | 2018-02-09 | 广东美的制冷设备有限公司 | Apparatus control method, device and computer-readable recording medium |
| CN107908277B (en) * | 2017-09-30 | 2019-12-03 | 珠海格力电器股份有限公司 | Control device, equipment and control method |
| CN107908277A (en) * | 2017-09-30 | 2018-04-13 | 珠海格力电器股份有限公司 | Control device, equipment and control method |
| CN108021880A (en) * | 2017-11-30 | 2018-05-11 | 宁波高新区锦众信息科技有限公司 | A kind of intelligent home control system based on gesture identification |
| CN108460354A (en) * | 2018-03-09 | 2018-08-28 | 深圳臻迪信息技术有限公司 | Unmanned aerial vehicle (UAV) control method, apparatus, unmanned plane and system |
| CN111603072A (en) * | 2019-02-22 | 2020-09-01 | 合盈光电（深圳）有限公司 | Conditioning machine driven by gestures |
| CN111736693A (en) * | 2020-06-09 | 2020-10-02 | 海尔优家智能科技（北京）有限公司 | Gesture control method and device of intelligent equipment |
| CN111736693B (en) * | 2020-06-09 | 2024-03-22 | 海尔优家智能科技（北京）有限公司 | Gesture control method and device of intelligent equipment |
| CN112328087A (en) * | 2020-11-19 | 2021-02-05 | 成都金都超星天文设备有限公司 | Method for controlling planetarium by gestures and control system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103295028B (en) | 2018-09-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103295028A (en) | Gesture operation control method, gesture operation control device and intelligent display terminal | |
| CN102193626B (en) | Gesture recognition apparatus, and method for controlling gesture recognition apparatus | |
| KR101603017B1 (en) | Gesture recognition device and gesture recognition device control method | |
| CN102200830A (en) | Non-contact control system and control method based on static gesture recognition | |
| US20130222232A1 (en) | Gesture recognition device and method thereof | |
| CN111047621B (en) | Target object tracking method, system, equipment and readable medium | |
| CN103295029A (en) | Interaction method and device of gesture control terminal | |
| CN102236413A (en) | Interface apparatus and gesture recognition method | |
| CN110929770A (en) | Intelligent tracking method, system and equipment based on image processing and readable medium | |
| CN105425964A (en) | Gesture identification method and system | |
| US9213413B2 (en) | Device interaction with spatially aware gestures | |
| CN107463903B (en) | Face key point positioning method and device | |
| CN103375880A (en) | Remote control device and method for air conditioner | |
| CN110929619A (en) | Target object tracking method, system and device based on image processing and readable medium | |
| CN104036240A (en) | Face feature point positioning method and device | |
| US11816924B2 (en) | Method for behaviour recognition based on line-of-sight estimation, electronic equipment, and storage medium | |
| CN103886284A (en) | Character attribute information identification method and device and electronic device | |
| US20220206576A1 (en) | Wearable electroencephalography sensor and device control methods using same | |
| CN105630239B (en) | Operate detection method and device | |
| CN113934307B (en) | Method for starting electronic equipment according to gestures and scenes | |
| CN105718033A (en) | Fatigue detection system and method | |
| KR102079033B1 (en) | Mobile terminal and method for controlling place recognition | |
| CN106228193A (en) | Image classification method and device | |
| CN104063041A (en) | Information processing method and electronic equipment | |
| KR20160054799A (en) | Remote controll device and operating method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |