CN109542239A - A kind of gestural control method, gesture equipment and system - Google Patents
A kind of gestural control method, gesture equipment and system Download PDFInfo
- Publication number
- CN109542239A CN109542239A CN201910041072.3A CN201910041072A CN109542239A CN 109542239 A CN109542239 A CN 109542239A CN 201910041072 A CN201910041072 A CN 201910041072A CN 109542239 A CN109542239 A CN 109542239A
- Authority
- CN
- China
- Prior art keywords
- hand
- keyboard
- gesture
- mode
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000004044 response Effects 0.000 claims abstract description 51
- 230000033001 locomotion Effects 0.000 claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 16
- 230000009471 action Effects 0.000 claims description 37
- 238000004020 luminiscence type Methods 0.000 claims description 29
- 238000004891 communication Methods 0.000 claims description 20
- 210000004247 hand Anatomy 0.000 claims description 19
- 241000905957 Channa melasoma Species 0.000 claims description 15
- 239000012141 concentrate Substances 0.000 claims description 15
- 210000001037 metacarpus Anatomy 0.000 claims description 12
- 238000005096 rolling process Methods 0.000 claims description 12
- 239000011159 matrix material Substances 0.000 claims description 9
- 230000003321 amplification Effects 0.000 claims description 7
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 7
- 230000005611 electricity Effects 0.000 claims description 4
- 239000011800 void material Substances 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 8
- 230000001419 dependent effect Effects 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 19
- 230000008859 change Effects 0.000 description 12
- 210000000707 wrist Anatomy 0.000 description 11
- 230000006870 function Effects 0.000 description 9
- 238000013461 design Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 210000000245 forearm Anatomy 0.000 description 6
- 230000008447 perception Effects 0.000 description 5
- 241001269238 Data Species 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 238000012216 screening Methods 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 238000013480 data collection Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003760 hair shine Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000007630 basic procedure Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000036544 posture Effects 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 206010003246 arthritis Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 208000018937 joint inflammation Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 208000011580 syndromic disease Diseases 0.000 description 1
- 230000035922 thirst Effects 0.000 description 1
- 238000010415 tidying Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 210000003857 wrist joint Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
The embodiment of the present application provides a kind of gesture equipment, gesture system and gestural control method, gesture equipment can perceive hand motion by sensor and generate gesture data, then handled to obtain output order by processor and be sent to terminal and control to terminal can be realized.Effective control to terminal device can be realized by above-mentioned gesture equipment in this way, do not need the limitation again dependent on operation planars such as keyboard, mouses, can make user's operation is spatially to obtain bigger freedom degree, and user experience is more preferable.In addition, gesture data is directly carried out special processing by gesture equipment and obtains output order in the application, it is ensured that identification is efficient, promotes recognition efficiency, achievees the effect that quick response, and further the user experience is improved.
Description
Technical field
This application involves field of intelligent control technology, in particular to a kind of gestural control method, gesture equipment and are
System.
Background technique
Under Information Age of making rapid progress, electronic communication brings unprecedented science and technology to us and experiences,
But people increasingly thirst for obtaining more freedom degrees over time and space simultaneously.However, traditional I/O (input/output)
Our operating space of equipment limit such as generally requires dependent on keyboard and mouse the control of computer, even and flat
The appearance of plate computer does not still get rid of the limitation of operation planar.
Summary of the invention
In view of this, the embodiment of the present application is designed to provide a kind of gestural control method, gesture equipment and system, with
So that user obtains more freedom degrees on operating space.
The embodiment of the present application provides a kind of gestural control method, comprising: perception hand motion generates gesture data；According to
The gesture data and preset gesture instruction collection determine that the gesture data concentrates corresponding simulation in the gesture instruction
The output order of input unit；And the output order is sent to terminal.
During above-mentioned realization, gesture data is generated by first perceiving hand motion, further according to gesture data and is preset
Gesture instruction collection determine that gesture data concentrates the output order of corresponding analogue input unit in gesture instruction, and then will be defeated
Instruction is sent to terminal out, to realize the control to terminal.The gesture data by corresponding to hand exercise is only needed in this way
Effective control to terminal device can be realized, do not need the limitation again dependent on operation planars such as keyboard, mouses, can make
User's operation is spatially to obtain bigger freedom degree, and user experience is more preferable.In addition, gesture data is directly by hand in the application
Gesture equipment obtains output order to carry out special processing, it is ensured that identification is efficient, promotes recognition efficiency, reaches quick sound
The effect answered, further the user experience is improved.Meanwhile whole system can be based on standard interface between hardware system and general
Instruction also reduces the data transfer rate amount of equipment room to realize.
Further, described to determine the gesture data in institute according to the gesture data and preset gesture instruction collection
Stating gesture instruction and concentrating the output order of corresponding analogue input unit includes: to handle the gesture data, is parsed
Meet the hand signal of the gesture instruction collection；The gesture is determined according to the current input mode of the analogue input unit
Signal concentrates corresponding output order in the gesture instruction.
During above-mentioned realization, the screening of gesture data can be first carried out, determining has which in gesture data be effective
Data (i.e. hand signal), then confirm instruction, it can effectively guarantee the confirmation efficiency of subsequent instructions, avoid unnecessary gesture
The interference that data compare instruction.In addition, being according to analogue input unit when carrying out confirmation command during above-mentioned realization
Current input mode come what is determined, i.e., the current input mould of analogue input unit is also relied on when output order is accepted really
Formula, the confirmation that this is allowed for output order are more accurate.And the selection of gesture instruction collection considers gesture collector with angle
The characteristics of degree and acceleration metering are main, while having also contemplated and being not easy the characteristics of obscuring between gesture.
Further, when the analogue input unit includes dummy keyboard, described according to the gesture data and pre-
If gesture instruction collection determine that the gesture data concentrates the output of corresponding analogue input unit to refer in the gesture instruction
After order, further includes: output order relevant to the dummy keyboard is sent to keyboard ancillary equipment, so that the keyboard is auxiliary
Equipment is helped to be shone in specific region according to the output order received to prompt the response region or word of the dummy keyboard
Symbol.
During above-mentioned realization, the prompt of the manipulation of the dummy keyboard carried out to user may be implemented, so that user is logical
Crossing keyboard ancillary equipment can more adapt to realize the control to terminal by above-mentioned gestural control method.
Further, the light emitting region on the response region or character of the dummy keyboard, with the keyboard ancillary equipment
Between corresponding relationship include at least one of:
The left hand keyboard region of dummy keyboard responds, and the left hand keyboard region of corresponding keyboard ancillary equipment is bright；
The left hand full key board panel of dummy keyboard responds, and the left hand of corresponding keyboard ancillary equipment and right hand keyboard region are bright；
The right hand keyboard region of dummy keyboard responds, and the right hand keyboard region of corresponding keyboard ancillary equipment is bright；
The right hand full key board panel of dummy keyboard responds, and the left hand of corresponding keyboard ancillary equipment and right hand keyboard region are bright；
The capitalization keyboard response of dummy keyboard, the upper case character lamp all light of corresponding keyboard ancillary equipment；
The right hand number key panel of dummy keyboard responds, and the right hand number key panel of corresponding keyboard ancillary equipment is bright；
The right-hand direction keyboard region of dummy keyboard responds, and the right-hand direction keyboard region of corresponding keyboard ancillary equipment is bright；
Certain a line of dummy keyboard responds, and the row of corresponding keyboard ancillary equipment is bright；
The character of a certain character response of dummy keyboard, corresponding keyboard ancillary equipment is bright；
The relevant range of the small letter keyboard response of dummy keyboard, corresponding keyboard ancillary equipment does not work.
During above-mentioned realization, can enable the user to clearly understand know mode locating for current keyboard and
Judge whether switched keyboard mode is wanted mode.
Further, the analogue input unit includes dummy keyboard and virtual mouse, and the gesture instruction collection includes hand
The corresponding relationship of gesture data and instruction, the corresponding relationship includes at least one of:
A holds the gesture data that fist unclamps again, corresponding instruction are as follows: A hand keyboard pattern switching is cut to A hand mouse mode
Change instruction；
B holds the gesture data that fist unclamps again, corresponding instruction are as follows: B hand keyboard pattern switching is cut to B hand mouse mode
Change instruction；
Left-hand palm rotation n (n be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: all
Switching command, and/or right hand numeric keypad mode and directional pad between small letter keyboard mode and all Caps keyboard mode
Switching command between mode；
Right hand palm rotation m (m be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: the right hand
Switching command, and/or right hand small letter keyboard mode and numeric keypad mode between capitalization keyboard mode and directional pad mode
Between switching command；
Left or right hand lift or put down β (β be it is preset be greater than 0 number) angle gesture data, corresponding instruction are as follows: key
The switching command that disk in the ranks switches；
B hand palm rotation m (m be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: the right hand
Switching command between plane mouse mode and right hand facade mouse mode；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to precise positioning mouse mould
Switching command between formula；
The gesture data that B hands down, corresponding instruction are as follows: the precise positioning mouse mode of B hand is switched to plane mouse mould
The switching command of formula；
The mobile gesture data in B hand front, rear, left and right, corresponding instruction are as follows: the plane mouse front, rear, left and right of B hand are moved
Dynamic move；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to accurate plane mouse mould
The switching command of formula；
The gesture data that B hands down, corresponding instruction are as follows: the accurate plane mouse mode of B hand is switched to plane mouse mould
The switching command of formula；
The mobile gesture data in B hand upper and lower, left and right, corresponding instruction are as follows: the facade mouse upper and lower, left and right of B hand are moved
Dynamic move；
The gesture data of B hand Forward, corresponding instruction are as follows: the facade mouse mode of B hand is switched to accurate facade mouse mould
The switching command of formula；
The gesture data that B hand retreats, corresponding instruction are as follows: the accurate facade mouse mode of B hand is switched to facade mouse mould
The switching command of formula；
The mobile gesture data of A hand up, down, left, right, before and after, corresponding instruction are as follows: the mouse auxiliary of A hand the page into
The status switching instruction of rolling, lower rolling, preceding page turning, rear page turning, amplification, diminution on row；
The gesture data of A hand and the contact of B hand the back of the hand, corresponding instruction are as follows: realize the operational order of device power-up or shutdown；
Under the keyboard mode, the dummy keyboard is divided into left hand keyboard area and right hand keyboard area；The mouse mould
Under formula, the A hand is left hand, and the B hand is the right hand or the A hand is the right hand, and the B hand is left hand.
Above-mentioned realization process is based on ergonomics, carries out the definition of gesture instruction collection, that is, is conducive to the accurate knowledge of gesture
Not, user is also convenient for operate by gesture.
Further, the gestural control method further include: according to the current input mode of the analogue input unit with
And the corresponding relationship of preset input pattern and control instruction, determine that the current input mode of the analogue input unit is corresponding
Control instruction, and the control instruction is sent to terminal.
Above-mentioned realization process determines corresponding instruction based on the current input mode of analogue input unit automatically, so that
The patterns of change of gesture equipment is more intelligent, and user experience is more preferable.
Further, the analogue input unit includes dummy keyboard and virtual mouse；The input pattern refers to control
The corresponding relationship of order includes at least one of: the current input mode is switched to mouse mode, B by keyboard mode for A hand
When hand is half keyboard mode, the control instruction are as follows: switching command of the B hand half keyboard pattern switching to B hand full keyboard mode；Institute
When to state current input mode be that A hand by mouse mode is switched to keyboard mode, B hand is full keyboard mode, the control instruction are as follows:
Switching command of the B hand full keyboard pattern switching to B hand half keyboard mode；The current input mode is that B hand is cut by keyboard mode
Change to mouse mode, A hand be half keyboard mode when, the control instruction are as follows: A hand half keyboard pattern switching to A hand full keyboard mould
The switching command of formula；When the current input mode is that B hand by mouse mode is switched to keyboard mode, A hand is full keyboard mode,
The control instruction are as follows: switching command of the A hand full keyboard pattern switching to A hand half keyboard mode；It is described under the keyboard mode
Dummy keyboard is divided into left hand keyboard area and right hand keyboard area；Under the mouse mode, the A hand is left hand, and the B hand is
The right hand or the A hand are the right hand, and the B hand is left hand.
Above-mentioned realization process actually enters mode based on current, the definition of instruction corresponding relationship is carried out, so that gesture is set
Standby patterns of change is more intelligent, and user experience is more preferable.
Present invention also provides a kind of gesture equipment, comprising: the first hand equipment, first hand equipment include processing
Device and sensor；The sensor generates gesture data to perceive hand motion；The processor is for obtaining the sensing
The gesture data that device generates, determines the gesture data in the hand according to the gesture data and preset gesture instruction collection
The output order of corresponding analogue input unit in gesture instruction set, and the output order is sent to exterior terminal.
In above-mentioned realization structure, gesture equipment can perceive hand motion by sensor and generate gesture data, then lead to
It crosses processor and is handled to obtain output order and be sent to terminal and control to terminal can be realized.Pass through above-mentioned gesture in this way
Effective control to terminal device can be realized in equipment, does not need the limitation again dependent on the operation planars such as keyboard, mouse, can be with
So that user's operation is spatially to obtain bigger freedom degree, user experience is more preferable.In addition, gesture data is direct in the application
Special processing is carried out by gesture equipment and obtains output order, it is ensured that recognition accuracy promotes recognition efficiency, reaches fast
The effect of speed response, further the user experience is improved.
In the first aspect, the gesture equipment further includes the second hand equipment and signal connector；Second hand
Equipment includes processor and sensor；The processor of first hand equipment and the second hand equipment respectively with the signal
Connector communication connection, and the output order is sent to by the exterior terminal by the signal connector.
In above-mentioned realization structure, gesture equipment includes two hand equipments, can be separately positioned on two hands of user
On, more meet human body reality.And two hand equipments realize the communication with terminal by signal connector, it is ensured that gesture
Signal of communication between equipment and terminal is more preferable.Furthermore the first hand equipment and the second hand device structure are consistent in process flow
Upper more preferable production, cost of manufacture are smaller.
Further, the processor of first hand equipment and the second hand equipment includes Acquisition Circuit, movement knowledge
Other circuit and data-phone；The signal connector includes signal processor；The Acquisition Circuit acquires hand from sensor
Gesture Data Concurrent gives the action recognition circuit；The action recognition circuit handles the gesture data, parses
Meet the hand signal of the gesture instruction collection, and the hand signal is sent to by the signal by the data-phone
Processor；The signal processor determines the hand signal received in the hand according to the current state of analogue input unit
Corresponding output order in gesture instruction set, and the output order is sent to exterior terminal.
In above-mentioned realization structure, the determination of output order is specially executed by signal connector, and effect is more preferable, simultaneously
It can be compatible with the industry interface and signal standards of current keyboard and mouse, exterior terminal need not carry out additional program installation and set
It sets, it can be with plug and play.And the first hand equipment and the second hand equipment exclusively carry out the acquisition and screening of gesture data, so that
First hand equipment and the second hand equipment it is more preferable for the acquisition of gesture data and screening effect, performance is more powerful.
In the second aspect, the gesture equipment further includes the second hand equipment；Second hand equipment includes processing
Device, sensor and the first data-phone；The processing of the processor of first hand equipment and second hand equipment
Device communication connection, and the processor of first hand equipment is logical by first data-phone and the exterior terminal
Letter.
In above-mentioned realization structure, gesture equipment includes two hand equipments, can be separately positioned on two hands of user
On, more meet human body reality.And two hand equipments only realize the communication with terminal by one of equipment, it can be in order to
Terminal carries out identification management.
Further, the processor of first hand equipment and the second hand equipment includes Acquisition Circuit, movement knowledge
Other circuit and the second data-phone；Second hand equipment further includes signal processor；The Acquisition Circuit is from sensor
Place's acquisition gesture data is simultaneously sent to the action recognition circuit；The action recognition circuit to the gesture data at
Reason parses the hand signal for meeting the gesture instruction collection, and passes through second data-phone for the hand signal
It is sent to the signal processor；The signal processor determines the hand received according to the current state of analogue input unit
Gesture signal concentrates corresponding output order in the gesture instruction, and passes through first data-phone for the output order
It is sent to exterior terminal.
In above-mentioned realization structure, one signal processor of design is only needed to carry out hand signal in two hand equipments
The processing of corresponding instruction, reduces infrastructure cost.Meanwhile it the data after gesture identification are passed into signal connector can drop
The volume of transmitted data of low equipment room reduces the data processing pressure of signal connector, improves the response speed of integral device.
Further, the sensor includes finger portion sensor；Finger portion sensor can be set to the first of finger
At articulations digitorum manus and/or at the second articulations digitorum manus.
In above-mentioned realization structure, the portion sensor of finger is set at the first articulations digitorum manus of finger and/or at the second articulations digitorum manus,
When no fixed pan, palm elbow are without fixed special support, it is only limitted under keyboard and mouse emulation scene, human finger master
Movement is realized by the first articulations digitorum manus, the second articulations digitorum manus and tip portion are substantially passive movements, therefore according to this
The scheme of case only needs to be arranged on the first articulations digitorum manus, can reduce gesture complexity, improves recognition accuracy and promotes number
According to collecting efficiency,.In addition, sensor setting interfered for a user at the first articulations digitorum manus it is smaller, less influence user exist
Other activities of other non-keyboards and mouse action are carried out while wearing；Interfacility link road can be allowed to contract in hardware configuration
Short, miniaturization and the wearing for being conducive to equipment are convenient.
Further, the sensor further includes metacarpus sensor；The metacarpus sensor is set in the processor
For perceiving palm action to generate gesture data.
In above-mentioned realization structure, the motion information of palm is acquired using special metacarpus sensor (before such as palm
Under rear left upper right, overturn), certain gestures required for this case can be provided.These gesture designs based on ergonomics,
Rotational characteristics around human synovial are designed, and identify accuracy in raising gesture data collection accuracy and gesture motion
Meanwhile improving comfort；Furthermore this gesture design is matched with attitude transducer based on angle calculation mode, improves people
Machine integrated adaptability.What is matched therewith is the layout designs of the keypad space of spherical surface matrix, can cooperate human body very well
It is more more humane than the keypad space design of conventional two-way array using elbow as the move mode of origin.
Further, the gesture equipment further includes switch module；The switch module include: be set to it is described first-hand
The first power switch, the first Hall sensor and the first magnetic patch in portion's equipment, and be set in second hand equipment
Second source switch, the second Hall sensor and the second magnetic patch；When first hand equipment and the second hand equipment are close
And after separating, the magnetic field of first magnetic patch and the second magnetic patch generates variation, makes first Hall sensor and the second Hall
Sensor generates electric current, and first power switch and second source is driven to open or close.
In above-mentioned realization structure, user can be realized control gesture and set after two hand equipments are close and separated
Standby opens or closes, i.e., user can realize the switch of the power supply to gesture equipment by gesture, and user's operation is simple, makes
With convenient, user experience height.
Further, the analogue input unit includes dummy keyboard；The dummy keyboard is space spherical surface matrix structure.
In above-mentioned realization structure, dummy keyboard is space spherical surface matrix structure, and user, can be with both hands in manipulation
Elbow and/or wrist are the origin of spherical surface keyboard, and palm is lifted using elbow and/or wrist as origin up and down with forearm puts certain angle
Degree can position different keyboard rows, and palm is swung certain angle with forearm using elbow and/or wrist as origin
The keyboard column of each finger control are positioned, control is more flexible, and can adapt to human motion feature to the greatest extent.
Further, the analogue input unit includes dummy keyboard and virtual mouse, and the gesture instruction collection includes hand
The corresponding relationship of gesture data and instruction, the corresponding relationship includes at least one of:
A holds the gesture data that fist unclamps again, corresponding instruction are as follows: A hand keyboard pattern switching is cut to A hand mouse mode
Change instruction；
B holds the gesture data that fist unclamps again, corresponding instruction are as follows: B hand keyboard pattern switching is cut to B hand mouse mode
Change instruction；
Left-hand palm rotation n (n be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: all
Switching command, and/or numeric keypad mode and directional pad mode between small letter keyboard mode and all Caps keyboard mode
Between switching command；
Right hand palm rotation m1 (m1 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: right
Switching command, and/or right hand small letter keyboard mode and numeric keypad mould between hand capitalization keyboard mode and directional pad mode
Switching command between formula；
Left or right hand lift or put down β (β be it is preset be greater than 0 number) angle gesture data, corresponding instruction are as follows: key
The switching command that disk in the ranks switches；
B hand palm rotation m2 (m2 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: right
Switching command between hand plane mouse mode and right hand facade mouse mode；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to precise positioning mouse mould
Switching command between formula；
The gesture data that B hands down, corresponding instruction are as follows: the precise positioning mouse mode of B hand is switched to plane mouse mould
The switching command of formula；
The mobile gesture data in B hand front, rear, left and right, corresponding instruction are as follows: the plane mouse front, rear, left and right of B hand are moved
Dynamic move；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to accurate plane mouse mould
The switching command of formula；
The gesture data that B hands down, corresponding instruction are as follows: the accurate plane mouse mode of B hand is switched to plane mouse mould
The switching command of formula；
The mobile gesture data in B hand upper and lower, left and right, corresponding instruction are as follows: the facade mouse upper and lower, left and right of B hand are moved
Dynamic move；
The gesture data of B hand Forward, corresponding instruction are as follows: the facade mouse mode of B hand is switched to accurate facade mouse mould
The switching command of formula；
The gesture data that B hand retreats, corresponding instruction are as follows: the accurate facade mouse mode of B hand is switched to facade mouse mould
The switching command of formula；
The mobile gesture data of A hand up, down, left, right, before and after, corresponding instruction are as follows: the mouse auxiliary of A hand the page into
The status switching instruction of rolling, lower rolling, preceding page turning, rear page turning, amplification, diminution on row；
The gesture data of A hand and the contact of B hand the back of the hand, corresponding instruction are as follows: realize the operational order of device power-up or shutdown；
Under the keyboard mode, the dummy keyboard is divided into left hand keyboard area and right hand keyboard area；The mouse mould
Under formula, the A hand is left hand, and the B hand is the right hand or the A hand is the right hand, and the B hand is left hand.
Above-mentioned realization structure is based on ergonomics, carries out the definition of gesture instruction collection, is carried out convenient for user by gesture
Operation.
Present invention also provides a kind of gesture system, the gesture including keyboard ancillary equipment and any of the above-described kind of structure is set
It is standby；The keyboard ancillary equipment and the gesture equipment communicate to connect, and receive the gesture equipment is sent and virtual key
The relevant output order of disk；The keyboard ancillary equipment is equipped with processor and luminescence unit；The processor is receiving
When the output order relevant to dummy keyboard that the gesture equipment is sent, the luminous list is controlled according to the output order
Member is shone in specific region to show the response region or character of dummy keyboard.
In above-mentioned realization structure, effective control to terminal device can be realized by gesture equipment by user, not need
Limitation dependent on operation planars such as keyboard, mouses again, can make user's operation is spatially to obtain bigger freedom degree
And more meeting the movement of ergonomics, user experience is more preferable.In addition, gesture data is directly carried out by gesture equipment specially
Processing obtain output order, it is ensured that identification accuracy promotes recognition efficiency, at the two-stage of gesture identification and signal identification
Reason achievees the effect that quick response while can reducing the volume of transmitted data of intermodule, and further the user experience is improved.This
Outside, the prompt that the manipulation to dummy keyboard carried out to user may be implemented by keyboard ancillary equipment, so that user passes through key
Disk ancillary equipment can more adapt to realize the control to terminal by above-mentioned gestural control method.
Further, the keyboard ancillary equipment is the entity pattern of preset dummy keyboard；The sound of the dummy keyboard
Region or character are answered, the corresponding relationship between the luminescence unit in the keyboard ancillary equipment includes at least one of:
The left hand keyboard region of dummy keyboard responds, and the left hand keyboard region luminescence unit of corresponding keyboard ancillary equipment is bright；
The left hand full key board panel of dummy keyboard responds, the left hand and right hand keyboard region luminescence unit of corresponding keyboard ancillary equipment
It is bright；
The right hand keyboard region of dummy keyboard responds, and the right hand keyboard region luminescence unit of corresponding keyboard ancillary equipment is bright；
The right hand full key board panel of dummy keyboard responds, the left hand and right hand keyboard region luminescence unit of corresponding keyboard ancillary equipment
It is bright；
The capitalization keyboard response of dummy keyboard, the upper case character lamp all light of corresponding keyboard ancillary equipment；
The right hand number key panel of dummy keyboard responds, the right hand number key panel luminescence unit of corresponding keyboard ancillary equipment
It is bright；
The right-hand direction keyboard region of dummy keyboard responds, the right-hand direction keyboard region luminescence unit of corresponding keyboard ancillary equipment
It is bright；
Certain a line of dummy keyboard responds, and the row luminescence unit of corresponding keyboard ancillary equipment is bright；
The character luminous unit of a certain character response of dummy keyboard, corresponding keyboard ancillary equipment is bright；
The relevant range luminescence unit of the small letter keyboard response of dummy keyboard, corresponding keyboard ancillary equipment does not work.
In above-mentioned realization structure, keyboard ancillary equipment is the entity pattern of preset dummy keyboard, so that user
Current manipulation position on the virtual keyboard can be easily corresponded to according to the prompt of keyboard ancillary equipment.In addition, above-mentioned
The keyboard knowing mode locating for current keyboard and judgement and being switched that corresponding relationship can enable the user to clearly understand
Whether mode is wanted mode.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application will make below to required in the embodiment of the present application
Attached drawing is briefly described, it should be understood that the following drawings illustrates only some embodiments of the application, therefore should not be seen
Work is the restriction to range, for those of ordinary skill in the art, without creative efforts, can be with
Other relevant attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of basic structure block diagram of gesture equipment provided by the embodiments of the present application；
Fig. 2 is a kind of structural schematic diagram of gesture equipment provided by the embodiments of the present application；
Fig. 3 is the structural schematic diagram of another gesture equipment provided by the embodiments of the present application；
Fig. 4 is a kind of structural block diagram of switch module provided by the embodiments of the present application；
Fig. 5 is a kind of structural block diagram of gesture system provided by the embodiments of the present application；
Fig. 6 is a kind of structural schematic diagram of keyboard ancillary equipment provided by the embodiments of the present application；
Fig. 7 is a kind of basic procedure schematic diagram of gestural control method provided by the present application；
Fig. 8 is the external connection schematic diagram in a kind of example 1 provided by the present application；
Fig. 9 is the circuit logic schematic diagram in a kind of example 1 provided by the present application；
Figure 10 is the external connection schematic diagram in a kind of example 2 provided by the present application；
Figure 11 is the circuit logic schematic diagram in a kind of example 2 provided by the present application；
Figure 12 is a kind of space corresponding diagram of keyboard and hand provided by the present application；
Figure 13 is a kind of dummy keyboard space corresponding diagram of space spherical surface matrix structure provided by the present application；
Figure 14-1 is a kind of optional realization structure of hand equipment provided by the present application；
Figure 14-2 is a kind of optional realization structure of sensor provided by the present application.
Specific embodiment
Below in conjunction with attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application is described.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.Meanwhile the application's
In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
Embodiment one:
Fig. 1 is please referred to, Fig. 1 is a kind of structural block diagram of gesture equipment provided by the embodiments of the present application.The gesture equipment 10
Including the first hand equipment 100, and the first hand equipment 100 includes processor 101 and sensor 102；Wherein: sensor 102
For perceiving hand motion and generating gesture data；Processor 101 is used to obtain the gesture data of the generation of sensor 102, according to
Gesture data and preset gesture instruction collection determine that gesture data concentrates the defeated of corresponding analogue input unit in gesture instruction
It instructs out, and output order is sent to exterior terminal.
It should be understood that user often more gets used to both hands operation, therefore hand in the present embodiment in practical applications
Gesture equipment can further include second hand equipment, and two hands that user is corresponded respectively to by two hand equipments carry out
Operation, to more meet organization of human body, so that user has better operating experience.
Shown in Figure 2 in a kind of mode in the cards, gesture equipment further includes the second hand equipment 110 and letter
Number connector 120；Wherein, the second hand equipment 110 includes processor 111 and sensor 112；First hand equipment 100
Processor 101 and the processor 111 of the second hand equipment 110 are communicated to connect with signal connector 120 respectively, and are connected by signal
It connects device 120 and output order is sent to exterior terminal.It is realized and end in this way, two hand equipments pass through signal connector 120
The communication at end, it is ensured that the signal of communication between gesture equipment and terminal is more preferable.
Illustratively, the processor of the first hand equipment 100 and the second hand equipment 110 includes Acquisition Circuit (processing
Acquisition Circuit is marked as 1011 in device 101, in processor 111 Acquisition Circuit marked as 1111), action recognition circuit (processor
Action recognition circuit numbers are 1012 in 101, and action recognition circuit numbers are 1112) (to locate with data-phone in processor 111
Data-phone is marked as 1013 in reason device 101, and data-phone is marked as 1113) in processor 111.And signal connector
120 include signal processor 121.
At this point, Acquisition Circuit 1011 acquires gesture data from sensor 102 and is sent to action recognition circuit 1012.So
Action recognition circuit 1012 handles gesture data afterwards, parses the hand signal for meeting gesture instruction collection, and pass through number
Hand signal is sent to signal processor 121 according to communicator 1013.Similarly, Acquisition Circuit 1111 acquires from sensor 112
Gesture data is simultaneously sent to action recognition circuit 1112.Then action recognition circuit 1112 handles gesture data, parsing
Meet the hand signal of gesture instruction collection out, and hand signal is sent to by signal processor 121 by data-phone 1113.
In turn, signal processor 121 determines the hand signal received in gesture instruction according to the current state of analogue input unit
Corresponding output order is concentrated, and output order is sent to exterior terminal.
It should be understood that in actual application, the hand exercise that user carries out is often very much, and there was only it
In it is some be just actually used for carry out terminal control movements.So in the gesture data that sensor generates, will there is one
Part gesture data is actually used for the effective gesture data for generating corresponding output order to exterior terminal, and other one hand
Gesture data are then user's generated invalid gesture datas that cannot generate corresponding output order in use.
In this mode, should there be effective gesture data in the first hand equipment 100 and/or the second hand equipment 110
Set (gesture in effective gesture data set is the hand signal for meeting gesture instruction collection), in action recognition circuit
When 1012 and/or 1112 pairs of gesture datas are handled, it can accurately know which gesture data is effective gesture data (i.e. hand
Gesture signal), which is invalid gesture data, and being should be ignored.It should be understood that in 100 He of the first hand equipment
When only an equipment is stored with effective gesture data set in second hand equipment 110, another equipment is carrying out gesture data
When processing, need to obtain effective gesture data collection from the equipment for having effective gesture data set by data-phone
It closes.
It should be noted that since signal processor 121 can be determined to receive according to the current state of analogue input unit
The hand signal arrived concentrates corresponding output order in gesture instruction, therefore in order to guarantee that signal processor 121 can be accurate
It determines that the corresponding output order of hand signal is, gesture instruction collection should be previously stored in signal connector 120,
And gesture instruction concentration should include the corresponding relationship of gesture data and instruction.It should also be noted that, in order to guarantee signal
The output order that processor 121 is determined can be smoothly transferred on exterior terminal, should also be provided with counting in signal connector 120
According to communicator, and the data-phone is connect with signal processor 121, is realized for the first hand equipment 100 and the second hand
The reception of 110 hand signal of equipment and transmission to output order.
It should be noted that in the examples described above, the first hand equipment 100 and 110 internal structure of the second hand equipment can
With consistent, so that the first hand equipment 100 and the second hand equipment 110 more preferably make in process flow, set gesture
Standby cost of manufacture is smaller.
Certainly, can also be not quite identical during specific implementation, such as in the alternatively possible of the embodiment of the present application
Shown in Figure 3 in the mode of realization, gesture equipment further includes the second hand equipment 110；Wherein, the second hand equipment 110 is wrapped
Include processor 111, sensor 112 and the first data-phone 1113；The processor 101 and second of first hand equipment 100
The processor 111 of hand equipment 110 communicates to connect, and the processor 101 of the first hand equipment 100 and the second hand equipment 110
Processor 111 communicate by the first data-phone 1113 of the second hand equipment 110 with exterior terminal, realizing will export
Instruction is sent to exterior terminal.In this way, two hand equipments pass through the first data-phone in the second hand equipment 110
1113 realize the communication with terminal.For terminal, received instruction is derived from the second hand equipment 110,
Its identification code for only needing to record the second hand equipment 110 in management can effectively be managed entire gesture equipment,
And then streamlining management complexity, improve the efficiency of management.
Optionally, the processor of the first hand equipment 100 and the second hand equipment 110 includes Acquisition Circuit (processor
Acquisition Circuit is marked as 1011 in 101, in processor 111 Acquisition Circuit marked as 1111), action recognition circuit (processor 101
1112) and the second data-phone middle action recognition circuit numbers are 1012, and action recognition circuit numbers are in processor 111
(second data-phone is marked as 1013 in processor 101, and second data-phone is marked as 1113) in processor 111.This
It outside, further include signal processor 113 in the second hand equipment 110.
At this point, Acquisition Circuit 1011 acquires gesture data from sensor 102 and is sent to action recognition circuit 1012.So
Action recognition circuit 1012 handles gesture data afterwards, parses the hand signal for meeting gesture instruction collection, and passes through the
Hand signal is sent to the signal processor 113 of the second hand equipment 110 by two data-phones 1013.Similarly, Acquisition Circuit
1111 acquire gesture data from sensor 112 and are sent to action recognition circuit 1112, and then action recognition circuit 1112 is right
Gesture data is handled, and the hand signal for meeting gesture instruction collection is parsed, and passes through the second data-phone 1113 for hand
Gesture signal is sent to signal processor 113.In turn, signal processor 113 is determined according to the current state of analogue input unit
The hand signal received concentrates corresponding output order in gesture instruction, and is referred to output by the first data-phone 1113
Order is sent to exterior terminal.
In this example, should there be effective gesture data in the first hand equipment 100 and/or the second hand equipment 110
Set (gesture in effective gesture data set is the hand signal for meeting gesture instruction collection), in action recognition circuit
When 1012 and/or 1112 pairs of gesture datas are handled, it can accurately know which gesture data is effective gesture data (i.e. hand
Gesture signal), which is invalid gesture data, and being should be ignored.
It should be noted that since signal processor 113 can be determined to receive according to the current state of analogue input unit
The hand signal arrived concentrates corresponding output order in gesture instruction, therefore in order to guarantee that signal processor 113 can be accurate
Determine that the corresponding output order of hand signal is, in addition to that should there be effective gesture number in the second hand equipment 110
Other than set, it should be also stored with gesture instruction collection, and gesture instruction concentrates pair that should include gesture data and instruct
It should be related to.
It should be understood that Acquisition Circuit and action recognition circuit can be by single-chip microcontrollers in above-mentioned two example
Nuc442 or STM32 etc. realizes correlation function.And sensor can pass through Posture acquisition chipset MPU9250, MINI54FDE
Etc. realizing.And data-phone then can be NFC (Near Field Communication, near-field communication), mrf24l01,
The communication modules such as bluetooth, WiFi.Such as may refer to circuit shown in Figure 14-1 and 14-2 to realize, Figure 14-1 is that hand is set
A kind of standby optional realization structure, and Figure 14-2 is a kind of optional realization structure of sensor, in structure.It needs to illustrate
Be, the signal processor 121 in the first above-mentioned example in signal connector 120 again may be by single-chip microcontroller Nuc442 or
STM32 etc. is realized, only needs to connect the communicators, data storage such as bluetooth by single-chip microcontroller Nuc442 or STM32 etc. at this time
Etc. signal connector 120 can be obtained.
In the embodiment of the present application, sensor 102/112 may include finger portion sensor 1021/1121, and refers to portion and sense
Device 1021/1121 can be set at the first articulations digitorum manus of finger and/or at the second articulations digitorum manus.It should be noted that the application
The first hand equipment 100 or the number of the finger portion sensor 1021/1121 in the second hand equipment 110 can be 5 in embodiment
It is a, so that user is when in use, it is corresponding on each finger to place a finger portion sensor targetedly to perceive that finger
Movement.The action induction of 5 fingers to user one on hand, the hand of generation are realized by 5 finger portion sensors in this way
Gesture data are with regard to more accurate.The first hand equipment in the not high use occasion of some pairs of precise requirements, the embodiment of the present application
100 or the number of the second finger portion sensor 1021/1121 in hand equipment 110 can be 2,3 or 4.
In the present embodiment, sensor 102/112 can also include metacarpus sensor 1022/1122.And in the present embodiment
In, metacarpus sensor 1022/1122 can be set in processor, thus when user uses gesture equipment, metacarpus sensor
1022/1122 is to be fitted on user's the back of the hand or palm, can perceive the palm action of user to generate corresponding gesture
Data.In this way, can be will be apparent that by metacarpus sensor 1022/1122, accurately be known before this hand of user carries out,
Afterwards, left and right, the hands molar behavior such as lift, put down, overturning, not will receive the shadow of the corresponding sports variation of finger in perception
It rings, it is ensured that the accuracy of the perception of hand mass motion.Of course, it will be understood that being not provided with metacarpus sensor
1021/1121 and be only arranged when referring to portion's sensor 1021/1121, pass through the globality to multiple finger portions sensor 1021/1121
The gesture data of also available corresponding hand mass motion is analyzed, but this mode is more multiple for the processing screening of data
It is miscellaneous, and accuracy be also not so good as be arranged metacarpus sensor it is high by 1021/1121.
It should be noted that the finger portion sensor and/or metacarpus sensor in the embodiment of the present application can use nine axis appearances
State sensor, and then using nine axis attitude transducers come effectively perceive hand exercise, it can also also be passed certainly using six axis postures
The sensor devices such as sensor are realized.
It should be noted that in the embodiment of the present application, in gesture equipment tool there are two when hand equipment, for the ease of with
Family realizes that the opening and closing to two hand equipments control, and switch module can be arranged in gesture equipment, referring to fig. 4 institute
Show, switch module includes: the first power switch 106 being set in the first hand equipment 100,105 and of the first Hall sensor
First magnetic patch 104, and the second source switch 116,115 and of the second Hall sensor that are set in the second hand equipment 110
Second magnetic patch 114.When the first hand equipment 100 and the second hand equipment 110 it is close and separate after, the first magnetic patch 104 and second
The magnetic field of magnetic patch 114 generates variation, and the first Hall sensor 105 and the second Hall sensor 115 is made to generate electric current, and drives the
One power switch 106 and second source switch 116 open or close.Accordingly even when power supply can be realized by gesture by obtaining user
Switch, user's operation is simple, easy to use, and Experience Degree is high.
In the embodiment of the present application, analogue input unit may include virtual mouse and dummy keyboard.And gesture instruction collection
Corresponding relationship including gesture data and instruction, which includes at least one of:
A holds the gesture data that fist unclamps again, corresponding instruction are as follows: A hand keyboard pattern switching is cut to A hand mouse mode
Change instruction.
It should be noted that above-mentioned left hand keyboard mode refers to that left hand can control the mode of keyboard, and similarly, following right sides
Hand keyboard mode refers to that the right hand can control the mode of keyboard.And left handed mouse mode then refers to that left hand can control mouse
Mode, similarly right handed mouse mode then refers to that the right hand can control the mode of mouse.
B holds the gesture data that fist unclamps again, corresponding instruction are as follows: B hand keyboard pattern switching is cut to B hand mouse mode
Change instruction.
Left-hand palm rotation n (n be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: all
Switching command, and/or numeric keypad mode and directional pad mode between small letter keyboard mode and all Caps keyboard mode
Between switching command.
Right hand palm rotation m1 (m1 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: right
Switching command, and/or right hand small letter keyboard mode and numeric keypad mould between hand capitalization keyboard mode and directional pad mode
Switching command between formula.
It should be noted that numeric keypad can be controlled by the right hand in the present embodiment.
B hand palm rotation m2 (m2 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: right
Switching command between hand plane mouse mode and right hand facade mouse mode.
It should be noted that without specific size relation between n, m1 and m2 in the application, in one kind of the present embodiment
N, m1 and m2 can be equal in embodiments possible.
The gesture data that the right hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to precise positioning mouse mould
Switching command between formula.
The gesture data that B hands down, corresponding instruction are as follows: the precise positioning mouse mode of B hand is switched to plane mouse mould
The switching command of formula.
Left or right hand lift or put down β (β be it is preset be greater than 0 number) angle gesture data, corresponding instruction are as follows: key
The switching command that disk in the ranks switches.
Especially, it should be noted that in practical applications, Yao Shixian gesture equipment is precisely controlled dummy keyboard, just need
Being accurately positioned and tidying up the corresponding keyboard of equipment current gesture action is which.In this regard, can in the embodiment of the present application
When realizing that user carries out gesture operation in the following ways, finger corresponds to the determination of the key of dummy keyboard:
Mode one: being filtered and integrate according to the data that accelerometer in sensor measures, obtain finger it is mobile away from
From to obtain the coordinate of finger, and then being corresponded to according to finger coordinate and go to can determine that correspondence in the coordinate of dummy keyboard
Key which is.But in this mode, still there is the thinking of fixed keyboard to exist, integral obtains the position of finger necessarily
It is reference with traditional key mapping, the moving distance of user can not be beyond range defined in keyboard.
In this regard, additionally providing mode two in the embodiment of the present application.In mode two, we pre-define a finger institute energy
Which column the keyboard of corresponding manipulation is, by A hand or B hand lift or put down β (β be it is preset be greater than 0 number) angle gesture number
The switching for carrying out keyboard row is controlled according to correspond to.Optionally, it can be lifted on the vertical plane using palm using wrist or elbow as origin
It determines which the keyboard row that right-hand man is enabled is specifically with the angular range that puts down, is determined in the keyboard row currently enabled
When, the corresponding keyboard key-position of each finger is also just able to decide.Particularly, it is being related to corresponding two column of a certain finger or two
, can be according to palm using wrist or elbow as origin when more than column key mapping, the angle of moving in rotation determines a left side in the horizontal plane
Which column the keyboard column that the right hand is enabled are specifically.For example, see shown in Figure 12, when entering keyboard mode, the hand of left/right hand
The palm is on the vertical plane initial angle with the angle α of horizontal plane, corresponds to Y0 row.Hereafter the palm of left/right hand is on the vertical plane
When relative to the α deflection β angle of-β, β~3, Y-1 row, Y1~Y3 row are respectively corresponded.It similarly, can also be with for the switching of keyboard column
It is to be realized by angle.Especially, it should be noted that in the present embodiment, switching back into keyboard mode from mouse mode
When, can be using the current position of palm as initial position fix to the initial row of dummy keyboard on, such as navigate to Y0 row.This
Afterwards relative to the i.e. corresponding switching a line of the every deflection β angle of initial position.
It should be understood that the mode that above two determining gesture data corresponds to keyboard key-position is provided in the present embodiment
Two kinds of feasible implementations, do not represent the embodiment of the present application only above two mode can be used and realize, as long as in fact
It can accurately determine that gesture data corresponds to the mode of keyboard key-position and can all be used by the embodiment of the present application, should all be protected in the application
It protects in range.
The mobile gesture data in B hand front, rear, left and right, corresponding instruction are as follows: the plane mouse front, rear, left and right of B hand are moved
Dynamic move.
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to accurate plane mouse mould
The switching command of formula.
The gesture data that B hands down, corresponding instruction are as follows: the accurate plane mouse mode of B hand is switched to plane mouse mould
The switching command of formula.
The gesture data of B hand Forward, corresponding instruction are as follows: the facade mouse mode of B hand is switched to accurate facade mouse mould
The switching command of formula.
The gesture data that B hand retreats, corresponding instruction are as follows: the accurate facade mouse mode of B hand is switched to facade mouse mould
The switching command of formula.
The mobile gesture data in B hand upper and lower, left and right, corresponding instruction are as follows: the facade mouse upper and lower, left and right of B hand are moved
Dynamic move.
The mobile gesture data of B hand up, down, left, right, before and after, corresponding instruction are as follows: the mouse auxiliary of A hand the page into
The status switching instruction of rolling, lower rolling, preceding page turning, rear page turning, amplification, diminution on row.
The gesture data of A hand and the contact of B hand the back of the hand, corresponding instruction are as follows: realize the operational order of device power-up or shutdown.
Under above-mentioned keyboard mode, dummy keyboard is divided into left hand keyboard area and right hand keyboard area, left hand keyboard area and
Right hand keyboard area can not be exchanged；And under mouse mode, A hand can be left hand, and B hand can be the right hand or A hand can be right
Hand, B hand can be left hand.
It should be understood that in the embodiment of the present application, signal processor is the current state according to analogue input unit
Determine that the hand signal received concentrates corresponding output order in gesture instruction.For example, being left hand in A hand, B hand is the right side
Hand integrates gesture instruction when including the corresponding relationship of all of above gesture data and instruction: in hand signal as left-hand palm
Rotate n degree again return when, when such as current corresponding keyboard is small letter keyboard, i.e., corresponding instruction are as follows: be by small letter keyboard shift
Capitalize keyboard；Similarly when current corresponding keyboard is capitalization keyboard, i.e., corresponding instruction are as follows: capitalization keyboard is switched to small letter
Keyboard；And when current keyboard has numeric keypad, then corresponding instruction are as follows: numeric keypad is switched to directional pad；Similarly,
When current keyboard has directional pad, then corresponding instruction are as follows: directional pad is switched to numeric keypad.It is in hand signal
Right hand palm rotate m degree again return when, such as current corresponding keyboard is right hand small letter keyboard, then corresponding instruction are as follows: by the right hand
Small letter keyboard shift is numeric keypad, similarly when current corresponding keyboard is numeric keypad, corresponding instruction are as follows: by number key
Disk is switched to right hand small letter keyboard；If current corresponding keyboard is that the right hand capitalizes keyboard, then corresponding instruction are as follows: capitalize the right hand
Keyboard shift is directional pad, similarly when current corresponding keyboard is directional pad, corresponding instruction are as follows: cut directional pad
It is changed to right hand capitalization keyboard.
It is to be appreciated that in the embodiment of the present application, for A hand palm rotation n degree, return or B hand palm rotate again
The value of the gesture data of m degree return again, n and m influence whether the sensitivity of user's manipulation.It is such as too small (such as in the value acquirement of n and m
Take 1-10) when, manipulation can be excessively sensitive, then possible user's palm, which has gently been shaken, meets A hand palm rotation n degree again
Return or B hand palm rotate m degree return again, this is easy for so that user's generation maloperation, reduces user experience instead.And
When the value of n and m obtains excessive (such as taking 180), at this point for realizing A hand palm rotation n degree return or B again for user
The operation that hand palm rotates m degree return again will be more inconvenient, to influence the usage experience of user.Optionally, in the application
In a kind of embodiments possible of embodiment, the value of n and m can be taken as 90, so that user's operation is relatively easy to, also be not easy
Maloperation.
It should be noted that in the embodiment of the present application, can also according to the current input mode of analogue input unit with
And the corresponding relationship of preset input pattern and control instruction, determine the corresponding control of the current input mode of analogue input unit
Instruction, and control instruction is sent to terminal.So that the patterns of change of gesture equipment is more intelligent, user experience is more preferable.
Illustratively, input pattern and the corresponding relationship of control instruction include can be at least one of:
When current input mode is that A hand by keyboard mode is switched to mouse mode, B hand is half keyboard mode, control instruction
Are as follows: switching command of the B hand half keyboard pattern switching to B hand full keyboard mode；
It should be noted that dummy keyboard can be divided into the embodiment of the present application left and right two regions, respectively correspond to
The left hand and the right hand of user operates.A hand half keyboard mode refers to that A hand can control the keyboard in one region of dummy keyboard
Mode, B hand half keyboard mode i.e. refer to that B hand can control the mode of the keyboard in another region of dummy keyboard.And A hand is complete
Keyboard mode then refers to that A hand can control the mode of the keyboard in dummy keyboard all areas, and B hand full keyboard mode then refers to
B hand can control the mode of the keyboard in dummy keyboard all areas.
When current input mode is that A hand by mouse mode is switched to keyboard mode, B hand is full keyboard mode, control instruction
Are as follows: switching command of the B hand full keyboard pattern switching to B hand half keyboard mode；
When current input mode is that B hand by keyboard mode is switched to mouse mode, A hand is half keyboard mode, control instruction
Are as follows: switching command of the A hand half keyboard pattern switching to A hand full keyboard mode；
When current input mode is that B hand by mouse mode is switched to keyboard mode, A hand is full keyboard mode, control instruction
Are as follows: switching command of the A hand full keyboard pattern switching to A hand half keyboard mode；
Under above-mentioned keyboard mode, dummy keyboard is divided into left hand keyboard area and right hand keyboard area, left hand keyboard area and
Right hand keyboard area can not be exchanged；And under mouse mode, A hand can be left hand, and B hand can be the right hand or A hand can be right
Hand, B hand can be left hand.
In this way, the control authority of another hand automatically becomes when a certain hand of user no longer carries out Keyboard Control
Entire keyboard can be controlled, this guarantees users to experience with good manipulation.
In the embodiment of the present application, dummy keyboard can be designed as common two-way array structure, but can also be laid out
For space spherical surface matrix structure, such as structure shown in Figure 13.It, can be fine when dummy keyboard is space spherical surface matrix structure
The positioning of dummy keyboard output order is realized on ground, such as can be using the elbow of both hands and/or wrist as the origin of spherical surface keyboard, in hand
The palm can position different keyboard rows when being lifted put certain angle up and down as origin using elbow and/or wrist with forearm, in palm
With forearm using elbow and/or wrist as origin swing certain angle when can position the keyboard of each finger control and arrange.
The control that this allows for user is more flexible, and can adapt to human motion feature to the greatest extent.It should be noted that Figure 13
The key that left hand and the right hand control respectively when key in middle dotted line frame is half keyboard mode.Key outside dotted line frame is full keyboard mode
Under, the key of another half keyboard of left or right hand extension.
Especially, it should be noted that in the present embodiment, it, can be with palm when switching back into keyboard mode from mouse mode
Current position (such as can be indicated using attitude angle) is as in initial position fix to the initial row of dummy keyboard.
It should be understood that each hand equipment provided in the embodiment of the present application can be set in various structure types
In gloves, the forms such as patch also can be set into.
It should be noted that in practical applications, since user is directly to realize dummy keyboard by gesture equipment
Manipulation, and dummy keyboard may can't be shown, then its essence is the blind behaviour of the keyboard of progress for a user, then
Unfamiliar people is used for equipment, in the blind behaviour of progress keyboard it is possible that manipulating uncomfortable or manipulation fault feelings
Condition.In this regard, additionally providing a kind of gesture system in the present embodiment, shown in Figure 5, gesture system includes the hand of above structure
Gesture equipment 10 and keyboard ancillary equipment 20, and keyboard ancillary equipment 20 and gesture equipment 10 communicate to connect, and receive gesture and set
The output order relevant to dummy keyboard that preparation is sent.Wherein, keyboard ancillary equipment 20 is equipped with processor 201 and shines
Unit 202.Processor 201 is when receiving the output order relevant to dummy keyboard that gesture equipment 10 is sent, according to defeated
The i.e. controllable luminescence unit 202 of instruction is shone in specific region to show the response region or character of dummy keyboard out.In this way
The manipulation of dummy keyboard is prompted to what user carried out accordingly by keyboard ancillary equipment 20, so that user passes through key
Disk ancillary equipment can more adapt to realize the control to terminal by above-mentioned gesture device, method.
Illustratively, luminescence unit 202 can be controlled by processor using multiple by controlled LED lamp in the present embodiment
The display to the response region or character of dummy keyboard is realized in the LED light on and off of different location processed.In the embodiment of the present application
In, the processor of keyboard ancillary equipment 20 can be realized by single-chip microcontroller or chip nuc442 or stm32f407 etc., be connected
It connects the communicators such as bluetooth and keyboard ancillary equipment 20 in the application can be obtained in data storage.
Optionally, in order to guarantee that the prompt that user sees in keyboard ancillary equipment 20 can accurately correspond to dummy keyboard
On, can design in the present embodiment keyboard ancillary equipment pattern be preset dummy keyboard entity pattern, it includes by
All keyboard areas of dummy keyboard, and the arrangement mode of keyboard area is identical as dummy keyboard.It is especially noted that right
Numeric keypad region in dummy keyboard, can be in dummy keyboard with the right hand or left hand keyboard area coincidence, can
When realizing the switching of keyboard by switching, but correspond to physically, the two keyboard areas then need to correspond to two not
Same provider location, therefore for keyboard ancillary equipment 20, it can be equipped with individual numeric keypad region, for example, see
The structural style of keyboard ancillary equipment 20 shown in fig. 6.
In the present embodiment, the response region or character of dummy keyboard, with the luminescence unit 202 in keyboard ancillary equipment 20
Between corresponding relationship include at least one of:
The left hand keyboard region of dummy keyboard responds, and the left hand keyboard region luminescence unit of corresponding keyboard ancillary equipment 20 is bright.
It should be noted that the left hand keyboard region of dummy keyboard responds when being switched to left hand half keyboard mode.
The left hand full key board panel of dummy keyboard responds, and the left hand of corresponding keyboard ancillary equipment 20 and right hand keyboard region are luminous single
Member is bright.
It should be noted that the left hand full key board panel of dummy keyboard responds when being switched to left hand full keyboard mode.
The right hand keyboard region of dummy keyboard responds, and the right hand keyboard region luminescence unit of corresponding keyboard ancillary equipment 20 is bright.
It should be noted that the right hand keyboard region of dummy keyboard responds when being switched to right hand half keyboard mode.
The right hand full key board panel of dummy keyboard responds, and the left hand of corresponding keyboard ancillary equipment 20 and right hand keyboard region are luminous single
Member is bright.
It should be noted that the right hand full key board panel of dummy keyboard responds when being switched to right hand full keyboard mode.
The capitalization keyboard response of dummy keyboard, the upper case character lamp all light of corresponding keyboard ancillary equipment 20, needs illustrate
It is, when being switched to capitalization keyboard mode, the capitalization keyboard response of dummy keyboard.
The right hand number key panel of dummy keyboard responds, and the right hand number key panel of corresponding keyboard ancillary equipment 20 shines single
Member is bright.
It should be noted that the number key panel of dummy keyboard responds when being switched to numeric keypad mode.
The right-hand direction keyboard region of dummy keyboard responds, and the right-hand direction keyboard region of corresponding keyboard ancillary equipment 20 shines single
Member is bright.
It should be noted that the directionkeys panel of dummy keyboard responds when being switched to directional pad mode.
Certain a line of dummy keyboard responds, and the row luminescence unit of corresponding keyboard ancillary equipment 20 is bright.
The character luminous unit of a certain character response of dummy keyboard, corresponding keyboard ancillary equipment 20 is bright.
The relevant range luminescence unit of the small letter keyboard response of dummy keyboard, corresponding keyboard ancillary equipment 20 does not work.
It should be noted that when being switched to small letter keyboard mode, the small letter keyboard response of dummy keyboard.
It is shown in Figure 7 the embodiment of the present application also provides a kind of gestural control method based on above-mentioned realization structure, Fig. 7
For a kind of basic procedure schematic diagram of gestural control method provided by the embodiments of the present application, comprising:
S701: perception hand motion generates gesture data；
In the present embodiment, the perception to hand motion can be realized by the sensor in above-mentioned realization structure, and
Generate gesture data.
S702: it determines that the gesture data is concentrated in gesture instruction according to gesture data and preset gesture instruction collection and corresponds to
Analogue input unit output order；
In the present embodiment, first gesture data can be handled, parses the hand signal for meeting gesture instruction collection,
Determine that hand signal concentrates corresponding output order in gesture instruction further according to the current input mode of analogue input unit.
It should be noted that effective gesture data set (effective gesture can be pre-set in the embodiment of the present application
Gesture in data acquisition system is the hand signal for meeting gesture instruction collection), so as to quickly from the gesture data of generation
In parse the hand signal for meeting gesture instruction collection.
It should also be noted that, same hand signal may be corresponding with multiple and different instructions, and work as in the embodiment of the present application
This preceding hand signal is specifically which corresponding instruction is then needed according to analogue input unit (simulation input in the present embodiment
Device may include virtual mouse and/or dummy keyboard) current input mode determine.For example, being left hand in A hand, B hand is
The right hand integrates gesture instruction when including the corresponding relationship of above-mentioned all gesture datas and instruction: in hand signal as left hand hand
Palm rotation n degree again return when, when such as current corresponding keyboard is small letter keyboard, i.e., corresponding instruction are as follows: by small letter keyboard shift
To capitalize keyboard；Similarly when current corresponding keyboard is capitalization keyboard, i.e., corresponding instruction are as follows: be switched to capitalization keyboard small
Write keyboard；And when current keyboard has numeric keypad, then corresponding instruction are as follows: numeric keypad is switched to directional pad；Together
Reason, when current keyboard has directional pad, then corresponding instruction are as follows: directional pad is switched to numeric keypad.It needs to illustrate
, the particular content of gesture instruction collection has been described in foregoing teachings, and details are not described herein.
S703: output order is sent to terminal.
In the embodiment of the present application, when analogue input unit includes dummy keyboard, according to gesture data and preset
Gesture instruction collection determines that gesture data, can be with after the output order that gesture instruction concentrates corresponding analogue input unit
Output order relevant to dummy keyboard is sent to keyboard ancillary equipment, so that keyboard ancillary equipment is according to the output received
Instruct the response region or character to be shone in specific region to prompt dummy keyboard.It should be noted that the response of dummy keyboard
The corresponding relationship between light emitting region on region or character and keyboard ancillary equipment has been described in foregoing teachings, herein not
It repeats again.
In the embodiment of the present application, gestural control method can also include: the current input mould according to analogue input unit
The corresponding relationship of formula and preset input pattern and control instruction determines that the current input mode of analogue input unit is corresponding
Control instruction, and control instruction is sent to terminal.So that the patterns of change of gesture equipment is more intelligent, user experience is more
It is good.
Illustratively, input pattern and the corresponding relationship of control instruction include can be at least one of:
When current input mode is that A hand by keyboard mode is switched to mouse mode, B hand is half keyboard mode, control instruction
Are as follows: switching command of the B hand half keyboard pattern switching to B hand full keyboard mode；
It should be noted that dummy keyboard can be divided into the embodiment of the present application left and right two regions, respectively correspond to
The left hand and the right hand of user operates.A hand half keyboard mode refers to that A hand can control the keyboard in one region of dummy keyboard
Mode, B hand half keyboard mode i.e. refer to that B hand can control the mode of the keyboard in another region of dummy keyboard.And A hand is complete
Keyboard mode then refers to that A hand can control the mode of the keyboard in dummy keyboard all areas, and B hand full keyboard mode then refers to
B hand can control the mode of the keyboard in dummy keyboard all areas.
When current input mode is that A hand by mouse mode is switched to keyboard mode, B hand is full keyboard mode, control instruction
Are as follows: switching command of the B hand full keyboard pattern switching to B hand half keyboard mode；
When current input mode is that B hand by keyboard mode is switched to mouse mode, A hand is half keyboard mode, control instruction
Are as follows: switching command of the A hand half keyboard pattern switching to A hand full keyboard mode；
When current input mode is that B hand by mouse mode is switched to keyboard mode, A hand is full keyboard mode, control instruction
Are as follows: switching command of the A hand full keyboard pattern switching to A hand half keyboard mode；
Under above-mentioned keyboard mode, dummy keyboard is divided into left hand keyboard area and right hand keyboard area, left hand keyboard area and
Right hand keyboard area can not be exchanged；And under mouse mode, A hand can be left hand, and B hand can be the right hand or A hand can be right
Hand, B hand can be left hand.
In this way, the control authority of another hand automatically becomes when a certain hand of user no longer carries out Keyboard Control
Entire keyboard can be controlled, this guarantees users to experience with good manipulation.
In conclusion gesture equipment, gesture system and gestural control method provided by the embodiments of the present application, gesture equipment is logical
Hand motion generation gesture data can be perceived by crossing sensor, then is handled to obtain output order and be sent to by processor
The control to terminal can be realized in terminal.Effective control to terminal device can be realized by above-mentioned gesture equipment in this way, no
Need the limitation again dependent on the operation planars such as keyboard, mouse, can make user's operation be spatially obtain it is bigger from
By spending, user experience is more preferable.In addition, in the application gesture data directly carried out by gesture equipment it is special processing exported
Instruction, it is ensured that identification is efficient, promotes recognition efficiency, achievees the effect that quick response, and further the user experience is improved.
In addition, further including having keyboard ancillary equipment in gesture system, can be thus achieved by keyboard ancillary equipment to user's progress
Prompt to the manipulation of dummy keyboard adapts to user more through above-mentioned gestural control method by keyboard ancillary equipment
To realize the control to terminal.
Embodiment two:
The present embodiment on the basis of example 1, respectively by taking the exemplary construction of Fig. 2 and Fig. 3 as an example, to the application make into
One step illustrates.
Example 1: shown in Figure 8, the first hand equipment 100 and the second hand equipment 110 are all to be mounted on setting for the back of the hand
Meter, does not influence the normal use of volar direction.And the first hand equipment 100 and the symmetrical design of the second hand equipment 110, and point
At the first articulations digitorum manus of the five fingers back side, corresponding position is not equipped with nine axis attitude transducers, and five sensors are by conducting wire and are located at hand
Processor 101/111 in the hand equipment of back connects.And the first hand equipment 100 and the second hand equipment 110 and keyboard
The data-phones such as the bluetooth that ancillary equipment 20 is then wirelessly established connection with signal connector 120, and passed through and end
End (such as computer, plate or mobile phone) is attached.Wherein, keyboard ancillary equipment 20 is displayed for dummy keyboard output
Signal condition, to prompt the response region or character of dummy keyboard.
It is shown in Figure 9, respectively include one in the first hand equipment 100 and the second hand equipment 110 and passes through hall sensing
The power switch and magnetic patch of device driving.Fix because of two Hall sensor positions, distance farther out when will not generate induced current.But
Be when the first hand equipment 100 and the second hand equipment 110 it is close and separate after, changes of magnetic field using Hall sensor generate electricity
Stream, and driving power opens or closes.
After first hand equipment 100 and the second hand equipment 110 are opened, sensor L0~L5 and R0~R5 generate hand in real time
The palm and finger gesture delta data, and by Acquisition Circuit 1011/1111 acquire after, send action recognition circuit 1012/ to
1112.Action recognition circuit 1012/1112 parses the hand for meeting gesture instruction collection by processing and analysis to gesture data
Gesture signal, and signal processor 121 is transferred to by data communication equipment 1013/1113.It should be noted that in signal connector
In 120 should be equipped with data-phone 122, for the first hand equipment 100 and 110 data communication of the second hand equipment and
It is communicated with terminal, memory 123 furthermore should be also equipped in signal connector 120, for storing gesture instruction collection.Accordingly
, it then can store effective gesture data set (effective gesture in the first hand equipment 100 and the second hand equipment 110
Gesture in data acquisition system is the hand signal for meeting gesture instruction collection), such as the effective gesture data set of Fig. 9 can deposit
It is stored in the memory of the first hand equipment 100 and the second hand equipment 110.Signal processor 121 carries out area to hand signal
Point, output order is sent to terminal by data communication equipment 122 and terminator terminating junctor, while will finger relevant to dummy keyboard
Order sends keyboard ancillary equipment 20 to.Refer to it should be noted that memory can be set in signal connector 120 to store gesture
Collection is enabled, to guarantee that signal processor 121 handles hand signal to obtain corresponding output order.It should also be noted that,
Data-phone in Fig. 9 in signal connector 120 can be realized between multiple equipment only with one by multiplexing functions
Communication, can also realize the data communication between distinct device respectively using multiple data-phones as shown in Figure 9.
Example 2: shown in Figure 10, the first hand equipment 100 and the second hand equipment 110 are all to be mounted on setting for the back of the hand
Meter, does not influence the normal use of volar direction.And the first hand equipment 100 and the symmetrical design of the second hand equipment 110, and point
At the first articulations digitorum manus of the five fingers back side, corresponding position is not equipped with nine axis attitude transducers, and five sensors are by conducting wire and are located at hand
Processor 101/111 in the hand equipment of back connects.And the first hand equipment 100 and the second hand equipment 110 and keyboard
Ancillary equipment 20 then wirelessly establishes connection with the second hand equipment 110, and passes through the bluetooth of the second hand equipment 110
Equal data-phones are attached with terminal (such as computer, plate or mobile phone).Wherein, keyboard ancillary equipment 20 can be used for showing
Show the signal condition of dummy keyboard output, to prompt the response region or character of dummy keyboard.
It is shown in Figure 11, respectively include one in the first hand equipment 100 and the second hand equipment 110 and passes through hall sensing
The power switch and magnetic patch of device driving.Fix because of two Hall sensor positions, distance farther out when will not generate induced current.But
Be when the first hand equipment 100 and the second hand equipment 110 it is close and separate after, changes of magnetic field using Hall sensor generate electricity
Stream, and driving power opens or closes.
After first hand equipment 100 and the second hand equipment 110 are opened, sensor L0~L5 and R0~R5 generate hand in real time
The palm and finger gesture delta data, and by Acquisition Circuit 1011/1111 acquire after, send action recognition circuit 1012/ to
1112.Action recognition circuit 1012/1112 parses the hand for meeting gesture instruction collection by processing and analysis to gesture data
Gesture signal, and the signal processor 121 in the second hand equipment 110 is transferred to by data communication equipment 1013/1113.It needs
It is bright, it can store effective gesture data set (gesture in effective gesture data set in the first hand equipment 100
As meet the hand signal of gesture instruction collection).In addition to that can there be effective gesture data collection in the second hand equipment 110
It closes, can also have gesture instruction collection.Hand signal is distinguished in the signal processor 121 of the second hand equipment 110
To after corresponding output order, output order can be sent to by end by the data-phone 1113 in the second hand equipment 110
End, while keyboard ancillary equipment 20 will be also sent in the relevant output order of dummy keyboard.It should be noted that each in Figure 11
Data-phone in equipment can be realized logical between multiple equipment and in equipment only with one by multiplexing functions
Letter, but can also the number between distinct device and in equipment be realized respectively using multiple data-phones as shown in Figure 11
According to communication.
In above-mentioned two example, dummy keyboard can be designed as common two-way array structure, but can also be laid out
For space spherical surface matrix structure, such as structure shown in Figure 13.When dummy keyboard is space spherical surface matrix structure, gesture equipment
Exported character, the corresponding keyboard cloth of right-hand man can be judged by the movement of the spatial position of palm and the first articulations digitorum manus
Office and character can (it should be understood that Figure 13 is only for signal, specific corresponding relationship can also make by oneself by user as shown in figure 13
Justice).It at this time can be using the elbow of both hands and/or wrist as the origin of spherical surface keyboard, in palm with forearm with elbow and/or wrist
Different keyboard rows can be positioned when lifting put certain angle up and down for origin, is with elbow and/or wrist with forearm in palm
Origin swing certain angle when can position the keyboard column of each finger control.The control that this allows for user is more clever
It is living, and human motion feature can be adapted to the greatest extent.It should be noted that the key in Figure 13 in dotted line frame is half keyboard mould
The key that left hand and the right hand control respectively when formula.Key outside dotted line frame is under full keyboard mode, left or right hand extension the other half
The key of keyboard.
In above-mentioned two example, dummy keyboard can be divided into two regions in left and right, it is such as shown in Figure 12, it is right respectively
It should be operated to the left hand and the right hand of user.It is particularly to be noted that the alphabetic keypad region of the right hand can be switched by instruction
For numeric keypad or directional pad.
Referring to the state description for shown in following state table, in table being gesture equipment:
Basic status table
| State | Explanation |
| Shutdown | The shutdown of gesture equipment |
| Booting | Gesture device power-up |
Mode state table
Mouse state table
| Facade mouse is mobile | Move cursor in vertical plane upper and lower, left and right. |
| Plane mouse is mobile | Move cursor in horizontal plane front, rear, left and right. |
Keyboard state table
Secondary status table
| Upper rolling | The page scrolls up |
| Lower rolling | The page scrolls down through |
| Preceding page turning | Page forward |
| Page turning afterwards | Page turning backward |
| Amplification | Page amplification |
| It reduces | The page reduces |
It is a kind of exemplary effective gesture data of the present embodiment and its corresponding explanation in table referring to shown in following table one:
Table one
It is a kind of exemplary gesture instruction collection of the present embodiment in table referring to shown in following table two:
Table two
It should be noted that " related initial according to current palm position setting after switching state described in upper table
Value " refers to, after mutually switching between keyboard and mouse, using current palm position as the corresponding initial bit of keyboard initial row
It sets.In addition, above-mentioned " control of right-hand man's state " refers to: a hand is switched to mouse mode by keyboard mode, another hand is half
Keyboard mode.
In above-mentioned example 1 and 2, keyboard ancillary equipment can be used for helping the just user's confirmation gesture output of gesture equipment
Character.Keyboard ancillary equipment receives the output order about dummy keyboard by the wireless connection with gesture equipment, and passes through
Display lamp or item (i.e. luminescence unit) in keyboard ancillary equipment, show the response region of dummy keyboard and the character of response.
Dummy keyboard may refer to following table three:
Table three
| Serial number | Response region or character | Explanation |
| 1 | The response of left hand keyboard region | Left hand keyboard region red block is bright |
| 2 | The response of left hand full key board panel | Left hand and right hand keyboard region red block are bright |
| 3 | The response of right hand keyboard region | Right hand keyboard region blue box is bright |
| 4 | The response of right hand full key board panel | Left hand and right hand keyboard region blue box are bright |
| 5 | Small letter keyboard response | Nothing |
| 6 | Capitalize keyboard response | Upper case character lamp all light |
| 7 | The response of right hand number key panel | Right hand number key panel blue box is bright |
| 8 | The response of right-hand direction keyboard region | Right-hand direction keyboard region blue box is bright |
| 9 | Row response | Row response box is bright |
| 10 | Character response | Character response lamp is bright |
According to gesture equipment provided by the embodiments of the present application and gesture system, both hands may not necessarily when operating by user
It is limited in specific plane, does not need the limitation again dependent on operation planars such as keyboard, mouses, can make user's operation is in sky
Between on obtain bigger freedom degree, not only improve and used in the environment of unsuitable conventional keyboard and mouse, be also beneficial to prevent
Some computer syndromes, such as wrist joint inflammation.In addition, it is fast to provide richer keyboard and mouse by sign language
Prompt operational order.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through
Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing
Show the device of multiple embodiments according to the application, the architectural framework in the cards of method and computer program product,
Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code
Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held
Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement
The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes
It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart
The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement
It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the application can integrate one independent portion of formation together
Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
In addition, the implementation described in each embodiment of the application, as long as not conflicting can combine at one
The scheme of the application is realized in embodiment.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module
It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps.
And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
The above description is only an example of the present application, the protection scope being not intended to limit this application, for ability
For the technical staff in domain, various changes and changes are possible in this application.Within the spirit and principles of this application, made
Any modification, equivalent substitution, improvement and etc. should be included within the scope of protection of this application.It should also be noted that similar label and
Letter indicates similar terms in following attached drawing, therefore, once it is defined in a certain Xiang Yi attached drawing, then in subsequent attached drawing
In do not need that it is further defined and explained.
The above, the only specific embodiment of the application, but the protection scope of the application is not limited thereto, it is any
Those familiar with the art within the technical scope of the present application, can easily think of the change or the replacement, and should all contain
Lid is within the scope of protection of this application.Therefore, the protection scope of the application shall be subject to the protection scope of the claim.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Claims (19)
1. a kind of gestural control method characterized by comprising
It perceives hand motion and generates gesture data；
Determine the gesture data in gesture instruction concentration pair according to the gesture data and preset gesture instruction collection
The output order for the analogue input unit answered；
And the output order is sent to terminal.
2. gestural control method as described in claim 1, which is characterized in that described according to the gesture data and preset hand
Gesture instruction set determines that the gesture data concentrates the output order of corresponding analogue input unit to include: in the gesture instruction
The gesture data is handled, the hand signal for meeting the gesture instruction collection is parsed；
Determine the hand signal in gesture instruction concentration pair according to the current input mode of the analogue input unit
The output order answered.
3. gestural control method as described in claim 1, which is characterized in that in the analogue input unit include dummy keyboard
When, determine the gesture data in the gesture instruction collection according to the gesture data and preset gesture instruction collection described
In corresponding analogue input unit output order after, further includes:
Output order relevant to the dummy keyboard is sent to keyboard ancillary equipment, for the keyboard ancillary equipment according to
The output order received is shone in specific region to prompt the response region or character of the dummy keyboard.
4. gestural control method as claimed in claim 3, which is characterized in that the response region or character of the dummy keyboard,
Corresponding relationship between the light emitting region in the keyboard ancillary equipment includes at least one of:
The left hand keyboard region of dummy keyboard responds, and the left hand keyboard region of corresponding keyboard ancillary equipment is bright；
The left hand full key board panel of dummy keyboard responds, and the left hand of corresponding keyboard ancillary equipment and right hand keyboard region are bright；
The right hand keyboard region of dummy keyboard responds, and the right hand keyboard region of corresponding keyboard ancillary equipment is bright；
The right hand full key board panel of dummy keyboard responds, and the left hand of corresponding keyboard ancillary equipment and right hand keyboard region are bright；
The capitalization keyboard response of dummy keyboard, the upper case character lamp all light of corresponding keyboard ancillary equipment；
The right hand number key panel of dummy keyboard responds, and the right hand number key panel of corresponding keyboard ancillary equipment is bright；
The right-hand direction keyboard region of dummy keyboard responds, and the right-hand direction keyboard region of corresponding keyboard ancillary equipment is bright；
Certain a line of dummy keyboard responds, and the row of corresponding keyboard ancillary equipment is bright；
The character of a certain character response of dummy keyboard, corresponding keyboard ancillary equipment is bright；
The relevant range of the small letter keyboard response of dummy keyboard, corresponding keyboard ancillary equipment does not work.
5. gestural control method according to any one of claims 1-4, which is characterized in that the analogue input unit includes void
Quasi- keyboard and virtual mouse, the gesture instruction collection include the corresponding relationship of gesture data and instruction, and the corresponding relationship includes
At least one of:
A holds the gesture data that fist unclamps again, corresponding instruction are as follows: the switching of A hand keyboard pattern switching to A hand mouse mode refers to
It enables；
B holds the gesture data that fist unclamps again, corresponding instruction are as follows: the switching of B hand keyboard pattern switching to B hand mouse mode refers to
It enables；
Left-hand palm rotation n (n be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: all-lowercase
Between switching command, and/or numeric keypad mode and directional pad mode between keyboard mode and all Caps keyboard mode
Switching command；
Right hand palm rotation m1 (m1 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: the right hand is big
Write switching command between keyboard mode and directional pad mode, and/or right hand small letter keyboard mode and numeric keypad mode it
Between switching command；
Left or right hand lift or put down β (β be it is preset be greater than 0 number) angle gesture data, corresponding instruction are as follows: keyboard row
Between the switching command that switches；
B hand palm rotation m2 (m2 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: the right hand is flat
Switching command between face mouse mode and right hand facade mouse mode；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand be switched to precise positioning mouse mode it
Between switching command；
The gesture data that B hands down, corresponding instruction are as follows: the precise positioning mouse mode of B hand is switched to plane mouse mode
Switching command；
The mobile gesture data in B hand front, rear, left and right, corresponding instruction are as follows: the plane mouse front, rear, left and right movement of B hand
Move；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to accurate plane mouse mode
Switching command；
The gesture data that B hands down, corresponding instruction are as follows: the accurate plane mouse mode of B hand is switched to plane mouse mode
Switching command；
The mobile gesture data in B hand upper and lower, left and right, corresponding instruction are as follows: the facade mouse upper and lower, left and right movement of B hand
Move；
The gesture data of B hand Forward, corresponding instruction are as follows: the facade mouse mode of B hand is switched to accurate facade mouse mode
Switching command；
The gesture data that B hand retreats, corresponding instruction are as follows: the accurate facade mouse mode of B hand is switched to facade mouse mode
Switching command；
The mobile gesture data of A hand up, down, left, right, before and after, corresponding instruction are as follows: the mouse of A hand assists on the page carries out
The status switching instruction of rolling, lower rolling, preceding page turning, rear page turning, amplification, diminution；
The gesture data of A hand and the contact of B hand the back of the hand, corresponding instruction are as follows: realize the operational order of device power-up or shutdown；
Under the keyboard mode, the dummy keyboard is divided into left hand keyboard area and right hand keyboard area；Under the mouse mode,
The A hand is left hand, and the B hand is the right hand or the A hand is the right hand, and the B hand is left hand.
6. gestural control method according to any one of claims 1-4, which is characterized in that the gestural control method also wraps
It includes: according to the current input mode of the analogue input unit and the corresponding relationship of preset input pattern and control instruction,
It determines the corresponding control instruction of the current input mode of the analogue input unit, and the control instruction is sent to terminal.
7. gestural control method as claimed in claim 6, which is characterized in that the analogue input unit include dummy keyboard and
Virtual mouse；
The input pattern and the corresponding relationship of control instruction include at least one of:
When the current input mode is that A hand by keyboard mode is switched to mouse mode, B hand is half keyboard mode, the control
Instruction are as follows: switching command of the B hand half keyboard pattern switching to B hand full keyboard mode；
When the current input mode is that A hand by mouse mode is switched to keyboard mode, B hand is full keyboard mode, the control
Instruction are as follows: switching command of the B hand full keyboard pattern switching to B hand half keyboard mode；
When the current input mode is that B hand by keyboard mode is switched to mouse mode, A hand is half keyboard mode, the control
Instruction are as follows: switching command of the A hand half keyboard pattern switching to A hand full keyboard mode；
When the current input mode is that B hand by mouse mode is switched to keyboard mode, A hand is full keyboard mode, the control
Instruction are as follows: switching command of the A hand full keyboard pattern switching to A hand half keyboard mode；
Under the keyboard mode, the dummy keyboard is divided into left hand keyboard area and right hand keyboard area；Under the mouse mode,
The A hand is left hand, and the B hand is the right hand or the A hand is the right hand, and the B hand is left hand.
8. a kind of gesture equipment characterized by comprising the first hand equipment,
First hand equipment includes processor and sensor；
The sensor generates gesture data to perceive hand motion；
The processor is used to obtain the gesture data that the sensor generates, and is referred to according to the gesture data and preset gesture
Collection is enabled to determine that the gesture data concentrates the output order of corresponding analogue input unit in the gesture instruction, and will be described
Output order is sent to exterior terminal.
9. gesture equipment as claimed in claim 8, which is characterized in that the gesture equipment further includes the second hand equipment and letter
Number connector；
Second hand equipment includes processor and sensor；The processing of first hand equipment and the second hand equipment
Device is communicated to connect with the signal connector respectively, and the output order is sent to outside described by the signal connector
Portion's terminal.
10. gesture equipment as claimed in claim 9, which is characterized in that first hand equipment and the second hand equipment
Processor includes Acquisition Circuit, action recognition circuit and data-phone；The signal connector includes signal processor；
The Acquisition Circuit acquires gesture data from sensor and is sent to the action recognition circuit；The action recognition electricity
Road handles the gesture data, parses the hand signal for meeting the gesture instruction collection, and logical by the data
Believe that the hand signal is sent to the signal processor by device；
The signal processor determines the hand signal received in the gesture according to the current state of analogue input unit
Corresponding output order in instruction set, and the output order is sent to exterior terminal.
11. gesture equipment as claimed in claim 8, which is characterized in that the gesture equipment further includes the second hand equipment；Institute
Stating the second hand equipment includes processor, sensor and the first data-phone；
The processor of first hand equipment is connect with the processor communication of second hand equipment, and first hand
The processor of equipment is communicated by first data-phone with the exterior terminal.
12. gesture equipment as claimed in claim 11, which is characterized in that first hand equipment and the second hand equipment
Processor includes Acquisition Circuit, action recognition circuit and the second data-phone；Second hand equipment further includes signal
Processor；
The Acquisition Circuit acquires gesture data from sensor and is sent to the action recognition circuit；The action recognition electricity
Road handles the gesture data, parses the hand signal for meeting the gesture instruction collection, and pass through second number
The hand signal is sent to the signal processor according to communicator；
The signal processor determines the hand signal received in the gesture according to the current state of analogue input unit
Corresponding output order in instruction set, and the output order is sent to by exterior terminal by first data-phone.
13. gesture equipment as claimed in claim 8, which is characterized in that the sensor includes finger portion sensor；The finger portion
Sensor can be set at the first articulations digitorum manus of finger and/or at the second articulations digitorum manus.
14. gesture equipment as claimed in claim 13, which is characterized in that the sensor further includes metacarpus sensor；It is described
Metacarpus sensor is set in the processor for perceiving palm action to generate gesture data.
15. such as the described in any item gesture equipment of claim 9-12, which is characterized in that further include switch module；
The switch module include: the first power switch being set in first hand equipment, the first Hall sensor and
First magnetic patch, and the second source switch, the second Hall sensor and the second magnetic patch that are set in second hand equipment；
When first hand equipment and the second hand equipment it is close and separate after, the magnetic field of first magnetic patch and the second magnetic patch
Variation is generated, so that first Hall sensor and the second Hall sensor is generated electric current, and drive first power switch
It is opened or closed with second source.
16. such as the described in any item gesture equipment of claim 8-14, which is characterized in that the analogue input unit includes virtual
Keyboard；The dummy keyboard is space spherical surface matrix structure.
17. such as the described in any item gesture equipment of claim 8-14, which is characterized in that the analogue input unit includes virtual
Keyboard and virtual mouse, the gesture instruction collection include the corresponding relationship of gesture data and instruction, the corresponding relationship include with
It is at least one lower:
A holds the gesture data that fist unclamps again, corresponding instruction are as follows: the switching of A hand keyboard pattern switching to A hand mouse mode refers to
It enables；
B holds the gesture data that fist unclamps again, corresponding instruction are as follows: the switching of B hand keyboard pattern switching to B hand mouse mode refers to
It enables；
Left-hand palm rotation n (n be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: all-lowercase
Switching command, and/or right hand numeric keypad mode and directional pad mode between keyboard mode and all Caps keyboard mode
Between switching command；
Right hand palm rotation m1 (m1 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: the right hand is big
Write switching command between keyboard mode and directional pad mode, and/or right hand small letter keyboard mode and numeric keypad mode it
Between switching command；
Left or right hand lift or put down β (β be it is preset be greater than 0 number) angle gesture data, corresponding instruction are as follows: keyboard row
Between the switching command that switches；
B hand palm rotation m2 (m2 be it is preset be greater than 0 number) degree return again gesture data, corresponding instruction are as follows: the right hand is flat
Switching command between face mouse mode and right hand facade mouse mode；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand be switched to precise positioning mouse mode it
Between switching command；
The gesture data that B hands down, corresponding instruction are as follows: the precise positioning mouse mode of B hand is switched to plane mouse mode
Switching command；
The mobile gesture data in B hand front, rear, left and right, corresponding instruction are as follows: the plane mouse front, rear, left and right movement of B hand
Move；
The gesture data that B hand lifts, corresponding instruction are as follows: the plane mouse mode of B hand is switched to accurate plane mouse mode
Switching command；
The gesture data that B hands down, corresponding instruction are as follows: the accurate plane mouse mode of B hand is switched to plane mouse mode
Switching command；
The mobile gesture data in B hand upper and lower, left and right, corresponding instruction are as follows: the facade mouse upper and lower, left and right movement of B hand
Move；
The gesture data of B hand Forward, corresponding instruction are as follows: the facade mouse mode of B hand is switched to accurate facade mouse mode
Switching command；
The gesture data that B hand retreats, corresponding instruction are as follows: the accurate facade mouse mode of B hand is switched to facade mouse mode
Switching command；
The mobile gesture data of A hand up, down, left, right, before and after, corresponding instruction are as follows: the mouse of A hand assists on the page carries out
The status switching instruction of rolling, lower rolling, preceding page turning, rear page turning, amplification, diminution；
The gesture data of A hand and the contact of B hand the back of the hand, corresponding instruction are as follows: realize the operational order of device power-up or shutdown；
Under the keyboard mode, the dummy keyboard is divided into left hand keyboard area and right hand keyboard area；Under the mouse mode,
The A hand is left hand, and the B hand is the right hand or the A hand is the right hand, and the B hand is left hand.
18. a kind of gesture system, which is characterized in that including keyboard ancillary equipment and as claim 6-14 is described in any item
Gesture equipment；
The keyboard ancillary equipment and the gesture equipment communicate to connect, and receive the gesture equipment is sent and virtual key
The relevant output order of disk；
The keyboard ancillary equipment is equipped with processor and luminescence unit；
The processor is when receiving the output order relevant to dummy keyboard that the gesture equipment is sent, according to described
Output order controls the luminescence unit and is shone in specific region to show the response region or character of dummy keyboard.
19. gesture system as claimed in claim 18, which is characterized in that the keyboard ancillary equipment is preset dummy keyboard
Entity pattern；
The corresponding relationship between luminescence unit on the response region or character of the dummy keyboard, with the keyboard ancillary equipment
Including at least one of:
The left hand keyboard region of dummy keyboard responds, and the left hand keyboard region luminescence unit of corresponding keyboard ancillary equipment is bright；
The left hand full key board panel of dummy keyboard responds, and the left hand and right hand keyboard region luminescence unit of corresponding keyboard ancillary equipment are bright；
The right hand keyboard region of dummy keyboard responds, and the right hand keyboard region luminescence unit of corresponding keyboard ancillary equipment is bright；
The right hand full key board panel of dummy keyboard responds, and the left hand and right hand keyboard region luminescence unit of corresponding keyboard ancillary equipment are bright；
The capitalization keyboard response of dummy keyboard, the upper case character lamp all light of corresponding keyboard ancillary equipment；
The right hand number key panel of dummy keyboard responds, and the right hand number key panel luminescence unit of corresponding keyboard ancillary equipment is bright；
The right-hand direction keyboard region of dummy keyboard responds, and the right-hand direction keyboard region luminescence unit of corresponding keyboard ancillary equipment is bright；
Certain a line of dummy keyboard responds, and the row luminescence unit of corresponding keyboard ancillary equipment is bright；
The character luminous unit of a certain character response of dummy keyboard, corresponding keyboard ancillary equipment is bright；
The relevant range luminescence unit of the small letter keyboard response of dummy keyboard, corresponding keyboard ancillary equipment does not work.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910041072.3A CN109542239A (en) | 2019-01-16 | 2019-01-16 | A kind of gestural control method, gesture equipment and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910041072.3A CN109542239A (en) | 2019-01-16 | 2019-01-16 | A kind of gestural control method, gesture equipment and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109542239A true CN109542239A (en) | 2019-03-29 |
Family
ID=65835594
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910041072.3A Pending CN109542239A (en) | 2019-01-16 | 2019-01-16 | A kind of gestural control method, gesture equipment and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109542239A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111475092A (en) * | 2020-03-23 | 2020-07-31 | 深圳市多亲科技有限公司 | Remote control operation method and device of smart phone and mobile terminal |
| CN113064541A (en) * | 2021-03-30 | 2021-07-02 | 深圳市联谛信息无障碍有限责任公司 | Method and device for facilitating visual disorder user to operate interactive interface |
| WO2022267760A1 (en) * | 2021-06-22 | 2022-12-29 | 腾讯科技（深圳）有限公司 | Key function execution method, apparatus and device, and storage medium |
| JP7442783B2 (en) | 2019-11-08 | 2024-03-05 | 国立大学法人 筑波大学 | Information processing device, information processing method, and program |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063183A (en) * | 2011-02-12 | 2011-05-18 | 深圳市亿思达显示科技有限公司 | Virtual input device of grove type |
| CN104536574A (en) * | 2014-12-29 | 2015-04-22 | 西安电子科技大学 | Glove type input device and input method thereof |
| CN105138136A (en) * | 2014-09-15 | 2015-12-09 | 北京至感传感器技术研究院有限公司 | Hand gesture recognition device, hand gesture recognition method and hand gesture recognition system |
| CN209070493U (en) * | 2019-01-16 | 2019-07-05 | 张斌 | A kind of gesture equipment and system |
-
2019
- 2019-01-16 CN CN201910041072.3A patent/CN109542239A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063183A (en) * | 2011-02-12 | 2011-05-18 | 深圳市亿思达显示科技有限公司 | Virtual input device of grove type |
| CN105138136A (en) * | 2014-09-15 | 2015-12-09 | 北京至感传感器技术研究院有限公司 | Hand gesture recognition device, hand gesture recognition method and hand gesture recognition system |
| CN104536574A (en) * | 2014-12-29 | 2015-04-22 | 西安电子科技大学 | Glove type input device and input method thereof |
| CN209070493U (en) * | 2019-01-16 | 2019-07-05 | 张斌 | A kind of gesture equipment and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7442783B2 (en) | 2019-11-08 | 2024-03-05 | 国立大学法人 筑波大学 | Information processing device, information processing method, and program |
| CN111475092A (en) * | 2020-03-23 | 2020-07-31 | 深圳市多亲科技有限公司 | Remote control operation method and device of smart phone and mobile terminal |
| CN113064541A (en) * | 2021-03-30 | 2021-07-02 | 深圳市联谛信息无障碍有限责任公司 | Method and device for facilitating visual disorder user to operate interactive interface |
| CN113064541B (en) * | 2021-03-30 | 2022-08-02 | 深圳市联谛信息无障碍有限责任公司 | Method and device for facilitating visual disorder user to operate interactive interface |
| WO2022267760A1 (en) * | 2021-06-22 | 2022-12-29 | 腾讯科技（深圳）有限公司 | Key function execution method, apparatus and device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109542239A (en) | A kind of gestural control method, gesture equipment and system | |
| US9218058B2 (en) | Wearable digital input device for multipoint free space data collection and analysis | |
| CN107678542B (en) | Ring type wearable device and man-machine interaction method | |
| US20030142065A1 (en) | Ring pointer device with inertial sensors | |
| CN104536574B (en) | A kind of glove-type input equipment and its input method | |
| CN103686283B (en) | A kind of smart television remote controller man-machine interaction method | |
| CN104834372A (en) | Multifunctional wearable human-computer interaction input equipment based on MEMS (Micro Electro Mechanical Systems) acceleration sensor | |
| CN102063183A (en) | Virtual input device of grove type | |
| CN104007844A (en) | Electronic instrument and wearable type input device for same | |
| CN107193455A (en) | A kind of information processing method and mobile terminal | |
| CN109558061A (en) | A kind of method of controlling operation thereof and terminal | |
| CN110989781A (en) | Bag type computer | |
| CN100397838C (en) | Digital type infrared-bluetooth two-bridge universal remote control device | |
| CN110851061A (en) | Method for controlling terminal by ring type mouse | |
| CN113784253B (en) | Multifunctional earphone charging box, control method thereof and terminal control system | |
| CN104636017A (en) | Wireless intelligent terminal control equipment and control method thereof | |
| CN209070493U (en) | A kind of gesture equipment and system | |
| CN103150028A (en) | Hand-held keyboard and input method thereof | |
| CN106155274B (en) | Electronic equipment and information processing method | |
| JP3211484U (en) | Tactile controller | |
| CN102778964B (en) | Air mouse, air mouse realize method and the device of control to cursor | |
| CN204808200U (en) | Multi -functional wearing formula human -computer interaction input device based on MEMS acceleration sensor | |
| CN215268253U (en) | Intelligent finger ring and wearable device with finger ring and glasses matched | |
| CN107145251A (en) | A kind of finger tip input equipment | |
| CN103345345A (en) | Multi-functional transparent capacitive type touch bluetooth wireless keyboard and implementation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |