CN106484102A - A kind of method and system according to gesture identification user operation action - Google Patents
A kind of method and system according to gesture identification user operation action Download PDFInfo
- Publication number
- CN106484102A CN106484102A CN201610830589.7A CN201610830589A CN106484102A CN 106484102 A CN106484102 A CN 106484102A CN 201610830589 A CN201610830589 A CN 201610830589A CN 106484102 A CN106484102 A CN 106484102A
- Authority
- CN
- China
- Prior art keywords
- gesture
- user
- action
- motion
- gesture motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of method and system according to gesture identification user operation action, wherein, methods described includes step：A, the open command of receive user, open the automatic identification function of terminal；B, the gesture motion of user in real；C, the gesture motion and the gesture motion in action database are contrasted, drawn the corresponding operational motion of the gesture motion；The present invention is realized controlling virtual unit by gesture motion, reaches the Based Intelligent Control of virtual reality device, method simple and effective by arranging user gesture and its corresponding operational motion.
Description
Technical field
The present invention relates to virtual reality device field, more particularly to a kind of method according to gesture identification user operation action
And system.
Background technology
Virtual reality technology is a kind of can to create with the computer simulation system in the experiencing virtual world that it utilizes computer
It is a kind of interactively Three-Dimensional Dynamic what comes into a driver's of Multi-source Information Fusion and the system emulation of entity behavior to generate a kind of simulated environment
User is made to be immersed in the environment.And it is all now the virtual reality all-in-one of the helmet or glasses form.And these are set
Standby, article purchase is being carried out, during game virtual commodity purchasing, if again by extraneous such as mouse, or other equipment is entering
Row article is selected or is paid, and undoubtedly increases the use difficulty of user.
Augmented reality be a kind of calculate in real time the position of camera image and angle and plus respective image, regard
Frequently, the technology of 3D model, the target of this technology are virtual world to be enclosed within real world on screen and carry out interaction.
But when virtual reality or augmented reality equipment are during actual utilization, obtain external object, Huo Zhetong
The physical button that crosses on equipment of itself is carried out when article is selected using very inconvenient.
Therefore, prior art has yet to be improved and developed.
Content of the invention
In view of above-mentioned the deficiencies in the prior art, it is an object of the invention to provide one kind is dynamic according to gesture identification user operation
The method and system of work, it is intended to solve in virtual reality, according to the problem of the action of user gesture identifying user.
Technical scheme is as follows：
A kind of method according to gesture identification user operation action, wherein, including step：
A, the open command of receive user, open the automatic identification function of terminal；
B, the gesture motion of user in real；
C, the gesture motion and the gesture motion in action database are contrasted, drawn the corresponding behaviour of the gesture motion
Make action.
The described method according to gesture identification user operation action, wherein, also includes before step A：
The corresponding relation of S, in advance acquisition user gesture and operational motion, and in preserving to action database.
The described method according to gesture identification user operation action, wherein, includes after step C：
D, the out code of receive user, the automatic identification function that closes a terminal.
The described method according to gesture identification user operation action, wherein, step C includes：
C1, judge whether the gesture motion of user is consistent with the gesture motion in action database；
C2, when the corresponding gesture motion for drawing is consistent with the anticipation of user operation, execute the operation of the corresponding gesture motion
Instruction；
C3, when the corresponding gesture motion for drawing and user anticipation operation inconsistent when, reacquire user action gesture.
A kind of system according to gesture identification user operation action, wherein, including：
Function opening module, for the open command of receive user, opens the automatic identification function of terminal；
Action acquisition module, for the gesture motion of user in real；
Comparing module, for being contrasted the gesture motion with the gesture motion in action database, draws the gesture
The corresponding operational motion of action.
The described system according to gesture identification user operation action, wherein, also includes：
Memory module, for obtaining the corresponding relation of user gesture and operational motion in advance, and in preserving to action database.
The described system according to gesture identification user operation action, wherein, also includes：
Function closedown module, for the out code of receive user, the automatic identification function that closes a terminal.
The described system according to gesture identification user operation action, wherein, the comparing module includes：
Whether judging unit, the gesture motion for judging user are consistent with the gesture motion in action database；
Performance element, for when the corresponding gesture motion for drawing is consistent with the anticipation of user operation, executing the corresponding gesture
The operational order of action；
Unit is recaptured, for when the corresponding gesture motion for drawing is inconsistent with the anticipation of user operation, reacquiring user's
Action gesture.
Beneficial effect：The invention discloses a kind of method and system according to gesture identification user operation action, wherein, institute
The method of stating includes step：A, the open command of receive user, open the automatic identification function of terminal；B, the hand of user in real
Gesture action；C, the gesture motion and the gesture motion in action database are contrasted, shown that the gesture motion is corresponded to
Operational motion；The present invention realizes controlling by gesture motion by arranging user gesture and its corresponding operational motion
Virtual unit, reaches the Based Intelligent Control of virtual reality device, method simple and effective.
Description of the drawings
The step of Fig. 1 is method according to gesture identification user operation action of the present invention flow chart.
The flow chart of the step of Fig. 2 is method according to gesture identification user operation action of the present invention S3.
Fig. 3 is the structured flowchart of the system according to gesture identification user operation action of the present invention.
Fig. 4 is the structured flowchart of the comparing module of the system according to gesture identification user operation action of the present invention.
Specific embodiment
The present invention provides a kind of method and system according to gesture identification user operation action, for make the purpose of the present invention,
Technical scheme and effect clearer, clear and definite, the present invention is described in more detail below.It should be appreciated that described herein
Specific embodiment is not intended to limit the present invention only in order to explain the present invention.
Flow chart the step of Fig. 1, Fig. 1 are method according to gesture identification user operation action of the present invention is referred to,
The invention discloses a kind of method according to gesture identification user operation action, wherein, including step：
S1, the open command of receive user, open the automatic identification function of terminal；
S2, the gesture motion of user in real；
S3, the gesture motion and the gesture motion in action database are contrasted, shown that the gesture motion is corresponding
Operational motion.
The invention discloses a kind of method according to gesture identification user operation action, specifically, automatic identification function
Default conditions are closed mode, when user needs to use, need to first turn on automatic identification function, and therefore, terminal can be received
The open command of user, so as to open the automatic identification function of terminal, after opening automatic identification function, terminal can be obtained in real time
The gesture motion of user, user can make the gesture motion of anticipation operation, after terminal obtains the gesture motion, can be by the gesture
Action is contrasted with the gesture motion in action database, so as to draw the gesture motion in corresponding action database, is entered
And the operational motion needed for user is drawn, to be controlled to virtual unit accordingly.By the method for the invention, Neng Gouzhi
Energy identifying user gesture, to operate to virtual unit, convenient and swift.
Further, the described method according to gesture identification user operation action, wherein, also wraps before step S1
Include：
The corresponding relation of S0, in advance acquisition user gesture and operational motion, and in preserving to action database.Side of the present invention
Method, the gesture according to user draw corresponding gesture motion, and then draw the gesture motion respective operations instruction, therefore, in step
Before rapid S1, need to prestore the corresponding relation of user gesture and operational motion, and in preserving to action database, different
User's hand details is different, therefore, corresponding relation in user's sets itself action database, disclosure satisfy that different users need
Ask.Due to the angle that likes or used of each user, scene can be different, therefore uses for ease of user, and system is carried
The setting of the meaning of gesture and expression is independently defined for user.Independently defined by user, the action set by user and meaning are same
In the memory space divided by sample equipment of being stored in the way of associating one by one, for contrast use is subsequently carried out, user is set certainly
The action of definition：User-defined action is stored, but equipment provides and user-defined path is arranged, specific triggering is certainly
The mode of definition can be entered by menu, or operated by certain physical button, or by voice control
The modes such as system instruction are triggered.Specific triggering mode should be including but not limited to such triggering mode
Further, the described method according to gesture identification user operation action, wherein, includes after step S3：
S4, the out code of receive user, the automatic identification function that closes a terminal.The method of the invention, according to user's hand
After gesture recognizes corresponding gesture motion, user may be selected to close the function, it is to avoid continuous drain, or avoid maloperation, user
Automatic identification function is turned on and off as needed can.
Further, as shown in Fig. 2 for S3 the step of method according to gesture identification user operation action of the present invention
Flow chart, the described method according to gesture identification user operation action, wherein, step S3 includes：
S301, judge whether the gesture motion of user is consistent with the gesture motion in action database；
S302, when the corresponding gesture motion for drawing is consistent with the anticipation of user operation, execute the behaviour of the corresponding gesture motion
Instruct；
S303, when the corresponding gesture motion for drawing and user anticipation operation inconsistent when, reacquire user action gesture.
The method of the invention, in step s3, when contrasting in action data, specific operating process is, first by the hand of user
Gesture motion contrast in gesture action and action database, judge the gesture motion of user whether with action database in gesture
Keep strokes, i.e. judge the gesture motion of user with the presence or absence of consistent gesture motion in action database, consistent when having
During gesture motion, show that there is in action database the gesture motion, it is right in the action database for getting then to need to judge
Whether the gesture motion that answers is the operation that user needs, i.e. whether the corresponding gesture motion for drawing operates one with the anticipation of user
Cause, due in the corresponding operational motion of user setup gesture motion, the different behaviour of the less multiple gestures correspondences of possible difference
Make action, user when being operated, possible gesture slight change, cause the corresponding gesture motion that draws not as user it is contemplated that
Therefore, this judges that step ensure that the operational order of final realization for user it is contemplated that when the corresponding gesture motion for drawing and use
Family anticipation operation is when be consistent, can execute corresponding gesture motion, and work as inconsistent, when, show the gesture motion of user
Gesture motion with which in action database is wrong, then need to reacquire the action gesture of user, continue to judge, until
The corresponding gesture motion gone out needed for user, executes corresponding operation.
The method of the invention, when comparing, according to the action in the user gesture for getting in real time, with action database
Contrasted.Specific way of contrast includes but is not limited in the following manner：1st, pass through 22 joint acquisition actions of finger, will be obtained
The position in 22 joints for taking is contrasted with the carrying out in action database
2nd, contrasted by stereo-picture, as virtual reality electronic equipment has the function of image three-dimensional, so by vertical
Image in body image comparison java standard library.
Further, the present invention also provides a kind of system according to gesture identification user operation action, as shown in figure 3, being
The structured flowchart of the system, wherein, including：
Function opening module 100, for the open command of receive user, opens the automatic identification function of terminal；
Action acquisition module 200, for the gesture motion of user in real；
Comparing module 300, for being contrasted the gesture motion with the gesture motion in action database, draws the hand
The corresponding operational motion of gesture action.The effect of the modules of system of the present invention and operating process in method and step
Through describing in detail, therefore here is not repeated.
Further, the described system according to gesture identification user operation action, wherein, also includes：
Memory module 400, for obtaining the corresponding relation of user gesture and operational motion in advance, and preserves to action database
In.
Further, the described system according to gesture identification user operation action, wherein, also includes：
Function closedown module 500, for the out code of receive user, the automatic identification function that closes a terminal.
Further, as shown in figure 4, comparison for the system according to gesture identification user operation action of the present invention
The structured flowchart of module, wherein, the comparing module 300 includes：
Whether judging unit 301, the gesture motion for judging user are consistent with the gesture motion in action database；
Performance element 302, for when the corresponding gesture motion for drawing is consistent with the anticipation of user operation, executing the corresponding hand
The operational order of gesture action.
Unit 303 is recaptured, for when the corresponding gesture motion for drawing is inconsistent with the anticipation of user operation, reacquiring
The action gesture of user.
In sum, a kind of the invention discloses method and system according to gesture identification user operation action, wherein, institute
The method of stating includes step：A, the open command of receive user, open the automatic identification function of terminal；B, the hand of user in real
Gesture action；C, the gesture motion and the gesture motion in action database are contrasted, shown that the gesture motion is corresponded to
Operational motion；The present invention realizes controlling by gesture motion by arranging user gesture and its corresponding operational motion
Virtual unit, reaches the Based Intelligent Control of virtual reality device, method simple and effective.
It should be appreciated that the application of the present invention is not limited to above-mentioned citing, and for those of ordinary skills, can
To be improved according to the above description or convert, all these modifications and variations should all belong to the guarantor of claims of the present invention
Shield scope.
Claims (8)
1. a kind of method according to gesture identification user operation action, it is characterised in that including step：
A, the open command of receive user, open the automatic identification function of terminal；
B, the gesture motion of user in real；
C, the gesture motion and the gesture motion in action database are contrasted, drawn the corresponding behaviour of the gesture motion
Make action.
2. the method according to gesture identification user operation action according to claim 1, it is characterised in that step A
Also include before：
The corresponding relation of S, in advance acquisition user gesture and operational motion, and in preserving to action database.
3. the method according to gesture identification user operation action according to claim 1, it is characterised in that step C
Include afterwards：
D, the out code of receive user, the automatic identification function that closes a terminal.
4. the method according to gesture identification user operation action according to claim 1, it is characterised in that step C
Including：
C1, judge whether the gesture motion of user is consistent with the gesture motion in action database；
C2, when the corresponding gesture motion for drawing is consistent with the anticipation of user operation, execute the operation of the corresponding gesture motion
Instruction；
C3, when the corresponding gesture motion for drawing and user anticipation operation inconsistent when, reacquire user action gesture.
5. a kind of system according to gesture identification user operation action, it is characterised in that include：
Function opening module, for the open command of receive user, opens the automatic identification function of terminal；
Action acquisition module, for the gesture motion of user in real；
Comparing module, for being contrasted the gesture motion with the gesture motion in action database, draws the gesture
The corresponding operational motion of action.
6. the system according to gesture identification user operation action according to claim 5, it is characterised in that also include：
Memory module, for obtaining the corresponding relation of user gesture and operational motion in advance, and in preserving to action database.
7. the system according to gesture identification user operation action according to claim 5, it is characterised in that also include：
Function closedown module, for the out code of receive user, the automatic identification function that closes a terminal.
8. the system according to gesture identification user operation action according to claim 5, it is characterised in that the comparison mould
Block includes：
Whether judging unit, the gesture motion for judging user are consistent with the gesture motion in action database；
Performance element, for when the corresponding gesture motion for drawing is consistent with the anticipation of user operation, executing the corresponding gesture
The operational order of action
Unit is recaptured, for when the corresponding gesture motion for drawing is inconsistent with the anticipation of user operation, reacquiring user's
Action gesture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610830589.7A CN106484102A (en) | 2016-09-19 | 2016-09-19 | A kind of method and system according to gesture identification user operation action |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610830589.7A CN106484102A (en) | 2016-09-19 | 2016-09-19 | A kind of method and system according to gesture identification user operation action |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106484102A true CN106484102A (en) | 2017-03-08 |
Family
ID=58267460
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610830589.7A Pending CN106484102A (en) | 2016-09-19 | 2016-09-19 | A kind of method and system according to gesture identification user operation action |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106484102A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109712384A (en) * | 2019-01-25 | 2019-05-03 | 北京戴纳实验科技有限公司 | A kind of novel intelligent vent cabinet infrared control system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102810023A (en) * | 2011-06-03 | 2012-12-05 | 联想(北京)有限公司 | Gesture recognition method and terminal equipment |
| CN105487673A (en) * | 2016-01-04 | 2016-04-13 | 京东方科技集团股份有限公司 | Man-machine interactive system, method and device |
| CN205507687U (en) * | 2016-04-12 | 2016-08-24 | 京东方科技集团股份有限公司 | Wear -type virtual reality equipment and virtual reality system |
-
2016
- 2016-09-19 CN CN201610830589.7A patent/CN106484102A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102810023A (en) * | 2011-06-03 | 2012-12-05 | 联想(北京)有限公司 | Gesture recognition method and terminal equipment |
| CN105487673A (en) * | 2016-01-04 | 2016-04-13 | 京东方科技集团股份有限公司 | Man-machine interactive system, method and device |
| CN205507687U (en) * | 2016-04-12 | 2016-08-24 | 京东方科技集团股份有限公司 | Wear -type virtual reality equipment and virtual reality system |
Non-Patent Citations (1)
| Title |
|---|
| 张生军: "《基于视觉的无标记手势识别》", 30 June 2016 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109712384A (en) * | 2019-01-25 | 2019-05-03 | 北京戴纳实验科技有限公司 | A kind of novel intelligent vent cabinet infrared control system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Martinez-Gonzalez et al. | Unrealrox: an extremely photorealistic virtual reality environment for robotics simulations and synthetic data generation | |
| CN106575160A (en) | Method and apparatus for providing interface recognizing movement in accordance with user's view | |
| WO2019041900A1 (en) | Method and device for recognizing assembly operation/simulating assembly in augmented reality environment | |
| CN110147256B (en) | Multi-screen interaction method and device | |
| CN102789312B (en) | A kind of user interactive system and method | |
| EP3899697A1 (en) | Mode-changeable augmented reality interface | |
| WO2018000519A1 (en) | Projection-based interaction control method and system for user interaction icon | |
| KR102021851B1 (en) | Method for processing interaction between object and user of virtual reality environment | |
| CN104750498A (en) | Method for controlling mouse module and electronic device | |
| CN113610984B (en) | Augmented reality method based on hollens 2 holographic glasses | |
| CN109582147A (en) | A kind of method and user equipment enhancing interaction content for rendering | |
| CN112784926A (en) | Gesture interaction method and system | |
| CN107450717A (en) | A kind of information processing method and Wearable | |
| Gupta et al. | Deep learning model based multimedia retrieval and its optimization in augmented reality applications | |
| CN104598113A (en) | Information processing method and electronic equipment | |
| CN106200900A (en) | Based on identifying that the method and system that virtual reality is mutual are triggered in region in video | |
| CN106484102A (en) | A kind of method and system according to gesture identification user operation action | |
| CN106155513B (en) | A kind of control method and device projecting touch screen | |
| US9870061B2 (en) | Input apparatus, input method and computer-executable program | |
| CN109739422B (en) | Window control method, device and equipment | |
| CN114327063A (en) | Interaction method and device of target virtual object, electronic equipment and storage medium | |
| CN105302310B (en) | A kind of gesture identifying device, system and method | |
| CN104765459A (en) | Virtual operation implementation method and device | |
| CN110604918B (en) | Interface element adjustment method and device, storage medium and electronic equipment | |
| CN107340962A (en) | Input method, device and virtual reality device based on virtual reality device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170308 |
|
| RJ01 | Rejection of invention patent application after publication |