CN111722703A - Gesture interaction method and system - Google Patents
Gesture interaction method and system Download PDFInfo
- Publication number
- CN111722703A CN111722703A CN201910223466.0A CN201910223466A CN111722703A CN 111722703 A CN111722703 A CN 111722703A CN 201910223466 A CN201910223466 A CN 201910223466A CN 111722703 A CN111722703 A CN 111722703A
- Authority
- CN
- China
- Prior art keywords
- movement information
- gesture
- information feature
- feature
- features
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a gesture interaction method and a system, comprising the following steps: when gesture operation of a user is obtained, obtaining gesture movement information characteristics according to the gesture operation; when the gesture movement information features are matched with first movement information features in preset interactive movement information features, corresponding related operations are executed according to the first movement information features, wherein the interactive movement information features comprise: a mobile selection information feature, a fast movement information feature, a flip down determination information feature, a dwell load information feature, a shake negative information feature. The gesture interaction method and the gesture interaction system provided by the invention realize closed-loop selection of operation, have no clear hand posture definition, have very low learning cost for gesture interaction users, have interaction universality and can reduce interaction misoperation of gestures.
Description
Technical Field
The invention relates to the technical field of human-computer interaction, in particular to a gesture interaction method and system.
Background
Currently, there are many ways to recognize gestures, most of which follow the following process flow: firstly, obtaining a gesture template with predefined characteristics through a training gesture; the actual gesture is then determined by comparing features of the gesture template to features extracted from the input image.
However, in the existing gesture command, the specification of a whole set of closed-loop full gesture command does not exist, and the learning cost is increased in the using process, so that the user can hardly operate the closed-loop full gesture command according to living habits.
Therefore, a method and a system for gesture interaction are needed to solve the above problems.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a gesture interaction method and system, which can realize closed-loop selection of operation, have no clear hand posture definition, have very low learning cost for gesture interaction users, have interaction universality and can reduce interaction misoperation of gestures.
The technical problem to be solved by the invention is realized by adopting the following technical scheme:
a gesture interaction method, comprising: when gesture operation of a user is obtained, obtaining gesture movement information characteristics according to the gesture operation; when the gesture movement information features are matched with first movement information features in preset interactive movement information features, corresponding related operations are executed according to the first movement information features, wherein the interactive movement information features comprise: a mobile selection information feature, a fast movement information feature, a flip down determination information feature, a dwell load information feature, a shake negative information feature.
In a preferred embodiment of the present invention, when the gesture movement information feature matches a first movement information feature in the preset interactive movement information features, the step of performing the corresponding related operation according to the first movement information feature includes: and a mapping relation table recorded with interactive mobile information characteristics and related operations is established in advance.
In a preferred embodiment of the present invention, when the gesture movement information feature matches a first movement information feature in the preset interactive movement information features, the step of performing corresponding related operations according to the first movement information feature includes: matching the gesture movement information features with the movement selection information features; and controlling the cursor to move in real time according to the movement of the gesture operation.
In a preferred embodiment of the present invention, when the gesture movement information feature matches a first movement information feature in the preset interactive movement information features, the step of performing corresponding related operations according to the first movement information feature includes: matching the gesture movement information features with the quick movement information features; and performing left-right page turning and/or multi-window selection operation of the page according to the moving direction of the gesture operation.
In a preferred embodiment of the present invention, when the gesture movement information feature matches a first movement information feature in the preset interactive movement information features, the step of performing corresponding related operations according to the first movement information feature includes: matching the gesture movement information characteristics with the information characteristics of the withholding load to acquire control cursor position information; when the staying position of the control cursor is in the control area, executing loading operation on the control area; when the staying position of the control cursor is not in the control area, no operation is executed.
In a preferred embodiment of the present invention, when the gesture movement information feature matches a first movement information feature in the preset interactive movement information features, the step of performing corresponding related operations according to the first movement information feature includes: and matching the movement information characteristic of the gesture operation with the shaking negative information characteristic, and executing the negative or removal operation of the current gesture operation.
In a preferred embodiment of the present invention, when the gesture movement information feature matches a first movement information feature in the preset interactive movement information features, the step of performing corresponding related operations according to the first movement information feature includes: matching the movement information characteristic of the gesture operation with the information characteristic determined by turning down to obtain the movement direction of the gesture instruction; if the mobile terminal moves from top to bottom, the upturning operation is executed; if the mobile terminal moves from bottom to top, the operation of turning down is executed.
In a preferred embodiment of the present invention, the step of obtaining the gesture movement information feature according to the gesture operation when obtaining the gesture operation of the user includes: and taking the movement information characteristic of the part where the hand of the user starts to move firstly as the gesture movement information characteristic, or taking the hand of the user as a whole and taking the whole movement information characteristic as the gesture movement information characteristic.
In a preferred embodiment of the present invention, the gesture interaction method further includes adding and/or modifying a mapping relationship between the interactive movement information feature and the related operation.
A gesture interaction system, comprising: a memory and a processor; the memory is used for storing an application program; the processor is used for running the application program to execute the following steps: when gesture operation of a user is obtained, obtaining gesture movement information characteristics according to the gesture operation; when the gesture movement information features are matched with first movement information features in preset interactive movement information features, corresponding related operations are executed according to the first movement information features, wherein the interactive movement information features comprise: a mobile selection information feature, a fast movement information feature, a flip down determination information feature, a dwell load information feature, a shake negative information feature.
The technical effect achieved by adopting the technical scheme is as follows: and acquiring gesture movement information characteristics of the gesture operation of the user and matching the gesture movement information characteristics with preset interactive movement information characteristics, and executing the operation corresponding to the gesture movement information characteristics after the matching is successful. The closed-loop selection of the operation is realized through the operation corresponding to the preset interactive movement information characteristics, no clear hand posture definition exists, the learning cost of gesture interaction users is very low, the interaction universality is realized, and the interaction misoperation of the gesture can be reduced.
The foregoing description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly understood, the present invention may be implemented in accordance with the content of the description, and in order to make the above and other objects, features, and advantages of the present invention more clearly understood, the following preferred embodiments are specifically described in detail with reference to the accompanying drawings.
Drawings
FIG. 1 is a flowchart of a gesture interaction method according to a first embodiment of the present invention;
FIG. 2 is a diagram illustrating a gesture interaction system according to a second embodiment of the present invention.
Detailed Description
To further illustrate the technical measures and effects taken by the present invention to achieve the intended objects, embodiments of the present invention will be described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. While the present invention has been described in connection with the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but is intended to cover various modifications, equivalent arrangements, and specific embodiments thereof.
Referring to fig. 1, fig. 1 is a flowchart illustrating a gesture interaction method according to a first embodiment of the invention.
In an embodiment, the main body of the gesture interaction method is a terminal device, the terminal device is a fixed terminal or a mobile terminal, the fixed terminal may be a personal computer, a vehicle-mounted terminal, and the like, and the mobile terminal may be a smart phone, a tablet computer, an MP3(moving picture expert group audio layer iii, motion picture experts compression standard audio layer 3), a PDA (personal digital assistant), and the like.
As shown in fig. 1, the gesture interaction method provided by the present application includes:
step S11: and when the gesture operation of the user is acquired, acquiring the gesture movement information characteristic according to the gesture operation.
Wherein the gesture movement information features include: moving track, moving time, moving speed and moving direction.
Specifically, in one embodiment, the movement selection information is characterized in that the movement speed is less than the preset speed and the movement track is not a continuous back-and-forth movement within the preset speed. The fast moving information is characterized in that the moving speed is greater than or equal to the preset speed, the moving track is not continuous reciprocating motion in the preset speed, and the moving direction is only the horizontal direction or the vertical direction. The downward turning determining information is characterized in that the moving track of the downward turning determining information is continuous upward and downward reciprocating movement in preset time. The shaking negative information is characterized in that the moving track of the shaking negative information is continuously moved back and forth left and right within the preset time. Dwell load information is characterized by a time for which no movement is made greater than a threshold.
In one embodiment, step S11: when the gesture operation of the user is acquired, acquiring the gesture movement information characteristics according to the gesture operation comprises the following steps: and acquiring the gesture operation of the user through a camera, a thermal imaging device or other devices. Specifically, in the present embodiment, after the hand of the user is recognized by the camera, the gesture operation of the hand of the user is acquired.
In one embodiment, step S11: when the gesture operation of the user is acquired, acquiring the gesture movement information characteristics according to the gesture operation comprises the following steps: and taking the movement information characteristic of the part where the hand of the user starts to move first as the gesture movement information characteristic. Specifically, the gesture movement information feature may be, but is not limited to, a movement information feature of a part where the user hand first starts to move, for example, in another embodiment, the user hand may be taken as a whole, and the movement information feature of the whole may be taken as the gesture movement information feature.
Step S12: and when the gesture movement information characteristic is matched with a first movement information characteristic in the preset interactive movement information characteristic, executing corresponding related operation according to the first movement information characteristic.
Wherein the interactive mobile information features include: a mobile selection information feature, a fast movement information feature, a flip down determination information feature, a dwell load information feature, a shake negative information feature. In particular, the corresponding operations are moving a control cursor, page turning or multi-window selection of a screen, page turning down, loading and negating the current operation
Specifically, if the gesture movement information feature is not matched with a first movement information feature in the preset interactive movement information feature, the user is prompted to re-input.
In one embodiment, at least one of a movement track, a movement speed, a movement time and a movement direction in the gesture movement information features is matched and verified with a first movement information feature in the interactive movement information features.
In one embodiment, step S12: when the gesture movement information feature is matched with a first movement information feature in the preset interactive movement information features, the method comprises the following steps of executing corresponding related operations according to the first movement information feature: and a mapping relation table recorded with interactive mobile information characteristics and related operations is established in advance. Specifically, when the gesture movement information feature of the gesture operation is matched with the interaction movement information feature, it is described that the operation corresponding to the gesture operation is included in the mapping relationship table.
In one embodiment, step S12: when the gesture movement information feature is matched with a first movement information feature in the preset interactive movement information features, executing corresponding related operations according to the first movement information feature comprises the following steps: matching the gesture movement information features with the movement selection information features; and controlling the cursor to move in real time according to the movement of the gesture operation.
In one embodiment, step S12: when the gesture movement information feature is matched with a first movement information feature in the preset interactive movement information features, executing corresponding related operations according to the first movement information feature comprises the following steps: matching the gesture movement information features with the quick movement information features; and performing left-right page turning and/or multi-window selection operation of the page according to the moving direction of the gesture operation.
In one embodiment, step S12: when the gesture movement information feature is matched with a first movement information feature in the preset interactive movement information features, executing corresponding related operations according to the first movement information feature comprises the following steps: matching the gesture movement information characteristics with the information characteristics of the withholding load to acquire control cursor position information; when the staying position of the control cursor is in the control area, executing loading operation on the control area; when the staying position of the control cursor is not in the control area, no operation is executed.
In one embodiment, step S12: when the gesture movement information feature is matched with a first movement information feature in the preset interactive movement information features, executing corresponding related operations according to the first movement information feature comprises the following steps: and matching the movement information characteristic of the gesture operation with the shaking negative information characteristic, and executing the negative or removal operation of the current gesture operation.
In one embodiment, step S12: when the gesture movement information feature is matched with a first movement information feature in the preset interactive movement information features, executing corresponding related operations according to the first movement information feature comprises the following steps: matching the movement information characteristic of the gesture operation with the information characteristic determined by turning down to obtain the movement direction of the gesture instruction; if the mobile terminal moves from top to bottom, the upturning operation is executed; if the mobile terminal moves from bottom to top, the operation of turning down is executed.
In another embodiment, the gesture interaction method further comprises adding and/or modifying a mapping relation between the interactive movement information features and the related operations.
Specifically, the gesture interaction method provided by the application obtains the gesture movement information characteristics of the gesture operation of the user to be matched with the preset interaction movement information characteristics, and executes the operation corresponding to the gesture movement information characteristics after the matching is successful. The closed-loop selection of the operation is realized through the operation corresponding to the preset interactive movement information characteristics, no clear hand posture definition exists, the learning cost of gesture interaction users is very low, the interaction universality is realized, and the interaction misoperation of the gesture can be reduced.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a voice broadcast language switching terminal according to a second embodiment of the present invention.
As shown in fig. 2, the speech switching terminal for voice broadcast provided by the present application includes: a memory 10 and a processor 20.
Specifically, the memory 10 is used for storing an application program, and the processor 20 is used for running the application program to execute the following steps: when gesture operation of a user is obtained, obtaining gesture movement information characteristics according to the gesture operation; when the gesture movement information features are matched with first movement information features in preset interactive movement information features, corresponding related operations are executed according to the first movement information features, wherein the interactive movement information features comprise: a mobile selection information feature, a fast movement information feature, a flip down determination information feature, a dwell load information feature, a shake negative information feature.
The preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the specific details of the above embodiments, the above embodiments are exemplary, and are not to be construed as limiting the present invention, and various simple modifications can be made to the technical solution of the present invention within the scope of the technical idea of the present invention, and these simple modifications all belong to the protection scope of the present invention.
Claims (10)
1. A gesture interaction method is characterized by comprising the following steps:
when gesture operation of a user is obtained, obtaining gesture movement information characteristics according to the gesture operation;
when the gesture movement information features are matched with first movement information features in preset interactive movement information features, corresponding related operations are executed according to the first movement information features, wherein the interactive movement information features comprise: a mobile selection information feature, a fast movement information feature, a flip down determination information feature, a dwell load information feature, a shake negative information feature.
2. The gesture interaction method according to claim 1, wherein when the gesture movement information feature is matched with a first movement information feature in preset interaction movement information features, the step of performing corresponding related operations according to the first movement information feature is preceded by:
and a mapping relation table recorded with the interactive mobile information characteristics and the related operation is established in advance.
3. The gesture interaction method according to claim 1, wherein when the gesture movement information feature is matched with a first movement information feature in preset interaction movement information features, the step of performing corresponding related operations according to the first movement information feature comprises:
the gesture movement information feature is matched with the movement selection information feature;
and controlling the cursor to move in real time according to the movement of the gesture operation.
4. The gesture interaction method according to claim 1, wherein when the gesture movement information feature is matched with a first movement information feature in preset interaction movement information features, the step of performing corresponding related operations according to the first movement information feature comprises:
the gesture movement information feature is matched with the fast movement information feature;
and performing left-right page turning and/or multi-window selection operation of the page according to the moving direction of the gesture operation.
5. The gesture interaction method according to claim 1, wherein when the gesture movement information feature is matched with a first movement information feature in preset interaction movement information features, the step of performing corresponding related operations according to the first movement information feature comprises:
the gesture movement information characteristics are matched with the information characteristics loaded by the withholding to acquire control cursor position information;
when the staying position of the control cursor is in a control area, executing loading operation on the control area;
and when the staying position of the control cursor is not in the control area, not executing any operation.
6. The gesture interaction method according to claim 1, wherein when the gesture movement information feature is matched with a first movement information feature in preset interaction movement information features, the step of performing corresponding related operations according to the first movement information feature comprises:
and the movement information characteristic of the gesture operation is matched with the shaking negation information characteristic, and negation or removal operation of the current gesture operation is executed.
7. The gesture interaction method according to claim 1, wherein when the gesture movement information feature is matched with a first movement information feature in preset interaction movement information features, the step of performing corresponding related operations according to the first movement information feature comprises:
the moving information characteristic of the gesture operation is matched with the information characteristic determined by the downward turning, and the moving direction of the gesture instruction is obtained;
if the mobile terminal moves from top to bottom, the upturning operation is executed;
if the mobile terminal moves from bottom to top, the operation of turning down is executed.
8. The gesture interaction method according to claim 1, wherein when acquiring the gesture operation of the user, the step of acquiring the gesture movement information feature according to the gesture operation includes:
the movement information characteristic of the part of the hand of the user which starts to move first is taken as the gesture movement information characteristic, or
And taking the hand of the user as a whole, and taking the whole movement information characteristic as the gesture movement information characteristic.
9. The gesture interaction method of claim 1, further comprising adding and/or modifying a mapping relationship between interactive movement information features and related operations.
10. A gesture interaction system, comprising: a memory and a processor;
the memory is used for storing an application program;
the processor is used for running the application program to execute the following steps:
when gesture operation of a user is obtained, obtaining gesture movement information characteristics according to the gesture operation;
when the gesture movement information features are matched with first movement information features in preset interactive movement information features, corresponding related operations are executed according to the first movement information features, wherein the interactive movement information features comprise: a mobile selection information feature, a fast movement information feature, a flip down determination information feature, a dwell load information feature, a shake negative information feature.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910223466.0A CN111722703A (en) | 2019-03-22 | 2019-03-22 | Gesture interaction method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910223466.0A CN111722703A (en) | 2019-03-22 | 2019-03-22 | Gesture interaction method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111722703A true CN111722703A (en) | 2020-09-29 |
Family
ID=72563530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910223466.0A Pending CN111722703A (en) | 2019-03-22 | 2019-03-22 | Gesture interaction method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111722703A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853561A (en) * | 2009-04-03 | 2010-10-06 | 玴荣科技股份有限公司 | Gesture-controlled remote control system |
| CN103139627A (en) * | 2013-02-07 | 2013-06-05 | 上海集成电路研发中心有限公司 | Intelligent television and gesture control method thereof |
| CN106648079A (en) * | 2016-12-05 | 2017-05-10 | 华南理工大学 | Human face identification and gesture interaction-based television entertainment system |
| US20170205939A1 (en) * | 2015-09-10 | 2017-07-20 | Boe Technology Group Co., Ltd. | Method and apparatus for touch responding of wearable device as well as wearable device |
| CN108268181A (en) * | 2017-01-04 | 2018-07-10 | 奥克斯空调股份有限公司 | A kind of control method and device of non-contact gesture identification |
-
2019
- 2019-03-22 CN CN201910223466.0A patent/CN111722703A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853561A (en) * | 2009-04-03 | 2010-10-06 | 玴荣科技股份有限公司 | Gesture-controlled remote control system |
| CN103139627A (en) * | 2013-02-07 | 2013-06-05 | 上海集成电路研发中心有限公司 | Intelligent television and gesture control method thereof |
| US20170205939A1 (en) * | 2015-09-10 | 2017-07-20 | Boe Technology Group Co., Ltd. | Method and apparatus for touch responding of wearable device as well as wearable device |
| CN106648079A (en) * | 2016-12-05 | 2017-05-10 | 华南理工大学 | Human face identification and gesture interaction-based television entertainment system |
| CN108268181A (en) * | 2017-01-04 | 2018-07-10 | 奥克斯空调股份有限公司 | A kind of control method and device of non-contact gesture identification |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022022495A1 (en) | Cross-device object dragging method and device | |
| KR102062310B1 (en) | Method and apparatus for prividing control service using head tracking in an electronic device | |
| US11366582B2 (en) | Screenshot capturing method, device, electronic device and computer-readable medium | |
| US9223487B2 (en) | Electronic apparatus, method of controlling the same, and related computer program | |
| US20200210061A1 (en) | Method, device and storage medium for sharing multimedia resource | |
| KR102462364B1 (en) | Method of displaying an image by using a scroll bar and apparatus thereof | |
| KR102373021B1 (en) | Global special effect conversion method, conversion device, terminal equipment and storage medium | |
| CN108920070B (en) | Screen splitting method and device based on special-shaped display screen, storage medium and mobile terminal | |
| WO2022188545A1 (en) | Content display method and apparatus, storage medium, and electronic device | |
| JP2023533281A (en) | Device control method and apparatus, storage medium and electronic device | |
| CN105739817B (en) | A kind of method, device and mobile terminal of icon hiding | |
| CN104182120B (en) | The display methods and display device of screen interface | |
| CN105808145A (en) | Method and terminal for achieving image processing | |
| CN109067944B (en) | Terminal control method, device, mobile terminal and storage medium | |
| EP4131055A1 (en) | Annotation method and electronic device | |
| CN108874481A (en) | Handle the method and device of suspended window | |
| CN108989553A (en) | The method, apparatus and electronic equipment of scene manipulation | |
| CN111722703A (en) | Gesture interaction method and system | |
| WO2020052374A1 (en) | Screenshot method and device | |
| CN112445348A (en) | Expression processing method, device and medium | |
| US20150234546A1 (en) | Method for Quickly Displaying a Skype Contacts List and Computer Program Thereof and Portable Electronic Device for Using the Same | |
| CN114647623A (en) | Folder processing method, intelligent terminal and storage medium | |
| CN113687722A (en) | Page control method, device, equipment and storage medium of electronic equipment | |
| CN109976549B (en) | Data processing method, device and machine readable medium | |
| CN105208196A (en) | Call initiation method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200929 |