CN108089708A - A kind of hanging gesture interaction method for improving gesture fatigue - Google Patents
A kind of hanging gesture interaction method for improving gesture fatigue Download PDFInfo
- Publication number
- CN108089708A CN108089708A CN201711409125.XA CN201711409125A CN108089708A CN 108089708 A CN108089708 A CN 108089708A CN 201711409125 A CN201711409125 A CN 201711409125A CN 108089708 A CN108089708 A CN 108089708A
- Authority
- CN
- China
- Prior art keywords
- gesture
- user
- coordinate
- values
- grid
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A kind of hanging gesture interaction method for improving gesture fatigue, for the clicking operation in gesture interaction, the input space of user gesture is defined, and using frame selection strategy and hovering strategy is chosen to choose object element, the input of gesture is completed in the space for gesture of definition.Clicking operation the most frequent to occur in interaction as improvement object, define the input space of user gesture, and using frame selection strategy and hovering strategy is chosen to choose object element, the input of gesture is completed in the space for gesture of definition, user is made to make choice clicking operation in the case where arm naturally droops as far as possible, is alleviated because the fatigue that arm is vacantly brought for a long time；The placement position for clicking on element in user interface is logically repartitioned simultaneously, optimizes the move mode of choice box in frame selection strategy, is alleviated because the arm fatigue brought mobile over long distances.
Description
Technical field
The invention belongs to field of human-computer interaction, and in particular to a kind of hanging gesture interaction method for improving gesture fatigue, it can
Effectively reduce gesture operation fatigue.
Background technology
As the development and people of computer vision technique are to the demands of new interactive means, based on computer vision
Gesture interaction progresses into the people visual field, promotes and is arrived by traditional graphical user interface (GUI, graphic user interface)
The transformation of natural user interface (NUI, natural user interface).It is carried out by human body gesture identification contactless
The system of control has been completely free of the dependence of logarithmic table and remote controler etc., has than the interactive modes such as conventional mouse, keyboard, wound
Broader practice scene is made.
However, the gesture interaction of the cameras such as RGB, RGBD realization is currently based on there are one outstanding feature --- user must
Arm must be lifted, arm is hanging.Traditional gesture input space, the hand based on Kinect proposed such as patent US9063578B2
Gesture input space PHIZ is intended to for the gesture interaction of clear and definite user, and by space lower limit set more than waist, user only lifts
Forearm is played, is just allowed to interact.In terms of interaction design angle, although this is a selection for meeting very much human interaction custom,
But also bring some problems.After the continuous operation of long period, user's arm generates feeling of fatigue, distending pain sense, so as to lose
Lose interaction wish.In field of human-computer interaction, which is referred to as " Gorilla Arm Syndrome ".Solve the problems, such as that this contributes to
The further genralrlization of natural user interface and popularization.
The content of the invention
To overcome existing issue, it is an object of the invention to provide a kind of hanging gesture interaction sides for improving gesture fatigue
Method, enhancing user are using the user experience of the non-contact gesture based on computer vision.
To achieve the above object, the present invention adopts the following technical scheme that：
A kind of hanging gesture interaction method for improving gesture fatigue for the clicking operation in gesture interaction, defines user
The input space of gesture, and using frame selection strategy and hovering strategy is chosen to choose object element, it is used for gesture in definition
Space in complete gesture input.
Further improve of the invention is that detailed process is as follows：
(1) user's skeleton point space coordinates is obtained using body-sensing sensor, and skeleton point is done using double exponential smoothing
Smoothing processing；
(2) to the skeleton point space coordinates after smoothing processing, the input space of user gesture is defined；It is used in step (1)
The user gesture input space of definition is divided into m continuous subintervals, composition in the X-direction of family bone point coordinates
CriterionX ordered sets；By the user gesture input space of definition in the Z-direction of user's bone point coordinates in step (1)
N continuous subintervals are divided into, form criterionZ ordered sets；
(3) gridding of user interface, and establish grid coordinate system；
(4) all set for clicking on element composition in the user interface after gridding are denoted as units；Using quick
Ranking method, by units by the ascending sequence of x values for the top left co-ordinate that element can be clicked in set, can each to click on member
Element sets a column value；Using quick sort, by units by the y values for the top left co-ordinate that element can be clicked in set
Ascending sequence sets a row value can each to click on element；
(5) (row, the column) that element can be clicked in being gathered with units corresponds to grid coordinate system in step (3)
In, substitution can each click on the coordinate of element within a grid；
(6) wrist joint coordinate and user's skeleton point of air line distance acquisition in step (1) of shoulder joint coordinate are calculated
Then projector distance in space coordinates in X-direction is inferred to the projector distance and belongs in criterionX ordered sets
Idx subinterval, the value range of idx is [1, m]；
Calculate wrist joint coordinate and user's bone space of points of air line distance acquisition in step (1) of shoulder joint coordinate
Projector distance in coordinate system in Z-direction is inferred to the projector distance and belongs to i-th dz sub-district in criterionZ ordered sets
Between, the value range of idz is [1, n]；
(7) in the user interface of actuation step (3) gridding it is vertical with it is horizontal without filling choice box be moved to grid
Corresponding position makes at the vertical coordinate (idx, idz) with the horizontal intersection point without filling choice box in step (5) grid；
(8) if kept for t seconds in mesh coordinate (idx, idz) with the intersection point of horizontally selected frame vertically, grid in step (5)
In mesh coordinate (idx, idz) at element of clicking on then be selected.
Further improve of the invention is that the detailed process of step (2) is as follows：
1) meet in the Y-direction for user's skeleton point space coordinates that the input space of user gesture obtains in step (1)：
The Y-coordinate in elbow joint is more than the Y-coordinate of wrist joint；
2) meet in user's skeleton point space coordinates that the input space of user gesture obtains in step (1) in X-direction：
Starting point coordinate value is start_pointx, terminal point coordinate end_pointx, then by the section decile between Origin And Destination
For m sub- continuums, the ceriterionX ordered sets being made of this m continuous subintervals are obtained；
Meet in user's skeleton point space coordinates that the input space of user gesture obtains in step (1) in Z-direction：It rises
Point coordinates value is start_pointz, then the section between Origin And Destination is divided into n by terminal point coordinate end_pointz
A sub- continuum obtains the ceriterionZ ordered sets being made of this n continuous subintervals.
The present invention, which further improves, to be, the start_pointx, end_pointx, start_pointz, end_
Pointz values are respectively 0.01,0.11,0.12,0.22.
Further improve of the invention is that the m values in step 2) and step (3) are that 5, n values are 4.
Further improve of the invention is, will be used for boundary division as 5 × 4 grids, and can each click on element one
In a grid；User interface draw horizontally and vertically two without filling choice box；Level is m net without filling choice box span
Lattice, initial position are user interface bottom；It is vertically n grid without filling choice box span, initial position is left in user interface
Then grid coordinate system is established in side, lower left corner mesh coordinate is (1,1), and upper right corner mesh coordinate is (m, n).
Further improve of the invention is, is each tool clicked on element and set a column value in step (4)
Body process is as follows：Count=0 is initialized, takes out in units click on element successively, if this can click on the upper left of element
The difference of the x values of angular coordinate and the x values of a upper top left co-ordinate that can click on element is more than threshold, and count values increase
1, and the column values that this can be clicked on to element are arranged to count；
It is that each element of clicking on sets the detailed process of a row value as follows in step (4)：Initialize count=0,
It takes out successively in units and clicks on element, if the y values of the top left co-ordinate that can click on element can click on member with upper one
The difference of the y values of the top left co-ordinate of element is more than threshold, count values increase by 1, and the row values that this can be clicked on to element are set
It is set to count.
Further improve of the invention is that threshold values are 5 in step (4).
Further improve of the invention is that t values are 1.25 in step (8).
Compared with prior art, beneficial effects of the present invention：
The gesture input space of the present invention allows user's arm in the case where naturally drooping as far as possible near hip joint
Clicking operation is carried out, the fatigue caused by arm is hanging is enable to alleviate.The gesture input space of the corresponding present invention, using frame
The problems such as selection strategy replaces pointer selection strategy and strategy is chosen in hovering, and solution target positions, erroneous activation.The present invention
The input space and the common input space (PHIZ) and non-overlapping, therefore the gesture interaction method of the present invention and the hanging hand of tradition
Gesture exchange method can coexist, and expand the choice of exchange method.In the interactive system coexisted, user independently selects to hand over
Mutual mode, it is more friendly to new user, while the possibility of flexible configuration is also provided for old user.In addition, based on to common use
The observation at family interface by ignoring the layout gap between element, reduces the displacement distance without filling choice box, also just reduces
User's arm displacement distance alleviates and generates hand fatigue because long range moves.The present invention is based on simple and practicable realization principle,
A kind of solution of the hanging gesture fatigue of reduction of synthesis is provided, there is certain enlightenment effect to this field researcher.
Description of the drawings
Fig. 1 is in the skeleton coordinate system X-direction that the exchange method of the present invention is obtained in body-sensing sensor Kinect
Schematic diagram；
Fig. 2 be experimental duties interface of the present invention and without filling choice box selection course schematic diagram；
Fig. 3 is the coordinate mark schematic diagram that element can be clicked in regular grid interface；
Fig. 4 is the coordinate mark schematic diagram that element can be clicked in the present invention treated grid interface；
Fig. 5 is experimental result of three kinds of exchange methods on Consumed Endurance values；
Fig. 6 is experimental result of three kinds of exchange methods on Borg CR10 values.
Specific embodiment
The present invention will be described in detail below in conjunction with the accompanying drawings.
The present invention proposes a solution for " Gorilla Arm Syndrome ".To occur in interaction the most frequently
Clicking operation for improve object, mainly choose method by defining gesture input space and target, user made to the greatest extent may be used in arm
Clicking operation is made choice in the case of naturally drooping, is alleviated because the fatigue that arm is vacantly brought for a long time；Secondly, it is actual
Gesture interaction application in, there is a situation where that element layout can be clicked on sparse, can logically repartition can click on element
Placement position, so as to reduce the movement of choice box, alleviate because the arm fatigue brought mobile over long distances.The present invention is for most
Common interaction models, click model make improvement, set about respectively in terms of the user gesture input space and user interface two
Optimization, it is therefore intended that arm motion scope is reduced, so as to improve the interaction fatigue of hanging gesture.
A kind of hanging gesture interaction method for improving gesture fatigue for the clicking operation in gesture interaction, defines user
The input space of gesture, and using frame selection strategy and hovering strategy is chosen to choose object element, it is used for gesture in definition
Space in complete gesture input.Detailed process is as follows：
(1) user's skeleton point space coordinates is obtained using body-sensing sensor Kinect, and using double exponential smoothing to bone
Bone point does smoothing processing；
(2) to the skeleton point space coordinates after smoothing processing, the input space of user gesture is defined, only within this space
Gesture movement will triggering effectively input：
1) meet in the Y-direction for user's skeleton point space coordinates that the input space of user gesture obtains in step (1)：
The Y-coordinate in elbow joint is more than the Y-coordinate of wrist joint.That is, the requirement wrist of the rational input space in the lower section of elbow,
It is exactly that apparent bending does not occur for forearm, and upper arm does not also lift
2) meet in user's skeleton point space coordinates that the input space of user gesture obtains in step (1) in X-direction：
Starting point coordinate value is start_pointx, terminal point coordinate end_pointx, then by the section decile between Origin And Destination
For m sub- continuums, the ceriterionX ordered sets being made of this m continuous subintervals are obtained；
Meet in user's skeleton point space coordinates that the input space of user gesture obtains in step (1) in Z-direction：It rises
Point coordinates value is start_pointz, then the section between Origin And Destination is divided into n by terminal point coordinate end_pointz
A sub- continuum obtains the ceriterionZ ordered sets being made of this n continuous subintervals；
Wherein, the start_pointx, end_pointx, start_pointz, end_pointz values are respectively
0.01,0.11, gridding, and by the order of criterionX and criterionZ record grids.M values are that 5, n values are 4.
(3) gridding of user interface, and establish grid coordinate system；
Referring to Fig. 2, boundary division will be used for as 5 × 4 grids, can each click on element in a grid；In user
Interface draw horizontally and vertically two without filling choice box；Level is m grid without filling choice box span, and initial position is boundary
Face bottom；It is vertically n grid without filling choice box span, then initial position establishes grid coordinate system on the left of interface, left
Inferior horn mesh coordinate is (1,1), and upper right corner mesh coordinate is (m, n), so far completes the gridding of user interface；Wherein, m values
It is 4 for 5, n values.Form without filling choice box is as shown in Figure 2.Fig. 3 represents the user interface gridding by this stage
A kind of user interface expression afterwards, the menu button arranged side by side of lower section three, one, upper right side close button.From the angle of mesh generation
From the point of view of degree, the coordinates of three buttons in lower section is (2,1) respectively, (3,1), (4,1), the coordinate of the close button in upper right side be (5,
4).It is noted that this layout middle two rows, left side one arrange it is no it is any click on element, this kind of clearance space operates purpose
For be redundancy, therefore, next the present invention actively ignore these intervals that can not click on element.
(4) all set for clicking on element composition in the user interface after gridding are denoted as units；
(5) it is using quick sort, units is ascending by the x values for the top left co-ordinate that element can be clicked in set
Sequence sets a column value can each to click on element；Detailed process is：Count=0 is initialized, takes out units successively
In click on element, if the upper left corner that the x values of the top left co-ordinate that can click on element can click on element with upper one is sat
The difference of target x values is more than threshold, count values increase by 1, and the column values that this can be clicked on to element are arranged to
count；
Using quick sort, by units by the ascending row of y values for the top left co-ordinate that element can be clicked in set
Sequence sets a row value can each to click on element；Detailed process is：Count=0 is initialized, is taken out successively in units
Element can be clicked on, if the y values of the top left co-ordinate that element can be clicked on and the y of a upper top left co-ordinate that can click on element
The difference of value is more than threshold, count values increase by 1, and the row values that this can be clicked on to element are arranged to count；
Wherein, threshold values are 5.The purpose is to be to eliminate the shake in UI arrangements, that is, floated downward on position
It moves 5 pixels and is still regarded as same row (column).
(6) (row, the column) that element can be clicked in being gathered with units corresponds to grid coordinate system in step (3)
In, substitution can each click on the coordinate of element within a grid；With reference to Fig. 4, by the processing in this stage, user circle after gridding
The three button coordinates in lower section are (1,1) respectively in face, and (2,1), (3,1), the coordinate of close button is (4,2).
(7) wrist joint coordinate and user's skeleton point of air line distance acquisition in step (1) of shoulder joint coordinate are calculated
Then projector distance in space coordinates in X-direction is inferred to the projector distance and belongs in criterionX ordered sets
Idx subinterval, the value range of idx is [1, m]；
Calculate wrist joint coordinate and user's bone space of points of air line distance acquisition in step (1) of shoulder joint coordinate
Projector distance in coordinate system in Z-direction is inferred to the projector distance and belongs to i-th dz sub-district in criterionZ ordered sets
Between, the value range of idz is [1, n]；
(8) corresponding position of grid is moved to without filling choice box with level vertically in actuation step (3), made vertically and water
The flat intersection point without filling choice box is at the coordinate (idx, idz) in step (6) in grid；
(9) if kept for t seconds in mesh coordinate (idx, idz) with the intersection point of horizontally selected frame vertically, grid in step (6)
In mesh coordinate (idx, idz) at element of clicking on then be selected.Wherein, t values are 1.25.In Fig. 2, mesh coordinate
(5,2) it is selected that the element at (takes t seconds) when annular progress bar is rotated by 360 °.
Fig. 1 shows in the above process in the embodiment of body-sensing sensor skeleton point space coordinates X-direction.
Prove that the present invention is reducing the validity of hanging gesture interaction fatigue below by experiment.
Referring to Fig. 2, user interface is divided into 5 × 4 grid, each grid is a rectangle, and orange expression can be clicked on
Element, for grey for that can not click on element, wherein darkorange represents the target that active user need to click on, after the completion of user clicks on,
The target becomes grey, and next target to be clicked on can be identified with darkorange.All orange targets of current page are all selected, under
One page occurs, and similary 8 targets (position is random) wait user to click on.Totally 7 pages, user need a little complete task altogether
Hit 56 targets.In order to embody effectiveness of the invention, the control methods of experiment clicks on method for common gesture, promotes and click on
It is clicked on hovering.Experimental measurements are Consumed Endurance values and BorgCR10 scale values.CE values represent that operation continues
The ratio of duration and tired threshold duration, value is bigger, shows that feeling of fatigue is stronger, belongs to objective measurement.Borg CR10 are one
Subjective scale is tested the feeling of fatigue after being tested to oneself and gives a mark according to the classification of scale, and 0~10 point, value is bigger, shows feeling of fatigue
It is stronger, belong to subjective measurement.Subject is convened from campus, amounts to 20 people, everyone is chosen using promotion, hovers and choose, originally
It invents, totally 3 kinds of methods are respectively completed 56 clicks.The result of experiment as seen in figs. 5-6, wherein push, point-and-
Corresponding promote is chosen, hover and choose, of the invention choose method respectively by dwell, bracelet.This hair as can be seen from the results
Bright CE values and BorgCR10 values is all minimum, and with significance,statistical, shows that the present invention reduces hanging gesture really
Interactive fatigability.
Except effectively alleviating hanging gesture interaction fatigue, because the input space and the common input space of the present invention
(PHIZ) it is and non-overlapping, therefore the exchange method of the present invention and the hanging gesture interaction method of tradition can coexist, and expand interaction
The choice of method.In the interactive system coexisted, additional mode switch button can be aided with so that user independently selects
Exchange method, it is so more friendly to new user, while also provided for old user and flexible method is carried out according to own situation
The possibility of configuration.
Clicking operation the most frequent to occur in interaction as object is improved, the input space of user gesture is defined, and is adopted
With frame selection strategy and hovering strategy is chosen to choose object element, the defeated of gesture is completed in the space for gesture of definition
Enter, user is made to make choice clicking operation in the case where arm naturally droops as far as possible, alleviate because arm is hanging for a long time
The fatigue brought；The placement position for clicking on element in user interface, optimization frame selection are logically repartitioned simultaneously
The move mode of choice box in strategy is alleviated because the arm fatigue brought mobile over long distances.
The upper preferable specific embodiment for the present invention, but protection scope of the present invention is not limited thereto, for
For those of ordinary skill in the art, without departing from the inventive concept of the premise, various modifications and improvements can be made,
These belong to protection scope of the present invention.
Claims (9)
1. a kind of hanging gesture interaction method for improving gesture fatigue, which is characterized in that for the clicking operation in gesture interaction,
The input space of user gesture is defined, and using frame selection strategy and hovering strategy is chosen to choose object element, in definition
For completing the input of gesture in the space of gesture.
A kind of 2. hanging gesture interaction method for improving gesture fatigue according to claim 1, which is characterized in that specific mistake
Journey is as follows：
(1) user's skeleton point space coordinates is obtained using body-sensing sensor, and skeleton point is done smoothly using double exponential smoothing
Processing；
(2) to the skeleton point space coordinates after smoothing processing, the input space of user gesture is defined；User's bone in step (1)
The user gesture input space of definition is divided into m continuous subintervals in the X-direction of bone point coordinates, composition criterionX has
Ordered sets；The user gesture input space of definition is divided into n even in the Z-direction of user's bone point coordinates in step (1)
Continuous subinterval, forms criterionZ ordered sets；
(3) gridding of user interface, and establish grid coordinate system；
(4) all set for clicking on element composition in the user interface after gridding are denoted as units；Using quicksort
Method by units by the ascending sequence of x values for the top left co-ordinate that element can be clicked in set, sets for that each can click on element
Put a column value；Using quick sort, by units by the y values for the top left co-ordinate that element can be clicked in set by small
To big sequence, one row value is set can each to click on element；
(5) (row, the column) that element can be clicked in being gathered with units is corresponded in the grid coordinate system in step (3), is taken
In generation, can each click on the coordinate of element within a grid；
(6) wrist joint coordinate and user's bone space of points of air line distance acquisition in step (1) of shoulder joint coordinate are calculated
Then projector distance in coordinate system in X-direction is inferred to the projector distance and belongs in criterionX ordered sets the i-th dx
Subinterval, the value range of idx is [1, m]；
Calculate wrist joint coordinate and user's skeleton point space coordinates of air line distance acquisition in step (1) of shoulder joint coordinate
Projector distance in system in Z-direction is inferred to the projector distance and belongs to i-th dz subinterval in criterionZ ordered sets,
The value range of idz is [1, n]；
(7) in the user interface of actuation step (3) gridding it is vertical to it is horizontal without filling choice box be moved to the corresponding of grid
Position makes at the vertical coordinate (idx, idz) with the horizontal intersection point without filling choice box in step (5) grid；
(8) if kept for t seconds in mesh coordinate (idx, idz) with the intersection point of horizontally selected frame vertically, in step (5) in grid
Element of clicking at mesh coordinate (idx, idz) is then selected.
A kind of 3. hanging gesture interaction method for improving gesture fatigue according to claim 2, which is characterized in that step
(2) detailed process is as follows：
1) meet in the Y-direction for user's skeleton point space coordinates that the input space of user gesture obtains in step (1)：Elbow
The Y-coordinate in joint is more than the Y-coordinate of wrist joint；
2) meet in user's skeleton point space coordinates that the input space of user gesture obtains in step (1) in X-direction：Starting point
Coordinate value is start_pointx, terminal point coordinate end_pointx, and the section between Origin And Destination then is divided into m
Sub- continuum obtains the ceriterionX ordered sets being made of this m continuous subintervals；
Meet in user's skeleton point space coordinates that the input space of user gesture obtains in step (1) in Z-direction：Starting point is sat
Scale value is start_pointz, terminal point coordinate end_pointz, and the section between Origin And Destination then is divided into n son
Continuum obtains the ceriterionZ ordered sets being made of this n continuous subintervals.
4. a kind of hanging gesture interaction method for improving gesture fatigue according to claim 3, which is characterized in that described
Start_pointx, end_pointx, start_pointz, end_pointz value are respectively 0.01,0.11,0.12,0.22.
A kind of 5. hanging gesture interaction method for improving gesture fatigue according to claim 3, which is characterized in that step 2)
It is that 5, n values are 4 with the m values in step (3).
A kind of 6. hanging gesture interaction method for improving gesture fatigue according to claim 2, which is characterized in that step
(3) detailed process is as follows：Boundary division will be used for as 5 × 4 grids, can each click on element in a grid；With
Family interface draw horizontally and vertically two without filling choice box；Level is m grid without filling choice box span, and initial position is
User interface bottom；It is vertically n grid without filling choice box span, then initial position establishes net on the left of user interface
Lattice coordinate system, lower left corner mesh coordinate are (1,1), and upper right corner mesh coordinate is (m, n).
A kind of 7. hanging gesture interaction method for improving gesture fatigue according to claim 2, which is characterized in that step
(4) it is that each element of clicking on sets the detailed process of a column value as follows in：Count=0 is initialized, is taken out successively
Element is clicked in units, if the x values of the top left co-ordinate that element can be clicked on and a upper upper left that can click on element
The difference of the x values of angular coordinate is more than threshold, count values increase by 1, and the column values that this can be clicked on to element are arranged to
count；
It is that each element of clicking on sets the detailed process of a row value as follows in step (4)：Count=0 is initialized, successively
It takes out in units and clicks on element, if the y values of the top left co-ordinate that can click on element can click on element with upper one
The difference of the y values of top left co-ordinate is more than threshold, count values increase by 1, and the row values that this can be clicked on to element are arranged to
count。
A kind of 8. hanging gesture interaction method for improving gesture fatigue according to claim 7, which is characterized in that step
(4) threshold values are 5 in.
A kind of 9. hanging gesture interaction method for improving gesture fatigue according to claim 2, which is characterized in that step
(8) t values are 1.25 in.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711409125.XA CN108089708A (en) | 2017-12-22 | 2017-12-22 | A kind of hanging gesture interaction method for improving gesture fatigue |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711409125.XA CN108089708A (en) | 2017-12-22 | 2017-12-22 | A kind of hanging gesture interaction method for improving gesture fatigue |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108089708A true CN108089708A (en) | 2018-05-29 |
Family
ID=62178925
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711409125.XA Pending CN108089708A (en) | 2017-12-22 | 2017-12-22 | A kind of hanging gesture interaction method for improving gesture fatigue |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108089708A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110096957A (en) * | 2019-03-27 | 2019-08-06 | 苏州清研微视电子科技有限公司 | The fatigue driving monitoring method and system merged based on face recognition and Activity recognition |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184021A (en) * | 2011-05-27 | 2011-09-14 | 华南理工大学 | Television man-machine interaction method based on handwriting input and fingertip mouse |
| CN102193624A (en) * | 2010-02-09 | 2011-09-21 | 微软公司 | Physical interaction zone for gesture-based user interfaces |
| US20130055120A1 (en) * | 2011-08-24 | 2013-02-28 | Primesense Ltd. | Sessionless pointing user interface |
| CN103399699A (en) * | 2013-07-31 | 2013-11-20 | 华南理工大学 | Method for gesture interaction with one hand serving as center |
| CN104765454A (en) * | 2015-04-02 | 2015-07-08 | 吉林大学 | Human muscle movement perception based menu selection method for human-computer interaction interface |
| CN104808788A (en) * | 2015-03-18 | 2015-07-29 | 北京工业大学 | Method for controlling user interfaces through non-contact gestures |
-
2017
- 2017-12-22 CN CN201711409125.XA patent/CN108089708A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102193624A (en) * | 2010-02-09 | 2011-09-21 | 微软公司 | Physical interaction zone for gesture-based user interfaces |
| CN102184021A (en) * | 2011-05-27 | 2011-09-14 | 华南理工大学 | Television man-machine interaction method based on handwriting input and fingertip mouse |
| US20130055120A1 (en) * | 2011-08-24 | 2013-02-28 | Primesense Ltd. | Sessionless pointing user interface |
| CN103399699A (en) * | 2013-07-31 | 2013-11-20 | 华南理工大学 | Method for gesture interaction with one hand serving as center |
| CN104808788A (en) * | 2015-03-18 | 2015-07-29 | 北京工业大学 | Method for controlling user interfaces through non-contact gestures |
| CN104765454A (en) * | 2015-04-02 | 2015-07-08 | 吉林大学 | Human muscle movement perception based menu selection method for human-computer interaction interface |
Non-Patent Citations (1)
| Title |
|---|
| 史小龙 等: "全息显控界面中多通道人机交互技术研究", 《包装工程》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110096957A (en) * | 2019-03-27 | 2019-08-06 | 苏州清研微视电子科技有限公司 | The fatigue driving monitoring method and system merged based on face recognition and Activity recognition |
| CN110096957B (en) * | 2019-03-27 | 2023-08-08 | 苏州清研微视电子科技有限公司 | Fatigue driving monitoring method and system based on facial recognition and behavior recognition fusion |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104808788B (en) | A kind of method that non-contact gesture manipulates user interface | |
| US9182882B2 (en) | Dynamic creation and modeling of solid models | |
| US9329691B2 (en) | Operation input apparatus and method using distinct determination and control areas | |
| Tian et al. | Tilt menu: using the 3D orientation information of pen devices to extend the selection capability of pen-based user interfaces | |
| CN103440101B (en) | Processing method, system and the mobile phone of a kind of original handwriting data | |
| US20130307765A1 (en) | Contactless Gesture-Based Control Method and Apparatus | |
| CN106023308A (en) | Somatosensory interaction rapid three-dimensional modeling auxiliary system and method thereof | |
| US10338387B2 (en) | Skin-based approach to virtual modeling | |
| CN103246351A (en) | User interaction system and method | |
| CN103529944A (en) | Human body movement identification method based on Kinect | |
| CN103500037A (en) | Track smoothing method and device | |
| CN109782920A (en) | One kind is for extending realistic individual machine exchange method and processing terminal | |
| CN107633551B (en) | The methods of exhibiting and device of a kind of dummy keyboard | |
| CN106406544A (en) | Semantic meaning type man-machine natural interaction control method and system | |
| WO2015108112A1 (en) | Manipulation determination device, manipulation determination method, and program | |
| CN103713741A (en) | Method for controlling display wall through gestures on basis of Kinect | |
| CN105183238A (en) | Handwriting erasing method based on infrared whiteboard, handwriting erasing device and infrared whiteboard thereof | |
| CN106383583B (en) | For the pinpoint method and system of control dummy object every empty human-computer interaction | |
| CN108089708A (en) | A kind of hanging gesture interaction method for improving gesture fatigue | |
| CN104932691A (en) | Real-time gesture interaction system with tactile perception feedback | |
| CN104820584B (en) | Construction method and system of 3D gesture interface for hierarchical information natural control | |
| CN111984151B (en) | Whiteboard canvas size and position roaming control method for improving processing efficiency | |
| CN103941857A (en) | Self-adaptive interface generating method based on human bone extraction in gesture interaction | |
| CN102541249A (en) | Virtual input method based on video image processing | |
| TW201234240A (en) | Device and method for detecting multi-proximity and touch behavior of a proximity-touch detection device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180529 |