CN107193463A - The method and apparatus of gesture operation is simulated on the mobile apparatus - Google Patents
The method and apparatus of gesture operation is simulated on the mobile apparatus Download PDFInfo
- Publication number
- CN107193463A CN107193463A CN201610146644.0A CN201610146644A CN107193463A CN 107193463 A CN107193463 A CN 107193463A CN 201610146644 A CN201610146644 A CN 201610146644A CN 107193463 A CN107193463 A CN 107193463A
- Authority
- CN
- China
- Prior art keywords
- mobile device
- gesture
- relative movement
- user
- simulated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
It is an object of the invention to provide the method and apparatus for simulating gesture operation on the mobile apparatus.The present invention can detect the relative movement operation that user is carried out to mobile device relative datum face.Then, the present invention can simulate the gesture operation corresponding to detected relative movement operation on the mobile device.The present invention proposes a kind of novel simulation and such as clicks on the scheme that gesture operation, slip gesture operate gesture operation.The present invention, which is solved when user's inconvenience directly performs gesture operation to mobile device, can not manipulate the technical problem of mobile device.Present invention could apply to user inconvenience directly to mobile device perform gesture operation application scenarios in, such as when user wears gloves.According to the present invention program, when user wears gloves, user can carry out relative movement operation to mobile device relative datum face, and the present invention can simulate the gesture operation corresponding to the relative movement operation that the user is carried out.
Description
Technical field
Hand is simulated on the mobile apparatus the present invention relates to mobile device technology field, more particularly to one kind
The technology of gesture operation.
Background technology
In cold snap, user's ordinary practice wears gloves.However, when user wears gloves, by
Can not directly contact the touch-screen of mobile device in finger, user can not mobile device touch-screen
Gesture operation, slip gesture operation gesture operation are such as clicked in upper execution.
The content of the invention
It is an object of the invention to provide the method and apparatus for simulating gesture operation on the mobile apparatus.
According to an aspect of the invention, there is provided a kind of gesture operation of simulation on the mobile apparatus
Method, this method includes：
The relative movement operation that-detection user is carried out to mobile device relative datum face；
- gesture operation relatively moved corresponding to operation is simulated on the mobile device.
According to another aspect of the present invention, a kind of gesture behaviour of simulation on the mobile apparatus is additionally provided
The device of work, wherein, the device includes：
- it is used for the device for detecting that the relative movement that user is carried out to mobile device relative datum face is operated；
- be used to simulate the gesture operation corresponding to the relative movement operation on the mobile device
Device.
Compared with prior art, the present invention can detect that user is carried out to mobile device relative datum face
Relative movement operation.Then, the present invention can simulate detected phase on the mobile device
To the gesture operation corresponding to moving operation.The present invention proposes a kind of novel simulation and such as puts hitter
The scheme of the gesture operations such as gesture operation, slip gesture operation.The present invention solves user's inconvenience directly
The technical problem of mobile device can not be manipulated when performing gesture operation to mobile device.The present invention can be with
In the application scenarios for directly performing gesture operation to mobile device applied to user's inconvenience, such as user
When wearing gloves.When user wears gloves, the finger of user can not directly contact the touch of mobile device
Screen, therefore user can not perform such as click gesture operation, slip hand on the touch-screen of mobile device
The gesture operations such as gesture operation.According to the present invention program, when user wears gloves, user can be to moving
Dynamic equipment relative datum face carries out relative movement operation, and the present invention can simulate the user and be carried out
The corresponding gesture operation of relative movement operation.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings,
The other features, objects and advantages of the present invention will become more apparent upon：
Fig. 1 shows that one kind according to an embodiment of the invention simulates gesture operation on the mobile apparatus
Method flow diagram；
Fig. 2 shows that one kind according to an embodiment of the invention simulates gesture operation on the mobile apparatus
Schematic device.
Same or analogous reference represents same or analogous part in accompanying drawing.
Embodiment
It should be mentioned that some are exemplary before exemplary embodiment is discussed in greater detail
Embodiment is described as processing or the method described as flow chart.Although flow chart grasps items
Be described into the processing of order, but many of which operation can by concurrently, concomitantly or
Person implements simultaneously.In addition, the order of operations can be rearranged.When its operation is completed
Shi Suoshu processing can be terminated, it is also possible to the additional step being not included in accompanying drawing.
The processing can correspond to method, function, code, subroutine, subprogram etc..
Alleged within a context " computer equipment ", also referred to as " computer ", referring to can be by fortune
Row preset program instructs to perform the predetermined process process such as numerical computations and/or logical calculated
Intelligent electronic device, it can include processor and memory, by computing device in memory
In the programmed instruction that prestores perform predetermined process process, or by ASIC, FPGA, DSP
Predetermined process process is performed Deng hardware, or is realized by said two devices combination.Computer equipment
Including but not limited to server, PC, notebook computer, tablet personal computer, smart mobile phone
Deng.
The computer equipment is for example including mobile device and the network equipment.Wherein, the movement
Equipment includes but is not limited to smart mobile phone, PDA etc.；The network equipment includes but is not limited to list
The individual webserver, multiple webservers composition server group or based on cloud computing (Cloud
Computing the cloud being made up of a large amount of computers or the webserver), wherein, cloud computing
It is one kind of Distributed Calculation, a super void being made up of the computer collection of a group loose couplings
Intend computer.Wherein, the computer equipment can isolated operation realize the present invention, also can connect
Enter network and the present invention is realized by the interactive operation with other computer equipments in network.
Wherein, the network residing for the computer equipment includes but is not limited to internet, wide area network, city
Domain net, LAN, VPN etc..
It should be noted that the mobile device, the network equipment and network etc. are only for example, its
He is such as applicable to the present invention at computer equipment or network existing or be likely to occur from now on,
It should be included within the scope of the present invention, and be incorporated herein by reference.
The method (some of them are illustrated by flow) discussed herein below can be by hard
Part, software, firmware, middleware, microcode, hardware description language or its any combination are come
Implement.When with software, firmware, middleware or microcode to implement, to implement necessary appoint
The program code or code segment of business can be stored in machine or computer-readable medium (is such as deposited
Storage media) in.(one or more) processor can implement necessary task.
Concrete structure and function detail disclosed herein are only representational, and are to be used for
The purpose of the exemplary embodiment of the present invention is described.But the present invention can pass through many replacement shapes
Formula is implemented, and is not interpreted as being limited only by the embodiments set forth herein.
Although it should be appreciated that may have been used term " first ", " second " etc. herein
To describe unit, but these units should not be limited by these terms.Use these arts
Language is used for the purpose of making a distinction a unit and another unit.For example, do not carrying on the back
In the case of scope from exemplary embodiment, first module can be referred to as second unit, and
And similarly second unit can be referred to as first module.Term "and/or" used herein above
Including any of the associated item listed by one of them or more and all combinations.
Term used herein above is not intended to limit and shown just for the sake of description specific embodiment
Example property embodiment.Unless the context clearly dictates otherwise, otherwise odd number shape used herein above
Formula " one ", " one " also attempt to include plural number.It is to be further understood that used herein above
Term " comprising " and/or "comprising" provide stated feature, integer, step, operation, unit
And/or the presence of component, and do not preclude the presence or addition of other one or more features, integer,
Step, operation, unit, component and/or its combination.
It should further be mentioned that in some replaces realization modes, the function/action being previously mentioned can
To occur according to the order different from being indicated in accompanying drawing.For example, depending on involved work(
Energy/action, the two width figures shown in succession can essentially substantially simultaneously perform or sometimes can be with
Perform in a reverse order.
The present invention is described in further detail below in conjunction with the accompanying drawings.
The present invention can be realized by mobile device.More specifically, the solution of the present invention for example can be by
The application installing and run in mobile device is realized.Further, the solution of the present invention can
To be integrated in as One function module in aforementioned applications.
For the sake of simple declaration, the present invention is more, and with application, simulation gesture operation enters on the mobile apparatus
Row citing.
Specifically, the application detection user in mobile device is carried out to mobile device relative datum face
Relative movement operation；Then, relative movement operation is simulated in the application on the mobile device
Corresponding gesture operation.
Wherein, mobile device includes but is not limited to any one based on the hand-held of intelligent operating system
Formula electronic product, its can with user by keyboard, dummy keyboard, touch pad, touch-screen and
The input equipments such as voice-operated device carry out man-machine interaction, smart mobile phone, tablet personal computer etc..
Wherein, intelligent operating system includes but is not limited to any by providing various applications to mobile device
(Application, referred to as APP) enriches the operating system of functions of the equipments, such as Android
(Android), IOS, Windows Phone etc..
Here, the application in the present invention means device and runs on the program product of mobile device,
Such as various reading class APP, browser APP.
Fig. 1 shows method flow diagram according to an embodiment of the invention, and it specifically illustrates one kind
The process of gesture operation is simulated on the mobile apparatus.In step sl, using detection user to moving
The relative movement operation that dynamic equipment relative datum face is carried out；In step s 2, this is applied at this
The corresponding gesture operation of relative movement operation is simulated on mobile device.
Specifically, in step sl, mobile device relative datum face is carried out using detection user
Relative movement operation.
Here, the usual device of mobile device has one or more action sensors, such as gyroscope is passed
Sensor, gravity sensor, acceleration transducer etc..Sensor can be detected to be set on movement
Standby various sensing datas, these sensing datas can reflect mobile device laying state,
Motion state.Wherein, the laying state of mobile device such as keeping flat, place vertically, tilt.Move
The motion state of dynamic equipment is for example static, motion, and the direction of motion, movement velocity etc..
Using the sensing data record for the laying state that can react one group mobile device
On the basis of sensing data.Face where the mobile device screen that the benchmark sensing data is reacted is i.e.
It can be determined that reference plane.Alternatively, the line perpendicular with reference plane can be determined that base
Fiducial axis.
Relative movement that the user is carried out to mobile device relative datum face operation is included but not
It is limited to the tilt operation (that is, user tilts the mobile device) in relative datum face, relative base
Standard is in face of various operations such as the moving operations of mobile device.
Here, using can be by the current sensing data of mobile device compared with benchmark sensing data
Compared with, to determine that the relative movement that user is carried out to mobile device relative datum face is operated, such as phase
Tilt operation, user to reference plane move moving operation of the mobile device etc. along a direction.
Those skilled in the art will be understood that reference plane not one be present in fixed position face.
If, can for example, the benchmark sensing data current laying state of reaction mobile device is keeps flat
It is reference plane with the face for being present in any height for reflecting flat condition.
For the sake of simple declaration, the present invention is illustrated more using horizontal plane as reference plane.This
Art personnel will be understood that in the application scenarios of the present invention scope of activities of user is led to
Normal smaller (in such as one city), the moving range of mobile device is generally also relatively limited.
It is approximately a plane as " horizontal plane " of reference plane under this application scenarios.However,
Consider that User Activity scope is larger, mobile device moving range is also in larger application scenarios
(for example, user goes by air Paris of flying to from Beijing), is used as " horizontal plane " of reference plane actual
It is not plane, and constitutes the sphere with certain curvature.
The reference plane can at least be configured based on following 2 kinds of modes：
1) reference plane is set in advance.
For example, reference plane can be redefined for horizontal plane.
2) application may be provided for determining the reference plane of the relative movement operation of mobile device.
Here, using user can be pointed out to be configured the reference plane of its mobile device.User
Mobile device can be put as free position, such as horizontal positioned, vertical placement, slant setting
Any of Deng.Using the face where mobile device screen during foregoing corresponding state can be set
It is set to reference plane.That is, using sensing data during foregoing corresponding state being recorded as into base
Quasi- sensing data.
When user enters for the first time to apply, it is initial that application can point out user to carry out reference plane
Set.Or, using can also user every time enter apply when, point out user set base
Quasi- face.
Those skilled in the art will be understood that the mode in foregoing 2 kinds of configuration baseline faces is only for example,
And any limitation of the invention is not construed as, it is any existing other or be likely to occur from now on
The mode in configuration baseline face is such as applicable to the present invention, also should be included in the scope of the present invention with
It is interior, and be incorporated herein by reference herein.
In step s 2, the application simulate on the mobile device the relative movement operation institute it is right
The gesture operation answered.
As it was previously stated, the relative movement operation example that user is carried out to mobile device relative datum face
Tilt operation, relative datum such as relative datum face face the moving operation of mobile device.It is described
Gesture operation is such as clicking on gesture operation, slip gesture operation.
Using can be according to detected relative movement operation in step sl (such as relative base
The tilt operation in quasi- face), inquire about the relative movement operation being pre-configured with corresponding with gesture operation
Relation, corresponding to determining relative movement operation (such as the tilt operation in relative datum face)
Gesture operation (such as slip gesture operation).It is determined that the gesture corresponding to relative movement operation is grasped
After work, using the gesture operation (such as slip gesture operation) can be simulated on the mobile device.
Hereinafter, the present invention will be expanded on further by way of examples for this specification.
User's relative datum moves operation in face of mobile device
Exemplified by using a reader application as " application " specifically described herein.Also, made with horizontal plane
On the basis of face, mobile device forward direction are put, screen is towards exemplified by user.User can along with base
The direction of the perpendicular reference axis in quasi- face, mobile device is moved upward or moved downwards.
For example, mobile device is moved downwards along the direction of the reference axis perpendicular with reference plane
The moving operation slip gesture operation that can correspond to slide to the left.If then reader application
User is detected to move mobile device downwards along the direction of the reference axis perpendicular with reference plane
During dynamic moving operation, reader application can simulate the cunning slided to the left on the mobile device
Gesture.The slip gesture slided to the left operation can for example be further corresponded to backward
The function of page turning.Then reader application can realize the function of page turning backward.
And for example, mobile device is moved upward along the direction of the reference axis perpendicular with reference plane
The moving operation slip gesture operation that can correspond to slide to the right.If then reader application
User is detected to move mobile device upward along the direction of the reference axis perpendicular with reference plane
During dynamic moving operation, reader application can simulate the cunning slided to the right on the mobile device
Gesture.The slip gesture slided to the right operation can further correspond to Page forward
Function.Then reader application can realize the function of Page forward.
User's relative datum carries out tilt operation in face of mobile device。
Using can on the mobile apparatus along the tilt operation incline direction simulate slip gesture
Operation.
Exemplified by using a reader application as " application " specifically described herein.Also, made with horizontal plane
On the basis of face, mobile device forward direction are put, screen is towards exemplified by user.User can be with respect to base
Mobile device is tilted to the left or is tilted to the right by quasi- face.
For example, the tilt operation being tilted to the left can correspond to the slip gesture operation slided to the left.
If then reader application detects user and the mobile device relative datum face is carried out to the left
During inclined tilt operation, reader application can simulate what is slided to the left on the mobile device
Slip gesture is operated.The slip gesture slided to the left operation can further correspond to turn over backward
The function of page.Then reader application can realize the function of page turning backward.
And for example, the tilt operation being tilted to the right can correspond to the slip gesture operation slided to the right.
If then reader application detects user and the mobile device relative datum face is carried out to the right
During inclined tilt operation, reader application can simulate what is slided to the right on the mobile device
Slip gesture is operated.The slip gesture slided to the right operation can further correspond to turn over forward
The function of page.Then reader application can realize the function of Page forward.
An instruction icon can be presented on the screen of mobile device
The body dynamics information of the instruction icon presented on the screen of mobile device can be with answering
It is associated with detected relative movement operation.
Here, described indicate that icon is used to indicate a position on the screen of mobile device.Refer to
Diagram target shape can be spherical, hand, arrow etc..The instruction icon can be in mobile device
Screen on move, such as moved to either direction.
Indicate icon body dynamics information include but is not limited to movement velocity, acceleration of motion,
Direction of motion etc..Indicate that the body dynamics information of icon can be with applying detected relative shifting
Dynamic operation is associated.
For example, the gradient for the tilt operation that user is carried out to mobile device relative datum face is got over
Greatly (that is, the angle that mobile device is currently located between plane and reference plane is bigger), indicate
The movement velocity or acceleration of motion of icon are also bigger.User is to mobile device relative datum face institute
The gradient of the tilt operation of progress is smaller (that is, mobile device is currently located plane and benchmark
Angle between face is smaller), indicate that the movement velocity or acceleration of motion of icon are also smaller.Again
Such as, the incline direction for the tilt operation that user is carried out to mobile device relative datum face is to the left
Roll oblique, it indicates that icon lateral movement to the left.User is carried out to mobile device relative datum face
Tilt operation incline direction to tilt to the right, it indicates that icon lateral movement to the right.User
The incline direction of the tilt operation carried out to mobile device relative datum face is to incline to upper left side
Tiltedly, it indicates that icon upper direction to the left.
Especially, indicate that the acceleration magnitude of icon can be positively correlated with the current institute of mobile device screen
In the sine value of the angle (being usually acute angle, less than 90 degree) of plane and reference plane.It is mobile
Device screen is currently located the angle (being usually acute angle, less than 90 degree) of plane and reference plane
Sine value be equal to mobile device screen and be currently located the angle of plane and reference axis and (be usually
Acute angle, less than 90 degree) cosine value.
According to a preferred embodiment of the present invention, user is carried out to mobile device relative datum face
Relative movement operation include the tilt operation in relative datum face.Here, using can be in the shifting
The mobile gesture operation to indicating icon, the mobile side of the movement gesture operation are simulated in dynamic equipment
To corresponding with the incline direction of tilt operation.
For example, the tilt operation that user is tilted to the left to mobile device relative datum face, then
The mobile gesture operation that icon is moved to the left will be indicated using that can simulate on the mobile apparatus.With
Family carries out the tilt operation to upper left overturning angle to mobile device relative datum face, then using can be with
The mobile gesture operation that icon is moved to upper left side will be indicated by simulating on the mobile apparatus.User couple
Mobile device relative datum face carries out the tilt operation of overturning angle to left down, then application can moved
The icon mobile mobile gesture operation in lower section to the left will be indicated by being simulated in dynamic equipment.That is, user
Mobile device relative datum face is carried out to the inclined tilt operation of either direction, then apply and moving
The mobile gesture operation that icon is moved to the direction will be indicated by being simulated in dynamic equipment.
It is highly preferred that if it is indicated that icon reaches screen edge and the vertical fortune of the instruction icon
Dynamic component is higher than predetermined threshold, using can also be simulated on the mobile device along incline direction
Slip gesture is operated.
Here, indicating that the vertical motion component of icon refers to --- indicate icon edge and mobile device
The speed or acceleration of the componental movement in the perpendicular direction of screen edge.Indicate icon along a direction
Motion can be broken down into the partite transport along the direction perpendicular with mobile device screen edge
It is dynamic and along the componental movement in the direction parallel with mobile device screen edge.
For example, if it is indicated that icon reaches mobile device left screen edge, and the instruction figure
Target vertical motion component is higher than predetermined threshold, that is, the instruction icon is along to the left (with shifting
The dynamic perpendicular direction of equipment left screen) componental movement speed or acceleration be higher than predetermined speed
Threshold value or acceleration rate threshold, application can also be simulated along left direction (with shielding on the left of mobile device
The perpendicular direction of curtain) slip gesture operation.When instruction icon reaches mobile device left screen
When the vertical motion component of edge but the instruction icon is less than predetermined threshold, application can stop mould
Intend operating along the slip gesture of left direction.
According to a further advantageous embodiment of the invention, user enters to mobile device relative datum face
Capable relative movement operation includes the vertical movement operation in relative datum face.Here, using can be with
Simulate in a mobile device to a click gesture operation that item may be selected, item may be selected by indicating in this
Initial position of the icon when vertical movement operation starts is determined.
Here, the optional item mean for realize be available for user select function interaction by
Button.The achievable function of optional item for example can for user's Page forward, backward page turning,
Exit current page etc..
Still using a reader application as " application " specifically described herein exemplified by.Also, with horizontal plane
Put as reference plane, mobile device forward direction, screen is towards exemplified by user.User can along with
The direction of the perpendicular reference axis of reference plane, mobile device is moved upward or moved downwards
It is dynamic.Indicate that initial position of the icon when vertical movement operation starts indicates " to turn over backward as realized
The optional item of page " function, when detecting the vertical movement operation that user moves downwards,
Being used for indicated by instruction icon is realized " page turning backward " using that can simulate in a mobile device
The click gesture operation of the optional item of function.Then, application can be realized " page turning backward "
Function.
It is highly preferred that each optional item is exaggerated.
, can so as to indicate that icon can be indicated exactly here, each optional item can be exaggerated
Options, is more convenient user's operation.
Here, the embodiment that above-mentioned user carries out tilt operation to mobile device relative datum face can
So that the reality of vertical movement operation is further carried out to mobile device relative datum face with above-mentioned user
Example is applied to be combined.
User first can carry out tilt operation to mobile device relative datum face.Using can be at this
The mobile gesture operation to indicating icon is simulated on mobile device, so as to indicate the initial bit of icon
Put instruction one and item may be selected.Then, user can carry out vertical to mobile device relative datum face
Moving operation, it is optional indicated by icon to indicating using that can simulate on the mobile device
The click gesture operation of item.
Fig. 2 shows method flow diagram according to an embodiment of the invention, and it specifically illustrates one kind
The device of gesture operation, namely analogue means 10 are simulated on the mobile apparatus.As shown in Fig. 2
Analogue means 10 is installed in application, and specifically includes device 11 and device 12.
The relative movement that the detection user of device 11 is carried out to mobile device relative datum face, which is operated, (is
It is easy to distinguish, is referred to as device 11 to operate detection means 11 below)；Then, device 12
Simulate on the mobile device the corresponding gesture operation of relative movement operation (for ease of distinguishing,
Device 12 is referred to as gesture analogue means 12 below).
Specifically, operation detection means 11 detection user is carried out to mobile device relative datum face
Relative movement operation.
Here, the usual device of mobile device has one or more action sensors, such as gyroscope is passed
Sensor, gravity sensor, acceleration transducer etc..Sensor can be detected to be set on movement
Standby various sensing datas, these sensing datas can reflect mobile device laying state,
Motion state.Wherein, the laying state of mobile device such as keeping flat, place vertically, tilt.Move
The motion state of dynamic equipment is for example static, motion, and the direction of motion, movement velocity etc..
Analogue means 10 can react one group the sensing number of the laying state of mobile device
According to sensing data on the basis of record.Where the mobile device screen that the benchmark sensing data is reacted
Face be that can be determined that reference plane.Alternatively, can be true with the perpendicular line of reference plane
It is set to reference axis.
Relative movement that the user is carried out to mobile device relative datum face operation is included but not
It is limited to the tilt operation (that is, user tilts the mobile device) in relative datum face, relative base
Standard is in face of various operations such as the moving operations of mobile device.
Here, operation detection means 11 can be by mobile device current sensing data and benchmark
Sensing data compares, to determine relative shifting that user is carried out to mobile device relative datum face
Dynamic operation, tilt operation, user such as relative datum face move the mobile device along a direction
Moving operation etc..
Those skilled in the art will be understood that reference plane not one be present in fixed position face.
If, can for example, the benchmark sensing data current laying state of reaction mobile device is keeps flat
It is reference plane with the face for being present in any height for reflecting flat condition.
For the sake of simple declaration, the present invention is illustrated more using horizontal plane as reference plane.This
Art personnel will be understood that in the application scenarios of the present invention scope of activities of user is led to
Normal smaller (in such as one city), the moving range of mobile device is generally also relatively limited.
It is approximately a plane as " horizontal plane " of reference plane under this application scenarios.However,
Consider that User Activity scope is larger, mobile device moving range is also in larger application scenarios
(for example, user goes by air Paris of flying to from Beijing), is used as " horizontal plane " of reference plane actual
It is not plane, and constitutes the sphere with certain curvature.
The reference plane can at least be configured based on following 2 kinds of modes：
1) reference plane is set in advance.
For example, reference plane can be redefined for horizontal plane.
2) application can also include reference plane setting device (not shown in Fig. 2).Benchmark
Face sets device to be provided for determining the reference plane that the relative movement of mobile device is operated.
Here, reference plane sets device that user can be pointed out to carry out the reference plane of its mobile device
Set.User can put mobile device as free position, such as horizontal positioned, it is vertical place,
Any of slant setting etc..Reference plane setting device is moved when can be by foregoing corresponding state
Face where device screen is set to reference plane.That is, reference plane sets device can will be foregoing
Sensing data on the basis of sensing data record during corresponding state.
When user enters for the first time to apply, reference plane sets device to point out user to benchmark
Face carries out initial setting up.Or, reference plane sets device to enter application every time in user
When, point out user that reference plane is set.
Those skilled in the art will be understood that the mode in foregoing 2 kinds of configuration baseline faces is only for example,
And any limitation of the invention is not construed as, it is any existing other or be likely to occur from now on
The mode in configuration baseline face is such as applicable to the present invention, also should be included in the scope of the present invention with
It is interior, and be incorporated herein by reference herein.
Then, gesture analogue means 12 simulates relative movement operation institute on the mobile device
Corresponding gesture operation.
As it was previously stated, the relative movement operation example that user is carried out to mobile device relative datum face
Tilt operation, relative datum such as relative datum face face the moving operation of mobile device.It is described
Gesture operation is such as clicking on gesture operation, slip gesture operation.
Gesture analogue means 12 can be according to the relative movement detected by operation detection means 11
Operate (such as tilt operation in relative datum face), inquire about be pre-configured with relative movement operation with
The corresponding relation of gesture operation, to determine that the relative movement operates (such as inclination in relative datum face
Operation) corresponding to gesture operation (such as slip gesture operation).It is determined that relative movement operation
After corresponding gesture operation, gesture analogue means 12 can be simulated on the mobile device
The gesture operation (such as slip gesture operation).
Hereinafter, the present invention will be expanded on further by way of examples for this specification.
User's relative datum moves operation in face of mobile device
Exemplified by using a reader application as " application " specifically described herein.Also, made with horizontal plane
On the basis of face, mobile device forward direction are put, screen is towards exemplified by user.User can along with base
The direction of the perpendicular reference axis in quasi- face, mobile device is moved upward or moved downwards.
For example, mobile device is moved downwards along the direction of the reference axis perpendicular with reference plane
The moving operation slip gesture operation that can correspond to slide to the left.If then reader application
In operation detection means 11 detect user along the reference axis perpendicular with reference plane direction
During the moving operation that mobile device is moved downwards, the gesture analogue means in reader application
12 can simulate the slip gesture operation slided to the left on the mobile device.What this was slided to the left
Slip gesture operation can for example further correspond to the function of page turning backward.Then reader application
The function of page turning backward can be realized.
And for example, mobile device is moved upward along the direction of the reference axis perpendicular with reference plane
The moving operation slip gesture operation that can correspond to slide to the right.If then reader application
In operation detection means 11 detect user along the reference axis perpendicular with reference plane direction
During the moving operation that mobile device is moved upward, the gesture analogue means in reader application
12 can simulate the slip gesture operation slided to the right on the mobile device.What this was slided to the right
Slip gesture operation can further correspond to the function of Page forward.Then reader application can be with
Realize the function of Page forward.
User's relative datum carries out tilt operation in face of mobile device。
Gesture analogue means 12 in can inclining along the tilt operation on the mobile apparatus
Tilted direction simulation slip gesture operation.
Exemplified by using a reader application as " application " specifically described herein.Also, made with horizontal plane
On the basis of face, mobile device forward direction are put, screen is towards exemplified by user.User can be with respect to base
Mobile device is tilted to the left or is tilted to the right by quasi- face.
For example, the tilt operation being tilted to the left can correspond to the slip gesture operation slided to the left.
If the operation detection means 11 then in reader application detects user to the mobile device phase
During the tilt operation being tilted to the left carried out to reference plane, the gesture simulation dress in reader application
The slip gesture operation slided to the left can be simulated on the mobile device by putting 12.This is slided to the left
Dynamic slip gesture operation can further correspond to the function of page turning backward.Then reader application
The function of page turning backward can be realized.
And for example, the tilt operation being tilted to the right can correspond to the slip gesture operation slided to the right.
If the operation detection means 11 then in reader application detects user to the mobile device phase
During the tilt operation being tilted to the right carried out to reference plane, the gesture simulation dress in reader application
The slip gesture operation slided to the right can be simulated on the mobile device by putting 12.This is slided to the right
Dynamic slip gesture operation can further correspond to the function of Page forward.Then reader application
The function of Page forward can be realized.
An instruction icon can be presented on the screen of mobile device
The body dynamics information of the instruction icon presented on the screen of mobile device can be with answering
Relative movement operation detected by operation detection means 11 in is associated.
Here, described indicate that icon is used to indicate a position on the screen of mobile device.Refer to
Diagram target shape can be spherical, hand, arrow etc..The instruction icon can be in mobile device
Screen on move, such as moved to either direction.
Indicate icon body dynamics information include but is not limited to movement velocity, acceleration of motion,
Direction of motion etc..Indicate that the body dynamics information of icon can be with the operation detection means in application
Relative movement operation detected by 11 is associated.
For example, the gradient for the tilt operation that user is carried out to mobile device relative datum face is got over
Greatly (that is, the angle that mobile device is currently located between plane and reference plane is bigger), indicate
The movement velocity or acceleration of motion of icon are also bigger.User is to mobile device relative datum face institute
The gradient of the tilt operation of progress is smaller (that is, mobile device is currently located plane and benchmark
Angle between face is smaller), indicate that the movement velocity or acceleration of motion of icon are also smaller.Again
Such as, the incline direction for the tilt operation that user is carried out to mobile device relative datum face is to the left
Roll oblique, it indicates that icon lateral movement to the left.User is carried out to mobile device relative datum face
Tilt operation incline direction to tilt to the right, it indicates that icon lateral movement to the right.User
The incline direction of the tilt operation carried out to mobile device relative datum face is to incline to upper left side
Tiltedly, it indicates that icon upper direction to the left.
Especially, indicate that the acceleration magnitude of icon can be positively correlated with the current institute of mobile device screen
In the sine value of the angle (being usually acute angle, less than 90 degree) of plane and reference plane.It is mobile
Device screen is currently located the angle (being usually acute angle, less than 90 degree) of plane and reference plane
Sine value be equal to mobile device screen and be currently located the angle of plane and reference axis and (be usually
Acute angle, less than 90 degree) cosine value.
According to a preferred embodiment of the present invention, user is carried out to mobile device relative datum face
Relative movement operation include the tilt operation in relative datum face.Here, the gesture mould in
The mobile gesture operation to indicating icon can be simulated on the mobile device by intending device 12, should
The moving direction of mobile gesture operation is corresponding with the incline direction of tilt operation.
For example, the tilt operation that user is tilted to the left to mobile device relative datum face, then
Gesture analogue means 12 can be simulated on the mobile apparatus will indicate the movement that icon is moved to the left
Gesture operation.User carries out the tilt operation to upper left overturning angle to mobile device relative datum face,
Then gesture analogue means 12 can be simulated on the mobile apparatus will indicate that icon is moved to upper left side
Mobile gesture operation.User carries out overturning angle to left down to mobile device relative datum face and inclined
Tiltedly operation, then gesture analogue means 12 can be simulated on the mobile apparatus to indicate icon to the left
The mobile gesture operation of lower section movement.That is, user mobile device relative datum face is carried out to
The inclined tilt operation of either direction, then gesture analogue means 12 is simulated on the mobile apparatus incites somebody to action
Indicate the mobile gesture operation that icon is moved to the direction.
It is highly preferred that if it is indicated that icon reaches screen edge and the vertical fortune of the instruction icon
Dynamic component is higher than predetermined threshold, gesture analogue means 12 can also on the mobile device along
Incline direction simulation slip gesture operation.
Here, indicating that the vertical motion component of icon refers to --- indicate icon edge and mobile device
The speed or acceleration of the componental movement in the perpendicular direction of screen edge.Indicate icon along a direction
Motion can be broken down into the partite transport along the direction perpendicular with mobile device screen edge
It is dynamic and along the componental movement in the direction parallel with mobile device screen edge.
For example, if it is indicated that icon reaches mobile device left screen edge, and the instruction figure
Target vertical motion component is higher than predetermined threshold, that is, the instruction icon is along to the left (with shifting
The dynamic perpendicular direction of equipment left screen) componental movement speed or acceleration be higher than predetermined speed
Threshold value or acceleration rate threshold, gesture analogue means 12 can also be simulated along left direction (with shifting
The dynamic perpendicular direction of equipment left screen) slip gesture operation.Moved when indicating that icon is reached
When the vertical motion component of equipment left screen edge but the instruction icon is less than predetermined threshold, hand
Gesture analogue means 12 can stop slip gesture of the simulation along left direction and operate.
According to a further advantageous embodiment of the invention, user enters to mobile device relative datum face
Capable relative movement operation includes the vertical movement operation in relative datum face.Here, in
Gesture analogue means 12 can simulate the click gesture behaviour that item may be selected to one in a mobile device
Make, this may be selected item and is determined by initial position when instruction icon is vertical movement operation.
Here, the optional item mean for realize be available for user select function interaction by
Button.The achievable function of optional item for example can for user's Page forward, backward page turning,
Exit current page etc..
Still using a reader application as " application " specifically described herein exemplified by.Also, with horizontal plane
Put as reference plane, mobile device forward direction, screen is towards exemplified by user.User can along with
The direction of the perpendicular reference axis of reference plane, mobile device is moved upward or moved downwards
It is dynamic.Indicate that initial position of the icon when vertical movement operation starts indicates " to turn over backward as realized
The optional item of page " function, when detecting the vertical movement operation that user moves downwards,
Gesture analogue means 12 can be simulated to indicating being used in fact indicated by icon in a mobile device
The click gesture operation of the optional item of existing " page turning backward " function.Then, application can be realized
The function of " page turning backward ".
It is highly preferred that each optional item is exaggerated.
, can so as to indicate that icon can be indicated exactly here, each optional item can be exaggerated
Options, is more convenient user's operation.
Here, the embodiment that above-mentioned user carries out tilt operation to mobile device relative datum face can
So that the reality of vertical movement operation is further carried out to mobile device relative datum face with above-mentioned user
Example is applied to be combined.
User first can carry out tilt operation to mobile device relative datum face.Gesture analogue means
12 can simulate the mobile gesture operation to indicating icon on the mobile device, so as to indicate to scheme
Target initial position indicates that one may be selected item.Then, user can be to mobile device relative datum
Face carries out vertical movement operation, and gesture analogue means 12 can be simulated pair on the mobile device
Indicate the click gesture operation of the optional item indicated by icon.
It should be noted that the present invention can be in the assembly of software and/or software and hardware by reality
Apply, for example, the present invention each device can using application specific integrated circuit (ASIC) or it is any its
His similar hardware device is realized.In one embodiment, software program of the invention can lead to
Computing device is crossed to realize steps described above or function.Similarly, software journey of the invention
Sequence (including related data structure) can be stored in computer readable recording medium storing program for performing, example
Such as, RAM memory, magnetically or optically driver or floppy disc and similar devices.In addition, this hair
Some bright steps or function can employ hardware to realize, for example, as with processor coordinate from
And perform the circuit of each step or function.
It is obvious to a person skilled in the art that the invention is not restricted to above-mentioned one exemplary embodiment
Details, and without departing from the spirit or essential characteristics of the present invention, can be with it
His concrete form realizes the present invention.Therefore, all should be by embodiment no matter from the point of view of which point
Regard exemplary as, and be nonrestrictive, the scope of the present invention is by appended claims
Rather than described above limit, it is intended that by fall the equivalency of claim implication and
In the range of all changes be included in the present invention.Should not be by any accompanying drawing mark in claim
Note is considered as the claim involved by limitation.Furthermore, it is to be understood that the word of " comprising " one is not excluded for other lists
Member or step, odd number are not excluded for plural number.The multiple units or device stated in system claims
It can also be realized by a unit or device by software or hardware.The first, the second grade word
Pragmatic represents title, and is not offered as any specific order.
Although above specifically shown and describe exemplary embodiment, people in the art
Member will be understood that in the case of the spirit and scope without departing substantially from claims, at it
It can be varied from terms of form and details.Protection sought herein is in appended claims
In illustrate.
Claims (16)
1. a kind of method for simulating gesture operation on the mobile apparatus, wherein, this method includes：
The relative movement operation that-detection user is carried out to mobile device relative datum face；
- gesture operation relatively moved corresponding to operation is simulated on the mobile device.
2. according to the method described in claim 1, wherein, this method also includes：
- be provided for determining the reference plane that the relative movement of the mobile device is operated.
3. method according to claim 1 or 2, wherein, the relative movement operation includes
The tilt operation of relatively described reference plane；
Wherein, the gesture simulated on the mobile device corresponding to the relative movement operation
The step of operation, specifically includes：
- on the mobile device along the tilt operation incline direction simulation slip gesture behaviour
Make.
4. method according to claim 1 or 2, wherein, on the screen of the mobile device
It is presented one and indicates icon, the body dynamics information of the instruction icon and the relative movement operation phase
Association.
5. method according to claim 4, wherein, the relative movement operation includes relative
The tilt operation of the reference plane；
Wherein, the gesture simulated on the mobile device corresponding to the relative movement operation
The step of operation, specifically includes：
- simulated on the mobile device to the mobile gesture operation for indicating icon, the shifting
The moving direction of gesture is corresponding with the incline direction of the tilt operation.
6. method according to claim 5, wherein, it is described to be simulated on the mobile device
It is described relative movement operation corresponding to gesture operation the step of also include：
If-the instruction icon reaches the vertical movement point of screen edge and the instruction icon
Amount is higher than predetermined threshold, along incline direction simulation slip gesture behaviour on the mobile device
Make.
7. method according to claim 4, wherein, the relative movement operation includes relative
The vertical movement operation of the reference plane；
Wherein, the gesture simulated on the mobile device corresponding to the relative movement operation
The step of operation, specifically includes：
- simulated in the mobile device to a click gesture operation that item may be selected, it is described optional
Item is selected to be determined by the initial position when instruction icon is the vertical movement operation.
8. method according to claim 7, wherein, each optional item is exaggerated.
9. a kind of device for simulating gesture operation on the mobile apparatus, wherein, the device includes：
- it is used for the device for detecting that the relative movement that user is carried out to mobile device relative datum face is operated；
- be used to simulate the gesture operation corresponding to the relative movement operation on the mobile device
Device.
10. device according to claim 9, wherein, the device also includes：
- be used to be provided for the device for relatively moving the reference plane operated for determining the mobile device.
11. the device according to claim 9 or 10, wherein, the relative movement operation bag
Include the tilt operation of relatively described reference plane；
Wherein, the gesture simulated on the mobile device corresponding to the relative movement operation
The device of operation specifically for：
- on the mobile device along the tilt operation incline direction simulation slip gesture behaviour
Make.
12. the device according to claim 9 or 10, wherein, the screen of the mobile device
Upper that an instruction icon is presented, the body dynamics information of the instruction icon is operated with the relative movement
It is associated.
13. device according to claim 12, wherein, the relative movement operation includes phase
To the tilt operation of the reference plane；
Wherein, the gesture simulated on the mobile device corresponding to the relative movement operation
The device of operation specifically for：
- simulated on the mobile device to the mobile gesture operation for indicating icon, the shifting
The moving direction of gesture is corresponding with the incline direction of the tilt operation.
14. device according to claim 13, wherein, the mould on the mobile device
The device for intending the gesture operation corresponding to the relative movement operation is additionally operable to：
If-the instruction icon reaches the vertical movement point of screen edge and the instruction icon
Amount is higher than predetermined threshold, along incline direction simulation slip gesture behaviour on the mobile device
Make.
15. device according to claim 12, wherein, the relative movement operation includes phase
To the vertical movement operation of the reference plane；
Wherein, the gesture simulated on the mobile device corresponding to the relative movement operation
The device of operation specifically for：
- simulated in the mobile device to a click gesture operation that item may be selected, it is described optional
Item is selected to be determined by the initial position when instruction icon is the vertical movement operation.
16. device according to claim 15, wherein, each optional item is exaggerated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610146644.0A CN107193463A (en) | 2016-03-15 | 2016-03-15 | The method and apparatus of gesture operation is simulated on the mobile apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610146644.0A CN107193463A (en) | 2016-03-15 | 2016-03-15 | The method and apparatus of gesture operation is simulated on the mobile apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107193463A true CN107193463A (en) | 2017-09-22 |
Family
ID=59870693
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610146644.0A Pending CN107193463A (en) | 2016-03-15 | 2016-03-15 | The method and apparatus of gesture operation is simulated on the mobile apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107193463A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110413176A (en) * | 2019-07-29 | 2019-11-05 | 网易（杭州）网络有限公司 | Exchange method, device, equipment and the computer readable storage medium of page scroll |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101957709A (en) * | 2009-07-13 | 2011-01-26 | 鸿富锦精密工业（深圳）有限公司 | Touch control method |
| CN102156536A (en) * | 2010-02-12 | 2011-08-17 | 英华达（南京）科技有限公司 | Method for controlling mobile electronic device |
| CN102520858A (en) * | 2011-12-08 | 2012-06-27 | 深圳市万兴软件有限公司 | Mobile terminal application control method and device |
| US20120326998A1 (en) * | 2011-06-22 | 2012-12-27 | International Business Machines Corporation | Mobile touch-generating device and communication with a touchscreen |
| CN103365575A (en) * | 2012-03-27 | 2013-10-23 | 百度在线网络技术（北京）有限公司 | Mobile terminal and unlocking method thereof |
| CN103970449A (en) * | 2014-05-26 | 2014-08-06 | 北京金山网络科技有限公司 | Multi-window sliding control method and device |
| CN104536674A (en) * | 2014-12-12 | 2015-04-22 | 北京百度网讯科技有限公司 | Method and device for executing operation on webpage in mobile equipment |
| CN104881192A (en) * | 2015-05-28 | 2015-09-02 | 努比亚技术有限公司 | Operation recognition method and device, and terminal |
-
2016
- 2016-03-15 CN CN201610146644.0A patent/CN107193463A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101957709A (en) * | 2009-07-13 | 2011-01-26 | 鸿富锦精密工业（深圳）有限公司 | Touch control method |
| CN102156536A (en) * | 2010-02-12 | 2011-08-17 | 英华达（南京）科技有限公司 | Method for controlling mobile electronic device |
| US20120326998A1 (en) * | 2011-06-22 | 2012-12-27 | International Business Machines Corporation | Mobile touch-generating device and communication with a touchscreen |
| CN102520858A (en) * | 2011-12-08 | 2012-06-27 | 深圳市万兴软件有限公司 | Mobile terminal application control method and device |
| CN103365575A (en) * | 2012-03-27 | 2013-10-23 | 百度在线网络技术（北京）有限公司 | Mobile terminal and unlocking method thereof |
| CN103970449A (en) * | 2014-05-26 | 2014-08-06 | 北京金山网络科技有限公司 | Multi-window sliding control method and device |
| CN104536674A (en) * | 2014-12-12 | 2015-04-22 | 北京百度网讯科技有限公司 | Method and device for executing operation on webpage in mobile equipment |
| CN104881192A (en) * | 2015-05-28 | 2015-09-02 | 努比亚技术有限公司 | Operation recognition method and device, and terminal |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110413176A (en) * | 2019-07-29 | 2019-11-05 | 网易（杭州）网络有限公司 | Exchange method, device, equipment and the computer readable storage medium of page scroll |
| CN110413176B (en) * | 2019-07-29 | 2021-07-09 | 网易（杭州）网络有限公司 | Page turning interaction method, device and equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10579205B2 (en) | Edge-based hooking gestures for invoking user interfaces | |
| CN109643210B (en) | Device manipulation using hovering | |
| CN102122230B (en) | Multi-finger gesture | |
| CN102207788B (en) | Radial menus with bezel gestures | |
| US7489306B2 (en) | Touch screen accuracy | |
| CN102197377B (en) | Multi-touch object inertia simulation | |
| Kin et al. | Eden: a professional multitouch tool for constructing virtual organic environments | |
| CN102122229A (en) | Use of bezel as an input mechanism | |
| CN102207818A (en) | Page manipulations using on and off-screen gestures | |
| CN102884498A (en) | Off-screen gestures to create on-screen input | |
| US20140137029A1 (en) | Cross slide gesture | |
| CN104166553B (en) | A kind of display methods and electronic equipment | |
| US20130191768A1 (en) | Method for manipulating a graphical object and an interactive input system employing the same | |
| EP3100151B1 (en) | Virtual mouse for a touch screen device | |
| JP2014501996A5 (en) | ||
| JP2014510337A (en) | Information display device including at least two touch screens and information display method thereof | |
| WO2012135534A1 (en) | 3d user interface control | |
| CN102754050A (en) | On and off-screen gesture combinations | |
| US20130155108A1 (en) | Augmented Reality User Interaction Methods, Computing Devices, And Articles Of Manufacture | |
| CN104024983B (en) | Interaction models for indirect interaction equipment | |
| KR102161061B1 (en) | Method and terminal for displaying a plurality of pages | |
| CA2862295A1 (en) | Directional control using a touch sensitive device | |
| KR101442438B1 (en) | Single touch process to achieve dual touch experience field | |
| WO2013147871A1 (en) | Detecting a first and a second touch to associate a data file with a graphical data object | |
| US20170315615A1 (en) | Gesture library |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170922 |