CN105224211B - A kind of method of controlling operation thereof of operation object, device and mobile terminal - Google Patents
A kind of method of controlling operation thereof of operation object, device and mobile terminal Download PDFInfo
- Publication number
- CN105224211B CN105224211B CN201410249339.5A CN201410249339A CN105224211B CN 105224211 B CN105224211 B CN 105224211B CN 201410249339 A CN201410249339 A CN 201410249339A CN 105224211 B CN105224211 B CN 105224211B
- Authority
- CN
- China
- Prior art keywords
- information
- operation object
- coordinate
- dimensional
- operating gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The present invention provides a kind of method of controlling operation thereof of operation object, device and mobile terminal, is related to field of communication technology.Wherein this method is applied to a mobile terminal, and the front of the mobile terminal has a touch screen, and there is infrared sensor, the method for controlling operation thereof of the operation object to include for the back side and/or side of the mobile terminal：Obtain the first trace information of first operating gesture of the user on the touch screen；The second trace information for obtaining second operating gesture of the user in the detection range of the infrared sensor, wherein second operating gesture is carried out at the same time with first operating gesture or there are a preset time is poor；According to first trace information and second trace information, a three-dimensional track information is obtained, and operation and control is carried out to operation object according to the three-dimensional track information.The solution of the present invention realizes the three-dimensional tactile for supporting mobile terminal, obtains good user experience.
Description
Technical field
The present invention relates to the communications field, a kind of method of controlling operation thereof of operation object, device and mobile terminal are particularly related to.
Background technology
In actual life, people's physical perception to the world be all 3 D stereo.It is right with the progress of science and technology
The research and development of 3D technology are also more and more deep, are particularly based on the 3D technology of computer, internet, gradually enter into people’s lives.
Existing mobile terminal is intelligent touch screen mostly, supports plane formula to touch, lacks the support of good user experience
The scheme of three-dimensional tactile.
Invention content
The object of the present invention is to provide a kind of method of controlling operation thereof of operation object, device and mobile terminals, realize and support
The three-dimensional tactile of mobile terminal obtains good user experience.
In order to achieve the above objectives, the embodiment of the present invention provides a kind of method of controlling operation thereof of operation object, is applied to one
There is touch screen, the back side and/or side of the mobile terminal to have infrared sensing in the front of mobile terminal, the mobile terminal
The method of controlling operation thereof of device, the operation object includes：
Obtain the first trace information of first operating gesture of the user on the touch screen；
The second trace information of second operating gesture of the user in the detection range of the infrared sensor is obtained,
Described in the second operating gesture be carried out at the same time with first operating gesture or there are a preset time is poor；
According to first trace information and second trace information, a three-dimensional track information is obtained, and according to described
Three-dimensional track information carries out operation and control to operation object.
Wherein, according to first trace information and second trace information, a three-dimensional track information is obtained, and according to
The three-dimensional track information to operation object carry out operation and control the step of include：
First trace information of first operating gesture is parsed, the plane coordinates letter of three-dimensional input signal is generated
Breath, wherein plane coordinates information include the first coordinate information and the second coordinate information；
Second trace information of second operating gesture is parsed, the third coordinate letter of three-dimensional input signal is generated
Breath；
Three-dimensional track information is determined according to the plane coordinates information and the third coordinate information, and operation object is carried out
Operation and control.
Wherein, first trace information of first operating gesture is parsed, the plane for generating three-dimensional input signal is sat
Mark information the step of include：
Obtain the two-dimensional coordinate (x of current operation object display location0, y0)；
By the two-dimensional coordinate (x of current operation object display location0, y0) and obtained according to first trace information
Starting position coordinates (the x of first operating gesture1, y1) and stop position coordinate (x2, y2), substitute into formula：
Obtain the two-dimensional coordinate (x ' of display location after the operation object moves0, y '0)；
Wherein, a is predetermined coefficient；
Two-dimensional coordinate (the x ' of display location after being moved according to the operation object0, y '0) determine the flat of three-dimensional input signal
Areal coordinate information.
Wherein, second trace information of second operating gesture is parsed, the third for generating three-dimensional input signal is sat
Mark information the step of include：
The displacement scalar value L of second operating gesture is obtained according to second trace information, gives tacit consent to the operation pair
The Z axis coordinate z of the initial position of elephant0It is 0；
The displacement scalar value L is substituted into formula：
L '=bL；
Obtain the Z axis coordinate z ' of display location after the movement of the operation object0Value L '；
Wherein, b is predetermined coefficient；
By the operation direction of second operating gesture compared with presetting positive negative direction, z ' is determined0Direction；
According to the Z axis coordinate z ' of display location after the movement of the operation object0Determine that the third of three-dimensional input signal is sat
Mark information.
Wherein, three-dimensional track information is determined according to the plane coordinates information and the third coordinate information, to operation pair
As the step of carrying out operation and control includes：
According to the plane coordinates information and the third coordinate information, the operation of the three-dimensional track information is obtained
Coordinate (the x ' of display location after the movement of object0, y '0, z '0), operation and control is carried out to the operation object and reaches expected position
It sets.
The embodiment of the present invention additionally provides a kind of operating control device of operation object, is applied to a mobile terminal, described
There is touch screen, the back side and/or side of the mobile terminal to have infrared sensor, the operation pair in the front of mobile terminal
The operating control device of elephant includes：
First acquisition module, the first trace information for obtaining first operating gesture of the user on the touch screen；
Second acquisition module, for obtaining second operating gesture of the user in the detection range of the infrared sensor
The second trace information, wherein second operating gesture and first operating gesture are carried out at the same time or there are a preset times
Difference；
Processing module, for according to first trace information and second trace information, obtaining three-dimensional track letter
Breath, and operation and control is carried out to operation object according to the three-dimensional track information.
Wherein, processing module described in root includes：
First processing submodule, first trace information for parsing first operating gesture generate three-dimensional defeated
Enter the plane coordinates information of signal, wherein plane coordinates information includes the first coordinate information and the second coordinate information；
Second processing submodule, second trace information for parsing second operating gesture generate three-dimensional defeated
Enter the third coordinate information of signal；
Third handles submodule, for determining three-dimensional track according to the plane coordinates information and the third coordinate information
Information carries out operation and control to operation object.
Wherein, the first processing submodule includes：
First acquisition unit, the two-dimensional coordinate (x for obtaining current operation object display location0, y0)；
First processing units are used for the two-dimensional coordinate (x of current operation object display location0, y0) and according to described
Starting position coordinates (the x for first operating gesture that one trace information obtains1, y1) and stop position coordinate (x2, y2), generation
Enter formula：
Obtain the two-dimensional coordinate (x ' of display location after the operation object moves0, y '0)；
Wherein, a is predetermined coefficient；
First determination unit, the two-dimensional coordinate (x ' for display location after being moved according to the operation object0, y '0) determine
The plane coordinates information of three-dimensional input signal.
Wherein, the second processing submodule includes：
Second acquisition unit, the displacement scalar value for obtaining second operating gesture according to second trace information
L gives tacit consent to the Z axis coordinate z of the initial position of the operation object0It is 0；
Second processing unit, for the displacement scalar value L to be substituted into formula：
L '=bL；
Obtain the Z axis coordinate z ' of display location after the movement of the operation object0Value L '；
Wherein, b is predetermined coefficient；
Second determination unit, for compared with presetting positive negative direction, determining the operation direction of second operating gesture
z’0Direction；
Third determination unit, for the Z axis coordinate z ' according to display location after the movement of the operation object0It determines three-dimensional
The third coordinate information of input signal.
Wherein, the third processing submodule includes：
Operation processing unit, for according to the plane coordinates information and the third coordinate information, obtaining the three-dimensional
Coordinate (the x ' of display location after the movement of the operation object of trace information0, y '0, z '0), the operation object is grasped
Make control and reaches desired location.
The embodiment of the present invention also provides a kind of mobile terminal, and the front of the mobile terminal has touch screen, the movement
The back side and/or side of terminal have infrared sensor, and the mobile terminal includes device as described above.
Wherein, the mobile terminal further includes：
Infrared sensor active module, the infrared ray sensing for operation activation corresponding position according to the user's choice
Device.
The above-mentioned technical proposal of the present invention has the beneficial effect that：
The method of controlling operation thereof of the operation object of the embodiment of the present invention, user can be by two kinds of operating gestures to mobile whole
It holds operation object in 3-D view to carry out operation and control, realizes three touches, enhance user experience.
Description of the drawings
Fig. 1 shows the step flow charts of the method for controlling operation thereof of the operation object of the embodiment of the present invention；
Fig. 2 indicates the structural schematic diagram of the operating control device of the operation object of the embodiment of the present invention.
Specific implementation mode
To keep the technical problem to be solved in the present invention, technical solution and advantage clearer, below in conjunction with attached drawing and tool
Body embodiment is described in detail.
The present invention is intelligent touch screen mostly for existing mobile terminal for the existing present invention, and plane formula is supported to touch
It touches, lacks the scheme of the support three-dimensional tactile of good user experience, a kind of method of controlling operation thereof of operation object is provided, by right
The operation and control of operation object realizes the three-dimensional tactile with good user experience in 3-D view.
As shown in Figure 1, the embodiment of the present invention provides a kind of method of controlling operation thereof of operation object, it is applied to a movement eventually
There is touch screen, the back side and/or side of the mobile terminal to have infrared sensor, institute in the front at end, the mobile terminal
The method of controlling operation thereof for stating operation object includes：
Step 11, the first trace information of first operating gesture of the user on the touch screen is obtained；
Wherein, first operating gesture includes the slide gesture of user on the touchscreen, and sliding trace can be used as
First track, therefore, the first trace information includes at least the coordinate of the first operating gesture initial position and stop position.
Step 12, the second track of second operating gesture of the user in the detection range of the infrared sensor is obtained
Information, wherein second operating gesture is carried out at the same time with first operating gesture or there are a preset time is poor；
It is well known that infrared sensor detection is object in certain spatial dimension, so the second operating gesture
It needs to complete corresponding operating in the detection range of infrared sensor, and due to needing the first operating gesture, the second operation
Gesture determines the final desired location of operation object jointly, in order to enable the first operating gesture and the second operating gesture without error
Acquisition, the second operating gesture is carried out at the same time with the first operating gesture or there are a preset time is poor.Wherein, the second trace information is extremely
Include the displacement scalar value L of the second operating gesture less.
Step 13, according to first trace information and second trace information, a three-dimensional track information, and root are obtained
Operation and control is carried out to operation object according to the three-dimensional track information.
Through the above steps, the method for controlling operation thereof of the operation object of the embodiment of the present invention is allowed users to by two kinds
Operating gesture carries out operation and control to operation object in mobile terminal 3-D view, realizes three touches, enhances user experience.
The method of the embodiment of the present invention accounts for dominant position at this stage in two-dimensional operation, in order to avoid being touched to common plane
The influence of function is touched, only 3D touch functions is being opened, could used after activating infrared sensor.Moreover, because infrared ray
Sensor is not single setting, is the infrared sensor array in the different location at the mobile terminal back side and/or side,
User can activate the infrared sensor of corresponding position according to use habit and different use occasions, if it is desired to obtain more
High sensitivity can activate more infrared sensors in array.
In the method for controlling operation thereof of the operation object of the embodiment of the present invention, step 13 includes：
Step 131, first trace information of first operating gesture is parsed, the plane of three-dimensional input signal is generated
Coordinate information, wherein plane coordinates information include the first coordinate information and the second coordinate information；
Step 132, second trace information of second operating gesture is parsed, the third of three-dimensional input signal is generated
Coordinate information；
Step 133, three-dimensional track information is determined according to the plane coordinates information and the third coordinate information, to operation
Object carries out operation and control.
It should be appreciated that in three dimensions, common localization method is true by three-dimensional cartesian coordinate (x, y, z)
Earnest body is in the position of three dimensions, wherein x, y, z are the x-axis for possessing common zero point and intersecting each other respectively, y-axis, z-axis
Coordinate value.In the operation object control method of the embodiment of the present invention, three-dimensional input letter is described using three-dimensional cartesian coordinate
Number coordinate information, including the first coordinate information, the second coordinate information and third coordinate information.Wherein, give tacit consent to x-axis, y-axis place
Plane is the plane parallel with touch screen, then z-axis is the direction vertical with touch screen plane.
Wherein, step 131 includes：
Step 1311, the two-dimensional coordinate (x of current operation object display location is obtained0, y0)；
Step 1312, by the two-dimensional coordinate (x of current operation object display location0, y0) and according to first track letter
Cease the starting position coordinates (x of first operating gesture obtained1, y1) and stop position coordinate (x2, y2), substitute into formula：
Wherein, a is predetermined coefficient, and the two dimension of display location after the operation object movement is obtained by formula (1), (2)
Coordinate (x '0, y '0)；
Step 1313, the two-dimensional coordinate (x ' of display location after being moved according to the operation object0, y '0) determine three-dimensional input
The plane coordinates information of signal.
By by the starting position coordinates of the first trace information of the first operating gesture and stop position coordinate and currently
The two-dimensional coordinate of operation object display location brings formula (1) into, (2) obtain the two dimension of display location after the operation object movement
Coordinate (x '0, y '0), it is first determined the plane coordinates information of operation object.
Then, include according to step 132：
Step 1321, the displacement scalar value L of second operating gesture is obtained according to second trace information, gives tacit consent to institute
State the Z axis coordinate z of the initial position of operation object0It is 0；
Step 1322, the displacement scalar value L is substituted into formula：
L '=bL (3)；
Wherein, b is predetermined coefficient, and the Z axis coordinate of display location after the movement of the operation object is obtained by formula (3)
z’0Value L '；
Step 1323, the operation direction of second operating gesture is determined into z ' compared with presetting positive negative direction0Side
To；
Step 1333, according to the Z axis coordinate z ' of display location after the movement of the operation object0Determine three-dimensional input signal
Third coordinate information.
In this way, obtaining the Z axis coordinate z ' of display location after the movement of the operation object further through above-mentioned steps0Value and
Direction determines the third coordinate information of operation object, i.e., coordinate in the z-axis direction.
After the three-dimensional coordinate for the desired location for obtaining operation object, it is necessary to operate on it control, step 133 packet
It includes：
Step 1331, according to the plane coordinates information and the third coordinate information, the three-dimensional track information is obtained
The operation object movement after display location coordinate (x '0, y '0, z '0), operation and control is carried out to the operation object and is arrived
Up to desired location.
Finally, it realizes and carries out operation and control according to the operating gesture of user, operation object is made to reach desired location.
The method of the embodiment of the present invention realizes the touch-control to 3-D view, such as：In a game application, simulation three
Apple tree is tieed up, the method for user through the embodiment of the present invention controls the process that apple is plucked in an analog mechanical hand getting.The big thumb of user
Finger slides from left to right on the touchscreen, obtains the first trace information of the first operating gesture, while index finger is carried on the back in mobile terminal
There is a movement gesture in the detection range of the infrared sensor in face and/or side, obtains the second track of the second operating gesture
Information.To the relevant treatment of the first trace information and the second trace information according to the method for the embodiment of the present invention, machinery is obtained
The information of hand desired location, operation and control manipulator reach user's desired location (x '0, y '0, z '0), complete the picking of apple.
Certainly, three-dimensional space position may not only pass through three-dimensional cartesian coordinate representation, the operation of above-mentioned operation object
In control method, it can also be expressed by circular cylindrical coordinate, the form of spherical coordinate.It needs in the first track of the first operating gesture
Information, obtain in the second trace information of the second operating gesture mutually in requisition for information, obtained using corresponding algorithm process pre-
The information of phase position.
As shown in Fig. 2, the embodiment of the present invention additionally provides a kind of operating control device of operation object, it is applied to a movement
There is touch screen, the back side and/or side of the mobile terminal to have infrared sensor in the front of terminal, the mobile terminal,
The operating control device of the operation object includes：
First acquisition module 10, the first track for obtaining first operating gesture of the user on the touch screen are believed
Breath；
Second acquisition module 20, for obtaining second manipulator of the user in the detection range of the infrared sensor
Second trace information of gesture, wherein second operating gesture and first operating gesture be carried out at the same time or there are one it is default when
Between it is poor；
Processing module 30, for according to first trace information and second trace information, obtaining a three-dimensional track
Information, and operation and control is carried out to operation object according to the three-dimensional track information.
Wherein, processing module described in root includes：
First processing submodule, first trace information for parsing first operating gesture generate three-dimensional defeated
Enter the plane coordinates information of signal, wherein plane coordinates information includes the first coordinate information and the second coordinate information；
Second processing submodule, second trace information for parsing second operating gesture generate three-dimensional defeated
Enter the third coordinate information of signal；
Third handles submodule, for determining three-dimensional track according to the plane coordinates information and the third coordinate information
Information carries out operation and control to operation object.
Wherein, the first processing submodule includes：
First acquisition unit, the two-dimensional coordinate (x for obtaining current operation object display location0, y0)；
First processing units are used for the two-dimensional coordinate (x of current operation object display location0, y0) and according to described
Starting position coordinates (the x for first operating gesture that one trace information obtains1, y1) and stop position coordinate (x2, y2), generation
Enter formula：
Wherein, a is predetermined coefficient, and the two dimension of display location after the operation object movement is obtained by formula (1), (2)
Coordinate (x '0, y '0)；
First determination unit, the two-dimensional coordinate (x ' for display location after being moved according to the operation object0, y '0) determine
The plane coordinates information of three-dimensional input signal.
Wherein, the second processing submodule includes：
Second acquisition unit, the displacement scalar value for obtaining second operating gesture according to second trace information
L gives tacit consent to the Z axis coordinate z of the initial position of the operation object0It is 0；
Second processing unit, for the displacement scalar value L to be substituted into formula：
L '=bL (3)；
Wherein, b is predetermined coefficient, and the Z axis coordinate of display location after the movement of the operation object is obtained by formula (3)
z’0Value L '；
Second determination unit, for compared with presetting positive negative direction, determining the operation direction of second operating gesture
z’0Direction；
Third determination unit, for the Z axis coordinate z ' according to display location after the movement of the operation object0It determines three-dimensional
The third coordinate information of input signal.
Wherein, the third processing submodule includes：
Operation processing unit, for according to the plane coordinates information and the third coordinate information, obtaining the three-dimensional
Coordinate (the x ' of display location after the movement of the operation object of trace information0, y '0, z '0), the operation object is grasped
Make control and reaches desired location.
It should be noted that the device is the device for the method for controlling operation thereof for applying aforesaid operations object, operation object
Method of controlling operation thereof realization method suitable for the embodiment of the device, can also reach identical technique effect.
The embodiment of the present invention also provides a kind of mobile terminal, and the front of the mobile terminal has touch screen, the movement
The back side and/or side of terminal include with infrared sensor, the mobile terminal：
First acquisition module, the first trace information for obtaining first operating gesture of the user on the touch screen；
Second acquisition module, the second track for obtaining second gesture of the user in the detection range of infrared sensor
Information；
Processing module, for according to first trace information and the second trace information, obtaining a three-dimensional track information, and
Operation and control is carried out to operation object according to the three-dimensional track information.
Wherein, processing module described in root includes：
First processing submodule, first trace information for parsing first operating gesture generate three-dimensional defeated
Enter the plane coordinates information of signal, wherein plane coordinates information includes the first coordinate information and the second coordinate information；
Second processing submodule, second trace information for parsing second operating gesture generate three-dimensional defeated
Enter the third coordinate information of signal；
Third handles submodule, for determining three-dimensional track according to the plane coordinates information and the third coordinate information
Information carries out operation and control to operation object.
Wherein, the first processing submodule includes：
First acquisition unit, the two-dimensional coordinate (x for obtaining current operation object display location0, y0)；
First processing units are used for the two-dimensional coordinate (x of current operation object display location0, y0) and according to described
Starting position coordinates (the x for first operating gesture that one trace information obtains1, y1) and stop position coordinate (x2, y2), generation
Enter formula：
Wherein, a is predetermined coefficient, and the two dimension of display location after the operation object movement is obtained by formula (1), (2)
Coordinate (x '0, y '0)；
First determination unit, the two-dimensional coordinate (x ' for display location after being moved according to the operation object0, y '0) determine
The plane coordinates information of three-dimensional input signal.
Wherein, the second processing submodule includes：
Second acquisition unit, the displacement scalar value for obtaining second operating gesture according to second trace information
L gives tacit consent to the Z axis coordinate z of the initial position of the operation object0It is 0；
Second processing unit, for the displacement scalar value L to be substituted into formula：
L '=bL (3)；
Wherein, b is predetermined coefficient, and the Z axis coordinate of display location after the movement of the operation object is obtained by formula (3)
z’0Value L '；
Second determination unit, for compared with presetting positive negative direction, determining the operation direction of second operating gesture
z’0Direction；
Third determination unit, for the Z axis coordinate z ' according to display location after the movement of the operation object0It determines three-dimensional
The third coordinate information of input signal.
Wherein, the third processing submodule includes：
Operation processing unit, for according to the plane coordinates information and the third coordinate information, obtaining the three-dimensional
Coordinate (the x ' of display location after the movement of the operation object of trace information0, y '0, z '0), the operation object is grasped
Make control and reaches desired location.
Wherein, in order to adapt to different demands of the user to activation infrared sensor, the mobile terminal further includes：It is infrared
Line sensor activation module, the infrared sensor for operation activation corresponding position according to the user's choice.
Moreover, accounting for dominant position at this stage in two-dimensional operation, in order to avoid the influence to commonly using planar touch function, only
Have and opening 3D touch functions, could be used after activating infrared sensor.Mobile terminal further includes：3D soft-touch control modules,
It is turned on or off 3D touch functions for operating according to the user's choice.
Likewise, the mobile terminal is the mobile terminal for the method for controlling operation thereof for applying aforesaid operations object, above-mentioned behaviour
Make the realization method of the method for controlling operation thereof of object suitable for the embodiment of the mobile terminal, can also reach identical technology effect
Fruit.
The above is the preferred embodiment of the present invention, it is noted that for those skilled in the art
For, without departing from the principles of the present invention, it can also make several improvements and retouch, these improvements and modifications
It should be regarded as protection scope of the present invention.
Claims (10)
1. a kind of method of controlling operation thereof of operation object is applied to a mobile terminal, the front of the mobile terminal, which has, to be touched
Screen, which is characterized in that the back side and/or side of the mobile terminal have infrared sensor, the operation of the operation object
Control method includes：
Obtain the first trace information of first operating gesture of the user on the touch screen；
Obtain the second trace information of second operating gesture of the user in the detection range of the infrared sensor, wherein institute
State that the second operating gesture is carried out at the same time with first operating gesture or there are a preset time is poor；
According to first trace information and second trace information, a three-dimensional track information is obtained, and according to the three-dimensional
Trace information carries out operation and control to operation object；Wherein,
According to first trace information and second trace information, a three-dimensional track information is obtained, and according to the three-dimensional
Trace information to operation object carry out operation and control the step of include：
First trace information of first operating gesture is parsed, the plane coordinates information of three-dimensional input signal is generated,
Middle plane coordinates information includes the first coordinate information and the second coordinate information；
Second trace information of second operating gesture is parsed, the third coordinate information of three-dimensional input signal is generated；
Three-dimensional track information is determined according to the plane coordinates information and the third coordinate information, and operation object is operated
Control.
2. the method for controlling operation thereof of operation object according to claim 1, which is characterized in that parsing first manipulator
The step of first trace information of gesture, the plane coordinates information for generating three-dimensional input signal includes：
Obtain the two-dimensional coordinate (x of current operation object display location0, y0)；
By the two-dimensional coordinate (x of current operation object display location0, y0) and according to described in first trace information acquisition
Starting position coordinates (the x of first operating gesture1, y1) and stop position coordinate (x2, y2), substitute into formula：
(x’0-x0)2+(y’0-y0)2=a [(x2-x1)2+(y2-y1)2]；
Obtain the two-dimensional coordinate (x ' of display location after the operation object moves0, y '0)；
Wherein, a is predetermined coefficient；
Two-dimensional coordinate (the x ' of display location after being moved according to the operation object0, y '0) determine that the plane of three-dimensional input signal is sat
Mark information.
3. the method for controlling operation thereof of operation object according to claim 1, which is characterized in that parsing second manipulator
The step of second trace information of gesture, the third coordinate information for generating three-dimensional input signal includes：
The displacement scalar value L that second operating gesture is obtained according to second trace information, gives tacit consent to the operation object
The Z axis coordinate z of initial position0It is 0；
The displacement scalar value L is substituted into formula：
L '=bL；
Obtain the Z axis coordinate z ' of display location after the movement of the operation object0Value L '；
Wherein, b is predetermined coefficient；
By the operation direction of second operating gesture compared with presetting positive negative direction, z ' is determined0Direction；
According to the Z axis coordinate z ' of display location after the movement of the operation object0Determine the third coordinate letter of three-dimensional input signal
Breath.
4. the method for controlling operation thereof of operation object according to claim 2 or 3, which is characterized in that sat according to the plane
Mark information and the third coordinate information determine three-dimensional track information, include to the step of operation object progress operation and control：
According to the plane coordinates information and the third coordinate information, the operation object of the three-dimensional track information is obtained
Movement after display location coordinate (x '0, y '0, z '0), operation and control is carried out to the operation object and reaches desired location.
5. a kind of operating control device of operation object is applied to a mobile terminal, the front of the mobile terminal, which has, to be touched
Screen, which is characterized in that the back side and/or side of the mobile terminal have infrared sensor, the operation of the operation object
Control device includes：
First acquisition module, the first trace information for obtaining first operating gesture of the user on the touch screen；
Second acquisition module, for obtaining second operating gesture of the user in the detection range of the infrared sensor
Two trace informations, wherein second operating gesture is carried out at the same time with first operating gesture or there are a preset time is poor；
Processing module, for according to first trace information and second trace information, obtaining a three-dimensional track information, and
Operation and control is carried out to operation object according to the three-dimensional track information；Wherein,
The processing module includes：
First processing submodule, first trace information for parsing first operating gesture generate three-dimensional input letter
Number plane coordinates information, wherein plane coordinates information include the first coordinate information and the second coordinate information；
Second processing submodule, second trace information for parsing second operating gesture generate three-dimensional input letter
Number third coordinate information；
Third handles submodule, for determining that three-dimensional track is believed according to the plane coordinates information and the third coordinate information
Breath carries out operation and control to operation object.
6. the operating control device of operation object according to claim 5, which is characterized in that the first processing submodule
Including：
First acquisition unit, the two-dimensional coordinate (x for obtaining current operation object display location0, y0)；
First processing units are used for the two-dimensional coordinate (x of current operation object display location0, y0) and according to first rail
Starting position coordinates (the x of first operating gesture of mark acquisition of information1, y1) and stop position coordinate (x2, y2), it substitutes into public
Formula：
(x’0-x0)2+(y’0-y0)2=a [(x2-x1)2+(y2-y1)2]；
Obtain the two-dimensional coordinate (x ' of display location after the operation object moves0, y '0)；
Wherein, a is predetermined coefficient；
First determination unit, the two-dimensional coordinate (x ' for display location after being moved according to the operation object0, y '0) determine three-dimensional
The plane coordinates information of input signal.
7. the operating control device of operation object according to claim 5, which is characterized in that the second processing submodule
Including：
Second acquisition unit, the displacement scalar value L for obtaining second operating gesture according to second trace information write from memory
Recognize the Z axis coordinate z of the initial position of the operation object0It is 0；
Second processing unit, for the displacement scalar value L to be substituted into formula：
L '=bL；
Obtain the Z axis coordinate z ' of display location after the movement of the operation object0Value L '；
Wherein, b is predetermined coefficient；
Second determination unit, for the operation direction of second operating gesture compared with presetting positive negative direction, to be determined z '0's
Direction；
Third determination unit, for the Z axis coordinate z ' according to display location after the movement of the operation object0Determine three-dimensional input
The third coordinate information of signal.
8. the operating control device of the operation object described according to claim 6 or 7, which is characterized in that third processing
Module includes：
Operation processing unit, for according to the plane coordinates information and the third coordinate information, obtaining the three-dimensional track
Coordinate (the x ' of display location after the movement of the operation object of information0, y '0, z '0), operation control is carried out to the operation object
System reaches desired location.
9. the front of a kind of mobile terminal, the mobile terminal has touch screen, which is characterized in that the back side of the mobile terminal
And/or it includes such as claim 5-8 any one of them devices that side, which has infrared sensor, the mobile terminal,.
10. mobile terminal according to claim 9, which is characterized in that the mobile terminal further includes：
Infrared sensor active module, the infrared sensor for operation activation corresponding position according to the user's choice.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410249339.5A CN105224211B (en) | 2014-06-06 | 2014-06-06 | A kind of method of controlling operation thereof of operation object, device and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410249339.5A CN105224211B (en) | 2014-06-06 | 2014-06-06 | A kind of method of controlling operation thereof of operation object, device and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105224211A CN105224211A (en) | 2016-01-06 |
| CN105224211B true CN105224211B (en) | 2018-09-28 |
Family
ID=54993220
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410249339.5A Expired - Fee Related CN105224211B (en) | 2014-06-06 | 2014-06-06 | A kind of method of controlling operation thereof of operation object, device and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105224211B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108885533B (en) * | 2016-12-21 | 2021-05-07 | 杰创科科技有限公司 | Combining virtual reality and augmented reality |
| CN107422853A (en) * | 2017-06-29 | 2017-12-01 | 努比亚技术有限公司 | A kind of gesture identification method, mobile terminal and computer-readable recording medium |
| CN107590823B (en) * | 2017-07-21 | 2021-02-23 | 昆山国显光电有限公司 | Method and device for capturing three-dimensional form |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009127916A2 (en) * | 2008-04-14 | 2009-10-22 | Sony Ericsson Mobile Communications Ab | Touch interface for mobile device |
| CN102446042A (en) * | 2010-10-12 | 2012-05-09 | 谊达光电科技股份有限公司 | Capacitive adjacent induction and touch sensing device and method |
| CN102681731A (en) * | 2011-01-19 | 2012-09-19 | 安华高科技Ecbuip(新加坡)私人有限公司 | Non-planar reflective folded optics |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8477139B2 (en) * | 2008-06-09 | 2013-07-02 | Apple Inc. | Touch screen device, method, and graphical user interface for manipulating three-dimensional virtual objects |
-
2014
- 2014-06-06 CN CN201410249339.5A patent/CN105224211B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009127916A2 (en) * | 2008-04-14 | 2009-10-22 | Sony Ericsson Mobile Communications Ab | Touch interface for mobile device |
| CN102446042A (en) * | 2010-10-12 | 2012-05-09 | 谊达光电科技股份有限公司 | Capacitive adjacent induction and touch sensing device and method |
| CN102681731A (en) * | 2011-01-19 | 2012-09-19 | 安华高科技Ecbuip(新加坡)私人有限公司 | Non-planar reflective folded optics |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105224211A (en) | 2016-01-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11360558B2 (en) | Computer systems with finger devices | |
| CN102662462B (en) | Electronic installation, gesture identification method and gesture application process | |
| CN103261997B (en) | Apparatus and method for user input for controlling displayed information | |
| CN104903834B (en) | For equipment, method and the graphic user interface in touch input to transition between display output relation | |
| CN102880290B (en) | A kind of display control method, device and terminal | |
| CN102779000B (en) | User interaction system and method | |
| CN102426486B (en) | Stereo interaction method and operated apparatus | |
| EP3097471A1 (en) | Grip detection | |
| CN104461172B (en) | A kind of display methods and electronic equipment | |
| KR20140142778A (en) | Method for correcting coordination of electronic pen and potable electronic device supporting the same | |
| CN104423855B (en) | A kind of information processing method and electronic equipment | |
| CN104866100A (en) | Eye-controlled device, eye-controlled method and eye-controlled system | |
| CN104969148A (en) | Depth-based user interface gesture control | |
| CN103777873B (en) | A kind of information processing method and electronic equipment | |
| CN102508562B (en) | Three-dimensional interaction system | |
| US20130285921A1 (en) | Systems and Methods for a Rollable Illumination Device | |
| CN104820523B (en) | A kind of method and device for realizing touch-control | |
| US11397478B1 (en) | Systems, devices, and methods for physical surface tracking with a stylus device in an AR/VR environment | |
| CN105224211B (en) | A kind of method of controlling operation thereof of operation object, device and mobile terminal | |
| CN104407753A (en) | Operation method of touch screen interface and terminal equipment | |
| TWI486815B (en) | Display device, system and method for controlling the display device | |
| WO2016057438A1 (en) | Multiple stage user interface | |
| KR20140106996A (en) | Method and apparatus for providing haptic | |
| CN102508561B (en) | Operating rod | |
| US20130257753A1 (en) | Modeling Actions Based on Speech and Touch Inputs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180928 Termination date: 20210606 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |