CN106557157B - Contact action method, touch-screen equipment and touch screen control system - Google Patents
Contact action method, touch-screen equipment and touch screen control system Download PDFInfo
- Publication number
- CN106557157B CN106557157B CN201510638750.6A CN201510638750A CN106557157B CN 106557157 B CN106557157 B CN 106557157B CN 201510638750 A CN201510638750 A CN 201510638750A CN 106557157 B CN106557157 B CN 106557157B
- Authority
- CN
- China
- Prior art keywords
- screen
- touch screen
- touch
- stops
- operator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Position Input By Displaying (AREA)
Abstract
The present invention provides a kind of contact action method, is operated including the operating area in touch screen；And the stops of detecting operator's current gaze, and make the operation that effect occur in the stops.The detecting process utilizes eyeball tracking, and the operational requirements of big screen equipment can completely be completed by obtaining location point in the operation for being superimposed with virtual touch frame.Based on this, the present invention also provides corresponding touch-screen equipment, i.e. the above method is easily applied to from the mobile devices such as large-screen mobile phone or large-size screen monitors pad；The present invention also provides touch screen control systems, so that during the above method is applied to mobile device control other equipment.
Description
Technical field
The present invention relates to touch screen control field more particularly to a kind of contact action methods, touch-screen equipment and touch screen control system
System.
Background technique
Touch-screen mobile phone refers to a kind of type of cell phone above the technical application to mobile phone screen by touch screen.On operating
Convenience, when people replace mouse or keyboard to work with touch screen, we must touch peace with finger or other objects first
Touch screen mounted in display front end, the icon or menu position that then system is touched according to finger are come regioselective.Information is defeated
The process for entering touch screen is made of touch detection component and touch screen controller；Before touch detection component is mounted on indicator screen
Touch screen controller is sent after receiving for detecting user touch location in face；And the main function of touch screen controller is from touch
Touch information is received on point detection device, and is converted into contact coordinate, then gives CPU, it can receive what CPU was sent simultaneously
It orders and is executed.
The feature of touch-screen mobile phone maximum is the screen of its that super large, and the person of can be used brings the enjoyment of vision, no matter from
The characteristic of large screen is all embodied in terms of text or image.But since screen is big, volume is also just bigger, touches for carrying
Screen mobile phone the space occupied is also big.Touch-screen mobile phone can use finger control simultaneously, perfectly substitute keyboard.
In today of smart phone homogeneity, more and more manufacturer's selections are made an issue of on large-screen mobile phone.For the moment it
Between various large-screen mobile phones be flooded with market.But large-size screen monitors brought while bringing us and reading enjoyment it is operational
It is inconvenient.For this situation, current main solution is divided into the following two kinds:
1. the range of large-size screen monitors is reduced by algorithm, large screen is scalable to a small screen, but in this way this
The display advantage of large-screen mobile phone can be allowed thoroughly to lose, and after large screen becomes smaller, the icon and text of response also become smaller, and are unfavorable for defeated
Enter.
2. eyeball tracking technology.That is input is completed by the movement of eyes in the position of tracking eyes on the touchscreen.So
And such method is easy to cause eye fatigue；In addition, the mode of eyes operation does not meet the common habit of people not only, and
Eyes also can not neatly show the operation that such as horizontally slips.
Summary of the invention
In order to solve the problems existing in the prior art, the present invention provides a kind of contact action method, comprising:
It is operated in an operating area of touch screen；And
The stops of operator's current gaze are detected, and make the operation that effect occur in the stops.
Optionally, the stops of operator's current gaze are detected by camera.
Optionally, the method for the stops of camera detecting operator's current gaze are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple calibrations on target screen
Point analysis obtains stops of the current gaze on the target screen.
Optionally, the target screen and the touch screen are same screen.
Optionally, the target screen and the touch screen are different screen.
Optionally, the quantity of the calibration point is five, is respectively arranged at the center and four corners of the target screen.
Optionally, before the procedure further include: adjust position and size of the operating area on the touch screen.
The present invention also provides a kind of touch-screen equipments, comprising:
Touch screen includes an operating area；And
Camera for detecting stops of operator's current gaze on the touch screen, and makes the operation in institute
It states stops and effect occurs.
Optionally, the method for the stops of camera detecting operator's current gaze are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple calibrations on the touch screen
Point analysis obtains stops of the current gaze on the touch screen.
Optionally, the quantity of the calibration point is five, is respectively arranged at the center and four corners of the touch screen.
Optionally, the touch-screen equipment is mobile device.
Optionally, before the procedure further include: adjust position and size of the operating area on the touch screen.
The present invention also provides a kind of touch screen control systems, comprising:
Touch screen includes an operating area；
Target screen, to show program and operating effect to be operated；And
Camera for detecting operator's current gaze in the stops of the target screen, and makes the operation exist
Effect occurs for the stops.
Optionally, the method for the stops of camera detecting operator's current gaze are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple on the target screen
Calibration point analysis obtains stops of the current gaze on the target screen.
Optionally, the quantity of the calibration point is five, is respectively arranged at the center and four corners of the touch screen.
Optionally, the touch screen is the screen of handheld device, and the target screen is to wirelessly communicate with the mobile device
Other equipment display screen.
Optionally, before the procedure further include: adjust position and size of the operating area on the touch screen.
The present invention provides a kind of contact action method, is operated including the operating area in touch screen；And detecting behaviour
The stops of author's current gaze, and make the operation that effect occur in the stops.The detecting process utilizes eyeball
Tracking, the operational requirements of big screen equipment can completely be completed by obtaining location point in the operation for being superimposed with virtual touch frame.Base
In this, the present invention also provides corresponding touch-screen equipments, i.e. the above method is easily applied to mobile from large-screen mobile phone or large-size screen monitors pad etc.
In equipment；The present invention also provides touch screen control systems, so that the above method is applied to the process of mobile device control other equipment
In.
Detailed description of the invention
Fig. 1 is the flow chart of contact action method described in one embodiment of the invention；
Fig. 2 is the schematic diagram of touch screen and operating area in contact action method described in one embodiment of the invention；
Fig. 3 is the operating process schematic diagram of contact action method lieutenant colonel's quasi-mode described in one embodiment of the invention；
Fig. 4 is the signal that effect occurs in the stops for operation in contact action method described in one embodiment of the invention
Figure.
Specific embodiment
The present invention is described in further detail below in conjunction with the drawings and specific embodiments.It is wanted according to following explanation and right
Book is sought, advantages and features of the invention will become apparent from.It should be noted that attached drawing is all made of very simplified form and using non-
Accurately ratio, only for the purpose of facilitating and clarifying the purpose of the embodiments of the invention.
The present invention provides a kind of contact action method, as shown in Figure 1, comprising: is operated in an operating area of touch screen；
And the stops of detecting operator's current gaze, and make the operation that effect occur in the sight stops.
As shown in Fig. 2, in the present embodiment, before being operated on touch screen further include: adjust the operating area 10 in institute
State the position on touch screen 20 and size.Specifically, operating area 10 on touch screen 20 is virtual transparent input frame, input frame it is big
Small and position can be customized, can drag to each position in 20 display area of touch screen.Operating area 10 is adjusted in screen
On position and size after, operating area 10 completion click, double-click, long-pressing, the capture of sliding.
Later, as shown in figure 3, entering calibration mode after having adjusted the operating area 10, can go out on touch screen 20 at this time
Existing multiple calibration points (calibration point 1-5).It in the present embodiment, is the stop that operator's current gaze is detected by camera 30
Place；The quantity of calibration point is five, is respectively arranged at the center and four corners of target screen.
The mode of above-mentioned calibration is as follows:
1, calibration mode is opened, and camera 30 is opened, and successively carries out face capture and eyes capture, to obtain operator's eye
The position of eyeball；
2, red flashing is presented in the multiple calibration points for needing to calibrate, and eyes of user is persistently certain about this multiple calibration point, simultaneously
Click the operating area 10 on screen；
3, after camera 30 obtains eye data, multiple calibration points become green and stop flashing；
4, later, user persistently operates, and starts the detecting calibration of next calibration point, that is, repeats the above steps
1~3；
5, finally, camera 30 passes through 5 points on screen of positioning, to determine the initial setting up of eyeball tracking algorithm, at this time
Camera 30 has analyzed the stops for obtaining current gaze on target screen.
Camera 30, which has been analyzed, obtains current gaze after the stops on target screen, so that operation is stopped in sight
Effect occurs for place.As shown in figure 4, operator's sight stops are, for example, Baidu map program a, and clicked at operating area 10
When, Baidu map program a is opened.
In the present embodiment, above-mentioned target screen and the touch screen 20 are same screen, and calibration point is distributed in touch screen
On 20；In such cases, contact action method of the invention is directed to the operation of mobile device itself, that is, passes through mobile device
Contact action so that effect occur with the mobile device sheet.In addition, target screen is different screens from the touch screen 20
Curtain, calibration point is distributed on target screen at this time；In such cases, contact action method of the invention is grasped by mobile device
Make, so that effect occurs on target screen.For example, controlling TV etc. by mobile device.Specific touch screen and target screen
It whether is same screen, the present invention is with no restriction, it is thus understood that the contact action method includes above-mentioned two situations.
For above-mentioned two situations, the present invention also each provides a kind of touch-screen equipment and touch screen control system, to point
It does not describe in system of this method applied to mobile device and by mobile device control.
The present invention provides a kind of touch-screen equipment, comprising:
Touch screen includes an operating area；And
Camera for detecting stops of operator's current gaze on the touch screen, and makes the operation in institute
It states stops and effect occurs.
The touch-screen equipment is mobile device in the present embodiment, the stop of camera detecting operator's current gaze
The method at place are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple calibrations on the touch screen
Point analysis obtains stops of the current gaze on the touch screen.
As described above, before the procedure further include: adjust position and size of the operating area on the touch screen.Separately
Outside, the quantity of the calibration point is five, is respectively arranged at the center and four corners of the touch screen.
The present invention also provides a kind of touch screen control systems, comprising:
Touch screen includes an operating area；
Target screen, to show program and operating effect to be operated；And
Camera for detecting operator's current gaze in the stops of the target screen, and makes the operation exist
Effect occurs for the stops.
Touch screen described in the present embodiment is the screen of mobile device, and the target screen is and the handheld device channel radio
The display screen of the other equipment of letter.At this point, the method for the stops of camera detecting operator's current gaze are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple on the target screen
Calibration point analysis obtains stops of the current gaze on the target screen.
As described above, the quantity of the calibration point is five, is respectively arranged at the center and four corners of the touch screen；Separately
Outside, before the procedure further include: adjust position and size of the operating area on the touch screen.
The present invention utilizes eyeball tracking, and obtaining location point can completely complete in the operation for being superimposed with virtual touch frame
The operational requirements of big screen equipment.This programme can be very easily applied on from large-screen mobile phone to handheld devices such as large-size screen monitors pad, by
It is mobile with eyeball in position input, it can theoretically operate all big screen equipments.But it due to camera shooting angle and takes the photograph
As the influence of head edge anamorphose, can be performed better than in general handheld device.
Obviously, those skilled in the art can carry out various modification and variations without departing from spirit of the invention to invention
And range.If in this way, these modifications and changes of the present invention belong to the claims in the present invention and its equivalent technologies range it
Interior, then the invention is also intended to include including these modification and variations.
Claims (17)
1. a kind of contact action method characterized by comprising
It is operated in an operating area of touch screen；And
The stops of operator's current gaze are detected, and make the operation that effect occur in the stops；
Wherein, the operating area is the virtual transparent input frame for being movable to any position on the touch screen.
2. contact action method as described in claim 1, which is characterized in that detect operator's current gaze by camera
Stops.
3. contact action method as claimed in claim 2, which is characterized in that camera detecting operator's current gaze
The method of stops are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple calibration points on target screen point
Analysis obtains stops of the current gaze on the target screen.
4. contact action method as claimed in claim 3, which is characterized in that the target screen is same screen with the touch screen
Curtain.
5. contact action method as claimed in claim 3, which is characterized in that the target screen is different screens from the touch screen
Curtain.
6. contact action method as claimed in claim 3, which is characterized in that the quantity of the calibration point is five, is set respectively
It is placed in the center and four corners of the target screen.
7. contact action method as described in claim 1, which is characterized in that before the procedure further include: adjust the operation
Position and size of the region on the touch screen.
8. a kind of touch-screen equipment characterized by comprising
Touch screen, includes an operating area, and the operating area is be movable to any position on the touch screen virtual transparent defeated
Enter frame；And
Camera for detecting stops of operator's current gaze on the touch screen, and makes on the operating area
Operation the stops occur effect.
9. touch-screen equipment as claimed in claim 8, which is characterized in that the stop of camera detecting operator's current gaze
The method at place are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple calibration points on the touch screen point
Analysis obtains stops of the current gaze on the touch screen.
10. touch-screen equipment as claimed in claim 9, which is characterized in that the quantity of the calibration point is five, is respectively arranged at
The center of the touch screen and four corners.
11. touch-screen equipment as claimed in claim 8, which is characterized in that the touch-screen equipment is mobile device.
12. touch-screen equipment as claimed in claim 8, which is characterized in that before the procedure further include: adjust the operating area
Position and size on the touch screen.
13. a kind of touch screen control system characterized by comprising
Touch screen, includes an operating area, and the operating area is be movable to any position on the touch screen virtual transparent defeated
Enter frame；
Target screen, to show program and operating effect to be operated；And
Camera for detecting operator's current gaze in the stops of the target screen, and makes in the operating area
On operation the stops occur effect.
14. touch screen control system as claimed in claim 13, which is characterized in that the camera detects operator's current gaze
Stops method are as follows:
The position of camera acquisition operator's eyes；And
For operator when an operating area of touch screen operates, the camera is by multiple calibrations on the target screen
Point analysis obtains stops of the current gaze on the target screen.
15. touch screen control system as claimed in claim 14, which is characterized in that the quantity of the calibration point is five, respectively
It is set to the center and four corners of the touch screen.
16. touch screen control system as claimed in claim 13, which is characterized in that the touch screen is the screen of handheld device, institute
State the display screen that target screen is the other equipment wirelessly communicated with a mobile device.
17. touch screen control system as claimed in claim 13, which is characterized in that before the procedure further include: adjust the behaviour
Make position and size of the region on the touch screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510638750.6A CN106557157B (en) | 2015-09-29 | 2015-09-29 | Contact action method, touch-screen equipment and touch screen control system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510638750.6A CN106557157B (en) | 2015-09-29 | 2015-09-29 | Contact action method, touch-screen equipment and touch screen control system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106557157A CN106557157A (en) | 2017-04-05 |
| CN106557157B true CN106557157B (en) | 2019-11-22 |
Family
ID=58418079
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510638750.6A Active CN106557157B (en) | 2015-09-29 | 2015-09-29 | Contact action method, touch-screen equipment and touch screen control system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106557157B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN104850318A (en) * | 2014-02-13 | 2015-08-19 | 联想（新加坡）私人有限公司 | Method and apparatus for transient message display control |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103777861A (en) * | 2012-10-23 | 2014-05-07 | 韩国电子通信研究院 | Terminal and method for controlling touch operation in the terminal |
-
2015
- 2015-09-29 CN CN201510638750.6A patent/CN106557157B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN104850318A (en) * | 2014-02-13 | 2015-08-19 | 联想（新加坡）私人有限公司 | Method and apparatus for transient message display control |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106557157A (en) | 2017-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9922179B2 (en) | Method and apparatus for user authentication | |
| US9111076B2 (en) | Mobile terminal and control method thereof | |
| US10108331B2 (en) | Method, apparatus and computer readable medium for window management on extending screens | |
| US11016644B2 (en) | Suspend button display method and terminal device | |
| US20140184526A1 (en) | Method and apparatus for dual display | |
| KR102429740B1 (en) | Method and apparatus for precessing touch event | |
| EP2988202A1 (en) | Electronic device and method for providing input interface | |
| EP3218792A1 (en) | System and methods for controlling a cursor based on finger pressure and direction | |
| WO2015192763A1 (en) | Touch screen control method and device | |
| KR20150108216A (en) | Method for processing input and an electronic device thereof | |
| KR20150128303A (en) | Method and apparatus for controlling displays | |
| WO2013189396A2 (en) | Method and system for moving application icon on touchscreen | |
| EP2889749B1 (en) | Electronic device and method for displaying user interface thereof | |
| EP2958006A1 (en) | Electronic device and method for controlling display | |
| WO2014024396A1 (en) | Information processing apparatus, information processing method, and computer program | |
| EP2947556B1 (en) | Method and apparatus for processing input using display | |
| CN108920066B (en) | Touch screen sliding adjustment method and device and touch equipment | |
| US20150103001A1 (en) | Touch control method and electronic device using the same | |
| EP3198389B1 (en) | Apparatus and method for identifying object | |
| US10732808B2 (en) | Information processing device, information processing method, and program | |
| US9958967B2 (en) | Method and electronic device for operating electronic pen | |
| CN109032710B (en) | Interface adjusting method, device, equipment and storage medium | |
| CN106796912B (en) | Electronic device and method for setting block | |
| CN106557157B (en) | Contact action method, touch-screen equipment and touch screen control system | |
| TWI607369B (en) | System and method for adjusting image display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20170405 Assignee: Shanghai Li Ke Semiconductor Technology Co., Ltd. Assignor: Leadcore Technology Co., Ltd. Contract record no.: 2018990000159 Denomination of invention: Touch screen operation method, touch screen device and touch screen control system License type: Common License Record date: 20180615 |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |