CN103699213A - Control method for double click of virtual mouse - Google Patents

Control method for double click of virtual mouse Download PDF

Info

Publication number
CN103699213A
CN103699213A CN201210554145.7A CN201210554145A CN103699213A CN 103699213 A CN103699213 A CN 103699213A CN 201210554145 A CN201210554145 A CN 201210554145A CN 103699213 A CN103699213 A CN 103699213A
Authority
CN
China
Prior art keywords
eyes
user
marker
double
standard substance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201210554145.7A
Other languages
Chinese (zh)
Inventor
胡小青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Beitente Electronic Technology Co Ltd
Original Assignee
Suzhou Beitente Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Beitente Electronic Technology Co Ltd filed Critical Suzhou Beitente Electronic Technology Co Ltd
Priority to CN201210554145.7A priority Critical patent/CN103699213A/en
Publication of CN103699213A publication Critical patent/CN103699213A/en
Withdrawn legal-status Critical Current

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a control method for double click of a virtual mouse. The method comprises the following steps: (1) arranging markers moving upwards and downwards along with the opening and closing of the eyes of a user on the upper eyelid of the user, arranging reference objects below the eyes of the user, and arranging a camera on an application electrical appliance; (2) calculating the distance between each marker and each reference object by using the reference state images of the camera in a double eye opening state, a double eye closing state, a left single eye closing state and a right single eye closing state, and storing in a storage unit; (3) calculating each distance in each real-time image, and comparing data in each reference image; (4) considering no command input when the opening or closing of double eyes is identified, and considering input of a mouse operating right button double click command when more than two right single eye closing states are detected within a certain preset time interval. The method disclosed by the invention is simple, accurate and rapid.

Description

The control method that virtual mouse is double-clicked
Technical field
The invention belongs to pseudo operation technical field, relate to the control method that a kind of virtual mouse is double-clicked.
Background technology
Development along with infotech, computer is more and more universal, mouse is as indispensable parts of computer, also along with computer has entered huge numbers of families, but the use of conventional mouse also brings many difficult problems, first conventional mouse is Activities Design based on hand, obviously like this makes the people that those cannot movable hand cannot valid function mouse, thereby cannot valid function computer.In addition, medical circle is also verified, uses for a long time conventional mouse, can cause physical property injury to people's wrist muscle, gently produces provisional ache, heavy cause the muscle disease that is difficult to for a long time healing.
Publication number is the Chinese patent of CN1889016A, a kind of eyes are disclosed to computer cursor automatic positioning controlling method and system, its principle is: the eyes image when taking respectively user and watch four angles of computer monitor attentively with camera, image conversion is become to gray scale array, to array dynamic process, average value processing Xuan Qi center is carried out in maximum effective coverage in remaining value, calculate the eyeball center of every width image, according to the part attribute of these four some eyeball centers and system demonstration, set up model; Obtain after the full figure coordinate of four some correspondences, according to 4, calculate wherein heart position M; Set up quadrilateral with 4, then be rectangle by quadrangle modification, calculate the length of rectangle and wide, and be divided by with the length and width of display, calculate respectively ratio KW and KH, the ratio obtaining is for determining the relation of the cursor correspondence position of eyeball position and monitor.The method that this virtual mouse is controlled is comparatively numerous and diverse, and easily maloperation, and improvements are needed in upper existence badly.
Summary of the invention
The object of this invention is to provide and a kind ofly comparatively simplify, precisely and the control method that virtual mouse is double-clicked fast.
The technical scheme that realizes the object of the invention is: the control method that a kind of virtual mouse is double-clicked, comprises the following steps:
1. on user's upper eyelid, arrange along with eyes open and close and the marker that moves up and down and be arranged on the primary standard substance below user's eyes; Answering setting on electrical appliance can photograph user's eyes, and the marker of each upper and lower both sides of eyes and the camera of primary standard substance;
2. utilize camera to take the following status image of user as normal condition image: eyes are opened state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker of each upper and lower both sides of eyes and primary standard substance, calculates the marker of each upper and lower both sides of eyes in each normal condition image and the spacing between primary standard substance, and deposits in storage unit;
3. when the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to the default speed of taking pictures, by calculating the marker of each upper and lower both sides of eyes in each realtime graphic and the spacing between primary standard substance, and with storage unit in data in each benchmark image of storing contrast, thereby identify user's eyes in which kind of state;
4. when identifying user, in eyes, open or when eyes are closed, be considered as inputting without instruction; When the simple eye closure state of right eye identifying in a certain Preset Time more than twice, be considered as inputting primary mouse right button and double-click instruction.
In such scheme, when the simple eye closure state of left eye identifying in a certain Preset Time more than twice, be considered as inputting primary mouse left button and double-click instruction.
The inventive method can be taken user's eyes area image frame by frame by camera, according to the spacing size between marker and a corresponding primary standard substance, identifying each eye is in opening or closed state, thereby which kind of instruction judgement user wants to send, realize and replace the manual operations that left mouse button is double-clicked and right button is double-clicked; Owing to monitoring and identifying, the switching of eyes is comparatively easy, thus with in conventional art, by monitoring eye movement, realize virtual mouse and control and compare, have comparatively simplify, advantage precisely and fast.
(embodiment 1)
embodiment
The present embodiment is the control method that a kind of virtual mouse is double-clicked, and comprises the following steps:
1. on user's upper eyelid, arrange along with eyes open and close and the marker that moves up and down and be arranged on the primary standard substance below user's eyes; Answering setting on electrical appliance can photograph user's eyes, and the marker of each upper and lower both sides of eyes and the camera of primary standard substance;
Described marker can be the regular shape coating being coated on upper eyelid, and for example colored horizontal line shape or mottled coating, can be also reflective sticker or the diffuse reflection paster of pasting on upper eyelid; Described primary standard substance can be also coating or reflective sticker or diffuse reflection paster; So long as and periphery yellowish pink and hair color to have the material of obvious difference all right.Described primary standard substance is the static eyes below that is arranged on preferably.
2. utilize camera to take the following status image of user as normal condition image: eyes are opened state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker 1 and primary standard substance 2 of each upper and lower both sides of eyes, calculates the marker 1 of each upper and lower both sides of eyes in each normal condition image and the spacing between primary standard substance 2, and deposits in storage unit;
This is to be not quite similar due to position that each user pasted or applied marker 1 and primary standard substance 2 separately, so after being preferably in and having pasted marker 1 and primary standard substance 2, take lower each normal condition image, so that as judgement more accurately;
A kind of concrete grammar of identifying spacing is: the image of four kinds of normal conditions that photograph is changed into gray scale array, also can directly change into 256 look formula arrays, marker 1 and primary standard substance 2 have obvious difference with periphery yellowish pink and hair color, so marker 1 and primary standard substance 2 all have significant array separately, and can judge corresponding marker 1 and the primary standard substance spacing between Shang Xia 2, and then judge that by identification spacing these place eyes are opened or closure;
3. when the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to the default speed of taking pictures, by calculating the marker 1 of each upper and lower both sides of eyes in each realtime graphic and the spacing between primary standard substance 2, and with storage unit in data in each benchmark image of storing contrast, thereby identify user's eyes in which kind of state;
4. when identifying user, in eyes, open or when eyes are closed, be considered as inputting without instruction; When in a certain Preset Time, for example in 0.2 second, identify the more than twice simple eye closure state of right eye, be considered as inputting primary mouse right button and double-click instruction.
In addition, when in a certain Preset Time, for example, in 0.2 second, identify the more than twice simple eye closure state of left eye, be considered as inputting primary mouse left button and double-click instruction.
In addition, when identifying user in the simple eye closure state of left eye, be considered as inputting primary mouse left button click commands, when identifying user in the simple eye closure state of right eye, be considered as inputting primary mouse and click instruction by right key.
Obviously, the above embodiment of the present invention is only for example of the present invention is clearly described, and is not the restriction to embodiments of the present invention.For those of ordinary skill in the field, can also make other changes in different forms on the basis of the above description.Here exhaustive without also giving all embodiments.And these belong to apparent variation or the change that connotation of the present invention extends out and still belong to protection scope of the present invention.

Claims (2)

1. on user's upper eyelid, arrange along with eyes open and close and the marker that moves up and down and be arranged on the primary standard substance below user's eyes; Answering setting on electrical appliance can photograph user's eyes, and the marker of each upper and lower both sides of eyes and the camera of primary standard substance;
2. utilize camera to take the following status image of user as normal condition image: eyes are opened state, eyes closure state, the simple eye closure state of left eye, the simple eye closure state of right eye; Described each normal condition image comprises user's eyes, and the marker of each upper and lower both sides of eyes and primary standard substance, calculates the marker of each upper and lower both sides of eyes in each normal condition image and the spacing between primary standard substance, and deposits in storage unit;
3. when the display screen of electrical appliance is answered in user's binocular fixation, camera takes the realtime graphic in user's eyes region continuously according to the default speed of taking pictures, by calculating the marker of each upper and lower both sides of eyes in each realtime graphic and the spacing between primary standard substance, and with storage unit in data in each benchmark image of storing contrast, thereby identify user's eyes in which kind of state;
4. when identifying user, in eyes, open or when eyes are closed, be considered as inputting without instruction; When the simple eye closure state of right eye identifying in a certain Preset Time more than twice, be considered as inputting primary mouse right button and double-click instruction.
2. the control method that virtual mouse according to claim 1 is double-clicked, is characterized in that: when the simple eye closure state of left eye identifying in a certain Preset Time more than twice, be considered as inputting primary mouse left button and double-click instruction.
CN201210554145.7A 2012-12-19 2012-12-19 Control method for double click of virtual mouse Withdrawn CN103699213A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210554145.7A CN103699213A (en) 2012-12-19 2012-12-19 Control method for double click of virtual mouse

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210554145.7A CN103699213A (en) 2012-12-19 2012-12-19 Control method for double click of virtual mouse

Publications (1)

Publication Number Publication Date
CN103699213A true CN103699213A (en) 2014-04-02

Family

ID=50360768

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210554145.7A Withdrawn CN103699213A (en) 2012-12-19 2012-12-19 Control method for double click of virtual mouse

Country Status (1)

Country Link
CN (1) CN103699213A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1960670A (en) * 2004-04-01 2007-05-09 威廉·C·托奇 Biosensors, communicators, and controllers for monitoring eye movement and methods for using them
CN101799717A (en) * 2010-03-05 2010-08-11 天津大学 Man-machine interaction method based on hand action catch
CN201945946U (en) * 2011-01-20 2011-08-24 叶尔肯·拜山 Head control mouse
CN102393796A (en) * 2011-07-25 2012-03-28 金宇 Control method based on winking-characteristic extraction and shooting spectacles based on the same
CN102799277A (en) * 2012-07-26 2012-11-28 深圳先进技术研究院 Wink action-based man-machine interaction method and system
US20120314047A1 (en) * 2011-06-13 2012-12-13 Sony Corporation Information processing apparatus and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1960670A (en) * 2004-04-01 2007-05-09 威廉·C·托奇 Biosensors, communicators, and controllers for monitoring eye movement and methods for using them
CN101799717A (en) * 2010-03-05 2010-08-11 天津大学 Man-machine interaction method based on hand action catch
CN201945946U (en) * 2011-01-20 2011-08-24 叶尔肯·拜山 Head control mouse
US20120314047A1 (en) * 2011-06-13 2012-12-13 Sony Corporation Information processing apparatus and program
CN102393796A (en) * 2011-07-25 2012-03-28 金宇 Control method based on winking-characteristic extraction and shooting spectacles based on the same
CN102799277A (en) * 2012-07-26 2012-11-28 深圳先进技术研究院 Wink action-based man-machine interaction method and system

Similar Documents

Publication Publication Date Title
CN103443742B (en) For staring the system and method with gesture interface
KR20180070688A (en) Method and Apparatus for Generating Facial Animation of a Human Face Model
CN106575160A (en) Method and apparatus for providing interface recognizing movement in accordance with user's view
CN105210116A (en) Method and apparatus for rendering object for multiple 3D displays
WO2018000519A1 (en) Projection-based interaction control method and system for user interaction icon
CN101441513A (en) System for performing non-contact type human-machine interaction by vision
CN106454322A (en) VR Image processing system and method thereof
CN107256121A (en) Control method and device, computer installation and the readable storage medium storing program for executing of control
CN105425954A (en) Human-computer interaction method and system applied to smart home
CN105320820A (en) Rapid cockpit design system and method based on immersive virtual reality platform
CN109145802A (en) More manpower gesture man-machine interaction methods and device based on Kinect
CN102096471A (en) Human-computer interaction method based on machine vision
CN103995623B (en) Non-contact type touch screen control device
US20180284914A1 (en) Physical-surface touch control in virtual environment
CN107589628A (en) A kind of holographic projector and its method of work based on gesture identification
CN107179876A (en) Human-computer interaction device based on virtual reality system
CN103902192A (en) Trigger control method and trigger control device for man-machine interactive operation
CN109839827A (en) A kind of gesture identification intelligent home control system based on total space location information
CN107450717A (en) A kind of information processing method and Wearable
CN208722146U (en) Wearable device for auxiliary positioning tracking
CN202995626U (en) Visual mouse clicking system
CN106200900A (en) Based on identifying that the method and system that virtual reality is mutual are triggered in region in video
CN110069101A (en) A kind of wearable calculating equipment and a kind of man-machine interaction method
CN104184941A (en) Monitoring system
CN103677247A (en) Method for virtual mouse clicking

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication
WW01 Invention patent application withdrawn after publication

Application publication date: 20140402