CN108459720A - Depending on control device and the control method of terminal - Google Patents

Depending on control device and the control method of terminal Download PDF

Info

Publication number
CN108459720A
CN108459720A CN201810353398.5A CN201810353398A CN108459720A CN 108459720 A CN108459720 A CN 108459720A CN 201810353398 A CN201810353398 A CN 201810353398A CN 108459720 A CN108459720 A CN 108459720A
Authority
CN
China
Prior art keywords
eyeball
pressure sensor
eyelid
detection unit
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810353398.5A
Other languages
Chinese (zh)
Other versions
CN108459720B (en
Inventor
于作鑫
吴昊
刘旭忠
安娜
马晓
罗宗玮
次刚
许少鹏
郭宝磊
苏伟
张铮
管清竹
宫心峰
徐斌
王国春
周锦钊
罗振华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Beijing BOE Optoelectronics Technology Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Beijing BOE Optoelectronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd, Beijing BOE Optoelectronics Technology Co Ltd filed Critical BOE Technology Group Co Ltd
Priority to CN201810353398.5A priority Critical patent/CN108459720B/en
Publication of CN108459720A publication Critical patent/CN108459720A/en
Application granted granted Critical
Publication of CN108459720B publication Critical patent/CN108459720B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

This application discloses a kind of control methods regarding control device and terminal, belong to electronic technology field.It is described to include depending on control device:Control unit and detection unit, and control unit is all connected with detection unit and terminal, and the default correspondence of motion state and control instruction is stored in control unit, detection unit when being contacted with the eyelid outside user eyeball, can obtain the contact information of eyelid;Control unit is used to determine the motion state of eyeball according to contact information, and determines that the corresponding target control of the motion state of eyeball instructs according to default correspondence, and instructs control terminal according to target control.The application is realized without can be controlled terminal by both hands.The application is used for control terminal.

Description

Depending on control device and the control method of terminal
Technical field
This application involves electronic technology field, more particularly to a kind of control method regarding control device and terminal.
Background technology
With the development of electronic technology, the control mode of terminal becomes more and more diversified.
In the related technology, it usually needs the both hands of user operate with control terminal terminal, such as use finger opponent Machine carries out the operations such as button.
Then it is difficult to go to operate with control terminal terminal by both hands however, for the awkward user of both hands, Therefore, there is an urgent need for a kind of without can be to scheme that terminal is controlled by both hands.
Invention content
This application provides a kind of control method regarding control device and terminal, may be implemented without passing through both hands just to terminal It is controlled.The technical solution is as follows:
On the one hand, it provides a kind of regard and controls device, it is described to include depending on control device:Control unit and detection unit, and it is described Control unit is all connected with the detection unit and terminal,
The default correspondence of motion state and control instruction is stored in described control unit, the detection unit can When being contacted with the eyelid outside user eyeball, the contact information of the eyelid is obtained;
Described control unit is used to determine the motion state of the eyeball according to the contact information, and according to described default Correspondence determines the corresponding target control instruction of the motion state of the eyeball, and is instructed and controlled according to the target control The terminal.
Optionally, the detection unit includes:First pressure sensor and second pressure sensor,
When the detection unit and the eyelid contact, the first pressure sensor and the second pressure sensor Contact, and be arranged on the left-right rotation direction of the eyeball with the eyelid, the first pressure sensor with it is described The distance of second pressure sensor is more than target range, and the target range is anterior chamber in the eyeball in the left-right rotation side Upward length;
The contact information of the eyelid includes:The pressure that the first pressure sensor and the second pressure sensor are subject to Power, the pressure that described control unit is used to be subject to according to the first pressure sensor and the second pressure sensor determine institute Stating eyeball, whether left-right rotation determines that the motion state of the eyeball is to turn left and when determining the eyeball left-right rotation State or right turn state.
Optionally, the detection unit further includes:Displacement sensor,
Institute's displacement sensors are between the first pressure sensor and the second pressure sensor, in the inspection When survey unit is contacted with the eyelid, institute's displacement sensors are contacted with the target location in the eyelid, the displacement sensing Device is for obtaining the displacement that rotates upwardly and downwardly direction on of the target location in the eyeball;
The contact information of the eyelid includes:The target location is in the displacement rotated upwardly and downwardly on direction, the control Unit processed is used to according to the displacement determine whether the eyeball rotates upwardly and downwardly, and when determining that the eyeball rotates upwardly and downwardly, Determine the eyeball motion state be on turn state or under turn state.
Optionally, described control unit is additionally operable to:
It obtains the target location and duration needed for the displacement occurs;
The movement speed of the target location is determined according to the displacement and the duration;
Judge whether the movement speed is less than pre-set velocity threshold value;
When the movement speed is less than the pre-set velocity threshold value, determine the eyeball whether up and down according to the displacement Rotation.
Optionally, described to further include depending on control device:Head hoop, curved surface mounting plate and connecting bracket,
The head hoop can be worn on the head of the user, and the curved surface mounting plate is arranged by the connecting bracket On the head hoop, the detection unit is arranged on the curved surface mounting plate, when the detection unit and the eyelid contact, Face of the concave surface of the curved surface mounting plate towards the user.
Optionally, the relative position of the curved surface mounting plate and the head hoop can be adjusted, the first pressure sensor, The relative position energy of each sensor and the curved surface mounting plate in the second pressure sensor and institute's displacement sensors It is enough to adjust.
Optionally, the connecting bracket includes:Sequentially connected first bar portion, the second bar portion and third bar portion,
First bar portion is connect with the head hoop, and the third bar portion is connect with the curved surface mounting plate, and described One bar portion is parallel to the third bar portion, and second bar portion is parallel to the left-right rotation direction.
Optionally, the first pressure sensor, the second pressure sensor and institute's displacement sensors are according to spiral shell Line connection type is set on the curved surface mounting plate.
On the other hand, a kind of control method of terminal is provided, regards control device for above-mentioned, described regard controls device packet It includes:Control unit and detection unit, and described control unit is all connected with the detection unit and terminal, in described control unit It is stored with the default correspondence of motion state and control instruction, the method includes:
When eyelid outside the detection unit and user eyeball contacts, the eyelid is obtained by the detection unit Contact information;
The motion state of the eyeball is determined according to the contact information;
The corresponding target control instruction of the motion state of the eyeball is determined according to the default correspondence;
The terminal is controlled according to target control instruction.
Optionally, the detection unit includes:First pressure sensor and second pressure sensor,
When the detection unit and the eyelid contact, the first pressure sensor and the second pressure sensor Contact, and be arranged on the left-right rotation direction of the eyeball with the eyelid, the first pressure sensor with it is described The distance of second pressure sensor is more than target range, and the target range is anterior chamber in the eyeball in the left-right rotation side Upward length;The contact information of the eyelid includes:The first pressure sensor and the second pressure sensor by Pressure,
The contact information that the eyelid is obtained by the detection unit includes:
Obtain the first pressure sensor and pressure that the second pressure sensor is subject to;
Whether the pressure being subject to according to the first pressure sensor and the second pressure sensor determines the eyeball Left-right rotation;
When determining the eyeball left-right rotation, determine that the motion state of the eyeball is left turn state or right turn state.
The advantageous effect that technical solution provided by the present application is brought is:
This application provides a kind of control methods regarding control device and terminal, should include control unit and detection depending on control device Unit, and control unit is connect with detection unit and terminal simultaneously, detection unit can be contacted with the eyelid outside user eyeball When, obtain the contact information of eyelid.Control unit can determine the motion state of eyeball according to the contact information, and according to default Correspondence determines the corresponding target control instruction of the motion state of the eyeball, and instructs control eventually according to the target control End.It that is to say, detection unit only needs to contact with the eyelid of user, the eyelid that control unit can be detected by detection unit Control of the contact information realization to terminal, it is thereby achieved that without just being controlled terminal by both hands.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the present application, for For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings Attached drawing.
Fig. 1 is a kind of application scenarios schematic diagram regarding control device provided in an embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram regarding control device provided in an embodiment of the present invention;
Fig. 3 is another structural schematic diagram for regarding control device provided in an embodiment of the present invention;
Fig. 4 is a kind of front view of detection unit provided in an embodiment of the present invention;
Fig. 5 is a kind of vertical view of detection unit provided in an embodiment of the present invention;
Fig. 6 is a kind of structural schematic diagram of eyeball provided in an embodiment of the present invention;
Fig. 7 is a kind of control method flow chart of terminal provided in an embodiment of the present invention;
Fig. 8 is the control method flow chart of another terminal provided in an embodiment of the present invention.
Specific implementation mode
To keep the purpose, technical scheme and advantage of the application clearer, below in conjunction with attached drawing to the application embodiment party Formula is described in further detail.
With the development of electronic technology, gradually show using only the limitation of both hands control terminal, the control for terminal The exploration of mode is also more and more.Terminal can such as be controlled by detecting the sight moving direction of user depending on control device System, so that using which control terminal the both hands inconvenience of user.
Fig. 1 is a kind of application scenarios schematic diagram regarding control device provided in an embodiment of the present invention.As shown in Figure 1, regarding control dress Setting 10 may include:Control unit 101 and detection unit 102, wherein detection unit 102 can be with the eyelid outside user eyeball Contact, and obtain the contact information of eyelid.Control unit 101 can be all connected with detection unit 102 and terminal 20, and be controlled The contact information for the eyelid that unit 101 can be obtained according to detection unit 102 determines the sight moving direction of user, and according to this The corresponding target control of sight moving direction instructs control terminal 20.Exemplary, which can be mobile phone, computer or television Deng.
Fig. 2 is a kind of structural schematic diagram regarding control device provided in an embodiment of the present invention.Incorporated by reference to Fig. 1 and Fig. 2, filled depending on control Setting 10 includes:Control unit 101 and detection unit 102, and control unit 101 is all connected with detection unit 102 and terminal 20.
The default correspondence of motion state and control instruction, 102 energy of detection unit can be stored in control unit 101 Enough when being contacted with the eyelid outside user eyeball, the contact information of eyelid is obtained;Control unit 101 is used for according to the contact information It determines the motion state of eyeball, and determines that the corresponding target control of the motion state of eyeball instructs according to default correspondence, with And control terminal is instructed according to the target control.
It depending on control device include control unit and detection unit in conclusion provided in an embodiment of the present invention, and control unit It is connect simultaneously with detection unit and terminal, detection unit can obtain connecing for eyelid when being contacted with the eyelid outside user eyeball Touch information.Control unit can determine the motion state of eyeball according to the contact information, and being determined according to default correspondence should The corresponding target control instruction of motion state of eyeball, and control terminal is instructed according to the target control.It that is to say, detect Unit only needs to contact with the eyelid of user, and control unit can pass through the contact information realization for the eyelid that detection unit detects Control to terminal, it is thereby achieved that without just being controlled terminal by both hands.
Optionally, with continued reference to FIG. 2, can also should include depending on control device 10:Head hoop 103, curved surface mounting plate 104 and company Connect holder (not marked in Fig. 2).Incorporated by reference to Fig. 1 and Fig. 2, head hoop 103 can be worn on the head of user, curved surface mounting plate 104 It can be arranged on head hoop 103 by connecting bracket, detection unit 102 can be arranged on curved surface mounting plate 104, single in detection When member 102 is contacted with eyelid, the face of the concave surface of curved surface mounting plate 104 towards user.Curved surface mounting plate 104 and head hoop 103 Relative position can be adjusted.It should be noted that the embodiment of the present invention is with by the position of head hoop fixed test unit, so that For detection unit can be contacted with eyelid, in practical application, the position of other fixed form fixed test units can also be used It sets, such as by bonding mode detection unit will be contacted with eyelid.
It is exemplary, as shown in Fig. 2, the connecting bracket that connection head hoop 103 installs version 104 with curved surface may include:Connect successively The first bar portion 1051, the second bar portion 1052 and the third bar portion 1053 connect, wherein the first bar portion 1051 can connect with head hoop 103 It connecing, third bar portion 1053 can be connect with curved surface mounting plate 104, and the first bar portion 1051 can be parallel to third bar portion 1053, Second bar portion 1052 can be parallel to the left-right rotation direction (side x in such as Fig. 2 of user's eyeball when wearing this and regarding control device To).Optionally, the first bar portion 1051 can also can be along the left/right rotation perpendicular to the left-right rotation direction, the second bar portion 1052 Dynamic direction is flexible, to adjust the relative position of curved surface mounting plate 104 and head hoop 103.In addition, the first bar portion also may be used with third bar portion To stretch along its length, the embodiment of the present invention is not construed as limiting this.
Since the relative position of curved surface mounting plate and head hoop is adjustable, even if the eye position of different users is different Can be flexible by controlling second bar portion, to adjust the relative position of curved surface mounting plate and head hoop, and then adjust detection unit With the relative position of head hoop so that detection unit is accurately contacted with the eyelid of user.User can also by control this second Bar portion is flexible, determines that eyelid that detection unit is contacted is the left eye skin or right eye skin of user, and that is to say should can be with depending on controlling device It touches, can also be touched with the right eye bark graft of user with the left eye bark graft of user, the flexibility that should regard control device is higher.Optionally, should The process that second bar portion is stretched along the left-right rotation direction can be controlled by control unit.
Optionally, as shown in figure 3, it is provided in an embodiment of the present invention depending on control device can also include two detection unit (Fig. 3 In be not shown), two curved surface mounting plates 104 and two connecting brackets, two detection units can contact the left side of user respectively Eyelid and right eye skin, and each detection unit is arranged on a curved surface mounting plate 104.User can be this two with self-defining Any detection unit work in detection unit, alternatively, two detection units can be made to work, and ought be respectively by this When the motion state difference for the eyeball that two detection units determine, control unit can be by the motion state of two eyeballs at this time It is determined as a kind of peculair motion state of eyeball, and can determines that this kind of peculair motion state is corresponding according to default correspondence Control instruction.It can be passed through by user it should be noted that whether the second bar portion in two connecting brackets carries out stretching Control unit voluntarily controls, exemplary, and second bar portion is in elongation state in the second bar portion of two shown in Fig. 3, another A second bar portion is in non-elongation state.
Optionally, Fig. 4 is a kind of front view of detection unit provided in an embodiment of the present invention, and Fig. 5 is the embodiment of the present invention A kind of vertical view of the detection unit provided.It please refers to Fig.4 or Fig. 5, detection unit 102 may include:First pressure sensor 1021 and second pressure sensor 1022.When detection unit and eyelid contact, first pressure sensor 1021 and second pressure Sensor 1022 is contacted with eyelid, and is arranged on the left-right rotation direction (directions x in such as Fig. 4) of eyeball, the first pressure Force snesor 1021 is more than target range at a distance from second pressure sensor 1022, which is anterior chamber in eyeball on a left side Length in right rotation direction.Control unit can according to the contact information of eyelid, and can when determining eyeball left-right rotation, Determine that the motion state of eyeball is left turn state or right turn state.At this point, the contact information of eyelid may include:First pressure passes The pressure that sensor and second pressure sensor are subject to.It should be noted that the embodiment of the present invention only includes with detection unit:First For two pressure sensors of pressure sensor and second pressure sensor, in practical application, detection unit can also include the Three pressure sensors, the third pressure sensor can be between first pressure sensor and second pressure sensors, this hair Bright embodiment does not limit this.
Exemplary, Fig. 6 shows a kind of structural schematic diagram of eyeball, as shown in fig. 6, the projection portion among eyeball 60 is For anterior chamber A.When Rotation of eyeball, the position of anterior chamber A can change, the other positions protrusion due to anterior chamber A relative to eyeball, The pressure that the eyelid position that then anterior chamber A is contacted is subject to can become larger.Incorporated by reference to Fig. 5 and Fig. 6, first pressure sensing 1021 and second Pressure sensor 1022 can be separately positioned on the both sides of anterior chamber A on the left-right rotation direction of eyeball, such as first pressure sensor 1021 are located at the left side of anterior chamber A, and second pressure sensor 1022 is located at the right side of anterior chamber A.
It is assumed that anterior chamber be arranged not in contact with pressure sensor position when, the pressure that pressure sensor is subject to is less than or waits In preset pressure threshold value.If the eyeball of user turns left, the pressure that first pressure sensor 1021 is subject to can be more than default Pressure threshold;If the eyeball of user turns right, the pressure that second pressure sensor 1022 is subject to can be more than preset pressure threshold Value.When control unit determines that only there are one the pressure that pressure sensor is subject in first pressure sensor and second pressure sensor When more than preset pressure threshold value, control unit can determine that eyeball has carried out left-right rotation.When control unit determines the only first pressure When the pressure that force snesor is subject to is more than preset pressure threshold value, control unit can determine that the motion state of eyeball is left-hand rotation shape State;When control unit determines that the pressure that only second pressure sensor is subject to is more than preset pressure threshold value, control unit can be true The motion state for determining eyeball is right turn state.
Optionally, first pressure sensor 1021 can be set with second pressure sensor 1022 according to thread connecting mode It is placed on curved surface mounting plate 104, so that the relative position of first pressure sensor 1021 and curved surface mounting plate 104, Yi Ji The relative position of two pressure sensors 1022 and curved surface mounting plate 104 can be adjusted.
It is exemplary, if the eyeball of user more protrudes, the opposite position of pressure sensor and curved surface mounting plate can be adjusted It sets, so that pressure sensor is moved to the direction far from user's face;Conversely, can then make pressure sensor to close to use The direction movement of the face at family.Referring to FIG. 5, since the concave surface of curved surface mounting plate is towards the face of user, and pressure sensor It is arranged as shown in Figure 5 on curved surface mounting plate, if pressure sensor is moved to the direction of the face close to user, first pressure Close to one end of user's face and the diminution at a distance from one end of user's face in second pressure sensor in sensor;If pressure Force snesor is moved to the direction of the face far from user, then close to one end and second of user's face in first pressure sensor Distance in pressure sensor close to one end of user's face increases.If the eyes of user are larger, it can make pressure sensing Device is moved to the direction far from user's face, conversely, pressure sensor can then be made to be transported to the direction of the face close to user It is dynamic.So, it even if the eye shape of different user is of different sizes, can also be installed by adjusting pressure sensor and curved surface The relative position of plate so that pressure sensor is in contact with the suitable position of user's eyelid.
Optionally, please continue to refer to Fig. 4 or Fig. 5, detection unit 102 can also include displacement sensor 1023, the displacement Sensor 1023 can be between first pressure sensor 1021 and second pressure sensor 1022.In detection unit and eyelid When contact, displacement sensor 1023 is contacted with the target location in eyelid, and displacement sensor 1023 exists for obtaining target location The displacement of eyeball rotated upwardly and downwardly on direction (directions y in such as Fig. 4).Control unit can be determined according to the contact information of eyelid Whether eyeball rotates upwardly and downwardly, and when determining that eyeball rotates upwardly and downwardly, and determines that the motion state of eyeball turns state or lower turn on being State.The contact information of eyelid can also include at this time:Displacement of the target location on rotating upwardly and downwardly direction.
Exemplary, please continue to refer to Fig. 4 or Fig. 5, which may include displacement sensor ontology (Fig. 4 and Fig. 5 In do not mark) idler wheel B, idler wheel B can contact with the target location in eyelid, the rotation direction of idler wheel be upper and lower directions (namely It is the directions y in Fig. 4).Rotating upwardly and downwardly eyelid and can also move up and down with eyeball, and drive idler wheel B along the side of movement of eyeball To rotation.Displacement sensor ontology can determine the displacement of target location, the position according to the rotation direction and rotational angle of idler wheel B Shifting includes direction of displacement and the distance that target location is moved in this direction, and control unit can obtain the displacement and target position Set the duration occurred needed for the displacement.Then, control unit can determine the shifting of the target location according to the displacement and the duration Dynamic speed, and judge whether the movement speed is less than pre-set velocity threshold value.If the movement speed is less than pre-set velocity threshold value, control Unit processed can determine whether eyeball rotates upwardly and downwardly according to the displacement.At this point, if the rotation direction of idler wheel B is downward, control Unit can determine that the motion state of eyeball turns state under being;If the rotation direction of idler wheel B is upward, control unit can be true The motion state for determining eyeball turns state on being.If the movement speed is more than pre-set velocity threshold value, control unit can determine use Family has carried out physiological blink.
It, can be according to the motion state and control wherein stored after control unit determines the target state of eyeball The default correspondence of instruction obtains the corresponding target control instruction of the target state, and is instructed according to the target control Control terminal.It is exemplary, with continued reference to FIG. 1, user is when by 20 read electronic documents of terminal, can by with terminal 20 Connection regards the electric document page-turning that shows of control device control terminal, and the default correspondence stored in control unit 101 can be with Including:Under turn state correspond to " control terminal show down one page electronic document " target control instruct.When the sight of user is along the side y To certain position being moved in the b of region from region a and stop moving down, then detection unit 102 can obtain the contact of eyelid Information (displacement that such as eyeball occurs).Control unit 101 if it is determined that eyeball occur the displacement speed be less than pre-set velocity threshold value, And determining that the motion state of eyeball turns state under being, then control unit 101 can preset correspondence acquisition according to this and " control eventually The target control instruction of the lower one page electronic document of end display ", and instruct control terminal to show down one page electricity according to the target control Subdocument.
Optionally, the default correspondence stored in the control unit can be by user's sets itself.User is passing through this Before control device control terminal, control unit can also calibrate the determination of the motion state of eyeball.As user can With first so that regarding control device detection unit contacted with the extrabulbar eyelid of user, then user can distinguish to the left, to the right, Upwardly or downwardly rotate eyeball;User can control the contact information that detection unit obtains eyelid in rotation eyeball every time, and The motion state of the secondary eyeball is inputted to control unit, and inputs the secondary eyeball fortune to control unit after physiological blink occurs It moves and blinks for physiological, so that the correspondence of control unit record eyelid contact information and eye movement state.Then, it uses The process of the rotation and input can be repeated several times in family, so that control unit can show that first pressure sensor corresponds to respectively Preset pressure threshold value, the corresponding preset pressure threshold value of second pressure sensor and pre-set velocity threshold value.
Optionally, displacement sensor 1023 can also be set on curved surface mounting plate 104 according to thread connecting mode, so that Obtaining displacement sensor 1023 and the relative position of curved surface mounting plate 104 can be adjusted.
In the related technology, the eyes image of user can be acquired by camera depending on control device, and to the image collected It is analyzed to determine the eye movement state of user;Then, control instruction, and then basis are obtained according to the eye movement state The control instruction control terminal.This depending on control device in the eye movement state for determining user, need sufficient light so that Image collection assembly can acquire image, therefore the limitation that should be used depending on control device is higher.
And in the embodiment of the present invention, detection unit is contacted with the extrabulbar eyelid of user, and not needing light can obtain The contact information of eyelid is taken, and determines the motion state of eyeball according to the contact information, and then is corresponding according to the motion state Facial control instruction control terminal.The control device provided in an embodiment of the present invention that regards is to light and no requirement (NR), therefore the present invention is implemented The limitation of example used depending on control device is relatively low.
When using the device provided in an embodiment of the present invention regarding control, the eyelid that can control detection unit and user connects user It touches, and first the default correspondence stored in control unit is adjusted or is calibrated;Then user can pass through mobile sight (that is to say rotation eyeball) depending on the terminal of control device connection to controlling.Control unit can be such as made to obtain the contact of eyelid The contact information of information, the eyelid includes:The pressure and displacement that first pressure sensor and second pressure sensor are subject to pass The displacement that rotates upwardly and downwardly direction on of the target location that sensor determines in eyeball;Then so that control unit is contacted according to eyelid Information determines the motion state of eyeball, and determines the corresponding target control of the motion state according to the default correspondence wherein stored System instruction, and then control terminal is instructed according to the target control.
It depending on control device include control unit and detection unit in conclusion provided in an embodiment of the present invention, and control unit It is connect simultaneously with detection unit and terminal, detection unit can obtain connecing for eyelid when being contacted with the eyelid outside user eyeball Touch information.Control unit can determine the motion state of eyeball according to the contact information, and being determined according to default correspondence should The corresponding target control instruction of motion state of eyeball, and control terminal is instructed according to the target control.It that is to say, detect Unit only needs to contact with the eyelid of user, and control unit can pass through the contact information realization for the eyelid that detection unit detects Control to terminal, it is thereby achieved that without just being controlled terminal by both hands.
Fig. 7 is a kind of control method flow chart of terminal provided in an embodiment of the present invention.This method can be used for Fig. 1, Fig. 2 Or Fig. 3 it is any shown in regard control device, as shown in fig. 7, this method includes:
When step 701, the eyelid outside detection unit and user eyeball contact, the contact of eyelid is obtained by detection unit Information.
Step 702, the motion state that eyeball is determined according to contact information.
Step 703 determines the corresponding target control instruction of the motion state of eyeball according to default correspondence.
Step 704 instructs control terminal according to target control.
In conclusion in the control method of terminal provided in an embodiment of the present invention, depending on control device can with user eyeball When outer eyelid contacts, the contact information of eyelid is obtained by detection unit, and can determine eyeball according to the contact information Motion state, and determine that the corresponding target control of the motion state of the eyeball instructs according to default correspondence, and according to institute State target control instruction control terminal.It that is to say, only need to contact with the eyelid of user depending on control device, so that it may to pass through detection unit Control of the contact information realization of the eyelid detected to terminal, it is thereby achieved that without just being controlled to terminal by both hands System.
Fig. 8 is the control method flow chart of another terminal provided in an embodiment of the present invention.This method can be used for Fig. 1, Control device is regarded shown in Fig. 2 or Fig. 3 is any, detection unit includes:First pressure sensor, second pressure sensor and displacement pass Sensor, as shown in figure 8, this method includes:
Step 801, when detection unit and eyelid contact, obtain first pressure sensor and second pressure sensor by Pressure, and by displacement sensor obtain target location eyeball the displacement rotated upwardly and downwardly on direction.Execute step 802.
First pressure sensor and second pressure sensor displacement sensor are contacted with eyelid, and are arranged in eyeball On left-right rotation direction, first pressure sensor is more than target range at a distance from second pressure sensor, and target range is eye Length of the anterior chamber on left-right rotation direction in ball.Displacement sensor is contacted with the target location in eyelid, and displacement sensor Between first pressure sensor and second pressure sensor.
Step 802, acquisition target location are subjected to displacement required duration.Execute step 803.
Step 803, the movement speed that target location is determined according to displacement and duration.Execute step 804.
Step 804 judges whether movement speed is less than pre-set velocity threshold value.If movement speed is less than pre-set velocity threshold value, Then follow the steps 805;If movement speed is greater than or equal to pre-set velocity threshold value, 801 are thened follow the steps.
Step 805, the pressure being subject to according to first pressure sensor and second pressure sensor and displacement, determine eyeball Motion state.Execute step 806.
Step 806 determines the corresponding target control instruction of the motion state of eyeball according to default correspondence.Execute step 807。
Step 807 instructs control terminal according to target control.
In conclusion in the control method of terminal provided in an embodiment of the present invention, depending on control device can with user eyeball When outer eyelid contacts, the contact information of eyelid is obtained by detection unit, and can determine eyeball according to the contact information Motion state, and determine that the corresponding target control of the motion state of the eyeball instructs according to default correspondence, and according to institute State target control instruction control terminal.It that is to say, only need to contact with the eyelid of user depending on control device, so that it may to pass through detection unit Control of the contact information realization of the eyelid detected to terminal, it is thereby achieved that without just being controlled to terminal by both hands System.
It should be noted that embodiment of the method provided in an embodiment of the present invention can mutually join with corresponding device embodiment It examines, it is not limited in the embodiment of the present invention.The sequencing of embodiment of the method step provided in an embodiment of the present invention can be into The appropriate adjustment of row, step also according to circumstances can accordingly be increased and decreased, and any one skilled in the art is in this Shen In the technical scope that please be disclosed, the method that can readily occur in variation should all cover within the protection domain of the application, therefore not It repeats again.
The foregoing is merely the alternative embodiments of the application, not to limit the application, it is all in spirit herein and Within principle, any modification, equivalent replacement, improvement and so on should be included within the protection domain of the application.

Claims (10)

1. one kind regarding control device, which is characterized in that described to include depending on control device:Control unit and detection unit, and the control Unit is all connected with the detection unit and terminal,
Be stored with the default correspondence of motion state and control instruction in described control unit, the detection unit can with When eyelid outside user eyeball contacts, the contact information of the eyelid is obtained;
Described control unit is used to determine the motion state of the eyeball according to the contact information, and according to the default correspondence Relationship determines the corresponding target control instruction of the motion state of the eyeball, and according to described in target control instruction control Terminal.
2. according to claim 1 regard control device, which is characterized in that the detection unit includes:First pressure sensor With second pressure sensor,
When the detection unit and the eyelid contact, the first pressure sensor and the second pressure sensor with The eyelid contact, and be arranged on the left-right rotation direction of the eyeball, the first pressure sensor and described second The distance of pressure sensor is more than target range, and the target range is anterior chamber in the eyeball on the left-right rotation direction Length;
The contact information of the eyelid includes:The pressure that the first pressure sensor and the second pressure sensor are subject to, Described in the pressure determination that described control unit is used to be subject to according to the first pressure sensor and the second pressure sensor Whether left-right rotation determines that the motion state of the eyeball is left-hand rotation shape and when determining the eyeball left-right rotation to eyeball State or right turn state.
3. according to claim 2 regard control device, which is characterized in that the detection unit further includes:Displacement sensor,
Institute's displacement sensors are single in the detection between the first pressure sensor and the second pressure sensor When the first and eyelid contacts, institute's displacement sensors are contacted with the target location in the eyelid, and institute's displacement sensors are used In obtaining the displacement rotated upwardly and downwardly on direction of the target location in the eyeball;
The contact information of the eyelid includes:In the displacement rotated upwardly and downwardly on direction, the control is single for the target location Member is used to determine whether the eyeball rotates upwardly and downwardly according to the displacement, and when determining that the eyeball rotates upwardly and downwardly, determines The motion state of the eyeball be on turn state or under turn state.
4. according to claim 3 regard control device, which is characterized in that described control unit is additionally operable to:
It obtains the target location and duration needed for the displacement occurs;
The movement speed of the target location is determined according to the displacement and the duration;
Judge whether the movement speed is less than pre-set velocity threshold value;
When the movement speed is less than the pre-set velocity threshold value, determine whether the eyeball turns up and down according to the displacement It is dynamic.
5. according to claim 3 or 4 regard control device, which is characterized in that described to further include depending on control device:Head hoop, curved surface Mounting plate and connecting bracket,
The head hoop can be worn on the head of the user, and the curved surface mounting plate is arranged by the connecting bracket described On head hoop, the detection unit is arranged on the curved surface mounting plate, described when the detection unit and the eyelid contact Face of the concave surface of curved surface mounting plate towards the user.
6. according to claim 5 regard control device, which is characterized in that
The relative position of the curved surface mounting plate and the head hoop can be adjusted, the first pressure sensor, second pressure The relative position of each sensor and the curved surface mounting plate can be adjusted in force snesor and institute's displacement sensors.
7. according to claim 5 regard control device, which is characterized in that the connecting bracket includes:Sequentially connected first Bar portion, the second bar portion and third bar portion,
First bar portion is connect with the head hoop, and the third bar portion is connect with the curved surface mounting plate, and first bar Portion is parallel to the third bar portion, and second bar portion is parallel to the left-right rotation direction.
8. according to claim 5 regard control device, which is characterized in that
The first pressure sensor, the second pressure sensor and institute's displacement sensors are set according to thread connecting mode It is placed on the curved surface mounting plate.
9. a kind of control method of terminal, which is characterized in that device is controlled for any described the regarding of claim 1 to 8, it is described to regard Controlling device includes:Control unit and detection unit, and described control unit is all connected with the detection unit and terminal, the control The default correspondence of motion state and control instruction is stored in unit processed, the method includes:
When eyelid outside the detection unit and user eyeball contacts, the contact of the eyelid is obtained by the detection unit Information;
The motion state of the eyeball is determined according to the contact information;
The corresponding target control instruction of the motion state of the eyeball is determined according to the default correspondence;
The terminal is controlled according to target control instruction.
10. according to the method described in claim 9, it is characterized in that, the detection unit includes:First pressure sensor and Two pressure sensors,
When the detection unit and the eyelid contact, the first pressure sensor and the second pressure sensor with The eyelid contact, and be arranged on the left-right rotation direction of the eyeball, the first pressure sensor and described second The distance of pressure sensor is more than target range, and the target range is anterior chamber in the eyeball on the left-right rotation direction Length;The contact information of the eyelid includes:The pressure that the first pressure sensor and the second pressure sensor are subject to Power,
The contact information that the eyelid is obtained by the detection unit includes:
Obtain the first pressure sensor and pressure that the second pressure sensor is subject to;
The pressure being subject to according to the first pressure sensor and the second pressure sensor determines whether the eyeball controls Rotation;
When determining the eyeball left-right rotation, determine that the motion state of the eyeball is left turn state or right turn state.
CN201810353398.5A 2018-04-19 2018-04-19 Video control device and method for controlling terminal by using video control device Active CN108459720B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810353398.5A CN108459720B (en) 2018-04-19 2018-04-19 Video control device and method for controlling terminal by using video control device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810353398.5A CN108459720B (en) 2018-04-19 2018-04-19 Video control device and method for controlling terminal by using video control device

Publications (2)

Publication Number Publication Date
CN108459720A true CN108459720A (en) 2018-08-28
CN108459720B CN108459720B (en) 2023-11-21

Family

ID=63235800

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810353398.5A Active CN108459720B (en) 2018-04-19 2018-04-19 Video control device and method for controlling terminal by using video control device

Country Status (1)

Country Link
CN (1) CN108459720B (en)

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11281324A (en) * 1998-03-30 1999-10-15 Isuzu Motors Ltd Measuring apparatus for line of sight
CN101898359A (en) * 2009-11-09 2010-12-01 沈阳工业大学 Humanoid robot eyes
CN103576340A (en) * 2012-08-03 2014-02-12 刘淼 Eyeglasses with mouse function
CN103699228A (en) * 2013-12-27 2014-04-02 深圳市金立通信设备有限公司 Blink control method and portable terminal
CN103780143A (en) * 2013-05-02 2014-05-07 国家纳米科学中心 Piezoelectric nanometer generator, eyeball moving monitor sensor and monitor method
CN104793741A (en) * 2015-04-03 2015-07-22 深圳市虚拟现实科技有限公司 Imaging system and method for guiding eyeballs to trace virtual reality
CN105138118A (en) * 2015-07-31 2015-12-09 努比亚技术有限公司 Intelligent glasses, method and mobile terminal for implementing human-computer interaction
CN105378598A (en) * 2013-07-19 2016-03-02 索尼公司 Detection device and method
CN105904459A (en) * 2016-05-19 2016-08-31 南京邮电大学 Robot control system based on eye electrical signal recognition and design method of system
CN106101786A (en) * 2016-06-15 2016-11-09 北京小米移动软件有限公司 The method and apparatus controlling target device
CN106537290A (en) * 2014-05-09 2017-03-22 谷歌公司 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
CN106569612A (en) * 2016-11-09 2017-04-19 宇龙计算机通信科技(深圳)有限公司 Method for protecting eyes, display device for protecting eyes and terminal
CN106610722A (en) * 2016-12-26 2017-05-03 宇龙计算机通信科技(深圳)有限公司 Terminal control method and system
CN106774924A (en) * 2016-12-30 2017-05-31 维沃移动通信有限公司 The data processing method and virtual reality terminal of a kind of virtual reality terminal
WO2017119659A1 (en) * 2016-01-04 2017-07-13 연세대학교 원주산학협력단 Portable nystagmus examination device
KR20170130989A (en) * 2016-05-20 2017-11-29 김현철 Eye ball mouse
CN107569208A (en) * 2017-08-25 2018-01-12 深圳市眼科医院 A kind of noninvasive eye socket pressure measuring device and measuring method

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11281324A (en) * 1998-03-30 1999-10-15 Isuzu Motors Ltd Measuring apparatus for line of sight
CN101898359A (en) * 2009-11-09 2010-12-01 沈阳工业大学 Humanoid robot eyes
CN103576340A (en) * 2012-08-03 2014-02-12 刘淼 Eyeglasses with mouse function
CN103780143A (en) * 2013-05-02 2014-05-07 国家纳米科学中心 Piezoelectric nanometer generator, eyeball moving monitor sensor and monitor method
CN105378598A (en) * 2013-07-19 2016-03-02 索尼公司 Detection device and method
CN103699228A (en) * 2013-12-27 2014-04-02 深圳市金立通信设备有限公司 Blink control method and portable terminal
CN106537290A (en) * 2014-05-09 2017-03-22 谷歌公司 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
CN104793741A (en) * 2015-04-03 2015-07-22 深圳市虚拟现实科技有限公司 Imaging system and method for guiding eyeballs to trace virtual reality
CN105138118A (en) * 2015-07-31 2015-12-09 努比亚技术有限公司 Intelligent glasses, method and mobile terminal for implementing human-computer interaction
WO2017119659A1 (en) * 2016-01-04 2017-07-13 연세대학교 원주산학협력단 Portable nystagmus examination device
CN105904459A (en) * 2016-05-19 2016-08-31 南京邮电大学 Robot control system based on eye electrical signal recognition and design method of system
KR20170130989A (en) * 2016-05-20 2017-11-29 김현철 Eye ball mouse
CN106101786A (en) * 2016-06-15 2016-11-09 北京小米移动软件有限公司 The method and apparatus controlling target device
CN106569612A (en) * 2016-11-09 2017-04-19 宇龙计算机通信科技(深圳)有限公司 Method for protecting eyes, display device for protecting eyes and terminal
CN106610722A (en) * 2016-12-26 2017-05-03 宇龙计算机通信科技(深圳)有限公司 Terminal control method and system
CN106774924A (en) * 2016-12-30 2017-05-31 维沃移动通信有限公司 The data processing method and virtual reality terminal of a kind of virtual reality terminal
CN107569208A (en) * 2017-08-25 2018-01-12 深圳市眼科医院 A kind of noninvasive eye socket pressure measuring device and measuring method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
FAEZEH FARIVAR; MOJTABA ROSTAMI KANDROODI; MAHDI ALIYARI SHOOREHDELI: "Intelligent Control of human prosthetic eye movements system for the emotional support by a huggable pet-type robot via Gaussian RBF neural network based on sliding mode control", 《THE 2ND INTERNATIONAL CONFERENCE ON CONTROL, INSTRUMENTATION AND AUTOMATION》 *
刘丽娟;李欣;: "眼控鼠标的研究", 现代电子技术, no. 24 *

Also Published As

Publication number Publication date
CN108459720B (en) 2023-11-21

Similar Documents

Publication Publication Date Title
ES2709051T3 (en) Control of a graphical user interface
CN103941991B (en) Information processing method and electronic equipment
US20200310541A1 (en) Systems and methods for control schemes based on neuromuscular data
EP3376888B1 (en) Apparel with pressure sensor control
CN108037821B (en) Wearable palm belt for gesture recognition
CN109690455A (en) Finger-worn type device with sensor and haptics member
CN104598019A (en) Screen operation apparatus and screen operation method
WO2015171559A1 (en) Enhanced user interface for a wearable electronic device
CN106817625A (en) Method, device and system for adjusting viewing angle of panoramic video and control terminal
WO2015011703A1 (en) Method and system for touchless activation of a device
CN104272218A (en) Virtual hand based on combined data
US20180063397A1 (en) Wearable device, control method and non-transitory storage medium
KR20140142778A (en) Method for correcting coordination of electronic pen and potable electronic device supporting the same
TW201427388A (en) Image interaction system, detecting method for detecting finger position, stereo display system and control method of stereo display
KR102110208B1 (en) Glasses type terminal and control method therefor
US9563258B2 (en) Switching method and electronic device
WO2012142869A1 (en) Method and apparatus for automatically adjusting terminal interface display
CN105867654A (en) Method for adjusting focal length of camera and terminal
CN106790935A (en) A kind of volume control method and system of curved sides screen mobile phone
WO2016064311A1 (en) Method and device for providing a touch-based user interface
TW201303675A (en) Optical navigation utilizing speed based algorithm selection
CN110140166A (en) For providing the system for exempting to manually enter to computer
JP5403522B2 (en) Control device, robot, control method, and program
US10444831B2 (en) User-input apparatus, method and program for user-input
CN108459720A (en) Depending on control device and the control method of terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant