CN109460706A - Eyeball tracking information processing method and device applied to terminal - Google Patents
Eyeball tracking information processing method and device applied to terminal Download PDFInfo
- Publication number
- CN109460706A CN109460706A CN201811163395.1A CN201811163395A CN109460706A CN 109460706 A CN109460706 A CN 109460706A CN 201811163395 A CN201811163395 A CN 201811163395A CN 109460706 A CN109460706 A CN 109460706A
- Authority
- CN
- China
- Prior art keywords
- functional module
- combination
- algorithm
- target
- eyeball tracking
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
- Eye Examination Apparatus (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a kind of eyeball tracking information processing methods and device applied to terminal.Wherein, this method comprises: obtaining scene information；The corresponding functional module combination of scene information is determined according to preset function module, and target algorithm combination corresponding to the functional module in functional module combination, wherein, include at least one functional module in functional module combination, include at least one target algorithm in target algorithm combination；It is combined according to functional module combination and target algorithm and determines target operational mode；Complete target operational mode switching.
Description
Technical field
The present invention relates to eyeball tracking technical fields, in particular to a kind of eyeball tracking information applied to terminal
Treating method and apparatus.
Background technique
Interactive mode of the eyeball tracking technology as innovation, it is more and more by big well known, in people work, study
Etc. be widely used.
Currently, eyeball tracking technology can be applicable in mobile device, for example, using eyeball tracking skill in mobile phone
Art.However, the usage scenario of usually mobile device is complicated, mobility is stronger, and the environmental change around mobile device is frequent, example
Such as, user's handheld mobile device moves towards outdoor from indoor.Accurately eyeball tracking is accessed as a result, it is desirable to which eyeball chases after in order to enabled
Track algorithm includes the algorithm of multiple application scenarios.
However, the eyeball tracking technology comprising different scenes algorithm makes the framework of eyeball tracking system more complicated, eye
The renewal speed of ball tracing algorithm is slack-off.Also, include different scenes algorithm eyeball tracking technology occupy resource it is more, account for
It is also more with the resource consumption of equipment, sacrifice other performances of mobile device.
Summary of the invention
The embodiment of the invention provides a kind of eyeball tracking information processing methods and device applied to terminal.
According to an aspect of an embodiment of the present invention, a kind of eyeball tracking information processing side applied to terminal is provided
Method, comprising: obtain scene information；The corresponding functional module combination of scene information and function are determined according to preset function module
The combination of target algorithm corresponding to functional module in block combiner, wherein include at least one function in functional module combination
Module, target algorithm combination in include at least one target algorithm；It is combined according to functional module combination and target algorithm and determines mesh
Mark operating mode；Complete target operational mode switching.
Further, completing operating mode switching includes: that control eyeball tracking equipment is switched to from current operating mode
Target operational mode, the functional module and target algorithm that current operating mode uses, the function of being used with target operational mode
It is at least partly different in module and target algorithm.
Further, applied to the eyeball tracking information processing method of terminal further include: determine parameter according to scene information
Information, wherein parameter information includes at least one of following: head cartridge range, frame per second, accuracy and precision, head cartridge range table
The range that sign target object head is moved, frame per second characterize the quantity of acquisition eyeball image in the unit time, and accuracy characterizes mesh
The deviation of the blinkpunkt position of object and the physical location of target object is marked, precision characterizes the dispersion degree of blinkpunkt position；
According to parameter information from preset function module determine functional module combination and the functional module combination in functional module institute
Corresponding target algorithm combination.
Further, applied to the eyeball tracking information processing method of terminal further include: include at least head in parameter information
In the case where box range, determine that functional module combination includes the first functional module, wherein the first functional module is for extracting eye
Feature；Judge whether eyeball tracking equipment is in moving condition；In the case where eyeball tracking equipment is in moving condition, obtain
Movement speed of the target object within the scope of head cartridge；Determine that the first functional module is corresponding from polyalgorithm according to movement speed
Target algorithm combination.
Further, applied to the eyeball tracking information processing method of terminal further include: be greater than default speed in movement speed
In the case where degree, determine that the corresponding target algorithm combination of the first functional module includes the first algorithm, wherein the first algorithm is used for
The eye feature of target object is obtained in full frame image；In the case where movement speed is less than or equal to pre-set velocity, first is determined
The corresponding target algorithm combination of functional module includes the second algorithm, wherein the second algorithm in eyes image for obtaining target
The eye feature of object.
Further, applied to the eyeball tracking information processing method of terminal further include: include at least standard in parameter information
In the case where exactness, determine that functional module combination includes the second functional module, wherein the second functional module is used to carry out pupil
Positioning；Obtain the distance between eyeball tracking equipment and the eye of target object；Distance and pre-determined distance are compared, obtains comparing knot
Fruit；Accuracy is determined according to comparison result；The corresponding target algorithm combination of the second functional module is determined according to accuracy.
Further, applied to the eyeball tracking information processing method of terminal further include: it is default accurate to be greater than in accuracy
In the case where degree, determine that the corresponding target algorithm combination of the second functional module includes third algorithm and the 4th algorithm, wherein third
Algorithm is used to carry out pupil coarse positioning, and the 4th algorithm is used to carry out fine positioning to pupil；It is less than or equal to default standard in accuracy
In the case where exactness, determine that the corresponding target algorithm combination of the second functional module includes third algorithm.
Further, applied to the eyeball tracking information processing method of terminal further include: include at least frame in parameter information
In the case where rate, determine that functional module combination includes third functional module, wherein third functional module is for determining acquisition eyeball
The frequency of image；Obtain the temperature information of eyeball tracking equipment；The system loss of eyeball tracking equipment is determined according to temperature information；
The frame per second of eyeball tracking equipment is determined according to the operating status of system loss and eyeball tracking equipment, wherein eyeball tracking is set
Standby operating status includes at least: front stage operation state, background operation state；Determine that third functional module is corresponding according to frame per second
Target algorithm combination.
Further, applied to the eyeball tracking information processing method of terminal further include: be greater than preset frame rate in frame per second
In the case of, determine that the corresponding target algorithm combination of third functional module includes the 5th algorithm, wherein the 5th algorithm is for reducing eye
The quantity of collected eyeball image in the ball tracing equipment unit time；In the case where frame per second is less than or equal to preset frame rate, really
Determining the corresponding target algorithm combination of third functional module includes the 6th algorithm, wherein the 6th algorithm is set for improving eyeball tracking
The quantity of collected eyeball image in the standby unit time.
According to another aspect of an embodiment of the present invention, a kind of eyeball tracking information processing side applied to terminal is additionally provided
Method, comprising: obtain environmental information；The corresponding functional module combination of environmental information and function are determined according to preset function module
The combination of target algorithm corresponding to functional module in block combiner, wherein include at least one function in functional module combination
Module, target algorithm combination in include at least one target algorithm；It is combined according to functional module combination and target algorithm and determines mesh
Mark operating mode；Complete target operational mode switching.
According to another aspect of an embodiment of the present invention, a kind of eyeball tracking information processing apparatus applied to terminal is additionally provided
It sets, comprising: module is obtained, for obtaining scene information；Selecting module, for determining scene information pair according to preset function module
Target algorithm combination corresponding to the functional module in functional module combination and functional module combination answered, wherein function mould
Include at least one functional module in block combination, includes at least one target algorithm in target algorithm combination；Determining module is used for
It is combined according to functional module combination and target algorithm and determines target operational mode；Switching module, for completing target operational mode
Switching.
According to another aspect of an embodiment of the present invention, a kind of storage medium is additionally provided, which includes storage
Program, wherein program executes the eyeball tracking information processing method for being applied to terminal.
According to another aspect of an embodiment of the present invention, a kind of processor is additionally provided, which is used to run program,
In, the eyeball tracking information processing method for being applied to terminal is executed when program is run.
In embodiments of the present invention, it by the way of according to different scenes automatic adaptation eyeball tracking technology, must show up
After scape information, determined in the corresponding functional module combination of scene information and functional module combination according to preset function module
Functional module corresponding to target algorithm combination, and according to functional module combination and target algorithm combine determine target operation mould
Then formula completes target operational mode switching.
In above process, after the scene information that scene locating for eyeball tracking equipment has been determined, further determine that with
The target algorithm that the scene information is most adapted to, i.e., different scene informations corresponds to different target algorithms, so that eyeball chases after
Track equipment uses the target algorithm being most adapted to the scene information of current scene to carry out the collected information of eyeball tracking equipment
Processing, and the algorithm not being adapted to the scene information of current scene is without processing, to reduce the money of eyeball tracking system
Source consumption.
Detailed description of the invention
The drawings described herein are used to provide a further understanding of the present invention, constitutes part of this application, this hair
Bright illustrative embodiments and their description are used to explain the present invention, and are not constituted improper limitations of the present invention.In the accompanying drawings:
Fig. 1 is a kind of flow chart of eyeball tracking information processing method applied to terminal according to an embodiment of the present invention；
Fig. 2 is a kind of structural representation of eyeball tracking information processing unit applied to terminal according to an embodiment of the present invention
Figure；And
Fig. 3 is a kind of flow chart of eyeball tracking information processing method applied to terminal according to an embodiment of the present invention.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention
Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
The model that the present invention protects all should belong in member's every other embodiment obtained without making creative work
It encloses.
It should be noted that description and claims of this specification and term " first " in above-mentioned attached drawing, "
Two " etc. be to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that using in this way
Data be interchangeable under appropriate circumstances, so as to the embodiment of the present invention described herein can in addition to illustrating herein or
Sequence other than those of description is implemented.In addition, term " includes " and " having " and their any deformation, it is intended that cover
Cover it is non-exclusive include, for example, the process, method, system, product or equipment for containing a series of steps or units are not necessarily limited to
Step or unit those of is clearly listed, but may include be not clearly listed or for these process, methods, product
Or other step or units that equipment is intrinsic.
Embodiment 1
According to embodiments of the present invention, a kind of eyeball tracking information processing method embodiment applied to terminal is provided, is needed
It is noted that step shown in the flowchart of the accompanying drawings can be in the computer system of such as a group of computer-executable instructions
Middle execution, although also, logical order is shown in flow charts, and it in some cases, can be to be different from herein
Sequence executes shown or described step.
Fig. 1 is the flow chart of the eyeball tracking information processing method according to an embodiment of the present invention applied to terminal, such as Fig. 1
Shown, this method comprises the following steps:
Step S102 obtains scene information.
It should be noted that eyeball tracking equipment is the mobile device with eyeball tracking function, wherein mobile device can
Think but be not limited to the equipment such as mobile phone, plate, intelligent glasses.In the present embodiment, mobile device has collector, the collector
The scene information of scene locating for eyeball tracking equipment can be acquired.
It should be noted that the scene information of eyeball tracking equipment includes the facility information and eyeball of eyeball tracking equipment
The environmental information of tracing equipment local environment, wherein the facility information of eyeball tracking equipment includes but is not limited to that eyeball tracking is set
Standby temperature, operating rate etc.；The environmental information of eyeball tracking equipment local environment includes but is not limited to eyeball tracking equipment
(for example, user is in the process of walking, the eye of user and the relative displacement of mobile device change moving condition, at this time really
Determine eyeball tracking equipment and be in moving condition), movement speed, eyeball tracking equipment and target object the distance between eye,
Eyeball tracking equipment local environment illumination brightness (for example, when user is from indoor moving to outdoor, mobile device local environment
Illumination brightness is changed), the application message of eyeball tracking equipment is (for example, user uses eyeball tracking when browsing webpage
The frequency of use of technology) etc..
Step S104 determines the corresponding functional module combination of scene information and functional module according to preset function module
The combination of target algorithm corresponding to functional module in combination, wherein it include at least one functional module in functional module combination,
It include at least one target algorithm in target algorithm combination.
It should be noted that the preset function module in eyeball tracking equipment includes multiple functional modules, multiple function moulds
At least one of block or the available functional module combination of multiple progress permutation and combination, for example, extracting the function of eye feature
Module, which can be combined to obtain a functional module with the functional module for positioning pupil, to be combined.In addition, the same function
Energy module may correspond to polyalgorithm, for example, the corresponding algorithm of the functional module positioned to pupil includes carrying out to pupil
The algorithm of fine positioning, and the algorithm of coarse positioning is carried out to pupil, polyalgorithm is combined available target algorithm combination.
Wherein, target algorithm is the algorithms most in use of scene locating for the eyeball tracking equipment applied to terminal, using target algorithm at this
To the available more accurate processing result of the collected information of eyeball tracking equipment under scape.
Optionally, user in the process of walking, the variation between the eye of user and the relative displacement of eyeball tracking equipment
Larger, under the scene, eyeball tracking equipment needs biggish head cartridge range and faster frame per second so that eyeball fixes point with
Track is more wide in range and frequent.
Optionally, when user is from indoor moving to outdoor, the illumination brightness of eyeball tracking equipment local environment is become
Change, wherein outdoor environment is bigger to the interference of eyeball tracking result, and relatively large deviation easily occurs for blinkpunkt accuracy.Under the scene,
The algorithm changeover of camera acquisition image information is the algorithm of infrared collecting image information by eyeball tracking equipment.
Optionally, user is when browsing webpage, using the moving up and down of eyeball tracking technical controlling webpage, jumps, but
Under the scene, the frequency of use of eyeball tracking is lower, and web page browsing needs the support of higher operational capability, in order not to rob
The resource of CPU or GPU are accounted for, eyeball tracking equipment reduces the execution frequency of eyeball tracking algorithm.
In addition it is also necessary to which explanation only runs functional module compatible with current scene and combines under a certain scene
In target algorithm corresponding to each functional module, while suspend mode processing is carried out to other algorithms, can achieve environment self-adaption
The purpose of eyeball tracking technology.
In addition, step S104 can optimize eyeball tracking algorithm, adaptively selected eyeball based on different scenes
Tracing algorithm, or the major parameter in eyeball tracking algorithm is adjusted, the resource for having reached reduction eyeball tracking system disappears
The purpose of consumption.
Step S106 is combined according to functional module combination and target algorithm and is determined target operational mode.
It should be noted that target operational mode be based on functional module combine, using target algorithm combine in target
The mode that algorithm handles eyeball tracking equipment acquired image.Since different scenes may correspond to different functions
Block combiner and target algorithm combination, therefore, corresponding target operational mode may also be different under different scenes, example
Such as, user is when browsing webpage, using the moving up and down of eyeball tracking technical controlling webpage, jumps, but under the scene, eye
The target operational mode of ball tracing equipment is to run eyeball tracking algorithm with lower execution frequency.
Step S108 completes target operational mode switching, wherein completing operating mode switching includes: control eyeball tracking
Equipment switches to target operational mode from current operating mode, and the functional module and target that current operating mode uses are calculated
It is at least partly different in method, with the functional module and target algorithm of target operational mode use.
In a kind of optional scheme, when user indoors when, eyeball tracking equipment using the first operating mode to user
Eyes image handled.When user is from indoor moving to outdoor, the illumination brightness hair of eyeball tracking equipment local environment
Variation is given birth to, at this point, obtaining the blinkpunkt of user if still handled using the first operating mode the eyes image of user
Information may inaccuracy.In addition, blinkpunkt accuracy easily occurs larger since interference of the outdoor environment to eyeball tracking result is bigger
Deviation, therefore, under the scene, the operating mode of eyeball tracking equipment is switched to by the first operating mode suitable for outdoor second
Operating mode, to obtain the blinkpunkt information of more accurate user.
Based on scheme defined by above-mentioned steps S102 to step S108, it can know, using automatic according to different scenes
The mode of adaptation eyeball tracking technology determines that scene information is corresponding according to preset function module after obtaining scene information
Target algorithm combination corresponding to functional module in functional module combination and functional module combination, and according to functional module
Combination and target algorithm, which combine, determines target operational mode, finally, completing target operational mode switching, wherein functional module group
Include at least one functional module in conjunction, includes at least one target algorithm in target algorithm combination.
It is easily noted that, after the scene information that scene locating for eyeball tracking equipment has been determined, further determines that
The target algorithm being most adapted to the scene information, i.e., different scene informations corresponds to different target algorithms, so that eyeball
Tracing equipment use the target algorithm that is most adapted to the scene information of current scene to the collected information of eyeball tracking equipment into
Row processing, and the algorithm not being adapted to the scene information of current scene reduces the resource of eyeball tracking system without processing
Consumption.
In a kind of optional scheme, determine that the corresponding functional module of scene information combines according to preset function module, with
And target algorithm combination corresponding to the functional module in functional module combination may include steps of:
Step S1020 determines parameter information according to scene information；
Step S1022 determines functional module combination and the functional module according to parameter information from preset function module
The combination of target algorithm corresponding to functional module in combination.
It should be noted that parameter information is including at least one of following: head cartridge range, frame per second, accuracy and precision.
Wherein, the range that head cartridge range characterization target object head is moved, including be moved forward and backward range and move left and right range；Frame
Rate characterizes the quantity of acquisition eyeball image in the unit time, for example, frame per second is that 30Hz indicates 30 frame images of acquisition per second；Accuracy
Characterize the deviation of the blinkpunkt position of target object and the physical location of target object；Precision characterizes the discrete of blinkpunkt position
Degree, for example, using the root mean square of continuous sample as precision.
In a kind of optional scheme, functional module combination is determined from preset function module according to parameter information and is somebody's turn to do
Target algorithm corresponding to functional module in functional module combination combines, and may include:
Step S20 determines that functional module combination includes the first function in the case where parameter information includes at least head cartridge range
Energy module, wherein the first functional module is for extracting eye feature；
Step S22, judges whether eyeball tracking equipment is in moving condition；
Step S24 obtains target object within the scope of head cartridge in the case where eyeball tracking equipment is in moving condition
Movement speed；
Step S26 determines that the corresponding target algorithm of the first functional module combines according to movement speed.
Optionally, in the case where movement speed is greater than pre-set velocity, the corresponding target algorithm of the first functional module is determined
Combination includes the first algorithm, wherein the first algorithm in full frame image for obtaining the eye feature of target object；In mobile speed
In the case that degree is less than or equal to pre-set velocity, determine that the corresponding target algorithm combination of the first functional module includes the second algorithm,
In, the second algorithm in eyes image for obtaining the eye feature of target object.
It should be noted that the head cartridge range of eyeball tracking equipment is determined by hardware camera and camera lens, wherein for
For eyeball tracking equipment, head cartridge range is definite value.In general, in the case where obtaining the blinkpunkt information of target object, eyeball
Tracing algorithm think the position of user and eyeball tracking equipment be it is relatively-stationary, at this time, it is only necessary to be adopted in eyeball tracking equipment
Eye feature is captured in ocular in the image of collection, i.e., the eye feature of target object is obtained using track algorithm.However,
When moving distance of the user within the scope of head cartridge is larger, and has been more than the default zone of eyeball tracking algorithm, eyeball tracking is calculated
Method needs to search ocular (eye feature of target object is obtained using the first algorithm) again in full frame image, causes
Total algorithm is time-consuming, and needs constantly two kinds of lookup algorithms of switching.In addition, if default is using the first algorithm in full width figure
Ocular is searched as in, then since the first algorithm takes a long time and it is more to consume memory source, leads to the wasting of resources.
Specifically, having the units such as gravity sensor, acceleration transducer, gyroscope in eyeball tracking equipment.Eyeball chases after
Track equipment obtains the number such as the collected acceleration value of units, the rotational angles such as gravity sensor, acceleration transducer, gyroscope
According to, and the data such as acceleration value, rotational angle determine whether eyeball tracking equipment is in moving condition.For example, in acceleration
In the case that value is greater than predetermined angle greater than predetermined acceleration value and/or rotational angle, determine that eyeball tracking equipment is in movement
State.In the case where eyeball tracking equipment is in moving condition, the further detected target object of eyeball tracking equipment is in head cartridge
Movement speed in range.Wherein, in the case where movement speed is greater than pre-set velocity, eyeball tracking equipment uses the first algorithm
Obtain the eye feature of target object；In the case where movement speed is less than or equal to pre-set velocity, eyeball tracking equipment is using the
The eye feature of two algorithms acquisition target object.
In a kind of optional scheme, functional module combination is determined from preset function module according to parameter information and is somebody's turn to do
Target algorithm corresponding to functional module in functional module combination combines, and may include:
Step S30 determines that functional module combination includes the second function in the case where parameter information includes at least accuracy
Module, wherein the second functional module is for positioning pupil；
Step S32 obtains the distance between eyeball tracking equipment and the eye of target object；
Step S34 compares distance and pre-determined distance, obtains comparison result；
Step S36 determines accuracy according to comparison result；
Step S38 determines that the corresponding target algorithm of the second functional module combines according to accuracy.
Optionally, in the case where accuracy is greater than default accuracy, the corresponding target algorithm of the second functional module is determined
Combination includes third algorithm and the 4th algorithm；In the case where accuracy is less than or equal to default accuracy, the second function mould is determined
The corresponding target algorithm combination of block includes third algorithm.Wherein, third algorithm is used to carry out pupil coarse positioning, and the 4th algorithm is used
In to pupil progress fine positioning.
It should be noted that the accuracy of blinkpunkt is one of the key index of eyeball tracking technology, different eyeballs is chased after
Track equipment can meet the needs of accuracy using different eyeball tracking algorithms.Optionally, in the eye for obtaining target object
After portion's feature, eyeball tracking equipment can carry out Pupil diameter twice, once be pupil coarse positioning, once be pupil fine positioning.
Wherein, Pupil diameter can be serial twice, can also only select coarse positioning.The two the difference is that the accuracy of blinkpunkt exists
Difference, while also not identical, whole operation time is not also identical for consumption of both modes to system resource.Therefore, can lead to
It crosses selection algorithm corresponding with current scene to position pupil, to avoid the waste of system resource.
Optionally, eyeball can voluntarily be selected by eyeball tracking equipment by way of the manually writing of eyeball tracking equipment
The accuracy of tracing algorithm.
Optionally, eyeball tracking equipment can also switch the accuracy of blinkpunkt by judging environment influence.Specifically, eye
Installation can detect between eyeball tracking equipment and the eye of target object by range sensor, range sensor on ball tracing equipment
Distance.Eyeball tracking equipment is big according to the distance between eye of eyeball tracking equipment and target object and pre-determined distance
It is small, to determine the accuracy of blinkpunkt.In the case where accuracy is greater than default accuracy, eyeball tracking equipment is used to pupil
The first algorithm for carrying out coarse positioning positions pupil with the mode that the second algorithm for carrying out fine positioning to pupil combines；?
In the case that accuracy is less than or equal to default accuracy, eyeball tracking equipment positions pupil using the second algorithm.
It should be noted that the accuracy of blinkpunkt is measured with a certain apart from upper misalignment angle, in misalignment angle one
In the case where fixed, the distance between eye of eyeball tracking equipment and target object is closer, then the distance of deviation is smaller.Therefore,
In the case where being less than a certain threshold value at a distance between eye of the eyeball tracking equipment with target object, eyeball tracking equipment is increased
Misalignment angle, at this point, the distance of deviation does not exceed distance threshold.
In a kind of optional scheme, functional module combination is determined from preset function module according to parameter information and is somebody's turn to do
Target algorithm corresponding to functional module in functional module combination combines, and may include:
Step S40 determines that functional module combination includes third function mould in the case where parameter information includes at least frame per second
Block, wherein third functional module is for determining the frequency of acquisition eyeball image；
Step S42 obtains the temperature information of eyeball tracking equipment；
Step S44 determines the system loss of eyeball tracking equipment according to temperature information；
Step S46 determines the frame per second of eyeball tracking equipment according to the operating status of system loss and eyeball tracking equipment,
Wherein, the operating status of eyeball tracking equipment includes at least: front stage operation state, background operation state；
Step S48 determines that the corresponding target algorithm of third functional module combines according to frame per second.Optionally, it is greater than in frame per second
In the case where preset frame rate, determine that the corresponding target algorithm combination of third functional module includes the 5th algorithm, wherein the 5th algorithm
For reducing the quantity of collected eyeball image in the eyeball tracking equipment unit time；It is less than or equal to preset frame rate in frame per second
In the case of, the corresponding target algorithm combination of third functional module includes the 6th algorithm, wherein the 6th algorithm is chased after for improving eyeball
The quantity of collected eyeball image in the track equipment unit time.
It should be noted that do not need it is quick, more watch point data attentively in the case where, can suitably reduce frame per second,
To reduce data volume to be treated and system energy consumption, system resource is saved.It therefore, can be corresponding with current scene by selecting
Frame per second, to avoid the waste of system resource.
Specifically, temperature sensor is equipped in eyeball tracking equipment, to detect the complete machine temperature of eyeball tracking equipment.Eye
Ball tracing equipment judges system loss according to the variation of temperature after determining complete machine temperature.Further, eyeball tracking equipment
Frame is determined according to the operating status (front stage operation state or background operation state) of system loss and eyeball tracking equipment
Rate, and then determined according to frame per second using the 5th algorithm for dropping frame, or eye is carried out using the 6th algorithm for rising frame
Ball tracking.Wherein, in the case where frame per second is greater than preset frame rate, eyeball tracking equipment carries out eyeball tracking using the 5th algorithm；
In the case where frame per second is less than or equal to preset frame rate, eyeball tracking equipment carries out eyeball tracking using the 6th algorithm.
It should be noted that as shown in the above, scheme provided herein is directed to different scenes, automatic adaptation eye
Ball tracing algorithm, can be according to the computing capability of eyeball tracking equipment, precision and environmental information etc. come to corresponding function
The algorithm of module is selected, to form Self-adapted System.If in addition, since eyeball tracking technology being divided into this application
Dry functional module, each functional module are triggered according to different scene modes, are worked.The independent dimension of each functional module
Protection mechanism forms adaptive solution in the way of function splicing and improves no matter in remote upgrade or independent maintenance
The flexibility of system.
Embodiment 2
According to embodiments of the present invention, a kind of eyeball tracking information processing method embodiment applied to terminal is additionally provided,
Wherein, Fig. 3 is the flow chart of the eyeball tracking information processing method according to an embodiment of the present invention applied to terminal, such as Fig. 3 institute
Show, this method comprises the following steps:
Step S302 obtains environmental information.
It should be noted that eyeball tracking equipment is the mobile device with eyeball tracking function, wherein mobile device can
Think but be not limited to the equipment such as mobile phone, plate, intelligent glasses.In the present embodiment, mobile device has collector, the collector
The environmental information of eyeball tracking equipment local environment can be acquired, for example, temperature, humidity, light intensity etc..
Step S304 determines the corresponding functional module combination of environmental information and functional module according to preset function module
The combination of target algorithm corresponding to functional module in combination, wherein it include at least one functional module in functional module combination,
It include at least one target algorithm in target algorithm combination.
It should be noted that the preset function module in eyeball tracking equipment includes multiple functional modules, multiple function moulds
The available functional module combination of any one or more carry out permutation and combination in block, for example, extracting the function of eye feature
Module, which can be combined to obtain a functional module with the functional module for positioning pupil, to be combined.In addition, the same function
Energy module may correspond to polyalgorithm, for example, the corresponding algorithm of the functional module positioned to pupil includes carrying out to pupil
The algorithm of fine positioning, and the algorithm of coarse positioning is carried out to pupil, polyalgorithm is combined available target algorithm combination.
Wherein, target algorithm is the algorithms most in use of the eyeball tracking equipment local environment applied to terminal, using target algorithm in the ring
To the available more accurate processing result of the collected information of eyeball tracking equipment under border.
Optionally, when user is from indoor moving to outdoor, the illumination brightness of eyeball tracking equipment local environment is become
Change, wherein outdoor environment is bigger to the interference of eyeball tracking result, and relatively large deviation easily occurs for blinkpunkt accuracy.Therefore, at this
Under scape, eyeball tracking equipment can start acquisition functional module, and will acquire in functional module based on camera acquisition image information
First gathering algorithm is switched to the second gathering algorithm based on infrared collecting image information, that is, will be believed based on infrared collecting image
Second gathering algorithm of breath is as target algorithm.
Step S306 is combined according to functional module combination and target algorithm and is determined target operational mode.
It should be noted that target operational mode be based on functional module combine, using target algorithm combine in target
The mode that algorithm handles eyeball tracking equipment acquired image.Since different environment may correspond to different functions
Block combiner and target algorithm combination, therefore, corresponding target operational mode may also be different in different environments.
Step S308 completes target operational mode switching, wherein completing operating mode switching includes: control eyeball tracking
Equipment switches to target operational mode from current operating mode, and the functional module and target that current operating mode uses are calculated
It is at least partly different in method, with the functional module and target algorithm of target operational mode use.
In a kind of optional scheme, when user indoors when, eyeball tracking equipment using the first operating mode to user
Eyes image handled.When user is from indoor moving to outdoor, the illumination brightness hair of eyeball tracking equipment local environment
Variation is given birth to, at this point, obtaining the blinkpunkt of user if still handled using the first operating mode the eyes image of user
Information may inaccuracy.In addition, blinkpunkt accuracy easily occurs larger since interference of the outdoor environment to eyeball tracking result is bigger
Deviation, therefore, under the scene, the operating mode of eyeball tracking equipment is switched to by the first operating mode suitable for outdoor second
Operating mode, to obtain the blinkpunkt information of more accurate user.
Based on scheme defined by above-mentioned steps S302 to step S308, it can know, using automatic according to varying environment
It is adapted to the mode of eyeball tracking technology, after the environmental information for obtaining eyeball tracking equipment, from pre- in eyeball tracking equipment
If selected in functional module corresponding with environmental information functional module combine and the functional module combine in functional module institute
Corresponding target algorithm combination, and combined according to functional module combination and target algorithm and determine target operational mode, finally, control
Eyeball tracking equipment is switched to target operational mode from current operating mode, wherein the function that current operating mode uses
It is at least partly different in module and target algorithm, with the functional module and target algorithm of target operational mode use.
It is easily noted that, after the environmental information that eyeball tracking equipment local environment has been determined, further determines that
The target algorithm being most adapted to the environmental information, i.e., different environmental informations corresponds to different target algorithms, so that eyeball
Tracing equipment use the target algorithm that is most adapted to the environmental information of current environment to the collected information of eyeball tracking equipment into
Row processing, and the algorithm not being adapted to the environmental information of current environment is without processing, to reduce eyeball tracking system
Resource consumption.
In a kind of optional scheme, according to selection functional module group corresponding with environmental information in preset function module
Target algorithm combination corresponding to functional module in conjunction and functional module combination may include steps of:
Step S2020 determines parameter information according to environmental information；
Step S2022 determines functional module combination and the functional module according to parameter information from preset function module
The combination of target algorithm corresponding to functional module in combination.
It should be noted that parameter information is including at least one of following: head cartridge range, frame per second, accuracy and precision.
Wherein, the range that head cartridge range characterization target object head is moved, including be moved forward and backward range and move left and right range；Frame
Rate characterizes the quantity of acquisition eyeball image in the unit time, for example, frame per second is that 30Hz indicates 30 frame images of acquisition per second；Accuracy
Characterize the deviation of the blinkpunkt position of target object and the physical location of target object；Precision characterizes the discrete of blinkpunkt position
Degree, for example, using the root mean square of continuous sample as precision.
It should be noted that determining the function mould in functional module combination and functional module combination according to parameter information
The combination of target algorithm corresponding to block, and according to functional module combine in each functional module corresponding target algorithm eyeball is chased after
Track equipment the process that is handled of collected information, identical as content provided by embodiment 1, details are not described herein.
Embodiment 3
According to embodiments of the present invention, a kind of eyeball tracking information processing unit embodiment applied to terminal is additionally provided,
It should be noted that the eyeball tracking information processing method for being applied to terminal provided by embodiment 1 can be performed in the device.Its
In, Fig. 2 is the structural schematic diagram of the eyeball tracking information processing unit according to an embodiment of the present invention applied to terminal, such as Fig. 2
Shown, which includes: to obtain module 201, selecting module 203, determining module 205 and switching module 207.
Wherein, module 201 is obtained, for obtaining scene information；Selecting module 203, for according in preset function module
Select corresponding with scene information functional module combine and functional module combine in functional module corresponding to target algorithm
Combination, wherein include at least one functional module in functional module combination, include that at least one target is calculated in target algorithm combination
Method；Determining module 205 determines target operational mode for combining according to functional module combination and target algorithm；Switching module
207, for completing target operational mode switching, wherein completing operating mode switching includes: control eyeball tracking equipment from current
Operating mode switch to target operational mode, the functional module and target algorithm that current operating mode uses, with target work
It is at least partly different in the functional module and target algorithm that operation mode uses.
It should be noted that above-mentioned acquisition module 201, selecting module 203, determining module 205 and switching module 207 are right
Should be in the step S102 to step S108 in embodiment 1, example and application scenarios that four modules and corresponding step are realized
It is identical, but it is not limited to the above embodiments 1 disclosure of that.
In a kind of optional scheme, determining module includes: the first determining module and the second determining module.Wherein,
One determining module, for determining parameter information according to scene information, wherein parameter information includes at least one of following: head cartridge model
It encloses, frame per second, accuracy and precision, the range that head cartridge range characterization target object head is moved, when frame per second characterizes unit
It is interior acquisition eyeball image quantity, accuracy characterize target object blinkpunkt position and target object physical location it is inclined
Difference, precision characterize the dispersion degree of blinkpunkt position；Second determining module, for determining functional module group according to parameter information
Target algorithm combination corresponding to functional module in conjunction and functional module combination.
It should be noted that above-mentioned first determining module and the second determining module correspond to the step in embodiment 1
S1020 to step S1022, two modules are identical as example and application scenarios that corresponding step is realized, but are not limited to above-mentioned
1 disclosure of that of embodiment.
In a kind of optional scheme, the second determining module includes: third determining module, judgment module, the first acquisition mould
Block and the 4th determining module.Wherein, third determining module is used in the case where parameter information includes at least head cartridge range,
Determine that functional module combination includes the first functional module, wherein the first functional module is for extracting eye feature；Judgment module,
For judging whether eyeball tracking equipment is in moving condition；First obtains module, for being in movement in eyeball tracking equipment
In the case where state, movement speed of the target object within the scope of head cartridge is obtained；4th determining module, for according to movement speed
Determine the corresponding target algorithm combination of the first functional module.
It should be noted that above-mentioned third determining module, judgment module, the first acquisition module and the 4th determining module pair
The example and application scenarios phase that should be realized in the step S20 to step S26 in embodiment 1, four modules with corresponding step
Together, but it is not limited to the above embodiments 1 disclosure of that.
In a kind of optional scheme, the 4th determining module includes: the 5th determining module and the 6th determining module.Its
In, the 5th determining module, for determining the corresponding target of the first functional module in the case where movement speed is greater than pre-set velocity
Algorithm combination includes the first algorithm, wherein the first algorithm in full frame image for obtaining the eye feature of target object；6th
Determining module is used in the case where movement speed is less than or equal to pre-set velocity, the corresponding target algorithm group of the first functional module
Closing includes the second algorithm, wherein the second algorithm in eyes image for obtaining the eye feature of target object.
In a kind of optional scheme, the second determining module includes: the 7th determining module, the second acquisition module, compares mould
Block, the 8th determining module and the 9th determining module.Wherein, the 7th determining module, it is accurate for being included at least in parameter information
In the case where degree, determine that functional module combination includes the second functional module, wherein the second functional module is for determining pupil
Position；Second obtains module, for obtaining the distance between the eye of eyeball tracking equipment and target object；Comparison module is used for
Distance and pre-determined distance are compared, comparison result is obtained；8th determining module, for determining accuracy according to comparison result；9th
Determining module, for determining that the corresponding target algorithm of the second functional module combines according to accuracy.
It should be noted that above-mentioned 7th determining module, second obtain module, comparison module, the 8th determining module and
9th determining module corresponds to the step S30 to step S38 in embodiment 1, and five modules are shown with what corresponding step was realized
Example is identical with application scenarios, but is not limited to the above embodiments 1 disclosure of that.
In a kind of optional scheme, the 9th determining module includes: the tenth determining module and the 11st determining module.Its
In, the tenth determining module, for determining the corresponding target of the second functional module in the case where accuracy is greater than default accuracy
Algorithm combination includes third algorithm and the 4th algorithm, wherein third algorithm is used to carry out coarse positioning to pupil, and the 4th algorithm is used for
Fine positioning is carried out to pupil；11st determining module, in the case where accuracy is less than or equal to default accuracy, determining the
The corresponding target algorithm combination of two functional modules includes third algorithm.
In a kind of optional scheme, the second determining module includes: the 12nd determining module, third acquisition module, the tenth
Three determining modules, the 14th determining module and the 15th determining module.Wherein, the 12nd determining module, for believing in parameter
In the case that breath includes at least frame per second, determine that functional module combination includes third functional module, wherein third functional module is used for
Determine the frequency of acquisition eyeball image；Third obtains module, for obtaining the temperature information of eyeball tracking equipment；13rd determines
Module, for determining the system loss of eyeball tracking equipment according to temperature information；14th determining module, for being damaged according to system
The operating status of consumption and eyeball tracking equipment determines the frame per second of eyeball tracking equipment, wherein the operation shape of eyeball tracking equipment
State includes at least: front stage operation state, background operation state；15th determining module, for determining third function according to frame per second
The corresponding target algorithm combination of module.
It should be noted that above-mentioned 12nd determining module, third obtain module, the 13rd determining module, the 14th really
Cover half block and the 15th determining module correspond to the step S40 to step S48 in embodiment 1, five modules and corresponding step
Suddenly the example realized is identical with application scenarios, but is not limited to the above embodiments 1 disclosure of that.
In a kind of optional scheme, the 15th determining module includes: that the 16th determining module and the 17th determine mould
Block.Wherein, the 16th determining module, for determining that third functional module is corresponding in the case where frame per second is greater than preset frame rate
Target algorithm combination includes the 5th algorithm, wherein the 5th algorithm is for reducing collected in the eyeball tracking equipment unit time
The quantity of eyeball image；17th determining module, for determining third function in the case where frame per second is less than or equal to preset frame rate
The corresponding target algorithm combination of module includes the 6th algorithm, wherein the 6th algorithm is for improving the eyeball tracking equipment unit time
The quantity of interior collected eyeball image.
Embodiment 4
According to another aspect of an embodiment of the present invention, a kind of storage medium is additionally provided, which includes storage
Program, wherein program executes the eyeball tracking information processing method for being applied to terminal provided by embodiment 1.
Embodiment 5
According to another aspect of an embodiment of the present invention, a kind of processor is additionally provided, which is used to run program,
In, the eyeball tracking information processing method for being applied to terminal provided by embodiment 1 is executed when program is run.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
In the above embodiment of the invention, it all emphasizes particularly on different fields to the description of each embodiment, does not have in some embodiment
The part of detailed description, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed technology contents can pass through others
Mode is realized.Wherein, the apparatus embodiments described above are merely exemplary, such as the division of the unit, Ke Yiwei
A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or
Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of unit or module
It connects, can be electrical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
On unit.It can some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can for personal computer, server or network equipment etc.) execute each embodiment the method for the present invention whole or
Part steps.And storage medium above-mentioned includes: that USB flash disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), mobile hard disk, magnetic or disk etc. be various to can store program code
Medium.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered
It is considered as protection scope of the present invention.
Claims (13)
1. a kind of eyeball tracking information processing method applied to terminal characterized by comprising
Obtain scene information；
It is determined in the corresponding functional module combination of the scene information and functional module combination according to preset function module
Functional module corresponding to target algorithm combination, wherein include at least one functional module, institute in functional module combination
Stating in target algorithm combination includes at least one target algorithm；
It is combined according to functional module combination and the target algorithm and determines target operational mode；
Complete the target operational mode switching.
2. the method according to claim 1, wherein completing the operating mode switching includes: that control eyeball chases after
Track equipment switches to the target operational mode, the functional module that the current operating mode uses from current operating mode
And it is at least partly different in target algorithm, with the functional module and target algorithm of target operational mode use.
3. the method according to claim 1, wherein determining that the scene information is corresponding according to preset function module
Functional module combination and the functional module combination in functional module corresponding to target algorithm combination, comprising:
Parameter information is determined according to the scene information, wherein the parameter information includes at least one of following: head cartridge range,
Frame per second, accuracy and precision, the range that head cartridge range characterization target object head is moved, the frame per second characterization are single
Position the time in acquisition eyeball image quantity, the accuracy characterize the target object blinkpunkt position and the target pair
The deviation of the physical location of elephant, the precision characterize the dispersion degree of the blinkpunkt position；
The functional module combination and the functional module group are determined from the preset function module according to the parameter information
The combination of target algorithm corresponding to functional module in conjunction.
4. according to the method described in claim 3, it is characterized in that, according to the parameter information from the preset function module
Determine target algorithm combination corresponding to the functional module in the functional module combination and functional module combination, comprising:
In the case where the parameter information includes at least the head cartridge range, determine that the functional module combination includes the first function
Energy module, wherein first functional module is for extracting eye feature；
Judge whether eyeball tracking equipment is in moving condition；
In the case where the eyeball tracking equipment is in the moving condition, the target object is obtained in the head cartridge range
Interior movement speed；
The corresponding target algorithm combination of first functional module is determined according to the movement speed.
5. according to the method described in claim 4, it is characterized in that, determining first functional module according to the movement speed
Corresponding target algorithm combination, comprising:
In the case where the movement speed is greater than pre-set velocity, the corresponding target algorithm combination of first functional module is determined
Including the first algorithm, wherein first algorithm is used to obtain the eye feature of the target object in full frame image；
In the case where the movement speed is less than or equal to the pre-set velocity, the corresponding target of first functional module is determined
Algorithm combination includes the second algorithm, wherein second algorithm is used to obtain the eye of the target object in eyes image
Feature.
6. according to the method described in claim 3, it is characterized in that, according to the parameter information from the preset function module
Determine target algorithm combination corresponding to the functional module in the functional module combination and functional module combination, comprising:
In the case where the parameter information includes at least the accuracy, determine that the functional module combination includes the second function
Module, wherein second functional module is for positioning pupil；
Obtain the distance between the eye of eyeball tracking equipment and the target object；
The distance and pre-determined distance are compared, comparison result is obtained；
The accuracy is determined according to the comparison result；
The corresponding target algorithm combination of second functional module is determined according to the accuracy.
7. according to the method described in claim 6, it is characterized in that, determining second functional module pair according to the accuracy
The target algorithm combination answered, comprising:
In the case where the accuracy is greater than default accuracy, the corresponding target algorithm combination of second functional module is determined
Including third algorithm and the 4th algorithm, wherein the third algorithm is used to carry out coarse positioning, the 4th algorithm to the pupil
For carrying out fine positioning to the pupil；
In the case where the accuracy is less than or equal to the default accuracy, the corresponding target of second functional module is determined
Algorithm combination includes the third algorithm.
8. according to the method described in claim 3, it is characterized in that, according to the parameter information from the preset function module
Determine target algorithm combination corresponding to the functional module in the functional module combination and functional module combination, comprising:
In the case where the parameter information includes at least the frame per second, determine that the functional module combination includes third function mould
Block, wherein the third functional module is for determining the frequency of acquisition eyeball image；
Obtain the temperature information of eyeball tracking equipment；
The system loss of the eyeball tracking equipment is determined according to the temperature information；
The frame per second of the eyeball tracking equipment is determined according to the operating status of the system loss and the eyeball tracking equipment,
Wherein, the operating status of the eyeball tracking equipment includes at least: front stage operation state, background operation state；
The corresponding target algorithm combination of the third functional module is determined according to the frame per second.
9. according to the method described in claim 8, it is characterized in that, determining that the third functional module is corresponding according to the frame per second
Target algorithm combination, comprising:
In the case where the frame per second is greater than preset frame rate, determine that the corresponding target algorithm combination of the third functional module includes
5th algorithm, wherein the 5th algorithm is for reducing collected eyeball image in the eyeball tracking equipment unit time
Quantity；
In the case where the frame per second is less than or equal to the preset frame rate, the corresponding target algorithm of the third functional module is determined
Combination includes the 6th algorithm, wherein the 6th algorithm is collected in the eyeball tracking equipment unit time for improving
The quantity of eyeball image.
10. a kind of eyeball tracking information processing method applied to terminal characterized by comprising
Obtain environmental information；
It is determined in the corresponding functional module combination of the environmental information and functional module combination according to preset function module
Functional module corresponding to target algorithm combination, wherein include at least one functional module, institute in functional module combination
Stating in target algorithm combination includes at least one target algorithm；
It is combined according to functional module combination and the target algorithm and determines target operational mode；
Complete the target operational mode switching.
11. a kind of eyeball tracking information processing unit applied to terminal characterized by comprising
Module is obtained, for obtaining scene information；
Selecting module, for determining the scene information corresponding functional module combination and described according to preset function module
Target algorithm combination corresponding to functional module in functional module combination, wherein include at least in the functional module combination
One functional module includes at least one target algorithm in target algorithm combination；
Determining module determines target operational mode for combining according to functional module combination and the target algorithm；
Switching module, for completing the target operational mode switching.
12. a kind of storage medium, which is characterized in that the storage medium includes the program of storage, wherein described program right of execution
Benefit require any one of 1 to 10 described in be applied to terminal eyeball tracking information processing method.
13. a kind of processor, which is characterized in that the processor is for running program, wherein right of execution when described program is run
Benefit require any one of 1 to 10 described in be applied to terminal eyeball tracking information processing method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811163395.1A CN109460706B (en) | 2018-09-30 | 2018-09-30 | Eyeball tracking information processing method and device applied to terminal |
| PCT/CN2019/097659 WO2020063077A1 (en) | 2018-09-30 | 2019-07-25 | Eyeball tracking information processing method and apparatus applied to terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811163395.1A CN109460706B (en) | 2018-09-30 | 2018-09-30 | Eyeball tracking information processing method and device applied to terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109460706A true CN109460706A (en) | 2019-03-12 |
| CN109460706B CN109460706B (en) | 2021-03-23 |
Family
ID=65607283
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811163395.1A Active CN109460706B (en) | 2018-09-30 | 2018-09-30 | Eyeball tracking information processing method and device applied to terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109460706B (en) |
| WO (1) | WO2020063077A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109960412A (en) * | 2019-03-22 | 2019-07-02 | 北京七鑫易维信息技术有限公司 | A kind of method and terminal device based on touch-control adjustment watching area |
| CN110225252A (en) * | 2019-06-11 | 2019-09-10 | Oppo广东移动通信有限公司 | Camera control method and Related product |
| CN110221696A (en) * | 2019-06-11 | 2019-09-10 | Oppo广东移动通信有限公司 | Eyeball tracking method and Related product |
| WO2020063077A1 (en) * | 2018-09-30 | 2020-04-02 | 北京七鑫易维信息技术有限公司 | Eyeball tracking information processing method and apparatus applied to terminal |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080298637A1 (en) * | 2003-05-30 | 2008-12-04 | Microsoft Corporation | Head Pose Assessment Methods and Systems |
| US20090115586A1 (en) * | 2006-12-19 | 2009-05-07 | Matvey Lvovskiy | Multifunctional collimator indicator |
| CN106406543A (en) * | 2016-11-23 | 2017-02-15 | 长春中国光学科学技术馆 | VR scene conversion device controlled by human eyes |
| CN106873778A (en) * | 2017-01-23 | 2017-06-20 | 深圳超多维科技有限公司 | A kind of progress control method of application, device and virtual reality device |
| US20170192499A1 (en) * | 2016-01-06 | 2017-07-06 | Oculus Vr, Llc | Eye tracking through illumination by head-mounted displays |
| CN107390863A (en) * | 2017-06-16 | 2017-11-24 | 北京七鑫易维信息技术有限公司 | Control method and device, electronic equipment, the storage medium of equipment |
| US9829708B1 (en) * | 2014-08-19 | 2017-11-28 | Boston Incubator Center, LLC | Method and apparatus of wearable eye pointing system |
| CN107533362A (en) * | 2015-05-08 | 2018-01-02 | Smi创新传感技术有限公司 | Eye-tracking device and the method for operating eye-tracking device |
| CN107992378A (en) * | 2017-10-30 | 2018-05-04 | 维沃移动通信有限公司 | A kind of document handling method and mobile terminal |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183538B (en) * | 2014-06-03 | 2019-10-29 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN104360732A (en) * | 2014-10-16 | 2015-02-18 | 南京大学 | Compensation method and device for improving accuracy of sight line tracking system |
| CN106708251A (en) * | 2015-08-12 | 2017-05-24 | 天津电眼科技有限公司 | Eyeball tracking technology-based intelligent glasses control method |
| US10016130B2 (en) * | 2015-09-04 | 2018-07-10 | University Of Massachusetts | Eye tracker system and methods for detecting eye parameters |
| CN106125919B (en) * | 2016-06-20 | 2019-04-26 | 联想(北京)有限公司 | A kind of condition control method and electronic equipment |
| CN109460706B (en) * | 2018-09-30 | 2021-03-23 | 北京七鑫易维信息技术有限公司 | Eyeball tracking information processing method and device applied to terminal |
-
2018
- 2018-09-30 CN CN201811163395.1A patent/CN109460706B/en active Active
-
2019
- 2019-07-25 WO PCT/CN2019/097659 patent/WO2020063077A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080298637A1 (en) * | 2003-05-30 | 2008-12-04 | Microsoft Corporation | Head Pose Assessment Methods and Systems |
| US20090115586A1 (en) * | 2006-12-19 | 2009-05-07 | Matvey Lvovskiy | Multifunctional collimator indicator |
| US9829708B1 (en) * | 2014-08-19 | 2017-11-28 | Boston Incubator Center, LLC | Method and apparatus of wearable eye pointing system |
| CN107533362A (en) * | 2015-05-08 | 2018-01-02 | Smi创新传感技术有限公司 | Eye-tracking device and the method for operating eye-tracking device |
| US20170192499A1 (en) * | 2016-01-06 | 2017-07-06 | Oculus Vr, Llc | Eye tracking through illumination by head-mounted displays |
| CN106406543A (en) * | 2016-11-23 | 2017-02-15 | 长春中国光学科学技术馆 | VR scene conversion device controlled by human eyes |
| CN106873778A (en) * | 2017-01-23 | 2017-06-20 | 深圳超多维科技有限公司 | A kind of progress control method of application, device and virtual reality device |
| CN107390863A (en) * | 2017-06-16 | 2017-11-24 | 北京七鑫易维信息技术有限公司 | Control method and device, electronic equipment, the storage medium of equipment |
| CN107992378A (en) * | 2017-10-30 | 2018-05-04 | 维沃移动通信有限公司 | A kind of document handling method and mobile terminal |
Non-Patent Citations (3)
| Title |
|---|
| LUISA BRINKSCHULTE等: ""A Multi Modal Interaction Paradigm Combining Gaze Tracking and Keyboard"", 《2017 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM)》 * |
| STEFANIA CRISTINA等: ""Unobtrusive and pervasive video-based eye-gaze tracking"", 《IMAGE AND VISION COMPUTING》 * |
| 吴凤山等: ""眼动人机交互技术的类别与特点"", 《人类工效学》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020063077A1 (en) * | 2018-09-30 | 2020-04-02 | 北京七鑫易维信息技术有限公司 | Eyeball tracking information processing method and apparatus applied to terminal |
| CN109960412A (en) * | 2019-03-22 | 2019-07-02 | 北京七鑫易维信息技术有限公司 | A kind of method and terminal device based on touch-control adjustment watching area |
| CN109960412B (en) * | 2019-03-22 | 2022-06-07 | 北京七鑫易维信息技术有限公司 | Method for adjusting gazing area based on touch control and terminal equipment |
| CN110225252A (en) * | 2019-06-11 | 2019-09-10 | Oppo广东移动通信有限公司 | Camera control method and Related product |
| CN110221696A (en) * | 2019-06-11 | 2019-09-10 | Oppo广东移动通信有限公司 | Eyeball tracking method and Related product |
| CN110225252B (en) * | 2019-06-11 | 2021-07-23 | Oppo广东移动通信有限公司 | Photographing control method and related product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109460706B (en) | 2021-03-23 |
| WO2020063077A1 (en) | 2020-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109460706A (en) | Eyeball tracking information processing method and device applied to terminal | |
| CN111182453B (en) | Positioning method, positioning device, electronic equipment and storage medium | |
| CN109951595A (en) | Intelligence adjusts method, apparatus, storage medium and the mobile terminal of screen intensity | |
| CN105159115B (en) | Smart machine control method and device | |
| EP3855287A1 (en) | Adding system and adding method for adding odor information to digital photos | |
| CN202815718U (en) | Individual carried-with device | |
| CN111225237B (en) | Sound and picture matching method of video, related device and storage medium | |
| CN106681609A (en) | Terminal device screen brightness adjusting method and device and terminal device | |
| CN108681399A (en) | A kind of apparatus control method, device, control device and storage medium | |
| CN110543233B (en) | Information processing apparatus and non-transitory computer readable medium | |
| CN105303149A (en) | Figure image display method and apparatus | |
| CN108491804A (en) | A kind of method, relevant apparatus and the system of chess game displaying | |
| CN106707512B (en) | Low-power consumption intelligent AR system and intelligent AR glasses | |
| CN110604579A (en) | Data acquisition method, device, terminal and storage medium | |
| CN105068646A (en) | Terminal control method and system | |
| CN105042789A (en) | Control method and system of intelligent air conditioner | |
| CN109495685A (en) | A kind of video camera day and night method for handover control, device and storage medium | |
| CN109993234A (en) | A kind of unmanned training data classification method, device and electronic equipment | |
| CN107360366A (en) | Photographic method, device, storage medium and electronic equipment | |
| CN113709385A (en) | Video processing method and device, computer equipment and storage medium | |
| CN106598222A (en) | Scene mode switching method and system | |
| CN110448909B (en) | Method and device for outputting result of target role in application and medium | |
| CN107544660A (en) | A kind of information processing method and electronic equipment | |
| CN109521875A (en) | A kind of screen control method, electronic equipment and computer readable storage medium | |
| CN111885218B (en) | Method and device for managing intelligent equipment and binding equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |