CN107767421A - Hot spot light source matching process and device in Eye-controlling focus equipment - Google Patents
Hot spot light source matching process and device in Eye-controlling focus equipment Download PDFInfo
- Publication number
- CN107767421A CN107767421A CN201710783732.6A CN201710783732A CN107767421A CN 107767421 A CN107767421 A CN 107767421A CN 201710783732 A CN201710783732 A CN 201710783732A CN 107767421 A CN107767421 A CN 107767421A
- Authority
- CN
- China
- Prior art keywords
- camera
- coordinate
- hot spot
- light source
- formula
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
The invention discloses hot spot light source matching process and device in a kind of Eye-controlling focus equipment.Wherein, Eye-controlling focus equipment includes first camera and second camera, and this method includes：The coordinate of all hot spots in the coordinate of acquisition multiple light sources, the coordinate of all hot spots in first camera and second camera, wherein, projection obtains hot spot to multiple light sources in first camera and second camera after corneal reflection；The coordinate of light source and the coordinate of hot spot are traveled through, when default first formula meets preparatory condition, determines the matching relationship of hot spot in hot spot in light source and first camera and/or second camera.The present invention solves the technical problem that the matching of hot spot light source is difficult in Eye-controlling focus equipment use in the prior art.
Description
Technical field
The present invention relates to Eye-controlling focus apparatus field, in particular to hot spot light source in a kind of Eye-controlling focus equipment
Method of completing the square and device.
Background technology
In the prior art when using Eye-controlling focus equipment, the 3D approximation ball models based on eyeball, VR equipment is according to pupil
Hole centre coordinate and corneal reflection, sight estimation is carried out to the remote equipment of blinkpunkt, when VR equipment uses polyphaser light more
During source, it is only necessary to single point correction process can estimates sight, above-mentioned VR equipment in actual use because light source and camera
Relative position is different, and some position camera captures are less than image, or the image captured is bad, in this case, due to
Light source is usually without specificity, therefore the matching of light source hot spot can not be completed.
For the problem of matching of hot spot light source is difficult in the above-mentioned equipment use of Eye-controlling focus in the prior art, not yet carry at present
Go out effective solution.
The content of the invention
The embodiments of the invention provide hot spot light source matching process and device in a kind of Eye-controlling focus equipment, at least to solve
The difficult technical problem of hot spot light source matching in the use of Eye-controlling focus equipment in the prior art.
One side according to embodiments of the present invention, there is provided hot spot light source matching process in a kind of Eye-controlling focus equipment,
Eye-controlling focus equipment includes first camera and second camera, and method includes：Obtain the institute in the coordinates of multiple light sources, first camera
There are the coordinate of hot spot and the coordinate of all hot spots in second camera, wherein, multiple light sources are after corneal reflection in the first phase
Projection obtains hot spot on machine and second camera；The coordinate of light source and the coordinate of hot spot are traveled through, is met in default first formula pre-
If during condition, determining the matching relationship of hot spot in hot spot in light source and first camera and/or second camera, wherein, the first formula
Including at least the second formula, the second formula is：(A1 × B1) × (A2 × B2)-(A3 × B3) × (A4 × B4), A1, A2, A3 and
A4 is the coordinate of any one light source, and B1, B2, B3 and B4 are the coordinate of any one hot spot in first camera or second camera,
And meeting A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, preparatory condition are default
First formula value is minimum.
Further, the first formula is the sum of the second formula and the 3rd formula, and the 3rd formula is：λ (A5 × B5) C, its
In, λ represents default empirical value, and A5 is the coordinate of any one light source, and B5 is any one light in first camera or second camera
The coordinate of spot, C represent the center of curvature coordinate of cornea.
Further, obtain in the coordinate of multiple light sources, the coordinate of all hot spots in first camera and second camera
After the coordinate of all hot spots, method also includes：The coordinate of light source and the coordinate of hot spot are traveled through, meets default bar in the first formula
During part, the center of curvature coordinate of cornea is determined.
Further, determining the matching relationship of hot spot in hot spot in light source and first camera and/or second camera includes：
When first formula meets preparatory condition, determine that A1 and B1 matches, A2 and B2 match, A3 and B3 match, A4 and B4 phases
Match somebody with somebody and A5 and B5 matches.
Further, the coordinate of the coordinate and hot spot that travel through light source includes：Light source is traveled through by optimized search algorithm
The coordinate of coordinate and hot spot.
Another aspect according to embodiments of the present invention, additionally provide hot spot light source matching dress in a kind of Eye-controlling focus equipment
Put, Eye-controlling focus equipment includes first camera and second camera, and device includes：Acquisition module, for obtaining the seat of multiple light sources
The coordinate of all hot spots in mark, the coordinate of all hot spots in first camera and second camera, wherein, multiple light sources are by angle
Projection obtains hot spot in first camera and second camera after film reflection；First determining module, for travel through light source coordinate and
The coordinate of hot spot, when default first formula meets preparatory condition, determine hot spot and/or the second phase in light source and first camera
The matching relationship of hot spot in machine, wherein, the first formula comprises at least the second formula, and the second formula is：(A1×B1)×(A2×
B2)-(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one light source, and B1, B2, B3 and B4 are the first phase
The coordinate of any one hot spot in machine or second camera, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2
≠ A3, B1 ≠ B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum.
Another aspect according to embodiments of the present invention, additionally provides a kind of storage medium, and storage medium includes the journey of storage
Sequence, wherein, equipment performs hot spot light source match party in above-mentioned Eye-controlling focus equipment where controlling storage medium when program is run
Method.
Another aspect according to embodiments of the present invention, a kind of processor being additionally provided, processor is used for operation program, its
In, program performs hot spot light source matching process in above-mentioned Eye-controlling focus equipment when running.
Another aspect according to embodiments of the present invention, additionally provide a kind of terminal, including Eye-controlling focus equipment, Eye-controlling focus
Equipment includes first camera and second camera, and terminal also includes：Acquisition module, for obtaining coordinate, the first phase of multiple light sources
The coordinate of all hot spots in the coordinate and second camera of all hot spots in machine, wherein, multiple light sources are after corneal reflection
Projection obtains hot spot in first camera and second camera；First determining module, for traveling through the coordinate of light source and the seat of hot spot
Mark, when default first formula meets preparatory condition, determine in light source and first camera hot spot in hot spot and/or second camera
Matching relationship, wherein, the first formula comprises at least the second formula, and the second formula is：(A1×B1)×(A2×B2)-(A3×
B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one light source, and B1, B2, B3 and B4 are first camera or the second phase
The coordinate of any one hot spot in machine, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠
B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum；Processor, processor operation program, wherein, when program is run
For performing hot spot light source matching process in above-mentioned Eye-controlling focus equipment from the data of acquisition module and the output of the first determining module.
Another aspect according to embodiments of the present invention, additionally provide a kind of terminal, including Eye-controlling focus equipment, Eye-controlling focus
Equipment includes first camera and second camera, and terminal also includes：Acquisition module, for obtaining coordinate, the first phase of multiple light sources
The coordinate of all hot spots in the coordinate and second camera of all hot spots in machine, wherein, multiple light sources are after corneal reflection
Projection obtains hot spot in first camera and second camera；First determining module, for traveling through the coordinate of light source and the seat of hot spot
Mark, when default first formula meets preparatory condition, determine in light source and first camera hot spot in hot spot and/or second camera
Matching relationship, wherein, the first formula comprises at least the second formula, and the second formula is：(A1×B1)×(A2×B2)-(A3×
B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one light source, and B1, B2, B3 and B4 are first camera or the second phase
The coordinate of any one hot spot in machine, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠
B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum；Storage medium, for storage program, wherein, program is being run
When for performing hot spot light source match party in above-mentioned Eye-controlling focus equipment from the data of acquisition module and the output of the first determining module
Method.
In embodiments of the present invention, it is multiple by obtaining for including first camera and second camera Eye-controlling focus equipment
The coordinate of all hot spots in the coordinate of light source, the coordinate of all hot spots in first camera and second camera, wherein, Duo Geguang
Projection obtains hot spot in first camera and second camera after corneal reflection in source；Travel through the coordinate of light source and the seat of hot spot
Mark, when default first formula meets preparatory condition, determine in light source and first camera hot spot in hot spot and/or second camera
Matching relationship, wherein, the first formula comprises at least the second formula, and the second formula is：(A1×B1)×(A2×B2)-(A3×
B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one light source, and B1, B2, B3 and B4 are first camera or the second phase
The coordinate of any one hot spot in machine, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠
B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum, have reached the purpose matched to hot spot and light source, so as to
Even hot spot light source can also be completed under conditions of camera capture is bad less than image or the image captured by realizing
The technique effect of matching, and then solve Eye-controlling focus equipment in the prior art and asked using the difficult technology of middle hot spot light source matching
Topic.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, forms the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is the schematic diagram of hot spot light source matching process in a kind of Eye-controlling focus equipment according to embodiments of the present invention；
Fig. 2 is the schematic diagram of hot spot light source matching process in a kind of Eye-controlling focus equipment according to embodiments of the present invention；With
And
Fig. 3 is the schematic diagram of hot spot light source coalignment in a kind of Eye-controlling focus equipment according to embodiments of the present invention.
Embodiment
It should be noted that in the case where not conflicting, the feature in embodiment and embodiment in the application can phase
Mutually combination.Describe the present invention in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
In order that those skilled in the art more fully understand the present invention program, below in conjunction with the embodiment of the present invention
Accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is only
The embodiment of a part of the invention, rather than whole embodiments.Based on the embodiment in the present invention, ordinary skill people
The every other embodiment that member is obtained under the premise of creative work is not made, it should all belong to the model that the present invention protects
Enclose.
It should be noted that term " first " in description and claims of this specification and above-mentioned accompanying drawing, "
Two " etc. be for distinguishing similar object, without for describing specific order or precedence.It should be appreciated that so use
Data can exchange in the appropriate case, so as to embodiments of the invention described herein can with except illustrating herein or
Order beyond those of description is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover
Cover it is non-exclusive include, be not necessarily limited to for example, containing the process of series of steps or unit, method, system, product or equipment
Those steps or unit clearly listed, but may include not list clearly or for these processes, method, product
Or the intrinsic other steps of equipment or unit.
Embodiment 1
According to embodiments of the present invention, there is provided the method for hot spot light source matching process is implemented in a kind of Eye-controlling focus equipment
Example, can be in the calculating of such as one group computer executable instructions the flow of accompanying drawing illustrates the step of, it is necessary to explanation
Performed in machine system, although also, show logical order in flow charts, in some cases, can with different from
Order herein performs shown or described step.
Fig. 1 is hot spot light source matching process in Eye-controlling focus equipment according to embodiments of the present invention, wherein, Eye-controlling focus is set
It is standby to include first camera and second camera, as shown in figure 1, this method comprises the following steps：
Step S102, obtain in the coordinate of multiple light sources, the coordinate of all hot spots in first camera and second camera
The coordinate of all hot spots, wherein, projection obtains hot spot to multiple light sources in first camera and second camera after corneal reflection.
Optionally, the Eye-controlling focus equipment in all embodiments of the invention include but is not limited to virtual reality device, can be with
The intelligent terminal of Eye-controlling focus is carried out, for example, mobile phone, computer, wearable device etc..
Specifically, as shown in Fig. 2 Fig. 2 be eyeball, light source and camera schematic diagram, wherein, left camera or the right side in Fig. 2
Camera can be first camera, corresponding, and right camera or left camera can be second cameras, and O1 represents the coordinate of left camera, O2
The coordinate of right camera is represented, the coordinate O1 of first camera and the coordinate O2 of second camera can be by demarcation, it is known that the I1 in Fig. 2
Represent the coordinate of light source 1 and light source 2 respectively with I2, two light sources are only gived in Fig. 2, herein it should be noted that the present invention
In the number of light source is not limited, light source can project after the corneal reflection of eyeball in the image plane of first camera
Hot spot is obtained, and projection obtains hot spot in the image plane of second camera, wherein, the coordinate of light source is known, specific
Embodiment in, can be represented with Ii, i represent light source label, i=1,2 ..., N, N represent light source total number, the first phase
The coordinate of hot spot in the image that the coordinate of hot spot and second camera capture to obtain in the image that machine captures to obtain can also obtain
Arrive, can specifically be obtained, had by camera Intrinsic Matrix conversion process according to the coordinate of pip of the light source on cornea
In the embodiment of body, the coordinate of hot spot can use uijRepresent, j represents camera label, represents first camera during j=1, table during j=2
Show second camera.
Step S104, the coordinate of light source and the coordinate of hot spot are traveled through, when default first formula meets preparatory condition, really
Determine the matching relationship of hot spot in hot spot in light source and first camera and/or second camera, wherein, the first formula comprises at least second
Formula, the second formula are：(A1 × B1) × (A2 × B2)-(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are any one
The coordinate of light source, B1, B2, B3 and B4 are the coordinate of any one hot spot in first camera or second camera, and meet A1 ≠ A3,
A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, preparatory condition are to preset the first formula value most
It is small.
Specifically, the building process of the first formula is：
First, according to reflection process coplanar constraint, following matrix equality relation (1) can be obtained：
In above formula (1), c represents the center of curvature coordinate of cornea, it is assumed that O1 is (0,0,0), that is, sets first camera to sit
Origin is marked, then above formula (1), which can become, turns to following formula (2)：
Solved with odd-numbered line, above formula (2) can be become and turn to following formula (3)：
The premise that above formula (3) meets is the hot spot u of first camera11Matched with light source I1, the hot spot u of first camera21
Matched with light source I2, until the hot spot u of first camera11Matched with light source I1, but be not aware that light in practice
Source and the matching relationship of hot spot, therefore according to above formula (3), can be closed using such as following formula (4) to solve the matching of hot spot and light source
System：
In above formula (4), um1..., un1For any one hot spot in the hot spot of first camera, with light source I1 and hot spot um1
Exemplified by, by I1 and hot spot um1Combine, if dm is 0 or closest to 0, illustrate hot spot um1It is to be matched with light source I1
Hot spot.
In order to more accurately obtain the matching relationship of hot spot and light source, above-mentioned second formula can be built, in the second formula
When being worth minimum, the corresponding relation of hot spot light source can be obtained, in a kind of specific embodiment, is meeting following formula (5)
In the case of, the matching relationship of hot spot light source can be obtained：
Wherein, IiCorresponding A 1,Corresponding A 2 and A4,Corresponding A 3, uj1Corresponding B1,Corresponding B2 and B4,Corresponding B3, on
It is that A2 and A4 is identical in the second formula in formula (5), B2 and B4 identical situations, the meaning of above formula (5) is：Arbitrarily choose three light sources
Coordinate and three hot spots, using one of light source coordinates and one of hot spot coordinate as a pair and do multiplication cross, such as above formula (5)
In, IiAnd uj1Do multiplication cross and obtain Ii×uj1,WithMultiplication cross is done to obtain WithMultiplication cross is done to obtainBy three
Any two in multiplication cross result is done multiplication cross and subtracted each other again, i.e., by Ii×uj1、WithMiddle any two is done multiplication cross and counted
Difference is calculated, if IiAnd uj1Matching,WithMatching,WithMatching, then
It can be 0 or to be substantially equal to 0, therefore all light source coordinates and all hot spot coordinates can be traveled through, find out and meet above formula (5)
Light source coordinates and hot spot coordinate, that is, the matching relationship of light source and hot spot is obtained, therefore, preparatory condition can be further defined to
One formula value is 0 or levels off to 0.
In embodiments of the present invention, it is multiple by obtaining for including first camera and second camera Eye-controlling focus equipment
The coordinate of all hot spots in the coordinate of light source, the coordinate of all hot spots in first camera and second camera, wherein, Duo Geguang
Projection obtains hot spot in first camera and second camera after corneal reflection in source；Travel through the coordinate of light source and the seat of hot spot
Mark, when default first formula meets preparatory condition, determine in light source and first camera hot spot in hot spot and/or second camera
Matching relationship, wherein, the first formula comprises at least the second formula, and the second formula is：(A1×B1)×(A2×B2)-(A3×
B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one light source, and B1, B2, B3 and B4 are first camera or the second phase
The coordinate of any one hot spot in machine, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠
B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum, have reached the purpose matched to hot spot and light source, so as to
Even hot spot light source can also be completed under conditions of camera capture is bad less than image or the image captured by realizing
The technique effect of matching, and then solve Eye-controlling focus equipment in the prior art and asked using the difficult technology of middle hot spot light source matching
Topic.
In a kind of optional embodiment, the first formula is the sum of the second formula and the 3rd formula, and the 3rd formula is：λ(A5
× B5) C, wherein, λ represents default empirical value, and A5 is the coordinate of any one light source, and B5 is in first camera or second camera
The coordinate of any one hot spot, C represent the center of curvature coordinate of cornea.
Specifically, the first formula can also include the 3rd formula, in this case, in the particular embodiment, full
In the case of foot formula (6), the matching relationship of hot spot light source can be obtained：
In above formula (6), IiCorresponding A 5, uj1Corresponding B5, that is to say, that A1 is identical with A5, and B1 is identical with B5, in above formula (6),It is the λ (I in order to ensure that c is unique point of safesi×uj1) c is to protect
Dm to dn value is 0 or levels off to 0 in card formula (4).
In a kind of optional embodiment, all light in step S102 in the coordinate of acquisition multiple light sources, first camera
In the coordinate and second camera of spot after the coordinate of all hot spots, method also includes：Step S202, travel through light source coordinate and
The coordinate of hot spot, when the first formula meets preparatory condition, determine the center of curvature coordinate of cornea.
Specifically, in the particular embodiment, can be in the hope of the center of curvature coordinate of c values, i.e. cornea by formula (6).
In a kind of optional embodiment, hot spot and/or second camera in light source and first camera are determined in step S104
The matching relationship of middle hot spot includes：Step S302, when the first formula meets preparatory condition, determine A1 and B1 match, A2 and
B2 matches, A3 and B3 match, A4 and B4 matches and A5 and B5 matches.
The coordinate of the coordinate and hot spot that travel through light source in a kind of optional embodiment, in step S104 includes：Step
S402, the coordinate of light source and the coordinate of hot spot are traveled through by optimized search algorithm.
Specifically, the coordinate for searching coordinate and hot spot that plain algorithm travels through light source using optimizing can be looked for fast and accurately
First formula of sening as an envoy to meets the light source coordinates and hot spot coordinate of preparatory condition.
Embodiment 2
According to embodiments of the present invention, there is provided the product of hot spot light source coalignment is implemented in a kind of Eye-controlling focus equipment
Example, Fig. 3 is hot spot light source coalignment in Eye-controlling focus equipment according to embodiments of the present invention, wherein, Eye-controlling focus equipment bag
First camera and second camera are included, as shown in figure 3, the device includes acquisition module and the first determining module, wherein, obtain mould
Block, for obtaining the coordinate of all hot spots in the coordinates of multiple light sources, first camera and all hot spots in second camera
Coordinate, wherein, projection obtains hot spot to multiple light sources in first camera and second camera after corneal reflection；First determines mould
Block, for traveling through the coordinate of light source and the coordinate of hot spot, when default first formula meets preparatory condition, determine light source and
In one camera in hot spot and/or second camera hot spot matching relationship, wherein, the first formula comprises at least the second formula, second
Formula is：(A1 × B1) × (A2 × B2)-(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are the seat of any one light source
Mark, B1, B2, B3 and B4 are the coordinate of any one hot spot in first camera or second camera, and meet A1 ≠ A3, A2 ≠ A4,
B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum.
In embodiments of the present invention, for including first camera and second camera Eye-controlling focus equipment, passing through acquisition module
The coordinate of all hot spots in the coordinate of acquisition multiple light sources, the coordinate of all hot spots in first camera and second camera, its
In, projection obtains hot spot to multiple light sources in first camera and second camera after corneal reflection；First determining module travels through
The coordinate of light source and the coordinate of hot spot, when default first formula meets preparatory condition, determine light in light source and first camera
The matching relationship of hot spot in spot and/or second camera, wherein, the first formula comprises at least the second formula, and the second formula is：(A1
× B1) × (A2 × B2)-(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 be any one light source coordinate, B1, B2, B3
It is the coordinate of any one hot spot in first camera or second camera with B4, and meets A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠
B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum, have been reached to hot spot and light
The purpose that source is matched, even it is achieved thereby that capturing the condition bad less than image or the image captured in camera
Under can also complete the technique effect of hot spot light source matching, and then solve hot spot in Eye-controlling focus equipment use in the prior art
The difficult technical problem of light source matching.
Herein it should be noted that the step S102 that above-mentioned acquisition module and the first determining module correspond in embodiment 1
To step S104, above-mentioned module is identical with example and application scenarios that corresponding step is realized, but is not limited to above-described embodiment 1
Disclosure of that.It should be noted that above-mentioned module can perform as a part of of device in such as one group of computer
Performed in the computer system of instruction.
In a kind of optional embodiment, the first formula is the sum of the second formula and the 3rd formula, and the 3rd formula is：λ(A5
× B5) C, wherein, λ represents default empirical value, and A5 is the coordinate of any one light source, and B5 is in first camera or second camera
The coordinate of any one hot spot, C represent the center of curvature coordinate of cornea.
In a kind of optional embodiment, device also includes the second determining module, for obtaining multiple light in acquisition module
In the coordinate in source, the coordinate of all hot spots in first camera and second camera after the coordinate of all hot spots, light source is traveled through
Coordinate and hot spot coordinate, when the first formula meets preparatory condition, determine the center of curvature coordinate of cornea.
Herein it should be noted that above-mentioned second determining module correspond to embodiment 1 in step S202, above-mentioned module with
The example that corresponding step is realized is identical with application scenarios, but is not limited to the disclosure of that of above-described embodiment 1.Need to illustrate
, above-mentioned module can hold as a part of of device in the computer system of such as one group computer executable instructions
OK.
In a kind of optional embodiment, the first determining module includes the 3rd determining module, for meeting in the first formula
During preparatory condition, determine that A1 and B1 matches, A2 and B2 match, A3 and B3 match, A4 and B4 matches and A5 and B5
Match.
Herein it should be noted that above-mentioned 3rd determining module correspond to embodiment 1 in step S302, above-mentioned module with
The example that corresponding step is realized is identical with application scenarios, but is not limited to the disclosure of that of above-described embodiment 1.Need to illustrate
, above-mentioned module can hold as a part of of device in the computer system of such as one group computer executable instructions
OK.
In a kind of optional embodiment, the first determining module includes spider module, for passing through optimized search algorithm
Travel through the coordinate of light source and the coordinate of hot spot.
Herein it should be noted that above-mentioned spider module correspond to embodiment 1 in step S402, above-mentioned module with it is corresponding
The step of the example realized it is identical with application scenarios, but be not limited to the disclosure of that of above-described embodiment 1.Need what is illustrated
It is that above-mentioned module can perform as a part of of device in the computer system of such as one group computer executable instructions.
Embodiment 3
According to embodiments of the present invention, there is provided a kind of product embodiments of storage medium, the storage medium include storage
Program, wherein, equipment where controlling storage medium when program is run performs hot spot light source in above-mentioned Eye-controlling focus equipment and matched
Method.
Embodiment 4
According to embodiments of the present invention, there is provided a kind of product embodiments of processor, the processor are used for operation program, its
In, program performs hot spot light source matching process in above-mentioned Eye-controlling focus equipment when running.
Embodiment 5
According to embodiments of the present invention, there is provided a kind of product embodiments of terminal, the terminal include Eye-controlling focus equipment, depending on
Line tracing equipment includes first camera and second camera, and terminal also includes acquisition module, the first determining module and processor, its
In, acquisition module, for obtain all hot spots in the coordinates of multiple light sources, first camera coordinate and second camera in institute
There is the coordinate of hot spot, wherein, projection obtains hot spot to multiple light sources in first camera and second camera after corneal reflection；The
One determining module, for traveling through the coordinate of light source and the coordinate of hot spot, when default first formula meets preparatory condition, it is determined that
In light source and first camera in hot spot and/or second camera hot spot matching relationship, wherein, it is public that the first formula comprises at least second
Formula, the second formula are：(A1 × B1) × (A2 × B2)-(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are any one light
The coordinate in source, B1, B2, B3 and B4 are the coordinate of any one hot spot in first camera or second camera, and meet A1 ≠ A3, A2
≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum；
Processor, processor operation program, wherein, for being held from the data of acquisition module and the output of the first determining module when program is run
Hot spot light source matching process in the above-mentioned Eye-controlling focus equipment of row.
Embodiment 6
According to embodiments of the present invention, there is provided a kind of product embodiments of terminal, the terminal include Eye-controlling focus equipment, depending on
Line tracing equipment includes first camera and second camera, and terminal also includes acquisition module, the first determining module and storage medium, its
In, acquisition module, for obtain all hot spots in the coordinates of multiple light sources, first camera coordinate and second camera in institute
There is the coordinate of hot spot, wherein, projection obtains hot spot to multiple light sources in first camera and second camera after corneal reflection；The
One determining module, for traveling through the coordinate of light source and the coordinate of hot spot, when default first formula meets preparatory condition, it is determined that
In light source and first camera in hot spot and/or second camera hot spot matching relationship, wherein, it is public that the first formula comprises at least second
Formula, the second formula are：(A1 × B1) × (A2 × B2)-(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are any one light
The coordinate in source, B1, B2, B3 and B4 are the coordinate of any one hot spot in first camera or second camera, and meet A1 ≠ A3, A2
≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, preparatory condition are that default first formula value is minimum；
Storage medium, for storage program, wherein, program is operationally for the data from acquisition module and the output of the first determining module
Perform hot spot light source matching process in above-mentioned Eye-controlling focus equipment.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
In the above embodiment of the present invention, the description to each embodiment all emphasizes particularly on different fields, and does not have in some embodiment
The part of detailed description, it may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed technology contents, others can be passed through
Mode is realized.Wherein, device embodiment described above is only schematical, such as the division of the unit, Ke Yiwei
A kind of division of logic function, can there is an other dividing mode when actually realizing, for example, multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, unit or module
Connect, can be electrical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On unit.Some or all of unit therein can be selected to realize the purpose of this embodiment scheme according to the actual needs.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and is used as independent production marketing or use
When, it can be stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially
The part to be contributed in other words to prior art or all or part of the technical scheme can be in the form of software products
Embody, the computer software product is stored in a storage medium, including some instructions are causing a computer
Equipment (can be personal computer, server or network equipment etc.) perform each embodiment methods described of the present invention whole or
Part steps.And foregoing storage medium includes：USB flash disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), mobile hard disk, magnetic disc or CD etc. are various can be with store program codes
Medium.
Described above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (10)
1. hot spot light source matching process in a kind of Eye-controlling focus equipment, it is characterised in that the Eye-controlling focus equipment includes first
Camera and second camera, methods described include：
All light in the coordinate of acquisition multiple light sources, the coordinate of all hot spots in the first camera and the second camera
The coordinate of spot, wherein, multiple light sources project after corneal reflection in the first camera and the second camera
To the hot spot；
The coordinate of the light source and the coordinate of the hot spot are traveled through, when default first formula meets preparatory condition, determines institute
The matching relationship of hot spot described in hot spot described in light source and the first camera and/or the second camera is stated, wherein, it is described
First formula comprises at least the second formula, and second formula is：(A1×B1)×(A2×B2)-(A3×B3)×(A4×
B4), A1, A2, A3 and A4 are the coordinate of any one of light source, and B1, B2, B3 and B4 are the first camera or described second
The coordinate of any one of hot spot in camera, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠ B4 or A1 ≠ A4, A2 ≠
A3, B1 ≠ B4, B2 ≠ B3, the preparatory condition are minimum for default first formula value.
2. according to the method for claim 1, it is characterised in that first formula is second formula and the 3rd formula
Sum, the 3rd formula is：λ (A5 × B5) C, wherein, λ represents default empirical value, and A5 is any one of light source
Coordinate, B5 are the coordinate of any one of hot spot in the first camera or the second camera, and C represents the song of the cornea
Rate centre coordinate.
3. according to the method for claim 2, it is characterised in that obtain in the coordinates of multiple light sources, the first camera
In the coordinate of all hot spots and the second camera after the coordinate of all hot spots, methods described also includes：
The coordinate of the light source and the coordinate of the hot spot are traveled through, when first formula meets the preparatory condition, it is determined that
The center of curvature coordinate of the cornea.
4. according to the method in claim 2 or 3, it is characterised in that determine described in the light source and the first camera
The matching relationship of hot spot includes described in hot spot and/or the second camera：
When first formula meets the preparatory condition, determine that A1 and B1 matches, A2 and B2 match, A3 and B3 phases
Match somebody with somebody, A4 and B4 matches and A5 and B5 matches.
5. according to the method described in any one in claim 1-3, it is characterised in that travel through the coordinate of the light source and described
The coordinate of hot spot includes：
The coordinate of the light source and the coordinate of the hot spot are traveled through by optimized search algorithm.
6. hot spot light source coalignment in a kind of Eye-controlling focus equipment, it is characterised in that the Eye-controlling focus equipment includes first
Camera and second camera, described device include：
Acquisition module, for obtaining the coordinate and described of all hot spots in the coordinates of multiple light sources, the first camera
The coordinate of all hot spots in two cameras, wherein, multiple light sources are after corneal reflection in the first camera and described
Two camera upslide shadows obtain the hot spot；
First determining module, for traveling through the coordinate of the light source and the coordinate of the hot spot, meet in default first formula
During preparatory condition, hot spot described in hot spot described in the light source and the first camera and/or the second camera is determined
Matching relationship, wherein, first formula comprises at least the second formula, and second formula is：(A1×B1)×(A2×B2)-
(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one of light source, and B1, B2, B3 and B4 are described the
The coordinate of any one of hot spot in one camera or the second camera, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠
B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, the preparatory condition are minimum for default first formula value.
A kind of 7. storage medium, it is characterised in that the storage medium includes the program of storage, wherein, run in described program
When control the storage medium where hot spot in Eye-controlling focus equipment in equipment perform claim requirement 1 to 5 described in any one
Light source matching process.
A kind of 8. processor, it is characterised in that the processor is used for operation program, wherein, right of execution when described program is run
Profit requires hot spot light source matching process in Eye-controlling focus equipment in 1 to 5 described in any one.
9. a kind of terminal, it is characterised in that including Eye-controlling focus equipment, the Eye-controlling focus equipment includes first camera and second
Camera, the terminal also include：
Acquisition module, for obtaining the coordinate and described of all hot spots in the coordinates of multiple light sources, the first camera
The coordinate of all hot spots in two cameras, wherein, multiple light sources are after corneal reflection in the first camera and described
Two camera upslide shadows obtain the hot spot；
First determining module, for traveling through the coordinate of the light source and the coordinate of the hot spot, meet in default first formula
During preparatory condition, hot spot described in hot spot described in the light source and the first camera and/or the second camera is determined
Matching relationship, wherein, first formula comprises at least the second formula, and second formula is：(A1×B1)×(A2×B2)-
(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one of light source, and B1, B2, B3 and B4 are described the
The coordinate of any one of hot spot in one camera or the second camera, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠
B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, the preparatory condition are minimum for default first formula value；
Processor, the processor operation program, wherein, for from the acquisition module and described first when described program is run
Hot spot light source matches in Eye-controlling focus equipment in the data perform claim requirement 1 to 5 of determining module output described in any one
Method.
10. a kind of terminal, it is characterised in that including Eye-controlling focus equipment, the Eye-controlling focus equipment includes first camera and the
Two cameras, the terminal also include：
Acquisition module, for obtaining the coordinate and described of all hot spots in the coordinates of multiple light sources, the first camera
The coordinate of all hot spots in two cameras, wherein, multiple light sources are after corneal reflection in the first camera and described
Two camera upslide shadows obtain the hot spot；
First determining module, for traveling through the coordinate of the light source and the coordinate of the hot spot, meet in default first formula
During preparatory condition, hot spot described in hot spot described in the light source and the first camera and/or the second camera is determined
Matching relationship, wherein, first formula comprises at least the second formula, and second formula is：(A1×B1)×(A2×B2)-
(A3 × B3) × (A4 × B4), A1, A2, A3 and A4 are the coordinate of any one of light source, and B1, B2, B3 and B4 are described the
The coordinate of any one of hot spot in one camera or the second camera, and meet A1 ≠ A3, A2 ≠ A4, B1 ≠ B3, B2 ≠
B4 or A1 ≠ A4, A2 ≠ A3, B1 ≠ B4, B2 ≠ B3, the preparatory condition are minimum for default first formula value；
Storage medium, for storage program, wherein, described program is operationally for from the acquisition module and described first true
Hot spot light source match party in Eye-controlling focus equipment in the data perform claim requirement 1 to 5 of cover half block output described in any one
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710783732.6A CN107767421B (en) | 2017-09-01 | 2017-09-01 | Light spot light source matching method and device in sight tracking equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710783732.6A CN107767421B (en) | 2017-09-01 | 2017-09-01 | Light spot light source matching method and device in sight tracking equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107767421A true CN107767421A (en) | 2018-03-06 |
| CN107767421B CN107767421B (en) | 2020-03-27 |
Family
ID=61265286
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710783732.6A Active CN107767421B (en) | 2017-09-01 | 2017-09-01 | Light spot light source matching method and device in sight tracking equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107767421B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113808160A (en) * | 2021-08-05 | 2021-12-17 | 虹软科技股份有限公司 | Sight direction tracking method and device |
| CN114428547A (en) * | 2020-10-29 | 2022-05-03 | 北京七鑫易维信息技术有限公司 | Sight tracking method, device, equipment and storage medium |
| CN114428398A (en) * | 2020-10-29 | 2022-05-03 | 北京七鑫易维信息技术有限公司 | Method, device and equipment for matching light spots with light sources and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070189742A1 (en) * | 2006-02-07 | 2007-08-16 | Honda Motor Co., Ltd. | Method and apparatus for detecting sight line vector |
| US7764387B2 (en) * | 2007-03-02 | 2010-07-27 | Applied Kinetics, Inc. | Apparatus and method for measuring suspension and head assemblies in a stack |
| US8456697B2 (en) * | 2009-07-16 | 2013-06-04 | Xerox Corporation | Adaptive illumination independent matching of spot colors |
| CN103530618A (en) * | 2013-10-23 | 2014-01-22 | 哈尔滨工业大学深圳研究生院 | Non-contact sight tracking method based on corneal reflex |
| CN104090659A (en) * | 2014-07-08 | 2014-10-08 | 金纯� | Operation pointer indication control device based on human eye image and sight tracking |
| CN106778641A (en) * | 2016-12-23 | 2017-05-31 | 北京七鑫易维信息技术有限公司 | Gaze estimation method and device |
| CN106840389A (en) * | 2016-12-30 | 2017-06-13 | 歌尔科技有限公司 | Light source estimating and measuring method and device, intelligent electronic device based on multiple balls |
-
2017
- 2017-09-01 CN CN201710783732.6A patent/CN107767421B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070189742A1 (en) * | 2006-02-07 | 2007-08-16 | Honda Motor Co., Ltd. | Method and apparatus for detecting sight line vector |
| US7764387B2 (en) * | 2007-03-02 | 2010-07-27 | Applied Kinetics, Inc. | Apparatus and method for measuring suspension and head assemblies in a stack |
| US8456697B2 (en) * | 2009-07-16 | 2013-06-04 | Xerox Corporation | Adaptive illumination independent matching of spot colors |
| CN103530618A (en) * | 2013-10-23 | 2014-01-22 | 哈尔滨工业大学深圳研究生院 | Non-contact sight tracking method based on corneal reflex |
| CN104090659A (en) * | 2014-07-08 | 2014-10-08 | 金纯� | Operation pointer indication control device based on human eye image and sight tracking |
| CN106778641A (en) * | 2016-12-23 | 2017-05-31 | 北京七鑫易维信息技术有限公司 | Gaze estimation method and device |
| CN106840389A (en) * | 2016-12-30 | 2017-06-13 | 歌尔科技有限公司 | Light source estimating and measuring method and device, intelligent electronic device based on multiple balls |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114428547A (en) * | 2020-10-29 | 2022-05-03 | 北京七鑫易维信息技术有限公司 | Sight tracking method, device, equipment and storage medium |
| CN114428398A (en) * | 2020-10-29 | 2022-05-03 | 北京七鑫易维信息技术有限公司 | Method, device and equipment for matching light spots with light sources and storage medium |
| CN114428398B (en) * | 2020-10-29 | 2023-12-26 | 北京七鑫易维信息技术有限公司 | Light spot and light source matching method, device, equipment and storage medium |
| CN113808160A (en) * | 2021-08-05 | 2021-12-17 | 虹软科技股份有限公司 | Sight direction tracking method and device |
| CN113808160B (en) * | 2021-08-05 | 2024-01-16 | 虹软科技股份有限公司 | Sight direction tracking method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107767421B (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI742690B (en) | Method and apparatus for detecting a human body, computer device, and storage medium | |
| US11295532B2 (en) | Method and apparatus for aligning 3D model | |
| Tanskanen et al. | Live metric 3D reconstruction on mobile phones | |
| WO2016127883A1 (en) | Image area detection method and device | |
| CN108197532A (en) | The method, apparatus and computer installation of recognition of face | |
| CN107767421A (en) | Hot spot light source matching process and device in Eye-controlling focus equipment | |
| CN106030661A (en) | View independent 3d scene texturing | |
| US20190272586A1 (en) | Virtual reality based shopping method and system | |
| CN108257112A (en) | The method and apparatus for filtering hot spot | |
| CN108334191A (en) | Based on the method and apparatus of the determination blinkpunkt of eye movement analysis equipment | |
| US9491263B2 (en) | Systems and methods for automatically modifying a picture or a video containing a face | |
| CN108463823A (en) | A kind of method for reconstructing, device and the terminal of user's Hair model | |
| CN109348731A (en) | A kind of method and device of images match | |
| CN110276060A (en) | The method and device of data processing | |
| CN109544262A (en) | Item recommendation method, device, electronic equipment, system and readable storage medium storing program for executing | |
| WO2017143773A1 (en) | Crowdsourcing learning method and device | |
| CN113408590B (en) | Scene recognition method, training method, device, electronic equipment and program product | |
| CN110149476A (en) | A kind of time-lapse photography method, apparatus, system and terminal device | |
| CN108334810A (en) | The method and apparatus that parameter is determined in Eye-controlling focus equipment | |
| CN109934664A (en) | Intelligent recommendation method, apparatus, equipment and storage medium based on shoes transaction | |
| CN109412832A (en) | User service providing method and system | |
| CN108898649A (en) | Image processing method and device | |
| CN110166759A (en) | The treating method and apparatus of image, storage medium, electronic device | |
| CN115170834A (en) | Chromatic aberration measuring method and device and electronic equipment | |
| WO2024104144A1 (en) | Image synthesis method and apparatus, storage medium, and electrical device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |