CN106137117A - Lighting camera device - Google Patents
Lighting camera device Download PDFInfo
- Publication number
- CN106137117A CN106137117A CN201510193867.8A CN201510193867A CN106137117A CN 106137117 A CN106137117 A CN 106137117A CN 201510193867 A CN201510193867 A CN 201510193867A CN 106137117 A CN106137117 A CN 106137117A
- Authority
- CN
- China
- Prior art keywords
- light source
- video camera
- light
- cover plate
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention provides and is prevented from escaping to from the light of the light source configured close to video camera the lighting camera device of video camera.Lighting camera device is provided with cover plate (4) in the front of housing (2).The optical axis (O1) of the first video camera (13) and the optical axis of light source (11a, 11b, 12a, 12b) that constitute image receiving means (10) are not vertically but obliquely towards the inner surface (4a) of cover plate (4).Boundary portion at the first video camera (13) Yu the first light source (11a) is provided with curtain-shaped cover member (15), in the front of curtain-shaped cover member (15), the inner surface at cover plate (4) is formed with recess (17).There is provided this recess (17), it is possible to prevent the light sent from the first light source (11a) from propagating in cover plate (4) and entering into the first video camera (13).
Description
Technical field
The present invention relates to detect the regarding of direction of visual lines of the object beyond the driver of car
The lighting camera device that line detector and monitoring arrangement etc. are used.
Background technology
The method for viewing points detecting employing lighting camera device is had described in patent documentation 1.Should
In method for viewing points detecting, 2 video cameras are towards the eyes of object.At each video camera
Being configured with to round shape concentric around 2 kinds of light sources, the circle along the inner side near away from video camera is configured with
Sending the light source of the light that centre wavelength is 850nm, the circle along outside is configured with the center of sending
Wavelength is the light source of the light of 950nm.By irradiating the light of 850nm, can by video camera
Obtain bright pupil image, obtain dark pupil image by irradiating the light of 950nm.
In this method for viewing points detecting, obtain pupil based on bright pupil image and dark pupil image
Hole pattern picture, and the corneal reflex point of light source is obtained from dark pupil image.Based on this image, calculate
Anti-from the cornea of object in the plane vertical with the datum line that video camera is connected with pupil
Exit point is to the vector of pupil, based on this vector and use the function of regulation to calculate regarding of object
Line is relative to the direction of the datum line of each video camera.
Patent documentation 1: No. 2012/020760 publication of International Publication
Method for viewing points detecting described in patent documentation 1, is configured with 2 around video camera
Plant light source, but when making video camera and 2 kinds of light sources spatially expose and configure, as device
Outward appearance is not preferred, it is preferred that arrange the shooting direction front of video camera and light source
The cover plate of the light conductivity that light emission direction front collectively covers.
But when arranging this cover plate, a part for the light sometimes sent from light source is in cover plate
Arrive video camera after portion's reflection, thus a part for the image obtained by video camera is due to this light
Composition and become overexposure state.Being positioned at the wavelength sent from light source near light source is
The light of 850nm, the intensity of light is higher, therefore when video camera obtains this light, of image
Clearly demarcated showing easily becomes overexposure state.
Additionally, wanting the optical axis making the lens of 2 video cameras optical axis with light source towards people's
Face and eyes and by when making it inclined relative to the inner surface of glass plate, from described optical axis
The light that sends of light source of side, obtuse angle configuration is formed easily in the inside of cover plate with described inner surface
Reflect and be irradiated on the lens of video camera.
Summary of the invention
The present invention solves above-mentioned conventional problem, it is therefore intended that provide a kind of lighting camera device,
Cover plate video camera and light source collectively covered is set and is prevented from being drawn by the reflection of cover plate
The generation of the overexposure state of the video camera risen.
The lighting camera device of the present invention, has: video camera, obtains the image of shooting object；
And multiple light source, providing detection light to shooting object, the feature of described lighting camera device exists
In, it is provided with the shooting front, direction and the light emission direction front of described light source of described video camera
The cover plate of the light transmission collectively covered, described cover plate with described video camera and described light source pair
The inner surface put is formed with recess, and described recess is formed at the front, shooting direction of described video camera
Boundary portion with the light emission direction front of described light source.
Preferably, the lighting camera device of the present invention, at described video camera and described cover plate
Being provided with curtain-shaped cover member between inner surface, described recess arrangement is in the prolongation of described curtain-shaped cover member
The maybe vicinity of this prolongation.
The lighting camera device of the present invention, by arranging recess at inner surface, even if thus from light
The light that source sends incides in cover plate, it is also possible to limits this light and propagates to the direction of video camera, energy
Enough suppression video cameras become overexposure state because of the light from light source.
In the present invention, it is preferred that the cross sectional shape of described recess is as from described cap
The described inner surface shape that A/F gradually decreases towards outer surface direction of part.
Additionally, in the present invention, it is preferred that be filled with in described recess for absorb from
The light absorbing material of the light that described light source sends.
The lighting camera device of the present invention, more effectively, the optical axis of described video camera is with described
The inclined light shaft ground of light source is towards the described inner surface of described cover, and described light source is arranged in ratio
The lens of described video camera closer to the position of described inner surface, described video camera optical axis with
Described inner surface forms the light emission direction front of the light source of the side configuration of acute angle and described shooting
The boundary portion in the shooting front, direction of machine, is formed with described recess.
In described lighting camera device, even if the optical axis of video camera and the optical axis of light source are being inclined
Under the state tiltedly configured relative to the inner surface of cover plate, it is also possible to limit the light from light source
Obtained by video camera via cover plate.
In the present invention, it is provided with the first light source, sends easily anti-by the retina of the eyes of people
The light of the wavelength penetrated；And secondary light source, send and be more difficult to by retina compared with described first light source
The light of wavelength of reflection, taking the photograph of the light emission direction front of described first light source and described video camera
Image space boundary portion forwards is formed with described recess.
The energy of the light of the first light source is high, easily video camera is brought impact, therefore by the
One light source forms recess with the boundary portion of video camera such that it is able to alleviate the light from the first light source
The impact that video camera is brought.
The present invention can be configured to, and described video camera is provided with multiple, is connecing with each video camera
Near position is configured with described light source, described cover plate by the front, shooting direction of whole video cameras and
All the light emission direction front of light source collectively covers.
By arranging the cover plate whole video cameras and whole light source collectively covered, it is possible to make device
Outward appearance good.
Invention effect
The lighting camera device of the present invention, even if covering being provided with the front by video camera and light source
In the case of the cover plate of lid, it is also possible to limit the light sent from light source and propagate in cover plate and arrive
Video camera, it is possible to suppress to be directly entered video camera via cover plate from the light of light source.
Additionally, the optical axis at the optical axis and light source making video camera tilts relative to the inner surface of cover plate
In the case of configuration, it is also possible to limit the light from light source and enter into video camera.Therefore, i.e.
Make be 2 video cameras and light source adjacent thereto are configured be configured to obliquely its optical axis towards
The structure of shooting object, it is also possible to cover whole video cameras with whole by plane cover plate
Light source, it is possible to the outward appearance making device is good.
Accompanying drawing explanation
In Fig. 1, (A) is the lighting camera device involved by the first embodiment of the present invention
Top view, (B) is its front view.
Fig. 2 II-II line is by putting that the lighting camera device shown in Fig. 1 (B) cuts off
Big sectional view.
Fig. 3 is by the sectional view of a part of enlarged representation of Fig. 2.
In Fig. 4, (A), (B), (C) are that the variation to the recess being formed at cover plate is entered
The amplification view that row represents.
In Fig. 5, (A), (B) are the positions to lighting camera device Yu the eyes of object
Relation carries out the explanatory diagram showed schematically.
In Fig. 6, (A), (B) are the explanatory diagrams that the calculating to line-of-sight detection is indicated.
Fig. 7 is that the structure to the sight line detector employing lighting camera device is indicated
Block diagram.
In Fig. 8, (A) is the lighting camera device involved by second embodiment of the present invention
Front view, (B) is its side view.
Symbol description
4: cover plate
4a: inner surface
4b: outer surface
10,20: image receiving means
11a, 11b, 21a, 21b: the first light source
12a, 12b, 22a, 22b: secondary light source
13,23: video camera
15: curtain-shaped cover member
17,117: recess
44,45: image acquiring section
50: pupil image extraction unit
53: pupil center's calculating section
54: pupil footpath calculating section (judges information obtaining section)
55: corneal reflex light center test section
56: direction of visual lines calculating section
60: eyes
O1, O2: optical axis
Detailed description of the invention
Hereinafter, referring to the drawings the lighting camera device involved by embodiments of the present invention is carried out
Explain.In this embodiment, lighting camera device is examined as the sight line of vehicle-mounted grade
Survey device and use.
The structure ＞ of ＜ lighting camera device
As depicted in figs. 1 and 2, the lighting camera device 1 of embodiments of the present invention has shell
Body 2.Housing 2 is the cubic shaped that left and right directions is elongated, and front is formed with peristome 3.
The shape of peristome 3 is rectangle, and this peristome is covered by one piece of cover plate 4.Cover plate 4 by
Color, so as to transmitted infrared light but for the wave band of visible ray light transmittance reduce.
Or, cover plate 4 is light transmission, stacking make coloured film that described light transmittance reduces and
Constitute.Therefore, in the front view of (B) of Fig. 1, actually cannot transmission cover plate 4 and
The internal structure of perusal housing 2.It is accommodated with the first image receiving means in the inside of housing 2
10 and second image receiving means 20.
As it is shown in figure 1, be arranged at the optical axis of the first video camera 13 of the first image receiving means 10
13c is configured to the optical axis 23c of the second video camera 23 being arranged at the second image receiving means 20,
It is separated by predetermined distance L1.Video camera 13,23 has CMOS, and (complementary metal film is partly led
Body), the imaging apparatus such as CCD (charge coupled cell), obtain and include that the eyes of driver exist
The image of interior face.In imaging apparatus, multiple pixels of two-dimensional arrangements detect light.
As it is shown in figure 1, the first image receiving means 10 have first video camera the 13, first light source 11a,
11b and secondary light source 12a, 12b.First light source 11a and the first light source 11b is respectively provided with
There are multiple (two), the first light source 11a and the first light source 11b to clip the first video camera
The mode of 13 is configured at the both sides of left and right directions (X-direction).Secondary light source 12a and the second light
Source 12b is respectively arranged with multiple (two).Secondary light source 12a and secondary light source 12b is with folder
The mode of the both sides the first video camera 13 is configured at the left and right sides.
Left and right directions (the X of the optical axis of optical axis O1 to the first light source 11a of the first video camera 13
Direction) distance be L11a, the right and left of the optical axis of described optical axis O1 to first light source 11b
To distance be L11b.The optical axis of the optical axis O1 of the first video camera 13 to secondary light source 12a
The distance of left and right directions (X-direction) be L12a, described optical axis O1 to secondary light source 12b
The distance of left and right directions of optical axis be L12b.
As it is shown in figure 1, the second image receiving means 20 have second video camera the 23, first light source 21a,
21b and secondary light source 22a, 22b.First light source 21a is provided with multiple (two), the
The distance of the optical axis O2 of one light source 21a to second video camera 23 is L11a, the first light source 21b
It is provided with multiple (two), the optical axis O2's of the first light source 21b to second video camera 23
Distance is L11b.Secondary light source 22a is provided with multiple (two), and secondary light source 22a arrives
The distance of the optical axis O2 of the second video camera 23 is L12a.Secondary light source 22b is provided with multiple
(two), the distance of the optical axis O2 of secondary light source 22b to second video camera 23 is L12b.
In the first image receiving means 10, first light source 11a, 11b to first video camera 13
Distance L11a of optical axis O1, L11b, than secondary light source 12a, 12b to the first video camera 13
Distance L12a of optical axis O1, L12b short.In the second image receiving means 20, the first light source
21a, 21b are to distance L11a of optical axis O2 of the second video camera 23, L11b, than the second light
Source 22a, 22b are short to distance L12a of optical axis O2, the L12b of the second video camera 23.
Here, in view of the distance of lighting camera device 1 with the driver as shooting object,
Light axle base L11a, L11b of first video camera 13 and first light source 11a, 11b and
First video camera 13 is relative with light axle base L12a, L12b of secondary light source 12a, 12b
The shortest with the light axle base L1 of the second video camera 23 in the first video camera 13, therefore
One light source 11a, 11b and secondary light source 12a, 12b can regard optical axis each other as relative to
One video camera 13 is the most coaxial.Similarly, the second video camera 23 and the first light source 21a,
Light axle base L11a, L11b of 21b and the second video camera 23 and secondary light source 22a,
Light axle base L12a, L12b of 22b is relative to the first video camera 13 and the second video camera 23
Light axle base L1 the shortest, therefore first light source 21a, 21b and secondary light source 22a,
The optical axis that 22b can regard as each other is the most coaxial relative to the second video camera 23.
On the other hand, the light axle base L1 foot of the first video camera 13 and the second video camera 23
Enough long, therefore first light source 11a, 11b and secondary light source 12a, 12b and the first video camera
Each optical axis of 13, takes the photograph with first light source 21a, 21a and secondary light source 22a, 22b and second
Each optical axis of camera 23, is not the most coaxial.
First light source 11a, 12a and first light source 21a, 21b is LED light source, and configures
Become, it is possible to infrared light (near infrared light) conduct of a length of 850nm of outgoing wave (first wave length)
Detection light, and this detection light is supplied to the eyes of object.Additionally, secondary light source 12a,
12b and secondary light source 22a, 22b are also LED light sources, and are configured to, it is possible to outgoing wave
The infrared light of a length of 940nm (second wave length) is as detection light, and is supplied to by this detection light
The eyes of object.
850nm is that the intraocular absorbance of the eyes of people is low and easily by retinal reflex
Wavelength, 940nm is the absorbance height in eyeball and is difficult to by the wavelength of retinal reflex.Additionally,
The light quantity of the infrared light of the wavelength 850nm sent from first light source 11a, 11b, 21a, 21b
(luminous energy) is redder than the wavelength 940nm's sent from secondary light source 12a, 12b, 22a, 22b
The light quantity (luminous energy) of outer light is big.
Fig. 2 is the sectional view of the II-II line of Fig. 1 (B), represents and is arranged at first by as filling
Put first video camera 13 and first light source 11a, 11b and secondary light source 12a, 12b of 10
Towards.
The lighting camera device 1 of present embodiment makes as vehicle-mounted sight line detector
By, its setting place sometimes as central control board etc. relative to the driving as shooting object
Member direction of visual lines and be arranged in diagonally forward.In this case, as in figure 2 it is shown, first takes the photograph
The optical axis O1 and first light source 11a, 11b of camera 13 and the light of secondary light source 12a, 12b
Axle is not the most with right angle but at a slant to the inner surface incidence of cover plate 4.It addition, first takes the photograph
The optical axis O1 and first light source 11a, 11b of camera 13 and the light of secondary light source 12a, 12b
Axle is parallel to each other.
First light source 11a and secondary light source 12a and the first video camera 13 are compared, and are located adjacent to
The position of the inner surface 4a of cover plate 4, the first light source 11b and secondary light source 12b and first takes the photograph
Camera 13 is compared, and also is located at the position close to inner surface 4a.Optical axis O1 and inner surface 4a
Angulation becomes acute angle theta in X2 side, therefore in the first light source 11b and of X2 side
Two light source 12b are compared with the first light source 11a being positioned at X1 side and secondary light source 12a, close
First video camera 13.
As in figure 2 it is shown, set between the first video camera 13 and each first light source 11a, 11b
It is equipped with curtain-shaped cover member 15, is separated the shooting direction of the first video camera 13 by curtain-shaped cover member 15
Front and the light emission direction front of first light source 11a, 11b.Curtain-shaped cover member 15 is by such as rubber material
Material, foamed resin material etc. have the material of light-proofness and softness like that and are formed.Such as, hide
Cover parts 15 and in the way of surrounding the lens front of the first video camera 13, be formed as circular cone continuously
Shape.
Further, on the front extended line of curtain-shaped cover member 15, i.e. taking the photograph at the first video camera 13
Image space forwards with the boundary portion in the light emission direction front of first light source 11a, 11b, at cover plate
The inner surface 4a of 4 is formed with recess 17.Curtain-shaped cover member 15 is formed as surrounding the first video camera
In the case of the lens of 13, recess 17 is again formed as surrounding the front of described lens.
Or, as shown in (B) of Fig. 1, recess 17 is at the first video camera 13 and the first light
The boundary portion of source 11a and the first video camera 13 and boundary portion of the first light source 11b, it is possible to
To be continuously formed on the diagram above-below direction at (B) of Fig. 1, Jiang Gai i.e. can also be spread all over
The total length in the direction that plate 4 traverses in the width direction and be formed as linearity.
In any case, what described recess 17 was formed on the front extended line of curtain-shaped cover member 15 is attached
Closely.Recess 17 is arranged in the position not hindering the light passed through in the inner side of curtain-shaped cover member 15
Put, it is possible to the visual angle of the first video camera 13 is obtained wider.Preferably, as in figure 2 it is shown,
Be formed as the extended line of the camera side inner surface of curtain-shaped cover member 15 and the inner surface position of recess 17
On same line.
As enlarged representation in Fig. 3, the cross sectional shape of recess 17 is formed as the interior of cover plate 4
A/F 17a at the 4a of surface is wider and width dimensions towards cover plate 4 outer surface 4b by
Gradual change is narrow, and cross sectional shape is V-shape.
It is illustrated in Figure 3 the luminance of the first light source 11a.It is formed without described in supposition
During the state of recess 17, the light 33 sent from the LED luminous source 31 of the first light source 11a
A part is reflected to the housing of the substantially spherical shape covered in the front of LED luminous source 31
The inner surface etc. of 32, and it is tilted into the inside of cover plate 4.Enter into the inside of cover plate 4
Light 34 reflected at the outer surface 4b of cover plate 4, escape to cover after transmission inner surface 4a
The X2 side of parts 15.The light 35 that this spills is obtained by the first video camera 13, and first
A part for the photographed images of video camera 13 becomes over-exposed state, it is impossible to accurately take
Obtain photographed images.
Therefore, as shown in Figures 2 and 3, by before the shooting direction of the first video camera 13
Side forms recess 17 with the boundary portion in the light emission direction front of the first light source 11a such that it is able to
It is breaking at the path of the light 34 of the internal communication of cover plate 4 with recess 17 and prevents light 35 by
One video camera 13 obtains.
Optical axis at the first light source 11a be set as inner surface 4a with cover plate 4 vertically towards
Time, from the composition of more light of the first light source 11a with subvertical degree to cover plate 4
Inner surface 4a is incident, and the light component therefore forwards irradiated after transmission cover plate 4 becomes many.Another
Aspect, as shown in Figures 2 and 3, the optical axis of the first light source 11a is relative to the interior table of cover plate 4
When face 4a extends at a slant, the light sent from luminous source 31 hits inner surface 4a's at a slant
Probability uprises, and light enters into the inside of cover plate 4 and easily propagates.Therefore, as in figure 2 it is shown,
Optical axis O1 at the first video camera 13 and the optical axis from light source are for incline relative to inner surface 4a
Oblique towards structure in, strengthened by arranging the effect that described recess 17 brings, it is possible to will lid
The propagation path of the light 34 in plate 4 cuts off, it is possible to solve the over-exposed of the first video camera 13
Deng problem.
This takes the photograph with first in the direction of illumination front of the first light source 11b of the X2 side shown in Fig. 2
The boundary portion in the shooting front, direction of camera 13 is also same.The optical axis of the first light source 11b
The most obliquely towards the inner surface 4a of cover plate 4, the light therefore sent from the first light source 11b exists
Propagate in cover plate 4, be easily accessible the first video camera 13.Therefore, at the first video camera 13
With the boundary portion of the first light source 11b, near the front of extended line of curtain-shaped cover member 15 or its
When being formed with recess 17, easily prevent the light sent from the first light source 11b from entering into first and take the photograph
Camera.
In the case of first light source 11a and the first light source 11b is compared, the of X2 side
One light source 11b is far longer than the first light source of X1 side to the impact that the first video camera 13 brings
The impact that first video camera 13 is brought by 11a.Light source 11a, 11b, 12a, 12b need to the greatest extent
It is possibly close to the inner surface 4a of cover plate 4.This is because, light source 11a, 11b, 12a,
When 12b is away from inner surface 4a, being reflected at inner surface 4a from the light that these light sources send
And the light component returning to the inner space of housing 2 becomes many.
Make optical axis O1 that light source close to cover plate 4 and makes the first video camera 13 and each light source
Inclined light shaft ground towards the result of inner surface 4a, the first light source 11b of X2 side and the second light
Compared with first light source 11a of source 12b and X1 side and secondary light source 12a, it is arranged in from first
The position that video camera 13 is near.As a result of which it is, compared with the first light source 11a of X1 side, from
The light that first light source 11b of X2 side sends is exposed to the probability of the X1 side of curtain-shaped cover member 15
Higher, in the acquirement image of the first video camera 13, by the leakage from the first light source 11b
The over-exposed phenomenon of the local that light causes is susceptible to.
It is preferred, therefore, that recess 17 is at least formed at the optical axis being positioned at the first video camera 13
O1 and inner surface 4a angulation θ becomes the first light source 11b of acute angle side (X2 side)
Boundary portion with the first video camera 13.But it is more preferable to, at the first light of X1 side
Source 11a and the boundary portion of the first video camera 13 and the first light source 11b of X2 side and first image
These both sides of the boundary portion of machine 13 form recess 17.
Additionally, obtain bright pupil image to make the first light source 11a luminous, it is preferred that
First light source 11a is arranged in the optical axis O1 close proximity with the first video camera 13.And
The wavelength of the light sent from the first light source 11a is 850nm, and the energy of this light compares secondary light source
The wavelength that 12a, 12b send is the big of the light of 940nm.Therefore, by the first light source 11a
The light forming recess 17 with the boundary portion of the first video camera 13 and will send from the first light source 11a
Propagation in cover plate 4 is cut off such that it is able to prevent the excessive exposure of the local of the first video camera
Light.
It is arranged in the structure of the second image receiving means 20 of X1 side and the first image receiving means 10 on a left side
Symmetry in right direction.The optical axis O2 of the second video camera 23 and light source 21a, 21b, 22a, 22b
The incline direction of optical axis and the incline direction of optical axis O1 of the first video camera 13 identical.?
On second image receiving means 20, also at the front, shooting direction of the second video camera 23 and the first light source
The boundary portion in the light emission direction front of 21a, 21b is formed with recess 17.
The structure ＞ of ＜ sight line detector
Fig. 7 shows the circuit block diagram of sight line detector.Sight line detector is by described photograph
Bright camera head 1 and calculation control unit CC are constituted.
Calculation control unit CC is made up of the CPU of computer, memorizer, and the function of each piece is passed through
Perform preassembled software to carry out computing.
Calculation control unit CC is provided with image acquiring section 44,45, pupil image extraction unit
50, pupil center's calculating section 53, pupil footpath calculating section 54, corneal reflex light center test section
55 and direction of visual lines calculating section 56.
By not shown light source control portion, control first light source 11a, 11b, 21a, 21b
And the lighting of secondary light source 12a, 12b, 22a, 22b/non-light, by video camera 13,23
The image obtained is obtained by image acquiring section 44,45 respectively by every frame.
The image obtained by image acquiring section 44,45 is read into pupil image by every frame and carries
Take portion 50.Pupil image extraction unit 50 possesses bright pupil image test section 51 and dark pupillogram
As test section 52.
Fig. 5 be the sight line of the eyes 60 to object towards the optical axis with video camera 13,23
The relation of O1, O2 carries out the top view showed schematically.As in figure 2 it is shown, first by as filling
The optical axis O1 of the first video camera 13 and the inclined light shaft of each light source of putting 10 towards cover plate 4,
In the second image receiving means 20 also, the optical axis O2 of the second video camera 23 and the light of each light source
Axle is at a slant towards cover plate 4.Even if to this end, lighting camera device 1 is as central control board
It is arranged in the diagonally forward as the driver imaging object, it is also possible to make the first video camera 13
Both optical axis O2 of optical axis O1 and the second video camera 23 towards from lighting camera device 1 from
Open face and the eyes 60 of the object of predetermined distance.
Fig. 6 be for according to the center of pupil center and corneal reflex light calculate sight line towards
Explanatory diagram.In Fig. 5 (A) and Fig. 6 (A), the direction of visual lines VL of object towards
The optical axis O1 of the first video camera 13 and the centre of the optical axis O2 of the second video camera 23, Fig. 5
(B) direction of visual lines VL is towards the optical axis O1 direction of the second video camera 23 and in Fig. 6 (B).
Eyes 60 have cornea 61 in front, there is pupil 62 and crystalline lens 63 in its rear.
And there is retina 64 in rearmost part.
When obtaining, by video camera 13,23, the image in region including eyes, by selecting
The light source lighted, it is possible to obtain the image that the lightness of pupil 62 is different.Bright pupil image and
Dark pupil image be the difference of the lightness by the pupil 62 in image relatively represent general
Reading, when comparing 2 images, the bright image of pupil 62 is bright pupil image,
The image that pupil 62 is dark is dark pupil image.
Dark pupil image and bright pupil image are by switching first light source 11a, 11b, 21a, 21b
Luminescence and the luminescence of secondary light source 12a, 12b, 22a, 22b carry out.
The wavelength 850nm of first light source 11a, 11b, 21a, 21b is easily at retina 64
Reflection.To this end, when first light source 11a, 11b of the first image receiving means 10 has lighted,
By in the image that substantially coaxial with first light source 11a, 11b the first video camera 13 obtains,
Infrared light after being reflected by retina 64 has passed through pupil 62 and has been detected, and pupil 62 has been seen
Become clear.This image is extracted by bright pupil image test section 51 as bright pupil image.
By big with it when this has lighted about first light source 21a, 21b in the second image receiving means 20
The image causing the second coaxial video camera 23 acquirement is also same.
The wavelength 940nm of secondary light source 12a, 12b, 22a, 22b is not easy at retina 64
Upper reflection.To this end, when secondary light source 12a, 12b of the first image receiving means 10 have lighted,
By in the image that substantially coaxial with secondary light source 12a, 12b the first video camera 13 obtains,
Reflecting infrared light hardly from retina 64, pupil 62 seems dark.This image is as dark pupil
Hole pattern picture, is extracted by dark pupil image test section 52.This is in the second image receiving means 20
Obtained by the video camera 23 substantially coaxial with it when having lighted about secondary light source 22a, 22b
Image be also same.
Shooting is alternately repeated dynamic by the first image receiving means 10 and the second image receiving means 20
Make such that it is able to obtain bright pupil image and dark pupil respectively by 2 video cameras 13,23
Image, it is possible to dimensionally measure the position of pupil.
Or, by switching light source to be lighted as following, it is also possible to obtain bright pupillogram
Picture and dark pupil image.
As shown in Fig. 5 (A), the optical axis O1 of the image receiving means 10 and optical axis O2 of image receiving means
It is provided to the eyes 60 of object at different angles.
When first light source 11a, the 11b being equipped on the first image receiving means 10 has been lighted,
By the image acquired by the first video camera 13 the most coaxial with first light source 11a, 11b
In, the infrared light after retina 64 reflects easily incides video camera 13, therefore becomes pupil
Hole 62 seems bright bright pupil image.This image is as bright pupil image, by bright pupil
Hole pattern extracts as test section 51.On the other hand, the second shooting of image receiving means 20 it is arranged at
The optical axis of the optical axis O2 of machine 23 and first light source 11a, 11b of the first image receiving means 10 is non-same
Axle, therefore when first light source 11a, 11b has been lighted, even if light at retina 64 by instead
Penetrating, this light is also not easy to be detected by the second video camera 23.To this end, by the second video camera 23
The image obtained becomes pupil 62 than dark dark pupil image.This image is as dark pupillogram
Picture, is extracted by dark pupil image test section 52.
Otherwise, when first light source 21a, 21b of the second image receiving means 20 has been lighted,
Retina 64 reflection after light by pupil 62 by and along optical axis O2 easily by second
Video camera 23 detects, and the image obtained by the second video camera 23 becomes bright pupil image.This
Time, the first video camera 13 that the light after retina 64 reflects is not easy by being positioned at diagonally forward is examined
Survey, become dark pupil image by the image acquired by the first video camera 13.
That is, when have issued the detection light of phase co-wavelength, from the light source of the group close to video camera (with
The light source that video camera is coaxial) when have issued light, become bright pupil from the image acquired by this video camera
Hole pattern picture, have issued from the light source (light source non-coaxial with video camera) of the group away from video camera
Light time, become dark pupil image from the image acquired by this video camera.
This is for the secondary light source 12a of the first image receiving means 10,12b, the second image receiving means
The combination of secondary light source 22a, 22b and video camera 13,23 is also identical.
In the pupil image extraction unit 50 shown in Fig. 7, if by image receiving means 10 with by picture
Both devices 20 achieve bright pupil image and dark pupil image, then from by bright pupillogram
The bright pupil image detected as test section 51 is deducted and is detected by dark pupil image test section 52
The dark pupil image arrived.By this calculating, in bright pupil image, residual shows as the pupil become clear
The image of 62, the image beyond this is cancelled and the most invisible.
The pupil image signal being indicated the shape of pupil 62 is provided to pupil center and calculates
Go out portion 53 and pupil footpath calculating section 54.In pupil center's calculating section 53, pupil image is believed
Number binarized by image procossing, calculate the part corresponding with the shape of pupil 62 and area
Area image.Further, extract and include the ellipse of this area image, calculate the major axis of ellipse with
The intersection point of short axle is as the center of pupil 62.In pupil footpath calculating section 54, based on pupil
Hole pattern image signal, the center of the pupil 62 calculated by pupil center's calculating section 53, ellipse
The major axis of circle and short axle, calculate the pupil footpath of pupil 62.
It follows that as shown in (A), (B) of Fig. 5, during arbitrary light source point light yellow, come
Being reflected on the surface of cornea 61 from the light of this light source, this light is by the first video camera 13 and second
Both video cameras 23 obtain, and are detected by bright pupil image test section 51 and dark pupil image
Portion 52 is detected.Especially, in dark pupil image test section 52, the image of pupil 62
Ratio is dark, therefore from the reflection light amount of pip 65 reflection of cornea 61 and as luminous point
(spot) image and easily detect.
The dark pupil image signal detected by dark pupil image test section 52 is provided to angle
Film reflection light center test section 55.Comprise based on from cornea 61 in dark pupil image signal is anti-
The luminance signal of the reflection light of exit point 65 reflection.Reflection from the pip 65 of cornea 61
Photoimaging goes out Pu Kenye picture (Purkinje image), and as shown in Figure 6 at video camera
13, in the imaging apparatus of 23, obtain as the dot pattern picture of the least area.At angle
Film reflection light center test section 55, carries out image procossing to dot pattern picture, obtains from cornea
The center of the reflection light of the pip 65 of 61.
The pupil center calculated by pupil center's calculating section 53 is calculated value and passes through corneal reflex
The corneal reflex light center that light center test section 55 calculates calculates value and is provided to direction of visual lines calculation
Go out portion 56.In direction of visual lines calculating section 56, calculate value and corneal reflex light according to pupil center
Center calculates value, detection sight line towards.
In (A) of Fig. 5, the direction of visual lines VL of the eyes 60 of people is towards the first video camera
The optical axis O1 of 13 and the middle direction of the optical axis O2 of the second video camera 23.Now, such as Fig. 6
(A), shown in, the center of the pip 65 from cornea 61 is consistent with the center of pupil 62.
On the other hand, in Fig. 5 (B), the direction of visual lines VL of the eyes 60 of people is considerably
Towards left side.Now, as shown in Fig. 6 (B), the center of pupil 62 with from cornea 61
Generation position, the center skew of the pip 65 risen.
In direction of visual lines calculating section 56, calculate the center of pupil 62 and anti-from cornea 61
Air line distance α (Fig. 6 (B)) at the center of exit point 65.In addition set pupil 62
Center, as the X-Y coordinate of initial point, calculates in the center of pupil 62 and pip 65
The inclination angle beta of line and X-axis that the heart is connected.Obtain based on by 2 video cameras 13,23
Image calculate described air line distance α and described inclination angle beta, thus calculate direction of visual lines
VL。
＜ variation ＞
Hereinafter variation is illustrated.
In the variation shown in Fig. 4 (A), fill in the recess 17 being formed at cover plate 4
There is light absorbing material 71.Light absorbing material 71 can absorb and send from the first light source 11a
The material of infrared light, be preferable to absorb the first light source 11a and secondary light source 12b this two
The wavelength of the light of side.Light absorbing material 71 is such as constituted based on material with carbon element.
By filling light absorbing material 71 at recess 17, it is possible to prevent light at recess 17
The reflection of surface, easily limit light and propagate in cover plate 4.
In the variation shown in (B), (C) of Fig. 4, it is formed at the recess of cover plate 4
The cross sectional shape of 117 is generally trapezoidal.The cross sectional shape of this recess 117 also, at inner surface
A/F at 4a is wider and A/F is along with becoming narrow gradually towards outer surface 4b.
So, by the cross sectional shape of recess 17,117 is formed as opening at inner surface 4a
Mouthful wider width and A/F are along with becoming narrow gradually towards outer surface 4b, thus at cover plate
When the light propagated in 4 hits the boundary face of recess 17,117, easily make the reflection direction court of light
Exterior surface 4b direction.
＜ the second embodiment ＞
In the second embodiment shown in (A), (B) of Fig. 8, first by as filling
Putting 10 and second this two side of image receiving means 20, the peripheral cyclic at video camera 13 is arranged
There is light source 11,12.Light source 11 sends the light of the wavelength of 850nm, and light source 12 sends 940nm
The light of wavelength.Curtain-shaped cover member 15 stretches out in the front of video camera 13, at video camera 13
The boundary portion in the light emission direction front of front and each light source 11,12, at the interior table of cover plate 4
Face 4a is formed with recess 17.In the case, recess 17 is to surround the front of video camera 13
Mode be formed as ring-type.
Claims (7)
1. a lighting camera device, has: video camera, obtains the image of shooting object；And it is many
Individual light source, provides detection light to shooting object, and described lighting camera device is characterised by,
It is provided with common to the shooting front, direction of described video camera and the light emission direction front of described light source
The cover plate of the light transmission covered, at the interior table opposed with described video camera and described light source of described cover plate
Face is formed with recess,
Before described recess is formed at the shooting front, direction of described video camera and the light emission direction of described light source
The boundary portion of side.
2. lighting camera device as claimed in claim 1, wherein,
Being provided with curtain-shaped cover member between the inner surface of described video camera and described cover plate, described recess is joined
Put in the prolongation of described curtain-shaped cover member near maybe this prolongation.
3. lighting camera device as claimed in claim 1, wherein,
The cross sectional shape of described recess is as from the described inner surface of described cover towards outer surface side
To and shape that A/F gradually decreases.
4. lighting camera device as claimed in claim 1, wherein,
Being filled with light absorbing material in described recess, this light absorbing material is for absorbing from described light source
The light sent.
5. lighting camera device as claimed in claim 1, wherein,
The inclined light shaft ground of the optical axis of described video camera and described light source towards described cover described in
Surface, described light source is arranged in than the lens of described video camera closer to the position of described inner surface,
Luminescence at the light source that the optical axis of described video camera configures with the side of described inner surface formation acute angle
Front, direction and the boundary portion in the shooting front, direction of described video camera, be formed with described recess.
6. lighting camera device as claimed in claim 1, wherein,
Described light source has the first light sending the easily light of the wavelength of retinal reflex by the eyes of people
Source and send the secondary light source being more difficult to the light by the wavelength of retinal reflex compared with described first light source,
Boundary portion shape in the light emission direction front of described first light source with the shooting front, direction of described video camera
Become to have described recess.
7. lighting camera device as claimed in claim 1, wherein,
Described video camera is provided with multiple, is being configured with described light source with each video camera close proximity,
The shooting front, direction of whole video cameras and the light emission direction front of whole light source are covered by described cover plate jointly
Lid.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2014-176149 | 2014-08-29 | ||
| JP2014176149A JP6360752B2 (en) | 2014-08-29 | 2014-08-29 | Illumination imaging device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106137117A true CN106137117A (en) | 2016-11-23 |
Family
ID=55658773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510193867.8A Pending CN106137117A (en) | 2014-08-29 | 2015-04-22 | Lighting camera device |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP6360752B2 (en) |
| CN (1) | CN106137117A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019000135A (en) * | 2017-06-09 | 2019-01-10 | 株式会社豊田中央研究所 | Visual line measurement device |
| CN109799610A (en) * | 2017-11-16 | 2019-05-24 | Aptiv技术有限公司 | Eye tracking apparatus |
| CN113520302A (en) * | 2019-01-30 | 2021-10-22 | 北京大学第三医院（北京大学第三临床医学院） | Ophthalmologic photographing method |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018181025A (en) * | 2017-04-17 | 2018-11-15 | アルプス電気株式会社 | Sight line detecting device |
| US11202567B2 (en) * | 2018-07-16 | 2021-12-21 | Verily Life Sciences Llc | Retinal camera with light baffle and dynamic illuminator for expanding eyebox |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06269412A (en) * | 1993-03-19 | 1994-09-27 | Canon Inc | Line-of-sight detector and optical device provided with the same |
| JPH10165371A (en) * | 1996-12-09 | 1998-06-23 | Niles Parts Co Ltd | Sight line measuring device |
| US20090087043A1 (en) * | 2007-09-27 | 2009-04-02 | Mitsumi Electric Co., Ltd. | Image Reading Apparatus and Image Reading Method |
| JP2010096716A (en) * | 2008-10-20 | 2010-04-30 | Nikon Corp | Infrared camera |
| JP2011048468A (en) * | 2009-08-25 | 2011-03-10 | Sharp Corp | Optical pointing device and electronic equipment loaded with the same device |
| CN103018999A (en) * | 2011-09-28 | 2013-04-03 | 鸿富锦精密工业（深圳）有限公司 | Taking lens hood structure |
| CN103116420A (en) * | 2011-11-16 | 2013-05-22 | 夏普株式会社 | Optical pointing device and electronic device including same |
| US20130188834A1 (en) * | 2010-08-09 | 2013-07-25 | Yoshinobu Ebisawa | Gaze point detection method and gaze point detection device |
| CN203275849U (en) * | 2013-05-22 | 2013-11-06 | 河南铭视安防工程有限公司 | Hemisphere camera |
| CN103929566A (en) * | 2013-01-15 | 2014-07-16 | 富士通株式会社 | Biometric Information Image-capturing Device And Biometric Authentication Apparatus |
| WO2014123241A1 (en) * | 2013-02-08 | 2014-08-14 | スカラ株式会社 | Eyeball imaging device |
| CN204993577U (en) * | 2015-07-27 | 2016-01-20 | 深圳市乐视视频技术有限公司 | Camera with separate optical assembly |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2375679A (en) * | 2001-04-09 | 2002-11-20 | Patrick Kerr | Retinal function camera using plural light wavelengths to produce a retinal function image showing haemoglobin oxygenation. |
| JP3979522B2 (en) * | 2002-02-21 | 2007-09-19 | シャープ株式会社 | Camera device and monitoring system |
| JP2006098847A (en) * | 2004-09-30 | 2006-04-13 | Showa Electric Wire & Cable Co Ltd | Photographing apparatus with illumination |
| JP4679123B2 (en) * | 2004-11-26 | 2011-04-27 | 株式会社コーナン・メディカル | Photorefractor |
-
2014
- 2014-08-29 JP JP2014176149A patent/JP6360752B2/en not_active Expired - Fee Related
-
2015
- 2015-04-22 CN CN201510193867.8A patent/CN106137117A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06269412A (en) * | 1993-03-19 | 1994-09-27 | Canon Inc | Line-of-sight detector and optical device provided with the same |
| JPH10165371A (en) * | 1996-12-09 | 1998-06-23 | Niles Parts Co Ltd | Sight line measuring device |
| US20090087043A1 (en) * | 2007-09-27 | 2009-04-02 | Mitsumi Electric Co., Ltd. | Image Reading Apparatus and Image Reading Method |
| JP2010096716A (en) * | 2008-10-20 | 2010-04-30 | Nikon Corp | Infrared camera |
| JP2011048468A (en) * | 2009-08-25 | 2011-03-10 | Sharp Corp | Optical pointing device and electronic equipment loaded with the same device |
| US20130188834A1 (en) * | 2010-08-09 | 2013-07-25 | Yoshinobu Ebisawa | Gaze point detection method and gaze point detection device |
| CN103018999A (en) * | 2011-09-28 | 2013-04-03 | 鸿富锦精密工业（深圳）有限公司 | Taking lens hood structure |
| CN103116420A (en) * | 2011-11-16 | 2013-05-22 | 夏普株式会社 | Optical pointing device and electronic device including same |
| CN103929566A (en) * | 2013-01-15 | 2014-07-16 | 富士通株式会社 | Biometric Information Image-capturing Device And Biometric Authentication Apparatus |
| WO2014123241A1 (en) * | 2013-02-08 | 2014-08-14 | スカラ株式会社 | Eyeball imaging device |
| CN203275849U (en) * | 2013-05-22 | 2013-11-06 | 河南铭视安防工程有限公司 | Hemisphere camera |
| CN204993577U (en) * | 2015-07-27 | 2016-01-20 | 深圳市乐视视频技术有限公司 | Camera with separate optical assembly |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019000135A (en) * | 2017-06-09 | 2019-01-10 | 株式会社豊田中央研究所 | Visual line measurement device |
| CN109799610A (en) * | 2017-11-16 | 2019-05-24 | Aptiv技术有限公司 | Eye tracking apparatus |
| CN113520302A (en) * | 2019-01-30 | 2021-10-22 | 北京大学第三医院（北京大学第三临床医学院） | Ophthalmologic photographing method |
Also Published As
| Publication number | Publication date |
|---|---|
| JP6360752B2 (en) | 2018-07-18 |
| JP2016051318A (en) | 2016-04-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106137117A (en) | Lighting camera device | |
| CN105852798B (en) | Wide area fundus camera | |
| JP6346525B2 (en) | Gaze detection device | |
| ES2553441T3 (en) | Strabismus Detection | |
| KR101902283B1 (en) | Camera sensing device for obtaining three-dimensional information of object and virtual golf simulation apparatus using the same | |
| CN106663183A (en) | Eye tracking and user reaction detection | |
| CN109471523A (en) | Use the eye tracks of eyeball center | |
| CN107852474A (en) | Head mounted display | |
| CA3030314A1 (en) | A system and method for preventing sight deterioration caused by near work with devices with electronic screens | |
| JP6462209B2 (en) | Measuring device and measuring method | |
| TWI468148B (en) | Auxiliary gaze and imaging focusing device | |
| CN106061367A (en) | Ocular fundus imaging systems, devices and methods | |
| US20180214022A1 (en) | Computer-implemented method for detecting a corneal vertex | |
| JP2010187746A (en) | Fundus camera | |
| CN108140244A (en) | Sight line detector and method for detecting sight line | |
| GB2496005A (en) | Method for detecting strabismus in images of the eyes | |
| JP5626039B2 (en) | Gaze detection apparatus and gaze detection method | |
| CN206505382U (en) | Binocular stereo vision ophthalmogyric device in a kind of VR/AR | |
| JP2017064094A (en) | Vein visualization device | |
| JP2016049259A (en) | Visual axis detecting apparatus | |
| JP2012115505A (en) | Visual line detection device and visual line detection method | |
| US20200029808A1 (en) | Real-time removal of ir led reflections from an image | |
| JP6555707B2 (en) | Pupil detection device, pupil detection method, and pupil detection program | |
| CN109587471A (en) | Image display system, image display method and image display program | |
| WO2021074960A1 (en) | Image processing method, image processing device, and image processing program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161123 |