US5714988A - Camera capable of detecting eye-gaze - Google Patents
Camera capable of detecting eye-gaze Download PDFInfo
- Publication number
- US5714988A US5714988A US08/472,726 US47272695A US5714988A US 5714988 A US5714988 A US 5714988A US 47272695 A US47272695 A US 47272695A US 5714988 A US5714988 A US 5714988A
- Authority
- US
- United States
- Prior art keywords
- eye
- gaze
- camera
- line
- detection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B13/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B13/02—Viewfinders
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/287—Systems for automatic generation of focusing signals including a sight line detecting device
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B2213/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B2213/02—Viewfinders
- G03B2213/025—Sightline detection
Definitions
- This invention relates to a camera provided with eye-gaze detecting means suitable for use, for example, in a camera such as a still camera or a video movie camera endowed with the function of detecting an eye-gaze position in the photographing picture plane (of various positions in the photographing plane, the position of the portion the user is gazing at) and controlling the auto focusing operation of a photo-taking lens or controlling the exposure of film or an image pickup element.
- cameras of this kind there are known cameras in which what portion in the photographing picture plane the photographer should recognize as the main object is determined on the basis of the result of the eye-gaze detection and a photo-taking lens is driven by the use of an information value representative of the focus detection state corresponding to the object in the determined portion to thereby effect so-called auto focusing.
- cameras in which automatic exposure control is effected by the use of an information value representative of the luminance of an object in the portion recognized as the main object on the basis of the eye-gaze detection such cameras are disclosed, for example, in Japanese Laid-Open Patent Application No. 63-94232, Japanese Laid-Open Patent Application No. 1-241511 and Japanese Laid-Open Patent Application No. 2-5).
- a plurality of focus detection areas 1-3 are set in the photographing picture plane 10. Also assume that when the photographer gazes at between the focus detection area 1 and the focus detection area 2, the focus detection area nearer to the eye-gaze point is selected and a photo-taking lens is driven on the basis of an information value representative of the focus detection state in that area. Assuming that in the case of such a camera, the photographer's eye-gaze point is near the intermediate point a between the focus detection area 1 and the focus detection area 2 and, as shown in FIG.
- the object distance D1 in the area 1 and the object distance D2 in the area 2 differ greatly from each other, the selected focus detection area will change over from the area 1 to the area 2 or from the area 2 to the area 1 simply if the eye-gaze point slightly moves unconsciously to right and left near the point a (the gaze of the human eye moves involuntarily even if one is gazing at one point).
- the photo-taking lens is reciprocally driven between driven positions R1 and R2 as shown in FIG. 9 of the accompanying drawings, and this results in the waste of electric power. This is a problem which will likewise arise when the vicinity of the intermediate point b between the focus detection areas 2 and 3 is gazed at.
- the selected focus detection area will change over when the eye-gaze passes the point a and the point b and therefore, in conformity therewith, the driving of the photo-taking lens will take place suddenly.
- the object distance focused in a photographed moving image varies suddenly and therefore, that moving image becomes very unnatural one.
- a photometry area corresponding to the photographer's eye-gaze point is selected and exposure is determined on the basis of the luminance information in that area.
- the photographer's eye-gaze point is near the intermediate point a between the photometry area 11 and the photometry area 12 and, as shown in FIG.
- the object luminance B1 in the area 11 and the object luminance B2 in the area 12 differ greatly from each other, the selected photometry area will change over from the area 11 to the area 12 or from the area 12 to the area 11 simply if the eye-gaze point slightly moves unconsciously to right and left near the point a. Accordingly, simply if in spite of having gazed at a single object present near the eye-gaze point a, the photographer slightly moves the eye-gaze point, the exposure amount as the result of automatic exposure control may greatly vary to E1 and E2 as shown in FIG. 12 of the accompanying drawings. This is a problem which will likewise arise when the vicinity of the intermediate point b between the photometry areas 12 and 13 is gazed at.
- the selected photometry area will change over when the eye-gaze passes the point a and the point b and therefore, in conformity therewith, the exposure amount controlled will vary suddenly.
- the brightness of photographed moving images varies suddenly and unnaturally.
- FIG. 1 is a schematic view showing the internal structure of a camera provided with eye-gaze detecting means according to an embodiment of the present invention.
- FIG. 2 is a graph showing the relation between the eye-gaze point by the camera of the FIG. 1 embodiment and weighting coefficients.
- FIG. 3 is a graph showing the relation between the eye-gaze point and the lens driven position.
- FIG. 4 is a schematic view showing the internal structure of a camera provided with eye-gaze detecting means according to another embodiment of the present invention.
- FIG. 5 is a graph showing the relation between the eye-gaze point by the camera of the FIG. 4 embodiment and weighting coefficients.
- FIG. 6 is a graph showing the relation between the eye-gaze point and the exposure amount.
- FIG. 7 shows the positions of focus detection areas and two particular eye-gaze points in the photographing picture plane.
- FIG. 8 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 7 and focus detection state information (object distance information).
- FIG. 9 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 7 and the lens driven position.
- FIG. 10 shows the positions of photometry areas and two particular eye-gaze points in the photographing picture plane.
- FIG. 11 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 10 and object luminance information.
- FIG. 12 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 10 and the exposure amount.
- FIG. 13 is a conceptional diagram of still another embodiment of the present invention.
- FIG. 14 is a block diagram of the FIG. 13 embodiment.
- FIG. 15 shows the divided patterns of the photometry areas and eye-gaze detection areas in the photographing picture plane of the FIG. 13 embodiment.
- FIG. 16 is a flow chart showing the operation of a CPU in the FIG. 13 embodiment.
- FIG. 17 is a block diagram of yet still another embodiment of the present invention.
- FIGS. 18A to 18C show the divided patterns of focus detection areas (distance measuring areas and eye-gaze detection areas in the photographing picture plane of the FIG. 17 embodiment.
- FIG. 19 is a flow chart showing the photographing operation of the FIG. 17 embodiment.
- FIG. 20 is a flow chart showing an example of the subroutine of FIG. 19.
- FIG. 21 is a flow chart showing another example of the subroutine of FIG. 19.
- FIG. 22 shows an example in which the divided patterns of the-eye-gaze detection areas of FIG. 15 have been changed.
- FIG. 1 shows the internal structure of a camera according to an embodiment of the present invention. This camera effects automatic focus adjustment on the basis of the result of eye-gaze detection.
- the reference numeral 21 designates an eye-gaze detecting device for detecting the photographer's eye-gaze point in the photographing picture plane 10.
- the eye-gaze detecting device 21 is contained in a housing 22.
- the reference numeral 23 denotes a focus detecting apparatus for the camera.
- the focus detecting apparatus 23 is provided below the eye-gaze detecting device 21 and is contained in the housing 22.
- This focus detecting apparatus has contained therein a first calculating device (not shown) for calculating information values (information values relating to the object distances in a plurality of areas 1-3 in the photographing picture plane 10) D1-D3 representative of the focus detection states of a photo-taking lens 24 corresponding to the plurality of focus detection areas 1-3 (FIG. 7) in the photographing picture plane 10.
- the reference numeral 25 designates a control device for controlling the amount of driving of the photo-taking lens 24 by a mean information value D calculated by itself.
- the control device 25 is connected to the focus detecting apparatus 23 and the eye-gaze detecting device 21.
- the mean information value D is calculated in the following manner by a second calculating device (not shown) contained in the control device 25.
- the reference numeral 26 denotes a motor for moving the photo-taking lens 24 in the direction of the optical axis thereof, and the reference numeral 27 designates a sub-mirror for directing a light beam transmitted through a half-mirror 28 to the focus detecting apparatus 23.
- the reference numeral 29 denotes a pentaprism, and the reference numeral 30 designates a finder screen.
- the eye-gaze point is at a point c indicated in the abscissa of FIG. 2, when the weighting coefficients k1-k3 for this eye-gaze point c are determined in accordance with the coefficient characteristic lines of FIG. 2, they are 0.65, 0.35 and 0, respectively, as indicated in the ordinate of FIG. 2.
- the information values D1-D3 representative of the focus detection states in the focus detection areas 1-3 are values greatly differing from one another as shown in FIG. 8, the mean information value D is as follows: ##EQU1##
- the present embodiment has been shown with respect to a case where there are three focus detection areas 1-3, the present invention is not restricted thereto. There may be two focus detection areas, or four or more focus detection areas. Where there are four or more focus detection areas, the lens driving will be effected more smoothly.
- information values representative of the focus adjusted states of the photo-taking lens corresponding to the focus detection areas 1-n in the photographing picture plane are D1, D2, . . . , Dn
- the weighting coefficients of the focus detection areas 1-n are k1, k2, . . . kn.
- the above-mentioned information values D1-D3 indicative of the focus detection states need not always correspond strictly to the object distances. Even information values (information from which can be known a rough standard of the amount of driving of the photo-taking lens necessary for focus adjustment and the direction of driving thereof) indicative of the amount and direction (front focus or rear focus) of defocus of the object image by the photo-taking lens can be applied to the present embodiment. In such case, if the detection of the information values and the calculation of the mean information value are repetitively effected while the photo-taking lens is driven, proper focus adjustment will be possible.
- the present invention is not restricted thereto, but design may be made such that automatic zooming is effected in the following manner on the basis of the mean information value D. That is, a motor for zooming is controlled so that the greater becomes the distance corresponding to the mean information value D, the more the photo-taking lens may be zoomed up and and so that the smaller becomes said distance, the more the photo-taking lens may be zoomed down, whereby the size of the object in the photographing picture plane can be made constant irrespective of the object distance.
- This camera effects automatic exposure control on the basis of the result of eye-gaze detection.
- FIG. 4 is a schematic view showing the internal structure of the camera according to this embodiment.
- the reference numeral 31 designates an eye-gaze detecting device for detecting the photographer's eye-gaze point in the photographing picture plane 10.
- the eye-gaze detecting device 31 is contained in a housing 32.
- the reference numeral 33 denotes a photometry device for the camera.
- the photometry device 33 is provided above the eye-gaze detecting device 31 and is contained in the housing 32.
- This photometry device 33 has contained therein a first calculating device (not shown) for calculating information values B1-B3 representative of object luminances in a plurality of photometry areas 11-13 (FIG. 10) in the photographing picture plane 10.
- the reference numeral 34 designates a control device for controlling the shutter speed of a shutter 35 and the amount of aperture of a stop 36 on the basis of a mean information value B calculated by itself.
- the control device 34 is connected to the photometry device 33 and the eye-gaze detecting device 31.
- the mean information value B is calculated in the following manner by a second calculating device (not shown) contained in the control device 34.
- the reference numeral 37 denotes a mirror
- the reference numeral 38 designates a pentaprism
- the reference numeral 39 denotes a finder screen
- the reference numeral 40 designates a photo-taking lens.
- the eye-gaze point is at a point c indicated in the abscissa of FIG. 5, when the weighting coefficients k11-k13 for this eye-gaze point c are determined in accordance with the coefficient characteristic lines of FIG. 5, the are 0.65, 0.35 and 0, respectively, as shown in the ordinate of FIG. 5.
- the mean information value B is as shown below. ##EQU2##
- FIGS. 13 to 16 show a camera according to still another embodiment of the present invention. This camera effects automatic exposure on the basis of the result of eye-gaze detection.
- the gaze position of the photographer's eye looking into the finder is detected time-serially.
- the amount of eye-gaze at each photometry area is measured.
- the object luminance in each zone is measured.
- weighting based on the amount of eye-gaze at each zone obtained at the step 132 is effected to the object luminance at each zone obtained at the step 133.
- a mean exposure value is calculated on the basis of the result of said weighting.
- the exposure calculating device in this embodiment is comprised chiefly of a control unit (CPU) 141 for controlling the system of the camera, and the CPU 141 has connected thereto the outputs from a release button 142, an eye-gaze detecting device 143 and a divisional photometry device 144.
- the output of the CPU 141 is connected to an indicator 145 and an exposure control device 146.
- the eye-gaze detecting device 143 and the divisional photometry device 144 divide the interior of the finder into five zones 151-155, i.e., the central portion, the top left portion, the top right portion, the bottom left portion and the bottom right portion, during photographing and effect eye-gaze detection and photometry, respectively, at each of the zones 151-155.
- the release button 142 is provided on a camera body, not shown, and by the photographer depressing the release button 142, a signal for photographing direction or the like is output to the CPU 141.
- the eye-gaze detecting device 143 is a device for detecting in which of the zones 151-155 the photographer's eye-gaze in the finder is positioned.
- the eye-gaze detecting device 143 use can be made, for example, of a device which applies infrared illuminating light to the photographer's eye and detects the position of the eye-gaze by the reflected image from the cornea or the crystal lens (for example, the device disclosed in Japanese Laid-Open Patent Application No. 1-274736).
- the divisional photometry device 144 is a device for measuring the object luminance in the finder at each of the zones 151-155 shown in FIG. 15, and it outputs the obtained luminance information to the CPU 141, which thus calculates the exposure value.
- the indicator 145 is a device for indicating the eye-gaze point position detected by the eye-gaze detecting device 143 and the exposure value calculated by the CPU 141.
- the exposure control device 146 is a device for controlling a shutter 147 and a stop 148 during photographing in conformity with the exposure value calculated by the CPU 141.
- n at #100 is a variable representative of the frequency of eye-gaze detection and is first set to 0.
- n+1 is substituted for n, and at #102, the first eye-gaze position detection is effected (this corresponds to the step 132 of FIG. 13).
- the photographer's eye-gaze position is represented by X-Y coordinates having the center of the finder as the origin, and the coordinates data is defined as Dn(X, Y).
- the detection of the eye-gaze position is effected 500 times at intervals of 5 ms, and the routine of #102-#103 is executed until n reaches 500 times as shown at #103.
- the routine of #102-#103 is executed until n reaches 500 times as shown at #103.
- shift is made to #104.
- B(I) is a variable representative of the luminance of each of the zones 151-155
- I is a number indicative of the correspondence to the five zones
- 1-5 are allotted as I to the zones 151-155.
- the block II comprising #105-#109 is a block for the eye-gaze detection after the aforedescribed 500 times of eye-gaze detection have been effected.
- the 501st eye-gaze position detection is effected and the coordinates data thereof is defined as D 501 (X, Y). Then at #106, the first coordinates data D 1 (X, Y) is erased, whereby the renewal of data is effected and stored in the CPU 141.
- #107 and #108 perform operations similar to the aforedescribed #100 and #101, and #109 shows that as described previously in connection with #106, the coordinates data D n+1 (X, Y) of the obtained eye-gaze position is replaced by coordinates data D n (X, Y).
- the coordinates data of the eye-gaze position are sequentially renewed to the newest data, and the number of the coordinates data are always kept at 500. Accordingly, even when much time is put in framing or the like, the coordinates data of the newest eye-gaze position is obtained.
- the eye-gaze frequency Q(I) for the five zones 151-155 is calculated from the obtained coordinates data of the eye-gaze position, and before that, at #110, Q(I) is set to the initial value 0.
- I is a number indicative of the correspondence to the five zones, and 1-5 are allotted as I to the zones 151-155.
- Shift is then made to a block III for calculating the eye-gaze frequency for each zone.
- the block III comprises #111-#121, and is a block for discriminating which of the zones 151-155 the respective ones of the 500 coordinates data D n (X, Y) detected in the aforedescribed blocks I and II belong to.
- the routine of #111-#121 is repeated until as shown at #121, the frequency of eye-gaze detection reaches 500 times, and the frequency discriminated for each zone becomes the frequency Q(I) corresponding to the final zones 151-155.
- weighting is effected to the exposure value B by the following equation (this corresponds to the steps 134 and 135 of FIG. 13). ##EQU3##
- each of Q(1)-Q(5) is divided by 500 to thereby find the proportion of eye-gaze times paid to the zones 151-155, and this proportion is multiplied by the object luminance B(I) for each zone measured at #104 to thereby find the arithmetical mean, and weighting is effected to the exposure value B. Therefore, the exposure value B is determined by the photographer's eye-gaze times to the zones 151-155, and the photographer's intention is sufficiently reflected upon exposure control.
- the shapes of the divided zones for effecting photometry and the divided zones for eye-gaze detection are the same, but they need not always be the same, for example, the divided zones for eye-gaze detection may be made narrower than the divided zones for photometry so as to be included in the divided zones for photometry. Also, the divided zones for photometry may be further subdivided than in FIG. 15.
- FIG. 22 shows an example in which the eye-gaze detection areas are made narrower than the photometry areas.
- the eye-gaze detection areas comprise horizontally 12 divisions ⁇ vertically 8 divisions, totalling to 96 divisions.
- These eye-gaze detection areas as indicated by thick lines in FIG. 22, are approximated to the divided shapes of the photometry areas 151-155 of FIG. 15 and are grouped for use for said weighting.
- the control as described in connection with FIGS. 5 and 6 will also become possible by using the result of the detection of the eye-gaze detection areas correspondingly to the focus detection areas differing in divided shape from the photometry areas 151-155, for example, the focus detection areas 1-3 of FIG. 7. If this is done, automatic exposure control and automatic focus adjustment can be accomplished on the basis of the output of a single eye-gaze detecting device and therefore, construction will become simple.
- the weighting of the exposure value B may be calculated by the use of the following equation, instead of the aforementioned equation. ##EQU4##
- weighting to each photometric output is effected by the moment of the square of the eye-gaze continuation time and therefore, as compared with the case of #22, more importance can be attached to the areas which are gazed at for a long time.
- eye-gaze detection is effected at predetermined time (5 milliseconds) intervals and therefore, the result is the eye-gaze continuation time for each area within a predetermined time before photographing.
- this can also be said to be a frequency indicative of how many times of the predetermined times (500 times) of eye-gaze detection each area has been gazed.
- the present invention is not restricted thereto, but also covers counting a simple eye-gaze frequency (number of times) which does not take the time element into account.
- FIGS. 17 to 21 Still another embodiment of the present invention is shown in FIGS. 17 to 21.
- FIG. 17 shows a block diagram of a camera according to the present embodiment, which is comprised of a CPU 171, a distance measuring portion 172, an eye-gaze detecting portion 173, an eye-gaze continuation time measuring portion 174 and a driving portion 175.
- the CPU 171 is a control device for effecting the various controls of the camera.
- the distance measuring portion 172 measures the object distances in distance measuring areas obtained by dividing the photographing picture plane.
- the eye-gaze detecting portion 173 detects which portion of eye-gaze detection areas obtained by dividing the photographing picture plane the photographer is gazing at.
- the eye-gaze continuation time measuring portion 174 includes a counter and measures the eye-gaze continuation time for each eye-gaze detection area detected by the eye-gaze detecting portion 173.
- the counter counts the clock pulses generated by the CPU 171 while a certain eye-gaze detection area is gazed at, and the CPU 171 stores therein this count number for each eye-gaze detection area. By reading this stored count number, the eye-gaze continuation time for each area can be found.
- the driving portion 175 is a driving device for driving the lens on the basis of distance information.
- FIGS. 18A to 18C are illustrations showing the eye-gaze detection areas of the eye-gaze detecting portion 173 and the distance measuring areas of the distance measuring device for the photographing picture plane of the camera of the present embodiment.
- FIG. 18A shows an example in which the photographing picture is divided horizontally into three
- FIG. 18B shows an example in which the photographing picture plane is divided vertically into three and divided horizontally into five, thus being overall divided into fifteen.
- areas partitioned by solid lines indicate distance measuring areas
- areas partitioned by broken lines indicate eye-gaze detection areas.
- the distance measuring areas are provided by dividing the photographing picture plane both vertically and horizontally into three, thus into nine in total, and the eye-gaze detection areas indicate detection areas for the eye-gaze position provided by further dividing the distance measuring areas into nine, thus overall into eighty-one.
- the detection areas of the distance measuring device and the detection areas for the eye-gaze position are not limited to those described above.
- FIG. 19 is a flow chart showing the photographing operation of the camera of the present embodiment. This photographing operation is started by depressing the shutter release button.
- a step S1 photometry is effected and the photometric value is memorized.
- a step S2 the distance measurement of the individual distance measuring areas shown in FIG. 18 is effected by the distance measuring portion 172 and each distance measurement value is memorized.
- the photographer's eye-gaze position is detected by the eye-gaze detecting portion 173. This detection is effected for a predetermined time (e.g. 1 second).
- the eye-gaze continuation time detected at the step S3 is output by the eye-gaze continuation time measuring portion 174.
- the photographing distance is determined with the eye-gaze continuation time at each eye-gaze detection area taken into account. This will be described later in greater detail.
- the photo-taking lens is driven so as to be focused to the photographing distance determined at the step S5, whereafter exposure is effected on the basis of the photometric value obtained at the step S1, and post-exposure processes such as film advance and shutter charge are carried out, thus terminating the photographing operation.
- FIG. 20 is a flow chart of a subroutine showing the substance of the process of determining the photographing distance to which the photo-taking lens is focused at the step S5.
- the eye-gaze detection zone P 1 of the longest eye-gaze continuation time is selected from among the eye-gaze positions selected at the step S10.
- the distance measurement value of the distance measuring area corresponding to the eye-gaze detection zone P 1 and the distance measurement value or values corresponding to one or more other eye-gaze detection zones for which the difference in eye-gaze continuation time from the eye-gaze detection zone P 1 is within the predetermined value t 1 are compared with one another, whereby the information of the closest object distance is selected as the photographing distance.
- weighting mean conforming to the eye-gaze continuation time for each zone is effected to the distance measurement-value of the distance measuring zone corresponding to the eye-gazed detection zone P 1 and the distance measurement value or values corresponding to one or more other eye-gaze detection zones for which the difference in eye-gaze continuation time from the eye-gaze detection zone P 1 is within the predetermined value t 2 , and the result of it is adopted as the photographing distance.
- the distance measurement value corresponding to the eye-gaze detection zone P 1 is determined as the photographing distance. This is because the eye-gaze continuation time for the eye-gaze detection zone P 1 is longer beyond the predetermined value t 2 than the eye-gaze continuation time for each of the other eye-gaze detection areas and therefore the eye-gaze detection area P 1 can be regarded as the main object on which the photo-taking lens should be focused.
- FIG. 21 is a flow chart of the subroutine showing another example of the process of the step S5 of the present embodiment.
- Steps S20 to S24 are the same as the steps S10 to S14 of FIG. 20.
- the photographing distance is set so that the photo-taking lens may be focused without fail on an object which is at the distance measurement value corresponding to the eye-gaze detection zone P 1 and an object or objects corresponding to an object or objects which are at the distance measurement value or values of one or more other eye-gaze detection zones for which the difference in eye-gaze continuation time exceeds the predetermined value t 1 and is within the predetermined value t 2 may also be within the depth of field as far as possible.
- the depth of field is enlarged. This enlargement of the depth of field is accomplished by stopping down, but the amount of the stopping down is limited within a range in which underexposure and the hand vibration by a reduction is shutter speed do not occur.
- a step S26 and subsequent steps are the same as the step S16 and subsequent steps of FIG. 20.
- the ratio between the horizontal dimension and vertical dimension of each eye-gaze detection area is smaller than the ratio between the horizontal dimension and vertical dimension of the photographing picture plane. This shows that the resolving power in the horizontal direction of eye-gaze detection is higher than the resolving power in the vertical direction. Since the human eye moves more often in the horizontal direction than in the vertical direction, it is advantageous to make the resolving power in the horizontal direction of eye-gaze detection higher.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Automatic Focus Adjustment (AREA)
- Exposure Control For Cameras (AREA)
- Focusing (AREA)
Abstract
A camera includes a photo-taking lens, an automatic focus adjusting device for effecting the automatic focus adjustment of the photo-taking lens, an eye-gaze detecting device for detecting the photographer's eye-gaze position in a finder field corresponding to a photographing picture plane, and producing an eye-gaze detection signal corresponding to the eye-gaze position, a focus adjustment signal producing device for outputting a plurality of focus adjustment signals corresponding to a plurality of detection areas in the photographing picture plane, and a control signal producing device for producing a control signal for controlling the automatic focus adjusting means, on the basis of the eye-gaze detection signal and the focus adjustment signals. The control signal producing device produces the control signal on the basis of the plurality of focus adjustment signals corresponding to the plurality of detection areas when the eye-gaze position indicated by the eye-gaze detection signal is at a position between the plurality of detection areas.
Description
This is a division of application Ser. No. 08/210,293 filed Mar. 18, 1994, now abandoned, which is a division of application Ser. No. 07/773,726 filed Oct. 9, 1991 (now U.S. Pat. No. 5,333,029).
1. Field of the Invention
This invention relates to a camera provided with eye-gaze detecting means suitable for use, for example, in a camera such as a still camera or a video movie camera endowed with the function of detecting an eye-gaze position in the photographing picture plane (of various positions in the photographing plane, the position of the portion the user is gazing at) and controlling the auto focusing operation of a photo-taking lens or controlling the exposure of film or an image pickup element.
2. Related Background Art
As cameras of this kind, there are known cameras in which what portion in the photographing picture plane the photographer should recognize as the main object is determined on the basis of the result of the eye-gaze detection and a photo-taking lens is driven by the use of an information value representative of the focus detection state corresponding to the object in the determined portion to thereby effect so-called auto focusing. There are also known cameras in which automatic exposure control is effected by the use of an information value representative of the luminance of an object in the portion recognized as the main object on the basis of the eye-gaze detection (such cameras are disclosed, for example, in Japanese Laid-Open Patent Application No. 63-94232, Japanese Laid-Open Patent Application No. 1-241511 and Japanese Laid-Open Patent Application No. 2-5).
However, in a camera wherein auto focusing is effected on the basis of the result of the eye-gaze detection, there may arise a problem as will be described below.
Suppose a case where, as shown in FIG. 7 of the accompanying drawings, a plurality of focus detection areas 1-3 are set in the photographing picture plane 10. Also assume that when the photographer gazes at between the focus detection area 1 and the focus detection area 2, the focus detection area nearer to the eye-gaze point is selected and a photo-taking lens is driven on the basis of an information value representative of the focus detection state in that area. Assuming that in the case of such a camera, the photographer's eye-gaze point is near the intermediate point a between the focus detection area 1 and the focus detection area 2 and, as shown in FIG. 8 of the accompanying drawings, the object distance D1 in the area 1 and the object distance D2 in the area 2 differ greatly from each other, the selected focus detection area will change over from the area 1 to the area 2 or from the area 2 to the area 1 simply if the eye-gaze point slightly moves unconsciously to right and left near the point a (the gaze of the human eye moves involuntarily even if one is gazing at one point). Each time the changeover takes place, the photo-taking lens is reciprocally driven between driven positions R1 and R2 as shown in FIG. 9 of the accompanying drawings, and this results in the waste of electric power. This is a problem which will likewise arise when the vicinity of the intermediate point b between the focus detection areas 2 and 3 is gazed at. Also, if the eye-gaze point is moved from the left end to the right end of the picture plane or conversely, the selected focus detection area will change over when the eye-gaze passes the point a and the point b and therefore, in conformity therewith, the driving of the photo-taking lens will take place suddenly. Thus, in the case of a camera for photographing moving images like a video movie camera, the object distance focused in a photographed moving image varies suddenly and therefore, that moving image becomes very unnatural one.
On the other hand, in a camera wherein automatic exposure is effected on the basis of the result of the eye-gaze detection, there may arise, for example, a problem as will be described below.
Assume that where as shown in FIG. 10 of the accompanying drawings, a plurality of photometry areas 11-13 are set in the photographing picture plane 10, a photometry area corresponding to the photographer's eye-gaze point is selected and exposure is determined on the basis of the luminance information in that area. In the case of such a camera, assuming that the photographer's eye-gaze point is near the intermediate point a between the photometry area 11 and the photometry area 12 and, as shown in FIG. 11 of the accompanying drawings, the object luminance B1 in the area 11 and the object luminance B2 in the area 12 differ greatly from each other, the selected photometry area will change over from the area 11 to the area 12 or from the area 12 to the area 11 simply if the eye-gaze point slightly moves unconsciously to right and left near the point a. Accordingly, simply if in spite of having gazed at a single object present near the eye-gaze point a, the photographer slightly moves the eye-gaze point, the exposure amount as the result of automatic exposure control may greatly vary to E1 and E2 as shown in FIG. 12 of the accompanying drawings. This is a problem which will likewise arise when the vicinity of the intermediate point b between the photometry areas 12 and 13 is gazed at. Also, if the eye-gaze point is moved from the left end to the right end of the picture plane or conversely, the selected photometry area will change over when the eye-gaze passes the point a and the point b and therefore, in conformity therewith, the exposure amount controlled will vary suddenly. Thus, in the case of a camera for photographing moving images like a video movie camera, the brightness of photographed moving images varies suddenly and unnaturally.
It is the object of the present invention to provide a camera in which more adequate automatic focus adjustment and automatic exposure control can be effected on the basis of eye-gaze detection with a result that better images can be obtained.
FIG. 1 is a schematic view showing the internal structure of a camera provided with eye-gaze detecting means according to an embodiment of the present invention.
FIG. 2 is a graph showing the relation between the eye-gaze point by the camera of the FIG. 1 embodiment and weighting coefficients.
FIG. 3 is a graph showing the relation between the eye-gaze point and the lens driven position.
FIG. 4 is a schematic view showing the internal structure of a camera provided with eye-gaze detecting means according to another embodiment of the present invention.
FIG. 5 is a graph showing the relation between the eye-gaze point by the camera of the FIG. 4 embodiment and weighting coefficients.
FIG. 6 is a graph showing the relation between the eye-gaze point and the exposure amount.
FIG. 7 shows the positions of focus detection areas and two particular eye-gaze points in the photographing picture plane.
FIG. 8 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 7 and focus detection state information (object distance information).
FIG. 9 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 7 and the lens driven position.
FIG. 10 shows the positions of photometry areas and two particular eye-gaze points in the photographing picture plane.
FIG. 11 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 10 and object luminance information.
FIG. 12 is a graph showing the relation between the two particular eye-gaze points shown in FIG. 10 and the exposure amount.
FIG. 13 is a conceptional diagram of still another embodiment of the present invention.
FIG. 14 is a block diagram of the FIG. 13 embodiment.
FIG. 15 shows the divided patterns of the photometry areas and eye-gaze detection areas in the photographing picture plane of the FIG. 13 embodiment.
FIG. 16 is a flow chart showing the operation of a CPU in the FIG. 13 embodiment.
FIG. 17 is a block diagram of yet still another embodiment of the present invention.
FIGS. 18A to 18C show the divided patterns of focus detection areas (distance measuring areas and eye-gaze detection areas in the photographing picture plane of the FIG. 17 embodiment.
FIG. 19 is a flow chart showing the photographing operation of the FIG. 17 embodiment.
FIG. 20 is a flow chart showing an example of the subroutine of FIG. 19.
FIG. 21 is a flow chart showing another example of the subroutine of FIG. 19.
FIG. 22 shows an example in which the divided patterns of the-eye-gaze detection areas of FIG. 15 have been changed.
FIG. 1 shows the internal structure of a camera according to an embodiment of the present invention. This camera effects automatic focus adjustment on the basis of the result of eye-gaze detection.
In FIG. 1, the reference numeral 21 designates an eye-gaze detecting device for detecting the photographer's eye-gaze point in the photographing picture plane 10. The eye-gaze detecting device 21 is contained in a housing 22. The reference numeral 23 denotes a focus detecting apparatus for the camera. The focus detecting apparatus 23 is provided below the eye-gaze detecting device 21 and is contained in the housing 22.
This focus detecting apparatus has contained therein a first calculating device (not shown) for calculating information values (information values relating to the object distances in a plurality of areas 1-3 in the photographing picture plane 10) D1-D3 representative of the focus detection states of a photo-taking lens 24 corresponding to the plurality of focus detection areas 1-3 (FIG. 7) in the photographing picture plane 10. The reference numeral 25 designates a control device for controlling the amount of driving of the photo-taking lens 24 by a mean information value D calculated by itself. The control device 25 is connected to the focus detecting apparatus 23 and the eye-gaze detecting device 21. The mean information value D is calculated in the following manner by a second calculating device (not shown) contained in the control device 25. That is, the second calculating device determines the weighting coefficients k1-k3 of the focus detection areas 1-3 on the basis of the photographer's eye-gaze point by the characteristic lines k1-k3 of the coefficients shown in FIG. 2, and calculates the mean information value D by an operation expression D=(k1×D1+k2×D2+k3×D3) ÷(k1+k2+k3).
The reference numeral 26 denotes a motor for moving the photo-taking lens 24 in the direction of the optical axis thereof, and the reference numeral 27 designates a sub-mirror for directing a light beam transmitted through a half-mirror 28 to the focus detecting apparatus 23. The reference numeral 29 denotes a pentaprism, and the reference numeral 30 designates a finder screen.
Description will now be made of an example of the calculation for finding the mean information value D from the information values D1-D3.
Assuming for example that the eye-gaze point is at a point c indicated in the abscissa of FIG. 2, when the weighting coefficients k1-k3 for this eye-gaze point c are determined in accordance with the coefficient characteristic lines of FIG. 2, they are 0.65, 0.35 and 0, respectively, as indicated in the ordinate of FIG. 2. Assuming that the information values D1-D3 representative of the focus detection states in the focus detection areas 1-3 are values greatly differing from one another as shown in FIG. 8, the mean information value D is as follows: ##EQU1##
When the amount of driving of the photo-taking lens 24 is controlled on the basis of the mean information value D obtained in this manner, the change in the lens position in the intermediate area of the focus detection areas becomes smooth as shown in FIG. 3 even if the eye-gaze point changes delicately.
While the present embodiment has been shown with respect to a case where there are three focus detection areas 1-3, the present invention is not restricted thereto. There may be two focus detection areas, or four or more focus detection areas. Where there are four or more focus detection areas, the lens driving will be effected more smoothly. In such case, the mean information value D can be calculated from an operation expression D=(k1×D1+k2×D2+. . . +kn×Dn)+(k1+k2+. . . +kn). Where information values representative of the focus adjusted states of the photo-taking lens corresponding to the focus detection areas 1-n in the photographing picture plane are D1, D2, . . . , Dn, and the weighting coefficients of the focus detection areas 1-n are k1, k2, . . . kn.
The above-mentioned information values D1-D3 indicative of the focus detection states need not always correspond strictly to the object distances. Even information values (information from which can be known a rough standard of the amount of driving of the photo-taking lens necessary for focus adjustment and the direction of driving thereof) indicative of the amount and direction (front focus or rear focus) of defocus of the object image by the photo-taking lens can be applied to the present embodiment. In such case, if the detection of the information values and the calculation of the mean information value are repetitively effected while the photo-taking lens is driven, proper focus adjustment will be possible.
While in the above-described embodiment, the automatic focus adjustment of the photo-taking lens has been effected in accordance with the mean information value D, the present invention is not restricted thereto, but design may be made such that automatic zooming is effected in the following manner on the basis of the mean information value D. That is, a motor for zooming is controlled so that the greater becomes the distance corresponding to the mean information value D, the more the photo-taking lens may be zoomed up and and so that the smaller becomes said distance, the more the photo-taking lens may be zoomed down, whereby the size of the object in the photographing picture plane can be made constant irrespective of the object distance.
Description will now be made of a camera according to another embodiment of the present invention. This camera effects automatic exposure control on the basis of the result of eye-gaze detection.
FIG. 4 is a schematic view showing the internal structure of the camera according to this embodiment. In FIG. 4, the reference numeral 31 designates an eye-gaze detecting device for detecting the photographer's eye-gaze point in the photographing picture plane 10. The eye-gaze detecting device 31 is contained in a housing 32. The reference numeral 33 denotes a photometry device for the camera. The photometry device 33 is provided above the eye-gaze detecting device 31 and is contained in the housing 32.
This photometry device 33 has contained therein a first calculating device (not shown) for calculating information values B1-B3 representative of object luminances in a plurality of photometry areas 11-13 (FIG. 10) in the photographing picture plane 10. The reference numeral 34 designates a control device for controlling the shutter speed of a shutter 35 and the amount of aperture of a stop 36 on the basis of a mean information value B calculated by itself. The control device 34 is connected to the photometry device 33 and the eye-gaze detecting device 31. The mean information value B is calculated in the following manner by a second calculating device (not shown) contained in the control device 34. That is, the second calculating device determines the weighting coefficients k11-k13 of the photometry areas 11-13 on the basis of the photographer's eye-gaze point by coefficient characteristic lines k11-k13 shown in FIG. 5, and calculates the mean information value B by an operation expression B=(k11×B1+k12×B2+k13×B3)÷(k11 +k12+k13).
The reference numeral 37 denotes a mirror, the reference numeral 38 designates a pentaprism, the reference numeral 39 denotes a finder screen, and the reference numeral 40 designates a photo-taking lens.
Description will now be made of an example of the calculation for finding the mean information value B from the information values B1-B3.
Assuming for example that the eye-gaze point is at a point c indicated in the abscissa of FIG. 5, when the weighting coefficients k11-k13 for this eye-gaze point c are determined in accordance with the coefficient characteristic lines of FIG. 5, the are 0.65, 0.35 and 0, respectively, as shown in the ordinate of FIG. 5. Assuming that the information values B1-B3 representative of luminances in the photometry areas 11-13 differ greatly from one another as shown in FIG. 11, the mean information value B is as shown below. ##EQU2##
When the shutter speed of the shutter 35 and the amount of aperture of the stop 36 are controlled on the basis of the mean information value B obtained in this manner, the variation in the exposure amount at the boundary between the photometry areas will become smooth as shown in FIG. 6 even if the eye-gaze point changes delicately.
While the present embodiment has been described with respect to a case where there are three photometry areas, the present invention is not restricted thereto, but there may be two photometry areas or four or more photometry areas.
FIGS. 13 to 16 show a camera according to still another embodiment of the present invention. This camera effects automatic exposure on the basis of the result of eye-gaze detection.
The basic operation of the present embodiment will first be described with reference to FIG. 13. At the step 131 of FIG. 13, the gaze position of the photographer's eye looking into the finder is detected time-serially. Then at a step 132, the amount of eye-gaze at each photometry area (zone) is measured. On the other hand, at a step 133, the object luminance in each zone is measured. At a step 134, weighting based on the amount of eye-gaze at each zone obtained at the step 132 is effected to the object luminance at each zone obtained at the step 133. Finally at a step 135, a mean exposure value is calculated on the basis of the result of said weighting.
The construction of the present embodiment will now be described with reference to FIGS. 14 and 15.
The exposure calculating device in this embodiment, as shown in FIG. 14, is comprised chiefly of a control unit (CPU) 141 for controlling the system of the camera, and the CPU 141 has connected thereto the outputs from a release button 142, an eye-gaze detecting device 143 and a divisional photometry device 144. The output of the CPU 141 is connected to an indicator 145 and an exposure control device 146.
Also, the eye-gaze detecting device 143 and the divisional photometry device 144, as shown in FIG. 15, divide the interior of the finder into five zones 151-155, i.e., the central portion, the top left portion, the top right portion, the bottom left portion and the bottom right portion, during photographing and effect eye-gaze detection and photometry, respectively, at each of the zones 151-155.
The release button 142 is provided on a camera body, not shown, and by the photographer depressing the release button 142, a signal for photographing direction or the like is output to the CPU 141.
The eye-gaze detecting device 143 is a device for detecting in which of the zones 151-155 the photographer's eye-gaze in the finder is positioned. As the eye-gaze detecting device 143, use can be made, for example, of a device which applies infrared illuminating light to the photographer's eye and detects the position of the eye-gaze by the reflected image from the cornea or the crystal lens (for example, the device disclosed in Japanese Laid-Open Patent Application No. 1-274736).
The divisional photometry device 144 is a device for measuring the object luminance in the finder at each of the zones 151-155 shown in FIG. 15, and it outputs the obtained luminance information to the CPU 141, which thus calculates the exposure value.
The indicator 145 is a device for indicating the eye-gaze point position detected by the eye-gaze detecting device 143 and the exposure value calculated by the CPU 141.
The exposure control device 146 is a device for controlling a shutter 147 and a stop 148 during photographing in conformity with the exposure value calculated by the CPU 141.
The process of the exposure value calculation effected in the CPU 141 will now be described with reference to FIG. 16.
In FIG. 16, when the entire system of the camera is started, shift is made to an eye-gaze position detection block I comprising #100-#103 (this corresponds to the step 131 of FIG. 13).
n at #100 is a variable representative of the frequency of eye-gaze detection and is first set to 0. At #101, n+1 is substituted for n, and at #102, the first eye-gaze position detection is effected (this corresponds to the step 132 of FIG. 13). The photographer's eye-gaze position is represented by X-Y coordinates having the center of the finder as the origin, and the coordinates data is defined as Dn(X, Y).
Accordingly, by measuring these coordinates, which of the zones 151-155 in the finder the photographer's eye-gaze point is looking to can be detected.
In the present embodiment, the detection of the eye-gaze position is effected 500 times at intervals of 5 ms, and the routine of #102-#103 is executed until n reaches 500 times as shown at #103. When at #103, n reaches 500 times, shift is made to #104.
At #104, the divisional photometry device 144 measures the object luminance B(I)(l=1-5) at each of the five zones 151-155 (this corresponds to the step 133 of FIG. 13). Here, B(I) is a variable representative of the luminance of each of the zones 151-155, and I is a number indicative of the correspondence to the five zones, and 1-5 are allotted as I to the zones 151-155.
The block II comprising #105-#109 is a block for the eye-gaze detection after the aforedescribed 500 times of eye-gaze detection have been effected.
At #105, the 501st eye-gaze position detection is effected and the coordinates data thereof is defined as D501 (X, Y). Then at #106, the first coordinates data D1 (X, Y) is erased, whereby the renewal of data is effected and stored in the CPU 141.
#107 and #108 perform operations similar to the aforedescribed # 100 and #101, and #109 shows that as described previously in connection with #106, the coordinates data Dn+1 (X, Y) of the obtained eye-gaze position is replaced by coordinates data Dn (X, Y).
In this manner, with the lapse of time, the coordinates data of the eye-gaze position are sequentially renewed to the newest data, and the number of the coordinates data are always kept at 500. Accordingly, even when much time is put in framing or the like, the coordinates data of the newest eye-gaze position is obtained.
Then, the eye-gaze frequency Q(I) for the five zones 151-155 is calculated from the obtained coordinates data of the eye-gaze position, and before that, at #110, Q(I) is set to the initial value 0. I is a number indicative of the correspondence to the five zones, and 1-5 are allotted as I to the zones 151-155.
Shift is then made to a block III for calculating the eye-gaze frequency for each zone. The block III comprises #111-#121, and is a block for discriminating which of the zones 151-155 the respective ones of the 500 coordinates data Dn (X, Y) detected in the aforedescribed blocks I and II belong to.
At #111, whether the detected coordinates data Dn (X, Y) are positioned in the zone 151 is discriminated. The coordinates which are the range of the zone 151 are preset, and by the coordinates data Dn (X, Y) being compared with these set values, whether the coordinates data Dn (X, Y) belong to the zone 151 is discriminated.
If at #111, it is judged that the coordinates data Dn (X, Y) are positioned in the zone 151, advance is made to #112, where Q(1)+1 is substituted for Q(1), and shift is made to #121 which will be described later.
If at #111, it is judged that the coordinates data Dn (X, Y) are not positioned in the zone 151, advance is made to #113. At #113, whether the coordinates data Dn (X, Y) are positioned in the zone 152 is discriminated.
If at #113, it is judged that Dn (X, Y) are positioned in the zone 152, advance is made to #114, where Q(2)+1 is substituted for Q(2), and shift is made to #121 as previously described, and if at #113, it is judged that Dn (X, Y) are not positioned in the zone 152, advance is made to #115.
Similar operations are performed at #115, #117 and #119, and whether the coordinates data Dn (X, Y) are positioned in the zone 152, the zone 154 and the zone 155, respectively, is discriminated.
If it is judged that the coordinates data Dn (X, Y) belong to any one of the zones 153, 154 and 155, advance is made in succession to one of #116, #118 and #120, as in the case of #111 and #113. Then, Q(3)+1, Q(4)+1 and Q(5)+1 are substituted for Q(3), Q(4) and Q(5), respectively, whereafter advance is made to #121.
The routine of #111-#121 is repeated until as shown at #121, the frequency of eye-gaze detection reaches 500 times, and the frequency discriminated for each zone becomes the frequency Q(I) corresponding to the final zones 151-155.
As previously described, eye-gaze detection is effected at intervals 5 ms and thus, the value of Q(I) corresponds to the total time for which the zones 151-155 have been gazed at during a predetermined time. If at #121, n=500, shift is made to #122, where the block III ends.
At #122, on the basis of each eye-gaze time detected, weighting is effected to the exposure value B by the following equation (this corresponds to the steps 134 and 135 of FIG. 13). ##EQU3##
That is, each of Q(1)-Q(5) is divided by 500 to thereby find the proportion of eye-gaze times paid to the zones 151-155, and this proportion is multiplied by the object luminance B(I) for each zone measured at #104 to thereby find the arithmetical mean, and weighting is effected to the exposure value B. Therefore, the exposure value B is determined by the photographer's eye-gaze times to the zones 151-155, and the photographer's intention is sufficiently reflected upon exposure control.
After the calculation of the exposure value B, advance is made to #123, where the exposure value is indicated by the indicator 145 described in connection with FIG. 14. Further, when at #124, the photographer releases the shutter, the series of operations are terminated, and when the photographer does not release the shutter, return is made to #104.
The present invention is not restricted to the above-described embodiments, but various modifications are possible within the Scope of the invention.
In the present embodiment, the shapes of the divided zones for effecting photometry and the divided zones for eye-gaze detection are the same, but they need not always be the same, for example, the divided zones for eye-gaze detection may be made narrower than the divided zones for photometry so as to be included in the divided zones for photometry. Also, the divided zones for photometry may be further subdivided than in FIG. 15.
FIG. 22 shows an example in which the eye-gaze detection areas are made narrower than the photometry areas. In FIG. 22, the eye-gaze detection areas comprise horizontally 12 divisions×vertically 8 divisions, totalling to 96 divisions. These eye-gaze detection areas, as indicated by thick lines in FIG. 22, are approximated to the divided shapes of the photometry areas 151-155 of FIG. 15 and are grouped for use for said weighting.
If the eye-gaze detection areas are thus subdivided into a matrix form, the control as described in connection with FIGS. 5 and 6 will also become possible by using the result of the detection of the eye-gaze detection areas correspondingly to the focus detection areas differing in divided shape from the photometry areas 151-155, for example, the focus detection areas 1-3 of FIG. 7. If this is done, automatic exposure control and automatic focus adjustment can be accomplished on the basis of the output of a single eye-gaze detecting device and therefore, construction will become simple.
Also, the weighting of the exposure value B may be calculated by the use of the following equation, instead of the aforementioned equation. ##EQU4##
When this equation this used, weighting to each photometric output is effected by the moment of the square of the eye-gaze continuation time and therefore, as compared with the case of #22, more importance can be attached to the areas which are gazed at for a long time.
Further, in the present embodiment, eye-gaze detection is effected at predetermined time (5 milliseconds) intervals and therefore, the result is the eye-gaze continuation time for each area within a predetermined time before photographing. However, this can also be said to be a frequency indicative of how many times of the predetermined times (500 times) of eye-gaze detection each area has been gazed. The present invention is not restricted thereto, but also covers counting a simple eye-gaze frequency (number of times) which does not take the time element into account.
Still another embodiment of the present invention is shown in FIGS. 17 to 21.
FIG. 17 shows a block diagram of a camera according to the present embodiment, which is comprised of a CPU 171, a distance measuring portion 172, an eye-gaze detecting portion 173, an eye-gaze continuation time measuring portion 174 and a driving portion 175. The CPU 171 is a control device for effecting the various controls of the camera. The distance measuring portion 172 measures the object distances in distance measuring areas obtained by dividing the photographing picture plane. The eye-gaze detecting portion 173 detects which portion of eye-gaze detection areas obtained by dividing the photographing picture plane the photographer is gazing at. The eye-gaze continuation time measuring portion 174 includes a counter and measures the eye-gaze continuation time for each eye-gaze detection area detected by the eye-gaze detecting portion 173. The counter counts the clock pulses generated by the CPU 171 while a certain eye-gaze detection area is gazed at, and the CPU 171 stores therein this count number for each eye-gaze detection area. By reading this stored count number, the eye-gaze continuation time for each area can be found. The driving portion 175 is a driving device for driving the lens on the basis of distance information.
FIGS. 18A to 18C are illustrations showing the eye-gaze detection areas of the eye-gaze detecting portion 173 and the distance measuring areas of the distance measuring device for the photographing picture plane of the camera of the present embodiment. FIG. 18A shows an example in which the photographing picture is divided horizontally into three, and FIG. 18B shows an example in which the photographing picture plane is divided vertically into three and divided horizontally into five, thus being overall divided into fifteen. In FIG. 18C, areas partitioned by solid lines indicate distance measuring areas, and areas partitioned by broken lines indicate eye-gaze detection areas. In FIG. 18C, the distance measuring areas are provided by dividing the photographing picture plane both vertically and horizontally into three, thus into nine in total, and the eye-gaze detection areas indicate detection areas for the eye-gaze position provided by further dividing the distance measuring areas into nine, thus overall into eighty-one.
Of course, the detection areas of the distance measuring device and the detection areas for the eye-gaze position are not limited to those described above.
FIG. 19 is a flow chart showing the photographing operation of the camera of the present embodiment. This photographing operation is started by depressing the shutter release button.
At a step S1, photometry is effected and the photometric value is memorized.
At a step S2, the distance measurement of the individual distance measuring areas shown in FIG. 18 is effected by the distance measuring portion 172 and each distance measurement value is memorized.
At a step S3, the photographer's eye-gaze position is detected by the eye-gaze detecting portion 173. This detection is effected for a predetermined time (e.g. 1 second).
At a step S4, the eye-gaze continuation time detected at the step S3 is output by the eye-gaze continuation time measuring portion 174.
At a step S5, the photographing distance is determined with the eye-gaze continuation time at each eye-gaze detection area taken into account. This will be described later in greater detail.
At a step S6, the photo-taking lens is driven so as to be focused to the photographing distance determined at the step S5, whereafter exposure is effected on the basis of the photometric value obtained at the step S1, and post-exposure processes such as film advance and shutter charge are carried out, thus terminating the photographing operation.
FIG. 20 is a flow chart of a subroutine showing the substance of the process of determining the photographing distance to which the photo-taking lens is focused at the step S5.
At a step S10, from among the eye-gaze positions detected, eye-gaze positions of a predetermined eye-gaze continuation time T1 (set to, e.g. T1 =1/5 T) or more are selected to the total time T (e.g. 1 second) for which the photographer gazes at the photographing picture plane.
At a step S11, the eye-gaze detection zone P1 of the longest eye-gaze continuation time is selected from among the eye-gaze positions selected at the step S10.
At a step S12, whether there is an eye-gaze detection zone in which the difference from the eye-gaze continuation time for the eye-gaze detection area P1 is within a predetermined value t1 (set to, e.g. t1 =1/20 T) is judged, and if such a zone is present, advance is made to a step S13, and if such a zone is absent, advance is made to a step S14.
At the step S13, the distance measurement value of the distance measuring area corresponding to the eye-gaze detection zone P1 and the distance measurement value or values corresponding to one or more other eye-gaze detection zones for which the difference in eye-gaze continuation time from the eye-gaze detection zone P1 is within the predetermined value t1 are compared with one another, whereby the information of the closest object distance is selected as the photographing distance.
At the step S14, whether one or more other eye-gaze detection zones for which the difference in eye-gaze continuation time from the eye-gaze detection zone P1 is within a predetermined value t2 (t2 >t1, and set to, e.g. t2 =1/10 T) are present is judged, and if such zone or zones are present, advance is made to a step S15, and if such zone or zones are absent advance is made to a step S16.
At the step S15, weighting mean conforming to the eye-gaze continuation time for each zone is effected to the distance measurement-value of the distance measuring zone corresponding to the eye-gazed detection zone P1 and the distance measurement value or values corresponding to one or more other eye-gaze detection zones for which the difference in eye-gaze continuation time from the eye-gaze detection zone P1 is within the predetermined value t2, and the result of it is adopted as the photographing distance.
At the step S16, the distance measurement value corresponding to the eye-gaze detection zone P1 is determined as the photographing distance. This is because the eye-gaze continuation time for the eye-gaze detection zone P1 is longer beyond the predetermined value t2 than the eye-gaze continuation time for each of the other eye-gaze detection areas and therefore the eye-gaze detection area P1 can be regarded as the main object on which the photo-taking lens should be focused.
Thereafter, return is made to the step S6 of FIG. 19.
FIG. 21 is a flow chart of the subroutine showing another example of the process of the step S5 of the present embodiment.
Steps S20 to S24 are the same as the steps S10 to S14 of FIG. 20.
At a step S25, the photographing distance is set so that the photo-taking lens may be focused without fail on an object which is at the distance measurement value corresponding to the eye-gaze detection zone P1 and an object or objects corresponding to an object or objects which are at the distance measurement value or values of one or more other eye-gaze detection zones for which the difference in eye-gaze continuation time exceeds the predetermined value t1 and is within the predetermined value t2 may also be within the depth of field as far as possible. When the difference between the object distances is great, the depth of field is enlarged. This enlargement of the depth of field is accomplished by stopping down, but the amount of the stopping down is limited within a range in which underexposure and the hand vibration by a reduction is shutter speed do not occur.
A step S26 and subsequent steps are the same as the step S16 and subsequent steps of FIG. 20.
Among the above-described embodiments, in the embodiments shown in FIGS. 18A and 18B and FIG. 22, as is apparent from these figures, the ratio between the horizontal dimension and vertical dimension of each eye-gaze detection area is smaller than the ratio between the horizontal dimension and vertical dimension of the photographing picture plane. This shows that the resolving power in the horizontal direction of eye-gaze detection is higher than the resolving power in the vertical direction. Since the human eye moves more often in the horizontal direction than in the vertical direction, it is advantageous to make the resolving power in the horizontal direction of eye-gaze detection higher.
Claims (7)
1. A camera comprising:
a line-of-sight detecting device that repetitively detects position of a photographer's line of sight, and that produces, for each detection, a position signal indicating the detected position of the photographer's line of sight, said line-of-sight detecting device including a memory device that stores a predetermined number of most recently produced position signals; and
an operating device having an operation controlled by said line-of-sight detecting device;
said line-of-sight detecting device controlling said operating device based on the position signals, of said predetermined number, stored in said memory device immediately before said operation of said operating device is started.
2. The camera of claim 1, wherein said line-of-sight detecting device includes an updating device that updates said memory device by replacing the position signals successively from the earliest position signal stored.
3. The camera of claim 2, wherein said updating device replaces each position signal with the position signal produced next thereafter.
4. The camera of claim 1, wherein said line-of-sight detecting device detects the position of the photographer's line of sight at a predetermined time interval.
5. The camera of claim 1, further including a manually operable operating member, and wherein the start of said operation of said operating device is effected in response to manual operation of said operating member.
6. The camera of claim 2 or 3, wherein said line-of-sight detecting device includes a calculating portion that re-calculates an operating parameter of said operating device when said memory device is updated.
7. The camera of claim 1, wherein said line-of-sight detecting device includes a calculating portion that calculates an operating parameter of said operating device by a calculation utilizing terms that are based, collectively, on all of said position signals stored immediately before said operation is started.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US08/472,726 US5714988A (en) | 1990-10-12 | 1995-06-07 | Camera capable of detecting eye-gaze |
Applications Claiming Priority (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2-272174 | 1990-10-12 | ||
JP2272174A JPH04149413A (en) | 1990-10-12 | 1990-10-12 | Camera provided with means for detecting line of sight |
JP2-287723 | 1990-10-25 | ||
JP28772390 | 1990-10-25 | ||
JP2291434A JPH04163537A (en) | 1990-10-29 | 1990-10-29 | Multipoint range finder with sight line detecting means |
JP2-291434 | 1990-10-29 | ||
US07/773,726 US5333029A (en) | 1990-10-12 | 1991-10-09 | Camera capable of detecting eye-gaze |
US21029394A | 1994-03-18 | 1994-03-18 | |
US08/472,726 US5714988A (en) | 1990-10-12 | 1995-06-07 | Camera capable of detecting eye-gaze |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US21029394A Division | 1990-10-12 | 1994-03-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
US5714988A true US5714988A (en) | 1998-02-03 |
Family
ID=27335978
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US07/773,726 Expired - Lifetime US5333029A (en) | 1990-10-12 | 1991-10-09 | Camera capable of detecting eye-gaze |
US08/477,590 Expired - Lifetime US5765045A (en) | 1990-10-12 | 1995-06-07 | Camera capable of detecting eye-gaze |
US08/477,591 Expired - Lifetime US5623703A (en) | 1990-10-12 | 1995-06-07 | Camera capable of detecting eye-gaze |
US08/472,726 Expired - Lifetime US5714988A (en) | 1990-10-12 | 1995-06-07 | Camera capable of detecting eye-gaze |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US07/773,726 Expired - Lifetime US5333029A (en) | 1990-10-12 | 1991-10-09 | Camera capable of detecting eye-gaze |
US08/477,590 Expired - Lifetime US5765045A (en) | 1990-10-12 | 1995-06-07 | Camera capable of detecting eye-gaze |
US08/477,591 Expired - Lifetime US5623703A (en) | 1990-10-12 | 1995-06-07 | Camera capable of detecting eye-gaze |
Country Status (3)
Country | Link |
---|---|
US (4) | US5333029A (en) |
EP (5) | EP0680726A3 (en) |
DE (1) | DE69125682T2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6229959B1 (en) | 1991-04-05 | 2001-05-08 | Canon Kabushiki Kaisha | Camera in which focus is detected from among a plurality of viewfields in conjunction with detection of the visual axis |
Families Citing this family (79)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03214133A (en) * | 1990-01-18 | 1991-09-19 | Nikon Corp | Focus detector |
US5515130A (en) * | 1990-12-10 | 1996-05-07 | Nikon Corporation | Camera control device |
DE4215523C2 (en) * | 1991-05-13 | 2002-12-05 | Canon Kk | Viewpoint detection device for a camera |
US5758201A (en) * | 1991-06-28 | 1998-05-26 | Nikon Corporation | Camera having line of sight detecting device |
EP0863431B1 (en) * | 1992-06-02 | 2004-10-20 | Canon Kabushiki Kaisha | Optical apparatus for detecting rotation of an eyeball of an observer |
US5614985A (en) * | 1992-10-28 | 1997-03-25 | Canon Kabushiki Kaisha | Camera with device for detecting line of sight |
US6035054A (en) * | 1992-10-29 | 2000-03-07 | Canon Kabushiki Kaisha | Visual axis detection apparatus and optical apparatus provided therewith |
JPH06148505A (en) * | 1992-10-30 | 1994-05-27 | Nikon Corp | Camera with line-of-sight detector |
JPH06313842A (en) * | 1993-04-28 | 1994-11-08 | Canon Inc | Automatic focusing camera |
JPH06337343A (en) * | 1993-05-31 | 1994-12-06 | Nikon Corp | Camera with line-of-sight detector |
EP0650292B1 (en) * | 1993-10-04 | 2002-04-03 | Canon Kabushiki Kaisha | Image pickup apparatus |
JPH07128583A (en) * | 1993-10-29 | 1995-05-19 | Canon Inc | Lens shutter camera with zoom function |
US5581323A (en) * | 1993-11-29 | 1996-12-03 | Canon Kabushiki Kaisha | Optical apparatus for controlling operations based on a user's visual axis |
US6388707B1 (en) * | 1994-04-12 | 2002-05-14 | Canon Kabushiki Kaisha | Image pickup apparatus having means for appointing an arbitrary position on the display frame and performing a predetermined signal process thereon |
JPH07311331A (en) * | 1994-05-18 | 1995-11-28 | Nikon Corp | Camera provided with line-of-sight detection device |
JPH08271784A (en) * | 1995-03-30 | 1996-10-18 | Canon Inc | Optical instrument with function of detecting line of sight |
US6538697B1 (en) * | 1995-04-26 | 2003-03-25 | Canon Kabushiki Kaisha | Man-machine interface apparatus and method |
US5913079A (en) * | 1995-07-31 | 1999-06-15 | Canon Kabushiki Kaisha | Optical apparatus having a line of sight detection device |
US6373961B1 (en) | 1996-03-26 | 2002-04-16 | Eye Control Technologies, Inc. | Eye controllable screen pointer |
US7076118B1 (en) | 1997-12-05 | 2006-07-11 | Sharp Laboratories Of America, Inc. | Document classification system |
US5839000A (en) * | 1997-11-10 | 1998-11-17 | Sharp Laboratories Of America, Inc. | Automatic zoom magnification control using detection of eyelid condition |
US6220706B1 (en) | 2000-02-10 | 2001-04-24 | Carl Zeiss, Inc. | Method and apparatus for determining position of an eye |
US6456788B1 (en) * | 2000-08-21 | 2002-09-24 | Canon Kabushiki Kaisha | Optical apparatus and camera provided with line-of-sight detecting device |
US6965394B2 (en) * | 2001-03-30 | 2005-11-15 | Koninklijke Philips Electronics N.V. | Remote camera control device |
DE10132872B4 (en) * | 2001-07-06 | 2018-10-11 | Volkswagen Ag | Head mounted optical inspection system |
US7006764B2 (en) * | 2002-11-12 | 2006-02-28 | Eastman Kodak Company | User interface for controlling cropping in electronic camera |
US7561793B2 (en) * | 2002-11-12 | 2009-07-14 | Eastman Kodak Company | User interface for controlling cropping in electronic camera |
US6907194B2 (en) | 2002-11-12 | 2005-06-14 | Eastman Kodak Company | Camera having continuously cropping viewfinder |
US7046924B2 (en) * | 2002-11-25 | 2006-05-16 | Eastman Kodak Company | Method and computer program product for determining an area of importance in an image using eye monitoring information |
US7206022B2 (en) | 2002-11-25 | 2007-04-17 | Eastman Kodak Company | Camera system with eye monitoring |
US7327890B2 (en) * | 2002-12-20 | 2008-02-05 | Eastman Kodak Company | Imaging method and system for determining an area of importance in an archival image |
US7872635B2 (en) * | 2003-05-15 | 2011-01-18 | Optimetrics, Inc. | Foveated display eye-tracking system and method |
US7705908B2 (en) * | 2003-12-16 | 2010-04-27 | Eastman Kodak Company | Imaging method and system for determining camera operating parameter |
US20050134719A1 (en) * | 2003-12-23 | 2005-06-23 | Eastman Kodak Company | Display device with automatic area of importance display |
US8659619B2 (en) | 2004-03-26 | 2014-02-25 | Intellectual Ventures Fund 83 Llc | Display device and method for determining an area of importance in an original image |
US20060044399A1 (en) * | 2004-09-01 | 2006-03-02 | Eastman Kodak Company | Control system for an image capture device |
JP4537192B2 (en) * | 2004-12-21 | 2010-09-01 | キヤノン株式会社 | Ophthalmic equipment |
US7697827B2 (en) * | 2005-10-17 | 2010-04-13 | Konicek Jeffrey C | User-friendlier interfaces for a camera |
US8467672B2 (en) * | 2005-10-17 | 2013-06-18 | Jeffrey C. Konicek | Voice recognition and gaze-tracking for a camera |
US7855743B2 (en) * | 2006-09-08 | 2010-12-21 | Sony Corporation | Image capturing and displaying apparatus and image capturing and displaying method |
JP2008067219A (en) * | 2006-09-08 | 2008-03-21 | Sony Corp | Imaging apparatus and imaging method |
JP4961914B2 (en) * | 2006-09-08 | 2012-06-27 | ソニー株式会社 | Imaging display device and imaging display method |
US7860382B2 (en) * | 2006-10-02 | 2010-12-28 | Sony Ericsson Mobile Communications Ab | Selecting autofocus area in an image |
US8155479B2 (en) | 2008-03-28 | 2012-04-10 | Intuitive Surgical Operations Inc. | Automated panning and digital zooming for robotic surgical systems |
US8808164B2 (en) | 2008-03-28 | 2014-08-19 | Intuitive Surgical Operations, Inc. | Controlling a robotic surgical tool with a display monitor |
US8482626B2 (en) | 2009-04-07 | 2013-07-09 | Mediatek Inc. | Digital camera and image capturing method |
US8482562B2 (en) | 2009-12-03 | 2013-07-09 | International Business Machines Corporation | Vision-based computer control |
US8531394B2 (en) * | 2010-07-23 | 2013-09-10 | Gregory A. Maltz | Unitized, vision-controlled, wireless eyeglasses transceiver |
US8531355B2 (en) | 2010-07-23 | 2013-09-10 | Gregory A. Maltz | Unitized, vision-controlled, wireless eyeglass transceiver |
US20130258089A1 (en) * | 2011-11-03 | 2013-10-03 | Intel Corporation | Eye Gaze Based Image Capture |
CN103246044B (en) * | 2012-02-09 | 2017-03-22 | 联想(北京)有限公司 | Automatic focusing method, automatic focusing system, and camera and camcorder provided with automatic focusing system |
US8988519B2 (en) * | 2012-03-20 | 2015-03-24 | Cisco Technology, Inc. | Automatic magnification of data on display screen based on eye characteristics of user |
US9148537B1 (en) * | 2012-05-18 | 2015-09-29 | hopTo Inc. | Facial cues as commands |
US9395826B1 (en) | 2012-05-25 | 2016-07-19 | hopTo Inc. | System for and method of translating motion-based user input between a client device and an application host computer |
US20150331486A1 (en) * | 2012-12-26 | 2015-11-19 | Sony Corporation | Image processing device, image processing method and program |
US10365874B2 (en) * | 2013-01-28 | 2019-07-30 | Sony Corporation | Information processing for band control of a communication stream |
KR102013708B1 (en) | 2013-03-29 | 2019-08-23 | 삼성전자주식회사 | Method for automatically setting focus and therefor |
US20150003819A1 (en) * | 2013-06-28 | 2015-01-01 | Nathan Ackerman | Camera auto-focus based on eye gaze |
KR102233728B1 (en) * | 2013-10-31 | 2021-03-30 | 삼성전자주식회사 | Method, apparatus and computer readable recording medium for controlling on an electronic device |
WO2015066475A1 (en) | 2013-10-31 | 2015-05-07 | The University of North Carlina at Chapel Hill | Methods, systems, and computer readable media for leveraging user gaze in user monitoring subregion selection systems |
CA2956795C (en) | 2014-08-03 | 2020-06-30 | PogoTec, Inc. | Wearable camera systems and apparatus and method for attaching camera systems or other electronic devices to wearable articles |
US9635222B2 (en) * | 2014-08-03 | 2017-04-25 | PogoTec, Inc. | Wearable camera systems and apparatus for aligning an eyewear camera |
RU2017124378A (en) | 2014-12-23 | 2019-01-24 | Поготек, Инк. | WIRELESS CAMERA SYSTEM AND METHODS |
US10567641B1 (en) | 2015-01-19 | 2020-02-18 | Devon Rueckner | Gaze-directed photography |
GB201507210D0 (en) | 2015-04-28 | 2015-06-10 | Microsoft Technology Licensing Llc | Eye gaze correction |
GB201507224D0 (en) | 2015-04-28 | 2015-06-10 | Microsoft Technology Licensing Llc | Eye gaze correction |
WO2016201261A1 (en) | 2015-06-10 | 2016-12-15 | PogoTec, Inc. | Eyewear with magnetic track for electronic wearable device |
US10481417B2 (en) | 2015-06-10 | 2019-11-19 | PogoTec, Inc. | Magnetic attachment mechanism for electronic wearable device |
JP6553418B2 (en) * | 2015-06-12 | 2019-07-31 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | Display control method, display control device and control program |
US10341787B2 (en) | 2015-10-29 | 2019-07-02 | PogoTec, Inc. | Hearing aid adapted for wireless power reception |
US11558538B2 (en) | 2016-03-18 | 2023-01-17 | Opkix, Inc. | Portable camera system |
EP3539285A4 (en) | 2016-11-08 | 2020-09-02 | Pogotec, Inc. | A smart case for electronic wearable device |
CN116886835A (en) * | 2016-12-23 | 2023-10-13 | 奇跃公司 | Techniques for determining settings of a content capture device |
CN110326300B (en) * | 2017-02-27 | 2021-12-21 | 索尼公司 | Information processing apparatus, information processing method, and computer-readable storage medium |
US9832372B1 (en) * | 2017-03-18 | 2017-11-28 | Jerry L. Conway, Sr. | Dynamic vediotelphony systems and methods of using the same |
US11300857B2 (en) | 2018-11-13 | 2022-04-12 | Opkix, Inc. | Wearable mounts for portable camera |
US11503204B2 (en) | 2019-12-19 | 2022-11-15 | Magic Leap, Inc. | Gradient-based exposure and gain control techniques |
JP7467114B2 (en) * | 2019-12-27 | 2024-04-15 | キヤノン株式会社 | Imaging device and control method thereof |
US20230379594A1 (en) * | 2022-05-20 | 2023-11-23 | Varjo Technologies Oy | Image blending |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4181408A (en) * | 1977-12-05 | 1980-01-01 | Senders John W | Vision compensation |
US4607922A (en) * | 1984-04-09 | 1986-08-26 | Humphrey Instruments Incorporated | Method for aligning an eye examination instrument with the eye under examination |
GB2196134A (en) * | 1986-09-30 | 1988-04-20 | Canon Kk | Auto-focus camera |
DE3841575A1 (en) * | 1987-12-17 | 1989-07-13 | Asahi Optical Co Ltd | Device for determining the viewing direction of the user of a photographic camera |
US4974010A (en) * | 1989-06-09 | 1990-11-27 | Lc Technologies, Inc. | Focus control system |
US5253008A (en) * | 1989-09-22 | 1993-10-12 | Canon Kabushiki Kaisha | Camera |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4047187A (en) * | 1974-04-01 | 1977-09-06 | Canon Kabushiki Kaisha | System for exposure measurement and/or focus detection by means of image senser |
US4574314A (en) * | 1982-05-28 | 1986-03-04 | Weinblatt Lee S | Camera autofocus technique |
JPS59170822A (en) * | 1983-03-17 | 1984-09-27 | Olympus Optical Co Ltd | Multiple spot light metering type camera |
EP0152496B1 (en) * | 1984-02-17 | 1988-09-07 | Olympus Optical Co., Ltd. | Electronic photographing apparatus |
DE3777222D1 (en) * | 1986-04-04 | 1992-04-16 | Applied Science Group Inc | METHOD AND DEVICE FOR DEVELOPING THE PRESENTATION OF THE VISION DISTRIBUTION WHEN PEOPLE WATCHING TELEVISION ADVERTISING. |
JP2522260B2 (en) * | 1986-10-08 | 1996-08-07 | キヤノン株式会社 | Camera controller |
US4855780A (en) * | 1987-05-22 | 1989-08-08 | Canon Kabushiki Kaisha | Photometric device for pseudo format camera |
JP2859270B2 (en) * | 1987-06-11 | 1999-02-17 | 旭光学工業株式会社 | Camera gaze direction detection device |
US4836670A (en) * | 1987-08-19 | 1989-06-06 | Center For Innovative Technology | Eye movement detector |
JP2505854B2 (en) * | 1988-03-23 | 1996-06-12 | キヤノン株式会社 | Camera with line-of-sight detection means |
JP2763296B2 (en) * | 1988-04-26 | 1998-06-11 | キヤノン株式会社 | Optical device having gazing point direction detecting device |
JP2950546B2 (en) * | 1988-08-31 | 1999-09-20 | キヤノン株式会社 | Eye gaze detecting device and camera having eye gaze detecting device |
US4950069A (en) * | 1988-11-04 | 1990-08-21 | University Of Virginia | Eye movement detector with improved calibration and speed |
US5245381A (en) * | 1990-08-20 | 1993-09-14 | Nikon Corporation | Apparatus for ordering to phototake with eye-detection |
-
1991
- 1991-10-09 US US07/773,726 patent/US5333029A/en not_active Expired - Lifetime
- 1991-10-14 DE DE69125682T patent/DE69125682T2/en not_active Expired - Fee Related
- 1991-10-14 EP EP95109070A patent/EP0680726A3/en not_active Withdrawn
- 1991-10-14 EP EP95109068A patent/EP0680724A3/en not_active Withdrawn
- 1991-10-14 EP EP95109069A patent/EP0680725A3/en not_active Withdrawn
- 1991-10-14 EP EP95109064A patent/EP0680723A3/en not_active Withdrawn
- 1991-10-14 EP EP91309423A patent/EP0480774B1/en not_active Expired - Lifetime
-
1995
- 1995-06-07 US US08/477,590 patent/US5765045A/en not_active Expired - Lifetime
- 1995-06-07 US US08/477,591 patent/US5623703A/en not_active Expired - Lifetime
- 1995-06-07 US US08/472,726 patent/US5714988A/en not_active Expired - Lifetime
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4181408A (en) * | 1977-12-05 | 1980-01-01 | Senders John W | Vision compensation |
US4607922A (en) * | 1984-04-09 | 1986-08-26 | Humphrey Instruments Incorporated | Method for aligning an eye examination instrument with the eye under examination |
GB2196134A (en) * | 1986-09-30 | 1988-04-20 | Canon Kk | Auto-focus camera |
DE3841575A1 (en) * | 1987-12-17 | 1989-07-13 | Asahi Optical Co Ltd | Device for determining the viewing direction of the user of a photographic camera |
US4974010A (en) * | 1989-06-09 | 1990-11-27 | Lc Technologies, Inc. | Focus control system |
US5253008A (en) * | 1989-09-22 | 1993-10-12 | Canon Kabushiki Kaisha | Camera |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6229959B1 (en) | 1991-04-05 | 2001-05-08 | Canon Kabushiki Kaisha | Camera in which focus is detected from among a plurality of viewfields in conjunction with detection of the visual axis |
Also Published As
Publication number | Publication date |
---|---|
EP0680726A2 (en) | 1995-11-08 |
EP0680724A3 (en) | 1997-09-24 |
US5333029A (en) | 1994-07-26 |
EP0480774A1 (en) | 1992-04-15 |
DE69125682T2 (en) | 1997-10-23 |
EP0680723A3 (en) | 1997-09-24 |
EP0680724A2 (en) | 1995-11-08 |
EP0680725A3 (en) | 1997-09-24 |
DE69125682D1 (en) | 1997-05-22 |
US5765045A (en) | 1998-06-09 |
EP0680725A2 (en) | 1995-11-08 |
EP0680726A3 (en) | 1997-09-24 |
EP0680723A2 (en) | 1995-11-08 |
US5623703A (en) | 1997-04-22 |
EP0480774B1 (en) | 1997-04-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5714988A (en) | Camera capable of detecting eye-gaze | |
US5253008A (en) | Camera | |
US6215960B1 (en) | Camera with camera-shake detection apparatus | |
US5091742A (en) | Camera having an auto focusing device | |
JP2605282B2 (en) | Automatic focusing device | |
JPH02135311A (en) | Focus detecting device | |
US5255044A (en) | Automatic exposure control apparatus with improved exposure value calculation for photographing a moving object | |
US5903788A (en) | Camera | |
US5546158A (en) | View point detecting apparatus wherein first and subsequent view point data are compared | |
US5745810A (en) | Image taking apparatus | |
US6584284B1 (en) | Camera provided with focus adjusting apparatus | |
US4998126A (en) | Automatic focus adjustment camera | |
US5515131A (en) | Optical apparatus having a function of inputting data of a visual axis | |
US5970258A (en) | Optical apparatus capable of performing a desired function by gazing | |
EP0438140B1 (en) | Focus detecting device in a camera | |
JPH03164727A (en) | Focus detecting photometric device | |
US5819119A (en) | Camera with a visual line position detection device and method | |
JP3186212B2 (en) | Eye-gaze input camera | |
US5627622A (en) | Trimming camera | |
JPH03107932A (en) | Photographing controller for camera | |
JP3610218B2 (en) | Automatic focusing device, imaging device, and automatic focusing method | |
JP3416277B2 (en) | Optical device | |
JPH03107933A (en) | Automatic exposure controller for camera | |
JP3571744B2 (en) | Camera with gaze detection means | |
JPH06202202A (en) | Camera |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FPAY | Fee payment |
Year of fee payment: 12 |