WO2008016035A1 - Camera device, liquid lens and image pickup method - Google Patents
Camera device, liquid lens and image pickup method Download PDFInfo
- Publication number
- WO2008016035A1 WO2008016035A1 PCT/JP2007/064953 JP2007064953W WO2008016035A1 WO 2008016035 A1 WO2008016035 A1 WO 2008016035A1 JP 2007064953 W JP2007064953 W JP 2007064953W WO 2008016035 A1 WO2008016035 A1 WO 2008016035A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- lens
- liquid
- liquid lens
- camera device
- compound eye
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/12—Fluid-filled or evacuated lenses
- G02B3/14—Fluid-filled or evacuated lenses of variable focal length
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B35/00—Stereoscopic photography
- G03B35/08—Stereoscopic photography by simultaneous recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/218—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/236—Image signal generators using stereoscopic image cameras using a single 2D image sensor using varifocal lenses or mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
- H04N13/289—Switching between monoscopic and stereoscopic modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
Definitions
- the present invention relates to a camera device that ties an image of a lens on an image sensor and electronically acquires and records information on the image, and more specifically, planar image information and stereoscopic information.
- the present invention relates to a camera apparatus that can acquire both image information and can acquire and record either one or both of a still image and a moving image.
- Patent Document 1 An example of a conventional power camera device that can acquire both planar image information and stereoscopic image information is a 3D camera described in Patent Document 1 below, for example.
- FIG. 10 shows an external view of a conventional 3D camera 910 including two camera heads, a fixed head 915 and a moving head 916.
- FIG. 11 shows a block configuration of the main part of the 3D camera 910. Show the chart.
- the fixed head 915 is a force S fixed to the main body of the 3D camera 910, and the moving head 916 can be slid and moved by operating the moving button 912.
- a state where the head is moved to the outermost side of the movable range is shown as a moving head 916.
- the state moved to the outermost side of the movable range is shown as a moving head 916, and the state moved to the innermost side of the movable range is shown as a moving head '916'. Yes.
- the fixed head 915 and the moving head 916 have a fixed head lens 917 and a moving head lens 918, respectively.
- the fixed head lens 917 and the movable head lens 918 can be zoomed by a zoom motor 926 and a zoom motor 929, which will be described later.
- the fixed head 915 and the moving head 916 have an optical wheel reason 937 and an optical wheel reason 938 that are parallel to each other regardless of the distance between them. Furthermore, each of the fixed head 915 and the moving head 916 has a charge coupled device (CCD) sensor that is an image sensor.
- CCD charge coupled device
- the fixed head 915 and the moving head 916 are substantially the same as each other, and are located in a common plane perpendicular to the optical axis 937 and the optical axis 938.
- the movable head 916 is slidable and movable while the optical axis 937 and the optical axis 938 are kept parallel to each other and positioned with the fixed head 915 in a common plane perpendicular to the two optical axes. Constructed to be! /
- the distance between the fixed head 915 and the movable head 916 can be controlled by the user.
- the moving head 916 may be moved mechanically while sliding, when a user presses a moving button 912 installed on the upper portion of the moving head 916 with a finger.
- the interval between the fixed head 915 and the moving head 916 may be adjusted by rotating the dial 913 connected to the moving head 916 by a worm gear.
- the moving head 916 may be moved by rotating the motor with an electronically controlled button switch such as a right movement button and a left movement button.
- the position of the moving head 916 is measured by a position encoder 925 and input to a visual feedback unit 932 that is a circuit for determining the field of view and the focal length of the fixed head lens 917 and the moving head lens 918.
- the position encoder 925 has a linear potentiometer for detecting the position of the moving head 916.
- the moving head 916 may be moved by a stepper motor, and its position may be measured by counting the number of steps of the motor.
- the visual feedback unit 932 controls the zoom control unit 924 in order to adjust the focal length of the fixed head lens 917 and the moving head lens 918, and the zoom control unit 924 controls the zoom motor 926 and the zoom motor 929. At this time, the focal length is controlled so as to maintain the same value.
- the visual feedback unit 932 also receives detailed information about the display unit 933 on which the captured image is displayed from the display unit configuration determination unit 930.
- This information is, for example, a preset value indicating the screen size of the display unit 933 and the planned observation distance. Alternatively, the user may input appropriate data for such information.
- the visual feedback unit 932 further receives subject depth information from the subject depth determination unit 931.
- the subject depth determination unit 931 may simply set the far point to infinity and the near point to the minimum focal length of the camera. In more advanced examples, for example, if the camera is an autofocus type, one is The above depth range limit value may be measured. In order to maximize the flexibility, the distance data measured accurately is supplied to the visual feedback unit 932 by pointing the autofocus sensor to the nearest and farthest points in the image to be captured.
- the zoom control unit 924 controls the zoom motor 926 and the zoom motor 929 to adjust the focal length of the fixed head lens 917 and the moving head lens 918, and in addition, the camera of the fixed head 915 and the moving head 916.
- Information indicating whether or not the force S is operating within the allowable conditions is supplied to the visual feedback unit 932. For example, when the maximum parallax condition is exceeded, the visual feedback unit 932 notifies the visual feedback unit 932 that the image that will be captured with the current camera settings is inappropriate, and the visual feedback unit 932 displays this. The user is notified by the information displayed in section 933. Similarly, if the depth of the captured image is too small, it may not be well perceived as 3D!
- the image captured by the imaging elements of the fixed head 915 and the moving head 916 is sent to the image processing unit 934, which is sent from the zoom control unit 924 and the visual feedback unit 932.
- the captured image is processed based on the data and is not displayed on the display unit 933.
- a processed or unprocessed image is stored in a fixed or detachable memory 935, and in the case of the detachable memory 935, the memory 935 is transferred to another device and the image is transferred to another device. For example, move to a computer or a 3D projector and perform other processing or display in 3D.
- the 3D camera 910 has a communication unit (not shown)
- the communication unit is used to move an image to another device such as a computer or a three-dimensional projector. Processing can be performed and stereoscopic display can be performed.
- the visual feedback unit 932 receives information indicating the position of the moving head 916 and the distance between the fixed head 915 and the moving head 916 from the position encoder 925.
- the visual feedback unit 932 receives information indicating the focal lengths of the lenses of the fixed head 915 and the moving head 916 from the zoom control unit 924, and combines the distance information between the fixed head 915 and the moving head 916 with the field of view of the camera. To decide. For example, if fixed head 915 and moving head 916 have the largest spacing, fixed head lens 917 and moving head lens 918 have the widest field of view.
- the focal length is controlled to have Conversely, if the distance between fixed head 915 and moving head 916 is set to a minimum, fixed head lens 917 and moving head lens 918 are controlled to have the narrowest field of view within the available range.
- FIG. 12 shows a cross-sectional view of this conventional liquid microlens 960.
- the liquid microlens 960 has a droplet 962 made of a transparent liquid, and its diameter is several microns to several millimeters.
- the droplet 962 is disposed on the transparent substrate 964.
- the transparent substrate 964 has a hydrophobic force or a hydrophobic coating layer. Therefore, if the interfacial tension of the droplet 962 with respect to the transparent substrate 964 is very high, the droplet 962 will “repel” on the transparent substrate 964 and become spherical.
- the interfacial tension of the droplet 962 with respect to the transparent substrate 964 is weakened by performing electromagnetic control to apply a predetermined voltage between the droplet 962 and the transparent substrate 964 by the electron wettability phenomenon described later. Therefore, it is possible to construct a lens in which the angle of the end of the droplet 962 with respect to the transparent substrate 964 is ⁇ .
- the transparent liquid constituting the droplet 962 and the transparent substrate 964 are transparent with respect to a certain range of light including visible light.
- the contact angle “ ⁇ ” between the droplet 962 and the transparent substrate 964 is determined by the following interfacial tension “Y” (usually measured in millinewtons per meter (mN / m)).
- the interfacial tension with the air (which may be gas or other fluid)
- the focal length f of the liquid microlens 960 is a function of the radius R and the refractive index “n”.
- n is the refractive index of the droplet 962
- n is the air surrounding the droplet 962 (gas or other
- the focal length f is expressed by Equation 3.
- the focal length of the 960s is a function of the contact angle ⁇ .
- FIG. 13 is a schematic view showing the electron wettability phenomenon.
- the contact angle ⁇ to ⁇ between the droplet 972, which is a conductive fluid, and the dielectric insulating layer 974, which has a dielectric constant ⁇ E '' and a thickness ⁇ d '' is reversible. Can be changed, and therefore the focal length is reversibly
- a changeable liquid microlens can be provided.
- a metal electrode 976 is disposed below the dielectric insulating layer 974 and is insulated from the conductive fluid droplet 972 by the dielectric insulating layer 974.
- the droplet 972 is, for example, a small water droplet
- the dielectric insulating layer 974 is a thin film or thin plate formed using, for example, Teflon (registered trademark) / Parylene as a material.
- Teflon registered trademark
- Parylene Parylene
- the droplet 972 tends to be "repelled" into a spherical shape on the dielectric insulating layer 974.
- the shape of the droplet 978 represented by a broken line is that the voltage V is applied between the metal electrode 976 and the droplet 972 to cause an electron wettability phenomenon, and the droplet 972 and the dielectric insulating layer The hydrophobicity with 974 is weakened (hydrophilicity becomes stronger), and the droplets 972 are evenly diffused with respect to the dielectric insulating layer 974.
- the voltage V at this time is in the range of several volts to several hundred volts, and the polarity is not relevant.
- the amount of diffusion is a function of the voltage V, and the contact angle ⁇ is expressed by Equation 4.
- Patent Document 1 JP 2001-142166 A
- Patent Document 2 Japanese Patent Laid-Open No. 2003-050303
- the force that can reversibly change the focal length of the lens by electromagnetic control by the liquid microlens as described above is not necessarily used to obtain a planar image and a stereoscopic image. I could't do it.
- a first aspect of the present invention is directed to a camera device.
- the present invention provides a liquid lens that can be switched between a monocular lens and a compound lens, and a liquid lens that is switched to a monocular lens to capture a planar image, and a liquid lens that is switched to a compound eye lens to capture a stereoscopic image.
- a switching unit a liquid lens that can be switched between a monocular lens and a compound lens, and a liquid lens that is switched to a monocular lens to capture a planar image, and a liquid lens that is switched to a compound eye lens to capture a stereoscopic image.
- Switching between 2D planar image capture and 3D stereoscopic image capture does not require a moving mechanism, reducing power consumption and improving reliability. Furthermore, it is possible to provide a small and lightweight 3D stereoscopic camera device.
- the switching unit preferably changes the number of optical axes and the arrangement of the optical axes when the liquid lens is switched to the compound eye lens.
- an optical axis control unit that changes the optical axis direction of the liquid lens is further provided, and the optical axis control unit switches the liquid lens to a monocular lens to capture a planar image, and the liquid lens. Depending on when you switch to a compound eye lens and take a 3D image, It is preferable to change the optical axis direction of the body lens.
- the switching unit transmits through the liquid lens when the liquid lens is switched to a monocular lens to capture a planar image and when the liquid lens is switched to a compound eye lens to capture a stereoscopic image. It is preferable to control the amount of light irradiated to the element.
- a moving unit that changes the distance between the image sensor and the liquid lens is further provided, and the moving unit controls the distance between the image sensor and the liquid lens.
- the distance between the liquid lens and the image sensor can be optimally controlled in accordance with the focal length of the liquid lens, and the zoom magnification including enlargement / reduction can be freely changed to obtain an optimal still image or A moving image can be taken.
- the recording unit further includes a recording unit that records either or both of a moving image and a still image captured by the liquid lens.
- the switching unit preferably switches between the monocular lens and the compound eye lens by moving the liquid constituting the liquid lens concentrically between the inner peripheral portion and the outer peripheral portion.
- the compound eye lens is composed of a plurality of microlenses, and the switching unit switches the number of microlenses by moving the liquid concentrically between the inner periphery and the outer periphery.
- the liquid constituting the liquid lens can be efficiently moved without waste, and at the same time.
- an arbitrary number of microlenses can be configured, and various stereoscopic images can be generated by capturing images captured from an arbitrary number of viewpoints.
- the liquid is preferably moved by electromagnetic control.
- the liquid moves by centrifugal force generated by rotating the liquid lens and electromagnetic control.
- electromagnetic control is performed by continuously turning on / off or raising / lowering at least one of a voltage and a magnetic field in the radial direction, and the liquid is caused to generate a wave by the electromagnetic control. It is preferable to further include an electromagnetic control unit to be moved.
- the electromagnetic wave does not require a mechanically movable part, and the liquid constituting the liquid lens can be moved at high speed and efficiently without waste at low energy consumption. It becomes possible to switch between a monocular lens and a compound eye lens.
- the outer peripheral portion of the liquid lens is not used for condensing light.
- liquids constituting the liquid lens that are not used for light collection or imaging are arranged on the outer periphery, and the focal length of the liquid lens and the number of microlenses can be switched or set more freely and flexibly. It becomes possible.
- the switching unit moves the liquid constituting the liquid lens so as to change the liquid amount distribution between the inner peripheral portion and the outer peripheral portion, thereby changing the light collection rate of the liquid lens, thereby improving the sensitivity. It is preferable to fiddle P.
- the switching unit lowers the sensitivity by lowering the light collection rate at the outer peripheral portion of the liquid lens by reducing the liquid amount at the outer peripheral portion.
- the switching unit lowers the liquid amount in the outer peripheral portion by thinning the outer peripheral portion of the liquid lens.
- the switching unit raises the light collection rate at the outer peripheral part of the liquid lens to increase the sensitivity by increasing the amount of liquid at the outer peripheral part! /.
- the switching unit increases the amount of liquid in the outer peripheral portion by thickening the outer peripheral portion of the liquid lens.
- the liquid amount distribution is preferably changed by changing the voltage applied to the inner and outer peripheral portions of the liquid lens to change the shape of the liquid lens.
- the switching unit moves the liquid not used for condensing in the liquid lens to the outside of the region used for condensing the liquid lens.
- the switching unit when the liquid lens is switched to the compound eye lens, the switching unit preferably inscribes the imaging element region without overlapping the liquid lens.
- the entire lens surface can be effectively used even though the aperture is small.
- the image processing apparatus further includes an image input processing unit, and when the liquid lens is switched to the compound eye lens, the switching unit is configured so that the liquid lens partially overlaps and is inscribed in the imaging element region. Part performs arithmetic processing on the input video from the overlapped part. Therefore, it is preferable to correct the image for each lens.
- the switching unit circumscribes the imaging element region where the liquid lens does not overlap when the liquid lens is switched to the compound eye lens.
- the video input processing unit is further provided, and when the liquid lens is switched to the compound-eye lens, the switching unit is configured so that the liquid lens partially overlaps and circumscribes the imaging element region. It is preferable that the unit corrects the image for each lens by performing arithmetic processing on the input image from the overlapping part.
- the outside of the liquid lens is preferably made of a liquid, a gel-like substance, or a gas having a specific gravity smaller than that of the liquid lens.
- phase transition control unit that causes the liquid lens to exist as a liquid only at the time of switching, and to exist as a solid at times other than the switching.
- phase transition control unit that causes the liquid lens to exist as a gas only at the time of switching, and to exist as a liquid or a solid other than at the time of switching.
- lens arrangement can be performed at high speed.
- the liquid lens is preferably a monocular lens when the power is off!
- the liquid lens is preferably a compound eye lens when the power is off.
- the liquid lens preferably has a flat plate shape when the power is turned off.
- the liquid lens can be controlled to have a lens shape that is asymmetric with respect to each lens center as well as only a symmetric lens shape with respect to each lens center.
- the switching unit has a switching unit, and a part of the imaging element region is broken to form a compound eye. If a part of the liquid crystal lens cannot be used, it is preferable to dispose the liquid lens only in the usable image sensor region.
- the second aspect of the present invention is directed to a liquid lens.
- the present invention includes a liquid that bends incident light, and switches between a monocular lens and a compound eye lens by moving the liquid concentrically between an inner periphery and an outer periphery.
- a compound eye structure can be realized without taking a plurality of lenses in advance, and a moving image or a still image can be taken.
- switching between 2D planar image capture and 3D stereoscopic image capture does not require a movable mechanism, thus reducing power consumption and improving reliability.
- the compound eye lens is composed of a plurality of microlenses, and the number of microlenses is switched by moving liquid concentrically between the inner peripheral portion and the outer peripheral portion.
- the liquid constituting the liquid lens can be efficiently moved without waste, and at the same time, an arbitrary number of microlenses can be configured to shoot various images taken from an arbitrary number of viewpoints. It is possible to generate a stereoscopic image.
- the liquid preferably moves by electromagnetic control.
- the liquid move by centrifugal force generated by rotating the liquid lens and electromagnetic control.
- the electromagnetic wave does not require a mechanically movable part, and the liquid constituting the liquid lens can be moved at a high speed and efficiently without waste while being used with low energy consumption. It becomes possible to switch between a monocular lens and a compound eye lens.
- the third aspect of the present invention is directed to an imaging method using a liquid lens.
- the liquid lens is switched to a monocular lens or a compound eye lens, a planar image is captured with the liquid lens switched to a monocular lens, and a stereoscopic image is captured with the liquid lens switched to a compound eye lens.
- a compound eye structure can be realized without taking a plurality of lenses in advance, and a moving image or a still image can be taken.
- switching between 2D planar image capture and 3D stereoscopic image capture does not require a movable mechanism, thus reducing power consumption and improving reliability.
- a three-dimensional stereoscopic camera device having a compound eye structure only by mounting an electromagnetic control unit that does not require mounting a plurality of lenses, movable mechanisms, and the like in advance.
- switching between 2D planar image capturing and 3D stereoscopic image capturing does not require a movable mechanism, and thus power consumption can be reduced and reliability can be improved.
- FIG. 1 is a block diagram of a main part of a three-dimensional stereoscopic camera according to an embodiment of the present invention.
- FIG. 2 is a schematic diagram showing a state in which the liquid lens unit is used as a monocular lens or a compound eye lens.
- FIG. 3 is a diagram showing an example of an image formed on the image sensor by the liquid lens unit.
- FIG. 4 is an enlarged view showing details of a lens control unit.
- FIG. 5 is a diagram showing an example of a method for moving the droplets constituting the liquid lens unit.
- FIG. 6 is a diagram showing an example in which the liquid lens unit is switched between a monocular lens and a compound eye lens.
- FIG. 7 is a diagram showing an example of switching the aperture and number of liquid microlenses constituting the liquid lens unit.
- FIG. 8 is a diagram showing an example of controlling sensitivity by changing the light collection rate of the liquid lens unit.
- FIG. 9 is a diagram showing an example of switching the sensitivity between the inner peripheral portion and the outer peripheral portion of the liquid lens portion.
- FIG. 10 is an external view of a conventional 3D camera.
- FIG. 11 is a block diagram of the main part of a conventional 3D camera.
- FIG. 12 is a cross-sectional view of a conventional liquid microlens.
- FIG. 13 is a schematic view showing an electron wettability phenomenon.
- FIG. 14 is a schematic view showing a state in which the liquid lens portion is used as a monocular lens or a compound eye lens.
- FIG. 15 is a schematic diagram showing a state in which the liquid lens unit is used as a monocular lens or a compound eye lens.
- FIG. 16 is a schematic diagram showing a state in which the liquid lens unit is used as a monocular lens or a compound eye lens.
- FIG. 17 is a cross-sectional view showing a state in which the liquid lens portion is used as a monocular lens or a compound eye lens.
- FIG. 18 is a schematic diagram showing a state in which the liquid lens unit is used as a monocular lens or a compound eye lens.
- FIG. 1 shows a block diagram of the main part of a 3D stereoscopic camera 100 according to an embodiment of the present invention.
- This 3D stereo camera 100 is a video movie camera or digital camera used for various purposes such as industrial, consumer, surveillance, robot, medical, analysis, measurement and measurement, entertainment, etc. (Digital still camera), still image camera can be used as a camera for moving image shooting.
- Digital still camera still image camera
- the three-dimensional stereoscopic camera 100 has one liquid lens portion 182 as its lens portion. As will be described later, this liquid lens unit 182 utilizes the electron wettability phenomenon described above. Thus, the focal length can be reversibly changed, and at the same time, it can be switched and used as a monocular lens or a compound eye lens.
- FIG. 2 shows a schematic view of the liquid lens portion 182 in a state where it is used as a monocular lens or a compound eye lens using the electron wettability phenomenon.
- Fig. 2 (a) shows a state in which the liquid lens portion 182 is used as one large lens of a single eye by utilizing the electron wettability phenomenon.
- the image sensor 186 is composed of phototransistors, photodiodes, and other various photoelectric element forces of various materials' configurations, and various structures such as a lattice matrix, a staggered lattice, a honeycomb structure, etc. This is an image sensor 186 that can capture an original planar image. For example, a single CCD area image sensor chip or a CMOS-planar image sensor.
- the image sensor 186 is a large diamond-shaped square in FIGS.
- This image sensor 186 is the same as that shown in FIG. 1, FIG. 2 (a), FIG. 2 (b), and FIG. 2 (c), and the liquid lens 182 (a) to liquid lens 182 ( Between the c) and the image sensor 186, there is a force S in which the lens control unit 184 corresponding to the dielectric insulating layer 974 and the metal electrode 976 described in the background art exists, and this will be described in detail later. do.
- the liquid lens unit 182 uses the above-described electron wettability phenomenon, and is controlled by the lens control unit 184 in FIGS. 2 (a), 2 (b), and 2 (c). As shown in the figure, a single lens consisting of one large lens (Fig. 2 (a)), a compound eye consisting of two lenses (Fig. 2 (b)), and a compound eye consisting of four lenses (Fig. 2 (c)) Can be used. This switching control method will also be described in detail later.
- FIGS. 2 (a), 2 (b), and 2 (c) are merely examples, and a compound eye composed of three lenses may be used! / However, it may be a compound eye consisting of five or more lenses, and even in the case of a compound eye consisting of two lenses, it is not always necessary to have a compound eye aligned horizontally and horizontally as shown in Fig. 2 (b).
- the compound eyes may be arranged in the vertical and vertical directions, or may be compound eyes arranged in an oblique direction. 3, 4, 5 or more The same applies to a compound eye composed of the upper lens.
- an image of one or a plurality of subjects can be formed on the image sensor 186.
- the diameter of one or a plurality of liquid microlenses constituting each liquid lens portion 182 is different, and is condensed on the image sensor 186 by each microlens. Since the amount of light is also different, when the liquid lens unit 182 is switched to a monocular lens to capture a planar image and to switch to a compound eye lens to capture a stereoscopic image, it is transmitted through the liquid lens and irradiated onto the image sensor 186. It is possible to control the amount of light.
- the lens diameter can be freely changed even when the liquid lens 182 (b) is used as two lenses as shown in Fig. 2 (b). Even when the liquid lens portion 182 (c) is used as four lenses as shown in FIG. 2 (c), the lens diameter can be freely changed, and in each case, the image sensor 186 is irradiated. The amount of light emitted can be controlled freely.
- the liquid lens unit 182 is used as the liquid lens unit 182 (a) including one lens, and the liquid lens unit 182 is used as two liquid microphones.
- the focal length of each liquid microlens It is possible to change or not to change. If this focal length is changed, the zoom of the image to be taken can be controlled.
- the interval between the liquid lens portion 182 and the image sensor 186 may be fixed.
- FIG. 3 shows an example of an image formed on the image sensor 186 by the liquid lens unit 182.
- one liquid lens unit 182 is controlled as six liquid microlenses (liquid microlens 351 to liquid microlens 356) by controlling a lens control unit (not shown in FIG. 3). I use it. As a result, six images (image 371 to image 376) of the subject 301 can be formed on the image sensor 186.
- the force S using the liquid lens portions 182 as six liquid microlenses arranged in a line in the vertical direction is an example for convenience of illustration, and the present invention is It is similar to the above that it is not limited to use.
- the force S that an image is formed only by the liquid microlens 351 to the liquid microphone mouth lens 356 using one liquid lens portion 182 is actually more liquid lenses (in FIG. (Not shown) and fixed focus lenses (including convex and concave lenses, spherical lenses and aspheric lenses) (not shown in Figure 3) may be used.
- the images 371 to 376 can be processed and generated not only by still images, but also by moving images. It is possible to generate body images, 3D stereoscopic images, 3D stereoscopic moving images, and the like. Also, in order to generate 3D stereoscopic images, 3D stereoscopic images, 3D stereoscopic moving images, etc., it is sufficient if there are images with at least two different viewpoints. Use images taken from many different viewpoints. By doing so, it is possible to generate more various 3D stereoscopic images, 3D stereoscopic images, 3D stereoscopic moving images, and the like.
- the liquid lens unit 182 (b) when the liquid lens unit 182 (b) is divided into two lenses and used, two images of the subject are created on the image sensor 186.
- the two images are input to the video input processing unit 121 and the video input processing unit 123, respectively.
- the liquid lens unit 182 may be used by being divided into a larger number of lenses. In such a case, the liquid lens unit 182 may have a larger number of video input processing units.
- video data 102 is input to the video input processing unit 121
- video data 104 is input to the video input processing unit 123.
- the video data 102 and the video data 104 are images (still images or images) taken from different viewpoints of the same subject, that is, from the position of each lens when one liquid lens unit 182 is divided into two lenses. Video).
- the video data 102 and the video data 104 are not necessarily the same subject, and only a part of the subject may be the same subject. That part of the subject is the same subject means that a part of the shooting scene (shooting area) overlaps! /.
- the video data 102 and the video data 104 processed by the video input processing unit 121 and the video input processing unit 123 are sent to the AV control buffer processing unit 125, where they are temporarily stored, and the user interface processing unit Various processes are performed based on user operation information sent from 165.
- examples of operations performed by the user using the user interface processing unit 165 include designation of codec methods such as MPEG2 and H.264.
- information indicating the designated codec method is sent from the user interface processing unit 165 to the AV control buffer processing unit 125, and the AV control buffer processing unit 125 Instructs the CODEC processing unit 127 to perform codec based on the information.
- the content of the operation performed by the user using the user interface processing unit 165 is to perform 3D video recording.
- the video data 102 and the video data 104 that have been once sent to and stored in the AV control buffer processing unit 125 are sent to the CODEC processing unit 127, and a predetermined code necessary for performing three-dimensional video recording is obtained.
- Processing is executed.
- the predetermined encoding process executed here is, for example, moving image compression encoding such as MPEG2, MPEG4, H.264, etc. if it is moving image data, for example, still image data.
- JPEG, PNG, GIF, BMP and other still image compression coding is, for example, JPEG, PNG, GIF, BMP and other still image compression coding.
- the liquid lens unit 182 of the three-dimensional stereoscopic camera 100 is switched as a monocular lens or a compound eye lens to capture a two-dimensional planar image, a three-dimensional stereoscopic image, a three-dimensional
- the user interface processing unit 165 is also used to switch a moving image to be taken or to change a focal length to take a zoomed image and to designate the same.
- Information input from the user interface processing unit 165 by the user according to the menu screen designated by the menu processing unit 163 is sent to the lens processing unit 184 and the AV buffer processing unit 125, and the liquid lens unit 182 is connected to a monocular lens or Necessary processing such as switching as a compound eye lens or switching the focal length is executed.
- the video data 102 and the video data 104 that have been subjected to the predetermined encoding process by the CODEC processing unit 127 are sent to the content processing unit 142 to be streamed.
- the stream processing here is, for example, processing for forming a partial 'transport' stream (hereinafter referred to as “partial TS”).
- the partial TS is used to generate and restore 3D stereoscopic images, such as audio data, various attribute data management data, and other data that are encoded video and still image data alone. It may contain various contents attached information used for.
- the video data 102 and the video data 104 converted to partial TS are recorded on the information recording medium 167 via the media access processing unit 161.
- the information recording medium 167 is, for example, a removable card type recording means using a non-volatile semiconductor memory such as an SD memory card, a removable recording means using a semiconductor memory backed up by a battery, Optical (detachable) recording means using DVD (digital 'versatile' disc), optically removable recording means using BD (blue 'ray' disc), HDD (hard disk This is a magnetic and non-removable (fixed) recording means using a drive.
- these recording means are merely examples, and any other recording means may be used.
- the media access processing unit 161 is a device driver for accessing the various information recording means as described above, and builds and controls a file system on the various information recording means. It may include a file system processing unit for use.
- the video input processing unit 121 and the video input processing unit 123 indicate various states of the lens control unit 184 and the liquid lens unit 182 when the video data 102 and the video data 104 are input.
- Dynamic device information such as the liquid lens unit 182 division method, number of divisions, center position of each divided lens, visual field direction angle, focal length, etc. are sent to the dynamic device information management unit 129.
- Each of these pieces of information may be a value expressed by an absolute coordinate axis with the latitude and longitude of the earth as a coordinate axis! /, And a relative value expressed by various other local coordinate axes. It doesn't matter.
- Information indicating the state of the lens control unit 184 for example, the liquid lens unit 182 is switched as a monocular lens or a compound eye lens to photograph a two-dimensional planar image, a three-dimensional stereoscopic image, or a three-dimensional video Information indicating the state of the lens control unit 184 when an image is captured or a zoom image is captured by switching the focal length is also sent to the dynamic device information management unit 146 as part of the dynamic device information. .
- the dynamic device information is temporarily stored in the dynamic device information management unit 129, and may be selected as necessary.
- the necessary information is the content ancillary information processing unit.
- the content-attached information processing unit 144 executes processing necessary for recording these dynamic device information on the information recording medium 167, for example, in the partial TS.
- the dynamic device information may be recorded in the information recording medium 167 separately from the partial TS that is not necessarily included in the partial TS.
- the static device information management unit 146 various static parameter information related to taking one or a plurality of images in the 3D stereoscopic camera 100, for example, the refraction of the liquid constituting the liquid lens unit 182
- the information, the number of pixels of the image sensor 186, the pixel pitch, and other various types of information are stored and managed. These pieces of information are also sent to the content-attached information processing unit 144.
- the content-attached information processing unit 144 stores these static devices.
- Information may be selected as necessary, and processing necessary for recording in the information recording medium 167, for example, included in the partial TS is executed for necessary information.
- the static device information may be recorded on the information recording medium 167 separately from the partial TS that is not necessarily included in the partial TS.
- the dynamic device information and the static device information are recorded separately from the partial TS.
- the partial TS, the dynamic device information, and the static device information may be an embodiment recorded on the information recording medium 167 as one file. It may be an embodiment recorded on the information recording medium 167 as another file, may be an embodiment recorded on one directory, or an embodiment recorded on another directory.
- the information may be recorded on one information recording medium 167, or may be recorded on another information recording medium 167.
- this static device information is various static parameter information related to shooting the video data 102 and the video data 104, and does not change during normal shooting! /. It may be an embodiment in which information is recorded on the information recording medium 167 in advance, instead of being recorded on the information recording medium 167 at the same time as or after the dynamic device information! An embodiment in which the information is recorded on the information recording medium 167 may be used.
- the dynamic parameter information and the static parameter information are also information for associating a video stream included in the video content with a viewpoint when the video stream is shot.
- the dynamic device information and the static device information processed by the content-attached information processing unit 144 are sent to the content processing unit 142 and incorporated in the persanolet TS, or as a part of the persanolet TS or the partial TS.
- the file is sent to the media access processing unit 161 and recorded on the information recording medium 167 as a separate file.
- the menu processing unit 163 displays a menu or a guide that assists the operation and a process associated therewith.
- the liquid lens unit 182 (b) is divided into two lenses for use, and the video data 102 and the video data 104 are obtained using these two lenses.
- the lens direction that is, the optical axis to adjust the focus. This control is executed by the lens control unit 184.
- FIG. 4 shows an enlarged detail of the lens control unit 184. As shown in FIG. As shown in FIG. 4, the metal electrode 476 constituting the lens control unit 184 is divided into a plurality of small electrodes.
- the metal electrode 476 is divided into a large number of small electrodes, and the voltage applied to each small electrode is changed to control the optical axis, the lens orientation, the focal position, etc. Can be realized.
- 13 metal electrodes 476 divided into small parts are arranged under a dielectric insulating layer 474, and each of these metal electrodes 476 and droplets 472 are arranged between them.
- the voltage applied to is as shown in Figure 4. That is, no voltage is applied to the rightmost two metal electrodes 476 (0V), and the left two metal electrodes 476 are applied with a voltage of 2V, and the left two metal electrodes are left.
- a voltage of IV is applied to 476, no voltage is applied to the left two metal electrodes 476 (0V), and one metal electrode 476 to the left is applied with a voltage of IV to the left
- a voltage of 2V is applied to the adjacent one metal electrode 476, a voltage of 3V is applied to the two left metal electrodes 476, and a voltage is not applied to the leftmost one metal electrode 476.
- each metal electrode 476 is a more continuous value or a discrete value than the discrete value as shown by the battery mark in FIG.
- the pitch can be set to a small value.
- dielectric insulation is applied to the right end face of the droplet 472 by applying a relatively low voltage on the right side of the droplet 472 and applying a relatively high voltage on the left side of the droplet 472.
- the contact angle of ⁇ is expressed by Equation 4, and the force S can be reduced by making ⁇ smaller than ⁇ .
- the optical axis of the liquid lens unit 182 formed by the droplet 472 is moved in a direction inclined from the vertical direction in FIG. 4, and the focal position is similarly opposite to the inclination of the optical axis. It can be moved to force S.
- a control for moving the liquid constituting the liquid lens unit 182 between the inner periphery and the outer periphery Do not use the liquid constituting the liquid lens unit 182 as a lens and the amount to be used as a lens! / Do not use as a lens! / Move to the outer periphery of the area where the liquid is used as a lens It is necessary to distribute the liquid used for the control and the lens according to the shape and arrangement of the predetermined lens.
- the liquid constituting the liquid lens unit 182 is divided into an amount that is used as a lens and an amount that is not used as a lens, and the outer periphery of an area where a liquid that is not used as a lens is used as a lens. It is possible to execute control to move to a part.
- the droplet 571 in FIG. 5 applies a relatively low voltage on the right side of the droplet 571 and applies a relatively high voltage on the left side of the droplet 571.
- the contact angle ⁇ with the dielectric insulating layer 574 at the right end surface of the droplet 571 is changed to the left end surface of the droplet 571.
- the contact angle with the dielectric insulating layer 574 is larger than the contact angle ⁇ . That is
- the voltage distribution between the two is shown as a solid line in the “Voltage distribution diagram between electrode and liquid” at the bottom of FIG. That is, in the droplet 571, the voltage between the electrode and the liquid at the left end of the droplet 571 is applied with a voltage that gradually decreases from both ends to 0 V at the central portion that is lower than the voltage at the left end at the highest right end.
- the shape of the liquid above the dielectric insulating layer 574 becomes a droplet 571.
- the droplet 572 moves as indicated by a broken line. That is, the droplet 572 moves slightly to the left from the state of the droplet 571, and the contact angle ⁇ with the dielectric insulating layer 574 on the right end surface of the droplet 572 is applied to the left side of the droplet 572.
- the contact angle with 74 is smaller than ⁇ . That is, in the previous state, the contact angle of the right end face
- ⁇ is the contact angle of the left end face in the next state, and the left end face contact in the previous state
- the angle ⁇ becomes the contact angle of the right end face in the next state.
- the voltage application range is further shifted to the left, and the right side is applied with a relatively low level and a voltage is applied, and the left side is applied with a relatively high level! . That is, the voltage distribution is in a state where the initial state is shifted to the left as it is.
- the voltage distribution between the liquid above the dielectric insulating layer 574 and the electrode below is shown in the “Voltage distribution between the electrode and liquid” at the bottom of FIG. As a solid line.
- the shape of the liquid above the dielectric insulating layer 574 is as shown in FIG. As indicated by the solid line as droplet 5 73. That is, the droplet 573 moves further to the left from the state of the droplet 572, and the contact angle ⁇ with the dielectric insulating layer 574 on the right end surface of the droplet 573 is the left of the droplet 573. From the contact angle ⁇ with the dielectric insulating layer 574 at the end face
- the shape of the droplet 573 is the same as the shape of the first droplet 571 shifted leftward.
- the liquid above the dielectric insulating layer 574 constituting the liquid lens portion 182 is allowed to flow, for example, from the concentric inner periphery to the outer periphery, or from the outer periphery to the inner periphery. Can be moved.
- a centrifugal force generated by rotating the liquid lens portion 182 itself which is obtained only by such electromagnetic control, is used, or the centrifugal force and the electromagnetic force are Can also be used in combination with is there. By doing so, the movement of the liquid constituting the liquid lens portion 182 can be made faster or more efficient.
- the amount of liquid constituting the liquid lens unit 182 should not be used as a lens amount and lens! Control to move to the outer periphery of the area to be used can be executed.
- the liquid constituting the liquid lens unit 182 is moved and the distribution of the liquid, that is, the shape of the droplets is changed, so that the monocular lens 661 and the compound eye lens 662 are changed. A method for switching between and will be described.
- This monocular lens 661 corresponds to the liquid lens portion 182 (a) shown in FIG.
- the range in which the voltage is applied between the liquid above the dielectric insulating layer 674 and the lower electrode, and the strength of the voltage, that is, the voltage distribution are shown in the lower part of FIG.
- “Voltage distribution diagram between electrode and liquid” one liquid lens portion 182 having a large diameter like the monocular lens 661 can be formed. That is, since this monocular lens 661 has a symmetrical shape, the voltage distribution is also symmetrical.
- the monocular lens 661 having a predetermined contact angle between the liquid and the dielectric insulating layer 674 can be formed by utilizing the above-described electron wettability phenomenon. By changing this voltage, the focal length of the monocular lens 661 can be changed.
- the liquid 669 that is not used to form the liquid lens portion 182 is moved to the outer periphery of the dielectric insulating layer 674, and the other liquid is used to insulate the dielectric.
- the compound-eye lens 662 corresponds to a lens having a larger number of lenses in the liquid lens portion 182 (c) composed of a plurality of microlenses shown in FIG.
- a liquid lens portion 182 composed of a large number of small-diameter liquid microlenses such as the compound-eye lens 662 can be configured.
- each of the microlenses composing the compound-eye lens 662 has a symmetrical shape, the voltage distribution is also symmetrical with respect to each of the microlenses. Then, by increasing the voltage applied to both ends of each microlens, the contact angle between the liquid and the dielectric insulating layer 674 is a predetermined angle by utilizing the above-mentioned electron wettability phenomenon. A compound eye lens 662 composed of microlenses can be formed. By changing this voltage, the focal length of the microlenses constituting each compound eye lens 662 can be changed with the force S.
- the liquid constituting the liquid lens unit 182 is moved and the distribution of the liquid, that is, the shape of the droplets is changed, so that the liquid my constituting the liquid lens unit 182 is changed.
- a method for switching the aperture and number of the clo lens will be described.
- Fig. 7 (a) shows a state in which a relatively small amount of liquid constituting the liquid lens portion 182 is used and a large number of small (small-diameter) compound eye lenses 752 are formed on the dielectric insulating layer 774. Show. In the example of FIG. 7 (a), the size and number of force lenses showing only nine compound eye lenses 752 having a small aperture are for convenience of illustration, and are not necessarily such sizes. It is not limited to numbers.
- the liquid that is not used to form the compound eye lens 752 is moved to the outer peripheral portion of the dielectric insulating layer 774, and is pooled as a liquid 759 that is not used.
- V and liquid 759 that are not used are relatively large. Since the method for moving the liquid is as described above, the description thereof is omitted.
- the liquid lens portion 182 composed of a large number of small-diameter liquid microlenses such as the compound-eye lens 752 can be configured. Since the method for forming the large number of liquid microphone lens is as described above, the description thereof is omitted.
- FIG. 7 (b) a relatively large amount of liquid constituting the liquid lens portion 182 is used, and a relatively large (large-diameter) compound eye lens 762 is relatively disposed on the dielectric insulating layer 774. Shows a few formed. In the example of FIG. 7 (b), only six compound eye lenses 762 having a large aperture are shown, but the size and number of lenses are for convenience of illustration, and such It is not limited to size and number! /.
- the liquid that is not used to form the compound eye lens 762 is moved to the outer periphery of the dielectric insulating layer 774 and pooled as a liquid 769 that is not used.
- the liquid used to form the compound-eye lens 762 is relatively large, and therefore the liquid 769 that is not used is relatively small. Since the method for moving the liquid is also as described above, the description thereof is omitted.
- the liquid lens portion 182 composed of a relatively small number of liquid microlenses having a relatively large aperture, such as the compound-eye lens 762, can be configured. it can. Since the method for forming a relatively small number of liquid microlenses is also as described above, description thereof is omitted.
- the liquid constituting the liquid lens unit 182 is moved so as to change the liquid mass distribution between the inner periphery and the outer periphery, and the light collection rate of the liquid lens unit 182 is changed.
- a method for controlling the sensitivity will be described.
- the electromagnetic control for switching the voltage range between the liquid above the dielectric insulating layer 874 and the lower electrode and the strength of the voltage, that is, the voltage distribution at high speed By changing the shape of the liquid, it is possible to cause a wave at the same time, thereby causing the liquid constituting the liquid lens portion 182 to flow, for example, from the concentric inner periphery to the outer periphery, or from the outer periphery to the inner portion.
- the liquid volume distribution can be changed between the inner periphery and the outer periphery.
- FIG. 8 (a) shows a state in which a relatively large amount of liquid is collected in the inner peripheral portion in this way. Since a relatively large amount of liquid is collected in the inner periphery, the amount of liquid 859 collected in the outer periphery is relatively small! /.
- liquid lens portion 182 composed of a relatively large number of liquid microlenses as shown in the compound eye lens 852.
- the size and number of the liquid microlenses are examples for convenience of illustration, and are not limited to such sizes and numbers.
- the compound-eye lens 852 covers a relatively large part (almost the entire range) of the image sensor 186! /. Sensitivity is increased.
- Fig. 8 (b) shows a state in which a relatively small amount of liquid is collected in the inner peripheral portion in this way. Since a relatively small amount of liquid is collected on the inner periphery, the amount of liquid 869 collected on the outer periphery is relatively large! /.
- a voltage is applied between the liquid above the dielectric insulating layer 874 and the lower electrode as shown in the "voltage distribution diagram between the electrode and liquid" shown in the lower part of Fig. 8 (b).
- a liquid lens portion 182 composed of a relatively small number of liquid microlenses as shown in the compound-eye lens 862 S.
- the size and number of the liquid microlenses are merely examples for convenience of illustration, and are not limited to such sizes and numbers!
- the compound-eye lens 862 covers only a relatively narrow range of the image sensor 186, so that the sensitivity is relatively low in this state.
- the lens control unit 184 controls the liquid lens unit 182 as described above.
- the liquid can be moved so as to change the liquid amount distribution between the inner periphery and the outer periphery, and the condensing rate of the liquid lens unit 182 can be changed to control the sensitivity.
- the liquid lens unit 182 is used as a compound eye lens or a monocular lens, the range of the imaging element 186 in which the lens exists is controlled.
- the power to do S. Therefore, even when the liquid lens unit 182 is switched to a monocular lens to capture a planar image or when the liquid lens unit 182 is switched to a compound eye lens to capture a stereoscopic image, the liquid lens unit 182 is transmitted through the imaging element 186. It is possible to control the amount of light.
- the liquid volume on the inner circumference is increased by increasing the inner circumference of the liquid lens section 182, and the light collection rate on the inner circumference of the liquid lens section 182 is increased to increase the inner circumference section.
- the sensitivity of the liquid lens is increased by increasing the outer periphery of the liquid lens unit 182 and increase the light collection rate on the outer periphery of the liquid lens unit 182 to increase the sensitivity on the outer periphery.
- a method of changing the liquid amount distribution between the inner periphery and the outer periphery by moving the liquid constituting the liquid lens portion 182 from the inner periphery to the outer periphery or from the outer periphery to the inner periphery. Is the same as above.
- the shape of the liquid is controlled by the electromagnetic control in which the voltage is applied between the liquid above the dielectric insulating layer 814 and the electrode below and the strength of the voltage, that is, the voltage distribution is switched at high speed.
- the liquid constituting the liquid lens portion 182 can be moved, for example, from the concentric inner periphery to the outer periphery, or from the outer periphery to the inner periphery.
- the liquid mass distribution can be changed between the inner periphery and the outer periphery.
- FIG. 9 (a) shows the state in which the image sensor 186 does not exist as the liquid 819 that does not use a lot of liquid in this way!
- a voltage is applied between the liquid above the dielectric insulating layer 814 and the lower electrode as shown in the "voltage distribution diagram between the electrode and liquid" shown in the lower part of Fig. 9 (a).
- a compound eye lens 811 having a relatively large aperture is formed at the center of the liquid lens portion 182 and a compound eye lens 812 having a relatively small aperture is formed around the liquid that is not used.
- Within 819 It can be formed in a region where the peripheral image sensor 186 exists.
- the size and number of the liquid microphone mouth lens are merely examples for convenience of illustration, and are not limited to such size and number.
- the amount of the liquid 819 that is not used and the amount of the liquid collected in the region where the image sensor 186 exists are determined depending on the size and number of the plurality of microlenses. It is not limited to the example shown in a).
- the liquid lens portion 182 has a thick central portion and a thin outer periphery, thereby increasing the liquid amount in the central portion and decreasing the liquid amount in the outer peripheral portion.
- the sensitivity can be increased by increasing the light condensing rate, and the sensitivity can be decreased by decreasing the light condensing rate at the outer periphery.
- the liquid lens portion 182 formed in this manner makes it possible to capture a clear image even when the amount of light changes greatly when entering or exiting a tunnel.
- FIG. 9B shows the state where the image sensor 186 does not exist as the liquid 829 that does not use a little liquid in this way!
- a voltage is applied between the liquid above the dielectric insulating layer 814 and the lower electrode as shown in the "voltage distribution diagram between the electrode and liquid" shown in the lower part of Fig. 9 (b).
- a compound eye lens 821 having a relatively small aperture is formed at the center of the liquid lens portion 182 and a compound eye lens 822 having a relatively large aperture is formed around the liquid that is not used. It can be formed in a region where the image pickup element 186 in the inner peripheral portion than 829 exists.
- the size and number of the liquid microphone mouth lens are merely examples for convenience of illustration, and are not limited to such size and number.
- the amount of the liquid 829 that is not used and the amount of the liquid collected in the region where the image sensor 186 exists are determined depending on the size and number of the plurality of microlenses. It is not limited to the example shown in b).
- the amount of liquid 819 that is not used and the amount of liquid 829 that is not used, and the amount of liquid that is collected in the area where the image sensor 186 in the example shown in FIGS. 9A and 9B are present which number is greater and how much is determined depending on the size and number of the plurality of microlenses, and is not necessarily limited to the above example.
- the liquid lens portion 182 has a thin central portion and a thick outer periphery.
- the liquid amount in the central part can be lowered to increase the liquid amount in the outer peripheral part
- the condensing rate in the central part can be lowered to lower the sensitivity
- the condensing rate in the outer peripheral part can be raised to increase the sensitivity.
- the liquid lens portion 182 formed in this way can shoot an image without distortion up to the end and every corner of the image sensor 186 even when shooting a wide image.
- the force described as “liquid” as the material constituting the liquid lens portion 182 is not necessarily limited to liquid.
- the material is a gel-like material, powder, solid, etc. Any material can be used as long as it can be moved by electromagnetic control or a combination of electromagnetic control and mechanical control.
- it may be in a movable state only when movement is necessary by performing electromagnetic control or a combination of electromagnetic control and dynamic control.
- the method of moving the material constituting these liquid lens portions 182 includes the liquid lens portion 182 in addition to the electromagnetic control and the combination of electromagnetic control and mechanical control as described above. It is also possible to change the lens shape indirectly by controlling the surrounding environment.
- Examples of a method of indirectly changing the lens shape by controlling the surrounding environment including the liquid lens portion 182 include, for example, changing the air pressure and wind pressure around the liquid lens portion 182. There is a method of filling the periphery of the liquid lens portion 182 with another liquid and changing the pressure distribution of the liquid filled in the periphery.
- the liquid lens when the liquid lens is switched to a compound eye lens, the liquid lens may be inscribed in the imaging element region without overlapping. As a result, the entire lens surface can be effectively used although it has a small diameter. Further, as shown in FIG. 15, when the liquid lens is switched to the compound eye lens, the liquid lens is partially overlapped so as to be inscribed in the imaging element region, and the video input processing unit 121 and the video input processing unit 123 The image for each lens may be corrected by performing arithmetic processing on the input image from the overlapped portion. Thereby, it is possible to set a high resolution with a large aperture.
- the liquid lens when the liquid lens is switched to a compound eye lens, the liquid lens You may make it circumscribe the image pick-up element area
- the outer lid portion of the liquid lens covering the liquid lens may be composed of a liquid, a gel-like substance, or a gas having a specific gravity smaller than that of the liquid lens.
- the liquid lens is made of water, and the lid that covers the liquid lens is oil.
- a phase transition control unit that causes the liquid lens to exist as a liquid only at the time of switching and to exist as a solid at the time other than the switching. This makes it possible to fix the influence of gravity after the phase transition.
- phase transition control unit that allows the liquid lens to exist as a gas only at the time of switching and to exist as a liquid or a solid other than at the time of switching may be further provided. Thereby, lens arrangement can be performed at high speed.
- the liquid lens may be a monocular lens when the power is off. As a result, more power saving can be maintained.
- the liquid lens may be a compound eye lens when the power is off. Thereby, it can maintain more power saving.
- the liquid lens may have a flat plate shape when the power is off. As a result, more power saving can be maintained.
- the liquid lens may be controllable with a lens shape that is asymmetric with respect to each lens center, as well as with a lens shape that is symmetrical with respect to each lens center. This makes it possible to cope with distortion correction due to lens shape changes and acceleration effects such as gravity.
- the switching unit that switches the liquid lens to a monocular or compound eye is used to capture a planar image and a stereoscopic image.
- the liquid lens may be arranged only in the usable image sensor region. As a result, even if a failure occurs in the image sensor, an image can be captured without being missed.
- a liquid lens that can be switched between a monocular lens and a compound eye lens is provided, a planar image is taken by switching the liquid lens to a monocular lens, and the liquid lens is switched to a compound eye lens to form a stereoscopic image.
- a 3D stereoscopic camera device that can capture moving images and still images by capturing images and realizing a compound eye structure simply by mounting an electromagnetic control unit without mounting multiple lenses in advance. It becomes possible to provide. As a result, switching between two-dimensional planar image shooting and three-dimensional stereoscopic image shooting does not require a movable mechanism, thus reducing power consumption and improving reliability.
- it is possible to provide a small and lightweight three-dimensional body force mela device its industrial applicability is extremely high.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Automatic Focus Adjustment (AREA)
- Studio Devices (AREA)
- Exposure Control For Cameras (AREA)
- Cameras In General (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP07791638A EP2042920B1 (en) | 2006-08-01 | 2007-07-31 | Camera device, liquid lens and image pickup method |
DE602007006494T DE602007006494D1 (de) | 2006-08-01 | 2007-07-31 | Kameraeinrichtung, flüssigkeitslinse und bilderfassungsverfahren |
US12/373,606 US8072486B2 (en) | 2006-08-01 | 2007-07-31 | Camera device, liquid lens, and image pickup method |
JP2008527754A JP4901870B2 (ja) | 2006-08-01 | 2007-07-31 | カメラ装置、液体レンズ及び撮像方法 |
US13/287,370 US20120069236A1 (en) | 2006-08-01 | 2011-11-02 | Camera device, liquid lens, and image pickup method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006-209680 | 2006-08-01 | ||
JP2006209680 | 2006-08-01 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/373,606 A-371-Of-International US8072486B2 (en) | 2006-08-01 | 2007-07-31 | Camera device, liquid lens, and image pickup method |
US13/287,370 Division US20120069236A1 (en) | 2006-08-01 | 2011-11-02 | Camera device, liquid lens, and image pickup method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008016035A1 true WO2008016035A1 (en) | 2008-02-07 |
Family
ID=38997210
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2007/064953 WO2008016035A1 (en) | 2006-08-01 | 2007-07-31 | Camera device, liquid lens and image pickup method |
Country Status (5)
Country | Link |
---|---|
US (2) | US8072486B2 (ja) |
EP (1) | EP2042920B1 (ja) |
JP (1) | JP4901870B2 (ja) |
DE (1) | DE602007006494D1 (ja) |
WO (1) | WO2008016035A1 (ja) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8885079B2 (en) | 2011-03-25 | 2014-11-11 | Fujifilm Corporation | Back-illuminated solid-state image sensing element, method of manufacturing the same, and imaging device |
JP2015033072A (ja) * | 2013-08-06 | 2015-02-16 | 株式会社モルフォ | 画像処理装置及び画像処理方法 |
CN112630935A (zh) * | 2020-12-28 | 2021-04-09 | 厦门力鼎光电股份有限公司 | 一种搭配液体镜头的虹膜识别光学镜头 |
WO2021171586A1 (ja) * | 2020-02-28 | 2021-09-02 | 日本電気株式会社 | 画像取得装置、画像取得方法および画像処理装置 |
Families Citing this family (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4905326B2 (ja) * | 2007-11-12 | 2012-03-28 | ソニー株式会社 | 撮像装置 |
JP5423235B2 (ja) * | 2009-08-20 | 2014-02-19 | ソニー株式会社 | 撮像装置 |
US8780185B2 (en) * | 2009-11-25 | 2014-07-15 | Olympus Imaging Corp. | Image pickup apparatus having a display controlled using interchangeable lens information and/or finder information |
EP2389004B1 (en) * | 2010-05-20 | 2013-07-24 | Sony Computer Entertainment Europe Ltd. | 3D camera and imaging method |
JP2012019383A (ja) * | 2010-07-08 | 2012-01-26 | Panasonic Corp | 記録制御装置、半導体記録装置および記録システム |
US8717680B2 (en) * | 2011-05-06 | 2014-05-06 | Nokia Corporation | Apparatus and associated methods |
US20120320164A1 (en) * | 2011-06-16 | 2012-12-20 | Lenny Lipton | Stereoscopic camera with polarizing apertures |
US20140218535A1 (en) | 2011-09-21 | 2014-08-07 | Magna Electronics Inc. | Vehicle vision system using image data transmission and power supply via a coaxial cable |
US10071687B2 (en) | 2011-11-28 | 2018-09-11 | Magna Electronics Inc. | Vision system for vehicle |
US9667872B2 (en) | 2012-12-05 | 2017-05-30 | Hewlett-Packard Development Company, L.P. | Camera to capture multiple images at multiple focus positions |
US10057498B1 (en) * | 2013-03-15 | 2018-08-21 | Cognex Corporation | Light field vision system camera and methods for using the same |
US10232797B2 (en) | 2013-04-29 | 2019-03-19 | Magna Electronics Inc. | Rear vision system for vehicle with dual purpose signal lines |
US10567705B2 (en) | 2013-06-10 | 2020-02-18 | Magna Electronics Inc. | Coaxial cable with bidirectional data transmission |
US9451162B2 (en) * | 2013-08-21 | 2016-09-20 | Jaunt Inc. | Camera array including camera modules |
US11019258B2 (en) | 2013-08-21 | 2021-05-25 | Verizon Patent And Licensing Inc. | Aggregating images and audio data to generate content |
US9911454B2 (en) | 2014-05-29 | 2018-03-06 | Jaunt Inc. | Camera array including camera modules |
US10368011B2 (en) | 2014-07-25 | 2019-07-30 | Jaunt Inc. | Camera array removing lens distortion |
US11108971B2 (en) | 2014-07-25 | 2021-08-31 | Verzon Patent and Licensing Ine. | Camera array removing lens distortion |
US10440398B2 (en) | 2014-07-28 | 2019-10-08 | Jaunt, Inc. | Probabilistic model to compress images for three-dimensional video |
US10701426B1 (en) | 2014-07-28 | 2020-06-30 | Verizon Patent And Licensing Inc. | Virtual reality system including social graph |
US10186301B1 (en) | 2014-07-28 | 2019-01-22 | Jaunt Inc. | Camera array including camera modules |
US9363569B1 (en) | 2014-07-28 | 2016-06-07 | Jaunt Inc. | Virtual reality system including social graph |
US9774887B1 (en) | 2016-09-19 | 2017-09-26 | Jaunt Inc. | Behavioral directional encoding of three-dimensional video |
US10440281B2 (en) * | 2014-08-13 | 2019-10-08 | Taiwan Semiconductor Manufacturing Company, Ltd. | Image processing apparatus on integrated circuit and method thereof |
CN105390519A (zh) * | 2015-12-04 | 2016-03-09 | 华中科技大学 | 一种复眼与高像质单眼时序电调成像探测芯片 |
US11032535B2 (en) | 2016-09-19 | 2021-06-08 | Verizon Patent And Licensing Inc. | Generating a three-dimensional preview of a three-dimensional video |
US10681341B2 (en) | 2016-09-19 | 2020-06-09 | Verizon Patent And Licensing Inc. | Using a sphere to reorient a location of a user in a three-dimensional virtual reality video |
US11032536B2 (en) | 2016-09-19 | 2021-06-08 | Verizon Patent And Licensing Inc. | Generating a three-dimensional preview from a two-dimensional selectable icon of a three-dimensional reality video |
TWI597704B (zh) | 2016-12-12 | 2017-09-01 | 國立清華大學 | 液體透鏡晶片、驅動裝置及其驅動方法 |
KR102402615B1 (ko) * | 2017-04-11 | 2022-05-27 | 엘지이노텍 주식회사 | 액체 렌즈 제어 회로 |
US10694167B1 (en) | 2018-12-12 | 2020-06-23 | Verizon Patent And Licensing Inc. | Camera array including camera modules |
KR20210148172A (ko) * | 2019-04-18 | 2021-12-07 | 소니그룹주식회사 | 교환 렌즈, 정보 처리 장치, 정보 처리 방법, 및 프로그램 |
CN112468684A (zh) * | 2019-09-09 | 2021-03-09 | 北京小米移动软件有限公司 | 摄像头模组和具有该摄像头模组的移动终端 |
CN113691714B (zh) * | 2021-08-24 | 2023-07-25 | 维沃移动通信(杭州)有限公司 | 电子设备 |
CN113612929B (zh) * | 2021-10-11 | 2021-12-21 | 北京创米智汇物联科技有限公司 | 复眼摄像装置及其控制方法、电子设备以及存储介质 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000036968A (ja) * | 1998-07-21 | 2000-02-02 | Canon Inc | 複眼撮像装置及び複眼撮像方法 |
JP2001142166A (ja) | 1999-09-15 | 2001-05-25 | Sharp Corp | 3dカメラ |
JP2003050303A (ja) | 2001-06-19 | 2003-02-21 | Lucent Technol Inc | 調整可能な液状マイクロレンズとその製造方法 |
JP2004311666A (ja) * | 2003-04-04 | 2004-11-04 | Kyocera Corp | 固体撮像素子 |
JP2005185090A (ja) * | 2003-11-25 | 2005-07-07 | Matsushita Electric Ind Co Ltd | 移動機構及びそれを用いた小型カメラ、ゴニオメーターとファイバースコープ |
JP2006064946A (ja) * | 2004-08-26 | 2006-03-09 | Fuji Photo Film Co Ltd | 光学素子、レンズユニット、および撮像装置 |
JP2007025601A (ja) * | 2005-07-21 | 2007-02-01 | Sony Corp | 表示装置、表示制御方法、並びにプログラム |
JP2007520166A (ja) * | 2004-01-26 | 2007-07-19 | ディジタル・オプティックス・コーポレイション | サブピクセル解像度を有する薄型カメラ |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6014259A (en) * | 1995-06-07 | 2000-01-11 | Wohlstadter; Jacob N. | Three dimensional imaging system |
JP2001016617A (ja) | 1999-06-30 | 2001-01-19 | Canon Inc | 撮像装置、その輻輳制御方法、記憶媒体および光学装置 |
US6864910B1 (en) * | 1999-06-30 | 2005-03-08 | Canon Kabushiki Kaisha | Optical apparatus |
KR100952184B1 (ko) | 2002-02-20 | 2010-04-09 | 코닌클리즈케 필립스 일렉트로닉스 엔.브이. | 디스플레이 장치 |
JP2004297540A (ja) * | 2003-03-27 | 2004-10-21 | Sharp Corp | 立体映像記録再生装置 |
IL155525A0 (en) * | 2003-04-21 | 2009-02-11 | Yaron Mayer | System and method for 3d photography and/or analysis of 3d images and/or display of 3d images |
GB2403814A (en) * | 2003-07-10 | 2005-01-12 | Ocuity Ltd | Directional display apparatus with birefringent lens structure |
US6847493B1 (en) * | 2003-08-08 | 2005-01-25 | Lucent Technologies Inc. | Optical beamsplitter with electro-wetting actuation |
US7545430B2 (en) | 2003-11-25 | 2009-06-09 | Panasonic Corporation | Moving mechanism, and compact camera, goniometer and fiberscope using the moving mechanism |
JP4396317B2 (ja) * | 2004-02-25 | 2010-01-13 | 富士フイルム株式会社 | 液体吐出ヘッド及びその製造方法 |
DE102005005933A1 (de) | 2005-02-09 | 2006-08-17 | Carl Zeiss Meditec Ag | Variable Optik |
JP2007110588A (ja) * | 2005-10-17 | 2007-04-26 | Funai Electric Co Ltd | 複眼撮像装置 |
JP2007121631A (ja) * | 2005-10-27 | 2007-05-17 | Funai Electric Co Ltd | 複眼撮像装置 |
KR101217550B1 (ko) * | 2006-01-26 | 2013-01-02 | 삼성전자주식회사 | 방사형 전기삼투 유동을 이용한 증발하는 액적 내의 입자분포 제어 장치 |
JP5040493B2 (ja) * | 2006-12-04 | 2012-10-03 | ソニー株式会社 | 撮像装置及び撮像方法 |
-
2007
- 2007-07-31 WO PCT/JP2007/064953 patent/WO2008016035A1/ja active Application Filing
- 2007-07-31 JP JP2008527754A patent/JP4901870B2/ja not_active Expired - Fee Related
- 2007-07-31 DE DE602007006494T patent/DE602007006494D1/de active Active
- 2007-07-31 US US12/373,606 patent/US8072486B2/en active Active
- 2007-07-31 EP EP07791638A patent/EP2042920B1/en not_active Expired - Fee Related
-
2011
- 2011-11-02 US US13/287,370 patent/US20120069236A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000036968A (ja) * | 1998-07-21 | 2000-02-02 | Canon Inc | 複眼撮像装置及び複眼撮像方法 |
JP2001142166A (ja) | 1999-09-15 | 2001-05-25 | Sharp Corp | 3dカメラ |
JP2003050303A (ja) | 2001-06-19 | 2003-02-21 | Lucent Technol Inc | 調整可能な液状マイクロレンズとその製造方法 |
JP2004311666A (ja) * | 2003-04-04 | 2004-11-04 | Kyocera Corp | 固体撮像素子 |
JP2005185090A (ja) * | 2003-11-25 | 2005-07-07 | Matsushita Electric Ind Co Ltd | 移動機構及びそれを用いた小型カメラ、ゴニオメーターとファイバースコープ |
JP2007520166A (ja) * | 2004-01-26 | 2007-07-19 | ディジタル・オプティックス・コーポレイション | サブピクセル解像度を有する薄型カメラ |
JP2006064946A (ja) * | 2004-08-26 | 2006-03-09 | Fuji Photo Film Co Ltd | 光学素子、レンズユニット、および撮像装置 |
JP2007025601A (ja) * | 2005-07-21 | 2007-02-01 | Sony Corp | 表示装置、表示制御方法、並びにプログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2042920A4 |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8885079B2 (en) | 2011-03-25 | 2014-11-11 | Fujifilm Corporation | Back-illuminated solid-state image sensing element, method of manufacturing the same, and imaging device |
JP2015033072A (ja) * | 2013-08-06 | 2015-02-16 | 株式会社モルフォ | 画像処理装置及び画像処理方法 |
WO2021171586A1 (ja) * | 2020-02-28 | 2021-09-02 | 日本電気株式会社 | 画像取得装置、画像取得方法および画像処理装置 |
JPWO2021171586A1 (ja) * | 2020-02-28 | 2021-09-02 | ||
JP7355213B2 (ja) | 2020-02-28 | 2023-10-03 | 日本電気株式会社 | 画像取得装置、画像取得方法および画像処理装置 |
US12010422B2 (en) | 2020-02-28 | 2024-06-11 | Nec Corporation | Image acquiring device, image acquiring method, and image processing device |
CN112630935A (zh) * | 2020-12-28 | 2021-04-09 | 厦门力鼎光电股份有限公司 | 一种搭配液体镜头的虹膜识别光学镜头 |
Also Published As
Publication number | Publication date |
---|---|
EP2042920B1 (en) | 2010-05-12 |
EP2042920A4 (en) | 2009-05-06 |
DE602007006494D1 (de) | 2010-06-24 |
JP4901870B2 (ja) | 2012-03-21 |
US20120069236A1 (en) | 2012-03-22 |
JPWO2008016035A1 (ja) | 2009-12-24 |
EP2042920A1 (en) | 2009-04-01 |
US20090174765A1 (en) | 2009-07-09 |
US8072486B2 (en) | 2011-12-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4901870B2 (ja) | カメラ装置、液体レンズ及び撮像方法 | |
US11714265B2 (en) | Camera module including magnet interacting with both coil for performing focusing function and coil for performing shake compensation function | |
JP5331838B2 (ja) | 固体撮像装置および携帯情報端末 | |
JP4981124B2 (ja) | 改良型プレノプティック・カメラ | |
JP2008170860A (ja) | 撮像素子およびその撮像素子を含む撮像装置 | |
US20140104388A1 (en) | Optical Lens Module Assembly With Auto Focus and 3-D Imaging Function | |
JP2010050707A (ja) | 撮像装置、表示装置および画像処理装置 | |
JP2007128085A (ja) | 液体ズームレンズ | |
US11558560B2 (en) | Imaging apparatuses and optical devices having spatially variable focal length | |
JP2007121846A (ja) | 液体レンズ装置、振れ補正装置及び撮像装置 | |
JP2014182300A (ja) | 液晶光学素子、固体撮像装置、携帯情報端末、および表示装置 | |
CN1844959A (zh) | 基于介质上电润湿的电控流体变焦透镜 | |
JP2006154742A (ja) | 光学素子を含むイメージピックアップモジュール | |
JP2008172682A (ja) | 撮像素子およびその撮像素子を含む撮像装置 | |
CN115022510A (zh) | 摄像头组件、电子设备及其拍摄方法和拍摄装置 | |
JP2008134323A (ja) | 撮像用のズームレンズ及び撮像装置 | |
CN103379272A (zh) | 相机模块及拍摄方法 | |
KR102326837B1 (ko) | 촬상 장치 및 그 동작방법 | |
JP2007121980A (ja) | 磁性流体レンズとその応用 | |
KR101761846B1 (ko) | 복수의 촬상 소자를 갖는 카메라 | |
JP2005062318A (ja) | 可変焦点距離光学系及び撮像装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07791638 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12373606 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007791638 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008527754 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
NENP | Non-entry into the national phase |
Ref country code: RU |