WO2016088840A1 - 撮像装置、電子機器およびプログラム - Google Patents
撮像装置、電子機器およびプログラム Download PDFInfo
- Publication number
- WO2016088840A1 WO2016088840A1 PCT/JP2015/084031 JP2015084031W WO2016088840A1 WO 2016088840 A1 WO2016088840 A1 WO 2016088840A1 JP 2015084031 W JP2015084031 W JP 2015084031W WO 2016088840 A1 WO2016088840 A1 WO 2016088840A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- imaging
- area
- icon
- region
- control unit
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 claims description 552
- 238000001514 detection method Methods 0.000 claims description 39
- 238000000034 method Methods 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 18
- 238000012545 processing Methods 0.000 description 73
- 230000000875 corresponding effect Effects 0.000 description 68
- 238000010586 diagram Methods 0.000 description 67
- 239000004973 liquid crystal related substance Substances 0.000 description 56
- 230000008859 change Effects 0.000 description 50
- 230000004048 modification Effects 0.000 description 37
- 238000012986 modification Methods 0.000 description 37
- 238000009825 accumulation Methods 0.000 description 33
- 210000003813 thumb Anatomy 0.000 description 23
- 238000004891 communication Methods 0.000 description 21
- 238000012937 correction Methods 0.000 description 21
- 239000002131 composite material Substances 0.000 description 17
- 210000003811 finger Anatomy 0.000 description 17
- 238000004364 calculation method Methods 0.000 description 12
- 238000012546 transfer Methods 0.000 description 11
- 210000004935 right thumb Anatomy 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000011218 segmentation Effects 0.000 description 5
- 230000007704 transition Effects 0.000 description 5
- 230000007423 decrease Effects 0.000 description 4
- 210000004247 hand Anatomy 0.000 description 4
- 241000238370 Sepia Species 0.000 description 3
- 241000724291 Tobacco streak virus Species 0.000 description 3
- 230000004397 blinking Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 210000004936 left thumb Anatomy 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 2
- 238000007664 blowing Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 238000004904 shortening Methods 0.000 description 2
- 241000282326 Felis catus Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000002844 melting Methods 0.000 description 1
- 230000008018 melting Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000002161 passivation Methods 0.000 description 1
- 239000012071 phase Substances 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 229910000679 solder Inorganic materials 0.000 description 1
- 239000007790 solid phase Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/18—Signals indicating condition of a camera member or suitability of light
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
- H04N23/635—Region indicators; Field of view indicators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
Definitions
- the present invention relates to an imaging device, an electronic device, and a program.
- An imaging apparatus that can control the exposure time by an electronic shutter for each pixel block obtained by dividing the imaging surface based on the amount of movement of the subject (see Patent Document 1).
- the imaging device includes an imaging element having a first imaging area and a second imaging area different from the first imaging area, and an image generated by the first imaging area. And a control unit that causes the display unit to display the image generated by the second imaging region on the display unit so that the region for setting the imaging condition of the imaging element is selected.
- the detection unit that detects a subject using the image generated by the first imaging region and the image generated by the second imaging region.
- the control unit determines an order in which the display unit displays an image generated by the first imaging region and an image generated by the second imaging region by the subject detected by the detection unit. Is preferred.
- the control unit sets the imaging condition of the first imaging region and the imaging condition of the second imaging region to the display unit. It is preferable to display.
- the control unit is configured to set a setting between an image generated by the first imaging region and an image generated by the second imaging region. It is preferable to increase the rank of the order of the image including the subject related to the imaging scene mode being set.
- the control unit is configured to focus out of an image generated by the first imaging region and an image generated by the second imaging region.
- the control unit is closest to the image generated by the first imaging region and the image generated by the second imaging region. It is preferable to increase the rank of the order of images including the subject.
- the control unit is configured to select a predetermined one of an image generated by the first imaging region and an image generated by the second imaging region. It is preferable to increase the rank of the order of the image including the subject having the luminance lower than the value or higher than the predetermined value.
- the control unit includes a subject out of an image generated by the first imaging region and an image generated by the second imaging region. It is preferable to increase the rank of the order for an image including a subject with a smaller distance difference between them.
- the control unit in the imaging device according to the second aspect, includes a luminance of an image generated by the first imaging region and an image generated by the second imaging region. It is preferable to increase the rank of the order for an image including a subject with a large difference.
- the control unit has a larger one of an image generated by the first imaging area and an image generated by the second imaging area. It is preferable to increase the rank of the order in the image including the subject.
- the control unit in the imaging device according to the second aspect, includes an image generated from the image generated by the first imaging region and the image generated by the second imaging region. It is preferable to increase the rank of the order in the image including the subject closer to the center of the image.
- the electronic device sets the imaging condition of the imaging element using the image generated by the first imaging area of the imaging element and the image generated by the second imaging area of the imaging element.
- a control unit that causes the display unit to display a region to be set; a setting unit that sets an imaging condition of the region of the imaging element selected by the image displayed on the display unit; Is provided.
- the detection unit that detects a subject using the image generated by the first imaging region and the image generated by the second imaging region.
- the control unit determines an order in which the display unit displays an image generated by the first imaging region and an image generated by the second imaging region by the subject detected by the detection unit. Is preferred.
- the control unit displays the imaging condition of the first imaging region and the imaging condition of the second imaging region on the display unit. It is preferable to display.
- the program includes an imaging process for imaging a subject by an imaging element having a first imaging area and a second imaging area different from the first imaging area, and the first imaging area.
- FIG. 5 is a block diagram showing a functional configuration of an image sensor corresponding to the circuit of FIG. 4. It is a figure which shows typically the image of the to-be-photographed object imaged on the image pick-up element of a camera.
- FIGS. 7A to 7C are diagrams illustrating examples of setting screens for imaging conditions. It is a flowchart explaining the flow of the process which sets an imaging condition for every area and images.
- FIGS. 12A to 12C are diagrams illustrating combinations of icons.
- FIG. 13A is a diagram illustrating an operation by the user.
- FIG. 13B is a diagram illustrating an imaging condition setting screen for an area.
- FIG. 14A is a diagram illustrating an imaging condition setting screen in the fifth modification.
- FIG. 14B is a diagram illustrating an imaging condition setting screen in the fifth modification.
- FIG. 15A is a diagram illustrating an operation by the user.
- FIG. 15B is a diagram illustrating an imaging condition setting screen in the fifth modification.
- FIG. 15C is a diagram illustrating a setting screen according to the fifth modification.
- FIG. 16A is a diagram illustrating an imaging condition setting screen in the fifth modification.
- FIG. 16B is a diagram exemplifying a setting screen during operation of icons.
- FIGS. 17A and 17B are diagrams for explaining an arrow icon whose length changes.
- FIG. 18A and FIG. 18B are diagrams illustrating setting screens during operation of icons. It is a figure which illustrates the setting screen of the imaging condition with respect to an area
- FIG. 20A is a diagram illustrating an imaging condition setting screen for a plurality of regions.
- FIG. 20B is a diagram illustrating an imaging condition setting screen for a plurality of regions.
- FIG. 21A is a diagram illustrating an imaging condition setting screen in the sixth modification.
- FIG. 21B is a diagram illustrating an imaging condition setting screen in the sixth modification.
- FIG. 22A and FIG. 22B are diagrams illustrating an imaging condition setting screen in the sixth modification.
- FIG. 23A and FIG. 23B are diagrams exemplifying imaging condition setting screens in Modification 6.
- FIG. 24A and FIG. 24B are diagrams illustrating an imaging condition setting screen in the sixth modification.
- FIG. 25A to FIG. 25E are diagrams illustrating examples of the imaging condition setting screen according to the sixth modification.
- FIG. 26A and FIG. 26B are diagrams exemplifying imaging condition setting screens in Modification 6.
- FIG. 27A and FIG. 27B are diagrams illustrating an imaging condition setting screen in the sixth modification.
- FIG. 28B are diagrams illustrating an imaging condition setting screen in the sixth modification.
- FIG. 29A and FIG. 29B are diagrams illustrating an imaging condition setting screen in the sixth modification.
- FIG. 30A and FIG. 30B are diagrams illustrating an imaging condition setting screen in the sixth modification.
- FIGS. 31A and 31B are diagrams illustrating an imaging condition setting screen according to the sixth modification.
- FIG. 16 is a block diagram illustrating a configuration of an imaging system according to Modification 7. It is a figure explaining supply of the program to a mobile device.
- FIG. 1 is a block diagram illustrating the configuration of an electronic device (for example, camera 1) according to an embodiment.
- the camera 1 includes an imaging optical system 31, an imaging unit 32, an image processing unit 33, a work memory 34, a control unit 35, a liquid crystal monitor 36, an operation member 37, and a nonvolatile memory 38. And a recording unit 39.
- the imaging optical system 31 guides the light flux from the object scene to the imaging unit 32.
- the imaging unit 32 includes an imaging device 100 and a driving unit 32a, and photoelectrically converts an image of a subject formed by the imaging optical system 31.
- the drive unit 32a generates a drive signal necessary for causing the image sensor 100 to perform accumulation control.
- An imaging instruction such as an accumulation time for the imaging unit 32 is transmitted from the control unit 35 to the driving unit 32a.
- the image processing unit 33 performs image processing on the image data captured by the imaging unit 32 in cooperation with the work memory 34.
- the image processing unit 33 includes, for example, contour enhancement processing, gamma correction, white balance adjustment, and the like.
- the work memory 34 temporarily records image data before and after image processing.
- the control unit 35 is configured by a CPU, for example, and controls the overall operation of the camera 1. For example, a predetermined exposure calculation is performed based on the image signal acquired by the imaging unit 32, the accumulation time of the image sensor 100 necessary for proper exposure is determined, and the drive unit 32a is instructed.
- the control unit 35 includes an object detection unit 35a, an area segmentation unit 35b, a setting unit 35c, an imaging condition setting unit 35d, an imaging control unit 35e, and an AF calculation unit 35f. These are realized by software by the control unit 35 executing a program stored in the nonvolatile memory 38, but these may be configured by an ASIC or the like.
- the object detection unit 35a performs a known object recognition process, and from the image acquired by the imaging unit 32, an animal (animal face) such as a person (person's face), a dog, or a cat, a plant, a bicycle, an automobile , Detecting a subject element such as a vehicle such as a train, a building, a stationary object, a landscape such as a mountain or a cloud, or a predetermined specific object.
- the area dividing unit 35b divides (divides) the imaging screen by the imaging unit 32 into a plurality of areas including the subject element detected as described above.
- the setting unit 35c ranks the plurality of regions divided by the region dividing unit 35b. The ordering method will be described later.
- the imaging condition setting unit 35d sets imaging conditions for the imaging device 100. As will be described later, the imaging condition can be set for each of a plurality of areas divided by the area dividing unit 35b.
- the imaging control unit 35e controls each area of the imaging element 100 under the imaging conditions set for each area. That is, the imaging control unit 35e controls imaging performed with different exposure time (accumulation time), gain, frame rate, and the like for each unit region of the imaging device 100.
- the AF calculation unit 35f performs automatic focus adjustment (autofocus: AF) calculation for focusing on a corresponding subject at a predetermined position (called a focus point) on the imaging screen.
- the AF calculation unit 35f sends a drive signal for moving the focus lens of the imaging optical system 31 to the in-focus position based on the AF calculation result.
- the AF method may be a contrast detection method or a phase difference detection method.
- the liquid crystal monitor 36 reproduces and displays the image processed by the image processing unit 33 and the image read out by the recording unit 39.
- the liquid crystal monitor 36 also displays an operation menu screen, a setting screen for setting imaging conditions, and the like.
- the operation member 37 is composed of various operation members such as a release button and a menu button.
- the operation member 37 sends an operation signal corresponding to each operation to the control unit 35.
- the operation member 37 includes a touch operation member provided on the display surface of the liquid crystal monitor 36.
- the non-volatile memory 38 records a program executed by the control unit 35.
- the recording unit 39 records image data or the like on a recording medium including a memory card (not shown).
- the recording unit 39 reads image data recorded on the recording medium in response to an instruction from the control unit 35.
- FIG. 2 is a cross-sectional view of the multilayer image sensor 100.
- the imaging device 100 includes a backside illumination type imaging chip 113 that outputs a pixel signal corresponding to incident light, a signal processing chip 111 that processes the pixel signal, and a memory chip 112 that records the pixel signal.
- the imaging chip 113, the signal processing chip 111, and the memory chip 112 are stacked, and are electrically connected to each other by a conductive bump 109 such as Cu.
- incident light is incident mainly in the positive direction of the Z axis indicated by the white arrow.
- the surface on the side where incident light enters is referred to as a back surface (imaging surface).
- the left direction of the paper orthogonal to the Z axis is the X axis plus direction
- the front side of the paper orthogonal to the Z axis and X axis is the Y axis plus direction.
- the coordinate axes are displayed so that the orientation of each figure can be understood with reference to the coordinate axes in FIG.
- the imaging chip 113 is a back-illuminated MOS image sensor.
- the PD layer 106 is disposed on the back side of the wiring layer 108.
- the PD layer 106 includes a plurality of PDs (photodiodes) 104 that are two-dimensionally arranged and store charges corresponding to incident light, and transistors 105 that are provided corresponding to the PDs 104.
- a color filter 102 is provided on the incident light incident side of the PD layer 106 via a passivation film 103.
- the color filter 102 has a plurality of types that transmit different wavelength regions, and has a specific arrangement corresponding to each of the PDs 104. The arrangement of the color filter 102 will be described later.
- a set of the color filter 102, the PD 104, and the transistor 105 forms one pixel.
- a microlens 101 is provided on the incident light incident side of the color filter 102 corresponding to each pixel.
- the microlens 101 condenses incident light toward the corresponding PD 104.
- the wiring layer 108 includes a wiring 107 that transmits a pixel signal from the PD layer 106 to the signal processing chip 111.
- the wiring 107 may be multilayer, and a passive element and an active element may be provided.
- a plurality of bumps 109 are arranged on the surface of the wiring layer 108.
- the plurality of bumps 109 are aligned with the plurality of bumps 109 provided on the opposing surfaces of the signal processing chip 111, and the imaging chip 113 and the signal processing chip 111 are pressed and aligned.
- the bumps 109 are joined and electrically connected.
- a plurality of bumps 109 are arranged on the mutually facing surfaces of the signal processing chip 111 and the memory chip 112.
- the bumps 109 are aligned with each other, and the signal processing chip 111 and the memory chip 112 are pressurized, so that the aligned bumps 109 are joined and electrically connected.
- the bonding between the bumps 109 is not limited to Cu bump bonding by solid phase diffusion, and micro bump bonding by solder melting may be employed. Further, for example, about one bump 109 may be provided for one block described later. Therefore, the size of the bump 109 may be larger than the pitch of the PD 104. Further, a bump larger than the bump 109 corresponding to the pixel region may be provided in a peripheral region other than the pixel region where the pixels are arranged.
- the signal processing chip 111 has TSVs (silicon through electrodes) 110 that connect circuits provided on the front and back surfaces to each other.
- the TSV 110 is preferably provided in the peripheral area.
- the TSV 110 may also be provided in the peripheral area of the imaging chip 113 and the memory chip 112.
- FIG. 3 is a diagram for explaining the pixel array and the unit area 131 of the imaging chip 113.
- a state where the imaging chip 113 is observed from the back surface (imaging surface) side is shown.
- 20 million or more pixels are arranged in a matrix in the pixel region.
- adjacent 16 pixels of 4 pixels ⁇ 4 pixels form one unit region 131.
- the grid lines in the figure indicate the concept that adjacent pixels are grouped to form a unit region 131.
- the number of pixels forming the unit region 131 is not limited to this, and may be about 1000, for example, 32 pixels ⁇ 64 pixels, or more or less.
- the unit region 131 in FIG. 3 includes four so-called Bayer arrays, which are composed of four pixels of green pixels Gb, Gr, blue pixels B, and red pixels R, vertically and horizontally.
- the green pixels Gb and Gr are pixels having a green filter as the color filter 102, and receive light in the green wavelength band of incident light.
- the blue pixel B is a pixel having a blue filter as the color filter 102 and receives light in the blue wavelength band
- the red pixel R is a pixel having a red filter as the color filter 102 and having a red wavelength band. Receives light.
- a plurality of blocks are defined so as to include at least one unit region 131 per block, and each block can control pixels included in each block with different control parameters. That is, it is possible to acquire imaging signals having different imaging conditions between a pixel group included in a certain block and a pixel group included in another block.
- the control parameters include a frame rate, a gain, a thinning rate, the number of addition rows or addition columns to which pixel signals are added, a charge accumulation time or accumulation count, a digitization bit number (word length), and the like.
- the imaging element 100 can freely perform not only thinning in the row direction (X-axis direction of the imaging chip 113) but also thinning in the column direction (Y-axis direction of the imaging chip 113).
- the control parameter may be a parameter in image processing after obtaining an image signal from a pixel.
- the reset transistors of the pixels included in the unit region 131 are configured to be turned on and off individually for each pixel.
- a reset wiring 300 for turning on / off the reset transistor of the pixel A is provided, and a reset wiring 310 for turning on / off the reset transistor of the pixel B is provided separately from the reset wiring 300.
- a reset line 320 for turning on and off the reset transistor of the pixel C is provided separately from the reset lines 300 and 310.
- dedicated reset wirings for turning on and off the respective reset transistors are provided.
- the transfer transistors of the pixels included in the unit region 131 are also configured to be turned on and off individually for each pixel.
- a transfer wiring 302 for turning on / off the transfer transistor of the pixel A, a transfer wiring 312 for turning on / off the transfer transistor of the pixel B, and a transfer wiring 322 for turning on / off the transfer transistor of the pixel C are separately provided.
- dedicated transfer wirings for turning on / off the respective transfer transistors are provided for the other pixels D to I.
- the selection transistors of the pixels included in the unit region 131 are also configured to be turned on and off individually for each pixel.
- a selection wiring 306 for turning on / off the selection transistor of the pixel A, a selection wiring 316 for turning on / off the selection transistor of the pixel B, and a selection wiring 326 for turning on / off the selection transistor of the pixel C are separately provided.
- a dedicated selection wiring for turning on and off each selection transistor is provided for the other pixels D to I.
- the power supply wiring 304 is commonly connected from the pixel A to the pixel I included in the unit region 131.
- the output wiring 308 is commonly connected from the pixel A to the pixel I included in the unit region 131.
- the power supply wiring 304 is commonly connected between a plurality of unit regions, but the output wiring 308 is provided for each unit region 131 individually.
- the load current source 309 supplies current to the output wiring 308.
- the load current source 309 may be provided on the imaging chip 113 side or may be provided on the signal processing chip 111 side.
- the charge accumulation including the charge accumulation start time, the accumulation end time, and the transfer timing is controlled from the pixel A to the pixel I included in the unit region 131. can do.
- the pixel signals of the pixels I from each pixel A can be output via the common output wiring 308.
- a so-called rolling shutter system in which charge accumulation is controlled in a regular order with respect to rows and columns for pixels A to I included in the unit region 131.
- pixel signals are output in the order of “ABCDEFGHI” in the example of FIG.
- the charge accumulation time can be controlled for each unit region 131.
- the unit area 131 included in another block is rested while the unit areas 131 included in some blocks perform charge accumulation (imaging). Only the image can be taken and the pixel signal can be output.
- FIG. 5 is a block diagram illustrating a functional configuration of the image sensor 100 corresponding to the circuit illustrated in FIG.
- the analog multiplexer 411 sequentially selects the nine PDs 104 forming the unit region 131 and outputs each pixel signal to the output wiring 308 provided corresponding to the unit region 131.
- the multiplexer 411 is formed on the imaging chip 113 together with the PD 104.
- the pixel signal output via the multiplexer 411 is supplied to the signal processing chip 111 by a signal processing circuit 412 that performs correlated double sampling (CDS) / analog / digital (A / D) conversion. D conversion is performed.
- CDS correlated double sampling
- a / D converted pixel signal is transferred to the demultiplexer 413 and stored in the pixel memory 414 corresponding to each pixel.
- the demultiplexer 413 and the pixel memory 414 are formed in the memory chip 112.
- the arithmetic circuit 415 processes the pixel signal stored in the pixel memory 414 and passes it to the subsequent image processing unit.
- the arithmetic circuit 415 may be provided in the signal processing chip 111 or may be provided in the memory chip 112. Note that FIG. 5 shows connections for one unit region 131, but actually these exist for each unit region 131 and operate in parallel. However, the arithmetic circuit 415 does not have to exist for each unit region 131. For example, one arithmetic circuit 415 may perform sequential processing while sequentially referring to the values of the pixel memory 414 corresponding to each unit region 131. Good.
- the output wiring 308 is provided corresponding to each of the unit areas 131. Since the image pickup device 100 includes the image pickup chip 113, the signal processing chip 111, and the memory chip 112, each chip is arranged in the plane direction by using an electrical connection between the chips using the bump 109 for the output wiring 308. Wiring can be routed without increasing the size.
- an imaging condition can be set for each of a plurality of blocks in the imaging device 100 (imaging chip 113).
- the control unit 35 causes the region segmented by the region segmenting unit 35b to correspond to the block, and causes each region to capture an image under imaging conditions.
- FIG. 6 is a diagram schematically showing a subject image formed on the image sensor 100 of the camera 1.
- the camera 1 photoelectrically converts the subject image to obtain a live view image before an imaging instruction is given.
- the live view image refers to a monitor image that is repeatedly imaged at a predetermined frame rate (for example, 60 fps).
- the control unit 35 sets the same imaging condition over the entire area of the imaging chip 113 (that is, the entire imaging screen) before the classification by the area classification unit 35b.
- the imaging condition before the classification is determined based on an exposure condition corresponding to the photometric value of the subject brightness or an exposure condition manually set by the user.
- an image including a person 61a, an automobile 62a, a bag 63a, a mountain 64a, and clouds 65a and 66a is formed on the imaging surface of the imaging chip 113.
- the person 61a holds the bag 63a with both hands.
- the automobile 62a stops at the right rear of the person 61a.
- the control unit 35 divides the screen of the live view image into a plurality of areas based on the live view image as follows.
- the subject element is detected from the live view image by the object detection unit 35a.
- the subject element is detected using a known subject recognition technique.
- the object detection unit 35a detects a person 61a, a car 62a, a bag 63a, a mountain 64a, a cloud 65a, and a cloud 66a as subject elements.
- the screen of the live view image is divided into regions including the subject elements by the region dividing unit 35b.
- the area including the person 61a is the first area 61
- the area including the car 62a is the second area 62
- the area including the bag 63a is the third area 63
- the area including the mountain 64a is the fourth area 64.
- the region including the cloud 65a is referred to as a fifth region 65
- the region including the cloud 66a is referred to as a sixth region 66.
- the setting unit 35c ranks the plurality of regions divided by the region dividing unit 35b.
- the setting unit 35c detects the following regions (1) to (4) among the regions divided by the region dividing unit 35b, the setting unit 35c prioritizes the imaging condition over the other regions divided by the region dividing unit 35b.
- (1) Region in which a specific subject is detected according to the imaging scene mode The specific subject differs depending on the imaging scene mode of the camera 1 that has been set. For example, when the imaging scene mode setting of the camera 1 is set to the portrait mode, the setting unit 35c sets the area including the automobile 62a as the second area 62 with respect to the first area 61 including the person 61a.
- the region including the bag 63 a is the third region 63, the region including the mountain 64 a is the fourth region 64, the region including the cloud 65 a is the fifth region 65, and the region including the cloud 66 a is the imaging condition than the sixth region 66.
- the setting unit 35c applies to the region including the landmark.
- the imaging condition is set as an area to be preferentially changed.
- the landscape mode it is based on the idea that there is a high possibility of setting (changing) the imaging condition of the area including the landmark.
- the landmark When the landmark is detected from the live view image by the object detection unit 35a, the landmark that may be included in the live view image by referring to the position information of the camera 1 acquired from a GPS receiver (not shown). May be specified, or a landmark may be designated by operating the operation member 37 by the user.
- the object detection unit 35a detects a landmark specified based on position information or a landmark designated by a user operation.
- the landmark is, for example, a mountain, a waterfall, an island, a tower, a building, or the like.
- the setting of the imaging scene mode of the camera 1 may be set by the user operating the operation member 37, or may be set by the control unit 37 based on the subject element detected from the screen of the live view image. May be.
- the setting unit 35c displays the subject element in focus (that is, the focus point). Is determined as a region in which the imaging condition is preferentially changed over a region including a subject element that is not in focus.
- an image is captured of an area including the subject element with the smallest focus shift amount (that is, the closest subject element from the subject element position to the in-focus position). You may make it determine as an area
- the setting unit 35c selects the subject element with the darkest or brightest subject element from among the plurality of subject elements detected by the object detection unit 35a.
- the area to be included is determined as an area in which the imaging condition is changed with priority over other areas.
- An object element that is too dark such as blackout and an object element that is too bright such as overexposure is based on the idea that there is a high possibility of setting (changing) the imaging condition.
- the setting unit 35c is an area for preferentially changing the imaging condition over a subject element far away from an area including a subject element closest to the camera 1. decide. For example, the control unit 35 acquires distance information from the camera 1 to the segmented subject element, and determines a region including the subject element closest to the camera 1. In addition, when the distance information cannot be obtained, the control unit 35 may determine an area including the subject element having the largest proportion of the screen as the subject element close to the camera 1.
- the setting unit 35c When the setting unit 35c detects the following regions (5) to (9) among the regions divided by the region dividing unit 35b, the setting unit 35c sets the rank lower than the regions (1) to (4) described above. Thus, the imaging condition is determined as a region to be changed.
- the setting unit 35c detects a plurality of detection points detected by the object detection unit 35a.
- the area including the subject element with the smallest focus deviation amount among the areas other than the area including the focused subject element is set as the area where the imaging condition is changed with priority over the other areas. Set.
- the smaller the amount of focus shift the higher the sharpness of the contour of the subject element. Therefore, it can be said that the subject element having a high contour sharpness has a small amount of focus shift.
- the setting unit 35c sets an area including a subject element having a high outline sharpness as an area in which the imaging condition is preferentially changed over an area having a low outline sharpness.
- Example 1 For example, in FIG. 6, a case is assumed where the person 61a is in focus due to the AF operation performed on the first region 61 by the AF calculation unit.
- the setting unit 35c sets the subject element having the smallest focus shift amount among the automobile 62a, the bag 63a, the mountain 64a, the cloud 65a, and the cloud 66a (that is, from the position of the person 61a in focus).
- the third region 63 including the bag 63a) at a close position is set as a region for preferentially changing the imaging condition after the first region 61 including the person 61a. Based on the idea that the imaging condition of the third region 63 including the bag 63a is likely to be set (changed) next to the first region 61 including the person 61a.
- Example 2 For example, in FIG. 6, a case is assumed in which the AF calculation unit focuses between the person 61a and the car 62a.
- the setting unit 35c has a subject element with the smallest focus shift amount among the automobile 62a, the bag 63a, the mountain 64a, the cloud 65a, and the cloud 66a (that is, the closest position from the focused position).
- the second area 62 including a certain automobile 62a) is set as an area in which the imaging condition is preferentially changed after the first area 61 including the person 61a. Based on the idea that the imaging condition of the second area 62 including the automobile 62a is likely to be set (changed) next to the first area 61 including the person 61a.
- the setting unit 35d sets an order based on the difference in distance from the camera 1 to the subject element. For example, in FIG. 6, it is assumed that the person 61a is in focus by performing the AF operation on the first region 61. In this case, the setting unit 35d determines that the distance from the camera 1 among the car 62a, the bag 63a, the mountain 64a, the cloud 65a, and the cloud 66a is close to the distance from the camera 1 to the person 61a (distance difference).
- the region including the subject element is set as a region for preferentially changing the imaging condition.
- Region including Subject Element with Large Brightness Difference For example, in FIG. 6, a case is assumed where the person 61a is in focus due to the AF operation performed on the first region 61.
- the setting unit 35c sets a region including the subject element having the largest luminance difference between the person 61a among the automobile 62a, the bag 63a, the mountain 64a, the cloud 65a, the cloud 65a, and the cloud 66a.
- the imaging condition is set as an area to be preferentially changed.
- the setting unit 35c preferentially sets the imaging condition to the fourth area 64 including the mountain 64a next to the first area 61 including the person 61a.
- An area including a subject element having a large luminance difference with the person 61a is based on the idea that there is a high possibility that an imaging condition is set (changed).
- any one of (5) to (9) may be selected in advance by operating the operation member 37 by the user.
- a plurality of (5) to (9) may be combined.
- the setting unit 35c ranks the second area 63 to the sixth area 66.
- the second area 62 including the automobile 62a which is a large subject element is ranked second
- the third area 63 including the bag 63a is ranked third
- the fourth area 64 including the mountain 64a is ranked fourth and includes the cloud 65a.
- the fifth region 65 is fifth
- the sixth region 66 including the cloud 66a is sixth.
- the setting unit 35c treats an area that has not been ordered even after the processes (5) to (9) as having an equivalent order.
- the control unit 35 When the control unit 35 divides the screen into a plurality of regions by the region dividing unit 35b, the control unit 35 displays a setting screen as illustrated in FIG. In FIG. 7A, a live view image 60a is displayed, and an imaging condition setting screen 70 is displayed on the right side of the live view image 60a.
- the setting screen 70 lists frame rate, shutter speed (TV), and gain (ISO) in order from the top as an example of setting items for imaging conditions.
- the frame rate is the number of frames of a live view image acquired per second or a moving image recorded by the camera 1.
- Gain is ISO sensitivity.
- the setting items for the imaging conditions may be added as appropriate in addition to those illustrated in FIG. When all the setting items do not fit in the setting screen 70, other setting items may be displayed by scrolling the setting items up and down.
- the areas of the first to sixth areas that are displayed with emphasis (thick display, bright display, display with different colors, display with broken lines, blinking display, etc.) Indicates the area to be set (changed).
- the first area 61 is a target for setting (changing) the imaging condition.
- the imaging condition setting unit 35d displays the highlighted area (first area 61).
- the current set value of the shutter speed is displayed on the screen (reference numeral 68).
- the camera 1 will be described on the premise of a touch operation, but the imaging condition may be set (changed) by operating a button or the like constituting the operation member 37.
- the imaging condition setting unit 35d increases or decreases the shutter speed display 68 from the current set value according to the tap operation.
- the imaging unit 32 (FIG. 1) so as to change the imaging condition of the unit region 131 (FIG. 3) of the imaging device 100 corresponding to the displayed region (first region 61) according to the tap operation.
- the decision icon 72 is an operation icon for confirming the set imaging condition.
- the imaging condition setting unit 35d also sets (changes) the frame rate and gain (ISO) in the same manner as the shutter speed (TV) setting (change).
- the imaging condition setting unit 35d has been described to set the imaging condition based on the user's operation, the imaging condition setting unit 35d is not limited thereto.
- the imaging condition setting unit 35d may set the imaging conditions based on the determination of the control unit 35 without being based on a user operation.
- the imaging condition setting unit 35d determines the overexposure or underexposure based on the determination of the control unit 35. You may make it set an imaging condition so that it may eliminate. For the area that is not highlighted (the area other than the first area 61), the set imaging conditions are maintained.
- the control unit 35 displays the entire target area brightly, increases the contrast of the entire target area, or displays the entire target area. May be displayed blinking.
- the target area may be surrounded by a frame.
- the display of the frame surrounding the target area may be a double frame or a single frame, and the display mode such as the line type, color, and brightness of the surrounding frame may be appropriately changed.
- the control unit 35 may display an indication of a region that is a target for setting imaging conditions such as an arrow in the vicinity of the target region.
- the control unit 35 may display the area other than the target area for which the imaging condition is set (changed) in a dark manner or display the area other than the target area with a lower contrast.
- the control unit 35 further classifies the first area to the sixth area for display (creates a display pattern) and ranks the display patterns.
- display classification display pattern
- the display classification includes, for example, a display pattern that displays the first rank region alone, a display pattern that displays a combination of the first rank region and the second rank region, and the first rank and second rank order. And a display pattern that displays a combination of the first and third order regions, a display pattern that displays a combination of the first and third order regions, a display pattern that displays the second order region alone,
- Various display patterns are created depending on the number of regions arranged in order, such as a display pattern for displaying regions independently.
- the scene mode is set to “portrait” as described above, it is considered that the user wants to set a person's imaging condition, and therefore the first ranked region is a person.
- the display pattern including the first rank region is higher in rank than the display pattern not including the first rank region. Therefore, the display pattern that displays the first rank region alone is the first pattern, the display pattern that displays the combination of the first rank order and the second rank region is the second pattern, the first rank order, the second rank order, and the rank order.
- a display pattern that is displayed in combination with the third region is ordered as a third pattern.
- the display pattern that displays the first-order region alone is the first pattern
- the display pattern that displays the combination of the first-order and second-order regions is the second pattern
- the first-order and third-order regions are ordered as a third pattern.
- the scene mode is set to “portrait”, a scene is assumed in which three subjects are lined up.
- the object detection unit 35a individually identifies three persons and creates a region.
- the order determination unit 35c uses the above-described methods such as the position of the focus point, the position close to the imaging device, the position close to the center of the screen, and the like to rank each order as the first rank, the second rank, and the third rank. Set.
- the display pattern for displaying the first rank region alone is the first pattern
- the display pattern for displaying the second rank region is the first pattern.
- a display pattern that displays two patterns and the third-ranked region alone may be added to the display pattern as a third pattern.
- a method for ordering such display patterns is not limited to imaging a person.
- the first pattern corresponds to the single display pattern because the first area 61 in the first rank is displayed alone, and the second pattern and the third pattern respectively include the first area 61 in the first rank and the other areas. Since it is displayed in combination, it corresponds to a composite display pattern.
- the control unit 35 classifies each subject element as a single region when the number of subject elements detected by the object detection unit 35a is smaller than a predetermined number.
- the subject area may be divided into a single area and a composite area combining the single areas. Alternatively, it may be divided into a composite area and a composite area.
- the control unit 35 For example, in the case of a travel group photo, if a single area is set for each person recognized by the control unit 35, the number of areas increases, and it takes time to set imaging conditions. For this reason, when a single person is combined and a subject person is set as one area (composite area) as a whole, the imaging conditions need only be set for the composite area, and the time can be reduced.
- a mark 69 displayed at the bottom of the live view image 60a indicates that a plurality of display patterns have been created (that is, display segmentation has been performed).
- three display patterns are provided by three circles constituting the mark 69.
- the control unit 35 automatically creates display patterns in accordance with the number of display patterns (that is, performs display classification). That is, the control unit 35 creates three display patterns when the number of display patterns is three. Note that the number of display patterns may be set in advance by the user operating the operation member 37.
- the control unit 35 ranks the display patterns in the order of the first pattern, the second pattern, and the third pattern. And when displaying an area
- the control unit 35 displays the second pattern in the second rank in the liquid crystal monitor 36 as illustrated in FIG. 7B.
- the live view image 60b which emphasized the outline of the 1st area
- the second from the left of the mark 69 is painted black, indicating that the second rank in the three display patterns is displayed.
- the imaging condition setting unit 35d increases or decreases the shutter speed display 68 from the current set value according to the tap operation.
- the imaging unit 32 changes the imaging condition of the unit area 131 (FIG. 3) of the imaging element 100 corresponding to the displayed area (the first area 61 or the second area 62) according to the tap operation.
- the imaging conditions are set in the order of the ordering areas, the order of the areas in which the imaging conditions are set may be changed depending on the user's intention such as a tap operation.
- the control unit 35 causes the liquid crystal monitor 36 to display the third pattern in the third rank as illustrated in FIG. 7C.
- the live view image 60c which emphasized each of the outline of the 1st area
- the third from the left of the mark 69 is painted black, indicating that the third rank in the three display patterns is displayed.
- the imaging condition setting unit 35d increases or decreases the shutter speed display 68 from the current set value according to the tap operation.
- the imaging condition of the unit area 131 (FIG. 3) of the imaging device 100 corresponding to the displayed area (the first area 61, the second area 62, or the third area 63) is changed according to the tap operation. In this way, an instruction is sent to the imaging unit 32 (FIG. 1).
- the imaging conditions are set in the order of the ordering areas, the order of the areas in which the imaging conditions are set may be changed depending on the user's intention such as a tap operation.
- control unit 35 causes the liquid crystal monitor 36 to display a display pattern having a high order contrary to the above description. Display.
- the control unit 35 After an imaging condition is set for each area (single area or composite area), when a release button (not shown) constituting the operation member 37 or a display instructing to start imaging is operated, the control unit 35 generates image data captured under the imaging conditions set for each of the divided areas, and records the generated image data on a recording medium such as a memory card (not shown).
- FIG. 8 is a flowchart for explaining the flow of processing for setting an imaging condition for each region (single region or composite region).
- the control unit 35 activates a program that executes the process shown in FIG.
- the control unit 35 causes the liquid crystal monitor 36 to start live view display, and proceeds to step S20.
- the control unit 35 instructs the imaging unit 32 to start acquiring a live view image, and sequentially displays the acquired live view image on the liquid crystal monitor 36. As described above, at this time, the same imaging condition is set over the entire area of the imaging chip 113, that is, the entire screen. If the setting for performing the AF operation is performed during live view display, the control unit 35 (AF calculation unit 35f) controls the AF operation for focusing on the subject element corresponding to the predetermined focus point. If the setting for performing the AF operation is not performed during the live view display, the control unit 35 (AF calculation unit 35f) performs the AF operation when the AF operation is instructed later.
- step S20 the control unit 35 (object detection unit 35a) detects the subject element from the live view image, and proceeds to step S30.
- step S30 the control unit 35 (region dividing unit 35b) divides the screen of the live view image into regions including subject elements, and proceeds to step S40.
- step S40 the control unit 35 (setting unit 35c) ranks the plurality of regions divided in step S30 according to the above-described procedures (1) to (11) and proceeds to step S50.
- step S50 the control unit 35 creates a display pattern (that is, performs display division) for the plurality of regions divided in step S30. As described above, the control unit 35 creates a display pattern for the area in accordance with the number of display patterns, and proceeds to step S60.
- 7A to 7C show a first pattern (single display pattern) in which the outline of the first area 61 is emphasized, and a second pattern (in which the outlines of the first area 61 and the second area 62 are emphasized) ( Compound display patterns), and three display patterns of a third pattern (composite display pattern) in which the outlines of the first region 61, the second region 62, and the third region 63 are emphasized are illustrated.
- the control unit 35 When creating four or more display patterns, the control unit 35, for example, a fourth pattern (composite display pattern) that emphasizes the outlines of the first region 61, the second region 62, and the fourth region 64, or the first region 61.
- a plurality of display patterns are created by variously combining areas targeted for setting (changing) imaging conditions, such as a sixth pattern (composite display pattern) that emphasizes the fourth area 64.
- the fourth area, the fifth area, and the sixth area are combined into one composite area 1, and the seventh pattern (composite display pattern) that emphasizes the outlines of the first area 61, the second area 62, and the composite area 1 is used. Also good.
- step S60 the control unit 35 ranks the plurality of display patterns generated in step S50 (that is, the area after display division) and proceeds to step S70.
- the control unit 35 normally places the first pattern in the first rank.
- the control unit 35 places the second pattern in the second rank.
- the control unit 35 places the third pattern in the third rank.
- the control unit 35 places the fourth pattern in the fourth rank and the fifth pattern in the fifth rank. Such an order is set by the control unit 35.
- step S70 the control unit 35 displays the areas in the order of order. As illustrated in FIG. 7A, the live view image 60a is displayed in the first pattern ranked first, and the imaging condition setting screen 70 is displayed on the liquid crystal monitor 36, and the process proceeds to step S80.
- the control unit 35 causes the liquid crystal monitor 36 to display other display patterns having different ranks as illustrated in FIGS. 7B and 7C.
- step S80 the control unit 35 determines whether an AF operation is necessary.
- the control unit 35 for example, when the focus adjustment state changes due to the movement of the subject, when the position of the focus point is changed by a user operation, or when execution of the AF operation is instructed by a user operation, An affirmative decision is made in step S80 and the process proceeds to step S85. If the focus adjustment state does not change, the position of the focus point is not changed by the user operation, and the execution of the AF operation is not instructed by the user operation, the control unit 35 makes a negative determination in step S80 and proceeds to step 90. .
- step S85 the control unit 35 performs the AF operation and returns to step S40.
- the control unit 35 that has returned to step S40 repeats the same processing as described above based on the live view image acquired after the AF operation.
- step S90 the control unit 35 (imaging condition setting unit 35d) sets an imaging condition for the highlighted area in accordance with a user operation, and the process proceeds to step S100.
- the display transition of the liquid crystal monitor 36 and the setting of the imaging condition according to the user operation in step S90 are as described above.
- step S100 the control unit 35 determines the presence / absence of an imaging instruction.
- a release button (not shown) constituting the operation member 37 or a display instructing imaging is operated, the control unit 35 makes an affirmative determination in step S100 and proceeds to step S110.
- the control unit 35 makes a negative determination in step S100 and returns to step S90.
- step S110 the control unit 35 performs predetermined imaging processing. That is, the image pickup control unit 35e controls the image pickup element 100 so as to pick up an image under the image pickup conditions set for each region, and the image processing unit 33 performs predetermined image processing on the image data obtained by the image pickup. Apply. Then, the recording unit 39 records the image data on a recording medium (not shown).
- step S120 the control unit 35 determines whether an end operation has been performed. When the end operation is performed, the control unit 35 makes a positive determination in step S120 and ends the process of FIG. When the end operation is not performed, the control unit 35 makes a negative determination in step S120 and returns to step S20. When returning to step S20, the control unit 35 repeats the above-described processing.
- the camera 1 captures an imaging surface based on an imaging unit 32 that captures a subject image by the imaging device 100 configured to be able to set imaging conditions for a plurality of regions on the imaging surface, and the captured live view image.
- An imaging condition setting unit 35d that sets imaging conditions for a plurality of areas is further provided, and the imaging target setting target areas are sequentially switched, and imaging based on user operations is performed on the setting target areas. Since the condition is set, the user can set in order for each area.
- the camera 1 includes a liquid crystal monitor 36 that displays an image picked up by the image pickup unit 32, and the control unit 35 selects a region to be set in the live view image displayed on the liquid crystal monitor 36 as another region. Therefore, the setting target area can be easily shown to the user.
- the area segmentation unit 35b detects a plurality of subject elements from the live view image by the object detection unit 35a, classifies the imaging surface into a plurality of single regions each including the subject element, or combines two or more single regions.
- the imaging surface is divided into a region and a single region, or the imaging surface is divided into a plurality of composite regions.
- the setting unit 35c increases the rank order of the regions including the subject elements related to the set imaging scene mode among the subject elements detected by the object detection unit 35a. As a result, the possibility of increasing the ranking of the area including the subject element that the user wants to shoot increases, so that the usability is improved.
- the setting unit 35c increases the rank order of the regions including the subject elements in focus among the subject elements detected by the object detection unit 35a. As a result, the possibility of increasing the ranking of the area including the subject element that the user wants to shoot increases, so that the usability is improved.
- the setting unit 35c increases the rank order of the regions including the closest subject element among the subject elements detected by the object detection unit 35a. As a result, the possibility of increasing the ranking of the area including the subject element that the user wants to shoot increases, so that the usability is improved.
- the setting unit 35c increases the rank order of regions including subject elements having a luminance lower than a predetermined value or higher than a predetermined value among the subject elements detected by the object detection unit 35a. This increases the possibility of increasing the rank of the area including the subject element whose user imaging condition is desired to be changed, which improves usability.
- the setting unit 35c increases the rank order of regions that include subject elements that have a smaller distance difference from the subject elements included in the regions of high rank order. I did it. For example, since the possibility that the order of the area including the subject element that the user wants to shoot after the subject element that the user wants to shoot increases is increased, the usability is improved.
- the setting unit 35c increases the rank order of regions that include subject elements that have a large luminance difference from the subject elements included in the regions of high rank order. I did it. For example, since the possibility that the user will increase the order of the region including the subject element whose imaging condition is to be changed is increased, the usability is improved.
- the setting unit 35c increases the rank order of regions including subject elements larger than other subject elements among the subject elements detected by the object detection unit 35a. For example, since the possibility that the order of the area including the subject element that the user wants to shoot after the subject element that the user wants to shoot increases is increased, the usability is improved.
- the setting unit 35c increases the order of rank in a region including subject elements closer to the center of the live view image than other subject elements. For example, since the possibility that the order of the area including the subject element that the user wants to shoot after the subject element that the user wants to shoot increases is increased, the usability is improved.
- the camera 1 includes a liquid crystal monitor 36 that displays a live view image acquired from the imaging unit 32 that captures a subject image by the imaging element 100 configured to be able to set imaging conditions of a plurality of areas on the imaging surface, An area dividing unit 35b for dividing the screen into a plurality of areas based on the view image. Since the camera 1 automatically divides it into a plurality of areas, it becomes easy for the user to make settings for each area. (15) Since the camera 1 includes the setting unit 35c that ranks the plurality of regions divided by the region sorting unit 35b, and the control unit 35 that performs predetermined processing corresponding to the plurality of regions in the order of rank. Processing for the areas can be performed in an appropriate order.
- the control unit 35 sends an imaging condition setting instruction for an area on the imaging surface.
- the imaging unit 32 is installed at a position away from the main body of the camera 1 and the imaging unit 32 is remotely controlled from the control unit 35, the setting process for each area of the image can be performed remotely. , It improves usability.
- the setting unit 35c has been described to rank the plurality of regions divided by the region dividing unit 35b.
- the setting unit 35c is not limited to this.
- the setting unit 35c may add information indicating whether or not the imaging condition is to be changed in the region divided by the region dividing unit 35b.
- the setting unit 35c may determine whether the imaging condition is to be changed based on the above-described method for setting the order of the regions.
- Modification 2 In the above description, an example has been described in which when a plurality of display patterns for a region are created, each pattern is displayed on the liquid crystal monitor 36 as illustrated in FIGS. 7A to 7C.
- the control unit 35 switches the display pattern in accordance with a slide operation on the screen of the liquid crystal monitor 36 by the user. Instead, the user may select an arbitrary display pattern by displaying a plurality of display patterns side by side on the liquid crystal monitor 36.
- the control unit 35 causes the liquid crystal monitor 36 to display a list of four display patterns.
- the first pattern 60a ranked first is displayed on the upper left of the screen
- the second pattern 60b ranked second is displayed on the upper right of the screen
- the fourth pattern 60d ranked third is displayed on the lower left of the screen. Is displayed, and the third pattern 60c in the fourth rank is displayed at the lower right of the screen.
- the control unit 35 causes the liquid crystal monitor 36 to display only the tapped display pattern instead of the list display.
- the control unit 35 causes the liquid crystal monitor 36 to display only the second pattern ranked second as in the case of FIG. 7B. .
- FIG. 10 is a diagram illustrating a display screen of the liquid crystal monitor 36 according to the third modification.
- the first pattern 60a ranked first is displayed in the upper left of the list display
- the second pattern 60b ranked second is displayed in the upper right of the list display
- the fourth pattern ranked third in the lower left of the list display. 60d is displayed
- the third pattern 60c in the fourth rank is displayed at the lower right of the list display.
- the control unit 35 causes the auxiliary screen 90 to display display pattern information that cannot be displayed.
- the fifth pattern at the fifth rank, the sixth pattern at the sixth rank, and the seventh pattern at the seventh rank are reduced and displayed on the auxiliary screen 90.
- the control unit 35 switches the display pattern to be displayed on the auxiliary screen 90. That is, the display pattern to be displayed is switched according to the tap operation.
- control unit 35 causes the liquid crystal monitor 36 to display only the tapped display pattern.
- FIG. 11 is a diagram for explaining display pattern switching according to the fourth modification.
- a landscape icon 74, a person icon 75, and a car icon 76 are displayed on the live view image 60f, respectively.
- the control unit 35 displays a live view image 60f in which the outline of the first region 61 having the person 61a (FIG. 6) as the subject element is emphasized.
- control unit 35 switches the display pattern by highlighting the outline of the region of the subject element corresponding to the icon and displaying the live view image.
- the control unit 35 displays a live view image in which the outline of the second region having the car 62a (FIG. 6) as a subject element is emphasized.
- the control unit 35 displays a live view image by emphasizing the outline of the fourth region having the mountain 64a (FIG. 6) as a subject element.
- the combination of the landscape icon 74, the person icon 75, and the car icon 76 that are displayed superimposed on the live view image is configured to be changeable.
- the control unit 35 changes the combination of icons to be displayed.
- FIG. 12 is a diagram illustrating a combination of icons.
- FIG. 12A is a diagram illustrating a combination of a landscape icon 74, a person icon 75, and a collective person icon 77.
- the control unit 35 causes the live view image to be displayed with emphasis on the outline of a region including a plurality of persons in the live view image.
- FIG. 12B is a diagram illustrating a combination of the landscape icon 74, the object icon 78, and the car icon 76.
- the control unit 35 displays the live view image by emphasizing the outline of the third region having the object (for example, the bag 63a in FIG. 6) as the subject element in the live view image. .
- FIG. 12C is a diagram illustrating a combination of a landscape icon 74, a cloud icon 79, and a whiteout icon 80.
- the control unit 35 emphasizes the outlines of the fifth region and the sixth region having the cloud (for example, clouds 65a and 66a in FIG. 6) as subject elements in the live view image. Display the live view image.
- the white-out icon 80 is tapped, the control unit 35 causes the live view image to be displayed with emphasis on a region higher than a predetermined luminance value in the live view image.
- the display pattern is switched by highlighting the outline of the region of the subject element corresponding to the icon tapped by the user and displaying the live view image.
- the user can specify an area in which the imaging condition is to be changed by a tap operation.
- the control unit 35 may be configured to order the display patterns or change the order according to the order of the display patterns switched according to the tap operation by the user.
- FIG. 13A shows setting of imaging conditions in the electronic device 2 having a camera function.
- the electronic device 2 displays an imaging condition setting screen on the liquid crystal monitor 36 on the assumption that an operation is performed in the manner illustrated in FIG. 13A by the user.
- the user operates the touch operation member on the display surface of the liquid crystal monitor 36 with one hand.
- the touch operation member of the electronic device 2 is operated with the thumb of the right hand, and the back surface of the electronic device 2 is supported by fingers other than the thumb.
- the movable range of the thumb of the right hand on the display surface of the liquid crystal monitor 36 is inside an arc whose radius is the length of the thumb around the joint position P of the thumb. Therefore, the control unit 35 predetermines an average holding position where the person holds the electronic device 2 and a movable range of the thumb based on an average length of the thumb of the person, and an operation described later inside the movable range.
- the unit 70 (FIG. 13B) is displayed.
- FIG. 13B is a diagram illustrating an imaging condition setting screen.
- the control unit 35 displays the live view image 60a as shown in FIG. 13B on the liquid crystal monitor 36.
- an area automatically selected by the control unit 35 may be set as an object for setting (changing) the imaging condition. For example, priorities can be given to the areas divided by the area dividing section 35b, and the areas selected by the control section 35 based on this order can be set as targets for setting (changing) the imaging conditions.
- the area to be displayed with emphasis is the target area for setting (changing) the imaging conditions Indicates.
- the user performs a long press operation (for example, keeps touching for more than 1 second) the display position of the area for which the imaging condition is set (changed) on the display surface of the liquid crystal monitor 36 on which the live view image 60a is displayed.
- a long press operation for example, keeps touching for more than 1 second
- the control unit 35 causes the operation unit 70 to be displayed in the lower right position of the screen (within the movable range of the right thumb) superimposed on the live view image 60a.
- the control unit 35 may display the operation unit 70 regardless of the user's operation when the region in which the imaging condition is set is determined.
- the operation unit 70 includes a curve 71, a curve 72, and a curve 73 in order from the outer side of the movable range, as an example of setting items of the imaging condition.
- a curve 71 corresponds to an operation unit that changes gain (ISO sensitivity), which is one of the exposure conditions, to be high or low.
- a curve 72 corresponds to an operation unit that changes shutter speed TV (charge accumulation time), which is one of the exposure conditions, faster or slower.
- a curve 73 corresponds to an operation unit that changes the frame rate, which is one of the exposure conditions, faster or slower.
- the frame rate refers to the number of frames of live view images and moving images acquired per second.
- the imaging conditions (exposure conditions and image processing conditions) to be changed by the operation unit 70 may be determined by the control unit 35 based on the live view image 60a, or the imaging conditions instructed in advance by a user operation may be changed. May be determined as The user operation includes sound, and the control unit 35 displays the curve 71 as the operation unit 70 when “gain” is input by sound, for example.
- the change target for example, gain
- the change target having a wider adjustment range of the imaging condition that is the change target is displayed at a position farther from the joint position P (FIG. 13A).
- Marks 71a to 73a are displayed on the curves 71 to 73, respectively.
- the initial position (display position on the curve) where the marks 71a to 73a are displayed on the operation unit 70 is the current setting of the target area (first area 61 in the example of FIG. 13B) for setting (changing) the imaging condition. This corresponds to the imaging condition being set.
- the mark 71a corresponds to the gain
- the upper end of the curve 71 corresponds to the upper limit of the gain adjustment range
- the lower end of the curve 71 corresponds to the lower limit of the gain adjustment range.
- the mark 71a is displayed approximately 1 ⁇ 2 on the curve 71, indicating that it is an intermediate value in the gain adjustment range.
- the mark 72a corresponds to the shutter speed
- the upper end of the curve 72 corresponds to the upper limit of the shutter speed adjustment range
- the lower end of the curve 72 corresponds to the lower limit of the shutter speed adjustment range.
- the mark 72a is displayed on the curve 72 at about 1/3 from the lower end, indicating that the value is 1/3 from the lower limit of the shutter speed adjustment range.
- the mark 73a corresponds to the frame rate
- the upper end of the curve 73 corresponds to the upper limit of the frame rate adjustment range
- the lower end of the curve 73 corresponds to the lower limit of the frame rate adjustment range.
- the mark 73a is displayed on the curve 73 at about 1 ⁇ 2 from the lower end, it indicates an intermediate value of the adjustment range of the frame rate.
- the control unit 35 (imaging condition setting unit 35d) is an object of setting (changing) the imaging condition in the live view image.
- the gain adjustment parameter of a certain first area 61 is changed to a value corresponding to the position of the thumb after the slide operation.
- the imaging condition setting unit 35d increases the gain by, for example, increasing the amplification degree of the signal read from the first area 61 to be larger than the currently set gain. Determine adjustment parameters.
- the imaging condition setting unit 35c when the gain of the first region 61 is lowered, the imaging condition setting unit 35c, for example, reduces the gain of the signal read from the first region 61 below the currently set gain, thereby increasing the gain.
- the adjustment parameter for lowering is determined.
- the imaging condition setting unit 35d sets the determined gain adjustment parameter in the imaging unit 32 or the image processing unit 33.
- the reason for setting in the imaging unit 32 is to change the gain by changing the exposure condition of the imaging device 100 in the next imaging.
- the reason for setting the image processing unit 33 is to obtain an image after gain change by performing image processing on the live view image.
- the control unit 35 moves the display position of the mark 71a on the curve 71 in correspondence with the position of the thumb after the slide operation.
- the control unit 35 performs the above processing, the user can check how the gain of the first region 61 changes in the live view image 60a.
- the control unit 35 maintains the gain adjustment parameter that has been set for a region (a region other than the first region 61) that is not set (changed) for the imaging condition.
- a region a region other than the first region 61
- the vicinity of the boundary with the first area 61 is captured in consideration of the balance of the entire image so as to blur the discontinuity of the imaging conditions in the vicinity of the boundary. Conditions may be changed.
- the control unit 35 (imaging condition setting unit 35d) also performs the setting (change) of the shutter speed and the setting (change) of the frame rate in the same manner as in the case of setting (changing) the gain.
- the imaging conditions (exposure conditions and image processing conditions) changed by the operation unit 70 may be brightness, contrast, and saturation.
- FIG. 14A is a diagram illustrating a setting screen for luminance, contrast, and saturation as imaging conditions.
- a curve is sequentially formed from the outside of the movable range. 74, curve 75, and curve 76 are included.
- a curve 74 corresponds to an operation unit that changes the brightness, which is one of the exposure conditions, to be high or low.
- a curve 75 corresponds to an operation unit that changes the contrast, which is one of the image processing conditions, to be high or low.
- a curve 76 corresponds to an operation unit that changes the saturation, which is one of the image processing conditions, to be high or low.
- FIG. 14A illustrates an example in which three curves corresponding to three imaging conditions are displayed on the operation unit 70, but only one curve corresponding to one imaging condition is displayed, or two imaging conditions are displayed. It is also possible to display two curves corresponding to.
- Marks 74a to 76a are displayed on the curves 74 to 76, respectively.
- the positions at which the marks 74a to 76a are displayed on the operation unit 70 are the imaging conditions of the target area (first area 61 in the example of FIG. 14A) where the imaging conditions are set (changed).
- the mark 74a corresponds to the luminance
- the upper end of the curve 74 corresponds to the upper limit of the luminance adjustment range
- the lower end of the curve 74 corresponds to the lower limit of the luminance adjustment range.
- the mark 75a corresponds to the contrast
- the upper end of the curve 75 corresponds to the upper limit of the contrast adjustment range
- the lower end of the curve 75 corresponds to the lower limit of the contrast adjustment range
- the mark 76a corresponds to saturation
- the upper end of the curve 76 corresponds to the upper limit of the saturation adjustment range
- the lower end of the curve 76 corresponds to the lower limit of the saturation adjustment range.
- the setting of the imaging conditions is the same as that for gain setting (change), shutter speed setting (change), and frame rate setting (change).
- FIG. 14B is a diagram illustrating an imaging condition setting screen assuming that the user performs an operation with the left hand. Although the curves 74 to 76 are different from the curve of FIG. 13B in the left-right direction, the functions are the same, and detailed description thereof is omitted.
- the control unit 35 may switch between the display in FIG. 13B and the display in FIG. 14B according to the switching operation on the operation menu screen or the like.
- the control unit 35 may switch between the display in FIG. 13B and the display in FIG. 14B according to the detection result of the acceleration sensor.
- the control unit 35 may detect the hand holding the electronic device 2 by the user and switch between the display in FIG. 13B and the display in FIG.
- FIG. 15A is a diagram illustrating an imaging condition setting screen on the assumption that the user performs an operation with both hands.
- the touch operation member of the electronic device 2 is operated with the thumbs of both hands of the user, and the back surface of the camera 1 is supported with fingers other than the thumbs.
- the movable range of the right thumb on the display surface of the liquid crystal monitor 36 is inside an arc whose radius is the length of the thumb with the joint position P of the right thumb as the center.
- the movable range of the left thumb on the display surface of the liquid crystal monitor 36 is inside an arc whose radius is the length of the thumb centered on the joint position Q of the left thumb.
- the control unit 35 predetermines a movable range of the thumb based on an average holding position where the person holds the electronic device 2 and an average length of the thumb of the person, and will be described later inside the movable range of the thumbs of both hands.
- the operation units 70A and 70B (FIG. 15B) are displayed.
- the operation unit 70A includes a curve 72 as an example of setting items for imaging conditions.
- a curve 72 corresponds to an operation unit that changes shutter speed TV (charge accumulation time), which is one of the exposure conditions, faster or slower.
- shutter speed TV charge accumulation time
- the curve 72 is different from the curve of FIG. 13B in that it is opposite to the left and right, the function is the same and the detailed description is omitted.
- the operation unit 70B includes a curve 71 and a curve 73 in order from the outside of the movable range of the right thumb as an example of setting items of the imaging condition.
- a curve 71 corresponds to an operation unit that changes gain (ISO sensitivity), which is one of the exposure conditions, to be high or low.
- a curve 73 corresponds to an operation unit that changes the frame rate, which is one of the exposure conditions, faster or slower.
- the curve 71 and the curve 73 have the same functions as the curve of FIG.
- FIG. 15C is a diagram illustrating another display form of the operation unit 70.
- the operation unit 70B is displayed at the lower right position (within the movable range of the right thumb) on the live view image 60a, and at the lower left position (within the movable range of the left thumb) of the screen.
- the operation unit 70C is displayed.
- the operation unit 70B includes a curve 71 and a curve 73 as an example of setting items for imaging conditions.
- the curve 71 and the curve 73 are obtained by dividing arcs having the same radius, unlike the case of FIG. 15B using arcs having different radii.
- the control unit 35 sets a plurality of curves 71 and 73 that are intermittent on the virtual line when the curve 71 and the curve 73 are set as the plurality of operation units 70. Thereby, it is possible to set (change) a plurality of imaging conditions without providing a plurality of curves with arcs of different radii as in the above embodiment.
- the operation unit 70A includes a curve 77 as an example of setting items.
- a curve 77 corresponds to an operation unit for turning on / off the filter processing.
- the control unit 35 performs predetermined processing on the first region 61 that is a target for setting (changing) the imaging condition in the live view image. On / off of the filtering process is changed to a setting corresponding to the position of the thumb after the slide operation.
- the imaging condition setting unit 35d sets the setting corresponding to the end position of the slide operation on the curve 77 in the image processing unit 33.
- the reason for setting the image processing unit 33 is to obtain an image after the filter processing for the first region 61 by performing image processing on the live view image.
- FIG. 16A is a diagram illustrating another display form of the operation unit. According to FIG. 16A, an icon group 80 is displayed as an operation unit in the movable range of the thumb of the right hand.
- the icon 81 is an operation icon for changing the brightness, which is one of the exposure conditions, to be high or low.
- the icon 82 is an operation icon for changing the contrast, which is one of the image processing conditions, to be high or low.
- the icon 83 is an operation icon for changing the saturation, which is one of the image processing conditions, to be high or low.
- the icon 84 is an operation icon for changing the shutter speed (charge accumulation time), which is one of the exposure conditions, to be faster or slower.
- the icon 85 is an operation icon for changing an exposure correction value for correcting the exposure higher than the appropriate exposure or lower than the appropriate exposure.
- the control unit 35 changes an imaging condition (that is, luminance, contrast, saturation, shutter speed, and exposure correction value) associated with the icon operated by the user.
- an imaging condition that is, luminance, contrast, saturation, shutter speed, and exposure correction value
- the imaging condition (exposure condition, image processing condition) to be changed may be determined by the control unit 35 based on the live view image 60a, or the imaging condition specified in advance by a user operation is determined as the change target. You may make it do.
- the user performs a long press operation (for example, keeps touching for more than 1 second) the display position of the area for which the imaging condition is set (changed) on the display surface of the liquid crystal monitor 36 on which the live view image 60a is displayed.
- a long press operation for example, keeps touching for more than 1 second
- the control unit 35 displays the icon group 80 as the operation unit on the lower right position of the screen (within the movable range of the right thumb) superimposed on the live view image 60a.
- FIG. 16B is a diagram illustrating a setting screen when the icon 81 is being operated.
- the control unit 35 superimposes the rotating arrow icon 86 on the live view image 60a and displays the liquid crystal monitor 36. To display.
- the control unit 35 further displays the same icon as the icon 81 being operated at the center of the arrow icon 86.
- the control unit 35 changes the length of the arrow icon 86 every predetermined time (for example, 2 seconds).
- FIG. 17 is a diagram for explaining an arrow icon 86 whose length changes.
- the control unit 35 gradually changes the display length from the arrow icon 86 in FIG. 17 (a) to the arrow icon 86 in FIG. 17 (b) with the passage of time, and the arrow icon 86 in FIG. 16 (b).
- the display length is gradually changed to longer.
- the control unit 35 returns the length of the arrow icon 86 to the minimum once, and gradually changes the length again.
- the control unit 35 causes the rotation display of the arrow icon 86 as described above to be repeatedly performed every predetermined time (in this example, 2 seconds) when the icon 81 is being operated. That is, the transition time from the minimum to the maximum length of the arrow icon 86 is 2 seconds, and the time required for one rotation of the arrow icon 86 is 2 seconds.
- the length of the arrow icon 86 corresponds to the adjustment value of the imaging condition (or image processing condition) corresponding to the icon touched by the user. Therefore, when the icon 81 is being operated, the maximum length of the arrow icon 86 corresponds to the upper limit of the luminance adjustment range, and the minimum length of the arrow icon 86 corresponds to the lower limit of the luminance adjustment range.
- the control unit 35 corresponds to the change in the length of the arrow icon 86, and adjusts the luminance adjustment parameter of the first region 61 that is the target for setting (changing) the imaging condition in the live view image. change.
- the imaging condition setting unit 35d determines an adjustment parameter for increasing the luminance by increasing the charge accumulation time, for example, among the imaging conditions of the first region 61.
- the imaging condition setting unit 35d determines an adjustment parameter for lowering the luminance among the imaging conditions of the first region 61, for example, by shortening the charge accumulation time.
- the user ends the operation of the icon 81 at a desired timing, using the change in the brightness of the first region 61 reflected in the live view image 60a and the change in the length of the rotating arrow icon 86 as a guide.
- the control unit 35 ends the display of the arrow icon 86 in response to the end of the operation.
- the imaging condition setting unit 35d determines an adjustment parameter when the user has finished operating the icon 81, and sets the determined luminance adjustment parameter in the imaging unit 32 or the image processing unit 33.
- the reason for setting in the imaging unit 32 is to change the luminance by changing the exposure condition of the imaging device 100 at the next imaging.
- the reason for setting the image processing unit 33 is to obtain an image after changing the brightness by performing image processing on the live view image.
- the control unit 35 maintains the set brightness adjustment parameter for the region (other region than the first region 61) that is not the target of setting (changing) the imaging condition.
- the vicinity of the boundary with the first area 61 is captured in consideration of the balance of the entire image so as to blur the discontinuity of the imaging conditions in the vicinity of the boundary. Conditions may be changed.
- FIG. 18A is a diagram illustrating a setting screen when the icon 84 is being operated.
- the control unit 35 superimposes the rotating arrow icon 86 on the live view image 60a and displays the liquid crystal monitor 36. To display.
- the control unit 35 further displays the same icon as the icon 84 being operated at the center of the arrow icon 86.
- FIG. 18B is a diagram exemplifying a setting screen when the icon 85 is being operated.
- the control unit 35 displays the rotating round arrow icon 86 on the live view image. It is displayed on the liquid crystal monitor 36 so as to overlap with 60a.
- the control unit 35 (display control unit 35f) further displays the same icon as the icon 85 being operated at the center of the round arrow icon 86.
- a touch operation member that detects contact pressure in addition to the presence / absence of the contact operation and the contact position may be used.
- the control unit 35 increases the change speed of the imaging condition as the contact operation pressure is higher.
- the controller 35 increases the rotation speed of the arrow icon 86 to be rotated and displayed as the contact operation pressure is higher.
- the rotation speed is controlled between 0.5 second per rotation and 5 seconds per rotation according to the level of the contact pressure. In this case, the time for the length of the arrow icon 86 to transition from the minimum to the maximum is also changed from 0.5 seconds to 5 seconds.
- a touch operation member for detecting a contact area may be used in addition to the presence / absence of the contact operation and the contact position.
- the control unit 35 increases the change speed of the imaging condition as the contact area increases.
- the control unit 35 increases the rotation speed of the arrow icon 86 to be rotated and displayed as the contact area increases. For example, the rotation speed is controlled between 0.5 second per rotation and 5 seconds per rotation according to the size of the contact area. In this case, the time for the length of the arrow icon 86 to transition from the minimum to the maximum is also changed from 0.5 seconds to 5 seconds.
- the control unit 35 may continue the display of the arrow icon 86 for a predetermined time (for example, 1 second) while stopping the rotation of the arrow icon 86 even when the icon operation by the user ends.
- the control unit 35 adjusts the imaging condition adjustment parameter at the time when the icon operation is ended according to the direction of the rotation operation along the arrow icon 86. Increase or decrease.
- the adjustment parameter is finely adjusted in the plus direction by a clockwise operation with the user's finger, and the adjustment parameter is finely adjusted in the minus direction by a counterclockwise operation with the user's finger.
- the control unit 35 ends the display of the arrow icon 86 and sets the adjustment parameter after fine adjustment to the imaging unit 32 or the image. Set in the processing unit 33.
- a predetermined time for example, 1 second
- the control unit 35 ends the display of the arrow icon 86 and The imaging condition adjustment parameter at the time when the icon operation is completed is set in the imaging unit 32 or the image processing unit 33.
- FIG. 19 is a diagram illustrating an imaging condition setting screen in the sixth modification.
- the control unit 35 sets a region selected by the user among the regions divided by the region dividing unit 35b as a target for setting (changing) the imaging condition.
- the control unit 35 sets the first area 61 including the person 61 a in the live view image 60 a as a target area for setting (changing) the imaging condition and highlighting the outline of the first area 61. .
- the control unit 35 corresponds to a region (first region 61 in the example of FIG. 19) that is a target for setting (changing) imaging conditions, and for example, at the left end of the screen, an icon group (icon 71, icon 72, and icon). 73) are displayed in the vertical direction.
- the icon 71 is an operation icon for changing the contrast, which is one of the image processing conditions, to be high or low.
- the icon 72 is an operation icon for changing the saturation, which is one of the image processing conditions, to be high or low.
- the icon 73 is an operation icon for changing the brightness, which is one of the exposure conditions, to be high or low.
- the positions at which the icons 71 to 73 are displayed correspond to the imaging conditions of the target area (first area 61 in the example of FIG. 19) where the imaging conditions are set (changed).
- the icon 71 corresponds to contrast
- the upper end of the screen corresponds to the upper limit of the contrast adjustment range
- the lower end of the screen corresponds to the lower limit of the contrast adjustment range.
- the upper limit of the contrast is a value at which the signal of the high luminance part in the first region 61 of the live view image is not saturated and the value at which the signal of the low luminance part in the first region 61 is not crushed black.
- the lower limit of the contrast is a value that leaves a difference in brightness in the first region 61 of the live view image.
- the contrast setting value under the reference condition is an intermediate value in the contrast adjustment range.
- the icon 72 corresponds to saturation
- the upper end of the screen corresponds to the upper limit of the saturation adjustment range
- the lower end of the screen corresponds to the lower limit of the saturation adjustment range.
- the upper limit of the saturation is a value that does not saturate the signal of high saturation (protruding color component) in the first region 61 of the live view image.
- the lower limit of the saturation is a value that leaves the vividness of the color in the first area 61 of the live view image (does not make an achromatic color).
- the saturation setting value in the reference condition is 1/3 from the lower limit of the saturation adjustment range. It shows that.
- the icon 73 corresponds to the luminance
- the upper end of the screen corresponds to the upper limit of the luminance adjustment range
- the lower end of the screen corresponds to the lower limit of the luminance adjustment range.
- the upper limit of the luminance is a value that does not saturate the signal of the high luminance portion in the first region 61 of the live view image (so-called whiteout).
- the lower limit of the luminance is a value in which the signal of the low luminance portion in the first area 61 of the live view image is not too dark (so-called black crushing).
- the luminance setting value in the reference condition is a value that is 1 ⁇ 4 from the lower limit of the luminance adjustment range. Show.
- the control unit 35 (imaging condition setting unit 35 d) is the target for setting (changing) the imaging condition in the live view image.
- the contrast adjustment parameter of the one area 61 is changed to a value corresponding to the position of the icon 71 after the drag operation. The user can check how the contrast of the first region 61 changes in the live view image 60a.
- the control unit 35 maintains the set contrast adjustment parameter for the region (other region other than the first region 61) that is not set (changed) for the imaging condition.
- the vicinity of the boundary with the first area 61 is captured in consideration of the balance of the entire image so as to blur the discontinuity of the imaging conditions in the vicinity of the boundary. Conditions may be changed.
- the imaging condition setting unit 35d determines the contrast adjustment parameter for the first region 61 in accordance with the position of the icon 71 after the drag operation, and sets it in the image processing unit 33.
- the reason for setting the image processing unit 33 is to obtain an image after the contrast change by performing image processing on the live view image.
- the control unit 35 (imaging condition setting unit 35d) also performs saturation setting (change) and luminance setting (change) in the same manner as the contrast setting (change).
- FIG. 20A is a diagram illustrating an imaging condition setting screen for a plurality of areas.
- the control unit 35 highlights the outline of the display position of the person 61 and the display position of the automobile 62.
- the control unit 35 corresponds to the target area (first area 61 in this example) for which the imaging condition is set (changed), and for example, in the icon area IG61 at the left end of the screen, the first icon group (icon 71, icon 72 and icons 73) are displayed so as to be arranged in the vertical direction.
- the icon area IG61 has a balloon to make the correspondence with the first area 61 easier to understand.
- control unit 35 corresponds to the other area (second area 62 in this example) to which the imaging condition is set (changed), for example, in the icon area IG62 at the right end of the screen, the second icon group. (Icon 71, icon 72, icon 73, and icon 75) are displayed so as to be arranged in the vertical direction.
- the icon area IG62 has a balloon to make the correspondence with the second area 62 easy to understand.
- the icon area IG61 corresponding to the first area 61 is actively displayed, and the icon area IG62 corresponding to the other area (second area 62) is displayed inactive.
- the control unit 35 validates the operation for the icon group in the icon area being actively displayed. Since the setting (change) of the imaging condition for the target area performed when the icon group for which the operation is effective is operated is the same as in the case of one target area, the description thereof is omitted.
- the control unit 35 controls the icon area (IG61) to be actively displayed and the target area for setting (changing) the imaging condition (that is, the first area 61 in which the outline is highlighted in the live view image 60a) in association with each other. To do. In FIG. 20A, it is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36.
- FIG. 20B is a diagram exemplifying a setting screen after switching the imaging condition setting (change) target.
- the outline of the second region 62 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36.
- the icon area IG62 corresponding to the second area 62 is actively displayed, and the icon area IG61 corresponding to the other area (first area 61) is displayed inactive.
- the control unit 35 validates the operation for the icon group in the icon area being actively displayed.
- control unit 35 switches the icon area for active display and sets (changes) the imaging condition even when the display position of the icon area IG62 is tapped instead of the second area 62 being tapped. You may perform switching of object.
- a moving subject may be subject to blurring depending on the shutter speed (charge accumulation time) value.
- the control unit 35 displays an icon corresponding to the shutter speed (charge accumulation time) in the second icon group corresponding to the second region 62. 75 is automatically included. Thereby, the user can perform an operation of changing the shutter speed (charge accumulation time) for the second region.
- two sets of icons for changing the imaging condition are displayed, so that the user can set the imaging conditions for the first area 61 and the second area 62 in the live view image 60a.
- the difference in values can be shown visually.
- the user can know the difference in imaging conditions between the first area 61 and the second area 62 by comparing the display positions of the icons in the vertical direction between the icon area IG61 and the icon area IG62, for example. .
- the display of the index corresponding to each icon is omitted, but the index is the same as the description in the case of one target area. It is.
- the icon display position does not necessarily have to be in the icon area IG61 or the icon area IG62.
- the icon display position is shifted in order to avoid overlapping of icons as described above, an icon that protrudes outside the icon area IG61 and the icon area IG62 may be displayed. Further, when the icon display position is shifted, the protrusion of the icon may be avoided by widening the icon area IG61 or the icon area IG62.
- the display positions of the icon area IG61 and the icon area IG62 have been described as being superimposed on the live view image 60a, but may be displayed separately from the live view image 60a.
- FIG. 21A is an example of an imaging condition setting screen and illustrates an icon 74 and an icon 75. It is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36. Similarly to the case of FIG. 19, the first area 61 including the person 61a is a target area for setting (changing) the imaging condition.
- the icon 74 is an operation icon for changing an exposure correction value for correcting the exposure higher than the appropriate exposure or lower than the appropriate exposure.
- the icon 75 is an operation icon for changing the shutter speed (charge accumulation time), which is one of the exposure conditions, to be faster or slower.
- the positions where the icons 74 and 75 are displayed correspond to the imaging conditions of the target area (first area 61 in the example of FIG. 21A) for which the imaging conditions are set (changed).
- the icon 74 corresponds to the exposure correction value
- the right end of the screen corresponds to the upper limit of the plus side exposure correction range
- the left end of the screen corresponds to the lower limit of the minus side exposure correction range.
- the icon 74 is displayed to the left of the center in the horizontal direction of the screen, and the exposure correction setting value is on the minus side of the intermediate value (exposure correction zero) of the exposure correction range. -0.5 EV. That is, the exposure correction setting for the first region 61 is on the under side.
- the icon 75 corresponds to the shutter speed (charge accumulation time), the right end of the screen corresponds to the upper limit on the high speed side, and the left side of the screen corresponds to the lower limit on the low speed side.
- the display position of the icon 75 corresponds to a position that is neither an upper limit nor a lower limit, for example.
- the normal display position of the icon 74 and its index 74m and the icon 75 and its index 75m in the left-right direction is the same position.
- the control unit 35 displays the index 74m.
- the display position of the index 75m is made different from the display position of the corresponding icon 74 or icon 75.
- the control unit 35 sets the imaging condition of the live view image.
- the adjustment parameter of the exposure correction value in the first area 61 is changed to a value corresponding to the position of the icon 74 after the drag operation.
- the imaging condition setting unit 35c has, for example, the charge accumulation time longer than the charge accumulation time of the reference condition among the imaging conditions of the first region 61. Or by increasing the gain as compared with the gain of the reference condition to determine the imaging condition after exposure correction.
- the imaging condition setting unit 35c compares, for example, the charge accumulation time of the imaging conditions of the first region 61 with the charge accumulation time of the reference condition.
- the image capturing condition after exposure correction is determined by shortening or reducing the gain compared to the gain of the reference condition. The user can check how the exposure of the first region 61 changes in the live view image 60a.
- the control unit 35 maintains the set imaging conditions for an area (an area other than the first area 61) that is not set (changed) for the imaging condition.
- an area an area other than the first area 61
- the vicinity of the boundary with the first area 61 is captured in consideration of the balance of the entire image so as to blur the discontinuity of the imaging conditions in the vicinity of the boundary. Conditions may be changed.
- the imaging condition setting unit 35d determines an exposure correction value adjustment parameter for the first region 61 in accordance with the position of the icon 74 after the drag operation, and sets it in the imaging unit 32 or the image processing unit 33.
- the reason for setting in the imaging unit 32 is to change the exposure correction value by changing the exposure condition of the image sensor 100 at the next imaging.
- the reason for setting the image processing unit 33 is to obtain an image after changing the exposure correction value by performing image processing on the live view image.
- the control unit 35 (imaging condition setting unit 35d) also performs shutter speed (charge accumulation time) in the same manner as in the case of setting (changing) the exposure condition using the icon 75.
- FIG. 21B is a diagram illustrating an imaging condition setting screen.
- the control unit 35 limits the settable range of other imaging conditions (for example, shutter speed (charge accumulation time)).
- a display 76 indicating the limited range is displayed.
- a display 76 indicating the shutter speed setting range after the limitation is displayed together with the icon 75.
- the shutter speed setting range can be easily communicated to the user by the icon 75 corresponding to the shutter speed (charge accumulation time) and the display 76 indicating the setting range after the limit.
- the operation icons for changing the imaging conditions are displayed in order instead of displaying all the icons 71 to 73 at a time as shown in FIGS. 21 (a) and 21 (b). May be.
- FIG. 22A is an example of an imaging condition setting screen and illustrates an icon 73 and its index 73m. It is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36. That is, the first region 61 including the person 61a (FIG. 6) is a target region for setting (changing) the imaging condition.
- the control unit 35 displays an icon 71 and an icon 72 in addition to the icon 73. That is, the control unit 35 sets (changes) the luminance adjustment parameter of the first region 61 that is the target for setting (changing) the imaging condition in the live view image 60a, and then displays the setting screen illustrated in FIG. Is displayed.
- FIG. 22B is an example of an imaging condition setting screen for an area, and illustrates a newly displayed icon 71 and index 71m, icon 72 and index 72m.
- the user can change the contrast corresponding to the icon 71 and the saturation corresponding to the icon 72 on the setting screen shown in FIG. 22B displayed after setting (changing) the brightness adjustment parameter.
- the order in which the icons 71 to 73 are displayed may be changed as appropriate.
- the control unit 35 displays the icon 71, the index 71m, and the icon 72 until a release instruction is given, that is, until a release button (not shown) constituting the operation member 37 or a display icon that instructs imaging is operated.
- the display of the index 72m may be continued.
- FIG. 23A is a diagram illustrating an imaging condition setting screen. It is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36.
- the control unit 35 corresponds to the target area (in this example, the first area 61) for setting (changing) the imaging condition, and the first icon group (icon 71, icon 72 and the icon 73) are displayed so as to be arranged in the left-right direction.
- the icon area IG61 has a balloon to make the correspondence with the first area 61 easier to understand.
- control unit 35 corresponds to the other area (second area 62 in this example) to which the imaging condition is set (changed), for example, in the icon area IG62 located under the icon area IG61.
- Two icon groups (icon 71, icon 72, icon 73, and icon 75) are displayed so as to be arranged in the left-right direction.
- the icon area IG62 has a balloon to make the correspondence with the second area 62 easy to understand.
- the icon area IG61 corresponding to the first area 61 is actively displayed, and the icon area IG62 corresponding to the other area (second area 62) is displayed inactive.
- the control unit 35 validates the operation for the icon group in the icon area being actively displayed. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- FIG. 23B is a diagram exemplifying a setting screen after switching the setting (change) target of the imaging condition. It is assumed that the outline of the second region 62 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36. In the example of FIG. 23B, the icon area IG62 corresponding to the second area 62 is actively displayed, and the icon area IG61 corresponding to the other area (first area 61) is inactively displayed. The control unit 35 validates the operation for the icon group in the icon area being actively displayed. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- FIG. 24A is a diagram illustrating an imaging condition setting screen. It is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36.
- the control unit 35 corresponds to the target area (first area 61 in this example) for which the imaging condition is set (changed), for example, in the icon area IG61 located at the upper end of the screen.
- One icon group (icon 71, icon 72, and icon 73) is displayed so as to be arranged in the left-right direction.
- the icon area IG61 has a balloon to make the correspondence with the first area 61 easier to understand.
- the control unit 35 (display control unit 35f) further displays a switching icon 76.
- the control unit 35 validates the operation for the first icon group in the displayed icon area IG61. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- FIG. 24B is a diagram illustrating an imaging condition setting screen when the switching icon 76 is tapped.
- the control unit 35 replaces the display of the icon area IG61 with an icon corresponding to the other area (second area 62 in this example) to which the imaging condition is set (changed).
- the area IG62 is displayed.
- the second icon group icon 71, icon 72, icon 73, and icon 75
- the icon area IG62 has a balloon to make the correspondence with the second area 62 easy to understand.
- FIG. 24B it is assumed that the outline of the second region 62 is highlighted in the live view image 60 a displayed on the liquid crystal monitor 36.
- the control unit 35 validates the operation for the second icon group in the displayed icon area IG62. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- FIG. 25A illustrates an imaging condition setting screen. It is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36.
- the control unit 35 corresponds to the target area (first area 61 in this example) for which the imaging condition is set (changed), for example, in the icon area IG61 at the left position of the screen.
- Icon groups icon 71, icon 72, and icon 73
- the icon area IG61 has a balloon to make the correspondence with the first area 61 easier to understand.
- the control unit 35 validates the operation for the first icon group in the displayed icon area IG61. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- the user performs a drag operation on the blowing part of the icon area IG61 as follows. For example, the balloon 90 is dragged to the display position of the second area 62 with the finger 90.
- the control unit 35 switches to the setting screen illustrated in FIG. It is assumed that the outline of the second region 62 is highlighted in the live view image 60a.
- the second icon group (icon 71, icon 72, icon 73, and icon 75) is displayed in the icon area IG62 corresponding to the second area 62 so as to be arranged vertically.
- the icon area IG62 has a balloon to make the correspondence with the second area 62 easy to understand.
- the control unit 35 validates the operation for the second icon group in the displayed icon area IG62. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- the icon area IG61 and the icon area IG62 may be displayed in the left-right direction.
- FIG. 25C illustrates an imaging condition setting screen. It is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36.
- the control unit 35 corresponds to the target area (first area 61 in this example) for which the imaging condition is set (changed), for example, in the icon area IG61 located at the top of the screen.
- One icon group (icon 71, icon 72, and icon 73) is displayed so as to be arranged in the left-right direction.
- the icon area IG61 has a balloon to make the correspondence with the first area 61 easier to understand.
- the control unit 35 validates the operation for the first icon group in the displayed icon area IG61. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- the user performs a drag operation on the blowing part of the icon area IG61 as follows. For example, the balloon 90 is dragged to the display position of the second area 62 with the finger 90.
- the control unit 35 switches to the setting screen illustrated in FIG. It is assumed that the outline of the second region 62 is highlighted in the live view image 60a.
- the second icon group (icon 71, icon 72, icon 73, and icon 75) is displayed in the left-right direction in the icon area IG62 corresponding to the second area 62.
- the icon area IG62 has a balloon to make the correspondence with the second area 62 easy to understand.
- the control unit 35 validates the operation for the second icon group in the displayed icon area IG62. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- the control unit 35 sets the same imaging condition as that set (changed) for a certain area for another area (copying of the imaging condition). For example, on the screen illustrated in FIG. 25A, for example, the user performs a long press operation (for example, keeps touching the icon region IG61 for 1 second or longer). When detecting the long press operation, the control unit 35 changes the display mode of the icon area IG61 and displays the icon area IG61 as if it is floating from the screen.
- a long press operation for example, keeps touching the icon region IG61 for 1 second or longer.
- the user taps the display position of the second area 62, for example, in a state where the display mode of the icon area IG61 is changed.
- the control unit 35 switches to the setting screen illustrated in FIG. It is assumed that the outline of the second region 62 is highlighted in the live view image 60a.
- the second icon group (icon 71, icon 72, icon 73, and icon 75) is displayed in the icon area IG62 corresponding to the second area 62 so as to be arranged in the vertical direction.
- the display positions of the icons 71 to 73 in the vertical direction are the same as the display positions in the case of the first icon group in FIG.
- the icon area IG62 has a balloon to make the correspondence with the second area 62 easy to understand.
- the control unit 35 (imaging condition setting unit 35d) further determines the same adjustment parameter as the imaging condition for the first region 61 for the second region 62 and sets it in the imaging unit 32 or the image processing unit 33.
- the reason for setting in the imaging unit 32 is to realize the changed contents by changing the exposure condition of the imaging device 100 at the next imaging.
- the reason for setting the image processing unit 33 is to obtain a changed image by performing image processing on the live view image.
- the icons 71 to 73 included in the second icon group in the second area 62 are included in the first icon group (icon 71, icon 72, icon 73) in the icon area IG61 in FIG. Icon.
- the icon 75 is an icon that was not included in the first icon group in the icon area IG61 in FIG.
- the reason why the control unit 35 includes the icon 75 in the second icon group in the second area 62 is as follows.
- the second area 62 includes the automobile 62a (FIG. 6) detected by the object detection unit 35a.
- the automobile 62a is a subject that may move.
- the control unit 35 uses the second icon group corresponding to the second region 62 to change the shutter speed (charge accumulation time) because the moving subject may cause subject blurring.
- An icon 75 is automatically included.
- the control unit 35 includes the icon 75 that is not included in the first icon group in the icon area IG61 (FIG. 25A) in the second icon group in the icon area IG62 (FIG. 25E). In order to inform the user of this fact, an icon 75 is popped up to make it stand out.
- the control unit 35 validates the operation for the second icon group in the displayed icon area IG62.
- the icons displayed in the first icon group in the icon area IG61 and the second icon group in the icon area IG62 can be added by a user operation. For example, an example will be described in which an icon 75 used for changing the shutter speed (charge accumulation time) is added to the first icon group in the icon region IG61 illustrated in FIGS. 23A and 24A.
- FIG. 26A is a diagram illustrating an imaging condition setting screen. It is assumed that the outline of the first region 61 is highlighted in the live view image 60a displayed on the liquid crystal monitor 36.
- the control unit 35 corresponds to the target area (first area 61 in this example) for which the imaging condition is set (changed), for example, in the icon area IG61 located at the upper end of the screen.
- One icon group (icon 71, icon 72, and icon 73) is displayed so as to be arranged in the left-right direction.
- the icon area IG61 has a balloon to make the correspondence with the first area 61 easier to understand.
- the control unit 35 (display control unit 35f) changes the display mode of the icon area IG61 to display the icon area IG61 as if it is floating from the screen and to display the plus icon 77.
- the control unit 35 switches to the setting screen illustrated in FIG. 26B, the display mode of the icon area IG61 returns to the normal mode, and a candidate icon area 78 displaying a candidate icon 74A and a candidate icon 75A that are addition candidates is displayed.
- the control unit 35 adds the icon 75 corresponding to the candidate icon 75A to the first icon group in the icon area IG61 and displays it, and displays the candidate icon area 78. Terminate.
- the control unit 35 enables the operation for the icon group in the displayed icon area IG61. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- control unit 35 determines that the icon area IG61 has a predetermined time (for example, 2 seconds) when a tap operation is not performed on any of the candidate icon 74A and the candidate icon 75A in the candidate icon area 78.
- the display of the candidate icon area 78 is terminated without adding an icon to the first icon group.
- the control unit 35 may perform switching of the icon area to be actively displayed and switching of the imaging condition setting (change) target when the knob icon 80 provided in the icon area is dragged.
- FIGS. 27 (a) to 28 (b) are diagrams illustrating examples of setting screens for imaging conditions.
- FIG. 27A it is assumed that the outline of the first region 61 of the live view image 60a displayed on the liquid crystal monitor 36 is highlighted.
- the control unit 35 corresponds to the target area (first area 61 in this example) for which the imaging condition is set (changed), and the first icon group (icon) in the icon area IG61 on the left side of the first area 61. 71, icon 72, and icon 73) are displayed so as to be arranged vertically.
- the control unit 35 (display control unit 35f) further displays a knob icon 80 at the lower part of the screen of the icon area IG61.
- the icon area IG61 has a balloon to make the correspondence with the first area 61 easier to understand.
- the control unit 35 validates the operation for the first icon group in the icon area IG61 displayed on the screen of FIG. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted.
- the user performs a drag operation on the knob icon 80 in the icon area IG61 as follows.
- the knob 90 is dragged with the finger 90 in the direction of the second area 62 (in the example of FIG. 27B, the right side of the screen).
- the control unit 35 moves the icon area IG61 rightward on the screen, and switches to the setting screen illustrated in FIG. 27B when the icon area IG61 reaches the first area 61. It is assumed that the outline of the second region 62 is highlighted in the live view image 60a of FIG.
- the second icon group (icon 71, icon 72, icon 73, and icon 75) is displayed in the icon area IG62 corresponding to the second area 62 so as to be arranged in the vertical direction.
- the icon area IG62 has a balloon to make the correspondence with the second area 62 easy to understand.
- the knob icon 80 displayed at the lower part of the screen of the icon area IG62 is similar to the icon area IG61.
- the control unit 35 validates the operation for the second icon group in the displayed icon area IG62.
- the imaging conditions set (changed) by the user operating the icons in the icon group can be canceled as follows.
- the control unit 35 displays the corner 81 (for example, upper right) of the icon area IG61 as if it is broken.
- FIG. 28A is a diagram illustrating a state where the corner 81 of the icon area IG61 in FIG. 27A is dragged.
- the user wants to return the imaging condition set (changed) by the icon operation to the reference condition, the user drags the corner 81 downward in the screen as if the icon area IG61 in FIG.
- the control unit 35 cancels the imaging condition set (changed) by the first icon group in the icon region IG61.
- FIG. 28B is a diagram illustrating a state where one of the icons in the icon area IG61 is swiped with the finger 90. For example, when the swipe operation is performed so that the icon 71 is swept out of the screen from the icon area IG61, the control unit 35 deletes the icon 61 from the icon area IG61 and resets the imaging condition corresponding to the icon 71.
- the icon may be deleted as follows. That is, the control unit 35 displays a delete icon (not shown) on the screen, and deletes the unnecessary icon when the user drags an unnecessary icon to the display position of the delete icon. The imaging condition corresponding to the icon is reset.
- the control unit 35 includes the icon deleted from the icon area IG61 in the candidate icon area 78 (FIG. 26B) described in the modified example 8. Thereby, the icon once deleted can be added (returned) to the first icon group in the icon area IG61 and the second icon group in the icon area IG62 by a user operation.
- the control unit 35 displays an icon area IGA that displays an icon group corresponding to the exposure condition and an icon area IGB that displays an icon group corresponding to the image processing condition.
- FIG. 29 (a) and FIG. 29 (b) are diagrams illustrating examples of setting screens for imaging conditions.
- FIG. 29A illustrates an icon area IGA that exclusively displays an icon group corresponding to the exposure condition
- FIG. 29B illustrates an icon area IGB that exclusively displays an icon group corresponding to the image processing condition. .
- the control unit 35 moves the icon 74 and the icon 75 up and down in the icon area IGA on the left side of the first area 61 in correspondence with the target area (first area 61 in this example) where the imaging condition is set (changed). Display them in a line.
- the control unit 35 (display control unit 35f) further displays as if the corner 81 of the icon area IGA is broken.
- the control unit 35 enables operations on the icons 74 and 75 displayed on the screen of FIG. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted. Further, the imaging condition canceling operation is the same as described above, and thus the description thereof is omitted.
- the user When the user wants to display the icon area IGB that exclusively displays the icon group corresponding to the image processing condition, the user draws an arc in the direction of the arrow as if the icon area IGA in FIG. Swipe operation.
- the control unit 35 When the control unit 35 detects the swipe operation illustrated in FIG. 29A, the control unit 35 corresponds to the target region (first region 61 in this example) for which the imaging condition is set (changed), and the upper position of the first region 61.
- the icon area IGB is displayed on the display area and icons 71 to 73 are displayed in the icon area IGB so as to be arranged in the left-right direction (FIG. 29B).
- the controller 35 further displays the icon area IGB as if the corner 81 is broken. Also in FIG. 29B, it is assumed that the outline of the first region 61 of the live view image 60a displayed on the liquid crystal monitor 36 is highlighted.
- the control unit 35 validates the operation for the icons 71 to 73 displayed on the screen of FIG. Since the setting (change) of the imaging condition for the target region performed when the icon group for which the operation is effective is operated is the same as that described above, the description thereof is omitted. Further, the imaging condition canceling operation is the same as described above, and thus the description thereof is omitted.
- the user When the user wants to display the icon area IGA that exclusively displays the icon group corresponding to the exposure condition, the user draws an arc in the direction of the arrow as if the icon area IGB of FIG. Swipe operation.
- the user taps the display position of the main subject to be targeted on the display surface of the liquid crystal monitor 36 on which the live view image 60a is displayed. .
- the icon area IGA that exclusively displays the icon group corresponding to the exposure condition and the icon area IGB that exclusively displays the icon group corresponding to the image processing condition are displayed separately. Can be made.
- FIG. 30A and FIG. 30B are diagrams illustrating an imaging condition setting screen.
- the control unit 35 displays an icon menu (not shown) superimposed on the live view image 60a.
- the icon menu includes, for example, icons 71 to 75.
- the control unit 35 ends the display of the icon menu and displays the icon 73 so as to overlap the first area.
- An example of this screen is the setting screen of FIG.
- the control unit 35 further transitions from the setting screen of FIG. 30A to the setting screen of FIG.
- the control unit 35 uses the brightness adjustment parameter value set in the first area 61 on the setting screen in FIG. 30B as a reference, and the brightness adjustment parameter value set in another area such as the second area 62. To decide.
- the slide bar 83 is an operation member that changes the luminance for an area other than the target area (such as the second area 62). For example, when the user drags the slide bar 82 left and right with the finger 90, the control unit 35 changes the brightness adjustment parameter of the first region 61 to a value corresponding to the position of the slide bar 82 after the drag operation. .
- the control unit 35 further controls the slide bar 83 so that, for example, the amount of operation of the slide bar 82 is the same as that of the slide bar 82 and the amount of operation in the same direction.
- the parameter is changed to a value corresponding to the position of the slide bar 83 after the control.
- the control unit 35 terminates the display of the slide bars 82 and 83 and the icon 73 when a predetermined time (for example, 2 seconds) has elapsed since the operation on the slide bars 82 and 83 is not performed, and FIG. 29B is displayed. Return to the display state.
- a predetermined time for example, 2 seconds
- FIG. 31A and FIG. 31B are diagrams illustrating an imaging condition setting screen.
- the control unit 35 causes the effect palette 84 to appear at the left end of the live view image 60a.
- An example of this screen is the setting screen of FIG.
- the control unit 35 performs “select color”, “sepia”, “toy camera style”, “monochrome”, “miniature style” on the pulled out pallet 84. ”,“ Picture-like ”and other icons indicating the rendering process for the image are displayed.
- An example of this screen is the setting screen of FIG.
- the user taps an arbitrary icon from the icons. For example, when the “sepia” icon is tapped by the user while the palette 84 covers the first area 61, the control unit 35 performs the first image processing that produces a sepia color on the first area 61. Apply to area.
- the control unit 35 ends the display of the palette 84 when an icon is tapped on the setting screen of FIG. 31B or when a predetermined time (for example, 2 seconds) elapses without any icon being tapped. Let According to this, it is possible to easily perform the effect processing setting (change) of the image.
- the camera 1 in which the imaging unit 32 and the control unit 35 are configured as a single electronic device has been described as an example.
- the imaging unit 1 and the control unit 35 may be provided separately, and the imaging system 1B that controls the imaging unit 32 from the control unit 35 via communication may be configured.
- the imaging device 1001 including the imaging unit 32 is controlled from the control device 1002 including the control unit 35 will be described.
- FIG. 32 is a block diagram illustrating the configuration of an imaging system 1B according to Modification 7.
- the imaging system 1B includes an imaging device 1001 and a display device 1002.
- the imaging device 1001 includes a first communication unit 1003 in addition to the imaging optical system 31 and the imaging unit 32 described in the above embodiment.
- the display device 1002 includes a second display unit 1002.
- a communication unit 1004 is provided.
- the first communication unit 1003 and the second communication unit 1004 can perform bidirectional data communication using, for example, a known wireless communication technology or optical communication technology. Note that the imaging device 1001 and the display device 1002 may be connected by a wired cable so that the first communication unit 1003 and the second communication unit 1004 perform bidirectional data communication.
- the control unit 35 controls the imaging unit 32 by performing data communication via the second communication unit 1004 and the first communication unit 1003. For example, by transmitting and receiving predetermined control data between the imaging device 1001 and the display device 1002, the display device 1002 can divide the screen into a plurality of regions or be divided based on the image as described above. An order is added to the areas, different imaging conditions are set for each divided area, and an imaging signal captured in each area is read out.
- the control unit 35 of the display device 1002 is provided with an object detection unit 35a, an area segmentation unit 35b, a setting unit 35c, an imaging condition setting unit 35d, an imaging control unit 35e, and an AF calculation unit 35f will be described. However, a part of the object detection unit 35a, the area segmentation unit 35b, the setting unit 35c, the imaging condition setting unit 35d, the imaging control unit 35e, and the AF calculation unit 35f may be provided in the imaging apparatus 1001.
- the program is supplied to the mobile device such as the camera 1, the high-function mobile phone 250, or the tablet terminal described above by infrared communication or short-range wireless communication from the personal computer 205 storing the program as illustrated in FIG. 33, for example. Can be sent to mobile devices.
- the program may be supplied to the personal computer 205 by setting a recording medium 204 such as a CD-ROM storing the program in the personal computer 205 or by a method via the communication line 201 such as a network. You may load. When passing through the communication line 201, the program is stored in the storage device 203 of the server 202 connected to the communication line.
- the program can be directly transmitted to the mobile device via a wireless LAN access point (not shown) connected to the communication line 201.
- a recording medium 204B such as a memory card storing the program may be set in the mobile device.
- the program can be supplied as various forms of computer program products, such as provision via a recording medium or a communication line.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Indication In Cameras, And Counting Of Exposures (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Focusing (AREA)
- Automatic Focus Adjustment (AREA)
- Exposure Control For Cameras (AREA)
- Camera Bodies And Camera Details Or Accessories (AREA)
Abstract
Description
本発明の第2の態様によると、第1の態様の撮像装置において、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とにより被写体の検出を行う検出部を備え、前記制御部は、前記検出部で検出された被写体により前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とを前記表示部に表示させる序列を決定するのが好ましい。
本発明の第3の態様によると、第1又は第2の態様の撮像装置において、前記制御部は、前記第1撮像領域の撮像条件と前記第2撮像領域の撮像条件とを前記表示部に表示させるのが好ましい。本発明の第4の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、設定されている撮像シーンモードと関連する被写体を含む画像の前記序列の順位を高くするのが好ましい。
本発明の第5の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、フォーカスが合っている被写体を含む画像の前記序列の順位を高くするのが好ましい。
本発明の第6の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、至近の被写体を含む画像の前記序列の順位を高くするのが好ましい。
本発明の第7の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、所定値より低輝度または所定値より高輝度の被写体を含む画像の前記序列の順位を高くするのが好ましい。
本発明の第8の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、被写体間の距離差が小さい被写体を含む画像ほど前記序列の順位を高くするのが好ましい。
本発明の第9の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、輝度差が大きい被写体を含む画像ほど前記序列の順位を高くするのが好ましい。
本発明の第10の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、大きな被写体を含む画像ほど前記序列の順位を高くするのが好ましい。
本発明の第11の態様によると、第2の態様の撮像装置において、前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、画像の中央に近い被写体を含む画像ほど前記序列の順位を高くするのが好ましい。
本発明の第12の態様によると、電子機器は、撮像素子の第1撮像領域により生成された画像と前記撮像素子の第2撮像領域により生成された画像とを、前記撮像素子の撮像条件を設定する領域を選択させるように表示部に表示させる制御部と、前記表示部に表示された画像により選択された、前記撮像素子の領域の撮像条件を設定する設定部と、
を備える。
本発明の第13の態様によると、第12の態様の電子機器において、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とにより被写体の検出を行う検出部を備え、前記制御部は、前記検出部で検出された被写体により前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とを前記表示部に表示させる序列を決定するのが好ましい。
本発明の第14の態様によると、第12又は第13の態様の電子機器において、前記制御部は、前記第1撮像領域の撮像条件と前記第2撮像領域の撮像条件とを前記表示部に表示させるのが好ましい。
本発明の第15の態様によると、プログラムは、第1撮像領域と前記第1撮像領域とは異なる第2撮像領域とを有する撮像素子により被写体を撮像させる撮像処理と、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とを、前記撮像素子の撮像条件を設定する領域を選択させるように表示部に表示させる表示処理と、
をコンピュータに実行させる。
図1は、一実施の形態による電子機器(例えば、カメラ1)の構成を例示するブロック図である。図1において、カメラ1は、撮像光学系31と、撮像部32と、画像処理部33と、ワークメモリ34と、制御部35と、液晶モニタ36と、操作部材37と、不揮発性メモリ38と、記録部39とを有する。
なお、AF方式は、コントラスト検出方式でも、位相差検出方式でも構わない。
上述したカメラ1に備わる積層型撮像素子100について説明する。なお、この積層型撮像素子100は、本願出願人が先に出願し公開された国際公開WO13/164915号に記載されているものである。図2は、積層型撮像素子100の断面図である。撮像素子100は、入射光に対応した画素信号を出力する裏面照射型撮像チップ113と、画素信号を処理する信号処理チップ111と、画素信号を記録するメモリチップ112とを備える。これら撮像チップ113、信号処理チップ111およびメモリチップ112は積層されており、Cu等の導電性を有するバンプ109により互いに電気的に接続される。
本実施形態では、撮像素子100(撮像チップ113)における複数のブロックごとに撮像条件を設定可能に構成する。制御部35は、領域区分け部35bによって区分けされた領域を上記ブロックに対応させて、領域ごとに撮像条件で撮像を行わせる。
(1)撮像シーンモードに応じた特定の被写体が検出された領域
特定の被写体は、設定されたカメラ1の撮像シーンモードによって異なる。例えば、カメラ1の撮像シーンモード設定がポートレートモードに設定されている場合に、設定部35cは、人物61aを含む第1領域61に対して、自動車62aを含む領域を第2領域62と、バッグ63aを含む領域を第3領域63と、山64aを含む領域を第4領域64と、雲65aを含む領域を第5領域65と、雲66aを含む領域を第6領域66よりも撮像条件を優先的に変更する領域として設定する。ポートレートモードの場合は、人物61aを含む第1領域61の撮像条件を設定(変更)する可能性が高いという考え方に基づく。
カメラ1の撮像シーンモードの設定は、ユーザーが操作部材37を操作することで設定されてもよいし、ライブビュー画像の画面から検出された被写体要素に基づいて制御部37により設定されるようにしてもよい。
上記フォーカスポイントに対応する被写体にフォーカスを合わせるAF動作が行われた場合に、設定部35cは、フォーカスが合っている被写体要素(すなわち、フォーカスポイントに対応する被写体要素)を含む領域に対して、フォーカスが合っていない被写体要素を含む領域よりも撮像条件を優先的に変更する領域として決定する。
なお、フォーカスが合っている被写体要素が存在しない場合には、フォーカスのずれ量が最も小さい被写体要素(すなわち、被写体要素の位置からフォーカスが合う位置までが最も近い被写体要素)を含む領域を、撮像条件を優先的に変更する領域として決定するようにしてもよい。
設定部35cは、物体検出部35aにより検出されている複数の被写体要素のうち、明るさが最も暗い被写体要素、または最も明るい被写体要素を含む領域を、他の領域よりも撮像条件を優先的に変更する領域として決定する。黒つぶれのような暗すぎる被写体要素や、白とびのような明るすぎる被写体要素は、撮像条件を設定(変更)する可能性が高いと考え方に基づく。
設定部35cは、カメラ1に至近の被写体要素を含む領域に対して、撮像条件を遠方の被写体要素よりも優先的に変更する領域として決定する。例えば、制御部35は、カメラ1から区分けされた被写体要素までの距離情報を取得し、カメラ1に至近の被写体要素を含む領域を決定する。また、制御部35は、距離情報を得られない場合は、画面を占める割合が最大の被写体要素を含む領域をカメラ1に至近の被写体要素として決定するようにしてもよい。
上記フォーカスポイントに対応する被写体にフォーカスを合わせるAF動作が行われた場合に、設定部35cは、物体検出部35aにより検出されている複数の被写体要素のうち、フォーカスが合っている被写体要素を含む領域以外の領域のうち最もフォーカスのずれ量が小さい被写体要素を含む領域を、他の領域よりも撮像条件を優先的に変更する領域として設定する。一般に、フォーカスのずれ量が小さいほど被写体要素の輪郭の尖鋭度が高くなるので、輪郭の尖鋭度が高い被写体要素はフォーカスのずれ量が小さいといえる。設定部35cは、輪郭の尖鋭度が高い被写体要素を含む領域を、撮像条件を輪郭の尖鋭度が低い領域よりも優先的に変更する領域として設定する。
例えば、図6において、AF演算部により第1領域61に対してAF動作が行われたことによって人物61aにフォーカスが合っている場合を想定する。設定部35cは、自動車62aと、バッグ63aと、山64aと、雲65aと、雲66aとのうち、フォーカスのずれ量が最も小さい被写体要素(すなわち、フォーカスが合っている人物61aの位置から最も近い位置にあるバッグ63a)を含む第3領域63を、人物61aを含む第1領域61に次いで撮像条件を優先的に変更する領域として設定する。人物61aを含む第1領域61に次いで、バッグ63aを含む第3領域63の撮像条件が設定(変更)される可能性が高いという考え方に基づく。
例えば、図6において、AF演算部により人物61aと自動車62aとの間にフォーカスが合っている場合を想定する。設定部35cは、自動車62aと、バッグ63aと、山64aと、雲65aと、雲66aとのうち、フォーカスのずれ量が最も小さい被写体要素(すなわち、フォーカスが合っている位置から最も近い位置にある自動車62a)を含む第2領域62を、人物61aを含む第1領域61に次いで撮像条件を優先的に変更する領域として設定する。人物61aを含む第1領域61に次いで、自動車62aを含む第2領域62の撮像条件が設定(変更)される可能性が高いという考え方に基づく。
設定部35dは、カメラ1から被写体要素までの距離の差に基づいて序列を設定する。例えば、図6において、第1領域61に対してAF動作が行われたことによって人物61aにフォーカスが合っている場合を想定する。この場合、設定部35dは、自動車62aと、バッグ63aと、山64aと、雲65aと、雲66aとのうち、カメラ1からの距離が、カメラ1から人物61aまでの距離に近い(距離差が小さい)被写体要素を含む領域ほど、撮像条件を優先的に変更する領域として設定する。
例えば、図6において、第1領域61に対してAF動作が行われたことによって人物61aにフォーカスが合っている場合を想定する。設定部35cは、自動車62aと、バッグ63aと、山64aと、雲65aと、雲65aと、雲66aとのうち、人物61aとの間で輝度差が最も大きい被写体要素を含む領域を、人物61aを含む第1領域61に次いで撮像条件を優先的に変更する領域として設定する。例えば、人物61aとの間で山64aの輝度差が最大である場合、設定部35cは、山64aを含む第4領域64を、人物61aを含む第1領域61に次いで撮像条件を優先的に変更する領域として設定する。人物61aとの間で輝度差が大きな被写体要素を含む領域は、撮像条件が設定(変更)される可能性が高いという考え方に基づく。
被写体要素を含む領域間のフォーカスのずれ量の差の大小関係が乏しく、領域間で輝度差の大小関係も乏しい場合には、設定部35cは、他の被写体要素に比べて大きな被写体要素を含む領域、換言すると画面内の占有面積が大きいほど、序列を高くする。
被写体要素を含む領域間のフォーカスのずれ量の差の大小関係が乏しく、領域間で輝度差の大小関係も乏しい場合には、設定部35cは、画面の中央に近い被写体要素を含む領域ほど、序列を高くする。
本実施形態では、ユーザーが操作部材37を操作することによって、上記(5)から(9)のいずれか一つがあらかじめ選択されるようにしてもよい。また、上記(5)から(9)のうち複数を組み合わせるようにしてもよい。
以後の説明では、カメラ1はタッチ操作を前提として説明を行うが、操作部材37を構成するボタン等の操作により、撮像条件の設定(変更)を行うようにしてもよい。
強調表示されていない領域(第1領域61以外の他の領域)については、設定されている撮像条件が維持される。
表示用の区分け(表示パターン)は、例えば、序列1位の領域を単独で表示する表示パターン、序列1位と序列2位の領域とを組み合わせて表示する表示パターン、序列1位と序列2位と序列3位の領域とを組み合わせて表示する表示パターン、序列1位と序列3位の領域とを組み合わせて表示する表示パターン、序列2位の領域を単独で表示する表示パターン、序列3位の領域を単独で表示する表示パターン、等の様に序列をつけた領域の数によって表示パターンは幾通りも作成される。
ここで、全撮像画像の中の被写体要素の数による領域の区分けについて説明する。
制御部35は、物体検出部35aによって検出されている被写体要素の数が所定数より少ない場合において被写体要素毎に単独領域として区分けをする。物体検出部35aによって検出されている被写体要素の数が所定数より多い場合には、単独領域と単独領域を組み合わせた複合領域とに区分けしてもよい。または、複合領域と複合領域とに区分けしてもよい。例えば、旅行の集合写真の場合、制御部35が認識した人物ごとに単独領域を設定すると領域の数が多くなり、撮像条件の設定に時間を要する。そのため、単独領域を組み合わせて、被写体人物を全体として1つの領域(複合領域)として設定すると、撮像条
件の設定は複合領域についてのみ行えばよく、時間を短縮することが可能となる。
なお、表示パターンの数は、ユーザーが操作部材37を操作することによってあらかじめ設定可能に構成してもよい。
図8は、領域(単独領域または複合領域)ごとに撮像条件を設定して撮像する処理の流れを説明するフローチャートである。カメラ1のメインスイッチがオン操作されると、制御部35は、図8に示す処理を実行するプログラムを起動させる。ステップS10において、制御部35は、液晶モニタ36にライブビュー表示を開始させて、ステップS20へ進む。
なお、ライブビュー表示中にAF動作を行う設定がなされている場合、制御部35(AF演算部35f)は、所定のフォーカスポイントに対応する被写体要素にフォーカスを合わせるAF動作を制御する。また、ライブビュー表示中にAF動作を行う設定がなされていない場合、制御部35(AF演算部35f)は、後にAF動作が指示された時点でAF動作を行う。
1の輪郭を強調する第7パターン(複合表示パターン)としてもよい。
(1)カメラ1は、撮像面の複数の領域の撮像条件を設定可能に構成された撮像素子100により被写体像を撮像する撮像部32と、撮像されたライブビュー画像に基づいて、撮像面を複数の領域に区分けする領域区分け部35bとを備える。カメラ1が、自動的に複数の領域に区分けするので、ユーザーにとって、領域ごとの設定が行いやすくなる。
(15)カメラ1は、領域区分け部35bによって区分けされた複数の領域に序列をつける設定部35cと、複数の領域に対応する所定の処理を、序列の順番に行う制御部35を備えるので、領域に対する処理を適切な順番に行うことができる。
上述した説明では、設定部35cは、領域区分け部35bによって区分けされた複数の領域に序列をつける説明をしたが、これに限定されない。設定部35cは、領域区分け部35bにより区分けされた領域において、撮像条件を変更すべき領域か否かを示す情報を付加するようにしてもよい。設定部35cは、撮像条件を変更すべき領域か否かの判断を、上述した領域の序列を設定する方法に基づいて行うようにすればよい。
上述した説明では、領域の表示パターンを複数作成した場合に、図7(a)~図7(c)に例示したように、1パターンずつ液晶モニタ36に表示する例を説明した。ユーザーによる液晶モニタ36の画面上のスライド操作に応じて、制御部35が、表示パターンを切り替える。この代わりに、液晶モニタ36に複数の表示パターンを並べて表示することにより、ユーザーが、任意の表示パターンを選べるようにしてもよい。
作成されている表示パターンの数が、8である場合を想定する。制御部35は、作成されている表示パターンの数が、一覧表示可能な数(例えば4)を超えているので、一覧表示に加えて、補助画面90を表示させる。図10は、変形例3による液晶モニタ36の表示画面を例示する図である。図10において、一覧表示の左上に序列1位の第1パターン60aが表示され、一覧表示の右上に序列2位の第2パターン60bが表示され、一覧表示の左下に序列3位の第4パターン60dが表示され、一覧表示の右下に序列4位の第3パターン60cが表示される。
図11は、変形例4による表示パターンの切り替えを説明する図である。図11において、ライブビュー画像60fに重ねて、風景アイコン74、人物アイコン75、および自動車アイコン76が、それぞれ表示されている。ユーザーが人物アイコン75をタップ操作すると、制御部35は、人物61a(図6)を被写体要素とする第1領域61の輪郭を強調したライブビュー画像60fを表示させる。
なお、制御部35は、ユーザーによるタップ操作に応じて切り替えた表示パターンの順番にしたがって、表示パターンに序列をつけたり、序列を変更したりするように構成してもよい。
上述した説明では、カメラ1を例に説明したが、スマートフォンやタブレット端末などのようにカメラ機能を備えた電子機器によって構成してもよい。
図13(a)は、カメラ機能を備えた電子機器2における撮像条件の設定について示している。電子機器2は、ユーザーによって図13(a)に例示する態様で操作が行われることを想定して、液晶モニタ36に撮像条件の設定画面を表示させる。一般に、ユーザーは、片手で液晶モニタ36の表示面のタッチ操作部材を操作する。図13(a)によれば、右手の親指で電子機器2のタッチ操作部材が操作され、親指以外の指で電子機器2の背面が支持されている。液晶モニタ36の表示面における右手の親指の可動範囲は、親指の関節位置Pを中心として親指の長さを半径とする円弧の内側である。
そこで、制御部35は、人が電子機器2を把持する平均的な持ち位置、および人の親指の平均的な長さに基づく親指の可動範囲をあらかじめ定め、この可動範囲の内側に後述する操作部70(図13(b))を表示させる。
なお、ユーザーによって選択された領域を撮像条件の設定(変更)の対象にする代わりに、制御部35が自動的に選んだ領域を撮像条件の設定(変更)の対象にしてもよい。例えば、領域区分け部35bによって区分けされた領域に優先順位を付けて、制御部35がこの順番に基づいて選んだ領域を撮像条件の設定(変更)の対象にすることができる。
なお、制御部35は、撮像条件の設定を行う領域が決定すると、ユーザーの操作によらずに操作部70を表示させてもよい。
なお、撮像条件の設定(変更)対象でない領域のうち、第1領域61との境界付近については、上記境界付近における撮像条件の不連続性をぼかすように、画像全体のバランスを考慮して撮像条件を変更してもよい。
なお、操作部70によって変更する撮像条件(露出条件や画像処理条件)は、輝度、コントラスト、および彩度でもよい。図14(a)は、撮像条件として輝度、コントラスト、および彩度の設定画面を例示する図である。ライブビュー画像60aに重ねて画面の右下位置(すなわち、右手親指の可動範囲内)に表示された操作部70には、撮像条件の設定項目の一例として、上記可動範囲の外寄りから順に曲線74、曲線75、および曲線76が含まれる。曲線74は、露出条件の1つである輝度を高く、または低く変更する操作部に相当する。曲線75は、画像処理条件の1つであるコントラストを高く、または低く変更する操作部に相当する。曲線76は、画像処理条件の1つである彩度を高く、または低く変更する操作部に相当する。図14(a)では、操作部70に3つの撮像条件に対応する3つの曲線を表示する例を説明するが、1つの撮像条件に対応する1つの曲線のみを表示したり、2つの撮像条件に対応する2つの曲線を表示したりすることも可能である。
なお、変更する撮像条件(露出条件、画像処理条件)を、制御部35がライブビュー画像60aに基づき決定するようにしてもよいし、ユーザー操作によってあらかじめ指示されている撮像条件を変更対象として決定するようにしてもよい。
なお、撮像条件の設定(変更)対象でない領域のうち、第1領域61との境界付近については、上記境界付近における撮像条件の不連続性をぼかすように、画像全体のバランスを考慮して撮像条件を変更してもよい。
これによれば、ユーザーは、撮像条件の設定(変更)をゆっくり行いたいときはアイコン群80のアイコンに指の先で軽く触れ、早く行いたいときはアイコン群80のアイコンに指の腹でしっかり触れればよいので、使い勝手をよくすることができる。
なお、ユーザーによるアイコン操作が終了後、矢印アイコン86に対する回転操作が行われることなく所定時間(たとえば1秒)が経過した場合には、制御部35は、矢印アイコン86の表示を終了させるとともに、アイコン操作が終了した時点における撮像条件の調整パラメータを撮像部32または画像処理部33に設定する。
図19は、変形例6における撮像条件の設定画面を例示する図である。制御部35は、領域区分け部35bによって区分けされた領域のうち、ユーザーによって選択された領域を撮像条件の設定(変更)の対象にする。図19では、制御部35は、ライブビュー画像60aにおいて人物61aを含む第1領域61を、撮像条件を設定(変更)する対象領域にするとともに、第1領域61の輪郭を強調して表示させる。
なお、撮像条件の設定(変更)対象でない領域のうち、第1領域61との境界付近については、上記境界付近における撮像条件の不連続性をぼかすように、画像全体のバランスを考慮して撮像条件を変更してもよい。
また、アイコンの表示位置をずらす場合などにおいて、アイコン領域IG61またはアイコン領域IG62の幅を広げることによってアイコンのはみ出しを避けてもよい。
ユーザーは、ライブビュー画像60aにおいて第1領域61の露出が変化する様子を確認できる。
なお、撮像条件の設定(変更)対象でない領域のうち、第1領域61との境界付近については、上記境界付近における撮像条件の不連続性をぼかすように、画像全体のバランスを考慮して撮像条件を変更してもよい。
なお、アイコン71~アイコン73を表示させる順番は、適宜変更して構わない。
なお、制御部35は、レリーズ指示が行われるまで、すなわち操作部材37を構成する不図示のレリーズボタン、または撮像を指示する表示アイコンが操作されるまでは、アイコン71および指標71mと、アイコン72および指標72mの表示を継続するようにしてもよい。
制御部35は、表示しているアイコン領域IG62の第2のアイコン群に対する操作を有効にする。操作が有効なアイコン群が操作された場合に行う対象領域に対する撮像条件の設定(変更)は、上述した説明と同様であるので、説明を省略する。
制御部35は、表示しているアイコン領域IG62の第2のアイコン群に対する操作を有効にする。操作が有効なアイコン群が操作された場合に行う対象領域に対する撮像条件の設定(変更)は、上述した説明と同様であるので、説明を省略する。
制御部35は、表示しているアイコン領域IG62の第2のアイコン群に対する操作を有効にする。
制御部35は、表示しているアイコン領域IG62の第2のアイコン群に対する操作を有効にする。
これによれば、画像の演出処理設定(変更)を簡単に行うことができる。
上述した実施の形態では、撮像部32と制御部35とを単一の電子機器として構成したカメラ1を例に説明した。この代わりに、例えば、撮像部32と制御部35とを分離して設け、制御部35から通信を介して撮像部32を制御する撮像システム1Bを構成してもよい。
以下、撮像部32を備えた撮像装置1001を、制御部35を備えた制御装置1002から制御する例を説明する。
なお、撮像装置1001と表示装置1002とを有線ケーブルにより有線接続し、第1通信部1003および第2通信部1004が双方向のデータ通信を行う構成にしてもよい。
表示装置1002は、例えば、スマートフォンのような高機能携帯電話機250によって構成することができる。また、撮像装置1001は、上述した積層型撮像素子を備える電子機器によって構成することができる。
なお、表示装置1002の制御部35に物体検出部35aと、領域区分け部35bと、設定部35cと、撮像条件設定部35dと、撮像制御部35eと、AF演算部35fとを設ける例を説明したが、物体検出部35a、領域区分け部35b、設定部35c、撮像条件設定部35d、撮像制御部35e、およびAF演算部35fの一部について、撮像装置1001に設けるようにしてもよい。
上述したカメラ1、高機能携帯電話機250、またはタブレット端末などのモバイル機器へのプログラムの供給は、例えば図33に例示するように、プログラムを格納したパーソナルコンピュータ205から赤外線通信や近距離無線通信によってモバイル機器へ送信することができる。
日本国特許出願2014年第245433号(2014年12月3日出願)
1B…撮像システム
2…電子機器
32…撮像部
35…制御部
35a…物体検出部
35b…領域区分け部
35c…設定部
36…液晶モニタ
100…撮像素子
1001…撮像装置
1002…表示装置
Claims (15)
- 第1撮像領域と、前記第1撮像領域とは異なる第2撮像領域と、を有する撮像素子と、
前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とを、前記撮像素子の撮像条件を設定する領域を選択させるように表示部に表示させる制御部と、
を備える撮像装置。 - 請求項1に記載の撮像装置において、
前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とにより被写体の検出を行う検出部を備え、
前記制御部は、前記検出部で検出された被写体により前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とを前記表示部に表示させる序列を決定する撮像装置。 - 請求項1又は請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域の撮像条件と前記第2撮像領域の撮像条件とを前記表示部に表示させる撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、設定されている撮像シーンモードと関連する被写体を含む画像の前記序列の順位を高くする撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、フォーカスが合っている被写体を含む画像の前記序列の順位を高くする撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、至近の被写体を含む画像の前記序列の順位を高くする撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、所定値より低輝度または所定値より高輝度の被写体を含む画像の前記序列の順位を高くする撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、被写体間の距離差が小さい被写体を含む画像ほど前記序列の順位を高くする撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、輝度差が大きい被写体を含む画像ほど前記序列の順位を高くする撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、大きな被写体を含む画像ほど前記序列の順位を高くする撮像装置。 - 請求項2に記載の撮像装置において、
前記制御部は、前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とのうち、画像の中央に近い被写体を含む画像ほど前記序列の順位を高くする撮像装置。 - 撮像素子の第1撮像領域により生成された画像と前記撮像素子の第2撮像領域により生成された画像とを、前記撮像素子の撮像条件を設定する領域を選択させるように表示部に表示させる制御部と、
前記表示部に表示された画像により選択された、前記撮像素子の領域の撮像条件を設定する設定部と、
を備える電子機器。 - 請求項12に記載の電子機器において、
前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とにより被写体の検出を行う検出部を備え、
前記制御部は、前記検出部で検出された被写体により前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とを前記表示部に表示させる序列を決定する電子機器。 - 請求項12又は請求項13に記載の電子機器において、
前記制御部は、前記第1撮像領域の撮像条件と前記第2撮像領域の撮像条件とを前記表示部に表示させる電子機器。 - 第1撮像領域と前記第1撮像領域とは異なる第2撮像領域とを有する撮像素子により被写体を撮像させる撮像処理と、
前記第1撮像領域により生成された画像と前記第2撮像領域により生成された画像とを、前記撮像素子の撮像条件を設定する領域を選択させるように表示部に表示させる表示処理と、
をコンピュータに実行させるプログラム。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201580065732.1A CN107005641B (zh) | 2014-12-03 | 2015-12-03 | 拍摄装置、电子设备以及存储有程序的记录介质 |
JP2016562675A JP6432606B2 (ja) | 2014-12-03 | 2015-12-03 | 電子機器 |
EP15864435.1A EP3229457B1 (en) | 2014-12-03 | 2015-12-03 | Image pickup device, electronic apparatus, and program |
US15/533,072 US10284771B2 (en) | 2014-12-03 | 2015-12-03 | Image-capturing apparatus, electronic device, and program |
US16/366,133 US11297221B2 (en) | 2014-12-03 | 2019-03-27 | Image-capturing apparatus, electronic device, and program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014-245433 | 2014-12-03 | ||
JP2014245433 | 2014-12-03 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/533,072 A-371-Of-International US10284771B2 (en) | 2014-12-03 | 2015-12-03 | Image-capturing apparatus, electronic device, and program |
US16/366,133 Continuation US11297221B2 (en) | 2014-12-03 | 2019-03-27 | Image-capturing apparatus, electronic device, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016088840A1 true WO2016088840A1 (ja) | 2016-06-09 |
Family
ID=56091780
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/084031 WO2016088840A1 (ja) | 2014-12-03 | 2015-12-03 | 撮像装置、電子機器およびプログラム |
Country Status (5)
Country | Link |
---|---|
US (2) | US10284771B2 (ja) |
EP (1) | EP3229457B1 (ja) |
JP (4) | JP6432606B2 (ja) |
CN (2) | CN107005641B (ja) |
WO (1) | WO2016088840A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017220892A (ja) * | 2016-06-10 | 2017-12-14 | オリンパス株式会社 | 画像処理装置及び画像処理方法 |
US12034015B2 (en) | 2018-05-25 | 2024-07-09 | Meta Platforms Technologies, Llc | Programmable pixel array |
Families Citing this family (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3229457B1 (en) * | 2014-12-03 | 2021-06-09 | Nikon Corporation | Image pickup device, electronic apparatus, and program |
JP2017017624A (ja) * | 2015-07-03 | 2017-01-19 | ソニー株式会社 | 撮像素子、画像処理方法、および電子機器 |
US10331944B2 (en) * | 2015-09-26 | 2019-06-25 | Intel Corporation | Technologies for dynamic performance of image analysis |
US10027896B2 (en) * | 2016-01-15 | 2018-07-17 | Semiconductor Energy Laboratory Co., Ltd. | Image display system, operation method of the same, and electronic device |
JP6623916B2 (ja) * | 2016-04-26 | 2019-12-25 | リコーイメージング株式会社 | 撮像装置 |
US10686996B2 (en) | 2017-06-26 | 2020-06-16 | Facebook Technologies, Llc | Digital pixel with extended dynamic range |
US10598546B2 (en) | 2017-08-17 | 2020-03-24 | Facebook Technologies, Llc | Detecting high intensity light in photo sensor |
JP2019072140A (ja) * | 2017-10-13 | 2019-05-16 | サミー株式会社 | 回胴式遊技機 |
JP2019072141A (ja) * | 2017-10-13 | 2019-05-16 | サミー株式会社 | 回胴式遊技機 |
JP2019072137A (ja) * | 2017-10-13 | 2019-05-16 | サミー株式会社 | 回胴式遊技機 |
JP7005334B2 (ja) * | 2017-12-22 | 2022-01-21 | キヤノン株式会社 | 電子機器、その制御方法およびプログラム |
US11906353B2 (en) | 2018-06-11 | 2024-02-20 | Meta Platforms Technologies, Llc | Digital pixel with extended dynamic range |
US11463636B2 (en) | 2018-06-27 | 2022-10-04 | Facebook Technologies, Llc | Pixel sensor having multiple photodiodes |
US10897586B2 (en) | 2018-06-28 | 2021-01-19 | Facebook Technologies, Llc | Global shutter image sensor |
JP7187190B2 (ja) * | 2018-06-29 | 2022-12-12 | キヤノン株式会社 | 電子機器、および電子機器の制御方法、プログラム、記憶媒体 |
US10931884B2 (en) | 2018-08-20 | 2021-02-23 | Facebook Technologies, Llc | Pixel sensor having adaptive exposure time |
US11956413B2 (en) | 2018-08-27 | 2024-04-09 | Meta Platforms Technologies, Llc | Pixel sensor having multiple photodiodes and shared comparator |
US11595602B2 (en) | 2018-11-05 | 2023-02-28 | Meta Platforms Technologies, Llc | Image sensor post processing |
US11962928B2 (en) | 2018-12-17 | 2024-04-16 | Meta Platforms Technologies, Llc | Programmable pixel array |
US11888002B2 (en) * | 2018-12-17 | 2024-01-30 | Meta Platforms Technologies, Llc | Dynamically programmable image sensor |
US11218660B1 (en) | 2019-03-26 | 2022-01-04 | Facebook Technologies, Llc | Pixel sensor having shared readout structure |
US11943561B2 (en) | 2019-06-13 | 2024-03-26 | Meta Platforms Technologies, Llc | Non-linear quantization at pixel sensor |
JP2021029033A (ja) * | 2019-08-09 | 2021-02-25 | キヤノン株式会社 | 露出設定装置、その制御方法、プログラム、及び記憶媒体 |
US11936998B1 (en) | 2019-10-17 | 2024-03-19 | Meta Platforms Technologies, Llc | Digital pixel sensor having extended dynamic range |
US11935291B2 (en) | 2019-10-30 | 2024-03-19 | Meta Platforms Technologies, Llc | Distributed sensor system |
US11948089B2 (en) | 2019-11-07 | 2024-04-02 | Meta Platforms Technologies, Llc | Sparse image sensing and processing |
CN111405199B (zh) * | 2020-03-27 | 2022-11-01 | 维沃移动通信(杭州)有限公司 | 一种图像拍摄方法和电子设备 |
US11902685B1 (en) | 2020-04-28 | 2024-02-13 | Meta Platforms Technologies, Llc | Pixel sensor having hierarchical memory |
US11825228B2 (en) | 2020-05-20 | 2023-11-21 | Meta Platforms Technologies, Llc | Programmable pixel array having multiple power domains |
US11910114B2 (en) | 2020-07-17 | 2024-02-20 | Meta Platforms Technologies, Llc | Multi-mode image sensor |
US11956560B2 (en) | 2020-10-09 | 2024-04-09 | Meta Platforms Technologies, Llc | Digital pixel sensor having reduced quantization operation |
US11935575B1 (en) | 2020-12-23 | 2024-03-19 | Meta Platforms Technologies, Llc | Heterogeneous memory system |
US12022218B2 (en) | 2020-12-29 | 2024-06-25 | Meta Platforms Technologies, Llc | Digital image sensor using a single-input comparator based quantizer |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008028960A (ja) * | 2006-07-25 | 2008-02-07 | Fujifilm Corp | 撮影装置及び露出制御方法 |
JP2010074314A (ja) * | 2008-09-16 | 2010-04-02 | Canon Inc | 撮像装置、その制御方法及びプログラム |
JP2013258438A (ja) * | 2012-05-18 | 2013-12-26 | Olympus Imaging Corp | 撮像装置 |
Family Cites Families (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004179868A (ja) | 2002-11-26 | 2004-06-24 | Canon Inc | 自動焦点調節機能を有する電子カメラ |
EP1653279B1 (en) * | 2003-07-15 | 2019-02-06 | Omron Corporation | Object decision device and imaging device |
JP2005055570A (ja) | 2003-08-01 | 2005-03-03 | Minolta Co Ltd | カメラ |
JP2006060629A (ja) | 2004-08-23 | 2006-03-02 | Olympus Corp | 画像処理装置と撮像装置、および画像処理プログラム |
JP4277216B2 (ja) | 2005-01-13 | 2009-06-10 | ソニー株式会社 | 撮像装置及び撮像結果の処理方法 |
JP2007074141A (ja) * | 2005-09-05 | 2007-03-22 | Canon Inc | 撮像装置及びその制御方法 |
JP4288612B2 (ja) * | 2005-09-14 | 2009-07-01 | ソニー株式会社 | 画像処理装置および方法、並びにプログラム |
US7688379B2 (en) * | 2005-12-09 | 2010-03-30 | Hewlett-Packard Development Company, L.P. | Selecting quality images from multiple captured images |
JP5164327B2 (ja) | 2005-12-26 | 2013-03-21 | カシオ計算機株式会社 | 撮影装置及びプログラム |
JP2008035328A (ja) * | 2006-07-31 | 2008-02-14 | Fujifilm Corp | テンプレート生成装置、画像配置装置、変更テンプレート生成装置およびそのプログラム |
US8488863B2 (en) * | 2008-11-06 | 2013-07-16 | Los Alamos National Security, Llc | Combinational pixel-by-pixel and object-level classifying, segmenting, and agglomerating in performing quantitative image analysis that distinguishes between healthy non-cancerous and cancerous cell nuclei and delineates nuclear, cytoplasm, and stromal material objects from stained biological tissue materials |
JP5247397B2 (ja) * | 2008-12-05 | 2013-07-24 | キヤノン株式会社 | 撮像装置及び撮像方法 |
JP5127686B2 (ja) * | 2008-12-11 | 2013-01-23 | キヤノン株式会社 | 画像処理装置および画像処理方法、ならびに、撮像装置 |
JP5374135B2 (ja) * | 2008-12-16 | 2013-12-25 | オリンパス株式会社 | 画像処理装置、画像処理装置の作動方法および画像処理プログラム |
JP5434361B2 (ja) | 2009-02-24 | 2014-03-05 | 株式会社リコー | 画像処理装置及び画像処理方法 |
US8179466B2 (en) * | 2009-03-11 | 2012-05-15 | Eastman Kodak Company | Capture of video with motion-speed determination and variable capture rate |
JP5695335B2 (ja) * | 2009-05-22 | 2015-04-01 | オリンパスイメージング株式会社 | 撮影条件制御装置、カメラ、画質制御装置およびプログラム |
KR101141854B1 (ko) * | 2009-12-30 | 2012-05-08 | 삼성전자주식회사 | 카메라 구동 방법 및 장치 |
JP2011239267A (ja) | 2010-05-12 | 2011-11-24 | Ricoh Co Ltd | 撮像装置及び画像処理装置 |
US8970720B2 (en) * | 2010-07-26 | 2015-03-03 | Apple Inc. | Automatic digital camera photography mode selection |
JP2012235332A (ja) | 2011-05-02 | 2012-11-29 | Sony Corp | 撮像装置、および撮像装置制御方法、並びにプログラム |
US8605199B2 (en) * | 2011-06-28 | 2013-12-10 | Canon Kabushiki Kaisha | Adjustment of imaging properties for an imaging assembly having light-field optics |
JP2013085178A (ja) | 2011-10-12 | 2013-05-09 | Nikon Corp | 画像表示装置、カメラおよび画像表示プログラム |
RU2018109081A (ru) * | 2012-05-02 | 2019-02-26 | Никон Корпорейшн | Устройство формирования изображений |
JP6029380B2 (ja) * | 2012-08-14 | 2016-11-24 | キヤノン株式会社 | 画像処理装置、画像処理装置を具備する撮像装置、画像処理方法、及びプログラム |
JP2014120844A (ja) * | 2012-12-14 | 2014-06-30 | Ricoh Co Ltd | 画像処理装置および撮像装置 |
US10088989B2 (en) * | 2014-11-18 | 2018-10-02 | Duelight Llc | System and method for computing operations based on a first and second user input |
CN105103537B (zh) * | 2013-02-27 | 2018-11-06 | 株式会社尼康 | 成像元件及电子设备 |
JP2014165855A (ja) | 2013-02-27 | 2014-09-08 | Nikon Corp | 電子機器 |
JP6343870B2 (ja) | 2013-03-15 | 2018-06-20 | 株式会社ニコン | 撮像素子および撮像装置 |
JP2014179920A (ja) | 2013-03-15 | 2014-09-25 | Canon Inc | 撮像装置及びその制御方法、プログラム、並びに記憶媒体 |
JP6286668B2 (ja) * | 2013-05-22 | 2018-03-07 | パナソニックIpマネジメント株式会社 | 撮像装置および撮像画像の表示方法 |
EP3229457B1 (en) | 2014-12-03 | 2021-06-09 | Nikon Corporation | Image pickup device, electronic apparatus, and program |
-
2015
- 2015-12-03 EP EP15864435.1A patent/EP3229457B1/en active Active
- 2015-12-03 CN CN201580065732.1A patent/CN107005641B/zh active Active
- 2015-12-03 US US15/533,072 patent/US10284771B2/en active Active
- 2015-12-03 JP JP2016562675A patent/JP6432606B2/ja active Active
- 2015-12-03 CN CN202011506467.5A patent/CN112653821A/zh active Pending
- 2015-12-03 WO PCT/JP2015/084031 patent/WO2016088840A1/ja active Application Filing
-
2018
- 2018-11-08 JP JP2018210631A patent/JP6610751B2/ja active Active
-
2019
- 2019-03-27 US US16/366,133 patent/US11297221B2/en active Active
- 2019-10-31 JP JP2019198899A patent/JP2020043574A/ja active Pending
-
2022
- 2022-04-25 JP JP2022071650A patent/JP7279835B2/ja active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008028960A (ja) * | 2006-07-25 | 2008-02-07 | Fujifilm Corp | 撮影装置及び露出制御方法 |
JP2010074314A (ja) * | 2008-09-16 | 2010-04-02 | Canon Inc | 撮像装置、その制御方法及びプログラム |
JP2013258438A (ja) * | 2012-05-18 | 2013-12-26 | Olympus Imaging Corp | 撮像装置 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017220892A (ja) * | 2016-06-10 | 2017-12-14 | オリンパス株式会社 | 画像処理装置及び画像処理方法 |
US12034015B2 (en) | 2018-05-25 | 2024-07-09 | Meta Platforms Technologies, Llc | Programmable pixel array |
Also Published As
Publication number | Publication date |
---|---|
JP2022097567A (ja) | 2022-06-30 |
JP2019071611A (ja) | 2019-05-09 |
US11297221B2 (en) | 2022-04-05 |
CN107005641A (zh) | 2017-08-01 |
EP3229457B1 (en) | 2021-06-09 |
US20170332008A1 (en) | 2017-11-16 |
CN107005641B (zh) | 2021-01-05 |
JP6432606B2 (ja) | 2018-12-05 |
EP3229457A1 (en) | 2017-10-11 |
JP7279835B2 (ja) | 2023-05-23 |
JPWO2016088840A1 (ja) | 2017-08-03 |
EP3229457A4 (en) | 2018-05-30 |
US10284771B2 (en) | 2019-05-07 |
CN112653821A (zh) | 2021-04-13 |
JP2020043574A (ja) | 2020-03-19 |
JP6610751B2 (ja) | 2019-11-27 |
US20190222750A1 (en) | 2019-07-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6610751B2 (ja) | 電子機器 | |
JP6617428B2 (ja) | 電子機器 | |
JP6604384B2 (ja) | 撮像装置 | |
JP2022174185A (ja) | 撮像装置 | |
US20230283881A1 (en) | Electronic device, image-capturing device, and image-capturing system | |
WO2017057492A1 (ja) | 撮像装置および画像処理装置 | |
JP2018056944A (ja) | 撮像装置および撮像素子 | |
JP6973599B2 (ja) | 電子機器 | |
JP6780762B2 (ja) | 電子機器 | |
WO2017057494A1 (ja) | 撮像装置および画像処理装置 | |
JP6589988B2 (ja) | 撮像装置 | |
JP6589989B2 (ja) | 撮像装置 | |
JP6604385B2 (ja) | 撮像装置 | |
WO2017057493A1 (ja) | 撮像装置および画像処理装置 | |
WO2017057495A1 (ja) | 撮像装置および画像処理装置 | |
JP2018056943A (ja) | 撮像装置および撮像素子 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15864435 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016562675 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15533072 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2015864435 Country of ref document: EP |