US8345109B2 - Imaging device and its shutter drive mode selection method - Google Patents

Imaging device and its shutter drive mode selection method Download PDF

Info

Publication number
US8345109B2
US8345109B2 US12/341,111 US34111108A US8345109B2 US 8345109 B2 US8345109 B2 US 8345109B2 US 34111108 A US34111108 A US 34111108A US 8345109 B2 US8345109 B2 US 8345109B2
Authority
US
United States
Prior art keywords
image
drive mode
shutter drive
inter
imaging device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US12/341,111
Other languages
English (en)
Other versions
US20090167911A1 (en
Inventor
Yasuo Takane
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Assigned to FUJIFILM CORPORATION reassignment FUJIFILM CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TAKANE, YASUO
Publication of US20090167911A1 publication Critical patent/US20090167911A1/en
Application granted granted Critical
Publication of US8345109B2 publication Critical patent/US8345109B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6811—Motion detection based on the image signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/53—Control of the integration time

Definitions

  • Digital cameras incorporating a CMOS image sensor have various shutter methods, that is, a global reset method which uses a mechanical shutter, a global shutter method in which the electronic shutter timing is controlled so as to be identical for all pixels, and a rolling shutter method in which the electronic shutter timing is controlled on a pixel-line-by-pixel-line basis.
  • the imaging device and its shutter drive mode selection method may calculate an inter-frame motion vector, for an entire frame, of the through image and perform the selection automatically based on the inter-frame motion vector.
  • FIG. 3 is a flowchart showing the operation procedure of an imaging control program, which includes shutter drive mode selection steps, according to a second embodiment.
  • an image signal processing circuit 23 for processing an image signal that is output from the CMOS image sensor 7 , a resizer 24 for resizing a result of the image processing, a CPU 25 for controlling the imaging device 1 in a unified manner, an image compression/expansion circuit 26 for compressing image-processed image data and expanding a compressed image, a media interface 27 which is connected to an external storage medium, a direct memory access controller (DMAC) 28 , a USB interface 29 which is connected to a PC, a printer, or the like (not shown), an encoder/LCD signal processing circuit 30 which is connected to a TV monitor and/or a liquid crystal display unit provided on the back side, for example, of the camera, and an I/O port 31 .
  • DMAC direct memory access controller
  • An image stabilization circuit 32 and a motion vector detection circuit 33 are connected to the image signal processing circuit 23 .
  • the image stabilization circuit 32 receives the detection signals of the gyro sensors 9 and 10 and the image processing result, and performs an image stabilization process.
  • the motion vector detection circuit 33 acquires an image processing result which is obtained by taking in a through image from the CMOS image sensor 7 , for example, before shooting of a still image and performing the image processing therefore (described later in detail).
  • step S 5 Upon execution of steps S 3 and S 4 , the process moves to step S 5 , and it is determined as to whether or not the shutter speed determined at step 84 is in such a range that the mechanical shutter 8 can follow. If the shutter speed can be followed by the mechanical shutter 8 , the process moves from step S 5 to step S 6 , where the global reset method is selected as a shutter drive mode.
  • step S 6 If a shutter drive mode is selected at step S 6 , S 9 , or S 10 , the process moves to step S 11 , where it is determined as to whether or not the release button has been depressed. If the release button has not been depressed yet, the process returns to step S 2 to execute step S 2 and the following steps again.
  • step S 5 it is determined as to whether or not the shutter speed determined at step S 4 is in such a range that the mechanical shutter 8 can follow. If the shutter speed is in the followable range, the global reset method is selected at step S 6 . If the shutter speed is not in the followable range, the process moves to step S 9 , where the global shutter method is selected. Subsequent steps S 11 , S 23 , and S 13 are the same as in the first embodiment.
  • the program according to this embodiment is activated when the imaging device 1 performs shooting in a sequential shooting mode. Steps S 1 , S 2 , S 3 ′, and S 4 are the same as in the second embodiment. Upon execution of steps S 3 ′ and S 4 , the process moves to step S 15 , where a reference value is corrected based on an AE value etc.
  • a shutter drive mode is selected based on motion vectors calculated from a through image
  • a second or subsequent image motion vectors are calculated based on image data produced by immediately preceding main shooting and a shutter drive mode is selected based on these motion vectors.
  • step S 21 it is determined as to whether the current operation mode is a moving image shooting mode or a reproduction mode. If the current operation mode is the reproduction mode, the process moves to a reproduction mode process. If the current operation mode is the moving image shooting mode, the process moves to step S 22 , where a through image is displayed. At the next step S 23 , it is determined as to whether or not the release button has been depressed. If the release button has not been depressed yet, the process returns to step S 22 . If the release button has been depressed, step S 24 is executed in parallel with steps S 25 and S 26 .
  • focal plane distortion occurs because the exposure timing varies from one line to another. If this type of distortion and distortion caused by camera shake occur simultaneously, an image is distorted notably and hence is very poor. In contrast, this embodiment can prevent such distortion because the shutter drive mode is switched according to the camera shake state.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
US12/341,111 2007-12-27 2008-12-22 Imaging device and its shutter drive mode selection method Active 2031-04-30 US8345109B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JPP2007-337204 2007-12-27
JP2007337204A JP4887275B2 (ja) 2007-12-27 2007-12-27 撮像装置及びそのシャッタ駆動モード選択方法

Publications (2)

Publication Number Publication Date
US20090167911A1 US20090167911A1 (en) 2009-07-02
US8345109B2 true US8345109B2 (en) 2013-01-01

Family

ID=40797765

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/341,111 Active 2031-04-30 US8345109B2 (en) 2007-12-27 2008-12-22 Imaging device and its shutter drive mode selection method

Country Status (5)

Country Link
US (1) US8345109B2 (zh)
JP (1) JP4887275B2 (zh)
KR (1) KR101519427B1 (zh)
MY (1) MY147678A (zh)
TW (1) TWI446098B (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170104898A1 (en) * 2014-06-11 2017-04-13 Sony Semiconductor Solutions Corporation Image processing apparatus, image processing method, and program
US11438534B2 (en) * 2018-09-07 2022-09-06 Sony Semiconductor Solutions Corporation Solid-state imaging device and electronic apparatus

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7841533B2 (en) 2003-11-13 2010-11-30 Metrologic Instruments, Inc. Method of capturing and processing digital images of an object within the field of view (FOV) of a hand-supportable digitial image capture and processing system
US7866557B2 (en) * 2007-09-27 2011-01-11 Symbol Technologies, Inc. Imaging-based bar code reader utilizing modified rolling shutter operation
JP5098831B2 (ja) * 2008-06-06 2012-12-12 ソニー株式会社 固体撮像素子およびカメラシステム
US7911505B2 (en) * 2008-08-20 2011-03-22 Eastman Kodak Company Detecting illuminant flicker
JP5683858B2 (ja) * 2009-07-28 2015-03-11 株式会社ザクティ 撮像装置
JP5460180B2 (ja) * 2009-08-25 2014-04-02 キヤノン株式会社 撮像装置及びその制御方法
JP2011135185A (ja) * 2009-12-22 2011-07-07 Sanyo Electric Co Ltd 撮像装置
US9171370B2 (en) * 2010-10-20 2015-10-27 Agency For Science, Technology And Research Method, an apparatus and a computer program product for deinterlacing an image having a plurality of pixels
JP5644400B2 (ja) * 2010-11-15 2014-12-24 セイコーエプソン株式会社 撮影装置、撮影方法および撮影プログラム
JP5625854B2 (ja) * 2010-12-13 2014-11-19 ソニー株式会社 撮像装置及びシャッタ動作選択方法
JP5821315B2 (ja) * 2011-06-21 2015-11-24 ソニー株式会社 電子機器、電子機器の駆動方法
US8941743B2 (en) * 2012-09-24 2015-01-27 Google Technology Holdings LLC Preventing motion artifacts by intelligently disabling video stabilization
JP5735479B2 (ja) * 2012-12-14 2015-06-17 富士フイルム株式会社 内視鏡及装置びその作動方法
JP2014126861A (ja) * 2012-12-27 2014-07-07 Canon Inc 撮像装置及びその制御方法、プログラム、記憶媒体
JP6071545B2 (ja) 2012-12-27 2017-02-01 キヤノン株式会社 撮像装置、画像処理装置及びその制御方法、プログラム、記憶媒体
JP2015033108A (ja) 2013-08-07 2015-02-16 ソニー株式会社 画像処理装置、画像処理方法およびプログラム
JP6391352B2 (ja) * 2014-08-07 2018-09-19 キヤノン株式会社 撮像装置、制御方法、プログラム及び記憶媒体
JP6704725B2 (ja) * 2015-12-16 2020-06-03 キヤノン株式会社 撮像装置、制御方法及びそのプログラム
WO2018055948A1 (ja) 2016-09-23 2018-03-29 富士フイルム株式会社 撮像装置、撮像装置の作動方法、撮像装置の作動プログラム
WO2022213327A1 (zh) * 2021-04-08 2022-10-13 深圳市大疆创新科技有限公司 成像方法、成像***以及包括该成像***的相机和可移动平台

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005086271A (ja) 2003-09-04 2005-03-31 Nikon Corp 電子カメラ
US20060140604A1 (en) * 2004-12-27 2006-06-29 Hirofumi Suda Image sensing apparatus with camera shake correction function
JP2006222637A (ja) 2005-02-09 2006-08-24 Olympus Corp 撮像装置
US20060202036A1 (en) * 2005-03-11 2006-09-14 Ynjiun Wang Bar code reading device with global electronic shutter control
JP2007019706A (ja) 2005-07-06 2007-01-25 Konica Minolta Holdings Inc 撮像装置
US20070058966A1 (en) * 2005-09-14 2007-03-15 Hitachi, Ltd. Image pickup device and image pickup method
JP2007142702A (ja) 2005-11-17 2007-06-07 Nikon Corp 画像処理装置
US20090002501A1 (en) * 2007-06-27 2009-01-01 Micron Technology, Inc. Image blur correction using a secondary camera
US20090021612A1 (en) * 2007-07-20 2009-01-22 Hamilton Jr John F Multiple component readout of image sensor
US20090084847A1 (en) * 2007-09-27 2009-04-02 Symbol Technologies, Inc. Imaging-Based Bar Code Reader Utilizing Modified Rolling Shutter Operation
US20090303362A1 (en) * 2008-06-06 2009-12-10 Sony Corporation Solid state image capture device and camera system
US7815120B2 (en) * 2008-12-12 2010-10-19 Symbol Technologies, Inc. Electronic shutter for a dual-mode imager
US20100329657A1 (en) * 2007-04-18 2010-12-30 Optoelectronics Co., Ltd. Method and Apparatus for Imaging a Moving Object

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005086271A (ja) 2003-09-04 2005-03-31 Nikon Corp 電子カメラ
US20060140604A1 (en) * 2004-12-27 2006-06-29 Hirofumi Suda Image sensing apparatus with camera shake correction function
JP2006222637A (ja) 2005-02-09 2006-08-24 Olympus Corp 撮像装置
US20100090007A1 (en) * 2005-03-11 2010-04-15 Hand Held Products, Inc. Apparatus having coordinated exposure period and illumination period
US20060202036A1 (en) * 2005-03-11 2006-09-14 Ynjiun Wang Bar code reading device with global electronic shutter control
JP2007019706A (ja) 2005-07-06 2007-01-25 Konica Minolta Holdings Inc 撮像装置
US20070058966A1 (en) * 2005-09-14 2007-03-15 Hitachi, Ltd. Image pickup device and image pickup method
JP2007142702A (ja) 2005-11-17 2007-06-07 Nikon Corp 画像処理装置
US20100329657A1 (en) * 2007-04-18 2010-12-30 Optoelectronics Co., Ltd. Method and Apparatus for Imaging a Moving Object
US20090002501A1 (en) * 2007-06-27 2009-01-01 Micron Technology, Inc. Image blur correction using a secondary camera
US20090021612A1 (en) * 2007-07-20 2009-01-22 Hamilton Jr John F Multiple component readout of image sensor
US20090084847A1 (en) * 2007-09-27 2009-04-02 Symbol Technologies, Inc. Imaging-Based Bar Code Reader Utilizing Modified Rolling Shutter Operation
US20090303362A1 (en) * 2008-06-06 2009-12-10 Sony Corporation Solid state image capture device and camera system
US7815120B2 (en) * 2008-12-12 2010-10-19 Symbol Technologies, Inc. Electronic shutter for a dual-mode imager

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170104898A1 (en) * 2014-06-11 2017-04-13 Sony Semiconductor Solutions Corporation Image processing apparatus, image processing method, and program
US9906693B2 (en) * 2014-06-11 2018-02-27 Sony Semiconductor Solutions Corporation Image processing apparatus, image processing method, and program
US11438534B2 (en) * 2018-09-07 2022-09-06 Sony Semiconductor Solutions Corporation Solid-state imaging device and electronic apparatus

Also Published As

Publication number Publication date
TWI446098B (zh) 2014-07-21
KR101519427B1 (ko) 2015-05-12
KR20090071471A (ko) 2009-07-01
JP2009159459A (ja) 2009-07-16
MY147678A (en) 2012-12-31
US20090167911A1 (en) 2009-07-02
JP4887275B2 (ja) 2012-02-29
TW200928572A (en) 2009-07-01

Similar Documents

Publication Publication Date Title
US8345109B2 (en) Imaging device and its shutter drive mode selection method
US7853134B2 (en) Imaging device with image blurring reduction function
US7995852B2 (en) Imaging device and imaging method
US8488006B2 (en) Imaging apparatus capable of detecting motion amount of an object and control method thereof
JP6124538B2 (ja) 撮像装置、撮像装置の制御方法、およびプログラム
JP4441919B2 (ja) 撮像装置及びそのプログラム
JP2009225072A (ja) 撮像装置
US8170409B2 (en) Method and apparatus for controlling flash emission
JP5343588B2 (ja) 撮像装置
JP4614143B2 (ja) 撮像装置及びそのプログラム
EP2088768B1 (en) Imaging apparatus, storage medium storing program and imaging method
US8836821B2 (en) Electronic camera
US8947556B2 (en) Image pickup apparatus, control method therefor, and storage medium storing control program therefor
JP2011223242A (ja) 電子カメラ
JP5482148B2 (ja) オートフォーカス調整回路及び撮像装置
US10003736B2 (en) Image pickup device
JP2012095116A (ja) 撮像装置及びその制御方法
US11356603B2 (en) Image capturing apparatus and control method therefor
JP2006217249A (ja) 電子カメラ、電子カメラシステムおよびプログラム
JP2007333909A (ja) 電子カメラ
JP2012199858A (ja) 撮像装置
JP2011130042A (ja) 撮像装置
JP2013126091A (ja) 撮像装置およびプログラム
JP2005286427A (ja) 撮像装置および合焦方法、制御プログラム、記録媒体
JP2018085659A (ja) 撮像装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJIFILM CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TAKANE, YASUO;REEL/FRAME:022037/0604

Effective date: 20081210

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8