TWI612807B - Methods and apparatus for implementing and using camera devices - Google Patents

Methods and apparatus for implementing and using camera devices Download PDF

Info

Publication number
TWI612807B
TWI612807B TW104144065A TW104144065A TWI612807B TW I612807 B TWI612807 B TW I612807B TW 104144065 A TW104144065 A TW 104144065A TW 104144065 A TW104144065 A TW 104144065A TW I612807 B TWI612807 B TW I612807B
Authority
TW
Taiwan
Prior art keywords
camera
sensor
image
camera module
module
Prior art date
Application number
TW104144065A
Other languages
Chinese (zh)
Other versions
TW201714449A (en
Inventor
拉吉夫 拉羅亞
薩普那A 施洛夫
Original Assignee
萊特股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/US2015/066532 external-priority patent/WO2016100756A1/en
Application filed by 萊特股份有限公司 filed Critical 萊特股份有限公司
Publication of TW201714449A publication Critical patent/TW201714449A/en
Application granted granted Critical
Publication of TWI612807B publication Critical patent/TWI612807B/en

Links

Landscapes

  • Studio Devices (AREA)
  • Cameras In General (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

本發明描述一種具有一感測器之攝像機裝置,該感測器相對於一安裝表面或其他參考表面成一角度安裝。包含成不同角度安裝於該攝像機裝置中之用於光重新引導之鏡之攝像機模組具有具不同旋轉量之感測器。在一些實施例中,無鏡之模組使用未旋轉感測器之攝像機模組,而具有鏡之攝像機模組可使用或可不使用取決於該等模組安裝於該攝像機裝置中之角度而旋轉之感測器。藉由使一些攝像機模組之感測器旋轉,可能由安裝一攝像機模組之角度引入之旋轉可被抵消。在一些實施例中,組合由不同攝像機模組捕捉之影像而無需在計算上使一影像旋轉,此係由於用來捕捉該影像之該攝像機模組中之該感測器之旋轉。 The present invention describes a camera device having a sensor mounted at an angle relative to a mounting surface or other reference surface. A camera module including a mirror for light re-directing mounted in the camera device at different angles has sensors having different amounts of rotation. In some embodiments, the mirrorless module uses a camera module that does not rotate the sensor, and the camera module with the mirror can be rotated with or without depending on the angle at which the modules are mounted in the camera device. Sensor. By rotating the sensors of some camera modules, the rotation that may be introduced by the angle at which a camera module is mounted can be offset. In some embodiments, images captured by different camera modules are combined without the need to computationally rotate an image due to the rotation of the sensor in the camera module used to capture the image.

Description

用於實施並使用攝像機裝置之方法及設備 Method and apparatus for implementing and using a camera device 相關申請案Related application

本申請案係關於2014年12月17日申請之美國專利申請案第62/093,405號及2015年10月6日申請之美國專利申請案第62/238,046號,該兩案之全文以引用方式明確併入本文中。 The present application is related to U.S. Patent Application Serial No. 62/093,405, filed on Dec. 17, 2014, and U.S. Patent Application Serial No. 62/238,046, filed on Incorporated herein.

本申請案係關於攝像機裝置方法及設備,且更特定言之,關於一種具有相對於一參考邊緣或表面或者一安裝表面成一角度安裝之一或多個感測器之攝像機裝置及/或用於使用此一裝置之方法。 The present application relates to a camera device method and apparatus, and more particularly to a camera device having one or more sensors mounted at an angle relative to a reference edge or surface or a mounting surface and/or for The method of using this device.

攝像機常常包含用來捕捉一或多個影像之一矩形感測器。一攝像機之感測器通常包含一矩形感測器區域,其中該感測器區域之一底部邊緣通常平行於攝像機外殼之底部邊緣延伸。該感測器可能且常常安裝於一印刷電路板上,該印刷電路板亦具有其平行於該攝像機之底部延伸之底部邊緣。 Cameras often include a rectangular sensor that captures one or more images. A camera sensor typically includes a rectangular sensor region, wherein one of the bottom edges of the sensor region extends generally parallel to the bottom edge of the camera housing. The sensor may and often is mounted on a printed circuit board that also has a bottom edge that extends parallel to the bottom of the camera.

雖然感測器之底部邊緣平行於一攝像機之底部延伸之感測器之習知佈置適用於諸多應用,但攝像機元件之此一結構設計及配置可限制攝像機設計及/或攝像機模組類型及/或其等安裝配置。 Although the conventional arrangement of the sensor with the bottom edge of the sensor parallel to the bottom of a camera is suitable for many applications, this structural design and configuration of the camera component can limit the camera design and/or camera module type and/or Or its installation configuration.

從實施方案角度看,歸因於空間約束及/或其他原因,將期望允許攝像機模組相對於其中安裝該模組或該等模組之一攝像機之底部成 廣範圍之角度安裝,其中不同模組有時相對於該攝像機裝置之底部成不同角度安裝。 From an implementation perspective, due to space constraints and/or other reasons, it would be desirable to allow the camera module to be mounted relative to the bottom of the camera in which the module or one of the modules is mounted. A wide range of angles are installed in which different modules are sometimes mounted at different angles relative to the bottom of the camera unit.

在使用鏡且成一角度安裝一攝像機模組時,一經捕捉之場景區域之部分將受鏡之使用及安裝該攝像機模組之角度之影響。由於鏡之使用及攝像機安裝,故若實施其中感測器定位為使其邊緣之一者平行於攝像機外殼之底部之習知感測器安裝,則一期望場景區域可能被裁剪。 When a camera module is mounted at an angle using a mirror, portions of the captured scene area will be affected by the use of the mirror and the angle at which the camera module is mounted. Due to the use of the mirror and the camera mounting, a desired scene area may be cropped if a conventional sensor in which the sensor is positioned such that one of its edges is parallel to the bottom of the camera housing is implemented.

鑑於上述內容,應明白,需要攝像機組件(例如,安裝於安裝板上之光學鏈及/或感測器)之新的且改良的結構設計,其促進在一攝像機裝置中包含多個攝像機模組,可能具有相對於攝像機之底部之不同定向且可能具有包含鏡之一或多個攝像機模組。 In view of the foregoing, it will be appreciated that there is a need for new and improved structural designs of camera assemblies (e.g., optical chains and/or sensors mounted on mounting boards) that facilitate the inclusion of multiple camera modules in a camera device. It may have a different orientation relative to the bottom of the camera and may have one or more camera modules including mirrors.

本發明之各種特徵係關於一攝像機裝置中之感測器佈置及/或使用。各種特徵及感測器安裝配置適用於包含多個光學鏈(有時亦稱為攝像機模組)之一攝像機或一攝像機裝置中,其中個別攝像機模組通常包含一單獨感測器,且不同攝像機模組可相對於其中安裝多個攝像機模組之一攝像機裝置殼體之底部成不同角度安裝。 Various features of the present invention relate to sensor placement and/or use in a camera device. Various features and sensor mounting configurations are suitable for use in a camera or a camera device that includes multiple optical chains (sometimes referred to as camera modules), where individual camera modules typically include a single sensor and different cameras The module can be mounted at different angles relative to the bottom of the camera device housing in which one of the plurality of camera modules is mounted.

在各項實施例中,感測器成不同角度安裝於印刷電路板(PCB)上,其考量攝像機模組可安裝於一攝像機裝置中之角度。藉由考量模組將如何安裝於一攝像機殼體中,而針對不同攝像機模組成不同角度安裝感測器,攝像機模組之平坦底部部分可容易地固定至一攝像機中之一安裝板且攝像機模組可相對於該安裝板之底部成期望角度定位,該安裝板之底部通常對應於其中安裝該安裝板及該等攝像機模組之攝像機殼體之底部。因此,雖然可使用具有用作安裝基底之安裝平坦底部之各種矩形攝像機模組,但不同攝像機模組可且有時將具有相對於攝像機模組之底部旋轉以考量攝像機模組將安裝至攝像機之安裝板之 角度之感測器。 In various embodiments, the sensors are mounted at different angles on a printed circuit board (PCB) that takes into account the angle at which the camera module can be mounted in a camera device. By considering how the module will be mounted in a camera housing and mounting the sensor at different angles for different camera modules, the flat bottom portion of the camera module can be easily fixed to one of the cameras and the camera The module can be positioned at a desired angle relative to the bottom of the mounting plate, the bottom of the mounting plate generally corresponding to the bottom of the camera housing in which the mounting plate and the camera modules are mounted. Thus, although various rectangular camera modules having a flat bottom mounted as a mounting base can be used, different camera modules can and sometimes have a rotation relative to the bottom of the camera module to allow for the camera module to be mounted to the camera. Mounting plate Angle sensor.

無鏡之攝像機模組可且有時安裝為使其等之感測器安裝板平行於攝像機模組所固定之攝像機之攝像機模組安裝板延伸。在此等實施例中,無鏡之攝像機模組之背面可固定至感測器安裝板,其中攝像機模組之光軸正對攝像機之正面。 The mirrorless camera module can sometimes be mounted such that its sensor mounting plate extends parallel to the camera module mounting plate of the camera to which the camera module is attached. In such embodiments, the back of the mirrorless camera module can be attached to the sensor mounting plate with the optical axis of the camera module facing the front of the camera.

具有鏡之攝像機模組可且有時確實使其等之感測器垂直於無鏡之攝像機模組之感測器安裝。雖然具有鏡之攝像機模組之感測器可能且有時確實沿其中安裝攝像機模組之攝像機殼體之背面至正面方向延伸,但具有鏡之攝像機模組可相對於攝像機殼體之底部成角度安裝。在一些實施例中,一感測器相對於一安裝表面(例如,其中包含該感測器之攝像機模組之平坦頂部或底部表面)安裝之角度係依據該攝像機模組將相對於其中安裝該攝像機模組之攝像機殼體之底部安裝之角度。在至少一些此等實施例中,包含一鏡之一攝像機模組之安裝表面(例如,頂部或底部表面)固定至不包含一鏡之一攝像機模組之正面或背面所固定之攝像機之安裝板。應明白,孔可包含於該安裝板中以在其中一攝像機模組之正面或頂部用作該攝像機模組安裝表面之情況中允許光穿過。 A camera module with a mirror can, and sometimes does, have its sensors mounted perpendicular to the sensor of the mirrorless camera module. Although the sensor having the mirror camera module may and sometimes does extend along the back side of the camera housing in which the camera module is mounted, the camera module having the mirror may be angled relative to the bottom of the camera housing installation. In some embodiments, the angle at which a sensor is mounted relative to a mounting surface (eg, the flat top or bottom surface of the camera module in which the sensor is included) is based on which the camera module will be mounted relative to the camera module The angle at which the bottom of the camera housing of the camera module is mounted. In at least some such embodiments, a mounting surface (eg, a top or bottom surface) of a camera module including a mirror is affixed to a mounting plate of a camera that is fixed to the front or back of a camera module that does not include a mirror . It will be appreciated that apertures may be included in the mounting plate to allow light to pass through in the event that the front or top of one of the camera modules is used as the camera module mounting surface.

各項實施例尤其適於促進將多個(例如,兩個、三個或更多個)光學鏈併入至其中實體空間可受限及/或出於技術原因,可能期望使不同光學鏈在一攝像機裝置之本體內不同地定向之單個攝像機裝置中。在各項實施例中描述方法及設備,其中包含鏡之攝像機模組可相對於一攝像機之一側表面或底部表面成不同角度安裝。 Embodiments are particularly suitable for facilitating the incorporation of multiple (eg, two, three or more) optical chains into which physical space may be limited and/or for technical reasons, it may be desirable to have different optical chains A single camera device that is oriented differently within the body of a camera device. Methods and apparatus are described in various embodiments in which a camera module including a mirror can be mounted at different angles relative to a side or bottom surface of a camera.

在一些實施例中,一光學鏈(例如,攝像機模組)包含一或多個透鏡及一感測器。在一些實施例中,該感測器佈置於一印刷電路板(PCB)上。該整個模組或該模組之一部分可圍封於一外殼中。安裝於一攝像機模組之外殼中之組件通常但不一定包含一攝像機模組之感測 器及上方安裝該感測器之印刷電路板(PCB)。該感測器及該PCB常常安裝於一攝像機模組外殼(例如,具有一平坦安裝表面之一矩形外殼)中。在一些實施例中,一攝像機模組之平坦安裝表面適於例如使用螺釘、粘合劑或其他緊固件將該攝像機模組固定至一攝像機模組安裝表面,例如可安裝於一攝像機殼體內或用作該攝像機之正面或背面之一鋁製安裝板。 In some embodiments, an optical chain (eg, a camera module) includes one or more lenses and a sensor. In some embodiments, the sensor is disposed on a printed circuit board (PCB). The entire module or a portion of the module can be enclosed in a housing. A component mounted in a housing of a camera module typically, but not necessarily, includes a sensing of a camera module And a printed circuit board (PCB) on which the sensor is mounted. The sensor and the PCB are often mounted in a camera module housing (eg, a rectangular housing having a flat mounting surface). In some embodiments, the flat mounting surface of a camera module is adapted to secure the camera module to a camera module mounting surface, such as by a screw, adhesive or other fastener, for example, in a camera housing or Used as an aluminum mounting plate on the front or back of the camera.

該矩形攝像機模組外殼有時稱為攝像機本體,但此不應與在包含多個攝像機模組之一攝像機之情況中常常容置多個攝像機模組之攝像機殼體相混淆。 The rectangular camera module housing is sometimes referred to as a camera body, but this should not be confused with a camera housing that often houses multiple camera modules in the case of a camera that includes one of the plurality of camera modules.

在一些特定實施例中,該攝像機模組外殼為矩形,其中在一些情況中本體長於其高度。在其他實施例中,當從正面檢視時,該攝像機外殼可為正方形。 In some particular embodiments, the camera module housing is rectangular, with the body being longer than its height in some cases. In other embodiments, the camera housing may be square when viewed from the front.

在此等實施方案中,該攝像機模組外殼通常包含一平坦參考表面,其允許攝像機之一或多個攝像機模組至攝像機本體之一些其他表面之簡易安裝。上方安裝一攝像機感測器本身之PCB可為矩形,然而其他形狀(諸如正方形或橢圓形)係可能的,但用於安裝之多數PCB具有實質上筆直之至少一個邊緣。具有至PCB之一或多個筆直邊緣亦實現簡易安裝。 In such embodiments, the camera module housing typically includes a flat reference surface that allows for easy installation of one or more camera modules of the camera to some other surface of the camera body. The PCB on which the camera sensor itself is mounted may be rectangular, however other shapes (such as square or elliptical) are possible, but most PCBs for mounting have at least one edge that is substantially straight. Easy installation with one or more straight edges to the PCB.

在一些實施例中,用於模組之安裝或定向之一攝像機模組之頂部或基底可用作一參考表面。替代地,一攝像機模組外殼之背面可用作一參考表面。 In some embodiments, the top or substrate of one of the camera modules for mounting or orienting the module can be used as a reference surface. Alternatively, the back of a camera module housing can be used as a reference surface.

可在單個攝像機模組中實施並使用本發明之特徵。因此,一攝像機裝置可包括一個攝像機模組。然而,在各項實施例中,一攝像機裝置包含多個不同攝像機模組,其中該等攝像機模組之至少一些包含鏡且具有具不同定向之感測器。因此,在一些實施例中,一攝像機裝置可包含:一第一攝像機模組,其具有一第一鏡及具有相對於該第一 攝像機模組之基底之一第一定向之一第一感測器;及一第二攝像機模組,其具有一第二鏡及一第二感測器,該第二感測器具有相對於其中定位該第二感測器之第二攝像機模組之安裝表面(例如,基底)之一不同定向。除該第一攝像機模組及該第二攝像機模組外,該攝像機裝置亦可包含無鏡但使感測器經安裝,使得該感測器及該感測器所定位之安裝板具有相同定向,且其中無鏡之攝像機模組之安裝面對應於該攝像機模組之背面或正面而非另一面之攝像機模組。 Features of the invention may be implemented and used in a single camera module. Therefore, a camera device can include a camera module. However, in various embodiments, a camera device includes a plurality of different camera modules, wherein at least some of the camera modules include mirrors and have sensors with different orientations. Therefore, in some embodiments, a camera device can include: a first camera module having a first mirror and having a first a first sensor of the first orientation of the base of the camera module; and a second camera module having a second mirror and a second sensor, the second sensor having a relative One of the mounting surfaces (eg, the substrate) of the second camera module that positions the second sensor is oriented differently. In addition to the first camera module and the second camera module, the camera device may also include a mirrorless sensor but the sensor is mounted such that the sensor and the mounting plate on which the sensor is positioned have the same orientation And the mounting surface of the mirrorless camera module corresponds to the camera module on the back or front side of the camera module instead of the other side.

應明白,在一些實施例中,各類型之多個攝像機模組包含於一攝像機裝置中。藉由使用具有不同感測器定向及鏡之若干組攝像機模組,可支援廣範圍之攝像機模組安裝位置。因此,具有鏡之攝像機模組可容易相對於攝像機殼體之底部成廣範圍之角度安裝,其中攝像機模組中之感測器定向依對應於所使用之攝像機模組安裝角度之一方式變化。 It should be understood that in some embodiments, multiple camera modules of each type are included in a camera device. A wide range of camera module mounting positions can be supported by using a number of camera modules with different sensor orientations and mirrors. Therefore, the camera module with the mirror can be easily installed at a wide range of angles with respect to the bottom of the camera housing, wherein the orientation of the sensor in the camera module varies according to one of the mounting angles of the camera module used.

在下文詳細描述中論述及描述眾多額外特徵及實施例以及變動。 Numerous additional features, embodiments, and variations are discussed and described in the following detailed description.

100‧‧‧攝像機裝置 100‧‧‧Camera device

102‧‧‧顯示裝置 102‧‧‧ display device

104‧‧‧發光器模組/照明模組/LED模組 104‧‧‧ illuminator module / lighting module / LED module

106‧‧‧輸入裝置/按鈕 106‧‧‧Input device/button

108‧‧‧記憶體 108‧‧‧ memory

110‧‧‧處理器 110‧‧‧ processor

112‧‧‧I/O介面 112‧‧‧I/O interface

114‧‧‧無線/有線介面 114‧‧‧Wireless/wired interface

116‧‧‧匯流排 116‧‧‧ Busbar

118‧‧‧資料處理模組 118‧‧‧Data Processing Module

120‧‧‧資料記憶體/資料/資訊 120‧‧‧Data Memory/Data/Information

122‧‧‧加速度計模組 122‧‧‧Accelerometer Module

124‧‧‧加速度計1 124‧‧‧Accelerometer 1

126‧‧‧加速度計2 126‧‧‧Accelerometer 2

128‧‧‧加速度計3 128‧‧‧Accelerometer 3

130‧‧‧光學鏈 130‧‧‧Optical chain

131‧‧‧攝像機模組 131‧‧‧Camera module

132‧‧‧選用之自動聚焦控制器 132‧‧‧Selected auto focus controller

133‧‧‧攝像機模組 133‧‧‧Camera module

134‧‧‧自動聚焦驅動器總成 134‧‧‧Automatic Focus Driver Assembly

140‧‧‧縮放控制器/縮放控制模組 140‧‧‧Zoom Controller/Zoom Control Module

148‧‧‧輸入狀態偵測模組 148‧‧‧Input status detection module

150‧‧‧曝光及讀出控制器/滾動快門控制器 150‧‧‧Exposure and readout controller/rolling shutter controller

152‧‧‧光控制裝置 152‧‧‧Light control device

180‧‧‧硬體模組總成 180‧‧‧ hardware module assembly

192‧‧‧3軸陀螺儀/陀螺儀模組 192‧‧‧3 axis gyro/gyro module

194‧‧‧陀螺儀 194‧‧‧Gyro

196‧‧‧陀螺儀 196‧‧‧Gyro

198‧‧‧陀螺儀 198‧‧‧Gyro

200‧‧‧攝像機裝置 200‧‧‧Camera device

202‧‧‧透視圖/攝像機裝置/攝像機 202‧‧‧Perspective/Camera Device/Camcorder

203‧‧‧正面/正面部分/前表面 203‧‧‧Front/front part/front surface

204‧‧‧背面/後表面 204‧‧‧Back/back surface

205‧‧‧殼體 205‧‧‧Shell

206‧‧‧深度 206‧‧‧depth

207‧‧‧底部 207‧‧‧ bottom

210‧‧‧圖式 210‧‧‧ schema

300‧‧‧攝像機裝置 300‧‧‧Camera device

302‧‧‧光學鏈/經旋轉攝像機模組 302‧‧‧Optical Chain/Rotating Camera Module

304‧‧‧光學鏈/攝像機模組 304‧‧‧Optical chain/camera module

306‧‧‧光學鏈 306‧‧‧ optical chain

308‧‧‧攝像機模組 308‧‧‧ camera module

310‧‧‧光學鏈/攝像機模組 310‧‧‧Optical chain/camera module

312‧‧‧光學鏈/攝像機模組 312‧‧‧Optical chain/camera module

314‧‧‧攝像機模組 314‧‧‧ camera module

316‧‧‧光學鏈/攝像機模組 316‧‧‧Optical chain/camera module

318‧‧‧攝像機模組 318‧‧‧Camera module

320‧‧‧光學鏈/攝像機模組 320‧‧‧Optical chain/camera module

322‧‧‧光學鏈 322‧‧‧Optical chain

324‧‧‧攝像機模組 324‧‧‧ camera module

326‧‧‧參考攝像機模組/光學鏈/前向攝像機模組 326‧‧‧Reference camera module/optical chain/forward camera module

328‧‧‧光學鏈/前向攝像機模組 328‧‧‧Optical Chain/Forward Camera Module

330‧‧‧光學鏈/前向攝像機模組 330‧‧‧Optical Chain/Forward Camera Module

332‧‧‧光學鏈/前向攝像機模組 332‧‧‧Optical Chain/Forward Camera Module

334‧‧‧光學鏈/前向攝像機模組 334‧‧‧Optical Chain/Forward Camera Module

400‧‧‧總成/攝像機模組 400‧‧‧assembly/camera module

401‧‧‧光軸 401‧‧‧ optical axis

402‧‧‧透鏡鏡筒總成 402‧‧‧ lens barrel assembly

403‧‧‧開口 403‧‧‧ openings

404‧‧‧感測器總成 404‧‧‧Sensor assembly

406‧‧‧透鏡 406‧‧‧ lens

408‧‧‧透鏡 408‧‧‧ lens

410‧‧‧感測器安裝板/印刷電路板(PCB) 410‧‧‧Sensor Mounting Board/Printed Circuit Board (PCB)

411‧‧‧攝像機模組外殼 411‧‧‧Camera module housing

412‧‧‧感測器區域/感測器 412‧‧‧Sensor area/sensor

414‧‧‧矩形區域/矩形感測器區域/光學作用影像感測區域/感測器之光學作用區域/光學作用部分 414‧‧‧Rectangular area/rectangular sensor area/optical action image sensing area/optical effect area/optical action part

420‧‧‧線 420‧‧‧ line

421‧‧‧後表面/背面 421‧‧‧Back surface/back

423‧‧‧底部 423‧‧‧ bottom

425‧‧‧正面 425‧‧‧ positive

427‧‧‧頂部 427‧‧‧ top

502‧‧‧較長側 502‧‧‧Longer side

502'‧‧‧較長側 502'‧‧‧Longer side

504‧‧‧短側 504‧‧‧ Short side

504'‧‧‧短側 504'‧‧‧ Short side

600‧‧‧圖式 600‧‧‧ pattern

602‧‧‧頂部側 602‧‧‧ top side

604‧‧‧底部(基底)側/基底 604‧‧‧ bottom (substrate) side / base

700‧‧‧光學鏈/攝像機模組 700‧‧‧Optical chain/camera module

701‧‧‧濾光器安裝座 701‧‧‧Filter Mount

702‧‧‧感測器 702‧‧‧ sensor

703‧‧‧濾光器 703‧‧‧Filter

704‧‧‧第二圓柱形模組部分/鏡筒部分 704‧‧‧Second cylindrical module part / barrel section

706‧‧‧第一圓柱形模組部分/鏡筒部分 706‧‧‧First cylindrical module part / barrel section

708‧‧‧鏡鉸鏈 708‧‧‧Mirror hinge

710‧‧‧光重新引導裝置/鏡 710‧‧‧Light redirector/mirror

712‧‧‧外開口 712‧‧‧Outside opening

714‧‧‧透鏡驅動器 714‧‧‧ lens driver

715‧‧‧感測器安裝板 715‧‧‧Sensor Mounting Plate

716‧‧‧鏡驅動器(MD) 716‧‧‧Mirror Driver (MD)

720‧‧‧鏡總成 720‧‧‧Mirror assembly

722‧‧‧光學透鏡總成/光學元件總成 722‧‧‧Optical lens assembly / optical component assembly

724‧‧‧感測器總成 724‧‧‧Sensor assembly

800‧‧‧圖式/攝像機模組 800‧‧‧Graphic/Camera Module

801‧‧‧X軸 801‧‧‧X axis

802‧‧‧鏡總成/鏡 802‧‧ Mirror assembly / mirror

803‧‧‧Y軸 803‧‧‧Y axis

804‧‧‧透鏡鏡筒總成 804‧‧‧ lens barrel assembly

806‧‧‧感測器總成 806‧‧‧Sensor assembly

808‧‧‧光軸 808‧‧‧ optical axis

820‧‧‧鏡總成/鏡 820‧‧‧Mirror assembly/mirror

822‧‧‧透鏡鏡筒總成 822‧‧‧ lens barrel assembly

824‧‧‧感測器總成 824‧‧‧Sensor assembly

826‧‧‧光軸 826‧‧‧ optical axis

900‧‧‧總成 900‧‧‧assembly

901‧‧‧光軸 901‧‧‧ optical axis

902‧‧‧透鏡鏡筒總成 902‧‧‧ lens barrel assembly

903‧‧‧開口 903‧‧‧ openings

904‧‧‧感測器總成 904‧‧‧Sensor assembly

906‧‧‧透鏡 906‧‧‧ lens

908‧‧‧透鏡 908‧‧‧ lens

910‧‧‧感測器安裝板/印刷電路板(PCB) 910‧‧‧Sensor Mounting Board/Printed Circuit Board (PCB)

912‧‧‧感測器區域 912‧‧‧Sensor area

914‧‧‧矩形區域/光學作用影像感測區域/感測器之光學作用區域/感測器矩形光學作用區域 914‧‧‧Rectangular area/optical action image sensing area/sensor optical area/sensor rectangular optical area

920‧‧‧線 920‧‧‧ line

1000‧‧‧圖式 1000‧‧‧ schema

1002‧‧‧較長側 1002‧‧‧Longer side

1002'‧‧‧較長側 1002'‧‧‧Longer side

1004‧‧‧短側 1004‧‧‧ Short side

1004'‧‧‧短側 1004'‧‧‧ Short side

1010‧‧‧頂部側 1010‧‧‧ top side

1010'‧‧‧基底 1010'‧‧‧Base

1012‧‧‧底部(基底)側 1012‧‧‧ bottom (substrate) side

1100‧‧‧圖式 1100‧‧‧ schema

1102‧‧‧對角線 1102‧‧‧ diagonal

1202‧‧‧圖式 1202‧‧‧ schema

1203‧‧‧受關注參考場景/受關注場景區域 1203‧‧‧Received Reference Scene/Attention Scene Area

1204‧‧‧圖式 1204‧‧‧ schema

1205‧‧‧參考影像 1205‧‧‧Reference image

1206‧‧‧圖式 1206‧‧‧ schema

1207‧‧‧影像區域 1207‧‧‧Image area

1208‧‧‧圖式 1208‧‧‧ schema

1209‧‧‧影像 1209‧‧ images

1300‧‧‧方法 1300‧‧‧ method

1302‧‧‧步驟 1302‧‧‧Steps

1304‧‧‧步驟 1304‧‧‧Steps

1306‧‧‧步驟 1306‧‧‧Steps

1308‧‧‧步驟 1308‧‧‧Steps

1310‧‧‧步驟 1310‧‧‧Steps

1312‧‧‧步驟 1312‧‧‧Steps

1314‧‧‧步驟 1314‧‧‧Steps

1315‧‧‧步驟 1315‧‧‧Steps

圖1為根據本發明之一項實施例實施之一例示性設備(例如,一攝像機裝置)之一方塊圖。 1 is a block diagram of an exemplary device (e.g., a camera device) implemented in accordance with an embodiment of the present invention.

圖2繪示包含複數個光學鏈(例如,攝像機模組)之一例示性攝像機裝置之一透視圖。 2 is a perspective view of one exemplary camera device including a plurality of optical chains (eg, camera modules).

圖3繪示根據一些實施例之在一項實施例中用來實施一攝像機裝置之光學鏈(例如,攝像機模組)之一配置。 3 illustrates one configuration of an optical chain (eg, a camera module) for implementing a camera device in one embodiment, in accordance with some embodiments.

圖4繪示在一些實施例中用於一例示性攝像機模組(例如,光學鏈)中之組件之一總成,該攝像機模組用於一攝像機裝置中。 4 illustrates an assembly of components in an exemplary camera module (eg, an optical chain) for use in a camera device in some embodiments.

圖5繪示更詳細地展示圖4中所展示之總成及一感測器總成之一透視圖之一圖式。 FIG. 5 is a diagram showing a perspective view of one of the assembly and a sensor assembly shown in FIG. 4 in more detail.

圖6繪示更詳細地展示一感測器安裝板上之一例示性感測器之配置之一圖式。 6 is a diagram showing one of the configurations of an exemplary sensor on a sensor mounting plate in more detail.

圖7展示用於各項例示性實施例中之一光學鏈,例如,攝像機模組。 Figure 7 shows an optical chain, such as a camera module, for use in various exemplary embodiments.

圖8為繪示一例示性攝像機裝置中之兩個例示性攝像機模組之配置之一圖式。 FIG. 8 is a diagram showing one configuration of two exemplary camera modules in an exemplary camera device.

圖9繪示在一些實施例中用於一例示性攝像機模組(例如,光學鏈)中之組件之一總成,該攝像機模組用於一攝像機裝置中。 9 illustrates an assembly for use in an exemplary camera module (eg, an optical chain) in some embodiments for use in a camera device.

圖10為繪示一影像感測器之光學作用區域相對於一感測器安裝板之對準之一圖式。 FIG. 10 is a diagram showing the alignment of an optically active area of an image sensor with respect to a sensor mounting plate.

圖11繪示展示一項例示性實施例中之感測器安裝板上之一例示性感測器針對用於一些實施例中之角度「θ」之一特定值之配置之一圖式。 11 is a diagram showing one of the configurations of an exemplary sensor on a sensor mounting plate in an exemplary embodiment for a particular value of one of the angles "θ" used in some embodiments.

圖12包含用來促進對本發明之一理解之各種圖式。 Figure 12 contains various figures for facilitating an understanding of one of the present inventions.

圖13繪示本發明之一例示性方法。 Figure 13 illustrates an exemplary method of the present invention.

圖1繪示根據本發明之一項例示性實施例實施之一例示性攝像機裝置100,諸如數位攝像機、具有攝像機功能之筆記本或具有攝像機功能之行動電話。雖然攝像機裝置100包含複數個攝像機模組131、133,但取決於實施例,該攝像機裝置可為單個攝像機模組131或133。 1 illustrates an exemplary camera device 100, such as a digital camera, a notebook with a camera function, or a mobile phone with camera functionality, in accordance with an illustrative embodiment of the present invention. Although the camera device 100 includes a plurality of camera modules 131, 133, the camera device may be a single camera module 131 or 133, depending on the embodiment.

然而,為了促進對本發明及使用具有不同定向(例如,相對於一參考表面或邊緣成不同角度旋轉)之感測器之益處之一領會,將在呈包含多個攝像機模組131、133之一攝像機之形式之一例示性攝像機裝置之內容脈絡中論述各種特徵。 However, in order to facilitate one of the benefits of the present invention and the use of sensors having different orientations (eg, rotating at different angles relative to a reference surface or edge), one of the plurality of camera modules 131, 133 will be included Various features are discussed in the context of an exemplary camera device in the form of a camera.

在一些實施例中,攝像機裝置100為一可攜式裝置。在其他實施 例中,攝像機裝置100為一固定裝置,諸如一壁裝式攝像機。攝像機裝置100包含多個光學鏈(例如,攝像機模組),在一些實施例中,該等光學鏈之一或多者具有一經旋轉感測器,其中另一攝像機模組之一感測器未旋轉。如下文將論述,攝像機模組131、133之一或多者可包含一鏡。攝像機模組131、133通常安裝至一安裝表面,例如,用作一或多個攝像機組件之一安裝板之剛性金屬板。該安裝板可包含在該安裝板定位於攝像機100之正面處時允許光進入一或多個光學鏈之透鏡之孔。 In some embodiments, camera device 100 is a portable device. In other implementations In the example, camera device 100 is a stationary device such as a wall mounted camera. The camera device 100 includes a plurality of optical chains (eg, camera modules). In some embodiments, one or more of the optical chains have a rotated sensor, wherein one of the other camera modules is not Rotate. As will be discussed below, one or more of the camera modules 131, 133 can include a mirror. The camera modules 131, 133 are typically mounted to a mounting surface, such as a rigid metal plate that serves as one of the one or more camera assemblies. The mounting plate can include apertures that allow light to enter the lens of one or more optical chains when the mounting plate is positioned at the front of the camera 100.

圖1依展示裝置100之各種元件之間的連接之方塊圖形式繪示攝像機裝置100。例示性攝像機裝置100包含一顯示裝置102、一發光器模組104、一輸入裝置106、一輸入狀態偵測模組148、一曝光及讀出控制器150(例如,一滾動快門控制器150)、一光控制裝置152、記憶體108、一處理器110、一硬體模組總成180、一無線及/或有線介面114(例如,一蜂巢式介面、一WIFI介面及/或一USB介面)、一I/O介面112、一加速度計模組122、3軸陀螺儀192及一匯流排116,其等安裝於由指向參考數字100的線所碰觸之矩形框表示之一外殼中。發光器模組104包含可為LED(發光二極體)之發光元件或可分別地經控制使得所有發光元件無須同時開啟之其他類型之發光元件。輸入裝置106可為且在一些實施例中為例如鍵盤、觸控螢幕或可用於輸入資訊、資料及/或指令之類似裝置。加速度計模組122包含排列於垂直軸上以提供一3軸加速度計模組之加速度計1 124、加速度計2 126及加速度計3 128。因此,加速度計模組122可沿3個獨立軸進行量測。類似地,3軸陀螺儀192(包含194、196及198)可沿3個不同軸之各者量測旋轉。加速度計模組122及陀螺儀模組192之輸出可且在一些實施例中隨著加速度計及陀螺儀輸出之變更而受監控,該加速度計及陀螺儀輸出由處理器110及/或縮放控制模組(例如,縮放控制器140)隨時間推移而 解譯並檢查以偵測指示沿一或多個方向之運動之加速度之變更。在一些實施例中,輸入裝置106包含可用來啟用或停用攝像機縮放功能之至少一個縮放控制按鈕。在一些此等實施例中,在縮放控制按鈕處於一按壓狀態時,啟用攝像機縮放功能,而在按鈕處於一未按壓狀態時,停用攝像機縮放功能。輸入狀態偵測模組148經結構設計以偵測輸入裝置(例如,縮放控制按鈕)之狀態,以偵測該按鈕係處於一按壓狀態或未按壓狀態。在一些實施例中,在攝像機裝置100中存在一狀態暫存器,該狀態暫存器包含指示由狀態偵測模組148偵測之縮放控制按鈕之狀態(例如,縮放控制按鈕是否處於指示啟用縮放之按壓狀態或縮放控制按鈕是否處於指示停用縮放之未按壓狀態)之一位元。 1 shows a camera device 100 in the form of a block diagram of the connections between the various components of the display device 100. The exemplary camera device 100 includes a display device 102, an illuminator module 104, an input device 106, an input state detection module 148, and an exposure and readout controller 150 (eg, a rolling shutter controller 150). a light control device 152, a memory 108, a processor 110, a hardware module assembly 180, a wireless and/or wired interface 114 (eg, a cellular interface, a WIFI interface, and/or a USB interface) An I/O interface 112, an accelerometer module 122, a 3-axis gyroscope 192, and a busbar 116, which are mounted in a housing represented by a rectangular frame that is touched by a line pointing to reference numeral 100. The illuminator module 104 includes illuminating elements that can be LEDs (light emitting diodes) or other types of illuminating elements that can be individually controlled such that all of the illuminating elements do not need to be turned on at the same time. Input device 106 can be, and in some embodiments is, a keyboard, a touch screen, or the like that can be used to input information, data, and/or instructions. The accelerometer module 122 includes an accelerometer 1 124, an accelerometer 2 126, and an accelerometer 3 128 arranged on a vertical axis to provide a 3-axis accelerometer module. Thus, the accelerometer module 122 can be measured along three independent axes. Similarly, a 3-axis gyroscope 192 (comprising 194, 196, and 198) can measure rotation along each of three different axes. The outputs of the accelerometer module 122 and the gyro module 192 can, in some embodiments, be monitored as the accelerometer and gyroscope outputs are changed, the accelerometer and gyroscope outputs being controlled by the processor 110 and/or zooming Modules (eg, zoom controller 140) over time Interpreting and checking to detect changes in acceleration indicative of motion in one or more directions. In some embodiments, input device 106 includes at least one zoom control button that can be used to enable or disable the camera zoom function. In some such embodiments, the camera zoom function is enabled when the zoom control button is in a pressed state, and the camera zoom function is disabled when the button is in an unpressed state. The input state detection module 148 is configured to detect the state of the input device (eg, the zoom control button) to detect that the button is in a pressed state or an uncompressed state. In some embodiments, there is a status register in the camera device 100, the status register including a status indicating a zoom control button detected by the status detection module 148 (eg, whether the zoom control button is instructed to enable One of the bits of the zoomed press state or the zoom control button is in an unpressed state indicating that the zoom is disabled.

顯示裝置102可為且在一些實施例中為用來顯示影像、視訊、關於攝像機裝置之結構設計之資訊及/或在攝像機裝置上執行之資料處理之狀態之一觸敏螢幕。在其中顯示裝置102為一觸控螢幕之情況中,顯示裝置102用作一額外輸入裝置及/或單獨輸入裝置(例如,按鈕106)之一替代物。該顯示裝置可安裝於一攝像機殼體之背面中,該攝像機殼體用作其中安裝攝像機組件之一殼。用來指示該攝像機裝置之參考數字100亦可用來指示該攝像機殼體,此係因為其為其中安裝在圖1中依方塊形式展示之其他組件之殼體。如在一些實施例中將論述,可藉由按壓一縮放控制感測器(例如,一觸控感測器)來控制縮放操作。在一些實施例中,在攝像機使用者觸控縮放控制感測器時,啟用縮放功能。例如,觸控感測器上之一手指啟動/啟用縮放功能。I/O介面112將顯示器102及輸入裝置106耦合至匯流排116且介接於可經由匯流排116通信及相互作用之顯示器102、輸入裝置106與攝像機之其他元件之間。 Display device 102 can be, and in some embodiments is, a touch sensitive screen for displaying images, video, information regarding the structural design of the camera device, and/or data processing performed on the camera device. In the case where display device 102 is a touch screen, display device 102 acts as an alternative to an additional input device and/or a separate input device (eg, button 106). The display device can be mounted in the back of a camera housing that serves as a housing in which the camera assembly is mounted. Reference numeral 100 used to indicate the camera device can also be used to indicate the camera housing, as it is a housing in which other components shown in block form are mounted in FIG. As will be discussed in some embodiments, the zoom operation can be controlled by pressing a zoom control sensor (eg, a touch sensor). In some embodiments, the zoom function is enabled when the camera user touches the zoom control sensor. For example, one of the touch sensors activates/enables the zoom function. The I/O interface 112 couples the display 102 and the input device 106 to the busbar 116 and interfaces between the display 102 that can communicate and interact via the busbar 116, the input device 106, and other components of the camera.

除耦合至I/O介面112外,匯流排116亦耦合至記憶體108、處理器110、一選用之自動聚焦控制器132、無線及/或有線介面114、一縮放 控制模組140及本文中亦稱為攝像機模組之複數個光學鏈130,例如,X個光學鏈。在一些實施例中,X為大於2之一整數,例如,3、4、7或一更大值,此係取決於特定實施例。複數個攝像機模組130可使用本申請案中所述之各種攝像機模組及/或配置之任一者來實施。例如,在一些實施例中,攝像機裝置100係使用具有如圖9至圖11中所展示之經旋轉感測器之一組攝像機模組來實施。在一些實施例中,攝像機裝置100係使用圖3中所展示之類型之攝像機模組來實施,其中一些攝像機模組具有如參考圖9至圖11進一步展示及論述之經旋轉感測器,而其他攝像機模組具有如參考圖4至圖6進一步展示及論述之未旋轉感測器。由複數個光學鏈130中之個別光學鏈捕捉之影像可且在各項實施例中儲存於記憶體108中,例如作為資料/資訊120之部分且由處理器110處理,例如以產生一或多個合成影像。 In addition to being coupled to the I/O interface 112, the bus 116 is also coupled to the memory 108, the processor 110, an optional auto focus controller 132, a wireless and/or wired interface 114, a zoom The control module 140 and a plurality of optical chains 130, also referred to herein as camera modules, are, for example, X optical chains. In some embodiments, X is an integer greater than 2, such as 3, 4, 7, or a larger value, depending on the particular embodiment. A plurality of camera modules 130 can be implemented using any of the various camera modules and/or configurations described in this application. For example, in some embodiments, camera device 100 is implemented using a camera module having one of the rotated sensors as shown in Figures 9-11. In some embodiments, camera device 100 is implemented using a camera module of the type shown in FIG. 3, some of which have rotated sensors as further shown and discussed with respect to FIGS. 9-11, and Other camera modules have unrotated sensors as further shown and discussed with respect to Figures 4-6. Images captured by individual optical chains of the plurality of optical chains 130 can be stored in memory 108 in various embodiments, for example as part of data/information 120 and processed by processor 110, for example to generate one or more A composite image.

X個攝像機模組131至133可且在各項實施例中確實包含具有不同焦距之攝像機模組。可依一給定焦距提供多個攝像機模組。一些攝像機模組可包含鏡,而其他攝像機模組可不包含鏡,如下文將參考圖3進一步論述。如下文將論述,取決於個別攝像機模組安裝於攝像機裝置100中之角度,不同攝像機模組可具有相對於個別攝像機模組之安裝表面的不同旋轉或定向。攝像機裝置100將被視為例示性,且多種不同類型之攝像機裝置可實施並使用本發明之一或多個特徵。 The X camera modules 131 to 133 can, and in various embodiments, indeed include camera modules having different focal lengths. Multiple camera modules can be provided at a given focal length. Some camera modules may include mirrors, while other camera modules may not include mirrors, as discussed further below with respect to FIG. As will be discussed below, different camera modules may have different rotations or orientations relative to the mounting surface of the individual camera modules depending on the angle at which the individual camera modules are mounted in the camera device 100. Camera device 100 will be considered exemplary, and many different types of camera devices may implement and use one or more features of the present invention.

同時或在一給定時間週期期間捕捉之來自不同攝像機模組之影像可經組合以產生一合成影像,例如,具有比由攝像機模組131、133之單一者捕捉之一個別影像更佳的解析度、頻率含量及/或光範圍之一影像。多個經捕捉之影像及/或合成影像可且在一些實施例中經處理以形成視訊,例如,對應於一時間週期之一系列影像。介面114將攝像機裝置100之內部組件耦合至一外部網路(例如,網際網路)及/或一或多個其他裝置(例如,記憶體或獨立電腦)。經由介面114,攝像 機裝置110可且確實輸出資料,例如,經捕捉之影像、經產生之合成影像及/或經產生之視訊。該輸出可至一網路或另一外部裝置用於處理、儲存及/或待共用。經捕捉之影像資料、經產生之合成影像及/或視訊可作為輸入資料提供至另一裝置用於進一步處理及/或經發送以儲存於例如外部記憶體、一外部裝置或一網路中。攝像機裝置100之介面114可且在一些例項中耦合至一電腦,使得可在外部電腦上處理影像資料。 Images captured from different camera modules simultaneously or captured during a given time period can be combined to produce a composite image, for example, having better resolution than capturing individual images from a single camera module 131, 133. An image of degree, frequency content, and/or light range. The plurality of captured images and/or composite images may, in some embodiments, be processed to form a video, for example, corresponding to a series of images over a period of time. Interface 114 couples internal components of camera device 100 to an external network (eg, the Internet) and/or one or more other devices (eg, a memory or a stand-alone computer). Via the interface 114, videography The device 110 can and does output data, such as captured images, resulting synthetic images, and/or generated video. The output can be to a network or another external device for processing, storage, and/or sharing. The captured image data, the resulting synthetic image and/or video may be provided as input to another device for further processing and/or transmission for storage, for example, in an external memory, an external device, or a network. The interface 114 of the camera device 100 can, and in some instances, be coupled to a computer such that the image material can be processed on an external computer.

在一些實施例中,照明模組104包含可依一受控方式進行照射以用作攝像機閃光燈之複數個發光元件(例如,LED),其中例如基於滾動快門操作及/或曝光時間依一同步方式按群組或個別地控制LED。出於論述之目的,模組104將稱為LED模組,此係因為在例示性實施例中,LED用作發光裝置,但如上文所論述,本發明不限於LED實施例且亦可使用其他發光源。在一些實施例中,LED模組104包含一發光元件(例如,LED)陣列。在一些實施例中,LED模組104中之發光元件經配置,使得可依與滾動快門操作同步之方式照射各個別LED及/或一LED群組。在一些但並非所有實施例中,循序地照射發光元件,使得在不同時間照射一區域之不同部分,使得在影像捕捉期間無需持續照明整個區域。雖然所有照明元件未在涉及一感測器之整組像素元件之讀出之一影像捕捉操作之整個持續時間保持開啟,但由於發光元件之照明與滾動快門操作之同步,將照射在一給定時間由於一滾動快門之使用而使其影像被捕捉之區域之部分(例如,掃描區域)。因此,在一些實施例中,各種發光元件經控制以在不同時間基於曝光時間及一感測器之哪個部分將用來在一給定時間捕捉一影像之一部分進行照射。在一些實施例中,LED模組104中之發光元件包含複數組發光元件,各組發光元件對應於它照射且由影像感測器之一不同部分捕捉之一不同影像區域。透鏡可且在一些實施例中用來將光從不同發光元件 引導至將由攝像機透過使用一或多個攝像機模組捕捉之不同場景區域。 In some embodiments, the illumination module 104 includes a plurality of illumination elements (eg, LEDs) that can be illuminated in a controlled manner for use as a camera flash, wherein, for example, based on rolling shutter operation and/or exposure time in a synchronized manner Control LEDs by group or individually. For purposes of discussion, the module 104 will be referred to as an LED module, as the LEDs are used as illumination devices in the exemplary embodiments, but as discussed above, the invention is not limited to LED embodiments and other Light source. In some embodiments, LED module 104 includes an array of light emitting elements (eg, LEDs). In some embodiments, the light-emitting elements in the LED module 104 are configured such that individual LEDs and/or a group of LEDs can be illuminated in synchronization with the rolling shutter operation. In some but not all embodiments, the illuminating elements are sequentially illuminated such that different portions of an area are illuminated at different times such that there is no need to continuously illuminate the entire area during image capture. Although all of the illumination elements are not turned on for the entire duration of one of the image capture operations of the entire set of pixel elements involved in a sensor, illumination will be illuminated at a given time due to illumination of the illumination element in synchronization with the rolling shutter operation. Time is the portion of the area in which the image is captured due to the use of a rolling shutter (eg, the scanning area). Thus, in some embodiments, the various illuminating elements are controlled to illuminate at a different time based on the exposure time and which portion of the sensor will be used to capture a portion of an image at a given time. In some embodiments, the light-emitting elements in the LED module 104 comprise a plurality of arrays of light-emitting elements, each set of light-emitting elements corresponding to a different image area that it illuminates and is captured by a different portion of the image sensor. Lenses can, and in some embodiments for, illuminating light from different illuminating elements Leads to different scene areas that will be captured by the camera through the use of one or more camera modules.

雖然各攝像機模組之外開口可受具有一光學功率之一透鏡保護,但在一些實施例中,使用一塊扁平玻璃或塑膠來覆蓋具有較少或無集中或分散光射線特性之一攝像機模組之開口。此塊扁平玻璃或塑膠可具有零或接近零的光學功率或光分散效應,但出於論述例示性攝像機裝置之目的,仍將稱為透鏡。 While the outer opening of each camera module can be protected by a lens having an optical power, in some embodiments, a flat glass or plastic is used to cover one of the camera modules with less or no concentrated or scattered light ray characteristics. The opening. This piece of flat glass or plastic may have an optical power or light dispersion effect of zero or near zero, but will still be referred to as a lens for the purposes of discussing an exemplary camera device.

滾動快門控制器150為控制一或多個影像感測器之不同部分在不同時間之讀出之一電子快門。一次讀取一列像素值,且按次序讀取各列以讀取各影像感測器。如下文將論述,在一些實施例中,控制由不同感測器捕捉之影像之讀出,使得該等感測器依與在一些實施例中多個感測器同時捕捉相同影像區域同步之方式捕捉一受關注場景區域(有時亦稱為受關注影像區域)。雖然在多數實施例中使用一電子滾動快門,但在一些實施例中可使用一機械滾動快門。 Rolling shutter controller 150 reads one of the electronic shutters at different times to control different portions of one or more image sensors. A column of pixel values is read at a time, and the columns are read in order to read each image sensor. As will be discussed below, in some embodiments, the reading of images captured by different sensors is controlled such that the sensors are synchronized to capture the same image area simultaneously with multiple sensors in some embodiments. Capture an area of interest (sometimes referred to as the image area of interest). While an electronic rolling shutter is used in most embodiments, a mechanical rolling shutter can be used in some embodiments.

光控制裝置152經結構設計以依與滾動快門控制器150之操作同步之方式控制發光元件(例如,包含於LED模組140中)。在一些實施例中,光控制裝置152進一步經結構設計以在一第三時間週期期間控制對應於一第N個影像區域之第N組發光元件以輸出光,該第N個時間週期基於滾動快門之時序而判定且為感測器之一第N個部分經曝光用於影像捕捉之一時間週期,N為對應於由該滾動快門用來完成總影像區域之一個完整讀出之時間週期總數之一整數值。 The light control device 152 is structurally designed to control the light emitting elements (eg, included in the LED module 140) in synchronization with the operation of the rolling shutter controller 150. In some embodiments, the light control device 152 is further configured to control the Nth group of light emitting elements corresponding to an Nth image region to output light during a third time period, the Nth time period being based on a rolling shutter The timing is determined and is the Nth portion of the sensor exposed for one time period of image capture, and N is the total number of time periods corresponding to a complete read by the rolling shutter to complete the total image area. An integer value.

加速度計模組122包含複數個加速度計,包含加速度計1 124、加速度計2 126及加速度計3 128。該等加速度計之各者經結構設計以偵測沿一給定方向之攝像機加速度。儘管三個加速度計124、126及128被展示為包含於加速度計模組122中,但應明白,在一些實施例中可使用三個以上加速度計。類似地,陀螺儀模組192包含3個陀螺儀 194、196及198,各軸一個陀螺儀,其適用於其中通常使用攝像機裝置之三維真實世界環境中。監控由一加速度計沿一給定方向偵測之攝像機加速度。指示攝像機運動之加速度及/或加速度變更及旋轉經監控並經處理以偵測一或多個運動方向,例如,正向攝像機運動、反向攝像機運動等。如下文所論述,指示攝像機運動之加速度/旋轉可用來控制縮放操作及/或在一些情況中提供至一攝像機安裝座,其可接著採取以下動作:諸如使一攝像機安裝座旋轉或使一攝像機支撐件旋轉以幫助穩定攝像機。 The accelerometer module 122 includes a plurality of accelerometers including an accelerometer 1 124, an accelerometer 2 126, and an accelerometer 3 128. Each of the accelerometers is structurally designed to detect camera acceleration along a given direction. Although three accelerometers 124, 126, and 128 are shown as being included in accelerometer module 122, it should be understood that more than three accelerometers may be used in some embodiments. Similarly, the gyro module 192 includes three gyroscopes. 194, 196, and 198, a gyroscope for each axis, which is suitable for use in a three-dimensional real world environment in which a camera device is typically used. Monitor camera acceleration detected by an accelerometer in a given direction. Acceleration and/or acceleration changes and rotations indicative of camera motion are monitored and processed to detect one or more directions of motion, such as forward camera motion, reverse camera motion, and the like. As discussed below, the acceleration/rotation indicating camera motion can be used to control the zoom operation and/or in some cases to a camera mount, which can then take the following actions: such as rotating a camera mount or supporting a camera Rotate to help stabilize the camera.

攝像機裝置100可包含且在一些實施例中確實包含一自動聚焦控制器132及/或自動聚焦驅動器總成134。在一些實施例中,自動聚焦驅動器總成134實施為一透鏡驅動器。自動聚焦控制器132在至少一些自動聚焦實施例中存在但將在定焦實施例中省略。自動聚焦控制器132控制用來實現一期望(例如,使用者指示)聚焦之一或多個光學鏈中之至少一個透鏡位置之調整。在其中個別驅動器總成包含於各光學鏈中之情況中,自動聚焦控制器132可驅動各種光學鏈之自動聚焦驅動器以聚焦於相同目標上。縮放控制模組140經結構設計以回應於使用者輸入而執行一縮放操作。 Camera device 100 may include, and in some embodiments does include, an auto focus controller 132 and/or auto focus driver assembly 134. In some embodiments, the autofocus driver assembly 134 is implemented as a lens driver. Autofocus controller 132 is present in at least some of the autofocus embodiments but will be omitted in the fixed focus embodiment. The auto focus controller 132 controls the adjustment of at least one of the one or more optical chains used to achieve a desired (eg, user indication) focus. In the case where individual driver assemblies are included in each optical chain, autofocus controller 132 can drive autofocus drivers of various optical chains to focus on the same target. The zoom control module 140 is structured to perform a zooming operation in response to user input.

處理器110控制攝像機裝置100之操作以控制攝像機裝置100之元件以實施本發明之方法。該處理器可為經預先結構設計以實施該等方法之一專用處理器。然而,在諸多實施例中,處理器110在儲存於記憶體108中之軟體模組及/或常式(其等包含在被執行時導致該處理器控制攝像機裝置100以實施本發明之方法之一者、多者或全部之指令)之引導下操作。記憶體108包含模組118之一總成,其中一或多個模組包含用於實施本發明之影像捕捉及/或影像資料處理方法之一或多個軟體常式,例如,機器可執行指令。於模組118之總成之模組中之代碼之個別步驟及/或行在由處理器110執行時控制處理器110以執行本 發明之方法之步驟。在由處理器110執行時,資料處理模組118導致由處理器110根據本發明之方法處理至少一些資料。模組118之總成包含一模式控制模組,該模式控制模組例如基於使用者輸入判定將實施複數種攝像機裝置操作模式之哪些。在不同操作模式中,可且常常基於選定操作模式不同地控制不同攝像機模組131、133。例如,取決於操作模式,不同攝像機模組可使用不同曝光時間。替代地,攝像機模組被引導至之場景區域及因此一場景之哪個部分由一個別攝像機模組捕捉可取決於以下項而變更:將如何使用由不同攝像機模組捕捉之影像,例如,經組合以形成一合成影像;及在使用者選定操作模式或自動選定操作模式期間個別攝像機模組將捕捉一較大場景之哪些部分。在一些實施例中,在執行來自一或多個模組總成之指令時由該處理器執行之操作取而代之由執行相同功能且包含於硬體模組總成中之一硬體模組執行。 The processor 110 controls the operation of the camera device 100 to control the elements of the camera device 100 to implement the method of the present invention. The processor can be a dedicated processor that is pre-engineered to implement one of the methods. However, in various embodiments, the processor 110 is in a software module and/or a routine stored in the memory 108 (which, when executed, causes the processor to control the camera device 100 to implement the method of the present invention. Operation under the guidance of one, many or all instructions). The memory 108 includes an assembly of modules 118, wherein one or more modules include one or more software routines for implementing the image capture and/or image data processing methods of the present invention, for example, machine executable instructions . The individual steps and/or lines of code in the modules of the assembly of module 118, when executed by processor 110, control processor 110 to execute the present The steps of the method of the invention. When executed by processor 110, data processing module 118 causes processor 110 to process at least some of the material in accordance with the methods of the present invention. The assembly of module 118 includes a mode control module that determines which of a plurality of camera device modes of operation will be implemented based on user input, for example. In different modes of operation, different camera modules 131, 133 can be and often controlled differently based on the selected mode of operation. For example, different camera modules can use different exposure times depending on the mode of operation. Alternatively, the camera module is directed to the scene area and thus which portion of a scene is captured by a different camera module may vary depending on how the images captured by the different camera modules will be used, for example, combined To form a composite image; and which portions of a larger scene will be captured by the individual camera modules during the user selected operating mode or automatically selected operating mode. In some embodiments, operations performed by the processor when executing instructions from one or more module assemblies are instead performed by a hardware module that performs the same function and is included in the hardware module assembly.

所得資料及資訊(例如,一場景之經捕捉影像、一場景之經組合影像等)儲存於資料記憶體120中以供將來使用、額外處理及/或輸出,例如,至顯示器裝置102以供顯示或至另一裝置以供傳輸、處理及/或顯示。記憶體108包含不同類型之記憶體,例如隨機存取記憶體(RAM),其中模組118之總成及資料/資訊120可且在一些實施例中經儲存以供將來使用。唯讀記憶體(ROM),其中模組118之總成可經儲存用於電源故障。非揮發性記憶體(諸如用於資料、資訊及指令儲存之快閃記憶體)亦可用來實施記憶體108。記憶卡可添加至該裝置以提供用於儲存資料(例如,影像及視訊)及/或指令(諸如程式設計)之額外記憶體。據此,記憶體108可使用用作儲存裝置之多種非暫時性電腦或機器可讀媒體之任一者來實施。 The resulting information and information (eg, captured images of a scene, combined images of a scene, etc.) are stored in data memory 120 for future use, additional processing, and/or output, for example, to display device 102 for display Or to another device for transmission, processing, and/or display. The memory 108 includes different types of memory, such as random access memory (RAM), wherein the assembly of the module 118 and the data/information 120 can, in some embodiments, be stored for future use. Read only memory (ROM) in which the assembly of module 118 can be stored for power failure. Non-volatile memory, such as flash memory for data, information, and instruction storage, can also be used to implement memory 108. A memory card can be added to the device to provide additional memory for storing data (eg, images and video) and/or instructions (such as programming). Accordingly, memory 108 can be implemented using any of a variety of non-transitory computer or machine readable media used as storage devices.

圖2繪示包含複數個光學鏈(例如,攝像機模組)之一例示性攝像機裝置202之一透視圖200。攝像機裝置202可相同於或類似於圖1中所 展示之攝像機裝置100。可見攝像機202之正面203包含複數個開口(為了簡單起見,由一圓表示),光經由該複數個開口進入該等攝像機模組且沿該等攝像機模組前進至該等攝像機模組中之對應影像感測器。攝像機之正面203可用作可固定光學模組之一安裝板。替代地,一攝像機模組安裝板可定位於攝像機模組之面203後方或定位於攝像機之背面處。在一此實施例中,該等攝像機模組固定至一安裝板,使模組定位於平行於攝像機裝置202之正面203且在攝像機裝置202之正面203後方。參考數字205用來指代攝像機裝置202之殼體,其可包含正面部分203以及一背面、底部207、頂部及側。顯示器可安裝於殼體205之背面中且因此在圖2中不可見。較大圓對應於具有較大光圈及焦距之光學鏈。圖中被展示為對應於該等光學鏈之開口之數目僅係例示性的。圖式210展示X-Y-Z軸以提供攝像機202之佈局之一透視圖且促進對下文論述之更佳理解。深度「D」206表示攝像機202之從攝像機之前表面203至攝像機之背/後表面204之厚度,沿圖中被標示為Z軸之物延伸。雖然圖2中未展示,但應明白,攝像機裝置202可且在一些實施例中確實包含相同或類似於圖1之攝像機裝置100之元件。因此,應明白,攝像機裝置202包含各種元件(諸如處理器110、記憶體108、縮放控制器140、曝光及讀出控制器150、加速度計、陀螺儀、自動聚焦控制器等)及上文參考攝像機裝置100所論述之各種其他元件。 2 illustrates a perspective view 200 of one exemplary camera device 202 including a plurality of optical chains (eg, camera modules). Camera device 202 can be the same as or similar to that shown in FIG. A camera device 100 is shown. It can be seen that the front side 203 of the camera 202 includes a plurality of openings (represented by a circle for simplicity) through which the light enters the camera modules and advances along the camera modules to corresponding ones of the camera modules. Image sensor. The front side 203 of the camera can be used as a mounting plate for a fixed optical module. Alternatively, a camera module mounting plate can be positioned behind the face 203 of the camera module or at the back of the camera. In one embodiment, the camera modules are secured to a mounting plate such that the module is positioned parallel to the front side 203 of the camera device 202 and behind the front side 203 of the camera device 202. Reference numeral 205 is used to refer to the housing of the camera device 202, which may include a front portion 203 and a back, bottom 207, top and sides. The display can be mounted in the back of the housing 205 and is therefore not visible in FIG. Larger circles correspond to optical chains with larger apertures and focal lengths. The number of openings shown in the figures that correspond to the optical chains are merely illustrative. Graph 210 shows the X-Y-Z axis to provide a perspective view of the layout of camera 202 and facilitates a better understanding of the discussion below. Depth "D" 206 represents the thickness of camera 202 from the front surface 203 of the camera to the back/rear surface 204 of the camera, extending along the object labeled Z-axis in the figure. Although not shown in FIG. 2, it should be understood that camera device 202 can, and in some embodiments does, include elements of camera device 100 that are the same or similar to FIG. Accordingly, it should be understood that camera device 202 includes various components (such as processor 110, memory 108, zoom controller 140, exposure and readout controller 150, accelerometer, gyroscope, auto focus controller, etc.) and reference above. Various other components discussed by camera device 100.

如上文所論述,例示性攝像機裝置可包含相對於一參考表面(諸如上方安裝模組之安裝板或其中包含攝像機模組之攝像機裝置之底部)成不同角度安裝之複數個不同攝像機模組。 As discussed above, an exemplary camera device can include a plurality of different camera modules mounted at different angles relative to a reference surface, such as a mounting plate of an upper mounting module or a bottom portion of a camera device having a camera module therein.

圖3為展示一例示性攝像機裝置300之本體內之光學鏈(例如,攝像機模組)之一配置之一圖300。該攝像機裝置可相同或類似於圖1及圖2中所展示之攝像機裝置100、202。在圖3之所繪示實例中,存在依所描繪方式配置之17個攝像機模組。在圖3中形狀看似正方形之攝像 機模組328、326、332、334、330不包含鏡且具有正對攝像機300之面之光學鏈。此等光學鏈之感測器安裝板安裝於相同於攝像機裝置之背面之平面中且具有相同於攝像機裝置之背面之一般定向。因此,模組328、326、332、334、330之感測器不相對於上方安裝它們之感測器安裝板旋轉且此等模組之背面或正面固定至平行於攝像機之面延伸之一模組安裝表面。其他光學鏈(諸如光學鏈302、320、322、304等)包含鏡。此等模組具有在Z維度中延伸之感測器安裝板。因此,雖然不包含一鏡之攝像機模組328之感測器安裝板在攝像機裝置300中從左至右且從頂部至底部延伸,但攝像機模組302之感測器安裝板將從攝像機之背面延伸至正面且如從攝像機正面檢視沿一對角線延伸。具有鏡之模組將接收穿過攝像機正面之光且接著在攝像機裝置之本體內將光朝向模組之感測器重新引導。因此,進入具有一鏡之一模組之光在撞擊模組之光學感測器(藉由模組之鏡將該光引導至該光學感測器上)之前,將被側向(例如,在一對角線上)或朝向攝像機裝置之頂部或底部引導。因此,在撞擊對應感測器之前,該等鏡允許光軸之一部分相對於攝像機之面成直角或另一角度延伸。 3 is a diagram 300 showing one of the configurations of an optical chain (eg, a camera module) within the body of an exemplary camera device 300. The camera device can be the same or similar to the camera devices 100, 202 shown in Figures 1 and 2. In the illustrated example of FIG. 3, there are 17 camera modules configured in the manner depicted. The shape of the image looks like a square in Figure 3. The machine modules 328, 326, 332, 334, 330 do not include a mirror and have an optical chain that faces the face of the camera 300. The sensor mounting plates of such optical chains are mounted in the same plane as the back of the camera device and have the same general orientation as the back of the camera device. Therefore, the sensors of the modules 328, 326, 332, 334, 330 are not rotated relative to the sensor mounting plate on which they are mounted and the back or front surface of the modules is fixed to a plane parallel to the plane of the camera. Group mounting surface. Other optical chains, such as optical chains 302, 320, 322, 304, etc., include mirrors. These modules have sensor mounting plates that extend in the Z dimension. Therefore, although the sensor mounting plate of the camera module 328 that does not include a mirror extends from left to right and from top to bottom in the camera device 300, the sensor mounting plate of the camera module 302 will be from the back of the camera. Extends to the front and extends along a diagonal line as viewed from the front of the camera. The module with the mirror will receive light passing through the front of the camera and then redirect the light towards the sensor of the module within the body of the camera device. Thus, light entering a module having a mirror will be laterally (eg, at the optical sensor of the impact module (which is directed onto the optical sensor by the mirror of the module) On a diagonal line) or towards the top or bottom of the camera unit. Thus, the mirrors allow a portion of the optical axis to extend at a right angle or another angle relative to the face of the camera prior to impacting the corresponding sensor.

七個光學鏈302、306、310、312、316、320、322具有最大透鏡及最大支援焦距。類似地,五個攝像機模組304、308、314、318、324具有中等直徑透鏡及中等支援焦距。具有最小直徑外開口(例如,光進入開口)及最小焦距之五個光學鏈326、328、330、332及334係使用不使用鏡且直接朝向攝像機之背面延伸之光學鏈來實施。不包含鏡總成之光學鏈可用作光學鏈326、328、330、332及334。從可被視為正視圖之圖3實例(其中攝像機外殼之正面經移除以允許攝像機模組之檢視),可見,較大數目個攝像機模組可如何併入至單個攝像機裝置中,允許使用單個攝像機進行一場景區域之相同或不同部分之多個影像之同時及/或同步捕捉。該攝像機裝置可接著組合多個影像以產生 具有影像屬性及/或品質(諸如超過使用攝像機202之攝像機模組之單一者實現所可能之像素數目)之一合成影像。 The seven optical chains 302, 306, 310, 312, 316, 320, 322 have a maximum lens and a maximum support focal length. Similarly, the five camera modules 304, 308, 314, 318, 324 have a medium diameter lens and a medium support focal length. The five optical chains 326, 328, 330, 332, and 334 having the smallest diameter outer opening (e.g., light entry opening) and minimum focal length are implemented using an optical chain that does not use a mirror and extends directly toward the back of the camera. An optical chain that does not include a mirror assembly can be used as the optical chains 326, 328, 330, 332, and 334. From the example of Figure 3, which can be considered a front view (where the front of the camera housing is removed to allow viewing of the camera module), it can be seen how a larger number of camera modules can be incorporated into a single camera device, allowing use A single camera performs simultaneous and/or simultaneous capture of multiple images of the same or different portions of a scene region. The camera device can then combine multiple images to generate The composite image is synthesized with one of image attributes and/or qualities, such as the number of possible pixels beyond the implementation of a single camera module using camera 202.

圖4繪示在一些實施例中用於一例示性攝像機模組(例如,光學鏈)中之組件之一總成400,該攝像機模組用於一攝像機裝置中。光軸401從攝像機模組400之正面延伸至感測器412所定位之模組之背面。總成400可用作圖3中所展示之攝像機模組之至少一些之部分,例如,諸如攝像機模組326、328、330、332、334。光學鏈326、328、330、332、334不包含鏡/鏡總成且因此總成400可簡單地用作此等攝像機模組自身之任一者。總成400包含具有適於用作一攝像機模組安裝表面之至少一個平坦表面之一外殼411。在圖4實例中,該攝像機模組不包含一鏡且攝像機模組400包含在一些實施例中適於且被要求將攝像機模組400安裝至一攝像機模組安裝板之一平坦前表面及一平坦後表面421。該攝像機模組亦包含平坦側及一平坦頂部427及平坦底部423。模組400亦包含一透鏡鏡筒總成402及一感測器總成404,其可且有時包含於外殼411中。外殼411之壁可用作感測器總成404之壁。線420繪示透鏡鏡筒總成停止及感測器總成404開始之處。如將論述,總成400之兩個部分(即,鏡筒總成402及感測器總成404)在用於一攝像機模組中時可耦合在一起。透鏡鏡筒總成402包含一開口403,光射線經由該開口403穿過,沿該透鏡鏡筒總成行進且到達濾光器及感測器總成404。參考401指示其中使用總成400之攝像機模組之光軸。透鏡鏡筒總成402進一步包含一或多個透鏡,例如,諸如為了簡單起見展示之兩個透鏡406、408,光射線在到達感測器總成404之前經由該一或多個透鏡穿行。雖然圖中未展示,但總成400亦可包含在感測器總成404前方或包含於感測器總成404內之一或多個濾光器。感測器總成404包含一感測器安裝板/印刷電路板(PCB)410,具有一感測器區域412,該感測器區域412對應於一感測器晶粒,沿該PCB或平坦參考表面(例 如,感測器安裝板410之基底)對準。矩形區域414表示感測器412之光學作用區域。攝像機模組400可且有時用作圖3中所展示之攝像機之攝像機模組326、328、334、332、330之一者,其中該攝像機模組外殼之背面421安裝於平行於攝像機裝置300之背面之一平面中且其中該感測器平行於其中定位模組400之攝像機之背面定位。然而,攝像機模組400之正面425可取而代之安裝至攝像機模組安裝板,例如,202,其用作攝像機之面或在攝像機之面後方。然而,其他結構設計係可能的。在圖5至圖6中進一步詳細地繪示感測器412之光學作用影像感測區域414參考PCB 410或一平坦參考表面之一例示性配置及對準。如圖中所展示,該感測器之光學作用區域414沿PCB 410之側定向,使得矩形感測器區域414之較長側平行於上方安裝該感測器之PCB板之邊緣。 4 illustrates an assembly 400 for use in an exemplary camera module (eg, an optical chain) in a camera device for use in a camera device. The optical axis 401 extends from the front of the camera module 400 to the back of the module on which the sensor 412 is positioned. Assembly 400 can be used as part of at least some of the camera modules shown in FIG. 3, such as camera modules 326, 328, 330, 332, 334, for example. The optical chains 326, 328, 330, 332, 334 do not include a mirror/mirror assembly and thus the assembly 400 can simply be used as any of these camera modules themselves. Assembly 400 includes a housing 411 having at least one planar surface suitable for use as a camera module mounting surface. In the example of FIG. 4, the camera module does not include a mirror and the camera module 400 includes, in some embodiments, is adapted and required to mount the camera module 400 to a flat front surface of a camera module mounting board and a The rear surface 421 is flat. The camera module also includes a flat side and a flat top 427 and a flat bottom 423. The module 400 also includes a lens barrel assembly 402 and a sensor assembly 404 that may and sometimes be included in the housing 411. The wall of the outer casing 411 can be used as the wall of the sensor assembly 404. Line 420 depicts where the lens barrel assembly is stopped and the sensor assembly 404 begins. As will be discussed, the two portions of the assembly 400 (i.e., the lens barrel assembly 402 and the sensor assembly 404) can be coupled together when used in a camera module. Lens barrel assembly 402 includes an opening 403 through which light rays pass, along which the lens barrel assembly travels and reaches the filter and sensor assembly 404. Reference 401 indicates the optical axis of the camera module in which the assembly 400 is used. The lens barrel assembly 402 further includes one or more lenses, such as, for example, two lenses 406, 408 shown for simplicity, through which the light rays travel before reaching the sensor assembly 404. Although not shown, the assembly 400 can also include one or more filters in front of the sensor assembly 404 or included in the sensor assembly 404. The sensor assembly 404 includes a sensor mounting board/printed circuit board (PCB) 410 having a sensor region 412 corresponding to a sensor die along the PCB or flat Reference surface For example, the base of the sensor mounting plate 410 is aligned. Rectangular region 414 represents the optically active region of sensor 412. The camera module 400 can be used and sometimes used as one of the camera modules 326, 328, 334, 332, 330 of the camera shown in FIG. 3, wherein the back surface 421 of the camera module housing is mounted parallel to the camera device 300. The back surface is located in one of the planes and wherein the sensor is positioned parallel to the back of the camera in which the positioning module 400 is located. However, the front side 425 of the camera module 400 can be instead mounted to a camera module mounting plate, such as 202, which acts as the face of the camera or behind the camera. However, other structural designs are possible. An exemplary configuration and alignment of one of the optically active image sensing regions 414 of the sensor 412 with reference to the PCB 410 or a flat reference surface is illustrated in further detail in FIGS. 5-6. As shown in the figure, the optically active region 414 of the sensor is oriented along the side of the PCB 410 such that the longer side of the rectangular sensor region 414 is parallel to the edge of the PCB on which the sensor is mounted.

圖5繪示展示從外面所見之攝像機模組400之一透視圖之一圖式500,例如,未展示整個攝像機模組外殼411之例示性外部視圖。對應於感測器總成404之攝像機模組外殼411之部分在圖5中被展示為由參考404標示之矩形區域,此係因為該感測器總成在攝像機外殼411之此部分內。光軸401展示在到達感測器總成404之前穿過鏡筒總成402之光之路徑。 5 depicts an illustration 500 of a perspective view of one of the camera modules 400 seen from the outside, for example, an illustrative external view of the entire camera module housing 411 is not shown. The portion of the camera module housing 411 corresponding to the sensor assembly 404 is shown in FIG. 5 as a rectangular area indicated by reference 404 because the sensor assembly is within this portion of the camera housing 411. The optical axis 401 shows the path of light that passes through the lens barrel assembly 402 before reaching the sensor assembly 404.

圖式500進一步展示影像感測器之光學作用區域414相對於攝像機模組400之感測器安裝板410之對準。感測器之光學作用區域414為具有兩個較長側502、502'及兩個短側504、504'之一矩形。從圖可明白,感測器之光學作用區域414經對準,使得感測器之光學作用區域414之較長側502、502'垂直於安裝板之基底。感測器412具有相同於上方安裝它的安裝板之定向且不相對於該安裝板之底部旋轉。 The diagram 500 further illustrates the alignment of the optically active region 414 of the image sensor relative to the sensor mounting plate 410 of the camera module 400. The optically active region 414 of the sensor is rectangular having one of the two longer sides 502, 502' and the two short sides 504, 504'. As can be appreciated, the optically active region 414 of the sensor is aligned such that the longer sides 502, 502' of the optically active region 414 of the sensor are perpendicular to the substrate of the mounting plate. The sensor 412 has the same orientation as the mounting plate on which it is mounted and does not rotate relative to the bottom of the mounting plate.

圖6繪示更詳細地展示一例示性感測器412在一感測器安裝板410上之配置之一圖式600。圖式600更詳細地展示感測器安裝板410、感 測器區域412(感測器晶粒)及感測器之光學作用區域414以及其等相對於彼此之對準。雖然感測器412被展示為一正方形,但應明白,感測器區域412可為且在諸多情況中為矩形。 6 is a diagram 600 showing one example of the configuration of an exemplary sensor 412 on a sensor mounting plate 410 in more detail. Figure 600 shows the sensor mounting plate 410 in more detail, sense Detector region 412 (sensor dies) and the optically active region 414 of the sensor and their alignment with respect to each other. While the sensor 412 is shown as a square, it should be understood that the sensor region 412 can be and in many cases be rectangular.

在對應於用於模組400中之未旋轉感測器結構設計之圖6圖中,分別由參考數字602及604指示安裝板之頂部側及底部(基底)側。如上文參考圖4至圖5所論述,感測器之光學作用區域414沿PCB 410之側而定向,使得光學作用部分414之較長側502、502'平行於上方安裝感測器之安裝板410之基底604。 In the Figure 6 corresponding to the design of the unrotated sensor structure used in module 400, the top side and bottom (substrate) sides of the mounting board are indicated by reference numerals 602 and 604, respectively. As discussed above with reference to Figures 4 through 5, the optically active region 414 of the sensor is oriented along the side of the PCB 410 such that the longer sides 502, 502' of the optically active portion 414 are mounted parallel to the mounting plate of the sensor. The base 604 of 410.

雖然圖4中所展示之感測器配置適於諸如模組326、328之攝像機模組(具有不相對於攝像機裝置300之底部旋轉或相對於攝像機裝置300之底部配置於一對角線上之攝像機模組),但其中該感測器經安裝,使得其邊緣平行於上方安裝該感測器之PCB板之邊緣之此一結構設計可能不適於其中攝像機模組相對於攝像機裝置之底部成角度安裝之實施例。 Although the sensor configuration shown in FIG. 4 is suitable for a camera module such as modules 326, 328 (having a camera that is not rotated relative to the bottom of camera device 300 or disposed on a pair of angles relative to the bottom of camera device 300) Module), but wherein the sensor is mounted such that its edge parallel to the edge of the PCB on which the sensor is mounted may not be suitable for angular mounting of the camera module relative to the bottom of the camera device An embodiment.

此係因為若圖4至圖6中所展示之感測器定向/對準用於安裝於一對角線上之攝像機模組(諸如攝像機模組320、318、302、304)中,則在由此等攝像機模組捕捉之一影像中可能丟失(例如,轉切)一受關注場景之一些部分,此係因為相比於具有具平行於攝像機之底部之一底部邊緣之感測器之攝像機模組,此等攝像機模組具有一旋轉偏移。 This is because if the sensor orientation/alignment shown in Figures 4-6 is used in a camera module (such as camera module 320, 318, 302, 304) mounted on a diagonal line, then Some of the parts of the scene of interest may be lost (eg, cut) in one of the images captured by the camera module, as compared to a camera module having a sensor having a bottom edge parallel to one of the bottoms of the camera. These camera modules have a rotational offset.

雖然諸如圖3中所展示成角度安裝攝像機模組具有關於縮放及其他功能之眾多優點及益處,但在一些實施例中,由具有旋轉偏移之攝像機模組之至少一些捕捉之一影像可歸因於來自一受關注場景之光歸因於感測器之旋轉偏移而錯過感測器作用區域而無法捕捉該受關注場景之部分。 While angled mounted camera modules such as those shown in FIG. 3 have numerous advantages and benefits with respect to zooming and other functions, in some embodiments, capturing at least one of the camera modules with rotational offset can be returned The portion of the scene of interest cannot be captured because the light from a scene of interest misses the sensor action area due to the rotational offset of the sensor.

圖7展示用於各項例示性實施例中之一光學鏈,例如,攝像機模組700。圖7中所繪示之類型之複數個光學鏈用於一攝像機裝置(諸如 攝像機202)中。例如,光學鏈700可用作攝像機模組302、304、306、308、310、312、314、316、318、320、322及324之任一者。攝像機模組700為包含整合在一起以形成該攝像機模組之不同元件之一總成之一光學鏈。如所繪示,攝像機模組700包含一鏡總成720、一光學透鏡總成722(亦稱為透鏡鏡筒總成,此係因為其可包含一可移動透鏡鏡筒中包含之多個透鏡)及一感測器總成724。攝像機模組700之鏡總成720包含可由一扁平玻璃/塑膠板覆蓋之一外開口712、定位於開口712後方之一光重新引導裝置(例如,鏡)710及一鏡鉸鏈708。鏡鉸鏈708耦合至鏡驅動器(MD)716。攝像機模組700之光學元件總成722包含一第一圓柱形模組部分706及一第二圓柱形模組部分704,其中光學元件總成722耦合至一透鏡驅動器714。攝像機模組700之感測器總成724之前方為安裝於一濾光器安裝座701上之一濾光器703或包含一濾光器安裝座701上之一濾光器703作為總成724之部分。感測器總成724進一步包含佈置於一感測器安裝板715上之一感測器702。該感測器安裝板可為且有時為具有電連接之一印刷電路板及/或可用來將安裝於該板上之感測器連接至其中安裝攝像機模組700之攝像機裝置之處理器之一撓性帶(flex tape)。攝像機模組700可用作包含一鏡之圖3之攝像機模組之任一者。光經由開口712進入光學鏈700且藉由鏡710重新引導,使得其到達該光學鏈之背面處之感測器702。第一圓柱形部分704及第二圓柱形部分706可容置一或多個透鏡且在一些情況中容置濾光器以及光在到達感測器702之前可能穿過之其他光學組件。雖然鏡710通常用來重新引導光達90度或近似90度,使得沿其光軸穿過開口712(其可定位於攝像機之面上)進入之光將沿光學鏈700之光軸重新引導,使得該光朝向攝像機之側行進,允許光學鏈700有效地使用其中安裝光學鏈700之攝像機裝置之側間距離,但鏡驅動器716可移動鉸鏈708及因此鏡710之位置以改變重新引導角度,使得其從90度變化。因 此,可藉由移動鉸鏈708及鏡710之全部或一部分而變化光學鏈700有效指向之方向。在一些實施例中,開口712覆蓋有無光學功率之一塊扁平玻璃,該扁平玻璃如上文所提及,即使該玻璃具有較少或無光學功率,仍可稱為外透鏡。MD 716可使用一馬達或其他機械機構來實施,其等可用來驅動或變更鏡710及/或將鏡連接至攝像機模組之其他組件(諸如圓柱形部分706)之鉸鏈708之位置。可藉由透鏡驅動器714移動光學元件總成722之圓柱形或鏡筒部分704、706,使得其等相對於彼此滑動,例如,可移動鏡筒部分704使得其進一步移進或移出鏡筒部分706,藉此改變從開口712至感測器702之距離,作為一聚焦或縮放操作之部分。應明白,光學鏈700允許相對較長光學鏈定位於具有小於光學鏈700之總長度之一深度之一攝像機裝置中。攝像機模組700尤其適於實施包含多個光學鏈但仍意欲於相對較薄以促進在一凹穴或其他儲存裝置中之儲存之攝像機裝置。 FIG. 7 shows an optical chain, such as camera module 700, for use in various exemplary embodiments. A plurality of optical chains of the type illustrated in Figure 7 are used in a camera device (such as In camera 202). For example, optical chain 700 can be used as any of camera modules 302, 304, 306, 308, 310, 312, 314, 316, 318, 320, 322, and 324. Camera module 700 is an optical chain that includes an assembly of one of the different components that are integrated to form the camera module. As shown, the camera module 700 includes a mirror assembly 720 and an optical lens assembly 722 (also referred to as a lens barrel assembly, as it may include a plurality of lenses included in a movable lens barrel) And a sensor assembly 724. The mirror assembly 720 of the camera module 700 includes an outer opening 712 that can be covered by a flat glass/plastic plate, a light redirecting device (eg, mirror) 710 positioned behind the opening 712, and a mirror hinge 708. Mirror hinge 708 is coupled to mirror driver (MD) 716. The optical component assembly 722 of the camera module 700 includes a first cylindrical module portion 706 and a second cylindrical module portion 704, wherein the optical component assembly 722 is coupled to a lens driver 714. The sensor assembly 724 of the camera module 700 is preceded by a filter 703 mounted on a filter mount 701 or a filter 703 including a filter mount 701 as an assembly 724. Part of it. The sensor assembly 724 further includes a sensor 702 disposed on a sensor mounting plate 715. The sensor mounting plate can be and sometimes is a printed circuit board having electrical connections and/or a processor that can be used to connect a sensor mounted on the board to a camera device in which the camera module 700 is mounted. A flexible tape. The camera module 700 can be used as any of the camera modules of FIG. 3 including a mirror. Light enters optical chain 700 via opening 712 and is redirected by mirror 710 such that it reaches sensor 702 at the back of the optical chain. The first cylindrical portion 704 and the second cylindrical portion 706 can house one or more lenses and in some cases house a filter and other optical components that light may pass before reaching the sensor 702. Although mirror 710 is typically used to redirect light to 90 degrees or approximately 90 degrees, light entering through aperture 712 (which can be positioned on the face of the camera) along its optical axis will be redirected along the optical axis of optical chain 700, Having the light travel toward the side of the camera allows the optical chain 700 to effectively use the inter-side distance of the camera device in which the optical chain 700 is mounted, but the mirror driver 716 can move the hinge 708 and thus the position of the mirror 710 to change the redirection angle so that It varies from 90 degrees. because Thus, the direction in which the optical chain 700 is effectively directed can be varied by moving all or a portion of the hinge 708 and the mirror 710. In some embodiments, the opening 712 is covered with a piece of flat glass with or without optical power, as mentioned above, even though the glass has less or no optical power, it can be referred to as an outer lens. The MD 716 can be implemented using a motor or other mechanical mechanism that can be used to drive or change the mirror 710 and/or to connect the mirror to the position of the hinge 708 of other components of the camera module, such as the cylindrical portion 706. The cylindrical or barrel portions 704, 706 of the optical element assembly 722 can be moved by the lens driver 714 such that they slide relative to each other, for example, the movable barrel portion 704 causes it to move further into or out of the barrel portion 706. Thereby, the distance from the opening 712 to the sensor 702 is changed as part of a focusing or zooming operation. It will be appreciated that the optical chain 700 allows a relatively long optical chain to be positioned in a camera device having a depth that is less than one of the total length of the optical chain 700. The camera module 700 is particularly suitable for implementing a camera device that includes a plurality of optical chains but is still intended to be relatively thin to facilitate storage in a pocket or other storage device.

圖8為繪示例示性攝像機裝置202中之兩個不同例示性攝像機模組在一X-Y平面中之配置之一圖式800。第一攝像機模組包含及/或對應於一鏡總成802、透鏡鏡筒總成804及感測器總成806,其中線808指示第一攝像機模組之光軸。第二攝像機模組包含及/或對應於一鏡總成820、透鏡鏡筒總成822及感測器總成824,其中線826指示第二攝像機模組之光軸。圖8中未展示透鏡鏡筒外殼,但第一攝像機模組及第二攝像機模組之各者亦將具有包含一平坦安裝表面之一外殼,該平坦安裝表面將對應於感測器總成806、824之底部或頂部,其中若攝像機模組安裝至攝像機之背面處之一板,則底部用作安裝表面,且在一些實施例中若攝像機模組安裝至定位於攝像機之正面側上之一安裝板,則頂部用作安裝表面。第一攝像機模組可對應於例如圖3之攝像機模組310或318,且第二攝像機模組可對應於例如圖3之攝像機模組320或308。其繪示第一攝像機模組及第二攝像機模組之光軸相對於X軸801之角度(θ)。X軸801及Y軸803經展示以促進對攝像機模組之定向之一 理解。 FIG. 8 is a diagram 800 illustrating one of two different exemplary camera modules in an exemplary camera device 202 in an X-Y plane. The first camera module includes and/or corresponds to a mirror assembly 802, a lens barrel assembly 804, and a sensor assembly 806, wherein line 808 indicates the optical axis of the first camera module. The second camera module includes and/or corresponds to a mirror assembly 820, a lens barrel assembly 822, and a sensor assembly 824, wherein line 826 indicates the optical axis of the second camera module. The lens barrel housing is not shown in FIG. 8, but each of the first camera module and the second camera module will also have a housing that includes a flat mounting surface that will correspond to the sensor assembly 806. The bottom or top of the 824, wherein if the camera module is mounted to one of the panels at the back of the camera, the bottom serves as a mounting surface, and in some embodiments, if the camera module is mounted to one of the front sides of the camera Install the plate and the top is used as the mounting surface. The first camera module may correspond to, for example, the camera module 310 or 318 of FIG. 3, and the second camera module may correspond to, for example, the camera module 320 or 308 of FIG. The angle (θ) of the optical axes of the first camera module and the second camera module relative to the X-axis 801 is shown. The X-axis 801 and the Y-axis 803 are shown to facilitate orientation of the camera module understanding.

圖9繪示在一些實施例中用於一攝像機裝置中之一例示性攝像機模組(例如,光學鏈)中所使用之組件之一總成900可包含一感測器,該感測器相對於上方安裝該感測器之一印刷電路板且亦相對於攝像機模組之底部及/或頂部平坦安裝表面旋轉,該底部及/或頂部平坦安裝表面通常將對應於上方安裝該感測器之印刷電路板之頂部及底部。在圖9中及在一些實施例中所展示之總成用作圖7中所展示之攝像機模組之組件,其中使用透鏡鏡筒總成902取代透鏡鏡筒總成702且使用感測器總成904取代感測器總成704。因此,在一些實施例中,一攝像機模組係依一鏡總成720位於透鏡鏡筒總成902及感測器總成904前方來實施。 9 illustrates that in one embodiment, one of the components 900 used in an exemplary camera module (eg, an optical chain) in a camera device can include a sensor that is relatively Mounting a printed circuit board of the sensor above and also rotating relative to the bottom and/or top flat mounting surface of the camera module, the bottom and/or top flat mounting surface will typically correspond to the sensor mounted above The top and bottom of the printed circuit board. The assembly shown in Figure 9 and in some embodiments is used as an assembly of the camera module shown in Figure 7, wherein the lens barrel assembly 902 is replaced with a lens barrel assembly 902 and the total sensor usage is used. 904 replaces sensor assembly 704. Thus, in some embodiments, a camera module is implemented in accordance with a mirror assembly 720 located in front of the lens barrel assembly 902 and the sensor assembly 904.

因此,應明白,為了簡單起見圖9未展示攝像機模組之鏡部分,但應明白,在一模組包含一鏡時,該鏡將作為圖9中所展示之組件之補充。例如,除透鏡鏡筒總成902及感測器總成904外,鏡802或820將被包含作為攝像機模組之部分。 Therefore, it should be understood that the mirror portion of the camera module is not shown in FIG. 9 for simplicity, but it should be understood that when a module includes a mirror, the mirror will complement the components shown in FIG. For example, in addition to the lens barrel assembly 902 and the sensor assembly 904, the mirror 802 or 820 will be included as part of the camera module.

總成900可用作圖3中所展示之攝像機模組之至少一些之部分,例如,諸如攝像機模組302、304、308、310、312、314、318及320。總成900包含在圖中展示為藉由線920分離之一透鏡鏡筒總成902部分及一感測器總成904部分。總成900之兩份部分(即,鏡筒總成902及感測器總成904)在用於如參考圖7之攝像機模組700所展示及所論述之一攝像機模組中時可耦合在一起。透鏡鏡筒總成902包含一開口903,光射線經由該開口903穿過,沿該透鏡鏡筒總成行進且到達濾光器及感測器總成904。參考901指示其中使用總成900之攝像機模組之光軸。透鏡鏡筒總成902進一步包含一或多個透鏡,例如,諸如為了簡單起見展示之兩個透鏡906、908,光射線在到達感測器總成904之前經由該一或多個透鏡穿行。雖然圖中未展示,但總成900亦可包含在感測 器總成904前方或包含於感測器總成904內之一或多個濾光器。感測器總成904包含一感測器安裝板/印刷電路板(PCB)910,具有一感測器區域912,該感測器區域912對應於一感測器晶粒,沿該PCB或平坦參考表面(例如,感測器安裝板910之基底)對準。矩形區域914表示感測器912之光學作用區域。展示(且在圖10至圖11中進一步更詳細地繪示)感測器912之光學作用影像感測區域914參考感測器安裝板910之基底之一例示性配置及對準。如圖9中所展示,該感測器之光學作用區域914相對於感測器安裝板910之基底成一角度而定向。攝像機模組之此一例示性結構設計(其中感測器光學作用區域914相對於感測器安裝板910之基底成一角度旋轉)允許一受關注場景區域之改良影像捕捉,而不失去該受關注場景區域之部分同時仍允許使用攝像機模組外殼之平坦表面安裝該攝像機模組。 Assembly 900 can be used as part of at least some of the camera modules shown in FIG. 3, such as camera modules 302, 304, 308, 310, 312, 314, 318, and 320, for example. Assembly 900 is shown in the figures as a portion of lens barrel assembly 902 and a sensor assembly 904 separated by line 920. The two portions of the assembly 900 (ie, the lens barrel assembly 902 and the sensor assembly 904) can be coupled to one of the camera modules as shown and described with respect to the camera module 700 of FIG. together. Lens barrel assembly 902 includes an opening 903 through which light rays pass, along which the lens barrel assembly travels and reaches the filter and sensor assembly 904. Reference 901 indicates the optical axis of the camera module in which the assembly 900 is used. The lens barrel assembly 902 further includes one or more lenses, such as, for example, two lenses 906, 908 shown for simplicity, through which the light rays travel before reaching the sensor assembly 904. Although not shown in the figure, the assembly 900 can also be included in the sensing One or more filters are included in front of or included in the sensor assembly 904. The sensor assembly 904 includes a sensor mounting board/printed circuit board (PCB) 910 having a sensor region 912 corresponding to a sensor die along the PCB or flat The reference surface (eg, the base of the sensor mounting plate 910) is aligned. Rectangular region 914 represents the optically active region of sensor 912. An exemplary configuration and alignment of the optically active image sensing region 914 of the sensor 912 with reference to one of the substrates of the sensor mounting plate 910 is shown (and shown in further detail in FIGS. 10-11). As shown in FIG. 9, the optically active region 914 of the sensor is oriented at an angle relative to the base of the sensor mounting plate 910. This exemplary structural design of the camera module (where the sensor optically active region 914 is rotated at an angle relative to the base of the sensor mounting plate 910) allows for improved image capture of a scene of interest without losing the focus Portions of the scene area still allow the camera module to be mounted using the flat surface of the camera module housing.

根據本發明之特徵,依藉由預測在攝像機模組安裝於一攝像機殼體中之一安裝板上且用來捕捉一影像時(例如,在其他模組捕捉場景區域之一影像的同時)將發生之偏移而抵消或避免將以其他方式引入至一捕捉影像中之旋轉偏移之此一方式完成諸如圖9中所繪示之旋轉感測器配置。攝像機模組內之感測器之旋轉偏移補償將在影像捕捉期間先驗地由於經旋轉感測器設計引入之旋轉偏移,藉此減小或避免在影像捕捉之後(例如,在將從由該相同攝像機之不同模組捕捉之影像產生一合成影像時)補償此一偏移之需要。 According to the features of the present invention, by predicting when the camera module is mounted on one of the camera housings and used to capture an image (for example, while other modules capture an image of the scene area) A rotational sensor configuration such as that depicted in Figure 9 is accomplished in such a manner that an offset occurs to cancel or avoid a rotational offset that would otherwise be introduced into a captured image. The rotational offset compensation of the sensor within the camera module will a priori due to the rotational offset introduced by the rotary sensor design during image capture, thereby reducing or avoiding after image capture (eg, at The need to compensate for this offset when an image captured by a different module of the same camera produces a composite image.

因此,雖然若感測器板未旋轉且捕捉到整個受關注影像區域,則可能在計算上補償一經旋轉影像,但在計算上校正此影像旋轉之需要被避免且由不同攝像機模組(包含相對於攝像機裝置之底部成一角度旋轉之攝像機模組)捕捉之影像可容易地組合,其中計算偏移將在不使用一經旋轉感測器之情況下存在之一影像旋轉。 Therefore, although if the sensor board is not rotated and the entire image area of interest is captured, it may be computationally compensated for the rotated image, but the need to correct the image rotation is computationally avoided and by different camera modules (including relative The captured images captured at an angle to the bottom of the camera unit can be easily combined, wherein the calculated offset will have one of the image rotations without the use of a rotary sensor.

圖10為更詳細地繪示影像感測器之光學作用區域914相對於感測 器安裝板910之對準之一圖式1000。感測器之光學作用區域914為具有兩個較長側1002、1002'及兩個短側1004、1004'之一矩形。分別由參考數字1010及1012指示安裝板910之頂部側及底部(基底)側。從圖可明白,感測器之光學作用區域914經對準,使得感測器之光學作用區域914之較長側1002、1002'相對於安裝板910之側1012成之一角度「θ」,而相對於安裝板910之基底1010'成之一角度「90°-θ」。 Figure 10 is a diagram showing the optical effect area 914 of the image sensor in more detail with respect to sensing One of the alignments of the mounting plate 910 is shown in FIG. The optically active region 914 of the sensor is rectangular having one of the two longer sides 1002, 1002' and the two short sides 1004, 1004'. The top side and bottom (substrate) sides of the mounting board 910 are indicated by reference numerals 1010 and 1012, respectively. As can be appreciated, the optically active region 914 of the sensor is aligned such that the longer sides 1002, 1002' of the optically active region 914 of the sensor are at an angle "θ" relative to the side 1012 of the mounting plate 910, The angle is "90°-θ" with respect to the base 1010' of the mounting plate 910.

圖11繪示展示一項例示性實施例中之感測器安裝板910上之一例示性感測器914針對用於一些實施例中之角度「θ」之一特定值之配置之一圖式1100。在所繪示實施例中,角度「θ=36.87」。如圖中所展示,在此一情況中,感測器之矩形光學作用區域914之對角線1102垂直於安裝板910之基底1010'。 11 is a diagram showing one of the configurations of the sensor 914 on one of the sensor mounting plates 910 in an exemplary embodiment for a particular value of one of the angles "θ" used in some embodiments. . In the illustrated embodiment, the angle "θ = 36.87". As shown in the figure, in this case, the diagonal 1102 of the rectangular optically active region 914 of the sensor is perpendicular to the substrate 1010' of the mounting board 910.

為了允許一薄攝像機實施方案,可能期望使用朝向一攝像機模組之正面定位之一鏡以重新引導光且允許定向一攝像機模組/光學鏈之至少一部分,使得一攝像機之左側與右側之間的空間可用於該光學鏈之一部分。一鏡之使用導致有時稱為折疊系統之物。光學鏈(一些具有鏡且其他無鏡)之一組合可導致一多模組攝像機裝置之一有用且期望的結構設計,其中多個光學鏈存在於且用於單個攝像機裝置中。在此一實施例中,通常期望容易組合由不同光學鏈(例如,攝像機模組)捕捉之影像。 In order to allow for a thin camera implementation, it may be desirable to use a mirror positioned toward the front of a camera module to redirect light and allow orientation of at least a portion of a camera module/optical chain such that between the left and right sides of a camera Space can be used for one part of the optical chain. The use of a mirror results in what is sometimes referred to as a folding system. The combination of one of the optical chains (some with mirrors and other without mirrors) can result in a useful and desirable structural design for one of the multi-module camera devices in which multiple optical chains are present and used in a single camera device. In this embodiment, it is generally desirable to easily combine images captured by different optical chains (e.g., camera modules).

在一成像系統(諸如一多攝像機折疊系統)中,由攝像機模組之一些捕捉之影像可具有相對於另一攝像機模組或一些參考場景之一些旋轉。此可歸因於攝像機裝置內之模組定位、特定攝像機模組內之鏡定向問題及/或歸因於其他原因。影像之此一旋轉亦可存在其他額外原因,諸如在組裝期間組件之間的未對準及/或歸因於與將多個攝像機模組及/或組件併入單個攝像機裝置中相關聯之空間約束之實體安裝問題。 In an imaging system, such as a multi-camera folding system, images captured by some of the camera modules may have some rotation relative to another camera module or some reference scene. This can be attributed to module positioning within the camera device, mirror orientation issues within a particular camera module, and/or due to other reasons. There may be other additional reasons for this rotation of the image, such as misalignment between components during assembly and/or due to the space associated with incorporating multiple camera modules and/or components into a single camera device. Constrained physical installation issues.

根據本發明,在此等情況中,如參考圖9至圖11所論述使一或多個攝像機模組之感測器相對於攝像機模組本體旋轉,上方安裝感測器之印刷電路板在至少一些情況中可支援攝像機模組對受關注場景之較佳捕捉,該攝像機模組包含安裝在可被視為相對於感測器安裝板之基底之一經旋轉位置之位置中之感測器。 According to the present invention, in such a case, as described with reference to FIGS. 9-11, the sensor of one or more camera modules is rotated relative to the camera module body, and the printed circuit board on which the sensor is mounted is at least In some cases, the camera module can be supported for better capture of the scene of interest, the camera module including a sensor mounted in a position that can be considered to be in a rotated position relative to the base of the sensor mounting plate.

應明白,若對應於具有相對於其他攝像機模組之一旋轉偏移視場之一攝像機之一感測器未旋轉,則該旋轉偏移攝像機感測器將捕捉一經旋轉影像,其中一參考場景/參考攝像機之一些相關區域可歸因於偏移而丟失,藉此減小經捕捉之影像在與由攝像機之其他攝像機模組捕捉之影像組合方面之有用性。 It should be understood that if one of the cameras has one of the cameras with respect to one of the other camera modules, the rotation offset camera sensor will capture a rotated image, one of the reference scenes. Some of the relevant areas of the reference camera may be lost due to offset, thereby reducing the usefulness of the captured image in combining with images captured by other camera modules of the camera.

因此,根據一些實施例之一個態樣,一多攝像機模組攝像機(上文所論述之攝像機)之一或多個攝像機模組之一感測器之光學作用區域(例如,感測器區域914)成一角度(例如,θ)旋轉。此旋轉補償將在影像捕捉期間發生之旋轉偏移。在一些實施例中,PCB佈局及示意圖據此考慮此旋轉角θ而設計,其中在每個模組(例如,光學鏈)的基礎上判定θ。在一些實施例中,在將一光學鏈安裝於一攝像機之本體中或該攝像機之一板上之前,依此定向將該光學鏈之感測器佈置、接合及/或安裝於一光學鏈外殼內。 Thus, in accordance with an aspect of some embodiments, one of a plurality of camera module cameras (cameras discussed above) or one of a plurality of camera modules has an optically active area (eg, sensor area 914) ) Rotate at an angle (eg, θ). This rotation compensates for the rotation offset that occurs during image capture. In some embodiments, the PCB layout and schematic are designed with this rotation angle θ considered, wherein θ is determined on a per module basis (eg, an optical chain). In some embodiments, the optical chain sensor is arranged, joined, and/or mounted to an optical chain housing prior to mounting an optical chain in the body of a camera or on one of the cameras. Inside.

圖12包含用來促進對本發明之一理解之各種圖式,包含展示使用圖3之多攝像機系統捕捉之一受關注參考場景1203之一圖式1202。圖式1204包含受關注參考場景1203之一影像1205,其為由一參考攝像機模組(諸如前向攝像機模組326、328、330、332或334)捕捉之一例示性影像。圖式1206展示將由具有旋轉偏移之一攝像機模組捕捉之參考場景1203之部分之一影像1207(其使用虛線繪示),前提是該偏移未藉由一對應感測器旋轉補償,因此展示其中由攝像機模組(諸如攝像機模組302、304、308、310、312、314、318及320)之一者執行影像 捕捉但不使用圖9及圖10中所展示之經旋轉感測器結構設計之一情況。從影像1205及1207(虛線)可明白,在未補償旋轉偏移時,經捕捉之影像1207失去受關注場景1203之一部分(例如,虛線框外之部分)。因此,可明白,當相比於參考影像1205,影像區域1207失去場景中之受關注部分,此係因為受關注場景區域1203之部分落於由虛線指示之影像捕捉區域外。圖式1208展示由使用根據本發明之一經旋轉感測器之一例示性攝像機模組(諸如攝像機模組302、304、308、310、312、314、318及320之任一者)捕捉之一影像1209。因此,不顧不同安裝配置、一鏡之使用及由攝像機模組(參考攝像機模組(例如,326)及具有偏移經補償之感測器對準之經旋轉攝像機模組(例如,302))引入之旋轉偏移,兩個模組將歸因於模組302中之感測器相對於用於攝像機模組302中之感測器安裝板之有意旋轉而捕捉相同受關注場景區域。 Figure 12 contains various diagrams for facilitating an understanding of one aspect of the present invention, including showing one of the patterns 1202 of one of the referenced reference scenes 1203 captured using the multi-camera system of Figure 3. The schema 1204 includes an image 1205 of the referenced reference scene 1203 that captures an exemplary image by a reference camera module, such as the forward camera module 326, 328, 330, 332, or 334. Figure 1206 shows an image 1207 (shown in phantom) of a portion of the reference scene 1203 that will be captured by one of the camera modules having a rotational offset, provided that the offset is not compensated by a corresponding sensor rotation, thus Demonstrating that images are executed by one of camera modules (such as camera modules 302, 304, 308, 310, 312, 314, 318, and 320) One of the cases of the rotational sensor structure design shown in Figures 9 and 10 is captured but not captured. As can be appreciated from images 1205 and 1207 (dashed lines), the captured image 1207 loses a portion of the scene of interest 1203 (eg, a portion outside the dashed box) when the rotational offset is not compensated. Thus, it can be appreciated that when compared to the reference image 1205, the image area 1207 loses the portion of interest in the scene because the portion of the scene of interest 1203 falls outside of the image capture area indicated by the dashed line. 1208 shows one of the captures of an exemplary camera module (such as any of camera modules 302, 304, 308, 310, 312, 314, 318, and 320) using one of the rotated sensors in accordance with the present invention. Image 1209. Therefore, regardless of the different mounting configurations, the use of a mirror, and the camera module (reference camera module (eg, 326) and rotated camera module with offset compensated sensor alignment (eg, 302)) With the introduced rotational offset, the two modules will capture the same scene of interest due to the intentional rotation of the sensor in module 302 relative to the sensor mounting plate used in camera module 302.

眾多額外變動及組合係可能的,同時保留在本發明之範疇內。 Numerous additional variations and combinations are possible while remaining within the scope of the invention.

本發明之技術可使用軟體、硬體及/或軟體及硬體之一組合來實施。本發明涉及設備,例如,包含一或多個攝像機或攝像機模組之專用攝像機裝置、行動電話及/或其他裝置。本發明亦涉及方法,例如,根據本發明控制及/或操作攝像機、包含一攝像機之裝置、攝像機模組等之方法。本發明亦涉及機器可讀媒體,例如,ROM、RAM、CD、硬碟機等,其等包含用於控制一機器以實施根據本發明之一或多個步驟之機器可讀指令。 The techniques of the present invention can be implemented using a combination of software, hardware, and/or a combination of a soft body and a hardware. The present invention relates to devices, such as dedicated camera devices, mobile phones, and/or other devices that include one or more cameras or camera modules. The invention also relates to methods, such as methods of controlling and/or operating a camera, a device including a camera, a camera module, etc., in accordance with the present invention. The invention also relates to a machine readable medium, such as a ROM, RAM, CD, hard drive, etc., which includes machine readable instructions for controlling a machine to perform one or more steps in accordance with the present invention.

在各項實施例中,本文中所述之裝置係使用一或多個模組來實施以執行對應於本發明之一或多種方法之步驟,例如,影像捕捉之控制及/或影像之組合。因此,在一些實施例中,本發明之各種特徵係使用模組來實施。此等模組可使用軟體、硬體或軟體及硬體之一組合來實施。在硬體實施方案之情況中,依硬體實施之實施例可將電路用作一模組之部分或全部。替代地,模組可依硬體實施為一或多個電路 及光學元件(諸如透鏡及/或其他硬體元件)之一組合。因此,在至少一些實施例中,一或多個模組及有時所有模組係完全依硬體來實施。在一些實施例中,模組實施為一程序中之邏輯,其中不同邏輯用於各模組。上文所述方法或方法步驟之許多可使用包含於一機器可讀媒體(諸如一記憶體裝置,例如,RAM、軟碟等)中之機器可執行指令(諸如軟體)來實施,以控制具有或無額外硬體之一機器(例如,一攝像機裝置或通用電腦),以例如在一或多個節點中實施上文所述方法之全部或部分。據此,本發明尤其涉及一機器可讀媒體,其包含用於導致或控制一機器(例如,處理器及相關聯硬體)以執行例如,上文所述之方法之步驟之一或多者或者全部之機器可執行指令。 In various embodiments, the devices described herein are implemented using one or more modules to perform steps corresponding to one or more methods of the present invention, such as image capture control and/or combination of images. Thus, in some embodiments, various features of the invention are implemented using a module. These modules can be implemented using a combination of software, hardware or a combination of software and hardware. In the case of a hardware implementation, the hardware-implemented embodiment can use the circuit as part or all of a module. Alternatively, the module can be implemented as one or more circuits by hardware And a combination of optical elements such as lenses and/or other hardware components. Thus, in at least some embodiments, one or more modules and sometimes all of the modules are implemented entirely in hardware. In some embodiments, the modules are implemented as logic in a program in which different logic is used for each module. Many of the methods or method steps described above can be implemented using machine-executable instructions (such as software) contained in a machine-readable medium (such as a memory device, such as a RAM, floppy disk, etc.) to control Or one of the machines without additional hardware (eg, a camera device or a general purpose computer), for example, implementing all or part of the methods described above in one or more nodes. Accordingly, the present invention is particularly directed to a machine readable medium comprising one or more of the steps for causing or controlling a machine (eg, a processor and associated hardware) to perform, for example, the methods described above. Or all machine executable instructions.

在一些實施例中,一攝像機之處理器經結構設計以控制攝像機以實施根據本發明之方法。 In some embodiments, a camera processor is structurally designed to control the camera to implement the method in accordance with the present invention.

雖然在一攝像機之內容脈絡中描述,但本發明之方法及設備之至少一些適用於廣範圍之影像捕捉系統,包含支援或提供影像捕捉功能之平板電腦及行動電話裝置。 Although described in the context of a camera, at least some of the methods and apparatus of the present invention are applicable to a wide range of image capture systems, including tablet and mobile phone devices that support or provide image capture functionality.

由本文中所述之攝像機裝置捕捉之影像可為可用於存檔一施工場地、一事故之狀況及/或可用於保留個人資訊(資訊係關於一住宅或車輛之狀況)之真實世界影像。 The images captured by the camera device described herein may be real-world images that may be used to archive a construction site, an accident, and/or may be used to retain personal information (information about a home or vehicle).

經捕捉之影像及/或合成影像可且有時顯示於攝像機裝置上或發送至一列印機以列印為可作為一個人或商業記錄之部分維持於一檔案中之一照片或永久性文件。 The captured image and/or composite image may and sometimes be displayed on the camera device or sent to a printer for printing as a photo or permanent file that can be maintained as a portion of a person or business record in a file.

在一項例示性實施例中,一種攝像機裝置包含一第一光學鏈,該第一光學鏈包含一第一感測器,該第一感測器具有包含一第一邊緣之一第一矩形影像感測區域,該第一感測器至少:i)安裝於一第一印刷電路板上,其中該第一邊緣相對於該第一印刷電路板之一第一邊緣成一第一角度旋轉;或ii)安裝於一第一攝像機模組外殼中,其中該第 一邊緣相對於一第一攝像機模組外殼之一平坦安裝表面成一角度旋轉。在此一攝像機裝置之一項實施例中,該第一感測器安裝於該攝像機外殼中,且其中該第一邊緣為相對於該外殼之平坦安裝表面成一非零角度安裝之該第一感測器之一筆直邊緣。在一些實施例中,該外殼之平坦安裝表面為該第一光學鏈之一頂部或底部表面,該安裝表面固定至該攝像機中之上方安裝至少一個其他攝像機模組之一攝像機模組安裝板。在一些實施例中,該平坦安裝表面安裝於一攝像機殼體中,其中該平坦安裝表面固定至一安裝板,該安裝板在一攝像機殼體中在平行於或大體上平行於該攝像機殼體之背面之一平面中延伸。該安裝板可為且有時為多個攝像機模組所固定之一板,該板定位於該攝像機裝置之前表面後方且平行於該攝像機裝置之該前表面。 In an exemplary embodiment, a camera device includes a first optical chain, the first optical chain includes a first sensor, and the first sensor has a first rectangular image including a first edge a sensing area, the first sensor being at least: i) mounted on a first printed circuit board, wherein the first edge rotates at a first angle relative to a first edge of the first printed circuit board; or ii ) installed in a first camera module housing, wherein the first An edge rotates at an angle relative to a flat mounting surface of a first camera module housing. In an embodiment of the camera device, the first sensor is mounted in the camera housing, and wherein the first edge is mounted at a non-zero angle relative to a flat mounting surface of the housing. One of the detectors has a straight edge. In some embodiments, the flat mounting surface of the housing is a top or bottom surface of the first optical chain, the mounting surface being secured to the camera module mounting plate of one of the at least one other camera module mounted above the camera. In some embodiments, the flat mounting surface is mounted in a camera housing, wherein the flat mounting surface is secured to a mounting plate that is parallel or substantially parallel to the camera housing in a camera housing The back side extends in one of the planes. The mounting plate can be, and sometimes is, one of a plurality of camera modules, the plate being positioned behind the front surface of the camera device and parallel to the front surface of the camera device.

在一些實施例中,該第一感測器安裝於一印刷電路板上,其中不同攝像機模組具有上方安裝感測器之不同電路板。在一些實施例中,該攝像機裝置為可被併入至另一裝置中之單個攝像機模組。在一些實施例中,該第一光學鏈包含一鏡。 In some embodiments, the first sensor is mounted on a printed circuit board, wherein different camera modules have different boards on which the sensors are mounted. In some embodiments, the camera device is a single camera module that can be incorporated into another device. In some embodiments, the first optical chain comprises a mirror.

在一些實施例中,該第一角度為小於90度之一非零角度。在一些實施例中,該攝像機裝置包含多個光學鏈,一些具有鏡且一些無鏡。在一項實施例中,該攝像機裝置包含不包含一鏡之至少一個額外光學鏈,該額外光學鏈包含一額外矩形感測器,其中該額外矩形感測器之一底部部分平行於該攝像機殼體之底部延伸。在一些實施例中,該額外光學鏈正對該攝像機裝置之面,且該額外光學鏈之感測器垂直於該第一光學鏈之感測器安裝。 In some embodiments, the first angle is one of less than 90 degrees non-zero angle. In some embodiments, the camera device includes a plurality of optical chains, some having mirrors and some without mirrors. In one embodiment, the camera device includes at least one additional optical chain that does not include a mirror, the additional optical chain including an additional rectangular sensor, wherein a bottom portion of the additional rectangular sensor is parallel to the camera housing The bottom of the body extends. In some embodiments, the additional optical chain is facing the face of the camera device and the sensor of the additional optical chain is mounted perpendicular to the sensor of the first optical chain.

在一些實施例中,包含第一光學鏈之攝像機裝置包含一第二光學鏈,該第二光學鏈包含一第二感測器,該第二感測器具有相對於上方安裝該第二感測器之一第二印刷電路板之底部成一第二角度旋轉之一第二矩形影像感測區域,該第二角度不同於該第一感測器相對於該 第一邊緣安裝之一第一角度,該第一邊緣為該第一印刷電路板之一底部邊緣。 In some embodiments, the camera device including the first optical chain includes a second optical chain, the second optical chain includes a second sensor, and the second sensor has the second sensing mounted opposite thereto One of the second printed circuit boards rotates at a second angle to rotate a second rectangular image sensing area, the second angle being different from the first sensor relative to the The first edge mounts a first angle, the first edge being a bottom edge of the first printed circuit board.

在至少一些實施例中,該攝像機裝置包含一攝像機殼體,該攝像機殼體包含一底部,且該第一光學鏈包含一鏡,其中該第一光學鏈具有一光軸,該光軸之一部分相對於該攝像機殼體之底部成一非零角度;且其中該攝像機裝置進一步包含一第二光學鏈,該第二光學鏈不包含一鏡但具有一第二感測器,其中一底部邊緣平行於該攝像機殼體之底部安裝。在一此實施例中,該攝像機裝置進一步包含一處理器,該處理器經結構設計以藉由組合由該第一光學鏈捕捉之一場景區域之一第一影像及由該第二光學鏈捕捉之場景區域之一第二影像產生一合成影像,而無需對該第一影像或該第二影像執行一影像旋轉操作。 In at least some embodiments, the camera device includes a camera housing, the camera housing includes a bottom, and the first optical chain includes a mirror, wherein the first optical chain has an optical axis, and a portion of the optical axis Forming a non-zero angle with respect to the bottom of the camera housing; and wherein the camera device further includes a second optical chain, the second optical chain does not include a mirror but has a second sensor, wherein a bottom edge is parallel to The bottom of the camera housing is mounted. In one embodiment, the camera device further includes a processor configured to capture a first image of one of the scene regions captured by the first optical chain and capture by the second optical chain The second image of one of the scene regions produces a composite image without performing an image rotation operation on the first image or the second image.

各項實施例涉及一種操作一攝像機裝置(諸如圖3中所展示之攝像機裝置)之方法。 Various embodiments are directed to a method of operating a camera device, such as the camera device shown in FIG.

圖13繪示操作一攝像機裝置之一種例示性方法之步驟。該方法在步驟1302中開始,其中該攝像機裝置(例如,攝像機裝置100、200或300)之處理器控制該攝像機裝置以實施該方法。在步驟1304中,該處理器操作一第一攝像機模組(例如,攝像機300之攝像機模組310)以捕捉一場景區域之一第一影像,該第一攝像機模組包含一第一鏡及一第一感測器,該第一感測器相對於上方安裝該第一感測器之一第一印刷電路板之一底部成一第一角度安裝。接著,在步驟1306中,該處理器操作一第二攝像機模組(例如,模組302)以捕捉該場景區域之一第二影像,該第二攝像機模組包含一第二鏡及一第二感測器,該感測器相對於上方安裝該第二感測器之一第二印刷電路板之一底部成一第二角度安裝,該第二角度不同於該第一角度。接著,在步驟1308中,該處理器操作不包含一鏡之一第三攝像機模組(例如,攝像機模組326)以捕捉該場景區域之一第三影像。在步驟1310中,在攝像機300中包 含之控制邏輯及/或一控制常式下,操作該處理器以從經捕捉之影像產生一合成影像。在步驟1312中,該處理器組合該第一影像及該第二影像以產生該場景區域之一合成影像,而無需對該第一影像及該第二影像之任一者執行一計算旋轉操作。在其中該第三攝像機模組用來捕捉該場景區域之一第三影像之實施例中,步驟1310包含步驟1314,其中該處理器組合該第一影像及該第二影像以產生該場景區域之一合成影像進一步包含組合該第一影像及該第二影像與該第三影像而無需對該第一影像、該第二影像及該第三影像之任一者執行一計算旋轉操作。在一些實施例中,操作從步驟1310繼續至步驟1315,其中該等經產生之合成影像經傳輸、儲存於記憶體中及/或顯示於攝像機之顯示裝置或另一顯示裝置上。 Figure 13 illustrates the steps of an exemplary method of operating a camera device. The method begins in step 1302, wherein a processor of the camera device (eg, camera device 100, 200, or 300) controls the camera device to implement the method. In step 1304, the processor operates a first camera module (for example, the camera module 310 of the camera 300) to capture a first image of a scene region, the first camera module includes a first mirror and a first camera module. The first sensor is mounted at a first angle with respect to a bottom of one of the first printed circuit boards on which the first sensor is mounted. Next, in step 1306, the processor operates a second camera module (eg, module 302) to capture a second image of the scene region, the second camera module includes a second mirror and a second a sensor mounted at a second angle with respect to a bottom of one of the second printed circuit boards on which the second sensor is mounted, the second angle being different from the first angle. Next, in step 1308, the processor operates to include a third camera module (eg, camera module 326) of one of the mirrors to capture a third image of the scene region. In step 1310, the package is included in the camera 300. The control logic and/or a control routine is operable to generate a composite image from the captured image. In step 1312, the processor combines the first image and the second image to generate a composite image of the scene region without performing a computational rotation operation on any of the first image and the second image. In an embodiment in which the third camera module is configured to capture a third image of the scene region, step 1310 includes a step 1314, wherein the processor combines the first image and the second image to generate the scene region. The composite image further includes combining the first image and the second image with the third image without performing a computational rotation operation on any of the first image, the second image, and the third image. In some embodiments, operation continues from step 1310 to step 1315, wherein the generated composite images are transmitted, stored in a memory, and/or displayed on a display device of the camera or another display device.

操作繼續從步驟1315返回至步驟1304,其中例如在一較遲時間可捕捉該場景區域之額外影像以根據該方法進行處理。因此,返回箭頭用於指示可在不同時間,例如基於觸發實施影像捕捉及/或方法1300之使用者輸入捕捉並組合額外影像。雖然參考3個攝像機模組說明本方法,但攝像機300之5個、7個、10個或所有攝像機模組可且在一些實施例中並行操作以捕捉影像且接著例如在步驟1310中組合該等影像以產生一合成影像,而無需或不實施作為組合程序之部分之經捕捉影像之任一者之一計算旋轉。 Operation continues from step 1315 to step 1304, where additional images of the scene region may be captured, for example, at a later time to be processed in accordance with the method. Thus, a return arrow is used to indicate that additional images can be captured and combined at different times, such as based on user input that triggers image capture and/or method 1300. Although the method is described with reference to three camera modules, five, seven, ten, or all camera modules of camera 300 can and in some embodiments operate in parallel to capture images and then combine them, for example, in step 1310. The image is used to produce a composite image, with or without one of the captured images that are part of the combined program.

雖然經旋轉感測器之使用允許組合避免對影像旋轉之需要,但在一些實施例中,所有實施方案未必排除作為組合程序之部分之影像之一或多者之旋轉,且一些影像可作為該組合之部分而被旋轉。 While the use of a rotary sensor allows the combination to avoid the need for image rotation, in some embodiments, all embodiments do not necessarily exclude rotation of one or more of the images that are part of the combined program, and some images may serve as The part of the combination is rotated.

在該方法之一些實施例中,第一角度為小於90度之一非零角度且第二角度為小於90度之一第二不同非零角度。在一些實施例中,用來實施該方法之第一攝像機模組及第二攝像機模組相對於該攝像機裝置之底部成一角度安裝,且其中該第三攝像機模組經安裝,使得第三 感測器之底部在該攝像機裝置中平行於該攝像機裝置之底部從左至右延伸。 In some embodiments of the method, the first angle is one of less than 90 degrees non-zero angle and the second angle is one of less than 90 degrees of the second different non-zero angle. In some embodiments, the first camera module and the second camera module for implementing the method are mounted at an angle relative to a bottom of the camera device, and wherein the third camera module is mounted such that the third The bottom of the sensor extends from left to right parallel to the bottom of the camera device in the camera device.

鑑於本發明之上文描述,熟習此項技術者將暸解上文所述之本發明之方法及設備之眾多額外變動。此等變動應被視為在本發明之範疇內。在各項實施例中,攝像機裝置被實施為數位攝像機、視訊攝像機、筆記型電腦、個人資料助理(PDA)或其他可攜式裝置,其等包含用於實施本發明之方法及/或將經捕捉之影像或經產生之合成影像傳輸至其他裝置進行儲存或顯示之接收器/傳輸器電路及邏輯及/或常式。 In view of the above description of the invention, those skilled in the art will be aware of numerous additional variations of the methods and apparatus of the invention described above. Such variations are considered to be within the scope of the invention. In various embodiments, the camera device is implemented as a digital camera, video camera, notebook computer, personal data assistant (PDA), or other portable device, etc., including methods for practicing the present invention and/or The captured image or the resulting synthetic image is transmitted to other devices for storage or display of the receiver/transmitter circuit and logic and/or routine.

眾多額外變動及組合係可能的,同時保留在本發明之範疇內。在一些實施例中實施之攝像機具有在使用期間不延伸超出攝像機之正面且被實施為可攜式手持型攝像機或包含攝像機之裝置之光學鏈。此等裝置可且在一些實施例中確實具有一相對較平坦正面,其中最外面透鏡或透明例如(扁平玻璃或塑膠)光學鏈覆蓋物用來覆蓋被固定光學鏈之正面處之光圈。然而,在其他實施例中,一光學鏈之透鏡及/或其他元件可且有時確實延伸超出攝像機裝置之面。 Numerous additional variations and combinations are possible while remaining within the scope of the invention. A camera implemented in some embodiments has an optical chain that does not extend beyond the front of the camera during use and is implemented as a portable handheld camera or a device that includes a camera. Such devices may, and in some embodiments do, have a relatively flat front surface with an outermost lens or transparent (e.g., flat glass or plastic) optical chain cover for covering the aperture at the front side of the fixed optical chain. However, in other embodiments, the lenses and/or other components of an optical chain can and sometimes do extend beyond the face of the camera device.

在各項實施例中,攝像機裝置被實施為數位攝像機、視訊攝像機、筆記型電腦、個人資料整理(PDA)或其他可攜式裝置,其等包含用於實施本發明之方法及/或將經捕捉之影像或經產生之合成影像傳輸至其他裝置進行儲存或顯示之接收器/傳輸器電路及邏輯及/或常式。 In various embodiments, the camera device is implemented as a digital camera, video camera, notebook computer, personal data processing (PDA) or other portable device, etc., including methods for practicing the present invention and/or The captured image or the resulting synthetic image is transmitted to other devices for storage or display of the receiver/transmitter circuit and logic and/or routine.

眾多額外實施例係可能的,同時保留在上文所論述之特徵之範疇內。 Numerous additional embodiments are possible while remaining within the scope of the features discussed above.

900‧‧‧總成 900‧‧‧assembly

901‧‧‧光軸 901‧‧‧ optical axis

902‧‧‧透鏡鏡筒總成 902‧‧‧ lens barrel assembly

903‧‧‧開口 903‧‧‧ openings

904‧‧‧感測器總成 904‧‧‧Sensor assembly

906‧‧‧透鏡 906‧‧‧ lens

908‧‧‧透鏡 908‧‧‧ lens

910‧‧‧感測器安裝板/印刷電路板(PCB) 910‧‧‧Sensor Mounting Board/Printed Circuit Board (PCB)

912‧‧‧感測器區域 912‧‧‧Sensor area

914‧‧‧矩形區域/光學作用影像感測區域/感測器之光學作用區域/感測器矩形光學作用區域 914‧‧‧Rectangular area/optical action image sensing area/sensor optical area/sensor rectangular optical area

920‧‧‧線 920‧‧‧ line

Claims (17)

一種攝像機裝置,其包括:一第一光學鏈,其包含一第一感測器,該第一感測器具有包含一第一邊緣之一第一矩形影像感測區域,該第一感測器安裝於一第一攝像機模組外殼中,其中該第一邊緣相對於該第一攝像機模組外殼之一平坦安裝表面成一角度旋轉,其中該第一邊緣為該第一感測器之一筆直邊緣,該第一感測器相對於該外殼之該平坦安裝表面成一非零角度安裝於一第一印刷電路板上。 A camera device includes: a first optical chain, comprising a first sensor, the first sensor having a first rectangular image sensing area including a first edge, the first sensor Mounted in a first camera module housing, wherein the first edge rotates at an angle relative to a flat mounting surface of the first camera module housing, wherein the first edge is a straight edge of the first sensor The first sensor is mounted on a first printed circuit board at a non-zero angle relative to the flat mounting surface of the housing. 如請求項1之攝像機裝置,其中該外殼之該平坦安裝表面為該第一光學鏈之一頂部或底部表面,該安裝表面固定至該攝像機中之上方安裝至少一個其他攝像機模組之一攝像機模組安裝板。 The camera device of claim 1, wherein the flat mounting surface of the outer casing is a top or bottom surface of the first optical chain, and the mounting surface is fixed to the camera to mount one of the at least one other camera module. Group mounting plate. 如請求項1之攝像機裝置,其中該平坦安裝表面安裝於一攝像機殼體中,其中該平坦安裝表面固定至一安裝板,該安裝板在一攝像機殼體中在平行於或大體上平行於該攝像機殼體之背面之一平面中延伸。 The camera device of claim 1, wherein the flat mounting surface is mounted in a camera housing, wherein the flat mounting surface is secured to a mounting plate that is parallel or substantially parallel to the camera housing The back of the camera housing extends in a plane. 如請求項3之攝像機裝置,其中該第一感測器安裝於該印刷電路板上。 The camera device of claim 3, wherein the first sensor is mounted on the printed circuit board. 如請求項1之攝像機裝置,其中該攝像機裝置為該第一光學鏈;且其中該第一攝像機模組外殼之該平坦安裝表面為該第一光學鏈之一頂部或底部表面,用於固定該第一攝像機模組外殼至一攝像機模組安裝板。 The camera device of claim 1, wherein the camera device is the first optical chain; and wherein the flat mounting surface of the first camera module housing is a top or bottom surface of the first optical chain for fixing the The first camera module housing to a camera module mounting plate. 如請求項1之攝像機裝置,其中該第一光學鏈進一步包含一第一鏡。 The camera device of claim 1, wherein the first optical chain further comprises a first mirror. 如請求項1之攝像機裝置,其中該第一角度為小於90度之一非零角度。 The camera device of claim 1, wherein the first angle is a non-zero angle that is less than 90 degrees. 如請求項1之攝像機裝置,其進一步包括:一額外光學鏈,其不包含一額外鏡,該額外光學鏈包含一額外矩形感測器,其中該額外矩形感測器之一底部部分平行於該攝像機殼體之底部延伸。 The camera device of claim 1, further comprising: an additional optical chain that does not include an additional mirror, the additional optical chain comprising an additional rectangular sensor, wherein a bottom portion of the additional rectangular sensor is parallel to the The bottom of the camera housing extends. 如請求項8之攝像機裝置,其中該額外光學鏈正對該攝像機裝置之面,且其中該額外光學鏈之該感測器垂直於該第一光學鏈之該感測器安裝。 The camera device of claim 8, wherein the additional optical chain is facing the camera device, and wherein the sensor of the additional optical chain is mounted perpendicular to the sensor of the first optical chain. 如請求項1之攝像機裝置,其進一步包括:一第二光學鏈,其包含一第二感測器,該第二感測器具有相對於上方安裝該第二感測器之一第二印刷電路板之底部成一第二角度旋轉之一第二矩形影像感測區域,該第二角度不同於該第一感測器相對於該第一邊緣安裝之一第一角度,該第一邊緣為該第一印刷電路板之一底部邊緣。 The camera device of claim 1, further comprising: a second optical chain comprising a second sensor, the second sensor having one of the second sensors mounted with respect to the second printed circuit The bottom of the board rotates at a second angle to rotate a second rectangular image sensing area, the second angle being different from the first angle of the first sensor mounted relative to the first edge, the first edge being the first A bottom edge of one of the printed circuit boards. 如請求項1之攝像機裝置,其進一步包括:一攝像機殼體,其包含一底部;其中該第一光學鏈包含一鏡且具有一光軸,該光軸之一部分相對於該攝像機殼體之該底部成一非零角度;且其中該攝像機裝置進一步包含一第二光學鏈,該第二光學鏈不包含一鏡但具有一第二感測器,其中一底部邊緣平行於該攝像機殼體之該底部安裝。 The camera device of claim 1, further comprising: a camera housing including a bottom; wherein the first optical chain includes a mirror and has an optical axis, and one of the optical axes is partially opposite to the camera housing The bottom portion is at a non-zero angle; and wherein the camera device further comprises a second optical chain, the second optical chain does not include a mirror but has a second sensor, wherein a bottom edge is parallel to the bottom of the camera housing installation. 如請求項11之攝像機裝置,其進一步包括:一處理器,其經結構設計以藉由組合由該第一光學鏈捕捉之一場景區域之一第一影像及由該第二光學鏈捕捉之該場景區域之一第二影像產生一合成影像,而無需對該第一影像或該第二 影像執行一影像旋轉操作。 The camera device of claim 11, further comprising: a processor configured to capture the first image of one of the scene regions captured by the first optical chain and captured by the second optical chain The second image of one of the scene regions produces a composite image without the first image or the second image The image performs an image rotation operation. 一種操作一攝像機裝置之方法,該方法包括:操作一第一攝像機模組以捕捉一場景區域之一影像,該第一攝像機模組包含一第一鏡及一第一感測器,該第一感測器相對於上方安裝該第一感測器之一第一印刷電路板之一底部成一第一角度安裝;操作一第二攝像機模組以捕捉該場景區域之一第二影像,該第二攝像機模組包含一第二鏡及一第二感測器,該感測器相對於上方安裝該第二感測器之一第二印刷電路板之一底部成一第二角度安裝,該第二角度不同於該第一角度;及操作一處理器以組合該第一影像及該第二影像以產生該場景區域之一合成影像,而無需對該第一影像及該第二影像之任一者執行一計算旋轉操作。 A method for operating a camera device, the method comprising: operating a first camera module to capture an image of a scene region, the first camera module comprising a first mirror and a first sensor, the first The sensor is mounted at a first angle with respect to a bottom of one of the first printed circuit boards on which the first sensor is mounted; a second camera module is operated to capture a second image of the scene region, the second The camera module includes a second mirror and a second sensor. The sensor is mounted at a second angle with respect to a bottom portion of the second printed circuit board on which the second sensor is mounted. The second angle is Different from the first angle; and operating a processor to combine the first image and the second image to generate a composite image of the scene region without performing execution on any of the first image and the second image A calculation of the rotation operation. 如請求項13之方法,其進一步包括:操作不包含一鏡之一第三攝像機模組以捕捉該場景區域之一第三影像;且其中操作一處理器以組合該第一影像及該第二影像以產生該場景區域之一合成影像進一步包含組合該第一影像及該第二影像與該第三影像,而無需對該第一影像、該第二影像及該第三影像之任一者執行一計算旋轉操作。 The method of claim 13, further comprising: operating a third camera module that does not include a mirror to capture a third image of the scene region; and operating a processor to combine the first image and the second The synthesizing the image to generate the one of the scene regions further includes combining the first image and the second image with the third image without performing execution on the first image, the second image, and the third image A calculation of the rotation operation. 如請求項13之方法,其中該第一角度為小於90度之一非零角度。 The method of claim 13, wherein the first angle is a non-zero angle that is less than 90 degrees. 如請求項15之方法,其中該第二角度為小於90度之一非零角度。 The method of claim 15, wherein the second angle is one of less than 90 degrees non-zero angle. 如請求項15之方法,其中該第一攝像機模組及該第二攝像機模組相對於該攝像機裝置之該底部成一角度安裝,且其中該第三 攝像機模組經安裝,使得該第三感測器之底部在該攝像機裝置中平行於該攝像機裝置之該底部從左至右延伸。 The method of claim 15, wherein the first camera module and the second camera module are mounted at an angle relative to the bottom of the camera device, and wherein the third The camera module is mounted such that the bottom of the third sensor extends from left to right parallel to the bottom of the camera device in the camera device.
TW104144065A 2015-10-06 2015-12-28 Methods and apparatus for implementing and using camera devices TWI612807B (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201562238046P 2015-10-06 2015-10-06
US62/238,046 2015-10-06
PCT/US2015/066532 WO2016100756A1 (en) 2014-12-17 2015-12-17 Methods and apparatus for implementing and using camera devices
??PCT/US15/66532 2015-12-17
US14/977,203 US9998638B2 (en) 2014-12-17 2015-12-21 Methods and apparatus for implementing and using camera devices
US14/977,203 2015-12-21

Publications (2)

Publication Number Publication Date
TW201714449A TW201714449A (en) 2017-04-16
TWI612807B true TWI612807B (en) 2018-01-21

Family

ID=59298010

Family Applications (1)

Application Number Title Priority Date Filing Date
TW104144065A TWI612807B (en) 2015-10-06 2015-12-28 Methods and apparatus for implementing and using camera devices

Country Status (1)

Country Link
TW (1) TWI612807B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070127915A1 (en) * 2005-12-02 2007-06-07 Premier Image Technology Corporation Digital camera

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070127915A1 (en) * 2005-12-02 2007-06-07 Premier Image Technology Corporation Digital camera

Also Published As

Publication number Publication date
TW201714449A (en) 2017-04-16

Similar Documents

Publication Publication Date Title
US10674050B2 (en) Methods and apparatus for implementing and using camera devices
US10523872B2 (en) Methods and apparatus for implementing zoom using one or more moveable camera modules
US10353195B2 (en) Camera device methods, apparatus and components
US9930233B2 (en) Filter mounting methods and apparatus and related camera apparatus
US10516834B2 (en) Methods and apparatus for facilitating selective blurring of one or more image portions
US9979878B2 (en) Intuitive camera user interface methods and apparatus
US10003738B2 (en) Methods and apparatus for detecting and/or indicating a blocked sensor or camera module
US10091447B2 (en) Methods and apparatus for synchronizing readout of multiple image sensors
CN104519265B (en) A kind of terminal device and image capture method
CN100510931C (en) Image capture device
JP5354168B2 (en) Projector and control method
KR100562161B1 (en) Digital image capturing apparatus capable of capturing images from different directions
US20170111570A1 (en) Mobile terminal
US9111484B2 (en) Electronic device for scene evaluation and image projection onto non-planar screens
TWI612807B (en) Methods and apparatus for implementing and using camera devices
US9948832B2 (en) Methods and apparatus for synchronized image capture in a device including optical chains with different orientations
JP2010145707A (en) Device
JP2014107735A (en) Imaging apparatus
JP6838960B2 (en) Imaging device
JP2011259166A (en) Imaging apparatus
JP2006246074A (en) Imaging device
JP2008236368A (en) Motor-driven universal head cradle
JP2015070337A (en) Imaging apparatus, imaging method and program