TW201109817A - Imaging system with multiple perspective angles and method thereof - Google Patents

Imaging system with multiple perspective angles and method thereof Download PDF

Info

Publication number
TW201109817A
TW201109817A TW098129739A TW98129739A TW201109817A TW 201109817 A TW201109817 A TW 201109817A TW 098129739 A TW098129739 A TW 098129739A TW 98129739 A TW98129739 A TW 98129739A TW 201109817 A TW201109817 A TW 201109817A
Authority
TW
Taiwan
Prior art keywords
optical module
image
module
camera system
image sensor
Prior art date
Application number
TW098129739A
Other languages
Chinese (zh)
Other versions
TWI392952B (en
Inventor
Cheng-Huan Chen
Original Assignee
Nat Univ Tsing Hua
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nat Univ Tsing Hua filed Critical Nat Univ Tsing Hua
Priority to TW098129739A priority Critical patent/TWI392952B/en
Publication of TW201109817A publication Critical patent/TW201109817A/en
Application granted granted Critical
Publication of TWI392952B publication Critical patent/TWI392952B/en

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The present invention is related to an imaging system with multiple perspective angles and a method thereof and applied to that using a fixed image sensor to capture images of different perspective angles of an object. The method comprises the steps of: (S1) providing a track, which has a plurality of positions corresponding to the plurality of perspective angles of the object; (S2) providing a pre-stage optical module on one of the positions of the track to receive the image of the object and projecting the image; (S3) providing a post-stage optical module to aim at the light path between the pre-stage optical module and an image sensor in order to let the image projected from the pre-stage optical module be introduced to the image sensor; (S4) controlling the image sensor to capture the image; and (S5) moving the pre-stage optical module to another position of the track. Restarting the step (S1) may not be stopped until all the images are captured.

Description

201109817 六、發明說明: 【發明所屬之技術領域】 本發明係關於一種攝像方法,尤指一種多視角攝像方 法及系統。 【先前技術】 隨著數位影像科技的蓬勃發展,結合於電視廣播與網 際網路的影音多媒體應用型態,係日益多元豐富。 在眾多影像展現種類中,環物影像展示為一種讓畫面 由平面轉為立體的處理技術。其建置程序,係先取得特定 景物各個不同視角的影像,再使用輔助軟體進行影像比對 與重建,進而縫接成平滑的立體擬真影像。.完成建構的影 像物件可透過動畫播放或介面操作,來展現景物不同視角 畫面,讓觀賞者產生貼近實境的感覺。 多視角影像除了應用於環物展示影像之外,亦可作為 立體三維視訊内容的素材。簡單來說,立體三維影像是以 一維影像為基礎,提供左右眼分別觀看不同視角的暫態或 父錯畫面,讓觀賞者產生立體視覺。立體三維影像為新一 代視訊發展重點項目之—,目前專責組織已在擬定標準, °丁疋透過電視、電腦、手機等各種消費性系統所播放的立 體三維視訊内容規格。 般而g,多視角影像擷取可藉由兩種方式,其一係 於目標物周圍定點設置攝像裝置,操取個別所在位置之視 201109817 角影像;另一種方式則是由拍攝者攜帶攝像裝置繞行景物 周圍,沿途於各個不同視角位置停留拍攝目標物。 凊參閱第一圖,該圖係為一習知技術之多視角影像拍 攝裱境之不意圖。如圖所示,執跡p為以目標景物丨〇為軸 心的弧線,上方各個位置均對應目標景物10的不同視角。 當必須取得位置A1、A2、A3對應之特定視.肖影像時,可 在位置Al、A2、A3上分設攝像裝置u、12、13,朝向目201109817 VI. Description of the Invention: [Technical Field] The present invention relates to an imaging method, and more particularly to a multi-view imaging method and system. [Prior Art] With the rapid development of digital imaging technology, the combination of audio and video multimedia applications in TV broadcasting and the Internet is increasingly diverse. Among the many types of image display, the ring image is displayed as a processing technique that turns the picture from flat to solid. The installation program first acquires images of different perspectives of a specific scene, and then uses the auxiliary software to perform image comparison and reconstruction, and then stitches into a smooth stereoscopic image. The completed image object can be displayed through animation or interface operation to show the different perspectives of the scene, so that the viewer can feel close to reality. Multi-view images can be used as a material for stereoscopic 3D video content in addition to ring image display. To put it simply, stereoscopic 3D images are based on one-dimensional images, providing left and right eyes to view different transient or parental images, allowing viewers to produce stereoscopic vision. Stereoscopic 3D imagery is a new generation of video development key projects. Currently, the dedicated organization is already drafting standards. ° Ding's stereoscopic 3D video content specifications are broadcasted through various consumer systems such as TV, computer and mobile phones. Generally, the multi-view image capture can be performed in two ways, one of which is to set the camera device around the target to operate the image of the individual position of the 201109817 angle image; the other way is to carry the camera device by the photographer. Around the scene, stop shooting the target along different points of view. Referring to the first figure, the figure is a schematic view of a multi-view image capturing environment of a prior art. As shown in the figure, the trace p is an arc centered on the target scene ,, and each of the upper positions corresponds to a different angle of view of the target scene 10. When it is necessary to obtain the specific viewing images corresponding to the positions A1, A2, and A3, the imaging devices u, 12, and 13 can be divided at the positions A1, A2, and A3 toward the mesh.

標景物進行拍攝,如此它們便可個別擷取到目標景物1〇的 不同視角影像15 1、15 2、1 5 3。The subject matter is photographed so that they can individually capture images of different perspectives of the target scene 15 1 , 15 2 , 1 5 3 .

上述拍攝環境須同時架設 構調整每一攝像裝置的拍攝角 攝細節改變時,又需待人工重 相當耗時費工。另一方面,採 方式’則不但使得拍攝效率受 隔、拍攝位置等諸多細節。 多部攝像裝置· ’’ _並-由人工建 度。當視角位置、.間隔等拍 建拍攝環境,影像取得過程 用攜帶攝像裝置移動拍攝的 限’並不易精準控制視角間 本案發明人鑒於多視角取像需求將 曰漸增加,尤其在 立體二維視訊内容各項標準即將推出 播放的鬲階立體影像内容不足的情形 改善現有多視角攝像技術的缺失。 之際,卻面臨了可供 。故而提出本案,以 【發明内容】 因此本發明之目的係、在於提供-種多視角攝像方法 及系統,其藉由可移動之前級光學模組、後級光學模組與 201109817 固設之影像感測器間的光路匹配,來取得目標景物的不同 視角影像,係可達成多視角影像满取之自動化,使得攝像 過程及細節更具效率且精準。 本發明係揭示-種多視角攝像方法,係適用於以一固 設之影像感測器摘取-目標景物之影像。.此多視角攝像方 法的步驟為首先,提供一執跡,此軌跡上之各個位置係對 應目標景物的不同視角;其次…前級光學模組於軌跡 上之-位置接收目標景物之影像,並投射出接收之影像; 隨後,以一後級光學模組匹配對準前級光學模組與影像感 測器間之光路,使刖級光學模組所投射之影像進一步投射 至影像感測n ;再來,控制影像.感測器_取影像接著, 移動前級光學模組至軌跡上之另—位置,並重複接收及投 射出目標景物之影像的步驟,以及之後的各個步驟。 於一具體實施例,所述之前級光學模組及後級光學模 組係分別為一曲面反射鏡。 本發明再揭示一種多視角攝像系統,係適用於擷取一 目私,y、物的衫像。此多視角攝像系統包括一控制模組、一 影像擷取模組、—掃描取像單元,以及—光路匹配單元。 。像操取;^組包括—影像感測器’此影像感測器係固設於 定"沾並接梵控制模組的控制,進行影像擷取。掃描取 像單元包括—前級光學模組,並接受控制模組的控制,帶 動月j,、及光子模組沿__軌跡行進。其中該軌跡上之各個位置 201109817 係對應目標景物的不同視角,前級光學模組於軌跡之各個 位置,係接收目標景物之影像,並投射出接收之影像。光 路匹配單元包括一後級光學模組,並接受控制模組的控 制’帶動後級光學模組匹配對準前級光學模組與影像感測 器間之光路,使前級光學模組所投射之該目標景物的影 像,進一步投射至影像感測器。 於一具體實施例,所述之前級光學模組及後級光學模 組係分別為一曲面反射鏡。 是以,本發明所揭示之多視角攝像方法及系統,係控 制前級光學模組沿目標景物周圍移動,接收並投射.出j斤在 位置對應之目標景物影像,並以後級光學模組匹.配對準前 級光學模組與影像感測器之間的光路,使固設之影像感測 器能夠取得目標景物之多視角影像。如此一來,便可利用 自動化程序控制前級光學模組、後級光學模組與影像感測 器之作動,使得多視角攝像過程及細節更具效率且精準。 以上之概述與接下來的詳細說明及附圖,皆是為了能 進-步說明本發明為達成預定目的所採取之方式、手段及 功效。而有關本發明的其他目的及優點,將在後續的說明 及圖式中加以闡述。 【實施方式】 本發明係提出 一種多視角攝像方法及 景物多視角影像之自動化擷取作 業環境, 系統,旨在建構 使拍攝過程更具 201109817 效率與精準。 首先叫參閱第二圖,該圖係為本發明之多視角攝像 系統之一具體實施 之應用不思圖。在此先以多視角攝像 系統2〇的簡明架構說明本案技術概念。.如圖所示…多視 角攝像系統2 0係搞田μ & & 係適用於擷取-目標景物8G的不同視角影In the above shooting environment, it is necessary to adjust the shooting angle of each camera device at the same time, and it takes a lot of time and labor to wait for the manual weight. On the other hand, the adoption method not only makes the shooting efficiency different, but also the shooting position and many other details. Multiple cameras • ’’ _ and – built by hand. When the viewing angle position, the interval, etc. are taken, the image acquisition process uses the mobile camera to move the shooting limit' and it is difficult to accurately control the angle of view. The inventor of the present invention will gradually increase the demand for multi-view imaging, especially in stereoscopic two-dimensional video. The content standards are about to be released. The situation in which the content of the third-order stereoscopic images is insufficient is improved to improve the existing multi-view camera technology. At the time, it is facing the availability. Therefore, the present invention is directed to the present invention. Therefore, the object of the present invention is to provide a multi-view image capturing method and system, which can be fixed by the movable optical module, the rear optical module and the 201109817 image. The optical path matching between the detectors can obtain different perspective images of the target scene, and the automation of multi-view image acquisition can be achieved, which makes the imaging process and details more efficient and accurate. The present invention discloses a multi-view imaging method suitable for extracting an image of a target scene with a fixed image sensor. The multi-view camera method firstly provides a trace, each position on the track corresponds to a different view angle of the target scene; secondly, the front stage optical module receives the image of the target scene at the position on the track, and Projecting the received image; subsequently, the optical circuit between the front optical module and the image sensor is matched by a rear optical module, so that the image projected by the first optical module is further projected to the image sensing n; Then, the image is controlled. The sensor takes the image and then moves the pre-stage optical module to another position on the track, and repeats the steps of receiving and projecting the image of the target scene, and the subsequent steps. In a specific embodiment, the prior optical module and the rear optical module are respectively a curved mirror. The invention further discloses a multi-view camera system, which is suitable for capturing a shirt image of a private, y, object. The multi-view camera system includes a control module, an image capture module, a scan image capture unit, and an optical path matching unit. . The image sensor includes a camera sensor. The scanning imaging unit includes a pre-stage optical module and is controlled by the control module to drive the moon j, and the photonic module to travel along the __ track. Each position on the trajectory 201109817 corresponds to different perspectives of the target scene, and the front optical module receives the image of the target scene at each position of the trajectory, and projects the received image. The optical path matching unit includes a rear stage optical module and is controlled by the control module to drive the rear stage optical module to match the optical path between the front stage optical module and the image sensor, so that the front stage optical module projects The image of the target scene is further projected to the image sensor. In a specific embodiment, the prior optical module and the rear optical module are respectively a curved mirror. Therefore, the multi-view image capturing method and system disclosed by the present invention controls the front-end optical module to move around the target scene, receive and project the target scene image corresponding to the position of the j-jin, and the optical module of the later stage. Aligning the optical path between the front-end optical module and the image sensor enables the fixed image sensor to obtain a multi-view image of the target scene. In this way, the automation program can be used to control the operation of the front-end optical module, the rear-stage optical module and the image sensor, so that the multi-view camera process and details are more efficient and accurate. The above summary, the following detailed description and the accompanying drawings are intended to illustrate the manner, the Other objects and advantages of the present invention will be described in the following description and drawings. [Embodiment] The present invention proposes a multi-view imaging method and an automatic capture operating environment and system for scene multi-view images, which are designed to make the shooting process more efficient and precise. Referring first to the second figure, the figure is an application of one of the multi-view camera systems of the present invention. Here, the technical concept of the present case will be explained by a concise architecture of the multi-view camera system. As shown in the figure...Multi-angle camera system 2 0 is the field μ &&&&&&&&&&&&&&&&&&&

像特別說明的是,所述之目標景物80係指—固定目標點 K之周圍景物。多視角攝像系統2〇包括一掃描取像單元 21、一光路匹配單元22,以及-影像擷取模組25。 其中,影像擷取模組25具有一.影像感測器25〇,其係 固u於—定點’用以操取數位影像資料。所述之影像 感測益250可為一電荷輕合元件(CCD-)或為一互補式金 屬氧化物半導體元件(CMOS) 取模組25可利用數位相機或攝 。於一具體實施例,影像擷 影機來達到其預定功能。 掃描取像單元21具有一座體213,上方設有一軌跡 215,此轨跡215上之各個位置係對應著目標景物8〇的不 同視角。於一具體實施例,軌跡215係為以目標景物80為 轴心的一段弧線。掃描取像單元21具有一前級光學模組 21 〇,可沿著軌跡215行進移動。於此實施例,前級光學模 、’且21 〇係為一曲面反射鏡,其反射曲面可為球面結構或非 球面結構’且鏡面係正對目標景物8〇,於軌跡2丨5之各個 位置均可持續接收並投射出目標景物80的影像。藉由在掃 私取像單元21設置一帶動機構,即可帶動前級光學模組 201109817 210沿軌跡215往復行進,軌跡2 1 5可依該帶動機構之調 整而改變。 光路匹配單元22個別具有一後級光學模組220,係用 以匹配對準前級光學模組210與影像擷取模組_25之間的光 路’使得前級光學模組2 10所投射出的目標景物8〇影像, 經由後級光學模組220進一步投射至固設之影像感測器 250。於此實施例,後級光學模組22〇係為另一曲面反射 鲁鏡’其反射曲面可為球面結構或非球面結構。光路匹配單 元22設有一對準機構,可搭載後級光學模組22〇配合前級 — 光學模組210的位置進行旋轉,以匹配對準前級光學模組 210與影像感測器250之間的光路。 … 後級光學模組前級光學模組接著’請參閱第三圖,該 圖係為本發明之掃描取像單元以及光路匹配單元之第—耳 體實施例之外觀示意圖。此實例中,掃描取像單元41之前 鲁級光學模組410為一曲面反射鏡,其曲面可為球面或非球 面結構,且反射鏡面前進一步設有一透鏡41卜另一方面, 光路匹配單元42之後級光學模組42〇為一曲面反射鏡,其 曲面可為球面或非球面結構,且反射鏡面前進一步設有一 透鏡421。透鏡411、421係用以輔助調整成像位置與消除 像差。 請參閱第四圖,該圖係為本發明之掃描取像單元以及 光路匹配單元之第二具體實施例之外觀示意圖;此實例 201109817 中’掃描取像單元51之前級光學模組 v馬一平面反射 j ’且反射鏡面前設有-魏511。另一方面,光路匹配 單元52之後級光學模組52〇為一平面反射鏡,且反射鏡面 前進一步設有一透鏡521。透鏡511、521 成像位置與消除像差。 . 係用以辅助調整 更進一步,影像擷取模組(該圖未示.)可具有一透鏡As specifically noted, the target scene 80 is referred to as a scene around the fixed target point K. The multi-view camera system 2 includes a scan image capturing unit 21, an optical path matching unit 22, and an image capturing module 25. The image capturing module 25 has an image sensor 25A that is fixed to the fixed point for reading digital image data. The image sensing benefit 250 can be a charge coupled component (CCD-) or a complementary metal oxide semiconductor component (CMOS). The module 25 can utilize a digital camera or camera. In one embodiment, the video camera is to achieve its intended function. The scanning image capturing unit 21 has a body 213, and a track 215 is disposed above, and each position on the track 215 corresponds to a different viewing angle of the target scene 8〇. In one embodiment, the trajectory 215 is an arc of an axis centered on the target scene 80. The scanning image taking unit 21 has a front stage optical module 21 〇 that can travel along the trajectory 215. In this embodiment, the front optical module, 'and 21 〇 is a curved mirror, the reflective surface can be a spherical structure or an aspherical structure' and the mirror is facing the target scene 8 〇, in each of the tracks 2丨5 The image of the target scene 80 can be continuously received and projected. By providing a driving mechanism in the image capturing unit 21, the front stage optical module 201109817 210 can be driven to reciprocate along the track 215, and the track 2 15 can be changed according to the adjustment of the driving mechanism. The optical path matching unit 22 has a rear stage optical module 220 for matching the optical path between the front stage optical module 210 and the image capturing module _25 so that the front stage optical module 2 10 projects The target scene image is further projected to the fixed image sensor 250 via the rear stage optical module 220. In this embodiment, the rear optical module 22 is another curved reflective mirror. The reflective surface may be a spherical structure or an aspherical structure. The optical path matching unit 22 is provided with an alignment mechanism for rotating the rear stage optical module 22 to cooperate with the position of the front stage optical module 210 to match the alignment between the front stage optical module 210 and the image sensor 250. The light path. The rear stage optical module front stage optical module is then referred to the third figure, which is a schematic view of the first embodiment of the scanning image taking unit and the optical path matching unit of the present invention. In this example, before the scanning image capturing unit 41, the gradation optical module 410 is a curved mirror, and the curved surface thereof may be a spherical or aspherical structure, and a mirror 41 is further disposed in front of the mirror. On the other hand, the optical path matching unit 42 The subsequent optical module 42 is a curved mirror, and the curved surface thereof may be a spherical or aspherical structure, and a lens 421 is further disposed in front of the mirror. Lenses 411, 421 are used to assist in adjusting the imaging position and eliminating aberrations. Please refer to the fourth figure, which is a schematic diagram of the second embodiment of the scanning image capturing unit and the optical path matching unit of the present invention; in this example, 201109817, the scanning optical imaging unit 51 has a front-level optical module v-plane. The reflection j 'and the front of the mirror - Wei 511. On the other hand, the optical path matching unit 52 is a planar mirror, and a lens 521 is further disposed in front of the mirror surface. The lenses 511, 521 image the position and eliminate aberrations. Used to assist the adjustment. Further, the image capture module (not shown in the figure) can have a lens

或透鏡組,以設於影像感測器前,進而辅助調整成像位^ 與消除像差。 藉由上述光學設計概念,輔以機構設計與程序控制架 構,即可達成多視角攝像自動化之目-的-。接:著.,請同時參 閱第五圖,該圖係為本發明之多視角攝像方法之步驟流程 圖,以下將藉第二圖之應用實例來輔助說明多視角攝像方 法的各個步驟流程。 ••一 . -- .:· .二.· 此多視角攝像方法係適用於多視角攝像系統2〇,以固 °又之影像感測器2 5 0來擷取目標景物8 〇的不同視角影像。 如第二圖所示,所述之多視角攝像方法包括下列步驟: 首先,提供一軌跡215,軌跡215上方之各個位置均 對應著目標景物80的不同視角,於第二圖之應用實例係規 劃於位置BbB2、B3、B4、B5擷取目標影像(步驟S100); 其次’以前級光學模組210於轨跡215上方之位置Bi 接收目標景物80的影像’並投射出所接收之影像(步驟 S102); 10 201109817 隨後,以後級光學模組220匹配對準前級光學模組2 1 〇 與影像感測器250之間的光路,使得前級光學模組2丨〇所 投射出的影像經後級光學模組22〇,進一步投射至影像感 測器 250 (步驟 S104) ; ..· 再來,控制影像感測器250擷取影像251(步驟S106 ); 接著,移動前級光學模組2 1 〇至軌跡_ 21 5 -上方之另〆 位置Β2,並回到步驟S102(步驟sl〇8)。 藉著重複執行各個步驟,即可控制前級光學模組2 j 〇 -人第移至位置B2、B3、B4、B5,並控制:固設之:影像感測 器250擷取各個位置個別對應之視角影像252、. 253、254、 255。 • - · —- ' '- . 以下係說明本案之具體實施架構。請參閱第六圖,該 圖係為本發明之多視角攝像系統之一具體實施例之系統架 構示意圖。如第六圖所示,一多視角攝像系統3〇係用以擷 取一目標景物90的不同視角影像,包括一控制模組31、 —掃描取像單元32、一光路匹配單元33,以及一影像擷取 模組3 5。 影像擷取模組35具有一影像感測器35〇,影像感測器 35〇係固設於一定點,用以擷取影像建立數位影像資料。 影像擷取模組35内部進一步具有控制器、記憶體等元件, 以與影像感測器350協同達到影像擷取記錄功能。控制模 組31為多視角攝像系統30的控制核心、,輕接於掃描取像 201109817 單兀2光路匹配單元33與影像擷取模組35,控制系統 各個單元協同運作。 掃描取像單元32具有一前級光學模組320,光路匹配 單-具有後級光學模組3 3 0,前級光學模組3 2 0與後 光于模』_ 3 3 0可為平面反射鏡或多面反射鏡。掃描取像 早兀32係接受控制模組3丨的驅動控制,帶動前級光學模 組320沿一預設之軌跡移動行進,此軌跡上方各個位置均 對應目標景物90的不同視角。前級光學模組32〇於軌跡上 方每一位置,均可接收並投射出目樣景物90的影像。 光路匹配單元33係接受控制模組3丨之驅動.控制,帶 動後級光學模組330匹配對準前級光學模組32〇與影像感 測器350間之光路,使前級光學模組32〇所投射出之影像, 經由後級光學模組330進一步投射至影像感測器35〇。影 像操取模組35並接受控制模組3 1之控制,以影像感測器 350擷取影像。 於一具體實施例,後級光學模組330係設於一定點, 控制模組3 1係控制後級光學模組330旋轉,以匹配對準前 級光學模組320與影像感測器350成像區間之光路。 掃描取像單元32係進一步包括一前級傳動元件322, 以及一帶動機構324。帶動機構324係由機械構件,例如. 齒輪、軸承、螺桿、移動平台與座體等結構件共同組成, 用以建構上述之前級光學模組320的行進軌跡,並搭載前 12 201109817 級光學模組320沿該轨跡稃叙此如油名 移勤。刖級傳動元件322係為一 麵接於控制模組3 1之傳動梦罢., ^' * ㈣裝f ’例如:馬達,用以接受控 制模組31的驅動,推動帶動棬 勒機構324作動,使前級光學模 組320移動至指定位置。 、 光路既配單元33係進—步包括一後級傳動元件332, 以及一對準機構334。對準機構334係、由機械構件,例如: 齒輪、轉動平台與底座等結構件共同組成,用以帶動後級 光學模組330變換角度或位置,使其得以機動配合對準前 級光學模組32〇之投射影像紐方位m射影像進一 步投射至影像感測器35〇。後級傳動元件332係.為一耦接 於控制模組31之傳動裝置,例如:馬達’哪以接受控制模 組3 1的驅動,推動對準機構334作動,使其帶動後級光學 模組330達成光路匹配對準機能ς . _ — 控制模組31可為一微控制器裝置或為一微電腦裝 置’根據内部預先規劃儲存之韌體’來控制週邊各個單元 的運作,並接受外部設定前級光學模組32〇沿軌跡之停留 位置、移動速度、影像擷取模組35擷取影像數量與時序間 隔等參數細節。 附帶一提的是,實務中,前級光學模組320、後級光 學模組330與影像感測器350間之光路匹配對準,與系統 硬體實際所佔空間尺寸相關,可經由預先之校正作業,取 得各項與光路對準相關的參數值,預先儲存於控制模組3 i 13 201109817 内部’其後控制模組31再根據這些參數,輸出訊號控制前 級光學模組320與後級光學模組33〇的作動。 攻< f,預先 於控制模組31 ί^部建立運算模式,依照拍攝現場所設定之 各個物件關聯位置,即時根據運算值輸出訊號控制前級 光學模組320與後級光學模組33〇的作動,進行光路對準。 再者,亦可設置感測裝置,利用傳回控制模組31的感測訊 號’即時❹i光路對準狀態。控制模組31輸出訊號驅動前 級光學模組320與後級光學模組33〇作動期間,—併參考 感測訊號,以判斷光路對準是否完成 多視角攝像系統30所取得的不ί同視角影像:,.可進—步 -根據拍攝視角位置,自動分類編號進行儲存,以便後續應 用於環物影像建構,或作為立體三維視訊内容素材。 藉由以上實例詳述,當可知悉本發明之多視角攝像方 法及系統’係藉由控制前級光學模組沿目標景物周圍移 動,接收並投射出所在位置接收之目標景物影像,並以後 級光學模組匹配對準前級光學模組與影像感測器之間的光 路,使固設之影像感測器能取得目標景物之多視角影像。 如此便可利用自動化程序控制多視角攝像之過程及細節, 使其更具效率與精準。 惟,以卫所述,僅為本發明的具體實施例之詳細說明 及圖式而已,並非用以限制本發明,本發明之所有範圍應 以下述之申請專利範圍為準,任何熟悉該項技藝者在本發 14 201109817 皆可涵蓋在以下本 明之領域内’可輕易思及之變化或修飾 案所界定之專利範圍。 L圖式簡單說明】 圖; 第-圖#為習知技術之多視角影像拍_之示意 第二圖 係為本發明之多視角攝像系統之一具體實施 例之應用示意圖; 第三圖 第四圖 第五圖 第六圖 係為本發明之掃描取像單柄又光路匹配單 元之第-具體實施例之峡示轉丄 係為本發明之掃描取像單元义展光路匹配單 几之第二具體實施例之外觀示意圖; 係為本發明以㈣攝雜衫㈣流程圖; 係為本發明之多視角攝像系統之一具體實施 例之系統架構示意圖。 主要元件符號說明】 、 80 、 90 11 、 12 、 13 ⑸〜153 、 251〜255 20、30 21 、 41 、 51 210 、 410 、 510 目標景物 攝像裝置 影像 多視角攝像系統 掃描取像單元 前級光學模組 15. 201109817 213 22 ' 32 ' 42 ' 52 220 、 320 ' 420 、 520 25 > 35 250 ' 350 31 322 # 324 332 334 411 、 421 、 511 、 521Or a lens group is provided in front of the image sensor to assist in adjusting the imaging position and eliminating aberrations. With the above optical design concept, supplemented by the mechanism design and program control architecture, the multi-view camera automation can be achieved. Please refer to the fifth figure, which is the flow chart of the multi-view camera method of the present invention. The following application examples of the second figure will be used to assist in explaining the steps of the multi-view camera method. ••一. -- .:· . II.· This multi-angle camera method is suitable for multi-view camera system 2 〇, with the image sensor 2 50 to capture the different perspectives of the target scene 8 〇 image. As shown in the second figure, the multi-view imaging method includes the following steps: First, a trajectory 215 is provided, and each position above the trajectory 215 corresponds to a different viewing angle of the target scene 80, and the application example in the second figure is planned. The target image is captured at positions BbB2, B3, B4, and B5 (step S100); secondly, the previous optical module 210 receives the image of the target scene 80 at a position Bi above the track 215 and projects the received image (step S102). 10 201109817 Subsequently, the subsequent optical module 220 matches the optical path between the pre-stage optical module 2 1 〇 and the image sensor 250, so that the image projected by the pre-stage optical module 2 经The stage optical module 22 is further projected to the image sensor 250 (step S104). . . . , the image sensor 250 is controlled to capture the image 251 (step S106); then, the front stage optical module 2 is moved. 1 〇 to track _ 21 5 - the other position Β 2 above, and return to step S102 (step s1 〇 8). By repeating the steps, the pre-stage optical module 2 j 〇-person can be controlled to move to the positions B2, B3, B4, B5, and control: the image sensor 250 captures each position individually. View image 252, .253, 254, 255. • - · --- ' '- . The following is a description of the specific implementation structure of the case. Please refer to the sixth figure, which is a schematic diagram of the system architecture of a specific embodiment of the multi-view camera system of the present invention. As shown in FIG. 6 , a multi-view camera system 3 is used to capture different view images of a target scene 90 , including a control module 31 , a scan image capturing unit 32 , an optical path matching unit 33 , and a Image capture module 35. The image capturing module 35 has an image sensor 35, and the image sensor 35 is fixed at a certain point for capturing images to establish digital image data. The image capturing module 35 further has components such as a controller and a memory to cooperate with the image sensor 350 to achieve an image capturing and recording function. The control module 31 is a control core of the multi-view camera system 30, and is connected to the scan acquisition image 201109817. The single-channel optical path matching unit 33 and the image capturing module 35 are operated by the control system units. The scanning image capturing unit 32 has a front stage optical module 320, the optical path matching single-having the rear stage optical module 3 3 0, the front stage optical module 3 2 0 and the rear light mode _ 3 3 0 can be a plane reflection Mirror or polygon mirror. Scanning and imaging The driving control of the control module 3丨 is carried out by the 32-inch system, and the pre-stage optical module 320 is moved along a predetermined trajectory, and each position above the trajectory corresponds to a different viewing angle of the target scene 90. The front stage optical module 32 can receive and project an image of the target scene 90 at each position above the track. The optical path matching unit 33 is driven by the control module 3 to control the optical module 330 to match the optical path between the pre-stage optical module 32 and the image sensor 350, so that the optical module 32 is provided. The image projected by the camera is further projected to the image sensor 35A via the rear stage optical module 330. The image manipulation module 35 is controlled by the control module 31, and the image is captured by the image sensor 350. In a specific embodiment, the rear stage optical module 330 is disposed at a certain point, and the control module 31 controls the rear stage optical module 330 to rotate to match the alignment of the front stage optical module 320 and the image sensor 350. The light path of the interval. The scan imaging unit 32 further includes a front stage transmission element 322 and a driving mechanism 324. The driving mechanism 324 is composed of mechanical components, for example, a gear, a bearing, a screw, a moving platform and a seat body, and is used for constructing the traveling trajectory of the previous optical module 320, and is equipped with the front 12 201109817 optical module. 320 along this trajectory to describe this as the oil name shifting. The stepping transmission component 322 is a driving dream connected to the control module 31. ^' * (4) is equipped with a f', for example, a motor for receiving the driving of the control module 31, and driving the actuator mechanism 324 to actuate The front stage optical module 320 is moved to a designated position. The optical path accommodating unit 33 includes a rear stage transmission element 332 and an alignment mechanism 334. The alignment mechanism 334 is composed of mechanical components, such as a gear, a rotating platform and a base, for driving the rear optical module 330 to change the angle or position, so that the motor module can be aligned with the front optical module. The projected image of the 32-inch projected image is further projected to the image sensor 35〇. The rear stage transmission component 332 is a transmission device coupled to the control module 31. For example, the motor 'is driven by the control module 31 to push the alignment mechanism 334 to drive the rear stage optical module. 330 achieves the optical path matching alignment function. _ - The control module 31 can be a microcontroller device or a microcomputer device 'based on the internal pre-planned storage firmware' to control the operation of each surrounding unit and accept external settings The level of the optical module 32 〇 along the trajectory, the moving speed, the image capturing module 35 captures the parameter details such as the number of images and the timing interval. Incidentally, in practice, the optical path between the front-end optical module 320, the rear-stage optical module 330, and the image sensor 350 is matched and aligned, and is related to the actual size of the space occupied by the system hardware, and may be Correction operation, obtaining various parameter values related to optical path alignment, pre-stored in the control module 3 i 13 201109817 internal 'The control module 31 then controls the pre-stage optical module 320 and the subsequent stage according to these parameters. The operation of the optical module 33〇. Attacking < f, pre-establishing the operation mode in the control module 31 ,^, according to the position of each object set in the shooting scene, and immediately controlling the pre-stage optical module 320 and the rear-stage optical module 33 according to the calculated value output signal 〇 Actuate and align the light path. Furthermore, a sensing device can be provided, which uses the sensing signal returned to the control module 31 to instantly align the optical path alignment state. The control module 31 outputs the signal-driven pre-stage optical module 320 and the rear-stage optical module 33 during the operation, and refers to the sensing signal to determine whether the optical path alignment completes the different viewing angles obtained by the multi-view imaging system 30. Image:,. can be advanced - according to the position of the shooting angle, the automatic classification number is stored for subsequent application in the ring image construction, or as a stereoscopic 3D video content material. As is apparent from the above examples, it can be seen that the multi-view imaging method and system of the present invention receives and projects the target scene image received at the location by controlling the movement of the pre-stage optical module along the target scene, and The optical module matches the optical path between the front optical module and the image sensor, so that the fixed image sensor can obtain the multi-view image of the target scene. This allows automated processes to control the process and details of multi-view imaging for greater efficiency and precision. The present invention is intended to be limited only by the detailed description of the embodiments of the invention, and is not intended to limit the scope of the invention. The scope of patents defined by the changes or modifications that can be easily considered in the field of the present invention can be covered by the present invention. A simple illustration of the L diagram] Figure 1 - Figure # is a multi-view image capture of the prior art. The second diagram is a schematic diagram of the application of one embodiment of the multi-view camera system of the present invention; FIG. 5 is a second embodiment of the scanning image capturing single-handle and optical path matching unit of the present invention. The third embodiment of the present invention is the second embodiment of the scanning image capturing unit of the present invention. A schematic diagram of the appearance of a specific embodiment; a flowchart of the fourth embodiment of the present invention; (4) is a schematic diagram of a system architecture of a specific embodiment of the multi-view camera system of the present invention. Main component symbol description], 80, 90 11 , 12 , 13 (5) ~ 153, 251~255 20, 30 21 , 41 , 51 210 , 410 , 510 Target scene camera image multi-view camera system scan image unit preamplifier Module 15. 201109817 213 22 ' 32 ' 42 ' 52 220 , 320 ' 420 , 520 25 > 35 250 ' 350 31 322 # 324 332 334 411 , 421 , 511 , 521

A1 〜A3、B1 〜B5 K Ρ、215 • S100〜S108 座體 光路匹配單元 後級光學模組 影像擷取模組 影像感測器 控制模組 前級傳動元件 帶動機構 後級傳動元件 對準機構 透鏡 位置 固定目標點 .軌跡 各個步驟流程 16A1 ~ A3, B1 ~ B5 K Ρ, 215 • S100 ~ S108 Seat optical path matching unit Rear stage optical module Image capture module Image sensor control module Front stage drive element Drive mechanism Rear stage drive element alignment mechanism Lens position fixed target point. Trajectory step flow 16

Claims (1)

201109817 七、申請專利範圍: 1. 一種多視角攝像方法’係適用於以一固設之影像感測器掏 取一目標景物之影像,該多視角攝像方法包括下列步驟: (a)提供一軌跡’其中該軌跡上之各個位置係對應該目 標景物的不同視角; - (b )以一前級光學模組於該軌跡上之一位置接收該目標 景物之影像,並投射出該接收之影像; (c )以一後級光學模組匹配對準該前級光學模組與該影 像感測器間之光路,使該前級光學模組所投射之影 像進一步投射至該影像感測器;. (d) 控制該影像感測器擷取影像;以及^ . (e) 移動該前級光學模組至該軌跡上之另一位置,並重 複步驟(b)。 2. 如申請專利範圍第丨項所述之多視角攝像方法,其中該執 跡係為以該目標景物為轴心之一弧線。 3. 如申請專利範圍第1項所述之多視角攝像方法,其中於步 驟(c )中,係控制該後級光學模組旋轉,以匹配對準該前 級光學模組與該影像感測器間之光路。 4. 如申請專利範圍第i項所述之多視角攝像方法,其中該軌 跡係設於一座體。 5. 如申明專利範圍第丨項所述之多視角攝像方法,其中該前 級光學模組及該後級光學模組係分別為一反射鏡。 17 201109817 6.如申睛專利範圍第5項所述之多視角攝像方法,其中於步 驟(b)前’更包括下列步驟: 提供透鏡77別设置於該前級光學模組與該後級光學模 組之反射鏡面前。 . .* 7·如申請專利範圍第i項所述之多視角攝像方法其中該前 級光學模組以及該後級光學模組係分別為-曲面反射鏡, 且該曲面反射鏡之曲面係為選自由球面結構與非球面結構 所組成之一群組其中之一種結構。 8. -種多視角攝像系統,係適用於擷取一目標景物的影像, 該多視角攝像系統包括: 一控制模組; -影像摘取模組,包括—影像感測器,該影像感測器係固 設於一定點,並接受該控制模組的控制,進行影像擷取; 一掃描取像單元,包括一前級光學模組,並接受該控制模 組的控制,帶動該前級光學模組沿一軌跡行進,其中該軌 跡上之各個位置係對應該目標景物的不同視角,該前級光 干模組於該軌跡之各個位置,係接收該目標景物之影像, 並投射出接收之影像;以及 一光路匹配單元,包括一後級光學模組,並接受該控制模 組的控制’帶動該後級光學模組匹配對準該前級光學模組 與該影像感測器間之光路,使該前級光學模組所投射之該 目標景物的影像,進一步投射至該影像感測器。 2〇ll〇98l7 如申响專利範圍第8項所述之多視角攝像系統,其中該軌 跡係為以該目標景物為軸心之一弧線。 10.如申請專利範圍第8項所述之多視角攝像系統,其中該前 級光學模組及該後級光學模組係分別為_反射鏡。 1.如申晴專利範圍第1 〇項所述之多視角攝像系統,其中該掃 描取像單元更包括-透鏡,設置於該前級光學模組之反射 鏡面前。 &如申請專利範圍第1G項所述之多視角攝像系統,其中光路 匹配單元更包括-透鏡,設置於該後級光學摸組之反射鏡 面前。 13.如申請專利範圍第8項所述之多視角攝像系統,其中該前 級光學模組以及該後級光學模組係分別為一曲面反射鏡, 且該曲面反射鏡之曲面料選自由球面結構與非球面結構 所組成之一群組其令之一種結構。 Η.如申請專利範圍第8項所述之多視角攝像系統,其中該影 像願取模組更包括以下任—種:透鏡與透鏡组,以設置於 該影像感測器前。 15·如申請專利範圍第8項所述之容趙β 9叮通之多視角攝像系統,其中該影 CCD) 一互補式 像感測器係為選 金屬氧化物半導體元件(c職)職成之—群組其中之 一種元件。 16.如申請專利範圍第8項所述 之多視角攝像系統,其中該掃 201109817 猫取像單元更包括—座體,以設置該軌跡。 17·如申請專利範圍第8項所述之多視角攝像系統,其中該掃 描取像單元更包括—帶動機構,係接受貧控制模組的驅 ▼動該則級光予模組沿該軌跡移動,該轨跡可依該帶 動機構之調整而改變。 18.如申請專利範園第17項所述之多視角攝像系統,其中該掃201109817 VII. Patent application scope: 1. A multi-angle imaging method is suitable for capturing an image of a target scene by using a fixed image sensor, the multi-view imaging method comprising the following steps: (a) providing a trajectory 'where the respective positions on the trajectory are different viewing angles corresponding to the target scene; - (b) receiving an image of the target scene at a position on the trajectory by a pre-stage optical module, and projecting the received image; (c) matching the optical path between the front optical module and the image sensor by a rear optical module, so that the image projected by the front optical module is further projected to the image sensor; (d) controlling the image sensor to capture the image; and (e) moving the front stage optical module to another position on the track and repeating step (b). 2. The multi-view imaging method of claim 2, wherein the execution is an arc centered on the target scene. 3. The multi-view imaging method according to claim 1, wherein in the step (c), the rear optical module is controlled to rotate to match the front optical module and the image sensing. The light path between the devices. 4. The multi-view imaging method of claim i, wherein the trajectory is provided in a body. 5. The multi-view imaging method of claim 2, wherein the front optical module and the rear optical module are respectively a mirror. 17 201109817 6. The multi-view imaging method according to claim 5, wherein before step (b), the method further comprises the steps of: providing a lens 77 disposed on the front optical module and the rear optical The front of the module's mirror. 7. The multi-view imaging method of claim i, wherein the front optical module and the rear optical module are respectively a curved mirror, and the curved surface of the curved mirror is One of the groups consisting of a combination of a spherical structure and an aspherical structure is selected. 8. A multi-view camera system for capturing an image of a target scene, the multi-view camera system comprising: a control module; an image capture module comprising: an image sensor, the image sensing The device is fixed at a certain point and is controlled by the control module to perform image capture; a scan image capturing unit includes a front stage optical module and is controlled by the control module to drive the front stage optical The module travels along a trajectory, wherein each position on the trajectory is a different view angle corresponding to the target scene, and the pre-stage optical dry module receives the image of the target scene at each position of the trajectory, and projects the received image And an optical path matching unit, comprising a rear stage optical module, and receiving the control of the control module to drive the rear optical module to match the optical path between the front optical module and the image sensor And causing the image of the target scene projected by the pre-stage optical module to be further projected to the image sensor. The multi-view camera system of claim 8, wherein the track is an arc centered on the target object. 10. The multi-view camera system of claim 8, wherein the front stage optical module and the rear stage optical module are respectively _ mirrors. 1. The multi-view camera system of claim 1, wherein the scanning image taking unit further comprises a lens disposed in front of the mirror of the front stage optical module. A multi-view camera system as described in claim 1G, wherein the optical path matching unit further includes a lens disposed in front of the mirror of the rear optical group. 13. The multi-view camera system of claim 8, wherein the front optical module and the rear optical module are respectively a curved mirror, and the curved surface of the curved mirror is selected from a spherical surface. A structure consisting of a structure and an aspheric structure. The multi-view camera system of claim 8, wherein the image-receiving module further comprises: a lens and a lens group disposed in front of the image sensor. 15. A multi-view camera system as described in claim 8 of the patent application scope, wherein the complementary image sensor is a metal oxide semiconductor component (c) One of the components of the group. 16. The multi-view camera system of claim 8, wherein the scan 201109817 cat image taking unit further comprises a body to set the track. The multi-view camera system of claim 8, wherein the scanning image capturing unit further comprises a driving mechanism, and the driving of the lean control module is performed, and the light is moved along the track. The trajectory can be changed according to the adjustment of the driving mechanism. 18. The multi-view camera system of claim 17, wherein the scan 描取像單元更包括一前級傳動元件,輕接於該控制模組, 以驅動該帶動機構搭載該前級光學模組沿該轨跡移動。 19·如申%專職圍第8項所述之多視角攝像系統,其中該光 路匹配單元更包括一對準機構,係接受該控制模組的驅 動’帶動該後級光學模組對準該前級光學模組與該影像感 測器間之光路。 2 〇 ‘如申請專利範圍第丨9項所述之多_視角攝像系統,其中該光 路匹配單元更包括-後級傳動元件,麵接於該控制模組, 以驅動該對準機構搭載該後級光學模組對準該前級光學模 組與該影像感測器間之光路。 21.如申請專利範圍第8項所述之多視角攝像系統,其中該控 制模組係驅動控制該後級光學模組旋轉,以匹配對準該前 級光學模組與該影像感測器間之光路。 20The image capturing unit further includes a front stage transmission component, and is lightly connected to the control module to drive the driving mechanism to carry the front stage optical module to move along the track. The multi-view camera system of claim 8, wherein the optical path matching unit further comprises an alignment mechanism that receives the driving of the control module to drive the rear optical module to align the front The optical path between the optical module and the image sensor. 2 〇 ', as described in claim 9, the _ viewing angle camera system, wherein the optical path matching unit further includes a rear-stage transmission component that is coupled to the control module to drive the alignment mechanism to be mounted The optical module is aligned with the optical path between the front optical module and the image sensor. 21. The multi-view camera system of claim 8, wherein the control module is configured to drive and control the rotation of the rear optical module to match the alignment between the front optical module and the image sensor. The light path. 20
TW098129739A 2009-09-03 2009-09-03 Imaging system with multiple perspective angles and method thereof TWI392952B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW098129739A TWI392952B (en) 2009-09-03 2009-09-03 Imaging system with multiple perspective angles and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW098129739A TWI392952B (en) 2009-09-03 2009-09-03 Imaging system with multiple perspective angles and method thereof

Publications (2)

Publication Number Publication Date
TW201109817A true TW201109817A (en) 2011-03-16
TWI392952B TWI392952B (en) 2013-04-11

Family

ID=44836073

Family Applications (1)

Application Number Title Priority Date Filing Date
TW098129739A TWI392952B (en) 2009-09-03 2009-09-03 Imaging system with multiple perspective angles and method thereof

Country Status (1)

Country Link
TW (1) TWI392952B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI418920B (en) * 2011-03-31 2013-12-11 Young Optics Inc Projection apparatus

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61265553A (en) * 1985-05-20 1986-11-25 Olympus Optical Co Ltd Optical scanning apparatus
TW514747B (en) * 2001-12-11 2002-12-21 Chung Shan Inst Of Science Field of view switching and focusing system of common-optical-path periscope
TWI278225B (en) * 2003-05-09 2007-04-01 I Art Corp Multiple views of stereoscopic image display scheme
JP4590546B2 (en) * 2004-06-14 2010-12-01 国立大学法人 東京大学 Image extraction device
US7843449B2 (en) * 2006-09-20 2010-11-30 Apple Inc. Three-dimensional display system
CN101082766A (en) * 2006-06-01 2007-12-05 上海杰图软件技术有限公司 Device and method rapid capturing panoramic view image

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI418920B (en) * 2011-03-31 2013-12-11 Young Optics Inc Projection apparatus
US9551919B2 (en) 2011-03-31 2017-01-24 Young Optics Inc. Projection apparatus

Also Published As

Publication number Publication date
TWI392952B (en) 2013-04-11

Similar Documents

Publication Publication Date Title
US7620309B2 (en) Plenoptic camera
US8743174B2 (en) Digital camera and method for controlling the same
WO2014178234A1 (en) Image processing device, image processing method and program
US20070146530A1 (en) Photographing apparatus, image display method, computer program and storage medium
CN103986867A (en) Image shooting terminal and image shooting method
CN109040552A (en) Based on Dual-Aperture zoom digital camera
CN102075674B (en) Imaging apparatus
WO2012077257A1 (en) Lens barrel, imaging device and camera
CN102959467A (en) Monocular stereoscopic imaging device
US20170171456A1 (en) Stereo Autofocus
CN101360190A (en) Imaging device, and control method for imaging device
CN109564376A (en) Time-multiplexed programmable view field imaging
WO2014155813A1 (en) Image processing device, imaging device, image processing method and image processing program
CN104853105A (en) Three-dimensional rapid automatic focusing method based on photographing device capable of controlling inclination of lens
JP2012222495A (en) Image processor, image processing method, and program
US20140118575A1 (en) Camera system
WO2012133105A1 (en) Lens control device and method of controlling lens
US20130050536A1 (en) Compound-eye imaging device
US8582016B2 (en) Photographing apparatus and focus detecting method using the same
TW201109817A (en) Imaging system with multiple perspective angles and method thereof
US11849100B2 (en) Information processing apparatus, control method, and non-transitory computer readable medium
US8401379B2 (en) Optical path adjusting device and photographing apparatus having the same
US20130076867A1 (en) Imaging apparatus
CN103760745A (en) Single-camera and double-camera stereoscopic image shooting device and shooting method for stop-motion shooting
US20120069148A1 (en) Image production device, image production method, program, and storage medium storing program

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees