TW201327470A - Method for adjusting depths of 3D image and method for displaying 3D image and associated device - Google Patents
Method for adjusting depths of 3D image and method for displaying 3D image and associated device Download PDFInfo
- Publication number
- TW201327470A TW201327470A TW100149956A TW100149956A TW201327470A TW 201327470 A TW201327470 A TW 201327470A TW 100149956 A TW100149956 A TW 100149956A TW 100149956 A TW100149956 A TW 100149956A TW 201327470 A TW201327470 A TW 201327470A
- Authority
- TW
- Taiwan
- Prior art keywords
- image frame
- adjusted
- eye
- disparity map
- stereoscopic image
- Prior art date
Links
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
Description
本發明係有關於立體影像，尤指一種調整立體影像之景深的方法以及顯示立體影像的方法與相關裝置。The present invention relates to a stereoscopic image, and more particularly to a method of adjusting the depth of field of a stereoscopic image and a method and related apparatus for displaying a stereoscopic image.
在製作立體影像時，攝影師會使用兩台攝影機，以不同的距離、角度來分別拍攝出一左眼影像以及一右眼影像，之後再將左眼影像與右眼影像同時顯示於螢幕上以供使用者觀看。然而，由於立體影像製作完成時，此立體影像的景深就已經決定了，因此若是此立體影像在製作時就給予太強或太弱的景深，或是使用者想要用不同尺寸的螢幕來觀看此立體影像時，則可能會導致使用者感到不舒適或是沒有立體的感覺。When making a stereoscopic image, the photographer uses two cameras to capture a left eye image and a right eye image at different distances and angles, and then display the left eye image and the right eye image on the screen simultaneously. For users to watch. However, since the depth of field of the stereoscopic image is determined when the stereoscopic image is completed, if the stereoscopic image is given too strong or too weak depth of field when the image is produced, or if the user wants to watch with a different size screen This stereoscopic image may cause the user to feel uncomfortable or have no stereoscopic feeling.
因此，本發明的目的之一在於提供一種調整立體影像之景深的方法以及顯示立體影像的方法與相關裝置，以解決上述的問題。Accordingly, it is an object of the present invention to provide a method of adjusting the depth of field of a stereoscopic image and a method and related apparatus for displaying a stereoscopic image to solve the above problems.
依據本發明一實施例，一種調整一立體影像之景深的方法包含有：接收該立體影像，其中該立體影像包含有一左眼影像圖框以及一右眼影像圖框；依據該左眼影像圖框以及該右眼影像圖框以產生一左眼視差圖以及一右眼視差圖；以及依據該左眼視差圖以及該右眼視差圖來調整該立體影像中至少一物體的景深，以產生一調整後立體影像。According to an embodiment of the present invention, a method for adjusting a depth of field of a stereoscopic image includes: receiving the stereoscopic image, wherein the stereoscopic image includes a left eye image frame and a right eye image frame; according to the left eye image frame And the right eye image frame to generate a left eye disparity map and a right eye disparity map; and adjusting the depth of field of the at least one object in the stereo image according to the left eye disparity map and the right eye disparity map to generate an adjustment Rear stereo image.
依據本發明另一實施例，一用來調整一立體影像之景深的裝置包含有一接收單元、一視差圖產生單元以及一影像處理單元。該接收單元係用以接收該立體影像，其中該立體影像包含有一左眼影像圖框以及一右眼影像圖框；該視差圖產生單元耦接於該接收單元，且用以依據該左眼影像圖框以及該右眼影像圖框以產生一左眼視差圖以及一右眼視差圖；該影像處理單元係耦接於該接收單元以及該視差圖產生單元，且用以依據該左眼視差圖以及該右眼視差圖來調整該立體影像中至少一物體的景深，以產生一調整後立體影像。According to another embodiment of the present invention, an apparatus for adjusting a depth of field of a stereoscopic image includes a receiving unit, a disparity map generating unit, and an image processing unit. The receiving unit is configured to receive the stereoscopic image, wherein the stereoscopic image includes a left-eye image frame and a right-eye image frame; the disparity map generating unit is coupled to the receiving unit, and configured to be based on the left-eye image a frame and the right-eye image frame to generate a left-eye disparity map and a right-eye disparity map; the image processing unit is coupled to the receiving unit and the disparity map generating unit, and configured to use the left-eye disparity map And the right-eye disparity map adjusts a depth of field of at least one object in the stereoscopic image to generate an adjusted stereoscopic image.
依據本發明另一實施例，一種顯示立體影像的方法包含有：接收一立體影像；依據該立體影像以產生一視差圖；依據該視差圖以及該立體影像來產生至少一調整後立體影像，其中該至少一調整後立體影像與該立體影像具有實質上相同的顯示內容以及不同的景深；以及接收一指令以自該至少一調整後立體影像與該立體影像中選擇其一來顯示於一顯示螢幕上。According to another embodiment of the present invention, a method for displaying a stereoscopic image includes: receiving a stereoscopic image; generating a disparity map according to the stereoscopic image; generating at least one adjusted stereoscopic image according to the disparity map and the stereoscopic image, wherein The at least one adjusted stereoscopic image has substantially the same display content and different depth of field as the stereoscopic image; and receives an instruction to display one of the at least one adjusted stereoscopic image and the stereoscopic image to be displayed on a display screen on.
依據本發明另一實施例，一種顯示立體影像的裝置包含有一接收單元、一視差圖產生單元以及一影像處理單元。該接收單元係用來接收一立體影像；該視差圖產生單元耦接於該接收單元，且用來依據該立體影像以產生一視差圖；該影像處理單元耦接於該接收單元以及該視差圖產生單元，且用來依據該視差圖以及該立體影像來產生至少一調整後立體影像，其中該至少一調整後立體影像與該立體影像具有實質上相同的顯示內容以及不同的景深；該影像處理單元另用來接收一指令以自該至少一調整後立體影像與該立體影像中選擇其一來顯示於一顯示螢幕上。According to another embodiment of the present invention, an apparatus for displaying a stereoscopic image includes a receiving unit, a disparity map generating unit, and an image processing unit. The receiving unit is configured to receive a stereoscopic image; the disparity map generating unit is coupled to the receiving unit, and configured to generate a disparity map according to the stereoscopic image; the image processing unit is coupled to the receiving unit and the disparity map Generating a unit, and configured to generate at least one adjusted stereoscopic image according to the disparity map and the stereoscopic image, wherein the at least one adjusted stereoscopic image has substantially the same display content and different depth of field as the stereoscopic image; The unit is further configured to receive an instruction to display one of the at least one adjusted stereoscopic image and the stereoscopic image to be displayed on a display screen.
請參考第1圖，第1圖為依據本發明一實施例之裝置100的示意圖。如第1圖所示，裝置100包含有一接收單元110、一視差圖產生單元120、一影像處理單元130以及一顯示裝置140。此外，裝置100係用來依據一立體影像來產生至少一個具有不同景深的調整後立體影像，之後再依據使用者所輸入的指令，以自原始立體影像或是調整後立體影像選擇其一來播放。Please refer to FIG. 1. FIG. 1 is a schematic diagram of an apparatus 100 in accordance with an embodiment of the present invention. As shown in FIG. 1 , the device 100 includes a receiving unit 110 , a disparity map generating unit 120 , an image processing unit 130 , and a display device 140 . In addition, the device 100 is configured to generate at least one adjusted stereoscopic image with different depth of field according to a stereoscopic image, and then select one of the original stereoscopic images or the adjusted stereoscopic image according to an instruction input by the user. .
請同時參考第1圖以及第2圖，第2圖為依據本發明一實施例之調整立體影像之景深的方法以及顯示立體影像的方法的流程圖。參考第2圖，流程如下所示。Please refer to FIG. 1 and FIG. 2 simultaneously. FIG. 2 is a flowchart of a method for adjusting the depth of field of a stereoscopic image and a method for displaying a stereoscopic image according to an embodiment of the invention. Referring to Figure 2, the flow is as follows.
首先，於步驟200中，接收單元110接收一立體影像。接著，於步驟202中，針對該立體影像中的一左眼影像圖框L以及一右眼影像圖框R，視差圖產生單元120依據左眼影像圖框L以及右眼影像圖框R以產生一左眼視差圖(disparity map)以及一右眼視差圖，其中該左眼視差圖以及該右眼視差圖係用來表示一物體於左眼影像圖框L中之位置與該物體於右眼影像圖框R之位置之間的水平距離。接著，於步驟204中，影像處理單元130依據該左眼視差圖來調整至少一物體於左眼影像圖框L中的位置，以產生至少一調整後左眼影像圖框，以及依據該右眼視差圖來調整至少一物體於右眼影像圖框R的位置，以產生至少一調整後右眼影像圖框；舉例來說，請參考第3圖，影像處理單元130可以使用深度影像繪圖(Depth Based Image Rendering，DIBR)之多視角合成方法(multi-view synthesis)來產生兩個調整後左眼影像圖框LL、LR以及兩個調整後右眼影像圖框RL、RR。另外，第4圖所示為左眼影像圖框L、右眼影像圖框R以及兩個調整後左眼影像圖框LL、LR以及兩個調整後右眼影像圖框RL、RR在景深上的示意圖。在第4圖中，調整後左眼影像圖框LL與調整後右眼影像圖框RR可視為一組調整後立體影像，其所顯示的畫面就如同兩台攝影機以較寬角度/較長距離來拍攝同一景像，因此具有較強的景深；另一方面，調整後左眼影像圖框LR與調整後右眼影像圖框RL可視為另一組調整後立體影像，其所顯示的畫面就如同兩台攝影機以較窄角度/較短距離來拍攝同一景像，因此具有較弱的景深。First, in step 200, the receiving unit 110 receives a stereoscopic image. Next, in step 202, for a left-eye image frame L and a right-eye image frame R in the stereoscopic image, the disparity map generating unit 120 generates the image according to the left-eye image frame L and the right-eye image frame R. a left-eye disparity map and a right-eye disparity map, wherein the left-eye disparity map and the right-eye disparity map are used to indicate the position of an object in the left-eye image frame L and the object in the right eye The horizontal distance between the positions of the image frame R. Then, in step 204, the image processing unit 130 adjusts the position of the at least one object in the left-eye image frame L according to the left-eye disparity map to generate at least one adjusted left-eye image frame, and according to the right eye. The parallax map is used to adjust the position of at least one object in the right eye image frame R to generate at least one adjusted right eye image frame; for example, referring to FIG. 3, the image processing unit 130 may use depth image mapping (Depth) Based on Image Rendering (DIBR), a multi-view synthesis method is used to generate two adjusted left eye image frames LL, LR and two adjusted right eye image frames RL, RR. In addition, Fig. 4 shows the left eye image frame L, the right eye image frame R, and the two adjusted left eye image frames LL, LR and the two adjusted right eye image frames RL, RR on the depth of field. Schematic diagram. In Fig. 4, the adjusted left eye image frame LL and the adjusted right eye image frame RR can be regarded as a set of adjusted stereoscopic images, and the displayed image is like a wide angle/long distance between the two cameras. To capture the same scene, so it has a strong depth of field; on the other hand, the adjusted left-eye image frame LR and the adjusted right-eye image frame RL can be regarded as another set of adjusted stereoscopic images, and the displayed image is displayed. Just as two cameras take the same scene at a narrower angle/short distance, they have a weaker depth of field.
另外，於本發明一實施例中，由於在調整左/右眼影像圖框以產生調整後左/右眼影像圖框時，可能會只針對左/右眼影像圖框中部分的物體進行水平移動，因此，該些移動物體在左/右眼影像圖框中的原始位置會失去影像資料，為了解決此問題，在調整部分物體於左/右眼影像圖框中的位置之後，影像處理單元130會另外對左/右眼影像圖框中該物體的原始位置進行背景插補，以產生該調整後左/右眼影像圖框。In addition, in an embodiment of the present invention, since the left/right eye image frame is adjusted to generate the adjusted left/right eye image frame, only the objects in the left/right eye image frame may be leveled. Moving, therefore, the moving objects will lose image data in the original position in the left/right eye image frame. To solve this problem, after adjusting the position of some objects in the left/right eye image frame, the image processing unit 130 additionally performs background interpolation on the original position of the object in the left/right eye image frame to generate the adjusted left/right eye image frame.
接著，於步驟206中，影像處理單元130依據一使用者輸入指令Vc，以自原始立體影像或是所產生之一或多個調整後立體影像中選擇其一，並將所選擇之立體影像的顯示資料傳送至顯示裝置140來播放。亦即，若是使用者覺得目前所觀看的立體影像景深不足，則可以藉由輸入指令Vc來選擇具有較強景深的調整後立體影像(例如第4圖所示之調整後左眼影像圖框LL與調整後右眼影像圖框RR)；而若是使用者覺得目前所觀看的立體影像景深太強，則可以藉由輸入指令Vc來選擇具有較弱景深的調整後立體影像(例如第4圖所示之調整後左眼影像圖框LR與調整後右眼影像圖框RL)。Next, in step 206, the image processing unit 130 selects one of the original stereoscopic images or one or more of the adjusted stereoscopic images according to a user input command Vc, and selects the selected stereoscopic image. The display material is transmitted to the display device 140 for playback. That is, if the user feels that the stereoscopic image currently viewed is insufficient in depth, the adjusted stereoscopic image having a strong depth of field can be selected by inputting the command Vc (for example, the adjusted left-eye image frame LL shown in FIG. 4) And the adjusted right eye image frame RR); if the user feels that the stereoscopic image currently viewed is too strong, the adjusted stereoscopic image with weaker depth of field can be selected by inputting the command Vc (for example, FIG. 4) The adjusted left eye image frame LR and the adjusted right eye image frame RL) are shown.
簡要歸納本發明，於本發明之調整立體影像之景深的方法以及顯示立體影像的方法與相關裝置中，可以依據原始立體影像來產生一或多組具有不同景深的調整後立體影像，而使用者可以依據喜好以及顯示螢幕大小來選擇要觀看哪種景深的立體影像，以達到最佳的顯示品質。Briefly summarized in the present invention, in the method for adjusting the depth of field of a stereoscopic image of the present invention and the method and related apparatus for displaying a stereoscopic image, one or more sets of adjusted stereoscopic images having different depths of field may be generated according to the original stereoscopic image, and the user You can choose which stereoscopic image of the depth of field you want to watch based on your preferences and the size of the display screen to achieve the best display quality.
以上所述僅為本發明之較佳實施例，凡依本發明申請專利範圍所做之均等變化與修飾，皆應屬本發明之涵蓋範圍。The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.
100．．．裝置100. . . Device
110．．．接收單元110. . . Receiving unit
120．．．視差圖產生單元120. . . Disparity map generation unit
130．．．影像處理單元130. . . Image processing unit
140．．．顯示裝置140. . . Display device
200~206．．．步驟200~206. . . step
第1圖為依據本發明一實施例之裝置100的示意圖。1 is a schematic illustration of an apparatus 100 in accordance with an embodiment of the present invention.
第2圖為依據本發明一實施例之調整立體影像之景深的方法以及顯示立體影像的方法的流程圖。2 is a flow chart of a method of adjusting a depth of field of a stereoscopic image and a method of displaying a stereoscopic image according to an embodiment of the invention.
第3圖為產生調整後左眼影像圖框以及調整後右眼影像圖框的示意圖。Figure 3 is a schematic diagram of the adjusted left eye image frame and the adjusted right eye image frame.
第4圖為兩組調整後立體影像所代表之景深的示意圖。Figure 4 is a schematic diagram of the depth of field represented by the two sets of adjusted stereoscopic images.
100．．．裝置100. . . Device
110．．．接收單元110. . . Receiving unit
120．．．視差圖產生單元120. . . Disparity map generation unit
130．．．影像處理單元130. . . Image processing unit
140．．．顯示裝置140. . . Display device
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW100149956A TW201327470A (en) | 2011-12-30 | 2011-12-30 | Method for adjusting depths of 3D image and method for displaying 3D image and associated device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW100149956A TW201327470A (en) | 2011-12-30 | 2011-12-30 | Method for adjusting depths of 3D image and method for displaying 3D image and associated device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| TW201327470A true TW201327470A (en) | 2013-07-01 |
Family
ID=49225131
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW100149956A TW201327470A (en) | 2011-12-30 | 2011-12-30 | Method for adjusting depths of 3D image and method for displaying 3D image and associated device |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TW201327470A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI566576B (en) * | 2014-06-03 | 2017-01-11 | 宏碁股份有限公司 | Stereoscopic view synthesis method and apparatus using the same |
| CN108307186A (en) * | 2018-02-07 | 2018-07-20 | 深圳市华星光电半导体显示技术有限公司 | Display control method, device, storage medium and the terminal of bore hole 3D rendering |
| US10607388B2 (en) | 2018-02-07 | 2020-03-31 | Shenzhen China Star Optoelectronics Semiconductor Display Technology Co., Ltd. | Display control method, display control device, storage medium and terminal of autostereoscopic three-dimensional (3D) image |
-
2011
- 2011-12-30 TW TW100149956A patent/TW201327470A/en unknown
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI566576B (en) * | 2014-06-03 | 2017-01-11 | 宏碁股份有限公司 | Stereoscopic view synthesis method and apparatus using the same |
| CN108307186A (en) * | 2018-02-07 | 2018-07-20 | 深圳市华星光电半导体显示技术有限公司 | Display control method, device, storage medium and the terminal of bore hole 3D rendering |
| US10607388B2 (en) | 2018-02-07 | 2020-03-31 | Shenzhen China Star Optoelectronics Semiconductor Display Technology Co., Ltd. | Display control method, display control device, storage medium and terminal of autostereoscopic three-dimensional (3D) image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101602904B1 (en) | A method of processing parallax information comprised in a signal | |
| US8711204B2 (en) | Stereoscopic editing for video production, post-production and display adaptation | |
| CN104010178B (en) | Binocular image parallax adjustment method and device and binocular camera | |
| TWI520569B (en) | Depth infornation generator, depth infornation generating method, and depth adjustment apparatus | |
| TWI504232B (en) | Apparatus for rendering 3d images | |
| JP2011176800A (en) | Image processing apparatus, 3d display apparatus, and image processing method | |
| KR20120032321A (en) | Display apparatus and method for processing image applied to the same | |
| US20170171534A1 (en) | Method and apparatus to display stereoscopic image in 3d display system | |
| JP6033625B2 (en) | Multi-viewpoint image generation device, image generation method, display device, program, and recording medium | |
| JP2003348621A (en) | Means for setting two-viewpoint camera | |
| TW201327470A (en) | Method for adjusting depths of 3D image and method for displaying 3D image and associated device | |
| TWI436636B (en) | Method and apparatus for adjusting three dimension video image | |
| CN103609104A (en) | Interactive user interface for stereoscopic effect adjustment | |
| JP5562122B2 (en) | Image processing apparatus and control method thereof | |
| JP2012080294A (en) | Electronic device, video processing method, and program | |
| CN104168469A (en) | Stereo preview apparatus and stereo preview method | |
| TW201230770A (en) | Apparatus and method for stereoscopic effect adjustment on video display | |
| JP2012222588A (en) | Image processing apparatus, image processing method, and program | |
| JP5036088B2 (en) | Stereoscopic image processing apparatus, stereoscopic image processing method, and program | |
| JP2011176822A (en) | Image processing apparatus, 3d display apparatus, and image processing method | |
| TWM471597U (en) | Auto-stereoscopic display system | |
| TWI502960B (en) | Device and method for 2d to 3d conversion | |
| CN103248904A (en) | Method for adjusting depth of field of stereoscopic image and method and device for displaying stereoscopic image | |
| Yang et al. | 3DTV Video Acquisition and Processing for Visual Discomfort Alleviation | |
| Lin | Controlling depth perception of stereoscopic images under given constraints |