TWI472218B - Device and method for generating stereoscopic image - Google Patents
Device and method for generating stereoscopic image Download PDFInfo
- Publication number
- TWI472218B TWI472218B TW100104576A TW100104576A TWI472218B TW I472218 B TWI472218 B TW I472218B TW 100104576 A TW100104576 A TW 100104576A TW 100104576 A TW100104576 A TW 100104576A TW I472218 B TWI472218 B TW I472218B
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- brightness
- picture
- map
- dimensional
- Prior art date
Links
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Controls And Circuits For Display Device (AREA)
Description
本發明是有關於一種影像產生裝置及其方法，且特別是有關於一種立體影像產生裝置及其方法。 The present invention relates to an image generating apparatus and method thereof, and more particularly to a stereoscopic image generating apparatus and method thereof.
隨著科技的進步與發達，人們對於物質生活以及精神層面的享受一向都只有增加而從未減少。以精神層面而言，在這科技日新月異的年代，人們希望能夠藉由立體顯示器來實現天馬行空的想像力，以達到身歷其境的效果；因此，如何使立體顯示器呈現立體的圖像或影像，便成為現今立體顯示器技術亟欲達到的目標。 With the advancement and development of science and technology, people's enjoyment of material life and spiritual level has always increased and never decreased. On the spiritual level, in this era of rapid technological change, people hope to achieve the imaginative effect of stereoscopic displays through stereoscopic displays; therefore, how to make stereoscopic images or stereoscopic images become stereoscopic images. Today's stereoscopic display technology is the desired goal.
立體顯示技術可大致分成使用者需戴特殊設計眼鏡觀看之戴眼鏡式(stereoscopic)以及直接裸眼觀看之裸眼式(naked eye)。就目前的立體顯示技術而言，主要是利用觀察者的左眼與右眼分別看到不同視差的左眼影像與右眼影像，而使觀察者感受到立體的視覺效果。一般來說，利用兩台照相機可分別取得左眼影像與右眼影像。或者，直接利用立體照相機來同時取得左眼影像與右眼影像，其中這種立體照相機是由兩台照相機所構成。 The stereoscopic display technology can be broadly divided into a stereoscopic eye that the user needs to wear with special design glasses and a naked eye that is directly viewed by the naked eye. In the current stereoscopic display technology, the left eye and the right eye of the observer are respectively used to see the left eye image and the right eye image of different parallaxes respectively, so that the observer perceives the stereoscopic visual effect. In general, the left eye image and the right eye image can be obtained by using two cameras. Alternatively, the stereo camera can be used to simultaneously acquire the left eye image and the right eye image, wherein the stereo camera is composed of two cameras.
此外，若能夠得到二維畫面的深度資訊，則二維畫面中每一物件相對的平移量便可透過計算取得，據此可將二維畫面生成對應的左眼畫面及右眼畫面。在現在，大部分的二維影像轉立體影像的方法中，都無法輕易的將原有的 二維影像直接轉換成立體影像。美國專利公開號US 20060232666之專利提出一種多視點影像生成的方法，其利用前一張及目前畫面的運動向量、亮度或顏色值為依據做邊緣偵測，再利用邊緣偵測來產生畫面深度圖。但是，在物件邊緣往往不易準確偵測而容易偵測錯誤，進而容易生成錯誤的畫面深度圖，以致於影響到立體影像的品質。 In addition, if the depth information of the two-dimensional picture can be obtained, the relative translation amount of each object in the two-dimensional picture can be obtained by calculation, and accordingly, the corresponding left-eye picture and right-eye picture can be generated on the two-dimensional picture. At present, most of the methods of 2D image to 3D image cannot be easily used. The 2D image is directly converted into a volume image. US Patent Publication No. US 20060232666 proposes a method for multi-view image generation, which uses the motion vector, brightness or color value of the previous and current pictures as edge detection, and then uses edge detection to generate a picture depth map. . However, at the edge of the object, it is often difficult to accurately detect and easily detect errors, and thus it is easy to generate an erroneous picture depth map, so as to affect the quality of the stereoscopic image.
本發明提供一種立體影像產生裝置及其方法，其可將二維畫面轉換為左眼畫面及右眼畫面，而右眼畫面與前一張二維畫面的左眼畫面搭配以產生立體影像，以提升視覺的立體感，並且加強影像的膚色部分。 The present invention provides a stereoscopic image generating device and a method thereof, which can convert a two-dimensional image into a left-eye image and a right-eye image, and a right-eye image is matched with a left-eye image of a previous two-dimensional image to generate a stereoscopic image to enhance vision. The stereoscopic effect and enhance the skin color portion of the image.
本發明提出一種立體影像產生裝置，包括亮度擷取單元、Cr色度擷取單元、第一加法器、亮度調整單元、背景深度產生單元、第二加法器、影像產生單元及延遲單元。亮度擷取單元接收二維畫面，且輸出二維畫面的亮度圖。Cr色度擷取單元接收二維畫面，且輸出二維畫面的Cr色度圖。第一加法器耦接亮度擷取單元及Cr色度擷取單元，用以結合亮度圖及Cr色度圖並輸出亮度參考圖。亮度調整單元耦接第一加法器，用以調整亮度參考圖的亮度值範圍。背景深度產生單元，用以產生背景深度圖。第二加法器耦接亮度調整單元及背景深度產生單元，用以結合調整後的亮度參考圖及背景深度圖並輸出畫面深度圖。影像產生單元耦接第二加法器並接收二維畫面，以依據二維畫面 及畫面深度圖產生左眼畫面及右眼畫面。延遲單元耦接影像產生單元，用以將左眼畫面及右眼畫面其中之一延遲一畫面期間。 The invention provides a stereoscopic image generating device, which comprises a brightness capturing unit, a Cr color capturing unit, a first adder, a brightness adjusting unit, a background depth generating unit, a second adder, an image generating unit and a delay unit. The brightness capturing unit receives the two-dimensional picture and outputs a brightness map of the two-dimensional picture. The Cr chromaticity capturing unit receives the two-dimensional picture and outputs a Cr chromaticity diagram of the two-dimensional picture. The first adder is coupled to the brightness capturing unit and the Cr color capturing unit for combining the brightness map and the Cr chromaticity diagram and outputting the brightness reference map. The brightness adjustment unit is coupled to the first adder for adjusting the brightness value range of the brightness reference map. A background depth generating unit for generating a background depth map. The second adder is coupled to the brightness adjusting unit and the background depth generating unit for combining the adjusted brightness reference picture and the background depth map and outputting the picture depth map. The image generating unit is coupled to the second adder and receives the two-dimensional image according to the two-dimensional image And the depth map of the screen produces a left eye picture and a right eye picture. The delay unit is coupled to the image generating unit for delaying one of the left eye frame and the right eye frame by one frame period.
在本發明之一實施例中，上述之調整後的亮度參考圖的亮度值範圍與背景深度圖的亮度值範圍的總和為二維畫面的亮度值範圍。 In an embodiment of the invention, the sum of the brightness value range of the adjusted brightness reference map and the brightness value range of the background depth map is a range of brightness values of the two-dimensional picture.
在本發明之一實施例中，上述之調整後的亮度參考圖的亮度值範圍小於二維畫面的亮度值範圍的一半。 In an embodiment of the invention, the brightness value range of the adjusted brightness reference map is less than half of the brightness value range of the two-dimensional picture.
在本發明之一實施例中，立體影像產生裝置更包括一緩衝單元，耦接影像產生單元並接收二維畫面，用以緩衝二維畫面。 In an embodiment of the present invention, the stereoscopic image generating device further includes a buffer unit coupled to the image generating unit and receiving the two-dimensional image for buffering the two-dimensional image.
在本發明之一實施例中，上述之背景深度產生單元包括列計數器及亮度值查找單元。列計數器接收二維畫面，以計數二維畫面的列數並輸出計數結果。亮度值查找單元耦接列計數器，並依據計數結果查找一查找表，以依據二維畫面的列數輸出對應的亮度值而形成背影深度圖。 In an embodiment of the invention, the background depth generation unit includes a column counter and a brightness value search unit. The column counter receives the two-dimensional picture to count the number of columns of the two-dimensional picture and output the counting result. The brightness value search unit is coupled to the column counter, and searches a lookup table according to the counting result to output a corresponding brightness value according to the number of columns of the two-dimensional picture to form a back depth map.
在本發明之一實施例中，上述之影像產生單元依據一深度影像繪圖法(depth-image-based rendering，DIBR)產生左眼畫面及右眼畫面。 In an embodiment of the invention, the image generating unit generates a left-eye image and a right-eye image according to a depth-image-based rendering (DIBR).
本發明亦提出一種立體影像產生方法，包括下列步驟。接收二維畫面。取得二維畫面的亮度圖及Cr色度圖。結合亮度圖及Cr色度圖作為亮度參考圖。結合亮度參考圖及背景深度圖以產生畫面深度圖。依據二維畫面及畫面深度圖產生左眼畫面及右眼畫面。輸出左眼畫及右眼畫面其 中之一，而左眼畫面及右眼畫面其中另一延遲一畫面期間後輸出。 The invention also proposes a stereo image generating method, which comprises the following steps. Receive a two-dimensional picture. Obtain the brightness map and Cr chromaticity diagram of the two-dimensional picture. The luminance map and the Cr chromaticity map are combined as a luminance reference map. The brightness reference map and the background depth map are combined to generate a picture depth map. The left eye picture and the right eye picture are generated according to the two-dimensional picture and the picture depth map. Output left eye and right eye One of them, while the left eye picture and the right eye picture are output after another one delay period.
在本發明之一實施例中，上述之亮度參考圖的亮度值範圍與背景深度圖的亮度值範圍的總和為二維畫面的亮度值範圍。 In an embodiment of the invention, the sum of the brightness value range of the brightness reference map and the brightness value range of the background depth map is a range of brightness values of the two-dimensional picture.
在本發明之一實施例中，上述之二維畫面的亮度值範圍小於等於二維畫面的亮度值範圍的一半。 In an embodiment of the invention, the brightness value range of the two-dimensional picture is less than or equal to half of the brightness value range of the two-dimensional picture.
在本發明之一實施例中，上述之背影深度圖的亮度值為由上往下逐列遞增。 In an embodiment of the invention, the brightness value of the back depth map is incremented column by column from top to bottom.
在本發明之一實施例中，上述之左眼畫面及右眼畫面為利用深度影像繪圖法產生。 In an embodiment of the invention, the left eye picture and the right eye picture are generated by a depth image mapping method.
基於上述，本發明實施例的立體影像產生裝置及其方法，其取得二維畫面的亮度圖及Cr色度圖以產生亮度參考圖，再將亮度參考圖與背景深度圖結合生成畫面深度圖，依據畫面深度圖及二維畫面可產生左眼畫面及右眼畫面，其中左眼畫面或右眼畫面的其中之一會對應的與前一張二維畫面的右眼畫面或左眼畫面作為立體影像的左眼畫面及右眼畫面。藉此，可產生立體影像的左眼畫面及右眼畫面，並且可提升視覺的立體感。 Based on the above, the stereoscopic image generating device and the method thereof are configured to obtain a luminance map and a Cr chromaticity map of a two-dimensional image to generate a luminance reference map, and then combine the luminance reference map and the background depth map to generate a depth map. The left-eye image and the right-eye image may be generated according to the image depth map and the two-dimensional image, wherein one of the left-eye image or the right-eye image corresponds to the right-eye image or the left-eye image of the previous two-dimensional image as the stereoscopic image. Left eye image and right eye image. Thereby, the left-eye image and the right-eye image of the stereoscopic image can be generated, and the stereoscopic effect of the visual can be improved.
為讓本發明之上述特徵和優點能更明顯易懂，下文特舉實施例，並配合所附圖式作詳細說明如下。 The above described features and advantages of the present invention will be more apparent from the following description.
一般來說，由於大部分人都是右手使用攝影機，因此 大部分的使用者利用攝影機對一個物件的拍攝習慣都是沿著物件由左到右拍攝。換言之，等同於在極短的時間內拍攝完第一個畫面之後向右移動並接著拍攝第二個畫面。在此情形下，相對於第二個畫面，上述第一個畫面等同於以左方視角方向看去，因此第一個畫面可以當作是左眼所看到的畫面。同樣地，而上述第二個畫面等同於以右方視角方向看去，因此第二個畫面可以當作是右眼所看到的畫面。 Generally speaking, since most people use the camera with their right hand, Most users use the camera to shoot an object from left to right along the object. In other words, it is equivalent to moving to the right after taking the first picture in a very short time and then taking the second picture. In this case, the first picture is equivalent to the left view direction with respect to the second picture, so the first picture can be regarded as the picture seen by the left eye. Similarly, the second picture described above is equivalent to looking in the right view direction, so the second picture can be regarded as the picture seen by the right eye.
依據上述，本發明會依據所拍攝到的每一張二維畫面產生對應的左眼畫面及右眼畫面，並且每一張左眼畫面會與對應下一張二維畫面的右眼畫面分別作為立體影像的左眼畫面及右眼畫面，以提升視覺的立體感。並且，本發明會擷取二維畫面的Cr色度圖，以強化二維畫面的膚色部分，進而強化物件判斷的準確度。 According to the above, the present invention generates a corresponding left-eye image and a right-eye image according to each of the captured two-dimensional images, and each left-eye image and the right-eye image corresponding to the next two-dimensional image are respectively used as the left of the stereoscopic image. Eye picture and right eye picture to enhance the three-dimensional sense of vision. Moreover, the present invention captures the Cr chromaticity diagram of the two-dimensional picture to enhance the skin color portion of the two-dimensional picture, thereby enhancing the accuracy of the object determination.
圖1為依據本發明一實施例的立體影像產生裝置的系統示意圖。圖2A至圖2J為本發明一實施例的二維畫面、亮度圖、Cr色度圖、亮度參考圖、調整後的亮度參考圖、背影深度圖、畫面深度圖、左眼畫面及右眼畫面的示意圖。請參照圖1，在本實施例中，立體影像產生裝置100包括亮度擷取單元110、Cr色度擷取單元120、加法器130、160、亮度調整單元140、背影深度產生單元150、影像產生單元170、延遲單元180及緩衝單元190。 FIG. 1 is a schematic diagram of a system of a stereoscopic image generating device according to an embodiment of the invention. 2A to 2J are a two-dimensional picture, a luminance map, a Cr chromaticity diagram, a luminance reference map, an adjusted luminance reference map, a back depth map, a screen depth map, a left-eye image, and a right-eye image according to an embodiment of the invention. Schematic diagram. Referring to FIG. 1 , in the embodiment, the stereoscopic image generating device 100 includes a brightness capturing unit 110 , a Cr color capturing unit 120 , an adder 130 , 160 , a brightness adjusting unit 140 , a back image depth generating unit 150 , and image generation. The unit 170, the delay unit 180, and the buffer unit 190.
亮度擷取單元110接收二維畫面FR，並擷取二維畫面FR的亮度分佈以輸出二維畫面FR的亮度圖PB，其中二維畫面FR如圖2A所示，亮度圖PB如圖2B所示。進 一步來說，亮度擷取單元110可在取得每一畫素的紅色子畫素、綠色子畫素及藍色子畫素的亮度值(即灰階值)後取平均值以作為每一畫素的亮度值。據此，當二維畫面FR為彩色畫面，則亮度圖PB會為灰階畫面(即不具有色彩的畫面)。 The brightness capturing unit 110 receives the two-dimensional picture FR and extracts the brightness distribution of the two-dimensional picture FR to output a brightness picture PB of the two-dimensional picture FR, wherein the two-dimensional picture FR is as shown in FIG. 2A, and the brightness picture PB is as shown in FIG. 2B. Show. Enter In one step, the brightness capturing unit 110 may average the brightness values (ie, gray scale values) of the red sub-pixel, the green sub-pixel, and the blue sub-pixel of each pixel to obtain each picture. The brightness value of the prime. Accordingly, when the two-dimensional picture FR is a color picture, the luminance picture PB will be a gray-scale picture (ie, a picture having no color).
Cr色度擷取單元120同樣接收二維畫面FR，並擷取二維畫面FR的Cr色度分佈以輸出輸出二維畫面FR的Cr色度圖PCr，其中Cr色度圖PCr如圖2C所示，而Cr色度圖PCr會保留二維畫面FR的中膚色部份，亦即Cr色度圖PCr會突顯二維畫面FR的膚色的部分。進一步來說，亮度擷取單元110可在取得每一畫素的紅色子畫素、綠色子畫素及藍色子畫素的亮度值(即灰階值)後，可利用下列公式計算每一畫素的亮度值。 The Cr chroma extraction unit 120 also receives the two-dimensional picture FR and extracts the Cr chromaticity distribution of the two-dimensional picture FR to output a Cr chromaticity diagram PCr outputting the two-dimensional picture FR, wherein the Cr chromaticity diagram PCr is as shown in FIG. 2C. The Cr chromaticity diagram PCr retains the mid-skin portion of the two-dimensional picture FR, that is, the Cr chromaticity diagram PCr highlights the portion of the skin color of the two-dimensional picture FR. Further, after acquiring the luminance values (ie, grayscale values) of the red sub-pixel, the green sub-pixel, and the blue sub-pixel of each pixel, the brightness capturing unit 110 may calculate each of the following formulas. The brightness value of the pixel.
Cr=0.5×R-0.419×G-0.081×B Cr=0.5×R-0.419×G-0.081×B
其中，上述公式中的Cr為每一畫素的色度值，R為每一紅色子畫素的亮度值，G為每一綠色子畫素的亮度值，B為每一藍色子畫素的亮度值。 Wherein, Cr in the above formula is the chromaticity value of each pixel, R is the luminance value of each red sub-pixel, G is the luminance value of each green sub-pixel, and B is each blue sub-pixel. The brightness value.
加法器130耦接亮度擷取單元110及Cr色度擷取單元120，用以結合亮度圖PB及Cr色度圖PCr並輸出亮度參考圖PBR，其中亮度參考圖PBR如圖2D所示，並且亮度參考圖PBR中的膚色部份會呈現高亮度，使得物件(在此以人體為例)會變得更明顯。進一步來說，加法器130會將每一個畫素所對應的亮度值及色度值相加，在所有畫素的亮度值與色度值相加後則形成亮度參考圖PBR。由於 Cr色度圖PCr會突顯膚色的部分，因此亮度參考圖PBR中的膚色部份亦會被突顯出來(在此為呈現高亮度狀態)。 The adder 130 is coupled to the luminance capturing unit 110 and the Cr chroma capturing unit 120 for combining the luminance map PB and the Cr chromaticity diagram PCr and outputting the luminance reference map PBR, wherein the luminance reference map PBR is as shown in FIG. 2D, and The skin color portion of the brightness reference map PBR will exhibit high brightness, making the object (here, for example, the human body) more visible. Further, the adder 130 adds the luminance value and the chrominance value corresponding to each pixel, and adds the luminance value and the chrominance value of all the pixels to form the luminance reference map PBR. due to The Cr chromaticity diagram PCr highlights the portion of the skin color, so the skin color portion of the brightness reference map PBR is also highlighted (here, the high brightness state is presented).
亮度調整單元140耦接加法器130，用以調整亮度參考圖PBR的亮度值範圍後輸出調整後之亮度參考圖PBR’，其中而亮度參考圖PBR’如圖2E所示。背景深度產生單元150用以產生背景深度圖PBD，其中背景深度圖PBD如圖2F所示。一般而言，畫面的背景的上方會離人眼較遠，而畫面的背景的下方會離人眼較近，在此以低亮度值(例如亮度值0)表示遠距離，以高亮度值(例如亮度值192)表示近距離，而畫面的亮度值會由上方至下方遞增，因此背影深度圖PBD的亮度值為由上往下逐列遞增。加法器160耦接亮度調整單元140及背景深度產生單元150，用以結合亮度參考圖PBR’及背景深度圖PBD並輸出一畫面深度圖PFD，其中畫面深度圖PFD如圖2G所示。 The brightness adjustment unit 140 is coupled to the adder 130 for adjusting the brightness value range of the brightness reference picture PBR and outputting the adjusted brightness reference picture PBR', wherein the brightness reference picture PBR' is as shown in FIG. 2E. The background depth generating unit 150 is configured to generate a background depth map PBD, wherein the background depth map PBD is as shown in FIG. 2F. In general, the top of the background of the picture will be farther away from the human eye, and the bottom of the background of the picture will be closer to the human eye. Here, the low distance value (for example, the brightness value 0) indicates the long distance, with a high brightness value ( For example, the brightness value 192) indicates a close distance, and the brightness value of the picture is increased from top to bottom, so the brightness value of the back depth map PBD is incremented column by column from top to bottom. The adder 160 is coupled to the brightness adjustment unit 140 and the background depth generation unit 150 for combining the brightness reference map PBR' and the background depth map PBD and outputting a picture depth map PFD, wherein the picture depth map PFD is as shown in FIG. 2G.
在本實施例中，亮度參考圖PBR’的亮度值範圍被調整為二維畫面FR的亮度值範圍。假設二維畫面FR的亮度值範圍為0~255，亮度參考圖PBR’的亮度值範圍會為0~64，亦即1/4的二維畫面FR的亮度值範圍。此時，亮度值的調整方式可以亮度參考圖PBR的每一畫素的亮度值除以4即可得到亮度參考圖PBR’。並且，背影深度圖PBD的亮度值範圍設定為0~192，亦即3/4的二維畫面FR的亮度值範圍，以便加法器160將背影深度圖PBD與亮度參考圖PBR’結合所輸出的畫面深度圖PFD的每一畫素的 亮度值不會超過上限，進而避免畫面深度圖PFD中物件因亮度值超過上限而模糊。 In the present embodiment, the luminance value range of the luminance reference map PBR' is adjusted to the luminance value range of the two-dimensional picture FR. Assuming that the luminance value of the two-dimensional picture FR ranges from 0 to 255, the luminance value range of the luminance reference picture PBR' may range from 0 to 64, that is, the luminance value range of the 1/4 two-dimensional picture FR. At this time, the brightness value can be adjusted by dividing the brightness value of each pixel of the luminance reference picture PBR by 4 to obtain the brightness reference picture PBR'. Moreover, the luminance value range of the back depth map PBD is set to be 0 to 192, that is, the luminance value range of the 3/4 two-dimensional picture FR, so that the adder 160 combines the back depth map PBD and the luminance reference picture PBR′. Picture depth map for each pixel of the PFD The brightness value does not exceed the upper limit, and the object in the picture depth map PFD is prevented from being blurred due to the brightness value exceeding the upper limit.
在其他實施例中，亮度參考圖PBR’的亮度值範圍與背影深度圖PBD的亮度值範圍的總和會等於二維畫面FR的亮度值範圍，並且畫面深度圖PFD會以背影深度圖PBD為主，因此亮度參考圖PBR’的亮度值範圍會小於等於二維畫面FR的亮度值範圍。 In other embodiments, the sum of the luminance value range of the luminance reference map PBR′ and the luminance value range of the back depth map PBD is equal to the luminance value range of the two-dimensional picture FR, and the picture depth map PFD is mainly based on the back depth map PBD. Therefore, the luminance value range of the luminance reference picture PBR' may be smaller than or equal to the luminance value range of the two-dimensional picture FR.
緩衝單元190耦接影像產生單元170並接收二維畫面FR，用以緩衝二維畫面FR，以使影像產生單元170接收畫面深度圖PFD及二維畫面FR的時間相似或相同。影像產生單元170耦接加法器160及緩衝單元190以接收二維畫面FR及畫面深度圖PFD，影像產生單元170依據二維畫面FR及畫面深度圖PFD產生左眼畫面LF及右眼畫面RF，其中影像產生單元170可依據深度影像繪圖法(depth-image-based rendering，DIBR)產生左眼畫面LF及右眼畫面RF，並且左眼畫面LF及右眼畫面RF分別如圖2H及圖2I所示。 The buffer unit 190 is coupled to the image generating unit 170 and receives the two-dimensional picture FR for buffering the two-dimensional picture FR so that the time when the image generating unit 170 receives the picture depth map PFD and the two-dimensional picture FR is similar or the same. The image generating unit 170 is coupled to the adder 160 and the buffer unit 190 to receive the two-dimensional picture FR and the picture depth map PFD. The image generating unit 170 generates the left-eye picture LF and the right-eye picture RF according to the two-dimensional picture FR and the picture depth map PFD. The image generating unit 170 can generate a left-eye image LF and a right-eye image RF according to depth-image-based rendering (DIBR), and the left-eye image LF and the right-eye image RF are respectively as shown in FIG. 2H and FIG. Show.
在本實施例中，圖2H及圖2I為移動前景(即人物)來生成左眼畫面LF及右眼畫面RF，亦即背景不動，圖2H的人物會偏右，圖2I的人物會偏左。但在其他實施例中，左眼畫面LF及右眼畫面RF可以移動背景來生成左眼畫面LF及右眼畫面RF，亦即前景(即人物)不會，左眼畫面LF的背景會左移，右眼畫面RF的背景會右移。 In this embodiment, FIG. 2H and FIG. 2I are moving foreground (ie, a person) to generate a left-eye picture LF and a right-eye picture RF, that is, the background is not moving, the person in FIG. 2H will be to the right, and the person in FIG. 2I will be left-left. . However, in other embodiments, the left-eye picture LF and the right-eye picture RF may move the background to generate the left-eye picture LF and the right-eye picture RF, that is, the foreground (ie, the person) does not, and the background of the left-eye picture LF moves to the left. The background of the right eye picture RF will shift to the right.
延遲單元180耦接影像產生單元170，用以將左眼畫 面LF延遲一個畫面期間後輸出，而右眼畫面RF會直接輸出。據此，右眼畫面RF會與對應前一張二維畫面FR的左眼畫面LF’配對以作為立體影像的左眼畫面及右眼畫面。 The delay unit 180 is coupled to the image generating unit 170 for drawing the left eye The surface LF is delayed after one picture period, and the right eye picture RF is directly output. Accordingly, the right-eye picture RF is paired with the left-eye picture LF' corresponding to the previous two-dimensional picture FR to serve as a left-eye picture and a right-eye picture of the stereoscopic video.
進一步來說，在本實施例中，背景深度產生單元150包括列計數器151及亮度值查找單元153。列計數器151接收二維畫面FR，以計數二維畫面FR的列數並輸出計數結果CR。亮度值查找單元153耦接列計數器151，並依據計數結果CR查找一查找表，以依據二維畫面FR的列數輸出對應的亮度值以形成背影深度圖PBD。在顯示器中，畫面的寫入方式會由上至下，因此二維畫面FR的列數會由上方往下計數。當計數結果CR表示二維畫面FR的列數逐漸增加時，則亮度值查找單元153輸出的亮度值亦會依據計數結果CR而增加，以致於可形成亮度值為由上往下逐列遞增的背影深度圖PBD。 Further, in the present embodiment, the background depth generation unit 150 includes a column counter 151 and a luminance value search unit 153. The column counter 151 receives the two-dimensional picture FR to count the number of columns of the two-dimensional picture FR and outputs the count result CR. The brightness value search unit 153 is coupled to the column counter 151, and searches a lookup table according to the count result CR to output a corresponding brightness value according to the number of columns of the two-dimensional picture FR to form a back depth map PBD. In the display, the picture is written from top to bottom, so the number of columns of the two-dimensional picture FR is counted from the top down. When the counting result CR indicates that the number of columns of the two-dimensional picture FR is gradually increased, the brightness value output by the brightness value searching unit 153 is also increased according to the counting result CR, so that the brightness value can be increased from top to bottom and column by column. Back view depth map PBD.
此外，在上述實施例中，是將左眼畫面LF延遲一個畫面期間後輸出，以使右眼畫面RF會與對應前一張二維畫面FR的左眼畫面LF’配對以作為立體影像的左眼畫面及右眼畫面。但在其他實施例中，可將右眼畫面RF延遲一個畫面期間後輸出，以使左眼畫面LF會與對應前一張二維畫面FR的右眼畫面配對以作為立體影像的左眼畫面及右眼畫面。換言之，在其他實施例中，延遲單元180用以將右眼畫面RF延遲一個畫面期間後輸出，而左眼畫面LF會直接輸出。據此，左眼畫面LF會與對應前一張二維畫面FR的右眼畫面配對以作為立體影像的左眼畫面及右 眼畫面。 Further, in the above embodiment, the left-eye picture LF is delayed by one picture period and output, so that the right-eye picture RF is paired with the left-eye picture LF' corresponding to the previous two-dimensional picture FR to serve as a left-eye picture of the stereoscopic picture. And the right eye picture. However, in other embodiments, the right-eye picture RF may be delayed by one picture period and then output, so that the left-eye picture LF is paired with the right-eye picture corresponding to the previous two-dimensional picture FR as the left-eye picture and the right eye of the stereoscopic image. Picture. In other words, in other embodiments, the delay unit 180 is configured to delay the right eye picture RF by one frame period and output the left eye picture LF. Accordingly, the left-eye picture LF is paired with the right-eye picture corresponding to the previous two-dimensional picture FR as the left-eye picture and the right of the stereoscopic image. Eye picture.
依據上述，可彙整一立體影像產生方法以應用於立體影像產生裝置100。圖3為依據本發明一實施例的立體影像產生方法的流程圖。請參照圖3，在本實施例中，會先接收二維畫面(步驟S310)，並且取得二維畫面的亮度圖及Cr色度圖(步驟S320)。接著，結合亮度圖及Cr色度圖作為亮度參考圖(步驟S330)。然後，結合亮度參考圖及背景深度圖以產生畫面深度圖(步驟S340)，再依據二維畫面及畫面深度圖產生左眼畫面及右眼畫面(步驟S350)。最後，輸出左眼畫面及右眼畫面的其中之一，而左眼畫面及右眼畫面的其中另一延遲一畫面期間後輸出。其中，上述步驟的細節可參照上述立體影像產生裝置100的說明，在此則不再贅述。 According to the above, a stereoscopic image generating method can be integrated to be applied to the stereoscopic image generating device 100. FIG. 3 is a flowchart of a method for generating a stereo image according to an embodiment of the invention. Referring to FIG. 3, in the present embodiment, a two-dimensional picture is received first (step S310), and a luminance map and a Cr chromaticity diagram of the two-dimensional picture are acquired (step S320). Next, the luminance map and the Cr chromaticity map are combined as a luminance reference map (step S330). Then, the brightness reference map and the background depth map are combined to generate a picture depth map (step S340), and the left eye picture and the right eye picture are generated according to the two-dimensional picture and the picture depth map (step S350). Finally, one of the left-eye picture and the right-eye picture is output, and the other of the left-eye picture and the right-eye picture is delayed by one picture period and output. For details of the above steps, reference may be made to the description of the above-described stereoscopic image generating device 100, and details are not described herein again.
綜上所述，本發明實施例的立體影像產生裝置及其方法，其取得二維畫面的亮度圖及Cr色度圖以產生亮度參考圖，再將亮度參考圖與背景深度圖結合生成畫面深度圖，依據畫面深度圖及二維畫面可產生左眼畫面及右眼畫面，其中左眼畫面或右眼畫面會對應的與前一張二維畫面的右眼畫面或左眼畫面作為立體影像的左眼畫面及右眼畫面。藉此，可產生立體影像的左眼畫面及右眼畫面，並且可提升視覺的立體感。 In summary, the stereoscopic image generating device and the method thereof are obtained by acquiring a luminance map and a Cr chromaticity diagram of a two-dimensional image to generate a luminance reference map, and combining the luminance reference map and the background depth map to generate a screen depth. The left eye picture and the right eye picture may be generated according to the picture depth map and the two-dimensional picture, wherein the left eye picture or the right eye picture corresponds to the left eye picture of the previous two-dimensional picture or the left eye picture as the left eye of the stereoscopic image Picture and right eye picture. Thereby, the left-eye image and the right-eye image of the stereoscopic image can be generated, and the stereoscopic effect of the visual can be improved.
雖然本發明已以實施例揭露如上，然其並非用以限定本發明，任何所屬技術領域中具有通常知識者，在不脫離本發明之精神和範圍內，當可作些許之更動與潤飾，故本 發明之保護範圍當視後附之申請專利範圍所界定者為準。 Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. this The scope of the invention is defined by the scope of the appended claims.
100‧‧‧立體影像產生裝置 100‧‧‧3D image generating device
110‧‧‧亮度擷取單元 110‧‧‧Brightness capture unit
120‧‧‧Cr色度擷取單元 120‧‧‧Cr color extraction unit
130、160‧‧‧加法器 130, 160‧‧ ‧ adder
140‧‧‧亮度調整單元 140‧‧‧Brightness adjustment unit
150‧‧‧背影深度產生單元 150‧‧‧ Back shadow depth generation unit
151‧‧‧列計數器 151‧‧‧ column counter
153‧‧‧亮度值查找單元 153‧‧‧Brightness value search unit
170‧‧‧影像產生單元 170‧‧‧Image Generation Unit
180‧‧‧延遲單元 180‧‧‧Delay unit
190‧‧‧緩衝單元 190‧‧‧buffer unit
FR‧‧‧二維畫面 FR‧‧‧ two-dimensional picture
LF、LF’‧‧‧左眼畫面 LF, LF’‧‧‧ left eye picture
PB‧‧‧亮度圖 PB‧‧‧Brightness map
PCr‧‧‧Cr色度圖 PCr‧‧‧Cr chromaticity diagram
PBD‧‧‧背景深度圖 PBD‧‧‧Depth map
PBR、PBR’‧‧‧亮度參考圖 PBR, PBR’‧‧‧ brightness reference map
PFD‧‧‧畫面深度圖 PFD‧‧‧ picture depth map
RF‧‧‧右眼畫面 RF‧‧‧right eye screen
S310、S320、S330、S340、S350、S360‧‧‧步驟 S310, S320, S330, S340, S350, S360‧‧ steps
圖1為依據本發明一實施例的立體影像產生裝置的系統示意圖。 FIG. 1 is a schematic diagram of a system of a stereoscopic image generating device according to an embodiment of the invention.
圖2A至圖2I為本發明一實施例的二維畫面、亮度圖、Cr色度圖、亮度參考圖、調整後的亮度參考圖、背影深度圖、畫面深度圖、左眼畫面及右眼畫面的示意圖。 2A to 2I are a two-dimensional picture, a luminance map, a Cr chromaticity diagram, a luminance reference map, an adjusted luminance reference map, a back depth map, a screen depth map, a left-eye image, and a right-eye image according to an embodiment of the invention. Schematic diagram.
圖3為依據本發明一實施例的立體影像產生方法的流程圖。 FIG. 3 is a flowchart of a method for generating a stereo image according to an embodiment of the invention.
S310、S320、S330、S340、S350、S360‧‧‧步驟 S310, S320, S330, S340, S350, S360‧‧ steps
Claims (12)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW100104576A TWI472218B (en) | 2011-02-11 | 2011-02-11 | Device and method for generating stereoscopic image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW100104576A TWI472218B (en) | 2011-02-11 | 2011-02-11 | Device and method for generating stereoscopic image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201234832A TW201234832A (en) | 2012-08-16 |
| TWI472218B true TWI472218B (en) | 2015-02-01 |
Family
ID=47070193
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW100104576A TWI472218B (en) | 2011-02-11 | 2011-02-11 | Device and method for generating stereoscopic image |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI472218B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200614825A (en) * | 2004-10-22 | 2006-05-01 | Mediatek Inc | Methods and systems for color image processing |
| TW200816800A (en) * | 2006-10-03 | 2008-04-01 | Univ Nat Taiwan | Single lens auto focus system for stereo image generation and method thereof |
| TW200931947A (en) * | 2008-01-14 | 2009-07-16 | Wintek Corp | Image processing apparatus and image processing method |
| US20100080448A1 (en) * | 2007-04-03 | 2010-04-01 | Wa James Tam | Method and graphical user interface for modifying depth maps |
| TW201029443A (en) * | 2008-11-04 | 2010-08-01 | Koninkl Philips Electronics Nv | Method and device for generating a depth map |
-
2011
- 2011-02-11 TW TW100104576A patent/TWI472218B/en not_active IP Right Cessation
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200614825A (en) * | 2004-10-22 | 2006-05-01 | Mediatek Inc | Methods and systems for color image processing |
| TW200816800A (en) * | 2006-10-03 | 2008-04-01 | Univ Nat Taiwan | Single lens auto focus system for stereo image generation and method thereof |
| US20100080448A1 (en) * | 2007-04-03 | 2010-04-01 | Wa James Tam | Method and graphical user interface for modifying depth maps |
| TW200931947A (en) * | 2008-01-14 | 2009-07-16 | Wintek Corp | Image processing apparatus and image processing method |
| TW201029443A (en) * | 2008-11-04 | 2010-08-01 | Koninkl Philips Electronics Nv | Method and device for generating a depth map |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201234832A (en) | 2012-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105814875B (en) | Selecting camera pairs for stereo imaging | |
| US8711204B2 (en) | Stereoscopic editing for video production, post-production and display adaptation | |
| TWI531212B (en) | System and method of rendering stereoscopic images | |
| US9338426B2 (en) | Three-dimensional image processing apparatus, three-dimensional imaging apparatus, and three-dimensional image processing method | |
| US11017587B2 (en) | Image generation method and image generation device | |
| US20120093394A1 (en) | Method for combining dual-lens images into mono-lens image | |
| JP5755571B2 (en) | Virtual viewpoint image generation device, virtual viewpoint image generation method, control program, recording medium, and stereoscopic display device | |
| JP6585938B2 (en) | Stereoscopic image depth conversion apparatus and program thereof | |
| US20140198104A1 (en) | Stereoscopic image generating method, stereoscopic image generating device, and display device having same | |
| TWI589150B (en) | Three-dimensional auto-focusing method and the system thereof | |
| KR20180000696A (en) | A method and apparatus for creating a pair of stereoscopic images using least one lightfield camera | |
| TW201801528A (en) | Stereo image generating method and electronic apparatus utilizing the method | |
| JP2015087851A (en) | Image processor and image processing program | |
| TWI478100B (en) | Method of image depth estimation and apparatus thereof | |
| JP5464129B2 (en) | Image processing apparatus and parallax information generating apparatus | |
| WO2020231484A3 (en) | Detection and ranging based on a single monoscopic frame | |
| TWI504936B (en) | Image processing device | |
| TWI472218B (en) | Device and method for generating stereoscopic image | |
| CN102075780B (en) | Stereoscopic image generating device and method | |
| CN108900825A (en) | A kind of conversion method of 2D image to 3D rendering | |
| TWI541761B (en) | Image processing method and electronic device thereof | |
| JP2014003486A (en) | Image processing device, image capturing device, image display device, image processing method, and program | |
| JP5924833B2 (en) | Image processing apparatus, image processing method, image processing program, and imaging apparatus | |
| Chappuis et al. | Subjective evaluation of an active crosstalk reduction system for mobile autostereoscopic displays | |
| TW201033936A (en) | Method of synthesizing stereoscopic video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |