TWM636416U - Multi-viewpoint 3D display device - Google Patents
Multi-viewpoint 3D display device Download PDFInfo
- Publication number
- TWM636416U TWM636416U TW111208718U TW111208718U TWM636416U TW M636416 U TWM636416 U TW M636416U TW 111208718 U TW111208718 U TW 111208718U TW 111208718 U TW111208718 U TW 111208718U TW M636416 U TWM636416 U TW M636416U
- Authority
- TW
- Taiwan
- Prior art keywords
- image
- view
- frame
- display device
- image data
- Prior art date
Links
- 238000003491 array Methods 0.000 claims abstract description 7
- 238000004364 calculation method Methods 0.000 claims description 18
- 230000000694 effects Effects 0.000 claims description 5
- 230000004927 fusion Effects 0.000 claims description 5
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 4
- 230000004888 barrier function Effects 0.000 description 2
- 235000019994 cava Nutrition 0.000 description 1
- 238000002674 endoscopic surgery Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Controls And Circuits For Display Device (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
Abstract
一種多視角3D顯示裝置,具有:一影像輸入單元,用以依一選擇信號之控制接收一單影像串流資料;一影像運算模組,用以處理該單影像串流資料以產生一幀3D影像資料,及在一記憶體中配置與多個預設視角對應之多幀輸出影像資料,其中,該些幀輸出影像資料中至少有一幀係該幀3D影像資料;以及一3D顯示器,具有與所述多個預設視角對應之多個像素陣列以依該些幀輸出影像資料顯示多個視角限定畫面。另外,該多視角3D顯示裝置亦可藉由一雙眼追跡模組偵測一觀者視角以為該觀者提供依該幀3D影像資料所顯示之一3D影像。A multi-view 3D display device, comprising: an image input unit for receiving a single image stream data controlled by a selection signal; an image computing module for processing the single image stream data to generate a frame of 3D image data, and disposing in a memory a multi-frame output image data corresponding to a plurality of preset viewing angles, wherein at least one of the frames of output image data is the frame of 3D image data; and a 3D display having the same A plurality of pixel arrays corresponding to the plurality of preset viewing angles are used to output image data according to the frames to display multiple viewing angle limited frames. In addition, the multi-view 3D display device can also detect a viewer's view angle through a binocular tracking module to provide the viewer with a 3D image displayed according to the frame of 3D image data.
Description
本創作係有關於顯示裝置,特別是關於一種多視角3D顯示裝置。 This creation is related to a display device, in particular to a multi-view 3D display device.
在內視鏡手術、探勘活動或救難任務中,常需要借助於一微型攝像頭拍攝人體內或洞穴中或倒榻的建築物中之2D影像,然後再將該2D影像顯示在一螢幕上。 In endoscopic surgery, exploration activities or rescue missions, it is often necessary to take 2D images of the human body, caves, or collapsed buildings with the help of a micro-camera, and then display the 2D images on a screen.
然而,在該些應用場域中,由於2D影像並無法把景深呈現出來,故2D影像有時並無法清楚地顯示現場的狀況。 However, in these application fields, since the 2D images cannot present the depth of field, the 2D images sometimes cannot clearly display the scene conditions.
因此,本領域亟需一種新穎的多視角3D顯示裝置。 Therefore, there is an urgent need in the art for a novel multi-view 3D display device.
本創作之一目的在於揭露一種多視角3D顯示裝置,其可依單影像串流資料產生一3D影像。 One purpose of this invention is to disclose a multi-view 3D display device, which can generate a 3D image according to a single image stream data.
本創作之另一目的在於揭露一種多視角3D顯示裝置,其可依一3D顯示器提供多個預設視角,且可為各該預設視角預備一對應的2D影像或3D影像。 Another purpose of the present invention is to disclose a multi-view 3D display device, which can provide multiple preset viewing angles according to a 3D display, and can prepare a corresponding 2D image or 3D image for each of the preset viewing angles.
本創作之又一目的在於揭露一種多視角3D顯示裝置,其可藉由一雙眼追跡模組偵測一觀者之視角以自動為該觀者在該視角提供一3D影像。 Another purpose of the present invention is to disclose a multi-view 3D display device, which can detect a viewer's view angle through a binocular tracking module to automatically provide the viewer with a 3D image at the view angle.
為達前述目的,一種多視角3D顯示裝置乃被提出,其具有:一影像輸入單元,用以依一選擇信號之控制接收一單影像串流資料資料;一影像運算模組,與該影像輸入單元耦接以接收該單影像串流資料,係用以執行一影像運算,該影像運算包括:依該選擇信號之控制自該單影像串流資料周期性地擷取一幀2D影像資料;依該選擇信號之控制對該幀2D影像資料進行一第一景深計算以產生一幀第一景深資料;依該選擇信號之控制對該幀2D影像資料與該幀第一景深資料進行一第一影像融合運算以產生一幀3D影像資料;及在一記憶體中配置與多個預設視角對應之多幀輸出影像資料,其中,該些幀輸出影像資料中至少有一幀係該幀3D影像資料;以及一多視角3D顯示器,與該影像運算模組耦接,具有與所述多個預設視角對應之多個像素陣列,且該些像素陣列係依該些幀輸出影像資料顯示與所述多個預設視角對應之多個視角限定畫面。 In order to achieve the aforementioned purpose, a multi-view 3D display device is proposed, which has: an image input unit, used to receive a single image stream data according to the control of a selection signal; an image computing module, connected with the image input The unit is coupled to receive the single image stream data, and is used to perform an image operation, and the image operation includes: periodically extracting a frame of 2D image data from the single image stream data according to the control of the selection signal; According to the control of the selection signal, a first depth of field calculation is performed on the frame of 2D image data to generate a frame of first depth of field data; according to the control of the selection signal, a first image is performed on the frame of 2D image data and the frame of the first depth of field data Fusion calculation to generate a frame of 3D image data; and disposing multiple frames of output image data corresponding to multiple preset viewing angles in a memory, wherein at least one frame of the output image data is the frame of 3D image data; And a multi-view 3D display, coupled with the image computing module, has a plurality of pixel arrays corresponding to the plurality of preset viewing angles, and the pixel arrays output image data according to the frames to display and display the multi-view A plurality of viewing angle limited frames corresponding to a preset viewing angle.
在一實施例中,該影像運算模組具有一影像擷取單元、一第一景深計算單元,其中,該影像擷取單元係用以自該單影像串流資料周期性地擷取該幀2D影像資料;及該第一景深計算單元係用以執行該第一景深計算。 In one embodiment, the image computing module has an image capture unit and a first depth of field calculation unit, wherein the image capture unit is used to periodically capture the frame 2D from the single video stream data image data; and the first depth-of-field calculation unit is used for performing the first depth-of-field calculation.
在一實施例中,該第一景深計算單元包含一第一類神經網路模組。 In one embodiment, the first depth calculation unit includes a first-type neural network module.
在一實施例中,該影像運算模組進一步具有一影像生成單元以執行該第一影像融合運算。 In one embodiment, the image computing module further has an image generating unit for performing the first image fusion operation.
在一實施例中,該影像運算模組進一步具有一多視角影像資料配置單元以在該記憶體中配置與所述多個預設視角對應之多幀輸出影像資料。 In one embodiment, the image computing module further has a multi-view image data configuration unit for configuring multiple frames of output image data corresponding to the plurality of preset viewing angles in the memory.
在一實施例中,該多視角3D顯示器係一柱狀透鏡式3D顯示器或一視差光柵式3D顯示器。 In one embodiment, the multi-view 3D display is a lenticular 3D display or a parallax barrier 3D display.
在一實施例中,所述之多視角3D顯示裝置進一步具有一雙眼追跡模組以偵測一觀者視角,且該影像運算模組係依該觀者視角映射所述多個預設視角以找出一索引視角,及將該幀3D影像資料載入該記憶體中之與該索引視角相對應之一幀所述輸出影像資料之儲存區中。 In one embodiment, the multi-view 3D display device further has a binocular tracking module to detect a viewer's viewing angle, and the image computing module maps the plurality of preset viewing angles according to the viewer's viewing angle to find an index viewing angle, and load the frame of 3D image data into the storage area of a frame of output image data corresponding to the index viewing angle in the memory.
在一實施例中,該些視角限定畫面皆係3D影像。 In one embodiment, the viewing angle limiting frames are all 3D images.
在一實施例中,該些視角限定畫面包含至少一2D影像。 In one embodiment, the viewing angle limiting frames include at least one 2D image.
在一實施例中,該些視角限定畫面包含至少一可縮放之3D影像。 In one embodiment, the viewing angle limiting frames include at least one zoomable 3D image.
在一實施例中,該些視角限定畫面包含至少一可縮放之2D影像。 In one embodiment, the viewing angle limiting frames include at least one scalable 2D image.
在可能的實施例中,所述之多視角3D顯示裝置之應用場域可為一內視鏡手術、一探勘活動或一救難任務。 In a possible embodiment, the application field of the multi-view 3D display device may be an endoscopic operation, an exploration activity or a rescue mission.
為使 貴審查委員能進一步瞭解本新型之結構、特徵及其目的,茲附以圖式及較佳具體實施例之詳細說明如後。 In order to enable your review committee to further understand the structure, characteristics and purpose of the present invention, the drawings and detailed descriptions of preferred embodiments are hereby attached.
100:多視角3D顯示裝置 100: Multi-view 3D display device
110:影像輸入單元 110: Image input unit
120:影像運算模組 120: Image computing module
130:多視角3D顯示器 130: Multi-view 3D display
140:雙眼追跡模組 140:Binocular tracking module
121:影像擷取單元 121: image capture unit
122:控制單元 122: Control unit
123:記憶體 123: memory
124:第一景深計算單元 124: The first depth of field calculation unit
126:影像生成單元 126: Image generation unit
127:多視角影像資料配置單元 127: Multi-view image data configuration unit
128:輸出單元 128: output unit
圖1繪示本創作之多視角3D顯示裝置之一實施例之方塊圖。 FIG. 1 shows a block diagram of an embodiment of a multi-view 3D display device of the present invention.
圖2繪示圖1之多視角3D顯示裝置之影像運算模組之一實施例之方塊圖。 FIG. 2 is a block diagram of an embodiment of an image computing module of the multi-view 3D display device in FIG. 1 .
請參照圖1,其繪示本創作之多視角3D顯示裝置之一實施例之方塊圖。 Please refer to FIG. 1 , which shows a block diagram of an embodiment of the multi-view 3D display device of the present invention.
如圖1所示,一多視角3D顯示裝置100具有一影像輸入單元110、一影像運算模組120、一多視角3D顯示器130及一雙眼追跡模組140。
As shown in FIG. 1 , a multi-view
影像輸入單元110係用以依一選擇信號SEL之控制接收一單影像串流資料D1。
The
影像運算模組120係與影像輸入單元110耦接以接收一輸入資料DIN,該輸入資料DIN可為該單影像串流資料D1,以據以執行一影像運算。請參照圖2,其繪示影像運算模組120之一實施例之方塊圖。如圖2所示,影像運算模組120具有一影像擷取單元121、一控制單元122、一記憶體123、一第一景深計算單元124、一影像生成單元126、一多視角影像資料配置單元127及一輸出單元128。
The image operation module 120 is coupled to the
影像擷取單元121係用以對該輸入資料DIN進行一影像擷取操作,以自該單影像串流資料D1周期性地擷取該幀2D影像資料。
The
控制單元122係用以依影像擷取單元121的輸出資料執行該影像運算,其包括:依該選擇信號SEL之控制自該單影像串流資料D1周期性地擷取一幀2D影像資料並將該幀2D影像資料存入記憶體123中;驅使第一景深計算單元124對該幀2D影像資料進行一第一景深計算以產生一幀第一景深資料;驅使影像生成單元126對該幀2D影像資料與該幀第一景深資料進行一第一影像融合運算以產生一幀3D影像資料D3D;驅使多視角影像資料配置單元127在記憶體123中配置與多個預設視角對應之多幀輸出影像資料DOUT,其中,該些幀輸出
影像資料DOUT中至少有一幀係該幀3D影像資料D3D;以及驅使輸出單元128輸出該些幀輸出影像資料DOUT。
The
多視角3D顯示器130係與影像運算模組120耦接,且其具有與所述多個預設視角對應之多個像素陣列,且該些像素陣列係依該些幀輸出影像資料DOUT顯示與所述多個預設視角對應之多個視角限定畫面。
The
另外,雙眼追跡模組140係用以偵測一觀者視角並將與該觀者視角對應一觀者視角資料DA傳送給影像運算模組120,且影像運算模組120係依該觀者視角資料DA映射所述多個預設視角以找出一索引視角,及將該幀3D影像資料載入記憶體123中之與該索引視角相對應之一幀所述輸出影像資料之儲存區中。
In addition, the
另外,第一景深計算單元124可包含一第一類神經網路模組。
In addition, the first
另外,多視角3D顯示器130可為一柱狀透鏡式3D顯示器或一視差光柵式3D顯示器。
In addition, the
另外,該些視角限定畫面可皆為3D影像,或包含至少一2D影像,或包含至少一可縮放之3D影像,或包含至少一可縮放之2D影像。 In addition, the viewing angle limiting frames may all be 3D images, or include at least one 2D image, or include at least one scalable 3D image, or include at least one scalable 2D image.
另外,本創作之多視角3D顯示裝置100之應用場域可為一內視鏡手術、一探勘活動或一救難任務。
In addition, the application field of the multi-view
藉由前述所揭露的設計,本創作可提供以下功效: With the design disclosed above, this creation can provide the following effects:
(一)本創作的多視角3D顯示裝置可依單影像串流資料產生一3D影像。 (1) The multi-view 3D display device of the present invention can generate a 3D image according to a single video streaming data.
(二)本創作的多視角3D顯示裝置可依一3D顯示器提供多個預設視角,且可為各該預設視角預備一對應的2D影像或3D影像。 (2) The multi-view 3D display device of the present invention can provide multiple preset viewing angles according to a 3D display, and can prepare a corresponding 2D image or 3D image for each preset viewing angle.
(三)本創作的多視角3D顯示裝置可藉由一雙眼追跡模組偵測一觀者之視角以自動為該觀者在該視角提供一3D影像。相對地,在使用傳統的多視角顯示器時,觀看者須站在特定角度才能正確看到3D的影像,亦即,觀看者要自已調整位置、角度才能看得到3D影像。 (3) The multi-view 3D display device of the invention can detect the view angle of a viewer through a binocular tracking module to automatically provide a 3D image for the viewer at the view angle. In contrast, when using a traditional multi-view display, the viewer must stand at a specific angle to see the 3D image correctly, that is, the viewer has to adjust the position and angle to see the 3D image.
本案所揭示者,乃較佳實施例,舉凡局部之變更或修飾而源於本案之技術思想而為熟習該項技藝之人所易於推知者,俱不脫本案之專利權範疇。 What is disclosed in this case is a preferred embodiment. For example, any partial changes or modifications derived from the technical ideas of this case and easily deduced by those who are familiar with the technology are within the scope of the patent right of this case.
綜上所陳,本案無論目的、手段或功效,皆顯示其迥異於習知技術,且其首先創作合於實用,確實符合新型之專利要件,懇請 貴審查委員明察並早日賜予專利俾嘉惠社會,是為至禱。 To sum up, this case, no matter the purpose, means or efficacy, shows that it is very different from the conventional technology, and its first creation is practical, and it does meet the requirements of a new patent. I urge your review committee to clearly understand and grant a patent as soon as possible to benefit the society. , is for the Most Prayer.
100:多視角3D顯示裝置 100: Multi-view 3D display device
110:影像輸入單元 110: Image input unit
120:影像運算模組 120: Image computing module
130:多視角3D顯示器 130: Multi-view 3D display
140:雙眼追跡模組 140:Binocular tracking module
Claims (11)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW111208718U TWM636416U (en) | 2022-08-11 | 2022-08-11 | Multi-viewpoint 3D display device |
CN202211324867.3A CN117640913A (en) | 2022-08-11 | 2022-10-27 | Multi-view 3D display device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW111208718U TWM636416U (en) | 2022-08-11 | 2022-08-11 | Multi-viewpoint 3D display device |
Publications (1)
Publication Number | Publication Date |
---|---|
TWM636416U true TWM636416U (en) | 2023-01-11 |
Family
ID=86658955
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW111208718U TWM636416U (en) | 2022-08-11 | 2022-08-11 | Multi-viewpoint 3D display device |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN117640913A (en) |
TW (1) | TWM636416U (en) |
-
2022
- 2022-08-11 TW TW111208718U patent/TWM636416U/en unknown
- 2022-10-27 CN CN202211324867.3A patent/CN117640913A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
CN117640913A (en) | 2024-03-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9341935B2 (en) | Image capturing device | |
CN104038690B (en) | Image processing apparatus, image capturing device and image processing method | |
JP4616559B2 (en) | Display device and display system | |
JP2017505565A (en) | Multi-plane video generation method and system | |
WO2012153447A1 (en) | Image processing device, image processing method, program, and integrated circuit | |
CN101636747A (en) | Two dimensional/three dimensional digital information obtains and display device | |
US20130286170A1 (en) | Method and apparatus for providing mono-vision in multi-view system | |
CN102428707A (en) | Stereovision-Image Position Matching Apparatus, Stereovision-Image Position Matching Method, And Program Therefor | |
TW201201569A (en) | Display device | |
US11032531B2 (en) | Mobile device having a 3D display with selectable magnification | |
CN116325771A (en) | Multi-sensor camera systems, devices, and methods for providing image pan, tilt, and zoom functionality | |
Afshari et al. | A spherical multi-camera system with real-time omnidirectional video acquisition capability | |
Hahne et al. | Baseline of virtual cameras acquired by a standard plenoptic camera setup | |
CN104104939A (en) | Wide viewing angle integrated imaging three-dimensional display system | |
US10306208B2 (en) | Device for creating and enhancing three-dimensional image effects | |
JP2002232913A (en) | Double eye camera and stereoscopic vision image viewing system | |
CN103716560A (en) | TV apparatus | |
JP2011141381A (en) | Stereoscopic image display device and stereoscopic image display method | |
TWM636416U (en) | Multi-viewpoint 3D display device | |
JP5347987B2 (en) | Video processing device | |
US8917316B2 (en) | Photographing equipment | |
TWI540880B (en) | Method for displaying stereoscopic image and stereoscopic image device | |
KR101222101B1 (en) | Apparatus for generating stereoscopic images | |
US9964772B2 (en) | Three-dimensional image display apparatus, methods and systems | |
Hill | Scalable multi-view stereo camera array for real world real-time image capture and three-dimensional displays |