CN117640913A - Multi-view 3D display device - Google Patents
Multi-view 3D display device Download PDFInfo
- Publication number
- CN117640913A CN117640913A CN202211324867.3A CN202211324867A CN117640913A CN 117640913 A CN117640913 A CN 117640913A CN 202211324867 A CN202211324867 A CN 202211324867A CN 117640913 A CN117640913 A CN 117640913A
- Authority
- CN
- China
- Prior art keywords
- image
- view
- frame
- display device
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003491 array Methods 0.000 claims abstract description 6
- 230000000007 visual effect Effects 0.000 claims abstract description 3
- 238000004364 calculation method Methods 0.000 claims description 12
- 238000000605 extraction Methods 0.000 claims description 7
- 230000004927 fusion Effects 0.000 claims description 5
- 230000000694 effects Effects 0.000 claims description 4
- 238000002674 endoscopic surgery Methods 0.000 claims description 4
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 239000000284 extract Substances 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 4
- 230000004888 barrier function Effects 0.000 description 2
- 238000000034 method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Landscapes
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
A multi-view 3D display device, comprising: the image input unit is used for receiving single image media stream data according to the control of the selection signal; the image operation module is used for processing the single-image media stream data to generate one frame of 3D image data, and configuring multiple frames of output image data corresponding to multiple preset visual angles in a memory, wherein at least one frame of the multiple frames of output image data is the frame of 3D image data; and a 3D display having a plurality of pixel arrays corresponding to the plurality of preset viewing angles, for displaying a plurality of viewing angle defining pictures according to the multi-frame output image data. In addition, the multi-view 3D display device may also detect a viewing angle of a viewer through the binocular tracking module, so as to provide the viewer with a 3D image displayed according to the frame 3D image data.
Description
Technical Field
The present invention relates to a display device, and more particularly, to a multi-view 3D display device.
Background
In endoscopic surgery, exploration activities or rescue tasks, it is often necessary to take 2D images of the inside of a person or in a cave or in a building of a couch by means of a miniature camera, and then display the 2D images on a screen.
However, in these application scenes, since the 2D image cannot present the depth of field, the 2D image sometimes cannot clearly display the situation of the scene.
Accordingly, there is an urgent need in the art for a novel multi-view 3D display device.
Disclosure of Invention
The invention aims to disclose a multi-view 3D display device which can generate 3D images according to single image media stream data.
Another object of the present invention is to disclose a multi-view 3D display device, which can provide a plurality of preset views according to a 3D display, and can prepare a corresponding 2D image or 3D image for each preset view.
Still another object of the present invention is to disclose a multi-view 3D display device, which can detect a view angle of a viewer through a binocular tracking module to automatically provide a 3D image for the viewer at the view angle.
To achieve the foregoing object, the present invention provides a multi-view 3D display device, comprising:
the image input unit is used for receiving single image media stream data according to the control of the selection signal;
the image operation module is coupled with the image input unit to receive the single image media stream data and is used for executing image operation, and the image operation comprises: periodically extracting a frame of 2D image data from the single image media stream data according to the control of the selection signal; performing a first depth of field calculation on the frame 2D image data according to the control of the selection signal to generate a frame of first depth of field data; performing a first image fusion operation on the frame 2D image data and the frame first depth data according to the control of the selection signal to generate a frame 3D image data; and configuring multi-frame output image data corresponding to a plurality of preset visual angles in a memory, wherein at least one frame of the frame output image data is the frame 3D image data; and
the multi-view 3D display is coupled with the image operation module and provided with a plurality of pixel arrays corresponding to the preset view angles, and the pixel arrays are used for outputting image data according to the frames to display a plurality of view angle limiting pictures corresponding to the preset view angles.
In an embodiment, the image operation module has an image extraction unit and a first depth of field calculation unit, wherein the image extraction unit is used for periodically extracting the frame 2D image data from the single image media stream data; and the first depth of field calculation unit is used for executing the first depth of field calculation.
In an embodiment, the first depth of view calculation unit includes a first type neural network module.
In an embodiment, the image computing module further has an image generating unit to perform the first image fusion operation.
In an embodiment, the image operation module further has a multi-view image data configuration unit for configuring multi-frame output image data corresponding to the plurality of preset views in the memory.
In an embodiment, the multi-view 3D display is a lenticular 3D display or a parallax barrier 3D display.
In an embodiment, the multi-view 3D display device further has a binocular tracking module for detecting a viewer view angle, and the image operation module maps the plurality of preset views according to the viewer view angle to find an index view angle, and loads the frame 3D image data into a storage area of the output image data corresponding to the index view angle in the memory.
In one embodiment, the view-defining pictures are 3D images.
In one embodiment, the view defining pictures comprise at least one 2D image.
In one embodiment, the view defining pictures comprise at least one scalable 3D image.
In one embodiment, the view defining pictures comprise at least one scalable 2D image.
In a possible embodiment, the application scenario of the multi-view 3D display device may be an endoscopic surgery, an exploration activity or a rescue task.
For a further understanding of the structure, features, and objects of the invention, reference should be made to the drawings and to the detailed description of preferred embodiments.
Drawings
FIG. 1 schematically illustrates a block diagram of one embodiment of a multi-view 3D display device of the present invention;
fig. 2 schematically illustrates a block diagram of an embodiment of an image operation module of the multi-view 3D display device of fig. 1.
Detailed Description
Referring to fig. 1, a block diagram of an embodiment of a multi-view 3D display device of the present invention is schematically shown.
As shown in fig. 1, a multi-view 3D display device 100 has an image input unit 110, an image operation module 120, a multi-view 3D display 130, and a binocular tracking module 140.
The image input unit 110 is configured to receive a single image media stream data D1 according to the control of the selection signal SEL.
The image computing module 120 is coupled to the image input unit 110 for receiving an input data D IN The input data D IN The single image media stream data D1 may be used to perform an image operation. Referring to fig. 2, a block diagram of an embodiment of the image computing module 120 is shown. As shown in fig. 2, the image computing module 120 has an image extracting unit 121, a control unit 122, a memory 123, a first depth calculating unit 124, an image generating unit 126, a multi-view image data configuring unit 127 and an output unit 128.
The image extraction unit 121 is used for inputting the data D IN An image extraction operation is performed to periodically extract the frame 2D image data from the single image media stream data D1.
The control unit 122 is configured to perform the image operation according to the output data of the image extraction unit 121, and includes: from the single image medium according to the control of the selection signal SELThe body stream data D1 periodically extracts a frame of 2D image data and stores the frame of 2D image data in the memory 123; driving the first depth-of-field calculation unit 124 to perform a first depth-of-field calculation on the frame 2D image data to generate a frame of first depth-of-field data; the image generation unit 126 is driven to perform a first image fusion operation on the frame 2D image data and the frame first depth data to generate a frame 3D image data D 3D The method comprises the steps of carrying out a first treatment on the surface of the The multi-view image data configuration unit 127 is driven to configure multi-frame output image data D corresponding to a plurality of preset views in the memory 123 OUT Wherein the frames output image data D OUT At least one frame is the 3D image data D of the frame 3D The method comprises the steps of carrying out a first treatment on the surface of the Driving the output unit 128 to output the frame output image data D OUT 。
The multi-view 3D display 130 is coupled to the image computing module 120 and has a plurality of pixel arrays corresponding to the predetermined views, and the pixel arrays output image data D according to the frames OUT And displaying a plurality of view limiting pictures corresponding to the plurality of preset views.
In addition, the binocular tracking module 140 is used for detecting a viewer's viewing angle and corresponding a viewer's viewing angle data D A Is transmitted to the image computing module 120, and the image computing module 120 is based on the observer view angle data D A Mapping the plurality of preset views to find an index view, and loading the frame of 3D image data into a storage area of the output image data corresponding to the index view in the memory 123.
In addition, the first depth of view calculating unit 124 may include a first type of neural network module.
In addition, the multi-view 3D display 130 may be a lenticular 3D display or a parallax barrier 3D display.
In addition, the view defining pictures can be 3D images, or include at least one 2D image, or include at least one scalable 3D image, or include at least one scalable 2D image.
In addition, the application scenario of the multi-view 3D display device 100 of the present invention may be an endoscopic surgery, an exploration activity or a rescue task.
Through the scheme disclosed by the invention, the following beneficial effects can be provided:
the multi-view 3D display device of the present invention can generate a 3D image according to single image media stream data.
The multi-view 3D display device of the present invention can provide a plurality of preset views according to the 3D display, and can prepare a corresponding 2D image or 3D image for each preset view.
The multi-view 3D display device of the present invention can automatically provide a 3D image to a viewer at a viewing angle by detecting the viewing angle of the viewer through a binocular tracking module. In contrast, when using the conventional multi-view display, a viewer must stand at a specific angle to correctly see the 3D image, i.e., the viewer must adjust the position and angle to see the 3D image.
The foregoing description of the embodiments has been provided for the purpose of illustrating the general principles of the invention, and is not meant to limit the invention thereto, but to limit the invention thereto, and any modifications, equivalents, improvements and equivalents thereof may be made without departing from the spirit and principles of the invention.
Claims (11)
1. A multi-view 3D display device, comprising:
the image input unit is used for receiving single image media stream data according to the control of the selection signal;
the image operation module is coupled with the image input unit to receive the single image media stream data and is used for executing image operation, and the image operation comprises: periodically extracting a frame of 2D image data from the single image media stream data according to the control of the selection signal; performing first depth-of-field calculation on the frame 2D image data to generate a frame of first depth-of-field data; performing a first image fusion operation on the frame 2D image data and the frame first depth data to generate a frame 3D image data; and configuring multi-frame output image data corresponding to a plurality of preset visual angles in a memory, wherein at least one frame in the multi-frame output image data is the frame 3D image data; and
the multi-view 3D display is coupled with the image operation module, is provided with a plurality of pixel arrays corresponding to the plurality of preset view angles, and displays a plurality of view angle limiting pictures corresponding to the plurality of preset view angles according to the multi-frame output image data, wherein the multi-view 3D display is a cylindrical lens type 3D display or a parallax grating type 3D display.
2. The multi-view 3D display device of claim 1, wherein the image operation module has an image extraction unit and a first depth of field calculation unit, wherein the image extraction unit is configured to periodically extract the frame 2D image data from the single image media stream data; the first depth of field calculation unit is configured to perform the first depth of field calculation.
3. The multi-view 3D display device of claim 2, wherein the first depth of view calculation unit comprises a first type of neural network module.
4. The multi-view 3D display device of claim 2, wherein the image computation module further has an image generation unit to perform the first image fusion operation.
5. The multi-view 3D display device of claim 4, wherein the image operation module further has a multi-view image data configuration unit to configure multi-frame output image data corresponding to the plurality of preset views in the memory.
6. The multi-view 3D display device of claim 1, further comprising a binocular tracking module for detecting a viewer's view angle, wherein the image operation module maps the plurality of preset views according to the viewer's view angle to find an index view angle, and loads the frame 3D image data into a storage area of the memory corresponding to the index view angle for one frame of the output image data.
7. The multi-view 3D display device of claim 1, wherein the plurality of view-defining pictures are all 3D images.
8. The multi-view 3D display device of claim 1, wherein the plurality of view defining pictures comprise at least one 2D image.
9. The multi-view 3D display device of claim 1, wherein the plurality of view defining pictures comprise at least one scalable 3D image.
10. The multi-view 3D display device of claim 1, wherein the plurality of view defining pictures comprise at least one scalable 2D image.
11. The multi-view 3D display device of claim 1, wherein the application scene of the multi-view 3D display device comprises any one of an endoscopic surgery, an exploration activity, and a rescue mission.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW111208718U TWM636416U (en) | 2022-08-11 | 2022-08-11 | Multi-viewpoint 3D display device |
| TW111208718 | 2022-08-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117640913A true CN117640913A (en) | 2024-03-01 |
Family
ID=86658955
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211324867.3A Pending CN117640913A (en) | 2022-08-11 | 2022-10-27 | Multi-view 3D display device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117640913A (en) |
| TW (1) | TWM636416U (en) |
-
2022
- 2022-08-11 TW TW111208718U patent/TWM636416U/en unknown
- 2022-10-27 CN CN202211324867.3A patent/CN117640913A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| TWM636416U (en) | 2023-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6556236B1 (en) | Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments | |
| US6011581A (en) | Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments | |
| US6985168B2 (en) | Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments | |
| US8633967B2 (en) | Method and device for the creation of pseudo-holographic images | |
| JP4740135B2 (en) | System and method for drawing 3D image on screen of 3D image display | |
| CN101783967B (en) | Signal processing device, image display device, signal processing method, and computer program | |
| WO2012153447A1 (en) | Image processing device, image processing method, program, and integrated circuit | |
| US8279221B2 (en) | 3D graphics processor and autostereoscopic display device using the same | |
| CN102100075A (en) | Stereoscopic image generating chip for mobile device and stereoscopic image display method using the same | |
| WO2016045425A1 (en) | Two-viewpoint stereoscopic image synthesizing method and system | |
| JP4928476B2 (en) | Stereoscopic image generating apparatus, method thereof and program thereof | |
| WO2011099896A1 (en) | Method for representing an initial three-dimensional scene on the basis of results of an image recording in a two-dimensional projection (variants) | |
| CN108076208B (en) | Display processing method and device and terminal | |
| EP2787735A1 (en) | Image processing device, image processing method and program | |
| JP3032414B2 (en) | Image processing method and image processing apparatus | |
| KR20150091064A (en) | Method and system for capturing a 3d image using single camera | |
| US10939092B2 (en) | Multiview image display apparatus and multiview image display method thereof | |
| CN107948631A (en) | It is a kind of based on cluster and the bore hole 3D systems that render | |
| CN112929636A (en) | 3D display device and 3D image display method | |
| KR101212223B1 (en) | Device taking a picture and method to generating the image with depth information | |
| WO2016179694A1 (en) | Spherical omnipolar imaging | |
| US8400493B2 (en) | Virtual stereoscopic camera | |
| KR101228916B1 (en) | Apparatus and method for displaying stereoscopic 3 dimensional image in multi vision | |
| CN103155576A (en) | Three-dimensional image display device, and three-dimensional image display method | |
| EP2822279B1 (en) | Autostereo tapestry representation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |