CN106507097B - Bore hole stereoscopic display live broadcast system and method based on directing backlight - Google Patents
Bore hole stereoscopic display live broadcast system and method based on directing backlight Download PDFInfo
- Publication number
- CN106507097B CN106507097B CN201611073557.3A CN201611073557A CN106507097B CN 106507097 B CN106507097 B CN 106507097B CN 201611073557 A CN201611073557 A CN 201611073557A CN 106507097 B CN106507097 B CN 106507097B
- Authority
- CN
- China
- Prior art keywords
- video stream
- eye
- image
- eye video
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/31—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers
- H04N13/315—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using parallax barriers the parallax barriers being time-variant
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses a kind of bore hole stereoscopic display live broadcast systems and method based on directing backlight, the system includes multiple camera modules, multi-channel video stream processing unit, image refreshing control module and image-display units, the multi-channel video stream processing unit obtains the multi-path video stream that multiple camera modules synchronize production, it selects two-path video stream as left-eye video stream and right-eye video stream from the multi-path video stream, the left-eye video stream and right-eye video stream is alternately input to described image refreshing control module；When the corresponding light-emitting zone of right eye shines, described image display module shows the right-eye video stream, and when left eye light-emitting zone shines, described image display module shows the left-eye video stream.The left-eye video stream produced in multiple camera modules and right-eye video stream real-time Transmission to image-display units, are improved the problem of conventional stereo image live streaming resolution of display system reduces by bore hole stereoscopic display of embodiment of the present invention live broadcast system and method.
Description
Technical field
The present invention relates to one kind, the invention belongs to bore hole three-dimensional video-frequencies, and field is broadcast live, and specifically disclose a kind of based on directing
Backlight, full HD or ultra high-definition bore hole stereoscopic display live broadcast system and method.
Background technology
Bore hole stereoscopic display net cast is the combination of bore hole 3D display technology and live streaming.Live streaming with existing prevalence is flat
Platform, stereoscopic display net cast are capable of providing depth information, form stereoscopic vision.Compared with scheme is broadcast live in current VR, bore hole is vertical
Body shows net cast without the assist types equipment such as helmet.Display equipment and image capture device are wanted in bore hole 3D live streamings
Ask relatively high.The bore hole stereoscopic display technology of mainstream is mainly based upon cylindrical lens or the bore hole stereoscopic display of visually impaired grating is set
It is standby.It is more than the resolution ratio meeting drop by half of these technical solutions.Under normal circumstances, viewpoint is more, and resolution ratio declines.Bore hole is three-dimensional
Show net cast to video capture device require it is also relatively high, common camera cannot be satisfied requirements, with capture it is super it is clear,
The picture of multi-angle.How high definition three-dimensional video-frequency is acquired in real time, and formation can be with real-time live broadcast digital signal, and forms nothing in terminal
Resolution loss, bore hole stereoscopic visual effect is following live streaming one important development trend of industry.
Invention content
The purpose of the present invention is to provide a kind of bore hole stereoscopic display live broadcast system and method based on directing backlight, purports
Solving the technical issues of existing naked-eye stereoscopic image live streaming resolution of display system declines.
For this purpose, an embodiment of the present invention provides a kind of bore hole stereoscopic display live broadcast systems based on directing backlight, including
Multiple camera modules, multi-channel video stream processing unit, image refreshing control module and image-display units,
The multi-channel video stream processing unit obtains the multi-path video stream that multiple camera modules synchronize production, from this
It selects two-path video stream as left-eye video stream and right-eye video stream in multi-path video stream, the left-eye video stream and right eye is regarded
Frequency stream is alternately input to described image refreshing control module；
Described image display unit includes eye recognition tracking module and the directing that is set gradually along the light direction of propagation
Backlight module, optically guiding unit and image display, the directing backlight module include multiple individually controllable and do not exist
Light-emitting zone in approximately the same plane, the light-emitting zone are whole towards the optically guiding unit；
Described image refresh control unit alternately refreshes described image using the left-eye video stream and right-eye video stream and shows
Show unit, the location determination at least one for the right and left eyes that the directing backlight module is determined according to the eye recognition tracking module
Light-emitting zone shines, and the light which sends out shows image by the light pilot unit and image display
Frame, wherein when the corresponding light-emitting zone of right eye shines, described image display module shows the image of the right-eye video stream
Frame, when left eye light-emitting zone shines, described image display module shows the picture frame of the left-eye video stream.
Further, the camera module is arranged in parallel.
Further, further include a camera shooting film layer, the camera module includes being arranged in the camera shooting film layer both sides
First camera module and second camera module, the camera shooting film layer and first camera module and second camera mould
The angle of the optical axis of group is 45 °, and, first camera module is produced by the transmitted light of the camera shooting film layer,
The second camera module is produced by the reflected light of the camera shooting film layer.
Further, the camera shooting film layer is semi-reflection and semi transmission lens or optical film layer.
Further, the multi-channel video stream processing unit is directed at the left-eye video stream and right-eye video stream into every trade
Correction, wherein the row alignment correction refers to that in the same plane, every a line of the image of the video flowing is aligned one by one.
Further, the left-eye video stream and right-eye video stream is parallel and frame is same that the multi-channel video stream processing unit exports
Step ground output, alternatively, the left-eye video stream of multi-channel video stream processing unit output and right-eye video stream are in a serial fashion
Alternately export the picture frame of two-path video.
Further, described image refreshing control module be greater than or equal to 100Hz speed to each frame image at
The left-eye video stream and right-eye video stream, are formed the image sequence of alternately output by reason, and described image display unit shows this
Image sequence.
Further, further include a Cloud Server, the multi-channel video stream processing unit is by the left-eye video stream and the right side
Eye video flowing is input to the Cloud Server, and the left-eye video stream and right-eye video stream are transmitted to described by the Cloud Server
Image refreshing control module.
The embodiment of the present invention additionally provides a kind of bore hole stereoscopic display live broadcasting method based on directing backlight, is applied to straight
Display terminal is broadcast, the live streaming display terminal includes light-emitting zone multiple individually controllable and not in approximately the same plane, described
Light-emitting zone is whole towards the optically guiding unit, which includes the following steps：
Obtain left-eye video stream and right-eye video stream that multiple cameras synchronize production；
According to the position of left eye and/or right eye, left eye light-emitting zone corresponding with the left eye or the corresponding right side of right eye are determined
Eye light-emitting zone；
It shines corresponding to the left eye light-emitting zone, is shown using the left-eye video stream refreshed image；Alternatively, right
Right eye light-emitting zone described in Ying Yu shines, and is shown using the right-eye video stream refreshed image.
Further, each frame image is handled with being greater than or equal to 100Hz speed, by the left-eye video stream and
Right-eye video stream forms the image sequence of alternately output, and described image display unit shows the image sequence.
Further, obtain that multiple cameras synchronize the left-eye video stream of production and right-eye video stream includes：Pass through multichannel
The video flowing of multiple synchronizations of multiple camera shootings is input to multi-channel video stream processing unit by video flow processing unit；
The multi-path video stream is input to image refreshing control module by the multi-channel video stream processing unit selectivity,
Form the left-eye video stream and right-eye video stream.
The beneficial effects of the invention are as follows：Bore hole stereoscopic display live streaming provided in an embodiment of the present invention based on directing backlight
System and method show the left-eye video stream produced in multiple camera modules and right-eye video stream real-time Transmission to image single
Member, the corresponding light-emitting zone of cooperation right and left eyes show the corresponding left-eye video stream of right and left eyes or right-eye video stream, improve tradition
The problem of resolution of display system reduces is broadcast live in stereopsis, realizes the bore hole Stereoscopic Video Presentation of full resolution, guarantees
Full HD (ultra high-definition) panel is enough utilized to obtain the stereopsis image quality of full HD (ultra high-definition).
Description of the drawings
Specific embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings, wherein：
Fig. 1 is bore hole stereoscopic display live broadcast system one embodiment provided in an embodiment of the present invention based on directing backlight
Structural schematic diagram；
Fig. 2 is that camera module signal is adopted in the bore hole stereoscopic display live broadcast system based on directing backlight shown in Fig. 1
Collection, the sequence diagram that vision signal refreshes, backlight refreshes；
Fig. 3 is bore hole stereoscopic display live broadcast system another embodiment party provided in an embodiment of the present invention based on directing backlight
The structural schematic diagram of formula；
Fig. 4 is in one embodiment of bore hole stereoscopic display live broadcast system based on directing backlight that inventive embodiments provide
The structural schematic diagram of image-display units；
Fig. 5 is the bore hole stereoscopic display live broadcast system another embodiment party provided in an embodiment of the present invention based on directing backlight
The structural schematic diagram of formula；
Fig. 6 is bore hole stereoscopic display live broadcast system one embodiment provided in an embodiment of the present invention based on directing backlight
The structural schematic diagram of middle camera module and camera shooting film layer；
Fig. 7 is bore hole stereoscopic display live broadcasting method one embodiment provided in an embodiment of the present invention based on directing backlight
Flow chart；
In figure：
100：Camera module；110：First camera shooting head mould；120：Second camera module；130：Image film layer；200：
Multi-channel video stream processing unit；300：Image refreshing control module；400：Image-display units；410：Directing backlight module；
411：Light-emitting zone A；412：Light-emitting zone B；420：Optically guiding unit；430：Image display；440：Eye recognition with
Track module；500：Cloud Server.
Specific implementation mode
Bore hole stereoscopic display live broadcast system provided in an embodiment of the present invention and method can overcome existing helmet-type virtually existing
The deficiency of real technology (VR) and augmented reality (AR) live broadcast system is a kind of without auxiliary such as any helmet of wearing or glasses
Scheme is broadcast live in the immersion stereopsis of equipment.Comparison is based on cylindrical lens (Lenticular) or grating (Parallel
Barrier) scheme is broadcast live in the stereopsis of technology, and the present invention is a kind of based on directing backlight (Directional
Backlight bore hole stereoscopic display live broadcast system).The program can ensure the image resolution ratio that each eye can receive
For full resolution, and maintain full HD or ultra high-definition level.
Fig. 1 is bore hole stereoscopic display live broadcast system one embodiment provided in an embodiment of the present invention based on directing backlight
Structural schematic diagram.As shown in Figure 1, it includes multiple camera shooting head moulds to be somebody's turn to do the bore hole stereoscopic display live broadcast system based on directing backlight
Block, multi-channel video stream processing unit 200, image refreshing control module 300 and image-display units 400.
Camera module 100 is used for recording video stream.In the present embodiment, the camera module is arranged in parallel,
Approximate forward direction alignment, and horizontal aligument.Wherein, 100 synchronous acquisition picture signal of multiple camera modules.For same
The moving scene at moment, the camera module 100 will be in the form of picture frame, and synchronous recording gets off.It is being embodied
In, which can be preferably synchronization camera, but fixed video camera can also be used to observe static three-dimensional field
Scape.
In some embodiments, the specification of above-mentioned camera module 100 should be to try to consistent with size, at least poor
It is different little.Each camera module 100 has independent distortion elimination ability.It is, for example, possible to use mathematical method eliminate it is radial and
Lens distortion in tangential direction so that the output of each camera is orthoscopic image.Meanwhile each camera module 100
With adjustment capability, the relative angle between each camera module 100, relative position, relative distance can should be adjusted
It is whole so that the correction image of row alignment can be exported.
The multi-channel video stream processing unit 200 obtains multiple video flowings that multiple camera modules synchronize production,
Select two-path video stream as left-eye video stream and right-eye video stream from multiple video flowing, by the left-eye video stream and the right side
Eye video flowing is alternately input to described image refreshing control module 300.The left eye that the multi-channel video stream processing unit 200 exports
Video flowing and right-eye video stream are parallel and export in frame synchronization, alternatively, the left eye of the multi-channel video stream processing unit 200 output
Video flowing and right-eye video stream alternately export the picture frame of two-path video in a serial fashion.
In the present embodiment, the multi-channel video stream processing unit 200 to the left-eye video stream and right-eye video stream into
Every trade alignment correction, wherein the row alignment correction refers to that in the same plane, every a line of the image of the video flowing is one by one
Alignment.
Described image refresh control unit alternately refreshes described image using the left-eye video stream and right-eye video stream and shows
Show unit 400.Described image refreshing control module 300 is handled each frame image with being greater than or equal to 100Hz speed, will
The left-eye video stream and right-eye video stream form the image sequence of alternately output, and described image display unit 400 shows the figure
As sequence.
Fig. 2 shows embodiment in, described image display unit 400 include 440 He of eye recognition and tracking module
Directing backlight module 410, optically guiding unit 420 and the image display 430 set gradually along the light direction of propagation, institute
It includes multiple individually controllable and not in approximately the same plane light-emitting zone, the light-emitting zone to state directing backlight module 410
The concave surface towards the optically guiding unit 420 is integrally formed.
In the present embodiment, several in directing backlight module are individually controllable and not in approximately the same plane, three-dimensional
The light-emitting zone of arrangement, the light-emitting zone in space, are issued in continuous or discrete shape.Backlight module forms several recessed
Face, by perpendicular to the cross section that the plane of image displa layer intercepts be in several curved sections or straightways, these curved sections or
Person's straightway will be formed towards the concave surface of optically guiding unit 420, these light-emitting zones are formed not in approximately the same plane
One solid space distribution.The on off state of light-emitting zone needs the image refreshing frequency of synchronous high refresh rate image refreshing unit
Rate, and the light-emitting zone position of the light source of corresponding right and left eyes is judged according to right and left eyes position respectively.Each light-emitting zone
It is light emitting diode (LED), Organic Light Emitting Diode (OLED) to have at least one individually controllable luminescence unit, luminescence unit
Deng.The image refreshing signal of high refresh rate image display 430, it should in real time output, and with directing backlight module into
Row synchronizes so that the refreshing and flicker of the light-emitting zone in directing backlight module can keep same with the refreshing of image
Step.The light-emitting zone A411 of corresponding left eye eyes, it should be synchronized with the refreshing of left-eye video stream；The light-emitting zone of corresponding right eye
B412, it should be synchronized with the refreshing of right-eye video stream.And the position of light-emitting zone, then it is obtained by eye recognition tracking module 440
The image data taken, carries out the identification of human eye, and obtains the accurate three dimensional space coordinate of observer's eyes, thus according to being obtained
Three dimensional space coordinate come the region that judges the region that shine He should close.
Wherein, above-mentioned optically guiding unit 420 is the optical film layer for realizing light beam directional transmissions, is located at directing backlight
Between module and image display 430.In some embodiments, optically guiding unit 420 is made of fresnel lens array.
In another embodiment, optically guiding unit 420 is made of fresnel lens array and beam shaping film layer, beam shaping film
Layer can improve picture homogeneous degree, and weaken Moire fringe.Described image display module 430 is liquid crystal display panel or organic
Light emitting diode (OLED) display panel.
In the present embodiment, the image data in image display 430 is provided by independent multiple camera modules.And
Camera module for eye recognition tracking module is realized using another independent photographing module.Eye recognition with
Track module is made of eye recognition camera module and software program, is mainly used for the position of viewer in front of recognition screen, is obtained
Obtain the three-dimensional space data of observer's eyes.In addition, the eye recognition camera module can also be above-mentioned multichannel camera shooting
Head mould group 100 is realized.
The course of work of bore hole stereoscopic display live broadcast system provided in an embodiment of the present invention is described below in detail, it is intended into one
Step illustrates spirit and substance of the present invention.
The directing backlight module 410 is true according to the position for the right and left eyes that the eye recognition tracking module 440 determines
A fixed at least light-emitting zone shines, and the light which sends out passes through the light pilot unit and image display
430 display picture frames, wherein when the corresponding light-emitting zone of right eye shines, described image display module 430 shows the right eye
Video flowing, when left eye light-emitting zone shines, described image display module 430 shows the left-eye video stream.
Specifically, multi-channel video processing unit will be transferred by the image sequence of different cameras acquisition back.
Then, the adjacent two or more video flowings of the input of multi-path video stream selectivity enter image refreshing control module 300.
The vision signal that wherein two-way synchronizes, left-eye video stream and right-eye video stream are complete at the ceaselessly moment in a manner of alternately refreshing
At refreshing.
By taking left-eye video stream refreshes display prior to right-eye video stream solid as an example, the work of the embodiment of the present invention is further described
Make process.It will be understood by those skilled in the art that can also be that right-eye video stream refreshes display prior to left-eye video stream.
Fig. 2 is that camera module signal is adopted in the bore hole stereoscopic display live broadcast system based on directing backlight shown in Fig. 1
Collection, the sequence diagram that vision signal refreshes, backlight refreshes.As shown in Fig. 2, image of the left-eye video stream to image-display units 400
The first frame of display module 430 is completed to refresh, while the corresponding backlight signal driving corresponding light-emitting zone of left eye eyes being allowed to open
Dynamic, when refreshing completion, corresponding light-emitting zone is closed.Then, image of the right-eye video stream to image-display units 400
The first frame of display module 430 is completed to refresh, while the corresponding light-emitting zone of corresponding backlight drive right eye eyeball being allowed to start, when
When refreshing completion, corresponding light-emitting zone is closed.Then left-eye video stream shows mould to the image of image-display units 400
Second frame of block 430 is completed to refresh, while the corresponding light-emitting zone of corresponding backlight signal driving left eye eyes being allowed to start, and works as brush
When new completion, corresponding light-emitting zone is closed.Then, right-eye video stream shows mould to the image of image-display units 400
Second frame of block 430 is completed to refresh, while the corresponding light-emitting zone of corresponding backlight drive right eye eyeball being allowed to start, when having refreshed
At when, corresponding light-emitting zone is closed, and so on.In specific example, it first can also continuously refresh display left eye and regard
Multiple frames of frequency stream, such as continuous first frame, the second frame and the third frame for refreshing display left-eye video stream, those skilled in the art
The quantity continuously refreshed can be set, then, then refreshing is carried out to right-eye video stream and is shown.
In image refreshing processing module processing procedure, the picture frame of left-eye video stream and right-eye video stream will be with alternately
The mode of refreshing exports, and in the image display of high refresh rate 430, with 100Hz or more than speed refreshed.
The frequency of refreshing preferably remains in 100Hz or more, to obtain smooth continuous stereo-picture using the persistence of vision function of human eye
Visual effect.
Fig. 3 is bore hole stereoscopic display live broadcast system another embodiment party provided in an embodiment of the present invention based on directing backlight
The structural schematic diagram of formula.Fig. 4 is the structural schematic diagram of image-display units 400 in Fig. 3 embodiments.With Fig. 2 shows bore hole
Stereoscopic display live broadcast system is compared, and the eye recognition tracking module 440 of the bore hole stereoscopic display live broadcast system shown in Fig. 3 is using more
A camera.As shown in figure 4, the eye recognition tracking module 440 is placed among display, and shooting direction is towards before display
Side.More mesh cameras include multiple camera modules 100 (including at least two), while being played " eye recognition and tracking " and " same
The function of step shooting multiway images ".Wherein, the video flowing of multiple synchronizations captured by multiple cameras, will enter into multi-channel video
Stream processing unit 200, and image refreshing control module 300 is input to by 200 selectivity of multi-channel video stream processing unit, to
Form left-eye video stream and right-eye video stream.
Fig. 5 is the bore hole stereoscopic display live broadcast system another embodiment party provided in an embodiment of the present invention based on directing backlight
The structural schematic diagram of formula.As shown in figure 5, compared with the bore hole stereoscopic display live broadcast system shown in Fig. 1, the bore hole shown in Fig. 5 is vertical
Body shows that live broadcast system further includes a Cloud Server 500, and two are selected in 200 multi-path video stream of multi-channel video stream processing unit
Then the left-eye video stream and right-eye video stream are input to described by road video flowing as left-eye video stream and right-eye video stream
The left-eye video stream and right-eye video stream are transmitted to described image refresh control by Cloud Server 500, the Cloud Server 500
Module 300.
In the present embodiment, multiple camera modules, the image sequence as captured by photographing module 1, photographing module 2 etc.,
It preferentially uploads on Cloud Server 500, then each image refreshing control module 300 is distributed to by Cloud Server 500, to realize
Scheme is broadcast live in more people, the long-range bore hole three-dimensional video-frequency based on directing backlight.
Fig. 6 is bore hole stereoscopic display live broadcast system one embodiment provided in an embodiment of the present invention based on directing backlight
The structural schematic diagram of middle camera module and camera shooting film layer 130.As shown in fig. 6, the camera module 100 further includes a camera shooting film
Layer 130, the camera module 100 include being arranged in 110 groups of the first camera shooting head mould of camera shooting film layer 130 both sides and second
Camera module 120, the optical axis that the camera shooting film layer 130 images 110 groups of head mould and second camera module 120 with described first
Angle be 45 °.Wherein, the camera shooting film layer 130 is semi-reflection and semi transmission lens, and 110 groups of the head mould of the first camera shooting passes through
The transmitted light of the camera shooting film layer 130 is produced, and the second camera module 120 is anti-by the camera shooting film layer 130
Light is penetrated to be produced.
Specifically, for multiple camera modules 100 of direct parallel arranged, it is limited to 100 firmware of camera module
Intrinsic width causes the machine between multiple cameras for shooting to limit too big, so as to cause the three-dimensional video-frequency for live streaming
Parallax is too big, and stereoscopic effect is bad, is easy to cause dizziness.Therefore, the structure of multiple camera modules 100 can be readjusted,
Using the camera of odd indexed as the first 110 groups of head mould of camera shooting, the optical axis of the first 110 groups of head mould of camera shooting is adjusted to a side
Upwards, using the camera of even number serial number as second camera module 120, the optical axis of second camera module 120 is adjusted to
On another orthogonal direction, and the camera shooting film layer 130 of a half-reflection and half-transmission is arranged in the front of two groups of camera modules.Wherein,
It is 45 degree to image film layer 130 and first and image the angle of the optical axis of 110 groups of head mould and second camera module 120.This makes
First 110 groups of the camera shooting head mould shooting that scene is carried out through camera shooting film layer 130.And second camera module 120 then penetrates half instead
The reflection of semi-transparent film layer carries out the shooting of scene, always obtains the bore hole stereoscopic display image letter for meeting stereoscopic display international standard
Number.
Fig. 7 is bore hole stereoscopic display live broadcasting method one embodiment provided in an embodiment of the present invention based on directing backlight
Flow chart.As shown in fig. 7, the bore hole stereoscopic display live broadcasting method is applied to live streaming display terminal, the live streaming display terminal
Including light-emitting zone multiple individually controllable and not in approximately the same plane, the light-emitting zone is integrally formed towards the light
Learn the concave surface of pilot unit 420.The bore hole stereoscopic display live broadcasting method includes step S610~S630.
Step S610：Obtain left-eye video stream and right-eye video stream that multiple cameras synchronize production；In the present embodiment,
The video flowing of multiple synchronizations of multiple camera shootings multichannel can be input to by multi-channel video stream processing unit to regard
Frequency stream processing unit；The multi-path video stream is input to image refreshing control by the multi-channel video stream processing unit selectivity
Module forms the left-eye video stream and right-eye video stream.
Step S620：According to the position of left eye and/or right eye, left eye light-emitting zone corresponding with the left eye or the right side are determined
The corresponding right eye light-emitting zone of eye；
Step S630：It shines corresponding to the left eye light-emitting zone, is shown using the left-eye video stream refreshed image
Show；Alternatively, shining corresponding to the right eye light-emitting zone, shown using the right-eye video stream refreshed image.It is specific and
Speech, handles each frame image with being greater than or equal to 100Hz speed, the left-eye video stream and right-eye video stream is formed
The alternately image sequence of output, described image display unit 400 show the image sequence.
In above-mentioned each embodiment, by two groups of video flowings in multiple camera modules 100, real-time Transmission enters direction
The bore hole stereo-picture display layer of type backlight, and in image displa layer, alternate intervals play at different times, on the one hand improve
The problem of conventional stereo image live streaming resolution of display system reduces, realizes the bore hole Stereoscopic Video Presentation of full resolution,
Guarantee the stereopsis image quality using full HD (ultra high-definition) panel acquisition full HD (ultra high-definition).On the other hand, will refer to
Single camera into type backlight naked-eye stereoscopic display is substituted for multiple camera modules 100, and is aided with above-mentioned controlling party
Conventional live streaming is changed into the bore hole solid live streaming of full resolution by formula.
Finally, bore hole stereoscopic display live broadcast system provided in an embodiment of the present invention utilizes transflective film by multiple camera shootings
Head is adjusted to orthohormbic structure, to reduce machine limit, always obtains the bore hole stereoscopic display image for meeting stereoscopic display international standard
Signal, and microshot or Minimally Invasive Surgery shooting may be implemented, and meet the occasions such as operation to three-dimensional display of high resolution
The requirement of stereo-picture.
Embodiments of the present invention are explained in detail above in conjunction with attached drawing, but the present invention is not limited to above-mentioned implementations
Mode, one skilled in the relevant art within the scope of knowledge, can also be in the premises for not departing from present inventive concept
It is lower that various changes can be made.
Claims (9)
1. a kind of bore hole stereoscopic display live broadcast system based on directing backlight, which is characterized in that including multiple camera modules,
Multi-channel video stream processing unit, image refreshing control module and image-display units,
The multi-channel video stream processing unit obtains the multi-path video stream that multiple camera modules synchronize production, from the multichannel
Select two-path video stream as left-eye video stream and right-eye video stream in video flowing, by the left-eye video stream and right-eye video stream
Alternating is input to described image refreshing control module；
Described image display unit includes eye recognition tracking module and the directing backlight that is set gradually along the light direction of propagation
Module, optically guiding unit and image display, the directing backlight module include multiple individually controllable and not same
Light-emitting zone in a plane, the light-emitting zone are whole towards optically guiding unit；
Described image refreshing control module alternately refreshes described image using the left-eye video stream and right-eye video stream and shows list
The location determination at least one of member, the right and left eyes that the directing backlight module is determined according to the eye recognition tracking module shines
Region shines, and the light which sends out shows picture frame by light pilot unit and image display, wherein
When the corresponding light-emitting zone of right eye shines, described image display module shows the picture frame of the right-eye video stream, is sent out in left eye
When light region shines, described image display module shows the picture frame of the left-eye video stream；
Multiple camera modules further include a camera shooting film layer, are arranged in the first camera module of the camera shooting film layer both sides and the
Two camera modules, the angle for imaging film layer and first camera module and the optical axis of second camera module are
45 °, and, first camera module is produced by the transmitted light of the camera shooting film layer, the second camera mould
Group is produced by the reflected light of the camera shooting film layer.
2. bore hole stereoscopic display live broadcast system as described in claim 1, which is characterized in that the camera module is mutually parallel
Setting.
3. bore hole stereoscopic display live broadcast system as described in claim 1, which is characterized in that the camera shooting film layer is semi-reflection and semi
Transmission lens or optical film layer.
4. bore hole stereoscopic display live broadcast system as described in claim 1, which is characterized in that the multi-channel video stream processing unit
To the left-eye video stream and right-eye video stream into every trade alignment correction, wherein the row alignment correction refers in same plane
On, every a line of the image of the video flowing is aligned one by one.
5. bore hole stereoscopic display live broadcast system as described in claim 1, which is characterized in that the multi-channel video stream processing unit
The left-eye video stream and right-eye video stream of output are parallel and export in frame synchronization, alternatively, the multi-channel video stream processing unit is defeated
The left-eye video stream and right-eye video stream gone out alternately exports the picture frame of two-path video in a serial fashion.
6. bore hole stereoscopic display live broadcast system as described in claim 1, which is characterized in that described image refreshing control module with
Each frame image is handled more than or equal to 100Hz speed, the left-eye video stream and right-eye video stream are formed into alternating
The image sequence of output, described image display unit show the image sequence.
7. bore hole stereoscopic display live broadcast system as described in claim 1, which is characterized in that further include a Cloud Server, it is described
The left-eye video stream and right-eye video stream are input to the Cloud Server, the Cloud Server by multi-channel video stream processing unit
The left-eye video stream and right-eye video stream are transmitted to described image refreshing control module.
8. a kind of bore hole stereoscopic display live broadcasting method based on directing backlight, is applied to live streaming display terminal, the live streaming is aobvious
Show that terminal includes multiple camera modules, multi-channel video stream processing unit, image refreshing control module and image-display units, institute
It includes eye recognition tracking module and the directing backlight module, the light that are set gradually along the light direction of propagation to state image-display units
It learns pilot unit and image display, the directing backlight module includes multiple individually controllable and not in approximately the same planes
Interior light-emitting zone, the light-emitting zone are whole towards optically guiding unit, which is characterized in that
The bore hole stereoscopic display live broadcasting method includes the following steps：
Left-eye video stream and right-eye video stream that multiple cameras synchronize production are obtained, including：
The video flowing of multiple synchronizations of multiple camera shootings multichannel is input to by multi-channel video stream processing unit to regard
Frequency stream processing unit；
The multi-path video stream is input to image refreshing control module by the multi-channel video stream processing unit selectivity, is formed
The left-eye video stream and right-eye video stream；
Multiple camera modules further include a camera shooting film layer, are arranged in the first camera module of the camera shooting film layer both sides and the
Two camera modules, the angle for imaging film layer and first camera module and the optical axis of second camera module are
45 °, first camera module is produced by the transmitted light of the camera shooting film layer, and the second camera module passes through
The reflected light of the camera shooting film layer is produced；
According to the position of left eye and/or right eye, left eye light-emitting zone corresponding with the left eye or the corresponding right eye of right eye are determined
Light-emitting zone；
It shines corresponding to the left eye light-emitting zone, is shown using the left-eye video stream refreshed image；Alternatively, corresponding to
The right eye light-emitting zone shines, and is shown using the right-eye video stream refreshed image.
9. the bore hole stereoscopic display live broadcasting method based on directing backlight as claimed in claim 8, which is characterized in that be more than
Or each frame image is handled equal to 100Hz speed, the left-eye video stream and right-eye video stream are formed and alternately exported
Image sequence, described image display unit shows the image sequence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611073557.3A CN106507097B (en) | 2016-11-29 | 2016-11-29 | Bore hole stereoscopic display live broadcast system and method based on directing backlight |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611073557.3A CN106507097B (en) | 2016-11-29 | 2016-11-29 | Bore hole stereoscopic display live broadcast system and method based on directing backlight |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106507097A CN106507097A (en) | 2017-03-15 |
| CN106507097B true CN106507097B (en) | 2018-10-02 |
Family
ID=58329074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611073557.3A Active CN106507097B (en) | 2016-11-29 | 2016-11-29 | Bore hole stereoscopic display live broadcast system and method based on directing backlight |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106507097B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106954059A (en) * | 2017-03-30 | 2017-07-14 | 合肥鑫晟光电科技有限公司 | A kind of 3D display control methods, device and 3D display devices |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101795420B (en) * | 2010-04-07 | 2012-12-26 | 昆山龙腾光电有限公司 | Stereo image displaying system and control method thereof |
| CN202068512U (en) * | 2010-04-21 | 2011-12-07 | 刘家方 | Stereo video live device watched with naked eyes |
| US10089937B2 (en) * | 2010-06-21 | 2018-10-02 | Microsoft Technology Licensing, Llc | Spatial and temporal multiplexing display |
| CN102395039B (en) * | 2011-11-18 | 2013-09-11 | 南开大学 | Follow-up illuminating free stereo video image display |
| CN103197428B (en) * | 2013-04-16 | 2016-02-03 | 佛山市英视通电子科技有限公司 | Based on the naked-eye stereoscopic image based display optical device of arc backlight and lens |
| CN104317120A (en) * | 2014-10-27 | 2015-01-28 | 中国科学院自动化研究所 | Free-viewpoint true three-dimensional display method and free-viewpoint true three-dimensional display system allowing many people to watch |
-
2016
- 2016-11-29 CN CN201611073557.3A patent/CN106507097B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN106507097A (en) | 2017-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10554960B2 (en) | Unassisted stereoscopic display device using directional backlight structure | |
| CN102801999B (en) | Synthetizing algorithm based on naked eye three-dimensional displaying technology | |
| CN102123291B (en) | Intelligent naked-eye stereoscopic display system and control method thereof | |
| CN102520787B (en) | Real-time spatial three-dimensional presentation system and real-time spatial three-dimensional presentation method | |
| US20040184145A1 (en) | Autostereoscopic display and method | |
| US6788274B2 (en) | Apparatus and method for displaying stereoscopic images | |
| CN1737638A (en) | Automatic stereoscopic display device with gradual gradient, microlens array, parallax and wide screen | |
| CN104597608B (en) | The directive property backing structure and method of the LED-based three-dimensional display without auxiliary equipment | |
| CN204481874U (en) | A kind of 3-dimensional image mobile phone | |
| CN108415173A (en) | Directive property backlight 3 d display device based on backlight array generator | |
| CN105093549A (en) | Directive backlight naked-eye 3D display apparatus and method realizing multi-person tracking | |
| CN107203047A (en) | The augmented reality system shown based on bore hole 3D | |
| CN106060513A (en) | Code stream caching mechanism for cylindrical surface stereoscopic panoramic video network playing | |
| Honda et al. | Three-dimensional display technologies satisfying" super multiview condition" | |
| CN106526878B (en) | Multi-dimensional free 3 d display device | |
| CN102376207B (en) | LED three-dimensional display screen and manufacturing method thereof, display system and method | |
| CN106507097B (en) | Bore hole stereoscopic display live broadcast system and method based on directing backlight | |
| CN103605213A (en) | Visual area expanding low-crosstalk free three-dimensional display device | |
| JPH01107247A (en) | Three-dimensional video display device | |
| CN103051909B (en) | For the masking-out conversion tracing of human eye method of bore hole 3D display | |
| CN105807434B (en) | A kind of bore hole 3D display viewing areas based reminding method | |
| CN205333973U (en) | Three -dimensional private cinema display device of high definition bore hole 3D | |
| WO2023201806A1 (en) | Flicker-free directional backlight naked eye 3d display device for multi-person viewing | |
| Braun et al. | Evaluating motion and binocular parallax as depth cues for autostereoscopic displays | |
| JP7304264B2 (en) | 3D image display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Fan Hang Inventor after: Liang Weitang Inventor after: Liu Tingting Inventor after: Chen Chaochun Inventor before: Fan Hang Inventor before: Liang Weitang Inventor before: Liu Tingting Inventor before: Chen Chaochun |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |