CN105100779A - Head-worn stereoscopic video playing method - Google Patents

Head-worn stereoscopic video playing method Download PDF

Info

Publication number
CN105100779A
CN105100779A CN201510593901.0A CN201510593901A CN105100779A CN 105100779 A CN105100779 A CN 105100779A CN 201510593901 A CN201510593901 A CN 201510593901A CN 105100779 A CN105100779 A CN 105100779A
Authority
CN
China
Prior art keywords
video
display
module
interlacing
stereoscopic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510593901.0A
Other languages
Chinese (zh)
Inventor
石俊生
黄小乔
邰永航
字崇德
李希才
杨欢
陈载清
程飞燕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yunnan Normal University
Original Assignee
Yunnan Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yunnan Normal University filed Critical Yunnan Normal University
Priority to CN201510593901.0A priority Critical patent/CN105100779A/en
Publication of CN105100779A publication Critical patent/CN105100779A/en
Pending legal-status Critical Current

Links

Landscapes

  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention relates to the field of stereoscopic display, and particularly relates to a head-worn stereoscopic video playing method. The head-worn stereoscopic video playing method relates to hardware and software. The hardware includes a memory, a processor, a displayer and an optical amplification component. The software includes a file operation module, a video decoding module, a video scaling module, a line interleaving conversion module, a display control module and a stereoscopic display module. According to the head-worn stereoscopic video playing method, complicated real-time frame dividing operation does not need to be performed by a PCU; use of an expensive high-performance or customized chip can be avoided, and stereoscopic display can be realized by an embedded platform with a video display controller; and stereoscopic display can be realized with no requirement of using a dedicated two-way video output control interface so that development cost is relatively low.

Description

A kind of wear-type three-dimensional video-frequency player method
Technical field
The present invention relates to field of stereoscopic display, particularly relate to a kind of wear-type three-dimensional video-frequency player method.
Background technology
Utilize solid (3D) Display Technique of mankind's binocular parallax generation stereoscopic depth long-standing, just have cheap red blue filter goggle before many decades, be mainly used in cinema.3D Display Technique, according to whether whether carrying the device accessory of auxiliary observation, and is distinguished into the large class of glasses 3D and bore hole 3D two.Glasses 3D can be divided into again shutter glasses and active with polaroid glasses and passive type and head-mounted display (HMD) three major types.3D stereo display technique trend is gradually from shutter glasses, polarization type glasses, and towards bore hole 3D technical development, but each technology has certain application.Shutter glasses, polarization type glasses 3D technical costs are low, realization easily, and can be used widely with existing two-dimensional display system compatibility, but still be there is the low generation flickering of refreshing frequency, the problem that naturality, comfortableness, timeliness are low.Bore hole 3D also claims Auto-stereo display, and bore hole 3D technology has multiple technologies at present, comprises holographic technique, volume type, parallax grating, lens pillar, time division multiplexing.What generally apply at present is adopt lens or parallax barrier to realize a point picture, according to its three-dimensional view provided number be divided into dual-view and multi views two class Display Technique, still there is the problem of technology and cost.Current 3D shows ubiquity and maximum disparity that eyes merge, Stereopsis, retinal rivalry, solid space distortion, display effect and quality problems [1-3].
HMD stereo display, namely Head Mounted 3D display or nearly eye binocular 3D show, it is the one originated from the earliest in 3D Display Technique, its general principle is before every eyes, place a display screen respectively, display comprises two width images of potential difference simultaneously respectively, the persistence of vision is formed and synthetic stereo image in brain, the also field display effect of infiltration type can be brought, be commonly used in the display device of the immersion of single use, the teaching demonstration system in military individual combat weapon aiming and virtual reality and augmented reality field, military training system are applied.Current wear-type 3D display is not only used widely at personal media player and electronic game, and has a wide range of applications in fields such as industrial production control system, microtechnic, medical video display, CAD/CAM displays.
Above Stereoscopic Video Presentation scheme adopts two independently display and control cores, controls different display channels respectively, drives different displays.
Although there has been a lot of miniscope product to invest market, wear-type 3D has shown application widely, inreal universal at present.Existing wear-type three-dimensional video-frequency player method, show to realize traditional high definition binocular 3D, two-path video exports simultaneously to need control chip to support, general needs two independently display and control core, control different display channels respectively, drive different displays, general processor does not possess such function, need the flush bonding processor of configure dedicated or realized by FPGA, even if just with a display controller, also the separation of the speed of primary processor very high ability achieve frame is needed, higher requirement is proposed to control chip, thus development cost is added, raise product price.Existing method can play non-cubic video and three-dimensional video-frequency, and can complete the conversion of video non-cubic video to Stereoscopic Video Presentation, but the real-time framing strategy of the video of employing is not described.
reference:
[1]SonJY,JavidiB,KwackKD.,Methodsfordisplayingthreedimensionalimages.IEEE,2006,94(3):502-523.
[2]NickHolliman,3DDisplaySystems[R],DepartmentofComputerScience,UniversityofDurham,2005
[3]JoelPollack,3DDisplayTechnologyFromStereoscopestoAutostereoDisplays[R],SharpSystemsofAmerica,2006。
Summary of the invention
For solving the problems of the technologies described above, the present invention proposes a kind of wear-type three-dimensional video-frequency player method, carries out complicated real-time framing operation without the need to CPU; Avoid using expensive high-performance or Custom Prosthesis chip, the general embedded platform with video display controller can realize stereo display; Do not need special two-way video to export control interface and can realize stereo display, development cost is lower.Its technical scheme is:
A kind of wear-type three-dimensional video-frequency player method, relate to hardware and software, it is characterized in that: hardware comprises memory, processor, display, optical amplifier assembly, software comprises file operation module, Video decoding module, video scaling module, line interlacing modular converter, display control module, stereo display module;
File operation module reads the stereoscopic video file after compressed encoding from memory;
Video decoding module decompresses to the stereo video data after compression, restores the vedio data that can show, and deposits among internal memory;
Video file after decompressing, according to rear end display resolution demand, is zoomed to a certain size, to adapt to line interlacing process and screen display by video scaling module;
Other three-dimensional video-frequency format conversion, to the process of decoded video frequency file, are the interlacing scan stagger scheme that right and left eyes image line interlocks by line interlacing modular converter;
The picture traverse of above-mentioned Zoom module and the synthesis of line interlacing modular converter should equal the wide of display physical resolution, is highly high 2 times of monitor resolution;
Display control module utilizes the interlacing scan way of output of ARM platform to read the right and left eyes image information of 3D stagger scheme, after image information is extracted as strange field, even field, export from same video data bus successively with time-interleaved form, output video synchronizing signal simultaneously, field sync signal makes right and left eyes video can by correct differentiation, final left eye display and the right eye display delivering to correspondence respectively, display device is then with progressive scanning mode refreshing video image;
Left eye display and right eye display share video data bus;
The image that display shows amplifies by optical amplifier assembly further.
In described method, make use of the combination of multiple scan mode to realize stereo display, specifically comprise: the processing unit of line interlacing conversion front end is all with mode treatment video image line by line, video image is converted to interlacing scan stagger scheme by line interlacing conversion, display control module extracts video image with interlace mode and send video data bus, and display device is then with progressive scanning mode refreshing video image.
After ensureing that rear end interlacing scan exports, the display resolution delivering to each display can reach the physical resolution of screen, the picture traverse of above-mentioned Zoom module and format converting module synthesis should equal the wide of display physical resolution, is highly high 2 times of monitor resolution.The picture size outputting to each display after extracting through interlacing scan is just suitable, therefore the refreshing mode of two displays is the mode of lining by line scan.
Optical amplifier assembly has two optical lenses to form, and by Nonlinear magnify decades of times, can make As soon as possible Promising Policy human visual experience, finally realizes three-dimensional video-frequency and plays and display.
This invention described scheme specific works flow process is described below: first decompressed by the three-dimensional video-frequency in storage medium, then by decoded right and left eyes video by row alternate pattern deposit in the display buffer of display controller, buffer data is sent from same video data bus in interleaved mode by the display controller utilizing flush bonding processor to carry afterwards, utilize field sync signal to realize left and right video data be separated and flush on different display respectively, after optical amplifier, finally realize three-dimensional video-frequency play and display.
Accompanying drawing explanation
Fig. 1 is present system hardware module schematic diagram;
Fig. 2 is the present invention program's schematic diagram;
Fig. 3 is that the solid based on ARM11 hardware platform of the embodiment of the present invention is play and display system schematics.
Embodiment
By reference to the accompanying drawings, clear, complete description is carried out to the technical scheme in the embodiment of the present invention.
A kind of wear-type three-dimensional video-frequency player method of the present invention, it is the three-dimensional video-frequency player implementation based on ARM platform nearly eye Binocular displays interlacing scan mechanism, do not need to configure special Custom Prosthesis chip, the general embedded platform with video display controller can realize stereo display, does not need complicated video framing to calculate.Below enumerate wherein a kind of specific embodiment, object is to be described in detail to content of the present invention, and accompanying drawing 3 is shown in by embodiment data flow block diagram.
First illustrate, set forth the broadcasting how utilizing content of the present invention to achieve a stereoscopic video file in the present embodiment, this embodiment employing ARM11 processor is the S3C6410 of SAMSUNG company.
Secondly illustrate, the display selected refreshes enable digital display with video, the digital micro displays such as such as miniature AM-OLED display SVGA050, SVGA060.Video data in bus is refreshed on left eye or right eye display by three-dimensional refresh enable signal by system respectively, completes the separation of three-dimensional video-frequency transmitting procedure.In the present embodiment, selected two pieces of Minitype digital display SVGA050V2 to be described scheme, the display resolution of individual monitor is 800 ' 600.
The present invention set forth stereoscopic player implementation method based on ARM platform and interlacing scan mechanism, the flow chart of data processing of player mainly comprises as shown in Figure 2: file operation 201, video decode 202, video scaling 203, line interlacing conversion 204, display and control 205, stereo display 206 module.Below in conjunction with Fig. 3, to based on ARM11 platform solid play and display system embodiment in each step be described in detail.
File operation 300 part is responsible for the stereoscopic video file read compressed encoding from storage medium after, and delivers in the MFC buffering area 311 of S3C6410 processor 310 inside setting.In specific embodiment, the stereoscopic video file of support comprises left-right format, top-down format, several solid storing Format Type of horizontal stagger scheme, and need not to distinguish form be full format 3D form or half form 3D form, because its processing procedure is similar.Operating system portable (SuSE) Linux OS in software platform, and use yaffs2 file system.Video file leaves in the storage mediums such as USB, SD card and portable hard drive, by the abstract file be called in file system, just can be realized the reading process of file by general system call.
Multimedia video decoder module 312 is responsible for the stereo video data decompression process after to compression, restores the image data format that can show and deposits among output internal memory.In specific embodiment, the decompression process of Video decoding module 312 video file utilizing S3C6410 processor 310 to carry.The Video decoding module FIMV-MFC of S3C6410 processor 310 is Video Codec IP of a high energy, and H.263P3 its support, MPEG-4SP, H.264BP with the compressed format such as VC-1MP.In a full-duplex mode, VGA30fps coding/decoding can be realized.Decoding process is as follows:
1. data flow reads out from coded file 300 by application program, is stored in MFC input block 311.
2. call to drive and the data of MFC input block 311 are passed to Video Decoder 312 by ahb bus.
3. Video Decoder 312 starts decoding, and decoded result is stored into MFC output buffer 313.
According to display resolution requirement, Video post-processing module 314 is responsible for the video file after by decompression and is zoomed to a certain size, to adapt to later stage line interlacing process and screen display demand.In specific embodiment, the convergent-divergent stone using S3C6410 processor 310 to carry realizes the size scaling of video image.Convergent-divergent process will consider the location mode of stereoscopic video images, and the display resolution as individual monitor is 800 ' 600, then need decoded video scaling to 1600 ' 600.
In specific embodiment, if decoded video is interlaced scan lines stagger scheme, then can directly skip line interlacing process.
Preferably, if be other three-dimensional video-frequency forms after decoding, then line interlacing processing section completes the further process of decoded video audio data, makes the video image information of various form finally be converted to line interlacing form.This part realizes mainly through software algorithm, mainly in the data transfer of frame buffer zone 315, is realizing conversion from Video post-processing 314.Concrete format conversion comprises: left-right format is converted to line interlacing form, and top-down format is converted to line interlacing form, and other stagger scheme is converted to line interlacing form.
For left-right format, left-right format image is deposited according to the form of the corresponding left display of left half screen, the corresponding right display of right half screen.Building-up process to be establishment one width size be 800 ' 1200 null images.The left half screen carrying of original video image is come once to arrange in even number line, then the odd-numbered line that the right half screen carrying of original image comes to be placed on new images is once arranged.
Extended formatting transfer principle and left-right format transfer process roughly the same, if video is originally with the video that alternate interlaced form/polarization form stores, then can be play-overed without the need to conversion.
Preferably, the object of line interlacing form synthesis is stereoscopic video images is deposited according to the mode of interlacing, goes out and odd field so that interlacing scan process can take out even number successively, respectively corresponding left eye picture and right eye picture.Because interlacing scan exists the situation of interlacing extraction, all over the screen in order to ensure display, in played in full screen situation, every two field picture resolution of synthesis should reach 800 ' 1200 sizes.
Preferably, in order to accelerate the data bed load function in transfer process, the dma module that ARM11 processor carries can be used.
In specific embodiment, display control module is display controller 316, and the video image after line interlacing conversion takes out from frame buffer zone 315 according to interlace mode by it, delivers to video data bus 320.It should be noted that, video data bus only has one.
Preferably, display controller 320 also produces corresponding video synchronization signal.Video synchronization signal is the driver' s timing of video bus necessity, for the picture element scan process of driving display, comprises vertical synchronization VS, horizontal synchronization HS, the enable DE of pixel, pixel clock VCLK.
Except general video synchronization signal, also need three-dimensional video-frequency synchronizing signal.Three-dimensional synchronizing signal also can be called 3D synchronizing signal, for being distinguished by the right and left eyes video data of transmission on same video data bus, refreshes respectively on different displays.
In concrete embodiment, three-dimensional synchronizing signal is realized by field sync signal.
In specific embodiment, display section adopts two OLED display 330, shares video data bus.By the three-dimensional synchronizing signal that 3D synchronous generator 330 produces, the frame of video that differentiation bus that can be correct is transmitted belongs to left-eye image or eye image, thus realizes refreshing two displays selectively.
Be more than the detail of embodiment, not needing special two-way video to export control interface as seen can realize stereo display, and development cost is lower.

Claims (1)

1. a wear-type three-dimensional video-frequency player method, relate to hardware and software, it is characterized in that: hardware comprises memory, processor, display, optical amplifier assembly, software comprises file operation module, Video decoding module, video scaling module, line interlacing modular converter, display control module, stereo display module;
File operation module reads the stereoscopic video file after compressed encoding from memory;
Video decoding module decompresses to the stereo video data after compression, restores the vedio data that can show, and deposits among internal memory;
Video file after decompressing, according to rear end display resolution demand, is zoomed to a certain size, to adapt to line interlacing process and screen display by video scaling module;
Other three-dimensional video-frequency format conversion, to the process of decoded video frequency file, are the interlacing scan stagger scheme that right and left eyes image line interlocks by line interlacing modular converter;
The picture traverse of above-mentioned Zoom module and the synthesis of line interlacing modular converter should equal the wide of display physical resolution, is highly high 2 times of monitor resolution;
Display control module utilizes the interlacing scan way of output of ARM platform to read the right and left eyes image information of 3D stagger scheme, after image information is extracted as strange field, even field, export from same video data bus successively with time-interleaved form, output video synchronizing signal simultaneously, field sync signal makes right and left eyes video can by correct differentiation, final left eye display and the right eye display delivering to correspondence respectively, display device is then with progressive scanning mode refreshing video image;
Left eye display and right eye display share video data bus;
The image that display shows amplifies by optical amplifier assembly further.
CN201510593901.0A 2015-09-18 2015-09-18 Head-worn stereoscopic video playing method Pending CN105100779A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510593901.0A CN105100779A (en) 2015-09-18 2015-09-18 Head-worn stereoscopic video playing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510593901.0A CN105100779A (en) 2015-09-18 2015-09-18 Head-worn stereoscopic video playing method

Publications (1)

Publication Number Publication Date
CN105100779A true CN105100779A (en) 2015-11-25

Family

ID=54580192

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510593901.0A Pending CN105100779A (en) 2015-09-18 2015-09-18 Head-worn stereoscopic video playing method

Country Status (1)

Country Link
CN (1) CN105100779A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105611280A (en) * 2015-12-31 2016-05-25 北京奇艺世纪科技有限公司 VR (Virtual Reality) video editing method and system based on android system
CN105657407A (en) * 2015-12-31 2016-06-08 深圳纳德光学有限公司 Head mounted display, and method and device for displaying binocular 3D video of head mounted display
CN106791771A (en) * 2016-12-23 2017-05-31 歌尔科技有限公司 The method and VR equipment of VR device plays 3D videos
CN106998462A (en) * 2017-04-06 2017-08-01 深圳市魔眼科技有限公司 One kind wears display system
CN106998461A (en) * 2017-04-06 2017-08-01 深圳市魔眼科技有限公司 One kind wears display system
CN107124607A (en) * 2017-05-08 2017-09-01 上海大学 The naked-eye stereoscopic display device and method of a kind of combination visual fatigue detection
CN108108321A (en) * 2017-12-20 2018-06-01 联想(北京)有限公司 A kind of head-mounted display apparatus and data interactive method
CN108156439A (en) * 2016-12-05 2018-06-12 晨星半导体股份有限公司 Stereopsis crossfire processing unit handles processing method with stereopsis crossfire
CN108282599A (en) * 2017-01-04 2018-07-13 深圳市巨烽显示科技有限公司 A kind of 3D display device and Endoscope-assisted diagnostic system
CN108419068A (en) * 2018-05-25 2018-08-17 张家港康得新光电材料有限公司 A kind of 3D rendering treating method and apparatus
CN111246198A (en) * 2020-02-10 2020-06-05 青岛小鸟看看科技有限公司 Video playing method, head-mounted device and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203747927U (en) * 2014-03-26 2014-07-30 云南师范大学 Near-to-eye binocular stereo display system for high-definition digital transmission
CN104243964A (en) * 2014-09-12 2014-12-24 西安诺瓦电子科技有限公司 Stereoscopic LED display control system and method and display control card
CN204465756U (en) * 2015-04-14 2015-07-08 合肥联宝信息技术有限公司 Wear-type 3D video appreciation device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203747927U (en) * 2014-03-26 2014-07-30 云南师范大学 Near-to-eye binocular stereo display system for high-definition digital transmission
CN104243964A (en) * 2014-09-12 2014-12-24 西安诺瓦电子科技有限公司 Stereoscopic LED display control system and method and display control card
CN204465756U (en) * 2015-04-14 2015-07-08 合肥联宝信息技术有限公司 Wear-type 3D video appreciation device

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
BIN ZHOU ET AL.: "《Design of HD Binocular Stereo Display System Based on ARM11》", 《PROC. OF SPIE 9237.OPTOELECTRIONIC IMAGING AND MULTIMEDIA TECHNOLOGY III》 *
卓斌等: "《》一种高清数字视频近眼立体显示***设计", 《光学与光电技术》 *
卓斌等: "《基于AM-OLED立体显示接口电路的设计》", 《液晶与显示》 *
姜超等: "《数字电视3D技术及3D视频传输格式》", 《大众科技》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657407B (en) * 2015-12-31 2018-11-23 深圳纳德光学有限公司 Head-mounted display and its binocular 3D image display method and device
CN105657407A (en) * 2015-12-31 2016-06-08 深圳纳德光学有限公司 Head mounted display, and method and device for displaying binocular 3D video of head mounted display
CN105611280A (en) * 2015-12-31 2016-05-25 北京奇艺世纪科技有限公司 VR (Virtual Reality) video editing method and system based on android system
CN108156439A (en) * 2016-12-05 2018-06-12 晨星半导体股份有限公司 Stereopsis crossfire processing unit handles processing method with stereopsis crossfire
CN106791771A (en) * 2016-12-23 2017-05-31 歌尔科技有限公司 The method and VR equipment of VR device plays 3D videos
CN108282599A (en) * 2017-01-04 2018-07-13 深圳市巨烽显示科技有限公司 A kind of 3D display device and Endoscope-assisted diagnostic system
CN108282599B (en) * 2017-01-04 2020-09-04 深圳市巨烽显示科技有限公司 3D display and endoscope auxiliary diagnosis system
CN106998462A (en) * 2017-04-06 2017-08-01 深圳市魔眼科技有限公司 One kind wears display system
CN106998461A (en) * 2017-04-06 2017-08-01 深圳市魔眼科技有限公司 One kind wears display system
CN107124607A (en) * 2017-05-08 2017-09-01 上海大学 The naked-eye stereoscopic display device and method of a kind of combination visual fatigue detection
CN108108321A (en) * 2017-12-20 2018-06-01 联想(北京)有限公司 A kind of head-mounted display apparatus and data interactive method
CN108419068A (en) * 2018-05-25 2018-08-17 张家港康得新光电材料有限公司 A kind of 3D rendering treating method and apparatus
CN111246198A (en) * 2020-02-10 2020-06-05 青岛小鸟看看科技有限公司 Video playing method, head-mounted device and storage medium

Similar Documents

Publication Publication Date Title
CN105100779A (en) Head-worn stereoscopic video playing method
US11012680B2 (en) Process and system for encoding and playback of stereoscopic video sequences
CN205356597U (en) Three -dimensional video broadcast system of wear -type
EP0746949B1 (en) Synthesized stereoscopic imaging system and method
CN101877795B (en) Stereoscopic image data transmitting, receiving and relaying method and its apparatus
KR100991804B1 (en) Stereoscopic Image Generation Chip For Mobile Equipment, and Method For Generating Stereoscopic Image Using The Same
US20080036854A1 (en) Method and system of communicating and rendering stereoscopic and dual-view images
WO2007072270A1 (en) 3d image display method and apparatus
CN104243964A (en) Stereoscopic LED display control system and method and display control card
US20110149052A1 (en) 3d image synchronization apparatus and 3d image providing system
CN103442241A (en) 3D displaying method and 3D displaying device
CN102868893A (en) Naked 3D image forming method, device and 3D displaying system
US20120120190A1 (en) Display device for use in a frame sequential 3d display system and related 3d display system
TWI674556B (en) The hardware system for inputting 3d image in a flat panel
CN102186096A (en) 3D display set-top box of common television set
CN101742315B (en) Full high-definition 3D signal transformation system
US20120163700A1 (en) Image processing device and image processing method
US20120154374A1 (en) 3d image conversion system
CN201667687U (en) Horizontal separation system for full high-definition 3D video data
CN202332125U (en) Active 3D (Three-Dimensional) LED (Light Emitting Diode) display screen
CN102802013B (en) Method and device for displaying images
JP5367031B2 (en) Information processing method and information processing apparatus
KR20020096203A (en) The Method for Enlarging or Reducing Stereoscopic Images
CN105263013A (en) Method for realizing binocular stereo video synchronization through vertical synchronizing signals
CN104811678A (en) Method and device for carrying out video playing

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20151125