CN102158696B - Three-dimensional video transmission method based on expanding window fountain code - Google Patents
Three-dimensional video transmission method based on expanding window fountain code Download PDFInfo
- Publication number
- CN102158696B CN102158696B CN 201110026373 CN201110026373A CN102158696B CN 102158696 B CN102158696 B CN 102158696B CN 201110026373 CN201110026373 CN 201110026373 CN 201110026373 A CN201110026373 A CN 201110026373A CN 102158696 B CN102158696 B CN 102158696B
- Authority
- CN
- China
- Prior art keywords
- data
- window
- mib
- lib
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention belongs to the technical field of network video transmission, and relates to a three-dimensional video transmission method based on an expanding window fountain code. The method comprises the following steps of: arranging management information base (MIB) data in front of library (LIB) data, and performing luby transform (LT) coding on the MIB data and LIB data, wherein the MIB data and the LIB data are obtained by performing arrangement and segmentation on video data; transmitting the data; performing expanding window fountain code channel decoding; and performing H.264 multi-viewpoint video coding (MVC) decoding. By the method, the reliability transmission of three-dimensional videos can be realized at the same time of ensuring the quality and transmission efficiency of the three-dimensional videos.
Description
Technical field
The invention belongs to the video transmission technologies field, relate to a kind of three-dimensional video-frequency transmission method.
Background technology
Along with the develop rapidly of the multimedia technology and the communication technology, obtained using widely based on the video conference of conventional two-dimensional planar video, video telephone, video broadcasting, digital TV in high resolution etc.Yet Along with people's improves the requirement of digital video day by day, and the ordinary video image can't satisfy people's requirement.Increased the depth information of scenery, strengthened the presence of vision and the three-dimensional video-frequency of sense true to nature and more and more received people's welcome.Meanwhile, the three-dimensional video-frequency technology all has broad application prospects in fields such as Industry Control, long-distance education, the tele-medicine consultation of doctors and operation, DTV, video conferences.Therefore, of having become in the video technique research of three-dimensional video-frequency technology enlivens the field.
The JVT of joint video expert group carries out the formulation work of three-dimensional video-frequency and multiple view video coding technology; Promptly on basis H.264/AVC, complete stereo scopic video coding, multiple view video coding (MVC) and gradable multi-vision-point encoding (ScalableMVC) instrument is provided.Based on multiple view video coding MVC H.264; It is the part of coding standard superset H.264; Utilize the H.264 compression algorithm of higher level code, to the characteristics of multi-view point video, through changing the H.264 framework of encoder of a part; Increase some coding toolses of encoder, reach the purpose of compression multi-view point video.
Reaching its maturity of stereo video coding-decoding technology, network technology flourish possibly become the transmission of three-dimensional video-frequency.Yet the video flowing of compression is responsive especially to the mistake of transmission owing in source encoder, having adopted predictive coding and Variable Length Code (VLC).The error bursts that the random error that insecure wire/wireless channel is introduced in bit stream, the loss of data that network congestion causes and multipath transmisstion cause etc., the video flowing in all might causing transmitting produces mistake and loss.And compressing video frequency flow in the transmission, in case mistake occurred, error message will rapid spread and diffusion on room and time, and video quality is sharply descended.In recent years, digital fountain sign indicating number did not have cbr (constant bit rate) with it, can adapt to more channel; And linear operation is all adopted in encoding and decoding; Make computational complexity lower, and as a kind of forward error correction, the characteristic that digital fountain sign indicating number need not to feed back has attracted increasing concern.M.Luby has proposed the notion of fountain sign indicating number in 1998, and has proposed first kind of feasible fountain sign indicating number---LT sign indicating number of efficient reality in 2002.Thereafter, people such as Shokrollahi further improve to fountain code coding/decoding performance consuming time, have proposed a kind of novel fountain code type Raptor sign indicating number.
Summary of the invention
The purpose of this invention is to provide a kind ofly when guaranteeing three-dimensional video-frequency quality and efficiency of transmission, can realize the method for three-dimensional video-frequency reliable transmission.The present invention is based on the unequal error protection system of the three-dimensional video-frequency of expansion window fountain sign indicating number, through the forward error correction of fountain sign indicating number, this system can guarantee to transmit reliably through the stereo video data of H.264 MVC compression.Native system can be suitable in all wired or wireless communication environment, and making can be with clean culture through the stereo video streaming of H.264 MVC compression, and the multicast and the forms of broadcasting are carried out reliable transmission.
A kind of three-dimensional video-frequency transmission method based on expansion window fountain sign indicating number comprises the following steps:
1) reads video data through the coding of MVC H.264;
2) carry out judgement, if header, motion, difference vector predicted difference, the frame internal information then belongs to the MIB data, and the person does not belong to the LIB data;
3) carry out data arrangement with cut apart, before the MIB data are placed on, the LIB data after;
4) data are cut apart the MIB data that the obtain data as first window of expansion window fountain sign indicating number, the LIB data are the data of second window;
5) choose the LT robust solitary wave degree distribution Ω of first window
Rs(500,0.03,0.5), the Raptor degree function distribution Ω of second window
R(x)=0.007969x+0.493570x
2+ 0.166220x
3+ 0.072646x
4+ 0.082558x
5+ 0.056058x
8+ 0.037229x
9+ 0.055590x
19+ 0.025023x
64+ 0.003135x
66
6) account for total data ratio ∏ according to data in first window
1, the selection probability Γ of first window that searching is optimum
1, then the ratio of second window data is 1-∏ 1
,It is 1-Γ that its window is selected probability
1
7) to MIB, the data of LIB are carried out the LT coding;
8) the LT coded data be will pass through through wired or wireless form, the Internet or client will be transferred to;
9) establish ε for expansion window fountain sign indicating number decoding expense,, the data that receive are at first carried out channel-decoding, receive (1+ ε) when receiving terminal and (MIB+LIB) during data, utilize the belief propagation interpretation method to carry out channel decoding at receiving terminal;
10) carry out channel decoding after, decoding is obtained MIB and LIB carries out the code stream reorganization, send into H.264MVC decoder then, decode.
As preferred implementation, the present invention can adopt And-Or Tree algorithm to seek the selection probability of first optimum window.
The expansion window fountain sign indicating number unequal error protection method of the H.264 MVC multi-viewpoint three-dimensional video that the present invention proposes; Incorporated joint Source-Channel Coding Technology; Can carry out unequal error protection according to the importance of data; Important data are more protected, thereby improved the reliability of transmission.Simultaneously because the fountain sign indicating number is with software mode reality; Speed is very fast, and is forward error correction, has not had the network delay of TCP to influence throughput; Can be in the Internet; Wireless network provides the three-dimensional video-frequency transmission near network bandwidth speed on mobile network and the satellite network, perfect streaming media on demand of quality or broadcasting can be provided.And owing to need not feed back, the growth of number of users has no influence for transmit leg, and transmit leg can be served the user of any amount, thereby increases client's number, can increase economic benefit, and application prospect can be fine.
Description of drawings
Fig. 1 entire system block diagram.
Fig. 2 data are cut apart flow chart.
Fig. 3 expands window fountain sign indicating number coding block diagram.
Fig. 4 expands window decoding fountain codes block diagram.
Fig. 5 MIB, the ber curve that LIB changes with the decoding expense.
Embodiment
For efficiency of transmission and data reliability; The present invention is directed to the multi-viewpoint three-dimensional Video transmission system; Based on joint source-channel coding and unequal error protection technology; Propose a kind of expansion window fountain sign indicating number (Expending Window Fountain Codes) data transmission method of H.264 MVC multi-viewpoint three-dimensional video, this method belongs to a kind of unequal error protection method.Below in conjunction with accompanying drawing and embodiment the present invention is described further.
One, three-dimensional video-frequency reads, encodes
Like Fig. 1, native system relates to three-dimensional video-frequency and reads, source encoding, chnnel coding, transmission, channel-decoding, source coding, seven parts such as Stereoscopic Video Presentation.Among the present invention, at first read eight viewpoint cycle tests videos, YUV 420 planar formats, sending into H.264, the MVC encoder carries out eight viewpoint stereo scopic video codings.Adopt the JMVC8.0 test code, H.264 MVChierarchical B reference frame management mode is predicted two kinds of forecast models in associating interview prediction and the viewpoint, carries out the coding of octuple three-dimensional video-frequency according to the order of 0-2-1-4-3-6-5-7.The i.e. image sequence of coded views 0 at first, the image sequence of coded views 2 is reference with images in viewpoint 0 image and the viewpoint 2 then, encodes.Once analogize, carry out the coding of eight viewpoints.
Two, data are cut apart
Through the stereo scopic video coding code stream that the coding of MVC H.264 obtains, have and the similar structure of encoder output code flow H.264.Just on the basis of the output code flow of H.264 encoding, also increased the parallax information between the different video channels, like difference vector, parallax predictive mode, prediction residual etc.Difference vector and motion vector have the effect of no less important, have than infra-frame prediction and inter-frame forecast mode and the even more important characteristic of predictive coefficient, in case difference vector makes a mistake the influence that the data of auxiliary video will receive.Therefore, think the slice header of auxiliary video, the coded frame type, parallax predicted macroblock type, and the difference vector between the different points of view is the same with motion vector in the same viewpoint need adopt high level protection.
So the present invention will be divided into the part of MIB, two different severity levels of LIB based on the three-dimensional video-frequency code stream of the coding of MVC H.264:
Most important view data MIB comprises that the A type cuts apart, and Type B is cut apart.The direct current of the coding mode of, difference vector predicted difference poor by slice header, macro block (mb) type, macroblock frame inner estimation mode information, macroblock image information, motion-vector prediction, frame end mark, intra-frame macro block and intra-frame macro block brightness, colourity and ac coefficient etc. are formed.The A type is cut apart, and is most important; Type B is cut apart, and the C type is cut apart the frame internal information and can be stoped drift effect better relatively, cuts apart more important than C type.Therefore, the MIB data need adopt high level protection.
Less important relatively view data LIB comprises that the C type cuts apart, i.e. the coding mode of inter macroblocks, inter macroblocks brightness DC coefficient, inter macroblocks colourity DC coefficient, inter macroblocks brightness ac coefficient, inter macroblocks colourity ac coefficient.Other protection of LIB The data relatively low level.
As shown in Figure 2, concrete extraction step is following:
1) read through MVC coded file H.264, with and coding follow the tracks of the trace_enc.txt file
2) carry out judgement, if A, B is cut apart, and then belongs to the MIB data, if C is cut apart, then belongs to the LIB data.
3) carry out data arrangement, before the MIB data are placed on, the LIB data after.
Three, expansion window fountain sign indicating number chnnel coding
1) as shown in Figure 3, data are cut apart the MIB that obtains, LIB two parts data are as the data of two importance of expansion window fountain sign indicating number.With the data of MIB as first window of expansion window fountain sign indicating number, the data of MIB and LIB are the data of second window.
2) the degree distribution function Michael Luby that chooses first window is in the robust solitary wave distribution Ω of proposition in " LT codes " in 2002
Rs(500,0.03,0.5), the degree function of second window was distributed as 2006, the Ω that Amin Shokrollahi proposes in " Raptor codes "
R(x) as follows:
Ω
R(x)＝0.007969x+0.493570x
2+0.166220x
3+0.072646x
4+0.082558x
5+0.056058x
8+0.037229x
9+0.055590x
19+0.025023x
64+0.003135x
66
3) account for total data ratio ∏ according to data in first window
1,, seek optimum window and select probability Γ through And-Or Tree algorithm
1(ratio of second window data is 1-∏
1, its window is selected probability 1-Γ
1), as shown in Figure 5, the degree distribution function that adopts the present invention to propose, MIB has the littler error rate than LIB.
4) as shown in Figure 3, encode, choose coding groups number of degrees d according to the number of degrees distribution Ω of first and second window.If first window, this is from the MIB packet, and picked at random d is individual equiprobably.With this d original data packet mould two draws, generate a coding groups.If second window, this is from MIB and LIB packet, and picked at random d is individual equiprobably.With this d original data packet mould two draws, generate a coding groups.Through the row coding, finish successively until cataloged procedure.
Four, transmission and expansion window fountain sign indicating number channel-decoding
To pass through information source among the present invention, the stereo video data of chnnel coding was advanced the wireless channel transmission through the BPSK modulation, was sent to receiving terminal.Decipher at receiving terminal:
1) receiving terminal receives packet, carries out the BPSK demodulation, sends into decoder and deciphers.
2) owing to the wireless channel additive gaussian white noise, so, do not adopt hard decision, and be based on soft-decision, adopt belief propagation (BP, the Belief Progatation) decoding algorithm of Judea Pearl in 1982 propositions, decipher.
3) judge receive data whether more than or equal to (1+ ε) (MIB+LIB) (ε is expansion window fountain sign indicating number decoding expense) during data, but be decoding success then.If not, return the first step, continue to accept data.
Five, H.264 MVC decoding and stereo display
After advancing channel decoding, obtain MIB and LIB, carry out the code stream reorganization, send into H.264 MVC decoder then, through the row decoding.Eight viewpoint three-dimensional video-frequencies with decoding obtains advanced the three-dimensional video-frequency composition algorithm, were spliced into the three-dimensional video-frequency of 1920x1080 resolution, then through playing up, play at the 3D display at last.
Claims (2)
1. the three-dimensional video-frequency transmission method based on expansion window fountain sign indicating number comprises the following steps:
1) reads video data through the coding of MVC H.264;
2) carry out judgement, if header, motion, difference vector predicted difference, the frame internal information then belongs to the MIB data, otherwise, the LIB data belonged to;
3) carry out data arrangement with cut apart, before the MIB data are placed on, the LIB data after;
4) data are cut apart the MIB data that the obtain data as first window of expansion window fountain sign indicating number, MIB and LIB data are the data of second window;
5) choose the LT robust solitary wave degree distribution Ω of first window
Rs(500,0.03,0.5), the Raptor degree function of second window distributes
Ω
R(x)=0.007969x+0.493570x
2+0.166220x
3+0.072646x
4+0.082558x
5+0.056058x
8+0.037229x
9+0.055590x
19+0.025023x
64+0.003135x
66;
6) account for total data ratio ∏ according to data in first window
1, the selection probability Γ of first window that searching is optimum
1, then the ratio of second window data is 1-∏
1, it is 1-Γ that its window is selected probability
1
7) to MIB, the data of LIB are carried out the LT coding;
8) the LT coded data be will pass through through wired or wireless form, the Internet or client will be transferred to;
9) establish ε for expansion window fountain sign indicating number decoding expense,, the data that receive are at first carried out channel-decoding, receive (1+ ε) when receiving terminal and (MIB+LIB) during data, utilize the belief propagation interpretation method to carry out channel decoding at receiving terminal;
10) carry out channel decoding after, decoding is obtained MIB and LIB carries out the code stream reorganization, send into H.264 MVC decoder then, decode.
2. a kind of three-dimensional video-frequency transmission method according to claim 1 is characterized in that, adopts And-Or Tree algorithm to seek the selection probability of first optimum window.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110026373 CN102158696B (en) | 2011-01-25 | 2011-01-25 | Three-dimensional video transmission method based on expanding window fountain code |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110026373 CN102158696B (en) | 2011-01-25 | 2011-01-25 | Three-dimensional video transmission method based on expanding window fountain code |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102158696A CN102158696A (en) | 2011-08-17 |
| CN102158696B true CN102158696B (en) | 2012-10-03 |
Family
ID=44439841
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110026373 Expired - Fee Related CN102158696B (en) | 2011-01-25 | 2011-01-25 | Three-dimensional video transmission method based on expanding window fountain code |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102158696B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102684893B (en) * | 2012-05-15 | 2014-07-16 | 北京理工大学 | Self-adaptive fountain coding method based on multimedia broadcast multicast service |
| CN104320147B (en) * | 2014-10-27 | 2017-08-08 | 中国传媒大学 | A kind of Raptor code methods of system unequal error protection |
| WO2022051897A1 (en) * | 2020-09-08 | 2022-03-17 | 华为技术有限公司 | Encoding method and apparatus |
| CN113068065B (en) * | 2021-02-25 | 2022-02-25 | 北京邮电大学 | Low-delay streaming media transmission method based on viewpoint prediction |
| CN113890683B (en) * | 2021-10-11 | 2024-06-25 | 东北大学 | Graded video transmission method based on unequal error protection on-line fountain codes |
| CN115987459B (en) * | 2022-12-28 | 2024-06-21 | 北京理工大学 | Extended window fountain code encoding method based on memory optimization |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008025510A1 (en) * | 2006-08-30 | 2008-03-06 | Jacobs University Bremen Ggmbh | Unequal-error protection bit loading for multicarrier transmission |
| CN101515842A (en) * | 2009-04-03 | 2009-08-26 | 北京理工大学 | Method for transmitting partial cooperative information based on fountain coding |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1992072A1 (en) * | 2006-01-27 | 2008-11-19 | Jacobs University Bremen gGmbH | Check-irregular ldpc codes for uep |
| US8315306B2 (en) * | 2006-09-08 | 2012-11-20 | The Texas A&M University System | Distributed joint source-channel coding of video using raptor codes |
| US8374254B2 (en) * | 2008-12-15 | 2013-02-12 | Sony Mobile Communications Ab | Multimedia stream combining |
-
2011
- 2011-01-25 CN CN 201110026373 patent/CN102158696B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008025510A1 (en) * | 2006-08-30 | 2008-03-06 | Jacobs University Bremen Ggmbh | Unequal-error protection bit loading for multicarrier transmission |
| CN101515842A (en) * | 2009-04-03 | 2009-08-26 | 北京理工大学 | Method for transmitting partial cooperative information based on fountain coding |
Non-Patent Citations (1)
| Title |
|---|
| Dino Sejdinovic,et al..Expanding Window Fountain Codes for Unequal Error Protection.《IEEE TRANSACTIONS ON COMMUNICATIONS》.2009,第57卷(第9期), * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102158696A (en) | 2011-08-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102158696B (en) | Three-dimensional video transmission method based on expanding window fountain code | |
| US20150382038A1 (en) | Multicasting multiview 3d video | |
| CN101686391A (en) | Video coding/decoding method and device as well as video playing method, device and system | |
| CN110740334B (en) | Frame-level application layer dynamic FEC encoding method | |
| Fujihashi et al. | FreeCast: Graceful free-viewpoint video delivery | |
| Roumy et al. | Universal lossless coding with random user access: the cost of interactivity | |
| Liu et al. | QoE-oriented 3D video transcoding for mobile streaming | |
| Xiang et al. | Robust multiview three-dimensional video communications based on distributed video coding | |
| EP3369251A2 (en) | Hybrid digital-analog coding of stereo video | |
| Micallef et al. | Error concealment techniques for multi-view video | |
| Kamolrat et al. | Joint source and channel coding for 3D video with depth image-based rendering | |
| CN103916714A (en) | Packet-loss resistance preprocessing and recovery method for wireless network video stream | |
| CN102227133B (en) | Stereo video transmission method | |
| CN107995502B (en) | Method, equipment and system for realizing self-adaptive streaming media | |
| Otomo et al. | Loss resilient multi-view video streaming over multiple transmission paths | |
| Blatsas et al. | A performance study of LT based unequal error protection for 3D video streaming | |
| KR100675451B1 (en) | Image communication system using a hierarchical code comprised of a plurality of layers | |
| Xiao et al. | Real-time forward error correction for video transmission | |
| Liu et al. | Application-adapted mobile 3D video coding and streaming—A survey | |
| Zhang et al. | A packetization strategy for interactive multiview video streaming over lossy networks | |
| Jing et al. | A packet loss protection scheme joint deterministic network coding and random linear network coding for H. 264/AVC | |
| Ramzan et al. | Efficient transmission of multiview video over unreliable channels | |
| Nemoianu et al. | Multi-view video streaming over wireless networks with RD-optimized scheduling of network coded packets | |
| CN104394401A (en) | Stereoscopic video transmission method based on rate-controlled modulation | |
| US9088778B2 (en) | Method and system for multiview distributed video coding with adaptive syndrome bit rate control |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20121003 Termination date: 20210125 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |