CN1668025A - Data, voice and video merged multi-code rate coding-decoding and isochronous transmission method thereof - Google Patents
Data, voice and video merged multi-code rate coding-decoding and isochronous transmission method thereof Download PDFInfo
- Publication number
- CN1668025A CN1668025A CN 200410016827 CN200410016827A CN1668025A CN 1668025 A CN1668025 A CN 1668025A CN 200410016827 CN200410016827 CN 200410016827 CN 200410016827 A CN200410016827 A CN 200410016827A CN 1668025 A CN1668025 A CN 1668025A
- Authority
- CN
- China
- Prior art keywords
- data
- video
- decoding
- voice
- code rate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000005540 biological transmission Effects 0.000 title claims abstract description 28
- 150000001875 compounds Chemical class 0.000 claims description 4
- 230000006870 function Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 2
- 238000007796 conventional method Methods 0.000 claims description 2
- 238000004806 packaging method and process Methods 0.000 abstract 1
- 230000001360 synchronised effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 7
- 230000003139 buffering effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 230000001314 paroxysmal effect Effects 0.000 description 1
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This invention discloses a multiple code rate code/decode integrating data, phones and video and its isochronous transmission method, which applies the following steps: carrying out a hierarchical code to the video, carrying out logic contact with the data units necessary to be displayed with the video frame at the same time, hierarchically encoding phones, packaging the data into data unit packets one by one in terms of the display requirement to add data unit number on the packet head, composing the data, phones and audio to a transmission flow entering into a forward gateway to be processed, decoding at the user end. Said encode method combines data, phones and video, which can isochronously transmit the transmission flow merging data, phones and video to ensure the synchronous play of data and video/audio when decoding.
Description
Technical field
The present invention relates to information transmission technology field, especially relate to a kind of multi code Rate of Chinese character encoding and decoding of having merged data, voice, video and etc. the time transmission method.
Background technology
Application that some are new such as live classroom, not only need to send voice, video at video conference or the like, but also need to transmit data, require very strong real-time simultaneously again, transmission requirements when having etc.
The live application of traditionally some only relates to voice and video, and the coding method that therefore is used for them has also only mixed voice and video, can not satisfy the demand of transmitting data simultaneously.In addition on the one hand, live application traditionally all is to different user's transmission when running into different user's access bandwidths with identical speed after sending out video-voice frequency flow, but because user's access bandwidth is inconsistent, when predetermined transmission rate surpasses available bandwidth, will cause shake, thus transmission can not guarantee to wait the time.
Summary of the invention
For the while transferring voice, video and data and transmit in the face of different user's access bandwidths provides when waiting, the invention provides a kind of novel fusion data, voice, video the multi code Rate of Chinese character encoding and decoding and etc. the time transmission method.
The technical solution adopted for the present invention to solve the technical problems is: a kind of multi code Rate of Chinese character encoding and decoding of having merged data, voice, video and etc. the time transmission method, adopt the following step:
Video is carried out hierarchical coding;
Needs and frame of video are carried out logical communication link in the data presented unit simultaneously;
Voice are carried out hierarchical coding;
Data are broken into one by one data cell bag according to the requirement that shows, add data unit number at the head of data cell bag;
Data, voice and audio frequency are carried out the compound transport stream of multichannel;
Transport stream enters the forwarding gateway, and this gateway has the real-time transcoding function and finds out each user's access bandwidth;
The forwarding gateway is selected necessarily to look the audio frequency level content according to each user's different access bandwidth and is sent;
Further, if transmit the access bandwidth of code check sum match user that gateway does not have the level content of some, just carry out the access bandwidth of the transcoding of different code checks with match user;
Enter corresponding input block for the audio frame of looking that receives, enter decoding buffer zone then;
Be introduced into corresponding input block for the data cell bag that receives, deposit in then in the interim memory space of mass storage, read the data of several unit that are about to use to the display buffer from interim memory space;
Voice are decoded according to the conventional method;
If when running into head in the time of video decode the frame of data unit number being arranged, call data display controller and from the display buffer, read needed data cell, if when the display buffer does not have required data cell then from mass storage, read in according to data unit number;
Further, described coding/decoding method is with clock control video and tone decoding, shows there is not clock control for data, but shows related data cell when decoded again in the video access unit that the data cell association is arranged.
The multi code Rate of Chinese character encoding and decoding of a kind of fused data of the present invention, voice, video and etc. the time transmission method beneficial effect mainly show: 1, the present invention encodes and has merged data, voice, video, supports new demands of applications better; 2, the present invention has taked the multi code Rate of Chinese character coding, has adopted the coding level of choosing varying number to come the access bandwidth of match user for different user's access bandwidths, can adapt to the demand of different bandwidth; 3, the present invention has utilized hierarchical coding and real-time transcoding effectively to mate the different user access bandwidth, transmission when waiting with realization; 4, the present invention goes into mass storage to the data that receive are existing, makes to have paroxysmal data and can pass in advance; 5, the present invention carries out relatedly when encoding and decoding to video and data, makes it can guarantee synchronism when playing.
Description of drawings
Fig. 1 is an overall procedure schematic diagram of the present invention;
Fig. 2 is the schematic diagram of coded portion of the present invention;
Fig. 3 is the schematic diagram of video PES packet format;
Fig. 4 is the schematic diagram of data PES packet format;
Fig. 5 is the schematic diagram of forwarding gateway of the present invention;
Fig. 6 is the schematic diagram of decoded portion of the present invention.
Embodiment
With reference to the accompanying drawings 1, a kind of multi code Rate of Chinese character encoding and decoding of having merged data, voice, video and etc. the time transmission method overall procedure:
Obtain the video primary flow from video source (1), obtain the audio frequency primary flow, obtain the data primary flow from data source (3) from audio-source (2);
Three road streams are admitted to multi code Rate of Chinese character hybrid coder (4) and carry out the multi code Rate of Chinese character hybrid coding, export one tunnel transport stream;
Transport stream is admitted to transmits gateway (5), transmits gateway and according to different user's access bandwidths transport stream is handled;
Transport stream after treatment is sent to user side through network (6);
After user side received transport stream, the multi code Rate of Chinese character decoder (7) on the user side carried out the multi code Rate of Chinese character decoding.
With reference to the accompanying drawings 2, a kind of multi code Rate of Chinese character coding method of having merged data, voice, video:
Voice are input to voice layered encoder (12) from speech source (11) to carry out hierarchical coding and obtains ES stream, passes through burster (13) grouping then and breaks into the PES bag;
Video is input to vedio layering coding device (15) from video source (14) to carry out hierarchical coding and obtains ES stream, pass through burster (16) grouping then and break into the PES bag, burster (16) links to each other with data source (17) simultaneously, interrelate when the payload of the grouping of burster (16) packing comprises the first module of video access unit and this video access unit and certain data cell, the head in this grouping need comprise this data unit number information so;
Data are input to burster (18) grouping from data source (17) and break into the PES bag;
Data, voice, video break into respectively behind the PES bag and to carry out multichannel through multiplexer (MUX) (19) and become a single TS stream transmission on the net after compound;
Accompanying drawing 3 and accompanying drawing 4 are the schematic diagram of video PES bag and data PES packet format.As shown in the figure, DU_flag and two fields of data unit number have been comprised at video PES packet header.If first byte and this video access unit that this PES bag payload comprises the video access unit interrelate with certain data cell, DU_flag is changed to " 1 " so, otherwise is changed to " 0 ".The data unit number field is an Optional Field, if DU_flag is changed to " 1 ", should comprise the data unit number that interrelates with the video access unit in the data unit number field so, otherwise not select the data unit number field;
DU_flag and two fields of data unit number have also been comprised at data cell PES packet header.If when this PES bag payload comprised first byte of data cell, DU_flag was changed to " 1 " so, otherwise is changed to " 0 ".The data unit number field is an Optional Field, if DU_flag is changed to " 1 ", should comprise corresponding data unit number in the data unit number field so, otherwise not select the data unit number field;
With reference to the accompanying drawings 5, a kind of multi code Rate of Chinese character code stream that has merged data, voice, video etc. the time transmission method:
Utilize transmitting the gateway guarantee can both have the transmission code rate that matches for the different access bandwidth of user, thus transmission when guaranteeing to wait;
The TS stream that the compound back of process coding and multichannel produces is input to reproducer (21), and reproducer (21) is copied into some streams according to the number of users that inserts with the TS stream of importing, and each flows for a user;
For example, certain first-class forwarding gateway that is sent to, these flow by the access bandwidth of selection control (22) according to this user then to be duplicated into several stream through reproducer (21), from vedio layering coding, select certain level and from the voice hierarchical coding, select certain level to add data to transmit access bandwidth with match user, at this moment the selector switch place select be on branch road, branch's selection function is also finished by selection control (22); If by said method can't match user access bandwidth, then select branch road down by selection control (22), flow to then into real-time transcoding device (23), carry out the transcoding of different code checks.
With reference to the accompanying drawings 6, a kind of multi code Rate of Chinese character coding/decoding method that has merged data, voice, video:
Transport stream comes out to from passage particular decoder (31) and transmits the stream multi-channel demodulator and decoder (32) carries out multi-channel demodulator, recovers original data flow, voice flow and video flowing through multi-channel demodulator;
Voice flow enters input buffering (33);
Video flowing enters input buffering (37);
Data flow enters input buffering (36), the mass storage of restoring (39), and then the data cell that will soon need use is called in display buffer (40);
Audio decoder (34) and Video Decoder (38) are decoded under the control of clock (35);
Video Decoder (38) is if current decoded video access unit has certain data cell and its to interrelate when decoding, and Video Decoder (38) notification data display controller (41) need show certain data cell so;
After data display controller (41) has notice, obtaining from display buffer (40) according to data unit number needs the data presented unit, if in display buffer (40), do not exist, then call in display buffer (40) from mass storage (39), take out from display buffer (40) again.
Claims (7)
1, the multi code Rate of Chinese character encoding and decoding of a kind of fused data, voice, video and etc. the time transmission method, adopt the following step:
Video is carried out hierarchical coding;
Carry out logical communication link in the data presented unit simultaneously with needs and frame of video in addition;
Voice are carried out hierarchical coding;
Data are broken into one by one data cell bag according to the requirement that shows, add data unit number at the head of data cell bag;
Data, voice and audio frequency are carried out the compound transport stream of multichannel;
Transport stream enters the forwarding gateway processes;
User side is decoded;
Data, voice, video have been merged in described coding method.
2, the multi code Rate of Chinese character encoding and decoding of a kind of fused data as claimed in claim 1, voice, video and etc. the time transmission method, it is characterized in that: described coding method is carried out related with data cell the video access unit.
3, the multi code Rate of Chinese character encoding and decoding of a kind of according to claim 1 fused data, voice, video and etc. the time transmission method, it is characterized in that:
The transmission method of described forwarding gateway processes comprises: transport stream enters the forwarding gateway, and this gateway has the real-time transcoding function and finds out each user's access bandwidth;
The forwarding gateway is selected necessarily to look the audio frequency level content according to each user's different access bandwidth and is sent.
4, the multi code Rate of Chinese character encoding and decoding of a kind of fused data as claimed in claim 3, voice, video and etc. the time transmission method, it is characterized in that: the coding level of described forwarding gateway by selecting varying number can't match user access bandwidth the time, just carry out the transcoding of different code checks.
5, the multi code Rate of Chinese character encoding and decoding of a kind of according to claim 1 fused data, voice, video and etc. the time transmission method, it is characterized in that: the coding/decoding method that described user side is decoded comprises:
Enter corresponding input block for the audio frame of looking that receives, enter the decoding buffer area then;
Be introduced into corresponding input block for the data cell bag that receives, deposit in then in the interim memory space of mass storage, read the data of several unit that are about to use to the display buffer from interim memory space;
Voice are decoded according to the conventional method;
If when running into head in the time of video decode the frame of data unit number being arranged, call data display controller and from the display buffer, read needed data cell, if when the display buffer does not have required data cell then from mass storage, read in according to data unit number.
6, the multi code Rate of Chinese character encoding and decoding of a kind of fused data as claimed in claim 5, voice, video and etc. the time transmission method, it is characterized in that: described coding/decoding method is with clock control video and tone decoding.
7, the multi code Rate of Chinese character encoding and decoding of a kind of fused data as claimed in claim 5, voice, video and etc. the time transmission method, it is characterized in that: described coding/decoding method shows it is to show related data cell when decoded again in the video access unit that the data cell association is arranged for data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200410016827 CN1668025A (en) | 2004-03-10 | 2004-03-10 | Data, voice and video merged multi-code rate coding-decoding and isochronous transmission method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200410016827 CN1668025A (en) | 2004-03-10 | 2004-03-10 | Data, voice and video merged multi-code rate coding-decoding and isochronous transmission method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1668025A true CN1668025A (en) | 2005-09-14 |
Family
ID=35038909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200410016827 Pending CN1668025A (en) | 2004-03-10 | 2004-03-10 | Data, voice and video merged multi-code rate coding-decoding and isochronous transmission method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1668025A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102118618A (en) * | 2011-03-30 | 2011-07-06 | 北京世纪鼎点软件有限公司 | Method for realizing H.264 multi-code-rate video stream based on PAFF |
| CN101378545B (en) * | 2007-08-28 | 2012-07-18 | 中兴通讯股份有限公司 | Layered transmission method for multimedia broadcast and multicast business |
| CN106162040A (en) * | 2015-03-30 | 2016-11-23 | 北京视联动力国际信息技术有限公司 | The method and apparatus that video conference accesses in many ways |
| CN110912608A (en) * | 2019-11-29 | 2020-03-24 | 南昌航空大学 | Single LED-based visible light real-time voice image communication coding system and method |
-
2004
- 2004-03-10 CN CN 200410016827 patent/CN1668025A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101378545B (en) * | 2007-08-28 | 2012-07-18 | 中兴通讯股份有限公司 | Layered transmission method for multimedia broadcast and multicast business |
| CN102118618A (en) * | 2011-03-30 | 2011-07-06 | 北京世纪鼎点软件有限公司 | Method for realizing H.264 multi-code-rate video stream based on PAFF |
| CN102118618B (en) * | 2011-03-30 | 2012-10-31 | 北京世纪鼎点软件有限公司 | Method for realizing H.264 multi-code-rate video stream based on PAFF |
| CN106162040A (en) * | 2015-03-30 | 2016-11-23 | 北京视联动力国际信息技术有限公司 | The method and apparatus that video conference accesses in many ways |
| CN110912608A (en) * | 2019-11-29 | 2020-03-24 | 南昌航空大学 | Single LED-based visible light real-time voice image communication coding system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1146205C (en) | Method of encapsulation of data into transport packets of constant size | |
| CN1126344C (en) | Distributed internet protocol-based real-time multimedia streaming architecture | |
| CN1236620C (en) | Video frequency signal compressor and its compressing method | |
| CN102123297B (en) | System and method for digital multimedia broadcasting | |
| CA2615352C (en) | System and method for jitter buffer reduction in scalable coding | |
| JP2000514277A (en) | Method and apparatus for processing data from multiple sources | |
| KR20080092420A (en) | Backward-compatible aggregation of pictures in scalable video coding | |
| US8432937B2 (en) | System and method for recovering the decoding order of layered media in packet-based communication | |
| CN1764974A (en) | The storage medium of storage multi-medium data and the method and apparatus of multimedia rendering data | |
| CN1179870A (en) | Method and device for encoding, transferring and decoding non-PCM bitstream between digital versatile disc device and multi-channel reproduction apparatus | |
| CA2295148C (en) | Multimedia multiplexing method | |
| CN110224793B (en) | Self-adaptive FEC method based on media content | |
| US8300705B2 (en) | Method for generating and processing hierarchical PES packet for digital satellite broadcasting based on SVC video | |
| CN102498722A (en) | Distribution of mpeg-2 ts multiplexed multimedia stream with selection of elementary packets of the stream | |
| CN102067551A (en) | Media stream processing | |
| CN1832569A (en) | Conference television system and conference television implementing method | |
| CN1960328A (en) | Method for packaging real time stream of mobile multimedia broadcast | |
| CN1992901A (en) | Method and apparatus for transmitting and receiving basic image frames and additional optional frames | |
| CN1668025A (en) | Data, voice and video merged multi-code rate coding-decoding and isochronous transmission method thereof | |
| KR100841896B1 (en) | Method and device for encoding £Í£Ð£Å£Ç-4 video data | |
| CN1625161A (en) | Method and system of information playback in immediate communication | |
| Sun et al. | A coded-domain video combiner for multipoint continuous presence video conferencing | |
| KR101220175B1 (en) | Method for generating and processing hierarchical pes packet for digital satellite broadcasting based on svc video | |
| JP3859501B2 (en) | Multimedia communication device | |
| JP2002152181A (en) | Method and device for multimedia communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |