CN103428535A - Real-time video transmission method, real-time video transmission and synchronous playing method and system and sending unit for real-time video transmission method - Google Patents
Real-time video transmission method, real-time video transmission and synchronous playing method and system and sending unit for real-time video transmission method Download PDFInfo
- Publication number
- CN103428535A CN103428535A CN2013103353782A CN201310335378A CN103428535A CN 103428535 A CN103428535 A CN 103428535A CN 2013103353782 A CN2013103353782 A CN 2013103353782A CN 201310335378 A CN201310335378 A CN 201310335378A CN 103428535 A CN103428535 A CN 103428535A
- Authority
- CN
- China
- Prior art keywords
- image
- timestamp
- package
- sound
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a real-time video transmission method. The real-time video transmission method comprises S1, detecting the network transmission rate of a first network module, and determining an image packet compression ratio according to the network transmission rate; S2, compressing image data to generate image packets by the image packet compression ratio; S3, compressing sound data to generate sound packets by a preset sound packet compression ratio; S4, adding an image timestamp to each image packet and a sound timestamp to each sound packet, and storing the added image packets and the sound packets in a first cache; S5, sending the image packets and the sound packets in the first cache to the Internet by the transmission control protocol (TCP). The invention further discloses a sending unit for operating the real-time video transmission method, a real-time video transmission and synchronous playing method and system.
Description
Technical field
The present invention relates to a kind of real-time audio-video transmission and transmission and synchronous broadcast method, system and transmitting element thereof.
Background technology
The fast development of the Internet brings people more audiovisual experience, due to factors such as use amount and hardware, network bandwidth produces height in time to be changed, therefore when transmitting and play real-time audio-video simultaneously, there will be the nonsynchronous phenomenon of signal of video signal and voice signal, affect result of broadcast.
Summary of the invention
For addressing the above problem, the technical scheme that the present invention adopts is:
A kind of transmitting element is provided, comprises: the first buffer memory; The first network module; The transmission rate detection module, for detection of the network transmission speed of first network module, and determine described image package compression ratio according to described network transmission speed; The image compression module, for generating the image package with described image package compression ratio compressing image data; The sound compression module, for generating the sound package to preset sound package compression ratio compression sound data; The timestamp module, be used to each image package filling image timestamp and be each sound package filling sound timestamp, and deposit image package and sound package after filling in first buffer memory; And the first network module, for Transmission Control Protocol, the image package of the first buffer memory and sound package being sent to the Internet.
Another technical solution used in the present invention is:
A kind of real-time audio-video transmission method is provided, runs in the described transmitting element of claim, comprise step: the network transmission speed of S1, detection first network module, and determine described image package compression ratio according to described network transmission speed; S2, with described image package compression ratio compressing image data, generate the image package; S3, to preset sound package compression ratio compression sound data, generate the sound package; S4, be each image package filling image timestamp and be each sound package filling sound timestamp, and deposit image package and sound package after filling in first buffer memory; S5, with Transmission Control Protocol, the image package in the first buffer memory and sound package are sent to the Internet.
Another technical solution used in the present invention is:
The transmission of a kind of real-time audio-video and synchronous playing system are provided, comprise broadcast unit and described transmitting element, described broadcast unit is for obtaining described image package and sound package and decompress(ion) contract playing video data and voice data by the Internet.
Another technical solution used in the present invention is:
A kind of real-time audio-video transmission and synchronous broadcast method are provided, run in described real-time audio-video transmission and Play System, comprise described real-time audio-video transmission method step, also comprise real-time audio-video synchronous broadcast method step, described real-time audio-video synchronous broadcast method step specifically comprises: S6, receive described image package and sound package from the Internet with Transmission Control Protocol, according to image timestamp ordering image package and input the second buffer memory, according to sound timestamp ordering sound package and input the second buffer memory; S7, the image package after sequence and sound package are decompressed and obtain image data and voice data; Voice data and image data after S8, broadcasting decompress.
Real-time audio-video transmission of the present invention and transmission and synchronous broadcast method, system and transmitting element thereof, transmitting element is by detecting and determine image package compression ratio according to the network transfer speeds of first network module, realize that, when network bandwidth produces the height variation in time, the signal of video signal of real-time audio-video transmission is synchronizeed with voice signal.Broadcast unit is according to the timestamp of the voice data of current and next decompression, search respectively the first image timestamp and the second image timestamp, and all image datas between obtaining, then all image datas of playing described current voice data and finding, thereby the synchronous broadcasting of time real-time audio-video.
The accompanying drawing explanation
Fig. 1 is the system architecture diagram of the transmission of a kind of real-time audio-video and synchronous playing system in an embodiment of the present invention;
Fig. 2 is the structured flowchart of a kind of transmitting element in an embodiment of the present invention;
Fig. 3 is the structured flowchart of broadcast unit in an embodiment of the present invention;
Fig. 4 is playing module structured flowchart in the first embodiment in Fig. 3;
Fig. 5 is the structured flowchart of playing module in the second execution mode in Fig. 3;
Fig. 6 is the flowchart of a kind of real-time audio-video transmission method in an embodiment of the present invention;
Fig. 7 is the flowchart of a kind of real-time audio-video synchronous broadcast method in an embodiment of the present invention.
The main element symbol description
Real-time audio-video transmission and synchronous playing system 100; Transmitting element 10; Broadcast unit 20; The first buffer memory 11; First network module 12; Image compression module 13; Sound compression module 14; Timestamp module 15; Transmission rate detection module 16; The second buffer memory 21; Second network module 22; The first order module 23; The second order module 24; Decompression module 25; Playing module 26; Voice data acquisition module 261; Image data acquisition module 262; The first playing module 263; The second playing module 264; Conversion submodule 2641; Play submodule 2642; M3U8 buffer memory 2643.
Embodiment
By describing technology contents of the present invention, structural feature in detail, being realized purpose and effect, below in conjunction with execution mode and coordinate accompanying drawing to be explained in detail.
Referring to Fig. 1, is the system architecture diagram of the transmission of a kind of real-time audio-video and synchronous playing system in an embodiment of the present invention.This real-time audio-video transmission comprises transmitting element 10 and the broadcast unit 20 communicated to connect with transmitting element 10 with synchronous playing system 100.
Referring to Fig. 2, is the structured flowchart of a kind of transmitting element in an embodiment of the present invention.Described transmitting element 10 comprises the first buffer memory 11, first network module 12, image compression module 13, sound compression module 14, timestamp module 15, transmission rate detection module 16.
Transmission rate detection module 16 is for detection of the network transmission speed that detects first network module 12, and determines described image package compression ratio according to the growth and decline of the first buffer memory 11.
Particularly, under proper network, for example frequency range is greater than 200Kbs, image package compression ratio is at least 5～6 times of sound package compression ratio, if use 32K sound package compression ratio compression sound data, be 32 packages of per second compression, image package compression ratio is at least 168K, and per second at least compresses 160 image packages.
When abnormal network, for example frequency range is less than 200Kbs, image compression (H.264) can reduce packed data as possible, but a limit is arranged, when the limit arrives, transmitting element can abandon the image package until frequency range has dropped to link voice while all no matter transmitting, if now network bandwidth can't recover can break within the time of (TTL).
Referring to Fig. 3, is the structured flowchart of broadcast unit in an embodiment of the present invention.Described broadcast unit 20 comprises the second buffer memory 21, second network module 22, the first order module 23, the second order module 24, decompression module 25, playing module 26.
The first order module 23 is for foundation image timestamp ordering image package and input the second buffer memory 21.
The second order module 24 is for foundation sound timestamp ordering sound package and input the second buffer memory 21.
Referring to Fig. 4, is playing module structured flowchart in the first embodiment in Fig. 3.In the first embodiment, described broadcast unit 20 is based on windows system or Android system, and described broadcast unit 20 is play video-audio data with the uncorrected data form.
Described playing module 26 comprises voice data acquisition module 261, image data acquisition module 262 and the first playing module 263.
Voice data acquisition module 261 is for obtaining current voice data.
Image data acquisition module 262 is for searching and immediate the first image timestamp of the sound timestamp of described current voice data, and with immediate the second image timestamp of the sound timestamp of next sound package, and obtain all image datas between the first image timestamp and the second image timestamp from the second buffer memory 21.
The first playing module 263 is for play all image datas between described current voice data and described the first image timestamp and the second image timestamp simultaneously.
Referring to Fig. 5, is the structured flowchart of playing module in the second execution mode in Fig. 3.In the second execution mode, different from the first execution mode, described broadcast unit 20 does not comprise the first playing module 263, and comprises the second playing module 264.Described broadcast unit 20, based on the ios system, is play video-audio data with document form.
Described the second playing module 264 comprises conversion submodule 2641, plays submodule 2642 and M3U8 buffer memory 2643.
Play submodule 2642 for the M3U8 file that reads M3U8 buffer memory 2643 and play image data and the voice data in the M3U8 file.
Next set forth a kind of real-time audio-video transmission provided by the invention and synchronous broadcast method, in the method operation and the transmission of described real-time audio-video and synchronous playing system.This real-time audio-video transmission comprises following two parts with synchronous broadcast method, and first is the real-time audio-video transmission method that runs on transmitting element, and second portion is the real-time audio-video synchronous broadcast method that runs on broadcast unit.
Referring to Fig. 6, is the flowchart of a kind of real-time audio-video transmission method in an embodiment of the present invention.The method runs in described transmitting element 10, comprises step:
Step S1, transmitting element detect the network transmission speed of first network module, and determine described image package compression ratio according to described network transmission speed;
Step S2, transmitting element generate the image package with described image package compression ratio compressing image data;
Step S3, transmitting element generate the sound package to preset sound package compression ratio compression sound data, and particularly, described default sound package compression ratio is 16kbps, 24kbps or 32kbps;
Step S4, transmitting element are each image package filling image timestamp and are each sound package filling sound timestamp, and deposit image package and sound package after filling in first buffer memory;
The first network module of step S5, transmitting element is sent to the Internet with Transmission Control Protocol by the image package in the first buffer memory and sound package.
Referring to Fig. 7, is the flowchart of a kind of real-time audio-video synchronous broadcast method in an embodiment of the present invention.The method runs in described broadcast unit 20, comprises step:
Step S6, broadcast unit receive described image package and sound package from the Internet with Transmission Control Protocol, according to image timestamp ordering image package and input the second buffer memory, according to sound timestamp ordering sound package and input the second buffer memory;
Image package after to sequence of step S7, broadcast unit and sound package decompress and obtain image data and voice data;
Step S8, broadcast unit are play voice data and image data after decompressing.
Wherein, in the first embodiment, described broadcast unit 20 is based on windows system or Android system, and described broadcast unit 20 is play video-audio data with the uncorrected data form, and now described step S8 specifically comprises the steps:
Step S81, obtain current voice data;
Step S82, search and immediate the first image timestamp of the sound timestamp of described current voice data, and with immediate the second image timestamp of the sound timestamp of next sound package, and obtain all image datas between the first image timestamp and the second image timestamp from the second buffer memory;
Step S83, play all image datas between described current voice data and described the first image timestamp and the second image timestamp simultaneously.
In the second execution mode, different from the first execution mode, described broadcast unit 20, based on the ios system, is play video-audio data with document form, and now described step S8 specifically comprises the steps:
Step S91, obtain current voice data;
Step S92, search and immediate the first image timestamp of the sound timestamp of described current voice data, and with immediate the second image timestamp of the sound timestamp of next sound package, and obtain all image datas between the first image timestamp and the second image timestamp from the second buffer memory;
Step S93, image data stacks all between the current voice data that obtains and the first image timestamp and the second image timestamp is converted to the M3U8 formatted file of TS stream, and deposits the M3U8 formatted file in the M3U8 buffer memory.
Step S94, read the M3U8 file in the M3U8 buffer memory and play image data and the voice data in the M3U8 file.
Real-time audio-video transmission of the present invention and transmission and synchronous broadcast method, system and transmitting element thereof, transmitting element is by detecting and determine image package compression ratio according to the network transfer speeds of first network module, realize that, when network bandwidth produces the height variation in time, the signal that affects of real-time audio-video transmission is synchronizeed with voice signal.Broadcast unit is according to the timestamp of the voice data of current and next decompression, search respectively the first image timestamp and the second image timestamp, and all image datas between obtaining, then all image datas of playing described current voice data and finding, thereby the synchronous broadcasting of time real-time audio-video.
The foregoing is only embodiments of the invention; not thereby limit the scope of the claims of the present invention; every equivalent structure or conversion of equivalent flow process that utilizes specification of the present invention and accompanying drawing content to do; or directly or indirectly be used in other relevant technical fields, all in like manner be included in scope of patent protection of the present invention.
Claims (9)
1. a transmitting element, is characterized in that, comprising:
The first buffer memory;
The first network module;
The transmission rate detection module, for detection of the network transmission speed of first network module, and determine described image package compression ratio according to described network transmission speed;
The image compression module, for generating the image package with described image package compression ratio compressing image data;
The sound compression module, for generating the sound package to preset sound package compression ratio compression sound data;
The timestamp module, be used to each image package filling image timestamp and be each sound package filling sound timestamp, and deposit image package and sound package after filling in first buffer memory; And
The first network module, for being sent to the Internet with Transmission Control Protocol by the image package of the first buffer memory and sound package.
2. a real-time audio-video transmission method, run in transmitting element claimed in claim 1, comprises step:
The network transmission speed of S1, detection first network module, and determine described image package compression ratio according to described network transmission speed;
S2, with described image package compression ratio compressing image data, generate the image package;
S3, to preset sound package compression ratio compression sound data, generate the sound package;
S4, be each image package filling image timestamp and be each sound package filling sound timestamp, and deposit image package and sound package after filling in first buffer memory;
S5, with Transmission Control Protocol, the image package in the first buffer memory and sound package are sent to the Internet.
3. a real-time audio-video transmits and synchronous playing system, it is characterized in that, comprise the described transmitting element of broadcast unit and claim 1, described broadcast unit is for obtaining described image package and sound package and decompress(ion) contract playing video data and voice data by the Internet.
4. a kind of real-time audio-video transmission according to claim 3 and synchronous playing system, is characterized in that, described broadcast unit comprises:
The second buffer memory;
The second network module, for receiving described image package and sound package from the Internet with Transmission Control Protocol;
The first order module, for foundation image timestamp ordering image package and input the second buffer memory;
The second order module, for foundation sound timestamp ordering sound package and input the second buffer memory;
Decompression module, decompress and obtain image data and voice data for the image package to after sequence and sound package;
Playing module, for playing voice data and the image data after decompression.
5. a kind of real-time audio-video transmission according to claim 4 and synchronous playing system, is characterized in that, described playing module comprises:
The voice data acquisition module, for obtaining voice data from the second buffer memory;
The image data acquisition module, for searching and immediate the first image timestamp of the sound timestamp of described current voice data, and with immediate the second image timestamp of the sound timestamp of next sound package, and obtain all image datas between the first image timestamp and the second image timestamp from the second buffer memory;
The first playing module, for play all image datas between described current voice data and described the first image timestamp and the second image timestamp simultaneously.
6. a kind of real-time audio-video transmission according to claim 4 and synchronous playing system, is characterized in that,
Described playing module comprises voice data acquisition module, image data acquisition module and the second playing module;
The voice data acquisition module is for obtaining voice data from the second buffer memory;
The image data acquisition module is for searching and immediate the first image timestamp of the sound timestamp of described current voice data, and with immediate the second image timestamp of the sound timestamp of next sound package, and obtain all image datas between the first image timestamp and the second image timestamp from the second buffer memory;
The second playing module comprises:
The conversion submodule, be converted to the M3U8 formatted file of TS stream for image data stacks all between the current voice data by obtaining and the first image timestamp and the second image timestamp, and deposit the M3U8 formatted file in the M3U8 buffer memory;
Play submodule, for the M3U8 file that reads the M3U8 buffer memory and play image data and the voice data in the M3U8 file.
7. a real-time audio-video transmits and synchronous broadcast method, run in the described real-time audio-video transmission of claim 3-6 any one and Play System, it is characterized in that, comprise the described real-time audio-video transmission method of claim 2 step, also comprise real-time audio-video synchronous broadcast method step, described real-time audio-video synchronous broadcast method step specifically comprises:
S6, receive described image package and sound package from the Internet with Transmission Control Protocol, according to image timestamp ordering image package and input the second buffer memory, according to sound timestamp ordering sound package and input the second buffer memory;
S7, the image package after sequence and sound package are decompressed and obtain image data and voice data;
Voice data and image data after S8, broadcasting decompress.
8. a kind of real-time audio-video transmission according to claim 7 and synchronous broadcast method, is characterized in that, described step S8 specifically comprises the steps:
S81, obtain current voice data;
S82, search and immediate the first image timestamp of the sound timestamp of described current voice data, and with immediate the second image timestamp of the sound timestamp of next sound package, and obtain all image datas between the first image timestamp and the second image timestamp from the second buffer memory;
S83, play all image datas between described current voice data and described the first image timestamp and the second image timestamp simultaneously.
9. a kind of real-time audio-video transmission according to claim 7 and synchronous broadcast method, is characterized in that, described step S8 specifically comprises the steps:
S91, obtain current voice data;
Step S92, search and immediate the first image timestamp of the sound timestamp of described current voice data, and with immediate the second image timestamp of the sound timestamp of next sound package, and obtain all image datas between the first image timestamp and the second image timestamp from the second buffer memory;
S93, image data stacks all between the current voice data that obtains and the first image timestamp and the second image timestamp is converted to the M3U8 formatted file of TS stream, and deposits the M3U8 formatted file in the M3U8 buffer memory;
S94, read the M3U8 file in the M3U8 buffer memory and play image data and the voice data in the M3U8 file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310335378.2A CN103428535B (en) | 2013-08-02 | Real-time audio-video transmits and transmits and synchronous broadcast method, system and transmitting element thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310335378.2A CN103428535B (en) | 2013-08-02 | Real-time audio-video transmits and transmits and synchronous broadcast method, system and transmitting element thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103428535A true CN103428535A (en) | 2013-12-04 |
| CN103428535B CN103428535B (en) | 2016-11-30 |
Family
ID=
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105323533A (en) * | 2014-07-04 | 2016-02-10 | 和硕联合科技股份有限公司 | Video conference method and system |
| CN106453306A (en) * | 2016-10-08 | 2017-02-22 | 广东欧珀移动通信有限公司 | Media data transmission synchronous method, device and system |
| CN109067434A (en) * | 2018-09-18 | 2018-12-21 | 同响科技股份有限公司 | Via the synchronization Public Address System of power line transmission digital audio-frequency data |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101466044A (en) * | 2007-12-19 | 2009-06-24 | 康佳集团股份有限公司 | Method and system for synchronously playing stream medium audio and video |
| CN102364952A (en) * | 2011-10-25 | 2012-02-29 | 浙江万朋网络技术有限公司 | Method for processing audio and video synchronization in simultaneous playing of a plurality of paths of audio and video |
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101466044A (en) * | 2007-12-19 | 2009-06-24 | 康佳集团股份有限公司 | Method and system for synchronously playing stream medium audio and video |
| CN102364952A (en) * | 2011-10-25 | 2012-02-29 | 浙江万朋网络技术有限公司 | Method for processing audio and video synchronization in simultaneous playing of a plurality of paths of audio and video |
Non-Patent Citations (2)
| Title |
|---|
| 刘高平: "自适应网络带宽的H.264视频流传输控制方法", 《浙江大学学报(工学版)》, vol. 46, no. 12, 31 December 2012 (2012-12-31) * |
| 方立华: "一种网络监控***中音视频同步的方法", 《网络与多媒体》, vol. 36, no. 01, 31 January 2012 (2012-01-31) * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105323533A (en) * | 2014-07-04 | 2016-02-10 | 和硕联合科技股份有限公司 | Video conference method and system |
| CN106453306A (en) * | 2016-10-08 | 2017-02-22 | 广东欧珀移动通信有限公司 | Media data transmission synchronous method, device and system |
| CN109067434A (en) * | 2018-09-18 | 2018-12-21 | 同响科技股份有限公司 | Via the synchronization Public Address System of power line transmission digital audio-frequency data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7260687B2 (en) | Transmission method and transmission device | |
| CN102256162B (en) | Method and system for optimizing media-on-demand based on real-time file format conversion | |
| CN105916058B (en) | A kind of streaming media buffer playback method, device and display equipment | |
| CA3122639C (en) | Method and apparatus for transmitting media data in multimedia transport system | |
| EP3518486B1 (en) | Data transmission method and apparatus, and electronic device | |
| KR102301333B1 (en) | Method and apparatus for streaming dash content over broadcast channels | |
| US9967582B2 (en) | Hybrid delivery method and reception method for MMT packaged SVC video contents | |
| JP2019193311A (en) | Reception method | |
| CN102868939A (en) | Method for synchronizing audio/video data in real-time video monitoring system | |
| CN102740125B (en) | System and method for playing streaming media | |
| CN106657143A (en) | Streaming media transmission method and device, server and terminal | |
| EP2822274A1 (en) | Method for converting online media data or playing video and apparatus thereof | |
| CN105009595A (en) | Transmission apparatus, transmission method, reception apparatus and reception method | |
| CN107223334B (en) | Method and apparatus for converting an MMTP stream to MPEG-2TS | |
| JP5587779B2 (en) | Apparatus and method for storing and reading a file having a media data container and a metadata container | |
| CN101951387A (en) | Method and device for transmitting stream media | |
| JP6724782B2 (en) | Transmission device, transmission method, reception device, and reception method | |
| KR20050106288A (en) | Network i/f card for supporting multi-streaming format and method thereof | |
| WO2021093608A1 (en) | Method and apparatus for video data processing, electronic device, and computer-readable medium | |
| CN103428527A (en) | Real-time data source media stream transformation method and breakpoint switching play method | |
| CN102075817A (en) | Method and system for forwarding audio and video data | |
| CN101916219A (en) | Streaming media display platform of on-chip multi-core network processor | |
| CN103227802B (en) | Based on many metadata transmission methods of UDP/TCP agreement | |
| CN102905174A (en) | Sharing method of transport stream | |
| CN103428535A (en) | Real-time video transmission method, real-time video transmission and synchronous playing method and system and sending unit for real-time video transmission method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20201120 Address after: 16L, main building, new Baohui building, Nanhai Avenue, Nanshan street, Nanshan District, Shenzhen City, Guangdong Province Patentee after: Shenzhen hangruixin Technology Co., Ltd Address before: 6 / F 16 / F, 872 Zhongzheng Road, Zhonghe District, Xinbei City, Taiwan, China Patentee before: FURTHER TECH Co.,Ltd. |