CN103856787A - Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network - Google Patents

Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network Download PDF

Info

Publication number
CN103856787A
CN103856787A CN201210511265.9A CN201210511265A CN103856787A CN 103856787 A CN103856787 A CN 103856787A CN 201210511265 A CN201210511265 A CN 201210511265A CN 103856787 A CN103856787 A CN 103856787A
Authority
CN
China
Prior art keywords
video
audio
server end
client
public network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210511265.9A
Other languages
Chinese (zh)
Other versions
CN103856787B (en
Inventor
陈璟远
范艳华
苏浩翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHANGHAI WENGUANG TECHNOLOGY (GROUP) CO LTD
Original Assignee
SHANGHAI WENGUANG TECHNOLOGY (GROUP) CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI WENGUANG TECHNOLOGY (GROUP) CO LTD filed Critical SHANGHAI WENGUANG TECHNOLOGY (GROUP) CO LTD
Priority to CN201210511265.9A priority Critical patent/CN103856787B/en
Publication of CN103856787A publication Critical patent/CN103856787A/en
Application granted granted Critical
Publication of CN103856787B publication Critical patent/CN103856787B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a commentary video passing-back live system based on the public network. The commentary video passing-back live system is of a C/S structure and comprises a server terminal and a client terminal, and the server terminal is connected with the client terminal through the public network. The server terminal is composed of a video encoder, a receiving-transmitting server and an audio/video synthesizer, the video encoder is respectively connected with the receiving-transmitting server and the audio/video synthesizer to convert original high-code-rate video SDI signals into low-code-rate IP data flow suitable for network transmission to enable the low-code-rate IP data flow to be output, the receiving-transmitting server is connected with the video encoder and the audio/video synthesizer to serve as a communication interface of the server terminal and the client terminal, and the audio/video synthesizer synthesizes original high-code-rate video data and commentary passing-back audio data and then carries out output. The client terminal is provided with an audio input device and a screen. According to the commentary video passing-back live system, a commentator can carry out commentary in the place with the network, the proper video code rate is automatically selected according to the network condition, and the optimal watching effect is achieved; live delay is controlled within the minimum range, it is guaranteed that finally-output audios and finally-output videos are synchronous, and the broadcast quality standard is met.

Description

Explain orally live broadcast system and the live broadcasting method thereof of audio return based on the band of public network
Technical field
The present invention relates to a kind of live broadcast system, be specifically related to a kind of live broadcast system and live broadcasting method thereof of the explanation of the band based on public network audio return.
Background technology
Along with wired and high speed development wireless broadband network technology, people can obtain quickly and efficiently by the Internet the information of video/audio, so Streaming Media arises at the historic moment, have met user's demand to high-quality multimedia messages on the internet.Broadcast application than traditional media, Streaming Media has more flexibly, more diversified application model, can meet different users and experience.Just because of the great potential that stream media technology possesses, it is online that it will be widely used in multimedia news, the network information service such as live, video request program, long-distance education.
Take traditional sports event live broadcast as example, its main its form be divided into on-the-spot broadcasting and studio talk-show live, this just necessarily requires to explain orally watches that on the limit, place of specifying the limit of competing explains orally.This situation is all harsher to the requirement of the side of explanation or the side of broadcast, and the first explanation must be on the scene; The second live cost is higher.If can accomplish now no matter where explain orally to be in can watch and compete and explain orally, this,, by being one innovation to traditional live game coverage, may breed the live-mode making new advances afterwards so, and for example ordinary people is in just can realize the explanation dream of oneself.
In order to realize above-mentioned functions requirement, now, the transmission of signal can only be by network flow-medium.Though nowadays Internet video client software is on the market not within minority, because this type of software all only supports that one-side transfer of data is that service end sends media data to client, cannot meet above-mentioned demand, and cost is high, efficiency is low, length consuming time.
In view of the above problems, the invention discloses a kind of live broadcast system and live broadcasting method thereof of the explanation of the band based on public network audio return.It has technical characterictic as mentioned below, to solve existing problem.
Summary of the invention
The object of this invention is to provide live broadcast system and live broadcasting method thereof that a kind of band based on public network explains orally audio return, it can receive raw video signal from network by client, and gather the audio return explaining orally to server end, output after video and audio is synthetic, assurance simultaneously reaches the live standard of broadcast level.
The band explanation live broadcast system of audio return and the object of live broadcasting method thereof that the present invention is based on public network are achieved through the following technical solutions: a kind of band based on public network explains orally the live broadcast system of audio return, the live broadcast system that the described band based on public network explains orally audio return is C/S structure, comprising: server end and client two parts of being provided with TCP listening port; It is characterized in that, described server end is connected by public network with described client.
Described server end is made up of video encoder, transmitting/receiving server and audio frequency and video synthesizer; Described video encoder is connected with described transmitting/receiving server and audio frequency and video synthesizer respectively, the original high bit-rate video sdi signal of input is converted to the low code check IP traffic output that is applicable to Internet Transmission; Described transmitting/receiving server is used for connecting described video encoder and audio frequency and video synthesizer, and as described server end and the communication interface of client; Described audio frequency and video synthesizer is by output after synthetic to original high bit-rate video data and the voice data that explains orally passback.
Described client is PC, and is provided with audio input device and screen in described client.
The above-mentioned band based on public network explains orally the live broadcast system of audio return, wherein, in described audio frequency and video synthesizer, be provided with video cache region, the size in described video cache region remains unchanged, for judging the timestamp of video data and voice data, and the high bit-rate video of buffer memory.
The above-mentioned band based on public network explains orally the live broadcasting method of the live broadcast system of audio return, and wherein, the method at least comprises the following steps:
Step 1, described server end is opened TCP listening port, and circular wait is from the connection of described client, and described client sends connection request by ICP/IP protocol to described server end.
Server end has three kinds of situations: 1, without response; 2, linking number is full; 3, successful connection; Described server end, without connection, continues to wait for; Described server end judges the maximum number of connections that now server end reaches, and refuses this connection, if be less than successful connection of maximum number of connections if be greater than maximum number of connections.
Step 2, after described server end and client successful connection, described client obtain local network bandwidth and and server end between the network delay that exists, the data of network delay pass to audio frequency and video synthesizer by sending to transmitting/receiving server.
Step 3, after user selected channel, the channel that described client is selected user sends instructions to described server end, now described server end cannot initiatively send data to described client, server end according to the corresponding video encoder of the instruction unpack of client to select suitable output video code check.
Step 4, described client realizes existing NAT crossing technology, sends UDP burrow after information until client, sets up UDP interface channel set up with described server end, and described server end sends low code check IP traffic to described client.
Step 5, described client will output to screen after low code check IP traffic decoding.
Step 6, in the time that announcer prepares to start to explain orally, opens described audio input device, just can explain orally sound by audio input device collection, and the voice data collecting is dressed up TS audio pack through encode seal.
Step 7 is stamped timestamp information PTS on described client is described TS voice data.
The value of the timestamp information PTS ' of a certain frame video pictures that the value of the timestamp information PTS of the TS voice data described in first can be seen at that time according to user is determined, i.e. the PTS of the first frame TS audio pack 0=PTS ', the timestamp information PTS of TS voice data afterwards nkeep increasing continuously.The value of PTS ' should keep strict conformance with original high bit-rate video timestamp information.
Step 8, passes back to described server end by complete TS audio pack by UDP interface channel.
The transmission of TS audio pack synchronous transmission in two new thread in the transmission of low code check IP traffic and step 8 in described step 4.
Step 9, described audio frequency and video synthesizer is by synthetic to the high bit-rate video of receiving and TS voice data, and circulation successively, until treat after live end that described client disconnects.
Under normal circumstances,, in the situation without time delay, audio frequency and video synthesizer on average interweaves complete TS audio pack in high bit-rate video.
The in the situation that of time delay, the discreet value of described server end computation delay, if the program constant time lag at described server end and described client two places is t, the network delay of described server end and described client is T, discreet value is T+t, this discreet value is also the minimum time delay of live broadcast system simultaneously, is also time delay minimum in existing similar technology.
The time span t ' corresponding to high bit-rate video of described video cache region buffer memory is described live broadcast system time delay T+t.
Losing synchronous in the situation that, when the high bit-rate video of receiving exceedes after the size in video cache region, when high bit-rate video data are not also received corresponding with it TS voice data, think and there is no TS voice data, in the corresponding frame of high bit-rate video data of output, insert quiet bag and guarantee that vision signal broadcasts normally; In audio reception bag, need to judge that the high bit-rate video whether this TS voice data has lagged behind at that time broadcasts progress by timestamp information afterwards, abandon without exception these data if fall behind, until the timestamp of TS voice data is caught up with the now timestamp of high bit-rate video, as the output that interweaves of TS voice data in the situation without time delay and original high bit-rate video.
The band that the present invention is based on public network explains orally the live broadcast system of audio return and live broadcasting method thereof owing to having adopted such scheme, makes it compared with prior art, has following advantage and good effect:
1, the band that the present invention is based on public network explains orally the live broadcast system of audio return can make announcer where no matter be in, as long as conveniently can explain orally on the ground that has network, and can automatically select suitable video code rate according to the on-site network condition of announcer, reach the best effect of watching.
2, the band that the present invention is based on public network explains orally in the live broadcasting method of live broadcast system of audio return and has adopted the processing method in time delay situation, can make live time delay be controlled in minimum scope, is time delay minimum in existing similar technology; Adopt the processing method in lock-out situation, guaranteed the synchronous and stable of final output signal audio frequency and video, reached the standard of broadcast level.
Below, will be described further by specific embodiment, but embodiment is only giving an example of alternative embodiment of the present invention, its disclosed feature is only for illustrating and set forth technical scheme of the present invention, the protection range being not intended to limit the present invention.
Accompanying drawing explanation
For a better understanding of the present invention, the accompanying drawing for reference that can quote with reference to this specification, in accompanying drawing:
Fig. 1 is the structural representation that the present invention is based on the live broadcast system of the band explanation audio return of public network.
Fig. 2 is the flow chart that the present invention is based on the live broadcasting method of the live broadcast system of the band explanation audio return of public network.
Fig. 3 is the decomposition process figure that the present invention is based on the server end of the live broadcasting method of the live broadcast system of the band explanation audio return of public network.
Fig. 4 is the decomposition process figure that the present invention is based on the client of the live broadcasting method of the live broadcast system of the band explanation audio return of public network.
Fig. 5 is the TS audio pack packing flow chart that the present invention is based on the live broadcast system of the band explanation audio return of public network.
Fig. 6 is sound, the video frame structure figure that the present invention is based on the live broadcast system of the band explanation audio return of public network.
Fig. 7 is the TS audio pack of the band that the present invention is based on public network weave in that explains orally the audio frequency and video synthesizer output of the live broadcast system of audio return and the frame structure schematic diagram of original high bit-rate video.
Fig. 8 is that the band that the present invention is based on public network explains orally the TS audio pack of the weave in of audio frequency and video synthesizer output after the live broadcast system time delay of audio return and the frame structure schematic diagram of original high bit-rate video.
Fig. 9 is the TS audio pack of the band that the present invention is based on public network weave in of audio frequency and video synthesizer output when explaining orally audio return live and being lock-out and the frame structure schematic diagram of original high bit-rate video.
 
Embodiment
According to claim of the present invention and the disclosed content of summary of the invention, described in technical scheme of the present invention is specific as follows.
Refer to shown in accompanying drawing 1, the band that the present invention is based on public network explains orally the live broadcast system employing C/S structure of audio return, comprises server end 1 and client 2 two parts of being provided with TCP listening port, and described server end 1 is connected by public network with described client 2; Described server end 1 is made up of video encoder 11, transmitting/receiving server 12 and audio frequency and video synthesizer 13; Described video encoder 11 is connected with described transmitting/receiving server 12 and audio frequency and video synthesizer 13 respectively, the original high bit-rate video sdi signal of input is converted to the low code check IP traffic output that is applicable to Internet Transmission; Described transmitting/receiving server 12 is for connecting described video encoder 11 and audio frequency and video synthesizer 13, and as the communication interface of described server end 1 and client 2; Described audio frequency and video synthesizer 13 is by output after synthetic to original high bit-rate video data and the voice data that explains orally passback; Described client 2 is PCs, and is provided with audio input device 21 and screen 22 in described client 2.
In described audio frequency and video synthesizer 13, be provided with video cache region 14, the size in described video cache region 14 remains unchanged, and judges the timestamp of video data and voice data, and the high bit-rate video of buffer memory; In the time that video cache region 14 is full, often receive the new high bit-rate video of a frame, just an output frame high bit-rate video of buffer memory the earliest.
Refer to accompanying drawing 2 to shown in accompanying drawing 5, the band that the present invention is based on public network explains orally the live broadcasting method of the live broadcast system of audio return, and this live broadcast system comprises server end 1 and client 2, and this live broadcasting method at least comprises the steps:
Step 1, described server end 1 is opened TCP listening port, and circular wait is from the connection of described client 2, and described client 2 sends connection request by ICP/IP protocol to described server end 1.
Now have three kinds of situations: 1, without response; 2, linking number is full; 3, successful connection.Described server end 1, without connecting, continues to wait for; Described server end 1 judges the maximum number of connections that now server end 1 reaches, and refuses this connection, if be less than successful connection of maximum number of connections if be greater than maximum number of connections.
Step 2, after described server end 1 and client 2 successful connections, described client 2 obtain local network bandwidth and and server end 1 between exist network delay, the data of network delay pass to audio frequency and video synthesizer 13 by sending to transmitting/receiving server 12.
Network delay can as after final signal output time delay and TS audio pack and original high bit-rate video synchronous according to sending to described server end 1.
Step 3, after user selected channel, the channel that described client 2 is selected user sends instructions to described server end 1, now described server end 1 cannot initiatively send data to described client 2, server end 1 to select suitable output video code check, has guaranteed that client 2 reaches best result of broadcast according to the corresponding video encoder 11 of the instruction unpack of client 2.
The output format of described video encoder 11 is TS H.264, and bit rate output is determined according to the network bandwidth at client 2 places.
Step 4, described client 2 realizes existing network address translation (Network Address Translation, be called for short NAT) pass through, sending User Datagram Protoco (UDP) (being called for short UDP) until client 2 burrows after information, set up User Datagram Protoco (UDP) (being called for short UDP) interface channel with described server end 1 and set up, described server end 1 sends low code check IP traffic to described client 2.
Step 5, described client 2 will output to screen 22 after low code check IP traffic decoding.
Step 6, in the time that announcer prepares to start to explain orally, opens described audio input device 21, just can be gathered and be explained orally sound by audio input device 21, and the voice data collecting is dressed up TS audio pack through encode seal.
Step 7 in order to guarantee the TS voice data of final output and synchronizeing of original high bit-rate video, is stamped timestamp information PTS on described client 2 is described TS voice data.
Refer to shown in accompanying drawing 6, the value of the timestamp information PTS ' of a certain frame video pictures that the value of the timestamp information PTS of the TS voice data described in first can be seen at that time according to user is determined, i.e. the PTS of the first frame TS audio pack 0=PTS ', the timestamp information PTS of TS voice data afterwards nkeep increasing continuously.The value of PTS ' should keep strict conformance with original high bit-rate video timestamp information.
The input video stream signal of audio frequency and video synthesizer 13 is the high bit-rate video stream through time delay, and strict being consistent of time stamp signal of the low code check IP traffic that the timestamp information of this high bit-rate video must be received with client 2 just can complete final synchronizeing.The timestamp information of wrapping according to the TS voice data of passback, just can be by average TS packets of audio data interweaving in original high bit-rate video flow data, thereby reach the synchronous of sound picture, explain orally to start recording point be exactly that frame picture that he sees at that time.
Step 8, passes back to described server end 1 by complete TS audio pack by UDP interface channel.
The transmission of TS audio pack synchronous transmission in two new thread in the transmission of low code check IP traffic and step 8 in described step 4.
Step 9, described audio frequency and video synthesizer 13 is by synthetic to the high bit-rate video of receiving and TS voice data, and circulation successively, until treat after live end that described client 2 disconnects.
Refer to shown in accompanying drawing 7, under normal circumstances,, in the situation without time delay, audio frequency and video synthesizer 13 on average interweaves complete TS audio pack in high bit-rate video.
Because voice data is based on public network transmission, so just exist various uncertain factors, so being carried out to buffer memory, original video data is extremely necessary.But the magnitude relationship of buffer memory has arrived live delay time size, buffer memory is crossed conference and is caused live time delay excessive; Thereby buffer memory is too small can be there is in the time that network delay is excessive Audio and Video timestamp and cannot align and cause broadcasting always.The in the situation that of time delay, the discreet value of described server end 1 computation delay, if described server end 1 is t with described 2 liang of program constant time lags of locating of client, described server end 1 is T with the network delay of described client 2, discreet value is T+t, this discreet value is also the minimum time delay of live broadcast system of the present invention simultaneously, is also time delay minimum in existing similar technology.But discreet value meeting is shaken when practice, so live time delay should leave certain surplus capacity, live smoothness could effectively be controlled so stable.
The time span t ' corresponding to high bit-rate video of described video cache region 14 buffer memorys is described live broadcast system time delay T+t.
When after T=delay threshold T ', be that video cache region 14 is when full, the new video data of a frame is often received in video cache region 14, and the just output frame video data of buffer memory the earliest from video cache region 14, to keep the size in video cache region 14 constant; Judge the timestamp PTS of audio frequency and video simultaneously, TS audio pack is inserted in video output streams after finding the corresponding TS audio pack of video.Such as, what video the second frame data were corresponding is the first frame data of audio frequency, audio frequency and video output stream is as shown in Figure 8 so.
Refer to shown in accompanying drawing 9, due to the uncertain factor of network, can there is the situation such as time delay, packet loss in UDP, do not deal with if run into this situation, and not predictable consequence will occur system, finally causes live signal abnormal.Such as, there is time delay in UDP, and the corresponding video data of voice data of now receiving is outwards output likely, there will be the asynchronous or picture of the sound picture phenomenons such as card of pausing if now do not process; Such as packet loss appears in network, this situation may directly cause the interruption of vision signal again.Above situation is all fatal in live, is also absolutely not to allow to occur.
Losing synchronous in the situation that, when the high bit-rate video of receiving exceedes after the size in video cache region 14, when high bit-rate video data are not also received corresponding with it TS voice data, think and there is no TS voice data, in the corresponding frame of high bit-rate video data of output, insert quiet bag and guarantee that vision signal broadcasts normally, in audio reception bag, need to judge that the high bit-rate video whether this TS voice data has lagged behind at that time broadcasts progress by timestamp information afterwards, abandon without exception these data if fallen behind, until the timestamp of TS voice data is caught up with the now timestamp of high bit-rate video, TS voice data and the original high bit-rate video output that interweaves as before subsequently.
In sum, the live broadcast system that the present invention is based on the band explanation audio return of public network can make announcer where no matter be in, as long as conveniently can explain orally on the ground that has network, and can automatically select suitable video code rate according to the on-site network condition of announcer, reach the best effect of watching; The band that the present invention is based on public network explains orally in the live broadcasting method of live broadcast system of audio return and has adopted the processing method in time delay situation, can make live time delay be controlled in minimum scope, is time delay minimum in existing similar technology; Adopt the processing method in lock-out situation, guaranteed the synchronous and stable of final output signal audio frequency and video, reached the standard of broadcast level.
Foregoing is that the band that the present invention is based on public network explains orally exemplifying of the live broadcast system of audio return and the specific embodiment of live broadcasting method thereof, for the wherein not equipment of detailed description and structure, should be understood to take the existing common apparatus in this area and universal method to be implemented.

Claims (10)

1. a live broadcast system that explains orally audio return based on the band of public network, the live broadcast system that the described band based on public network explains orally audio return is C/S structure, comprising: server end (1) and client (2) two parts of being provided with TCP listening port; It is characterized in that, described server end (1) is connected by public network with described client (2);
Described server end (1) is made up of video encoder (11), transmitting/receiving server (12) and audio frequency and video synthesizer (13); Described video encoder (11) is connected with described transmitting/receiving server (12) and audio frequency and video synthesizer (13) respectively, the original high bit-rate video sdi signal of input is converted to the low code check IP traffic output that is applicable to Internet Transmission; Described transmitting/receiving server (12) is for connecting described video encoder (11) and audio frequency and video synthesizer (13), and as the communication interface of described server end (1) and client (2); Described audio frequency and video synthesizer (13) is by output after synthetic to original high bit-rate video data and the voice data that explains orally passback;
Described client (2) is PC, and in described client (2), is provided with audio input device (21) and screen (22).
2. the band based on public network according to claim 1 explains orally the live broadcast system of audio return, it is characterized in that: in described audio frequency and video synthesizer (13), be provided with video cache region (14), the size in described video cache region (14) remains unchanged, for judging the timestamp of video data and voice data, and the high bit-rate video of buffer memory.
3. the band based on public network according to claim 1 explains orally the live broadcasting method of the live broadcast system of audio return, it is characterized in that: the method at least comprises the following steps:
Step 1, described server end (1) is opened TCP listening port, and circular wait is from the connection of described client (2), and described client (2) sends connection request by ICP/IP protocol to described server end (1);
Step 2, after described server end (1) and client (2) successful connection, described client (2) obtain local network bandwidth and and server end (1) between exist network delay, the data of network delay pass to audio frequency and video synthesizer (13) by sending to transmitting/receiving server (12);
Step 3, after user selected channel, the channel that described client (2) is selected user sends instructions to described server end (1), now described server end (1) cannot initiatively send data to described client (2), server end (1) according to the corresponding video encoder of instruction unpack (11) of client (2) to select suitable output video code check;
Step 4, described client (2) realizes NAT and passes through, send UDP until client (2) and burrow after information, set up UDP interface channel set up with described server end (1), described server end (1) sends low code check IP traffic to described client (2);
Step 5, described client (2) will output to screen (22) after low code check IP traffic decoding;
Step 6, in the time that announcer prepares to start to explain orally, opens described audio input device (21), just can pass through audio input device (21) collection and explain orally sound, and the voice data collecting is dressed up TS audio pack through encode seal;
Step 7, stamps timestamp information PTS in described client (2) on described TS voice data;
Step 8, passes back to described server end (1) by complete TS audio pack by UDP interface channel;
Step 9, described audio frequency and video synthesizer (13) is by synthetic to the high bit-rate video of receiving and TS voice data, and circulation successively, until treat after live end that described client (2) disconnects.
4. the band based on public network according to claim 3 explains orally the live broadcasting method of the live broadcast system of audio return, it is characterized in that: in described step 1, server end (1) has three kinds of situations: 1, without response; 2, linking number is full; 3, successful connection; If described server end (1) without connecting, continues to wait for; Described server end (1) judges the maximum number of connections that now server end (1) reaches, and refuses this connection, if be less than successful connection of maximum number of connections if be greater than maximum number of connections.
5. the band based on public network according to claim 3 explains orally the live broadcasting method of the live broadcast system of audio return, it is characterized in that: in described step 7, the value of the timestamp information PTS ' of a certain frame video pictures that the value of the timestamp information PTS of the TS voice data described in first can be seen at that time according to user is determined, i.e. the PTS of the first frame TS audio pack 0=PTS ', the timestamp information PTS of TS voice data afterwards nkeep increasing continuously; The value of PTS ' should keep strict conformance with original high bit-rate video timestamp information.
6. the band based on public network according to claim 3 explains orally the live broadcasting method of the live broadcast system of audio return, it is characterized in that: the transmission of TS audio pack synchronous transmission in two new thread in the transmission of low code check IP traffic and step 8 in described step 4.
7. the band based on public network according to claim 3 explains orally the live broadcasting method of the live broadcast system of audio return, it is characterized in that: in described step 9, under normal circumstances, in the situation without time delay, audio frequency and video synthesizer (13) on average interweaves complete TS audio pack in high bit-rate video.
8. the band based on public network according to claim 3 explains orally the live broadcasting method of the live broadcast system of audio return, it is characterized in that: in described step 9, the in the situation that of time delay, the discreet value of described server end (1) computation delay, if described server end (1) is t with the program constant time lag at described client (2) two places, described server end (1) is T with the network delay of described client (2), discreet value is T+t, and this discreet value is also the minimum time delay of live broadcast system simultaneously.
9. the live broadcasting method that explains orally the live broadcast system of audio return according to the band based on public network described in claim 2 or 8, is characterized in that: the time span t ' corresponding to high bit-rate video of described video cache region (14) buffer memory is described live broadcast system time delay T+t.
10. the band based on public network according to claim 3 explains orally the live broadcasting method of the live broadcast system of audio return, it is characterized in that: in described step 9, losing synchronous in the situation that, when the high bit-rate video of receiving exceedes after the size of video cache region (14), when high bit-rate video data are not also received corresponding with it TS voice data, think and there is no TS voice data, in the corresponding frame of high bit-rate video data of output, insert quiet bag and guarantee that vision signal broadcasts normally;
In audio reception bag, need to judge that the high bit-rate video whether this TS voice data has lagged behind at that time broadcasts progress by timestamp information afterwards, abandon without exception these data if fall behind, until the timestamp of TS voice data is caught up with the now timestamp of high bit-rate video, as the output that interweaves of TS voice data in the situation without time delay and original high bit-rate video.
CN201210511265.9A 2012-12-04 2012-12-04 Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network Active CN103856787B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210511265.9A CN103856787B (en) 2012-12-04 2012-12-04 Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210511265.9A CN103856787B (en) 2012-12-04 2012-12-04 Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network

Publications (2)

Publication Number Publication Date
CN103856787A true CN103856787A (en) 2014-06-11
CN103856787B CN103856787B (en) 2017-02-22

Family

ID=50863927

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210511265.9A Active CN103856787B (en) 2012-12-04 2012-12-04 Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network

Country Status (1)

Country Link
CN (1) CN103856787B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618798A (en) * 2015-02-12 2015-05-13 北京清源新创科技有限公司 Playing time control method and device for Internet live video
CN105025314A (en) * 2015-07-15 2015-11-04 腾讯科技(深圳)有限公司 Multimedia live broadcast method and device
WO2016150317A1 (en) * 2015-03-23 2016-09-29 阿里巴巴集团控股有限公司 Method, apparatus and system for synthesizing live video
CN106941613A (en) * 2017-04-14 2017-07-11 武汉鲨鱼网络直播技术有限公司 A kind of compacting of audio frequency and video interflow and supplying system and method
CN107124622A (en) * 2017-04-14 2017-09-01 武汉鲨鱼网络直播技术有限公司 A kind of audio frequency and video interflow compact system and method
CN107197186A (en) * 2017-04-14 2017-09-22 武汉鲨鱼网络直播技术有限公司 A kind of audio frequency and video compact system and method
WO2018077259A1 (en) * 2016-10-31 2018-05-03 腾讯科技(深圳)有限公司 Media information handover method and server, and computer storage medium
CN107995503A (en) * 2017-11-07 2018-05-04 西安万像电子科技有限公司 Audio and video playing method and apparatus
CN110691218A (en) * 2019-09-09 2020-01-14 苏州臻迪智能科技有限公司 Audio data transmission method and device, electronic equipment and readable storage medium
CN115942066A (en) * 2022-12-06 2023-04-07 腾讯音乐娱乐科技(深圳)有限公司 Audio live broadcasting method, electronic equipment and computer readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020029381A1 (en) * 2000-09-06 2002-03-07 Eric Inselberg Method and apparatus for interactive audience participation at a live spectator event
US20050278764A1 (en) * 2004-06-01 2005-12-15 Craig Barr Home entertainment apparatus and method
CN101018237A (en) * 2007-01-16 2007-08-15 成都金山互动娱乐科技有限公司 A method for playing the online synchronization explication of the network game
CN101420621A (en) * 2007-10-24 2009-04-29 深圳华为通信技术有限公司 Transmission equipment, system and method for interactive television message
CN101938606A (en) * 2009-07-03 2011-01-05 北京大学 Method, system and device for propelling multimedia data
CN102195939A (en) * 2010-03-11 2011-09-21 盛乐信息技术(上海)有限公司 High-speed wireless network remote-control competition system and implementation method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020029381A1 (en) * 2000-09-06 2002-03-07 Eric Inselberg Method and apparatus for interactive audience participation at a live spectator event
US20050278764A1 (en) * 2004-06-01 2005-12-15 Craig Barr Home entertainment apparatus and method
CN101018237A (en) * 2007-01-16 2007-08-15 成都金山互动娱乐科技有限公司 A method for playing the online synchronization explication of the network game
CN101420621A (en) * 2007-10-24 2009-04-29 深圳华为通信技术有限公司 Transmission equipment, system and method for interactive television message
CN101938606A (en) * 2009-07-03 2011-01-05 北京大学 Method, system and device for propelling multimedia data
CN102195939A (en) * 2010-03-11 2011-09-21 盛乐信息技术(上海)有限公司 High-speed wireless network remote-control competition system and implementation method thereof

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618798A (en) * 2015-02-12 2015-05-13 北京清源新创科技有限公司 Playing time control method and device for Internet live video
CN104618798B (en) * 2015-02-12 2016-01-20 北京清源新创科技有限公司 The broadcasting moment control method of Internet net cast and device
WO2016150317A1 (en) * 2015-03-23 2016-09-29 阿里巴巴集团控股有限公司 Method, apparatus and system for synthesizing live video
CN106162221A (en) * 2015-03-23 2016-11-23 阿里巴巴集团控股有限公司 The synthetic method of live video, Apparatus and system
CN105025314A (en) * 2015-07-15 2015-11-04 腾讯科技(深圳)有限公司 Multimedia live broadcast method and device
CN105025314B (en) * 2015-07-15 2016-11-16 腾讯科技(深圳)有限公司 Multimedia live broadcast method and apparatus
WO2018077259A1 (en) * 2016-10-31 2018-05-03 腾讯科技(深圳)有限公司 Media information handover method and server, and computer storage medium
CN107124622A (en) * 2017-04-14 2017-09-01 武汉鲨鱼网络直播技术有限公司 A kind of audio frequency and video interflow compact system and method
CN107197186A (en) * 2017-04-14 2017-09-22 武汉鲨鱼网络直播技术有限公司 A kind of audio frequency and video compact system and method
CN106941613A (en) * 2017-04-14 2017-07-11 武汉鲨鱼网络直播技术有限公司 A kind of compacting of audio frequency and video interflow and supplying system and method
CN107995503A (en) * 2017-11-07 2018-05-04 西安万像电子科技有限公司 Audio and video playing method and apparatus
CN110691218A (en) * 2019-09-09 2020-01-14 苏州臻迪智能科技有限公司 Audio data transmission method and device, electronic equipment and readable storage medium
CN115942066A (en) * 2022-12-06 2023-04-07 腾讯音乐娱乐科技(深圳)有限公司 Audio live broadcasting method, electronic equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN103856787B (en) 2017-02-22

Similar Documents

Publication Publication Date Title
CN103856787A (en) Commentary video passing-back live system based on public network and live method of commentary video passing-back live system based on public network
US11019186B2 (en) Apparatus for transmitting broadcast signal, apparatus for receiving broadcast signal, method for transmitting broadcast signal and method for receiving broadcast signal
US7346698B2 (en) Webcasting method and system for time-based synchronization of multiple, independent media streams
CN103733631B (en) Media content transceiving method and transceiving apparatus using same
US7817672B2 (en) Method and device for providing programs to multiple end user devices
CN105491393A (en) Method for implementing multi-user live video business
US8458751B2 (en) Systems and methods for accessing selected packetized programming streams
CN103546662A (en) Audio and video synchronizing method in network monitoring system
CN104602044A (en) RTMP stream media public network live broadcast system and design method thereof
CN105072506B (en) The transmission method and system of live teaching broadcast video
CN110267064A (en) Audio broadcast state processing method, device, equipment and storage medium
CN113727144A (en) High-definition live broadcast system and streaming media method based on mixed cloud
CN108494792A (en) A kind of flash player plays the converting system and its working method of hls video flowings
CN108574816B (en) Video networking terminal and communication method and device based on video networking terminal
CN110602542B (en) Audio and video synchronization method, audio and video synchronization system, equipment and storage medium
CN107920072A (en) A kind of multimedia sharing method and system based on data characteristics
CN103826084A (en) Audio encoding method
CN109862386A (en) Live data transmission method and device
CN105763941A (en) Channel switching method and system
CN101754024A (en) Multiplexing device and multiplexing method
CN104093089A (en) Cinema program live telecasting system and method
CN109714316B (en) Audio mixing processing method of video network and video network system
CN106790030A (en) Multi-screen collaboration audio transmission service end, client, system and its processing method
CN103269448A (en) Method for achieving synchronization of audio and video on the basis of RTP/RTCP feedback early-warning algorithm
CN110545447B (en) Audio and video synchronization method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant