CN106358051A - Method for data correction in multimedia synchronized broadcast - Google Patents

Method for data correction in multimedia synchronized broadcast Download PDF

Info

Publication number
CN106358051A
CN106358051A CN201510411835.0A CN201510411835A CN106358051A CN 106358051 A CN106358051 A CN 106358051A CN 201510411835 A CN201510411835 A CN 201510411835A CN 106358051 A CN106358051 A CN 106358051A
Authority
CN
China
Prior art keywords
package
client
main control
control end
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510411835.0A
Other languages
Chinese (zh)
Other versions
CN106358051B (en
Inventor
于宗元
陈志佳
余秉璜
郭浤洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NFORE TECHNOLOGY Co Ltd
Original Assignee
NFORE TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NFORE TECHNOLOGY Co Ltd filed Critical NFORE TECHNOLOGY Co Ltd
Priority to CN201510411835.0A priority Critical patent/CN106358051B/en
Publication of CN106358051A publication Critical patent/CN106358051A/en
Application granted granted Critical
Publication of CN106358051B publication Critical patent/CN106358051B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242Synchronization processes, e.g. processing of PCR [Program Clock References]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64746Control signals issued by the network directed to the server or the client
    • H04N21/64761Control signals issued by the network directed to the server or the client directed to the server
    • H04N21/64776Control signals issued by the network directed to the server or the client directed to the server for requesting retransmission, e.g. of data packets lost or corrupted during transmission from server

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a method for data correction in multimedia synchronized broadcast. A master port controls the synchronized broadcast of a multimedia device in multiple clients and performs data correction, one client is used as the source of a display media and the source of the display media is provided for the other clients for synchronized broadcast; when the client is displaying, the mater port can continuously deliver a serial flow packet including a serial number; after receiving the serial flow packet, the client checks if the data is lost; if not, the client continues to receive the next serial flow packet, and the serial flow packet is continuous sequence number; if the data in the serial flow packet is lost, the client sends a feedback requirement to the master port according to the data loss state; the master port can send a response packet including the serial number to the client with data loss, thus the client still can stably display when the network is unstable.

Description

The method being applied to Data correction during multimedia synchronous are play
Technical field
The present invention relates to multimedia play technology field, it is applied to multimedia synchronous broadcast particularly to one kind The method putting middle Data correction.
Background technology
In one-to-one, one-to-many multimedia transmission, Synchronization Control is that main control end can control multiple stage visitor Family end is synchronously play, suspends and is stopped, and can select based on wherein one client by main control end, and Other clients receive the multimedia messages of primary client as broadcasting media source, but main control end is necessary The package that constantly transmission controls, to maintain multiple stage client continued synchronization to play, these main control end are sent Control the package substantial amounts that package and client send back to.
In multimedia series flow, the transmission quantity of main control end is always the bottleneck of whole mechanism, is working out string During stream mechanism, needing tries every possible means forces down the transmission quantity of main control end.However, network environment stable with Its transmission quantity of no appreciable impact, such as cyclic redundancy check (CRC) (cyclic redundancy check, crc), envelope Bag is lost etc., when network environment is unstable, how the transmission quantity of the whole crossfire of shrinkage limit be one important Subject under discussion.
Therefore, the present invention proposes a kind of method being applied to Data correction during multimedia synchronous are play, Concrete framework and embodiments thereof will be described under:
Content of the invention
Present invention is primarily targeted at offer is a kind of is applied to Data correction during multimedia synchronous are play Method, wherein this main control end send the crossfire package of continuous sequence number to each visitor using the mode multicasting Family end, if after client checks find data degradation, can using negative response mechanism (nack, Negative-acknowledge) claim to main control end, main control end is determined according to the frequency receiving requirement Determine how to retransmit package.
Another object of the present invention is to offer is a kind of is applied to Data correction during multimedia synchronous are play Method, wherein main control end can go to estimate the frequency of package re-transmission using the packet delay time of negative response, To avoid client to distribute the feedback request of data degradation indiscriminately, quick for Data correction to improve client Perception.
It is still another object of the present invention to provide a kind of be applied to Data correction during multimedia synchronous are play Method, wherein multi-media data streams are supplied to all clients by wherein one client and synchronously broadcast together Put, and main control end can control the broadcast state of these clients.
In order to achieve the above object, the invention provides one kind is applied to data during multimedia synchronous are play The method of correction, is controlled using a main control end multimedia device in multiple client synchronously to play and goes forward side by side Row Data correction, and media source as broadcasting media source and will be play with one of client It is supplied to other client synchronization to play, when client is play, this data correcting method includes The following step: main control end constantly sends the crossfire package comprising a sequence number;The plurality of client receives string After stream package, check whether the data in crossfire package has loss, if free of losses, continue to next Serial number consecutive number in individual crossfire package, and the plurality of crossfire package, if the data in crossfire package There is loss, then a feedback request is sent to main control end according to data degradation state, main control end sends a bag Response package containing this sequence number is given the client of data degradation.
In one embodiment of this invention, when this main control end sends a time-out package, this client receives Carry out the following step after this time-out package:
This client assert that the broadcast state of this main control end is to suspend, and records the letter in this time-out package Breath;
Judge whether the data in this time-out package has loss;And
If there being loss, again receive this time-out package, if free of losses, this multimedia device suspends Play.
In one embodiment of this invention, this main control end sends this time-out package every a fixed cycle.
In one embodiment of this invention, this main control end sends crossfire package and an ending of same sequence number During package, this client carries out the following step after receiving this ending package:
This client assert that the broadcast state of this main control end is end-of-file, and records in this ending package Information;
According to this ending package, judge whether the data of this crossfire package is complete;
If the information in this ending package shows that this main control end also has data not send, continue to connect Receive this crossfire package, if data is complete, this client assert that the broadcast state of this multimedia device is Stop;And
This multimedia device stops playing.
In one embodiment of this invention, to this when this client judges that this ending packet data is imperfect Main control end proposes this feedback request, and this main control end resends this crossfire package of this sequence number to this client End.
In one embodiment of this invention, if this crossfire package is transmitted across in a Preset Time, This main control end ignores this feedback request.
In one embodiment of this invention, this multimedia device is sound equipment, wireless speakerses, broadcaster Or music player.
In one embodiment of this invention, this main control end is smart mobile phone or computer.
In one embodiment of this invention, this main control end and the plurality of client pass through the Internet or wireless Network on-line.
In one embodiment of this invention, when this client judges that information has loss, should using a negative Mechanism of answering proposes this feedback request to this main control end, and this main control end determines according to the frequency of this feedback request How to retransmit package.
Below by specific embodiment elaborate, when being easier to understand the purpose of the present invention, in technology Appearance, feature and its effect reached.
Brief description
The framework being applied to the method for Data correction during multimedia synchronous are play that Fig. 1 provides for the present invention Schematic diagram;
Fig. 2 is applied to broadcasting in the method for Data correction during multimedia synchronous are play for what the present invention provided When flow chart;
Fig. 3 is applied to master control in the method for Data correction during multimedia synchronous are play for what the present invention provided Hold the flow chart requested timeout;
Fig. 4 is applied to master control in the method for Data correction during multimedia synchronous are play for what the present invention provided End requires the flow chart stopping.
Description of reference numerals: 10- main control end;12- client;14- LAN.
Specific embodiment
The present invention provides a kind of method being applied to Data correction during multimedia synchronous are play, and its framework is such as Shown in Fig. 1, comprise a main control end 10 and multiple client 12, each client 12 comprises at least one Multimedia device, it can be sound equipment, wireless speakerses, broadcaster or music player, main control end 10 Can have the electronic product of remote control function for smart mobile phone or computer etc.;Client 12 is same In LAN 14, online by wireless transmission method each other, and client 12 and main control end Then can be connected by wired the Internet or wireless network transmissions (as wi-fi, bluetooth etc.) between 10. In the present invention, the client 12 in same LAN 14 can play simultaneously same song or Same radio station, by the multimedia device in one of client 12 as playing media source and defeated Go out multimedia series flow, other clients 12 receive this multimedia series flow with synchronous broadcasting, between client Primary and secondary, play the selection of media source and the control (as play, suspending, stop etc.) of broadcast state All it is controlled by main control end 10.
When client is play, flow chart as shown in Figure 2, in step s10, main control end meeting Constantly send the crossfire package comprising a sequence number, this serial number sequence number up-to-date at present;Step s12 visitor After family end receives crossfire package, check whether the data in crossfire package has loss in step s14, if Free of losses, then return to step s10 and continue to next crossfire package, and the sequence number in crossfire package For consecutive number, whether client is it is known that having the package omitting a certain sequence number and making sequence number discontinuous; If the data in crossfire package has loss, enter step s16, client is according to data degradation state Send a feedback request (feedback request) to main control end, then, in step s18, main control end is received To after feedback request, learn that the crossfire package of firm transmission is wrong, can again send the sound comprising this sequence number Answer package (feedback response) to the client having data degradation;So repeat step s12~s18, As long as the errorless crossfire package that just can continue to Next Sequence of the crossfire packet data receiving, to tie up Keep steady fixed broadcast state.
Main control end and client are existed based on RTP (real-time transport protocol) Two ends use the synchronization system frequency of network agreement (network time protocol).Therefore Meeting proof time when multiple client is synchronously play, it is ensured that energy Complete Synchronization, will not occur a certain client The problem of fast or slow 0.1 second of song tempo etc play by the multimedia device at end.
If main control end wants client to suspend playing, flow chart as shown in Figure 3.In step s20, main Control end periodically sends a time-out package to all clients, and client can be recognized after receiving time-out package Determining the present broadcast state of main control end is to suspend, and records the information suspending package, such as step s22~s24 Described, then step s26 judges whether the data suspended in package has loss, if there being loss, In step s27, client can propose a feedback request to main control end, returns in step s30, master control End resends the crossfire package of this sequence number to client;Then return to step s20 and again receive time-out envelope Bag, if free of losses, the multimedia device in client suspends to be play, such as step s28.
Whether play or suspend, when client proposes feedback request, if main control end is pre- one If resending the crossfire package of this sequence number in the time, then main control end can ignore feedback request, in case Only transmission congestion.
If main control end wants client to stop playing, flow chart as shown in Figure 4.In step s30, main Control end is periodically sent the crossfire package of same sequence number and and is ended up package to all clients, step In s32~s34, after client receives ending package, assert that the broadcast state of main control end is end-of-file, And record the information in ending package;Step s36 judges the data in crossfire package according to ending package Whether there is loss (whether complete);If the information in ending package shows that main control end also has data not yet Send, then, in step s37, client can propose a feedback request to main control end, returns to step In rapid s30, main control end resends the crossfire package of this sequence number to client;If conversely, data is complete Whole, represent main control end no data, then, as described in step s38, client assert multimedia device Broadcast state is to stop;And the multimedia device in step s40 client stops playing, now will not Reexamine whether data has loss, until the broadcast state of next main control end changes.If but client carries When going out feedback request, main control end had resend crossfire package, then main control end in a Preset Time Feedback request can be ignored, to prevent from transmitting congestion.
When client judges that packet data has loss, using a negative response (nack, Negative-acknowledge) mechanism proposes feedback request to main control end, and main control end is according to feedback request Frequency and estimate the frequency of re-transmission time delay and determine how to retransmit package, consequently, it is possible to can keep away Exempt from the feedback request that client distributes data degradation indiscriminately, improve the sensitivity for Data correction for the client.
In sum, what the present invention provided is applied to the method profit of Data correction during multimedia synchronous are play With sending the crossfire package of continuous sequence number to each client, find that data is damaged after client checks Feed back to main control end during mistake to require to resend, if main control end receives multiple feedback requests in a set time Then ignored, to avoid transmitting congestion.Because Data correction uses the side of negative response feedback request Formula is processed, therefore under the multimedia of sync client and main control end, broadcast state, it is possible to decrease master control The transmission quantity at end simultaneously saves bandwidth, and strengthen the Reliability of Network (network reliability) of client, Still can stable playback when network environment is unstable.
The foregoing is only presently preferred embodiments of the present invention, be not used for limiting present invention enforcement Scope.Therefore i.e. all impartial changes done according to the feature described in scope of the invention as claimed and spirit or Modify, all should be included in protection scope of the present invention.

Claims (10)

1. a kind of method being applied to Data correction during multimedia synchronous are play, it utilizes a main control end control Multimedia device in multiple client processed is synchronously play and is carried out Data correction, and the plurality of client Other clients are supplied to as broadcasting media source and by playing media source with one of client End is synchronous to play it is characterised in that when the plurality of client is play, this data correcting method Comprise the following steps:
This main control end constantly sends the crossfire package comprising a sequence number;
The plurality of client receives this crossfire package, checks whether the data in this crossfire package has loss, If free of losses, return to previous step and continue to next crossfire package, and in the plurality of crossfire package This serial number consecutive number, if the data in this crossfire package has loss, according to data degradation state Send a feedback request to this main control end;And
This main control end sends a response package comprising this sequence number to this client having data degradation.
2. the method being applied to Data correction during multimedia synchronous are play according to claim 1, It is characterized in that, when this main control end sends a time-out package, it is laggard that this client receives this time-out package Row the following step:
This client assert that the broadcast state of this main control end is to suspend, and records the letter in this time-out package Breath;
Judge whether the data in this time-out package has loss;And
If there being loss, again receive this time-out package, if free of losses, this multimedia device suspends Play.
3. the method being applied to Data correction during multimedia synchronous are play according to claim 2, It is characterized in that, this main control end sends this time-out package every a fixed cycle.
4. the method being applied to Data correction during multimedia synchronous are play according to claim 1, It is characterized in that, when this main control end sends crossfire package and an ending package of same sequence number, this client Hold and after receiving this ending package, carry out the following step:
This client assert that the broadcast state of this main control end is end-of-file, and records in this ending package Information;
According to this ending package, judge whether the data of this crossfire package is complete;
If the information in this ending package shows that this main control end also has data not send, continue to connect Receive this crossfire package, if data is complete, this client assert that the broadcast state of this multimedia device is Stop;And
This multimedia device stops playing.
5. the method being applied to Data correction during multimedia synchronous are play according to claim 4, It is characterized in that, to this main control end, this is proposed when this client judges that this ending packet data is imperfect anti- Feedback requires, and this main control end resends this crossfire package of this sequence number to this client.
6. the method being applied to Data correction during multimedia synchronous are play according to claim 5, It is characterized in that, if this crossfire package is transmitted across in a Preset Time, this main control end ignores this Feedback request.
7. the method being applied to Data correction during multimedia synchronous are play according to claim 1, It is characterized in that, this multimedia device is sound equipment, wireless speakerses, broadcaster or music player.
8. the method being applied to Data correction during multimedia synchronous are play according to claim 1, It is characterized in that, this main control end is smart mobile phone or computer.
9. the method being applied to Data correction during multimedia synchronous are play according to claim 1, It is characterized in that, this main control end and the plurality of client pass through the Internet or wireless network linking.
10. according to claim 1 or 2 or 4 be applied to multimedia synchronous play in data school Positive method it is characterised in that when this client judges that information has loss, using a negative response machine Make and propose this feedback request to this main control end, how this main control end determines according to the frequency of this feedback request Retransmit package.
CN201510411835.0A 2015-07-14 2015-07-14 Method applied to Data correction in multimedia synchronous broadcasting Expired - Fee Related CN106358051B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510411835.0A CN106358051B (en) 2015-07-14 2015-07-14 Method applied to Data correction in multimedia synchronous broadcasting

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510411835.0A CN106358051B (en) 2015-07-14 2015-07-14 Method applied to Data correction in multimedia synchronous broadcasting

Publications (2)

Publication Number Publication Date
CN106358051A true CN106358051A (en) 2017-01-25
CN106358051B CN106358051B (en) 2019-06-11

Family

ID=57842169

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510411835.0A Expired - Fee Related CN106358051B (en) 2015-07-14 2015-07-14 Method applied to Data correction in multimedia synchronous broadcasting

Country Status (1)

Country Link
CN (1) CN106358051B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021180174A1 (en) * 2020-03-11 2021-09-16 广州酷狗计算机科技有限公司 Song playing method, apparatus, and system and computer storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101394252A (en) * 2008-11-12 2009-03-25 北京佳讯飞鸿电气股份有限公司 Data transmission method based on RTP
CN101577599A (en) * 2008-05-07 2009-11-11 安凯(广州)软件技术有限公司 Embedded two-computer synchronizing method
CN101631250A (en) * 2008-07-17 2010-01-20 奇景光电股份有限公司 Synchronizing device and method
CN104270684A (en) * 2014-09-24 2015-01-07 北京中科大洋科技发展股份有限公司 Video and audio data network transmission system and method oriented to real-time application
KR20150028972A (en) * 2015-01-26 2015-03-17 주식회사 비즈모델라인 Method for Playing Movie Synchronous

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101577599A (en) * 2008-05-07 2009-11-11 安凯(广州)软件技术有限公司 Embedded two-computer synchronizing method
CN101631250A (en) * 2008-07-17 2010-01-20 奇景光电股份有限公司 Synchronizing device and method
CN101394252A (en) * 2008-11-12 2009-03-25 北京佳讯飞鸿电气股份有限公司 Data transmission method based on RTP
CN104270684A (en) * 2014-09-24 2015-01-07 北京中科大洋科技发展股份有限公司 Video and audio data network transmission system and method oriented to real-time application
KR20150028972A (en) * 2015-01-26 2015-03-17 주식회사 비즈모델라인 Method for Playing Movie Synchronous

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021180174A1 (en) * 2020-03-11 2021-09-16 广州酷狗计算机科技有限公司 Song playing method, apparatus, and system and computer storage medium

Also Published As

Publication number Publication date
CN106358051B (en) 2019-06-11

Similar Documents

Publication Publication Date Title
EP1897326B1 (en) Transport mechanisms for dynamic rich media scenes
US10051031B2 (en) Further device timing adjustments and methods for supporting DASH over broadcast
CN103797810B (en) Synchronous wireless display apparatus
CN112771941B (en) Data synchronization method, device, equipment, system and storage medium
CN105245317A (en) Data transmission method, transmitting end, receiving end and data transmission system
US20070162810A1 (en) Retransmission control method and system for multicast information distribution service, retransmission control apparatus, wireless base station and wireless terminal
US8813160B2 (en) Method, system and user device for obtaining a key frame in a streaming media service
KR101298640B1 (en) Method and apparatus for transmitting transport stream packets
CN105656616B (en) Method, apparatus, transmitting terminal and the receiving end of more data synchronization between devices
JP2004525545A (en) Webcast method and system for synchronizing multiple independent media streams in time
WO2003098884A1 (en) Protocol, information processing system and method, information processing device and method, recording medium, and program
CN105874803A (en) Content presentation for mpeg media transport
US20120233346A1 (en) Method, apparatus and system for rapid acquisition of multicast realtime transport protcol sessions
US20150046533A1 (en) Conference system
US20160248829A1 (en) Availability Start Time Adjustment By Device For DASH Over Broadcast
CN103607255A (en) Wireless channel video communication packet loss rate control method
CN106358051A (en) Method for data correction in multimedia synchronized broadcast
JP2009081654A (en) Stream synchronous reproduction system and method
CN101212332A (en) Stream recording method, apparatus and system
JPWO2011024272A1 (en) Base station control device and communication system
CN210129959U (en) Wireless local area network audio stream transmission system
CN104010032A (en) Data transmission method and device
US10756844B2 (en) Devices and method for wirelessly broadcasting media packets
TWI559761B (en) Application of Data Synchronization in Multimedia Synchronization
JP2001156731A (en) Information providing method for radio data communication, information transmitter and information receiver

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190611

Termination date: 20210714