CN102752669A - Transfer processing method and system for multi-channel real-time streaming media file and receiving device - Google Patents

Transfer processing method and system for multi-channel real-time streaming media file and receiving device Download PDF

Info

Publication number
CN102752669A
CN102752669A CN2011100972419A CN201110097241A CN102752669A CN 102752669 A CN102752669 A CN 102752669A CN 2011100972419 A CN2011100972419 A CN 2011100972419A CN 201110097241 A CN201110097241 A CN 201110097241A CN 102752669 A CN102752669 A CN 102752669A
Authority
CN
China
Prior art keywords
streaming media
packet
time
client
time stamp
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011100972419A
Other languages
Chinese (zh)
Other versions
CN102752669B (en
Inventor
王爱宝
卢燕青
杨敏维
何峣
吴恒章
郭茂文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN201110097241.9A priority Critical patent/CN102752669B/en
Publication of CN102752669A publication Critical patent/CN102752669A/en
Application granted granted Critical
Publication of CN102752669B publication Critical patent/CN102752669B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The embodiment of the invention discloses a transfer processing method and a transfer processing system for a multi-channel real-time streaming media file, and a receiving device. The method comprises the following steps of: receiving data packets on L streaming media channels by a client side in a way of aiming at a same streaming media program, wherein the system clocks of N streaming media servers are consistent; when a time variable phi is a nonblank value, recognizing whether timestamps TS on the data packets are more than the sum TC+phi of the current system moment TC of the client side and the time variable phi or not; if the timestamps are not more than the sum, abandoning the data packets; if the timestamps are more than the sum, storing the data packets in a corresponding buffer area playing queue according to a sequence from a small one to a big one of the timestamps TS; and when the TC+phi reaches the timestamp TS on a first data packet in the playing queue, decompressing, decoding and playing the data packets in the playing queue in sequence. According to the embodiment of the invention, the synchronous playing of the real-time streaming media files transferred in a multi-channel way can be realized, and the situation that a plurality of frames are asynchronous is avoided.

Description

The transfer processing method of Multi-channel Real-time files in stream media and system, receiving system
Technical field
The present invention relates to stream media technology, relate in particular to a kind of transfer processing method and system, receiving system of Multi-channel Real-time files in stream media.
Background technology
Streaming Media is meant the mode media formats that (Internet) or Intranet (Intranet) are play in the Internet that adopts stream transmission, for example: audio frequency, video or multimedia file.Stream transmission refers to that mainly streaming media server is with whole audio/video (Audio/Video; Hereinafter to be referred as: A/V), 3-D graphic (three-dimensional; Hereinafter to be referred as: 3D) wait files in stream media to resolve to compressed package one by one through specific compress mode; Send client in proper order, in real time, be generally subscriber computer.Subscriber computer at first creating a buffering area, is not downloaded whole files in stream media before the playing stream media file, the beginning partial content of a download stream media file deposits buffering area in, and packet is carried out buffer memory and media data is correctly exported.The data flow of Streaming Media transmits at any time at any time and plays; The user needn't wait until as adopting downloading mode that whole download of whole files in stream media finishes; But the startup time-delay that only need pass through seconds or tens of seconds can utilize decompression apparatus to playing after compressing files in stream media decompress(ion)s such as A/V, 3D and watching on the subscriber computer, and the remainder of files in stream media will continue to download from streaming media server on the backstage this moment.Therefore, subscriber computer need not to download complete media files and can play.Compare with simple downloading mode, this stream transmission mode that media file is play while downloading not only makes and starts time-delay shortening significantly, and the demand of computer system buffer memory capacity is also reduced greatly, greatly reduces user's stand-by period.If the connection speed of computer network is play required speed less than files in stream media, playing program will be taken the stream medium data that deposits in the buffering area, avoids playing interrupting, and makes playback quality be maintained.
Stream transmission is except can be to client transmits the files in stream media completed, and the sound of collection site, video push offer the user in real time to client in real time.Therefore, Streaming Media more can be applied in the multiple fields higher to the real-time transmission requirement such as on-the-spot broadcasting, television relay, accident report except can better bearing the multimedia-on-demand service as downloading.
In practical application; Can the concrete scene of more complete, real understanding for the ease of the user; Can adopt one or more streaming media servers that Same Scene is carried out multi-angle takes; Form a plurality of real time flow medium files, and respectively through L Streaming Media passage (hereinafter to be referred as: multichannel) be pushed to client.For example: take competitive sports through multi-angle, a plurality of pictures that different angles are taken are sent to client through multichannel.
In realizing process of the present invention, the inventor finds that when giving client with a plurality of real time flow medium file push that form, there is following problem through multichannel in a plurality of streaming media servers at least in the prior art:
Owing to have system's time difference between a plurality of streaming media servers; When reasons such as perhaps multichannel network transfer speeds is inconsistent, client were play multichannel real time flow medium file simultaneously, nonsynchronous situation between a plurality of pictures can appear; That is: the image content of a plurality of real time flow medium files broadcasts is not the content of same time; Make that the user can't the concrete scene of understanding directly perceived, complete, real, reduced the quality of service of streaming media service, and cause user experience to descend.
Summary of the invention
Embodiment of the invention technical problem to be solved is: transfer processing method and system, receiving system that a kind of Multi-channel Real-time files in stream media is provided; To realize that the synchronous playing of the real time flow medium file of multichannel transmission is avoided nonsynchronous situation between a plurality of pictures.
For solving the problems of the technologies described above, the transfer processing method of a kind of Multi-channel Real-time files in stream media that the embodiment of the invention provides comprises:
Client receives packet to same flow-medium performance on L Streaming Media passage; Said packet sends after stamping time stamp T S by a streaming media server in N the streaming media server; The system clock of a said N streaming media server is consistent; Wherein, N is the integer greater than 1, and L is the integer that is not less than N;
When said client was non-null, value at the time variable θ that is provided with in advance, whether recognition time stabbed TS greater than said client current system time TC and time variable θ value sum TC+ θ;
If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, said client abandons said packet;
If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; Said client is saved in said packet the relevant position in the Streaming Media passage corresponding buffer region of transmitting said packet, and the packet in the said buffering area forms according to the ascending order of time stamp T S and plays formation;
Whether said client monitors system time TC and time variable θ value sum TC+ θ reach the time stamp T S on first packet in the said broadcast formation;
When said client reaches in the said broadcast formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ, successively the packet in the said broadcast formation is carried out decompress(ion), decoding, broadcast.
A kind of receiving system that the embodiment of the invention provides comprises:
Memory cell comprises a plurality of buffering areas that L Streaming Media passage is corresponding respectively, and stores the time variable θ that is provided with in advance that L is the integer greater than 1;
Receiving element; Be used on L Streaming Media passage, receiving packet to same flow-medium performance; Said packet sends after stamping time stamp T S by a streaming media server in N the streaming media server; The system clock of a said N streaming media server is consistent, and wherein, N is for greater than 1 and be not more than the integer of L;
First recognition unit is used for when said time variable θ is non-null, value, and whether recognition time stabs TS greater than said receiving system current system time TC and time variable θ value sum TC+ θ;
Storage processing unit is used for the recognition result according to said first recognition unit, if time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, abandons said packet; If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; Said packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of the said packet of transmission, the packet in the said buffering area forms according to the ascending order of time stamp T S and plays formation;
First monitoring means is used for monitoring system moment TC and time variable θ value sum TC+ θ and whether reaches the time stamp T S on said first packet of broadcast formation;
The playback process unit; Be used for monitoring result according to said first monitoring means; When system time TC and time variable θ value sum TC+ θ reach in the said broadcast formation time stamp T S on first packet, successively the packet in the said broadcast formation is carried out decompress(ion), decoding, broadcast.
The transmission treatment system of a kind of Multi-channel Real-time files in stream media that the embodiment of the invention provides comprises a client and N streaming media server, and the system clock of a said N streaming media server is consistent, and N is the integer greater than 1;
Said client is used on L Streaming Media passage, receiving packet to same flow-medium performance, and said packet sends after stamping time stamp T S by a streaming media server in N the streaming media server, and L is the integer that is not less than N; When the time variable θ that is provided with in advance was non-null, value, whether recognition time stabbed TS greater than said client current system time TC and time variable θ value sum TC+ θ; If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, abandon said packet; If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; Said packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of the said packet of transmission, the packet in the said buffering area forms according to the ascending order of time stamp T S and plays formation; Whether monitoring system moment TC and time variable θ value sum TC+ θ reach the time stamp T S on first packet in the said broadcast formation; When system time TC and time variable θ value sum TC+ θ reach in the said broadcast formation time stamp T S on first packet, successively the packet in the said broadcast formation is carried out decompress(ion), decoding, broadcast;
Said streaming media server is used for behind the packet marking time stamp T S, and a Streaming Media passage through in L the Streaming Media passage sends to said client.
The transfer processing method of the Multi-channel Real-time files in stream media that provides based on the above embodiment of the present invention and system, receiving system; When client receives the same flow-medium performance packet that on L Streaming Media passage, is sent by N streaming media server; If the time variable θ that is provided with in advance is a non-null, value; To each packet that receives, whether the time stamp T S in the recognition data bag is greater than client current system time TC and time variable θ value sum TC+ θ, when time stamp T S is not more than system time TC and time variable θ value sum TC+ θ; Abandon this packet; Otherwise be saved in the relevant position in the Streaming Media passage corresponding buffer region of this packet of transmission according to the ascending order of time stamp T S, form play formation, and when system time TC and time variable θ value sum TC+ θ reach in the broadcast formation time stamp T S on first packet; Successively the packet of playing in the formation is carried out decompress(ion), decoding, broadcast; Under the consistent situation of the system clock of N streaming media server, abandon the packet of overtime transmission, and play the broadcast formation in each buffering area successively according to the client clock; Compared with prior art; The synchronous playing of the real time flow medium file of having realized multichannel is transmitted has avoided existing between a plurality of streaming media servers nonsynchronous situation between a plurality of pictures that reasons such as system's time difference, multichannel network transfer speeds be inconsistent cause, and makes that the user can the concrete scene of understanding directly perceived, complete, real; Improve the quality of service of streaming media service, promoted user experience.
Through accompanying drawing and embodiment, technical scheme of the present invention is done further detailed description below.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work property, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of an embodiment of transfer processing method of Multi-channel Real-time files in stream media of the present invention;
Fig. 2 is the flow chart of another embodiment of transfer processing method of Multi-channel Real-time files in stream media of the present invention;
Fig. 3 is the flow chart of an application implementation example of transfer processing method of Multi-channel Real-time files in stream media of the present invention;
Fig. 4 is the structural representation of an embodiment of receiving system of the present invention;
Fig. 5 is the structural representation of another embodiment of receiving system of the present invention;
Fig. 6 is the structural representation of another embodiment of receiving system of the present invention;
Fig. 7 is the structural representation of an embodiment of transmission treatment system of Multi-channel Real-time files in stream media of the present invention;
Fig. 8 is the structural representation of another embodiment of transmission treatment system of Multi-channel Real-time files in stream media of the present invention.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
The embodiment of the invention can form multichannel real time flow medium file, and the real time flow medium file of a plurality of passages is transmitted and synchronous playing Same Scene being carried out the multi-angle shooting.
Fig. 1 is the flow chart of an embodiment of transfer processing method of Multi-channel Real-time files in stream media of the present invention.As shown in Figure 1, the transfer processing method of this embodiment Multi-channel Real-time files in stream media comprises:
Step 101; Client receives packet to same flow-medium performance on L Streaming Media passage; This packet sends after stamping time stamp T S by a streaming media server in N the streaming media server; The system clock of the streaming media server of N wherein is consistent, and N is the integer greater than 1, and L is the integer that is not less than N.
When step 102, client were non-null, value at the time variable θ that is provided with in advance, whether the time stamp T S in the recognition data bag was greater than client current system time TC and time variable θ value sum TC+ θ.If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, execution in step 103.Otherwise, if time stamp T S is greater than system time TC and time variable θ value sum TC+ θ, execution in step 104.
Step 103, the client packet discard.Afterwards, do not carry out the flow of present embodiment.
Step 104, client are saved in packet the relevant position in the Streaming Media passage corresponding buffer region of transmitting this packet, and the packet in the buffering area forms according to the ascending order of time stamp T S and plays formation.
Step 105, whether client monitors system time TC and time variable θ value sum TC+ θ reach is play the time stamp T S on first packet in the formation.
Step 106, client reaches when playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ, successively the packet of playing in the formation is carried out decompress(ion), decoding, broadcast.
The transfer processing method of the Multi-channel Real-time files in stream media that provides based on the above embodiment of the present invention; When client receives the same flow-medium performance packet that on L Streaming Media passage, is sent by N streaming media server; If the time variable θ that is provided with in advance is a non-null, value, to each packet that receives, whether the time stamp T S in the recognition data bag is greater than client current system time TC and time variable θ value sum TC+ θ; When time stamp T S is not more than system time TC and time variable θ value sum TC+ θ; Abandon this packet, otherwise be saved in the relevant position in the Streaming Media passage corresponding buffer region of transmitting this packet, form and play formation according to the ascending order of time stamp T S; And reach when playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ; Successively the packet of playing in the formation is carried out decompress(ion), decoding, broadcast, under the situation of the system clock unanimity of N streaming media server, abandon the packet of overtime transmission; And play the broadcast formation in each buffering area successively according to the client clock; The synchronous playing of the real time flow medium file of having realized multichannel is transmitted has avoided existing between a plurality of streaming media servers nonsynchronous situation between a plurality of pictures that reasons such as system's time difference, multichannel network transfer speeds be inconsistent cause, and makes that the user can the concrete scene of understanding directly perceived, complete, real; Improve the quality of service of streaming media service, promoted user experience.
According to a specific embodiment of the present invention, before the transfer processing method embodiment of above-mentioned Multi-channel Real-time files in stream media flow process, can calibrate the system clock of N streaming media server, make the system clock of this N streaming media server consistent.For example: can through but be not limited to following mode the system clock of N streaming media server calibrated:
(Network Time Protocol hereinafter to be referred as the NTP) system clock of server, calibrates the system clock of self, makes that the system clock of N streaming media server is consistent according to same NTP respectively for N streaming media server; Perhaps; N-1 streaming media server in N streaming media server; According to the system clock of N-1 streaming media server another streaming media server in addition in N the streaming media server, the system clock of self is calibrated respectively, made that the system clock of N streaming media server is consistent.
Fig. 2 is the flow chart of another embodiment of transfer processing method of Multi-channel Real-time files in stream media of the present invention.As shown in Figure 2, the transfer processing method of this embodiment Multi-channel Real-time files in stream media comprises:
Step 201, client are sent Streaming Media to N streaming media server respectively and are obtained request, and the system clock of this N streaming media server is calibrated to unanimity.Wherein, N is the integer greater than 1,
Step 202; Lay respectively at N each transmission processing unit in the transmission processing unit of the L on the streaming media server; Flow-medium performance is carried out multi-angle shooting, collecting, coding; Obtain files in stream media, the files in stream media of current Streaming Media channel transfer be compressed into a plurality of packets, and according to sequencing to a plurality of packets respectively behind the mark time stamp T S Streaming Media passage through correspondence send to client.Time stamp T S wherein is the corresponding current system time of Streaming Media passage place streaming media server.L Streaming Media passage is corresponding one by one with L transmission processing unit.Wherein, L is the integer that is not less than N.
A streaming media server can be born a Streaming Media passage in L the Streaming Media passage; Also can bear a plurality of Streaming Media passages in L the Streaming Media passage; Because N stream media server system clock is consistent; As its work clock, the work clock that also is L transmission processing unit also is consistent to transmission processing unit with the system clock of streaming media server at place.
Step 203, client receives packet to same flow-medium performance respectively on L Streaming Media passage.And when receiving each packet, the operation of execution in step 204 to step 210 is up to finishing receiving all packets that N streaming media server sends to the Streaming Media request of obtaining of client transmission.
Step 204, whether the time variable θ that client identification is provided with in advance is non-null, value.If time variable θ is a non-null, value, execution in step 208.Otherwise, if time variable θ is a null value, execution in step 205.
The initial value that time variable θ can be set in advance is a null value.
Step 205, client are saved in packet the relevant position in the Streaming Media passage corresponding buffer region of transmits data packets, and the packet in the buffering area forms the broadcast formation respectively according to the ascending order of time stamp T S.
According to another specific embodiment of the present invention, client can be created a plurality of buffering areas respectively to L Streaming Media passage in advance before the operation of execution in step 205.
Whether step 206 in a plurality of buffering areas of L Streaming Media passage correspondence of client identification, all has packet.If packet is all arranged, execution in step 207 in a plurality of buffering areas.Otherwise,, do not carry out the subsequent operation of present embodiment as long as have a buffering area not have packet in a plurality of buffering areas of L Streaming Media passage correspondence.
Step 207, client be according to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas, and give time variable θ with time variable θ value, and execution in step 211 then.
Step 208, whether the time stamp T S in the client recognition data bag is greater than client current system time TC and time variable θ value sum TC+ θ.If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, execution in step 209.Otherwise, if time stamp T S is greater than system time TC and time variable θ value sum TC+ θ, execution in step 210.
Step 209, the client packet discard.Afterwards, do not carry out the flow of present embodiment.
Step 210, client are saved in packet the relevant position in the Streaming Media passage corresponding buffer region of transmitting this packet, and the packet in the buffering area forms the broadcast formation respectively according to the ascending order of time stamp T S.
Step 211, whether client monitors system time TC and time variable θ value sum TC+ θ reach and respectively play the time stamp T S on first packet in the formation.Do not reach when respectively playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ, do not carry out the flow of present embodiment.When system time TC and time variable θ value sum TC+ θ reach in some broadcast formations the time stamp T S on first packet, execution in step 212.
Step 212, client are carried out decompress(ion), decoding, broadcast to the packet in this some broadcast formation successively, the respectively corresponding Streaming Media passage of each picture.
According to another specific embodiment of the present invention, in the step 207 of above-mentioned embodiment shown in Figure 2, client can be through following mode, according to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas:
Time stamp T S in more a plurality of buffering areas on first packet;
Choose in a plurality of buffering areas the minimum time stamp T S of numerical value on first packet Min
Obtain the minimum time stamp T S of numerical value MinAnd the difference TS between the system time TC Min-TC is with difference TS Min-TC is as time variable θ value.
Further; According to another specific embodiment of the present invention, in the transfer processing method embodiment of above-mentioned each the Multi-channel Real-time files in stream media of the present invention, client can also be monitored the situation that abandons of packet on L the Streaming Media passage; When a continuous N packet that in L Streaming Media passage, transmits on some Streaming Media passages all is dropped; Perhaps, add up the packet loss of packet on L the Streaming Media passage respectively, the packet loss of data packets for transmission reaches when presetting the packet loss threshold value on some Streaming Media passages; Finish the session connection of this some Streaming Media passage; Again send to the corresponding streaming media server of this some Streaming Media passage then and obtain request again, thereby skip out-of-date packet, so that the corresponding transmission processing unit of some Streaming Media passages restarts the operation of execution in step 202; Flow-medium performance is carried out shooting, collecting, coding; Obtain files in stream media, the files in stream media of current Streaming Media channel transfer be compressed into a plurality of packets, and in order to a plurality of packets respectively behind the mark time stamp T S Streaming Media passage through correspondence send to client.
Fig. 3 is the flow chart of an application implementation example of transfer processing method of Multi-channel Real-time files in stream media of the present invention.This application implementation example comprises that with two streaming media server A, B 3 transmission processing units 11,12,13 are that example describes.Wherein, streaming media server A comprises transmission processing unit 11 and transmission processing unit 12, should bear Streaming Media passage 21 and Streaming Media passage 22 mutually, and streaming media server B comprises transmission processing unit 13, should bear Streaming Media passage 23 mutually.Streaming Media passage 21,22,23 is respectively the source of 3 real time flow mediums; Each transmission processing unit is appreciated that the aggregate into acquisition of media, coding and stream output; Client is represented all clients that receive the real time flow medium file, is appreciated that the aggregate that receives, decodes and play into files in stream media.In this application implementation example, ntp server specifically support this NTP of the third edition among the RFC1305 (hereinafter to be referred as NTPv3) standard agreement, as shown in Figure 3, this application implementation example comprises following flow process:
Step 301, streaming media server A, B send the query time request respectively through Network Time Protocol to ntp server.
Step 302, ntp server are returned the query time response to streaming media server A, B respectively, comprise the on-demand system time information of ntp server in this query time response.
Step 303, streaming media server A, B proofread and correct self system clock according to the on-demand system time information in the query time response; Make it consistent with the system clock of ntp server respectively; Like this, streaming media server A is consistent with the system clock of streaming media server B, at this moment; Because transmission processing unit 11,12,13 adopts the work clock of the system clock of place streaming media server as self respectively, the work clock of transmission processing unit 11,12,13 is consistent.
Step 304, client are obtained request to streaming media server A and streaming media server B transmission Streaming Media respectively.
Step 305; Transmission processing unit 11,12,13 begins carry out shooting, collecting, the coding of multi-angle with scene; Obtain files in stream media; The files in stream media of Streaming Media passage 21,22,23 transmission that will be through correspondence is compressed into a plurality of packets, and according to sequencing to a plurality of packets respectively behind the mark time stamp T S, the Streaming Media passage 21,22,23 through correspondence sends to client respectively.Time stamp T S wherein is the corresponding current system time of Streaming Media passage 21,22,23 place streaming media servers.
Step 306, client be receiving stream media packet on Streaming Media passage 21,22,23 simultaneously.And when receiving each packet, the operation of execution in step 307 to step 313 is up to finishing receiving all packets that the Streaming Media request of obtaining that streaming media server A, B send to client is sent.
Step 307, whether the time variable θ that client identification is provided with in advance is non-null, value.If time variable θ is a non-null, value, execution in step 311.Otherwise, if time variable θ is a null value, execution in step 308.
The initial value that time variable θ is set in advance is a null value.
Step 308; Client is saved in packet the relevant position in Streaming Media passage 21, Streaming Media passage 22 or Streaming Media passage 23 corresponding buffer region 31, buffering area 32 or the buffering area 33 of this packet of transmission, and the packet in the buffering area 31,32,33 forms respectively according to the ascending order of time stamp T S and plays formation 41,42,43.
Whether step 309 all has packet in the client identification buffering area 31,32,33.If packet is all arranged, execution in step 310 in the buffering area 31,32,33.Otherwise,, do not carry out the subsequent operation of present embodiment as long as have a buffering area not have packet in the buffering area 31,32,33.
Step 310, client be the time stamp T S on first packet in the buffering area 31,32,33 relatively, chooses in a plurality of buffering areas the minimum time stamp T S of numerical value on first packet Min, obtain the minimum time stamp T S of numerical value MinAnd the difference TS between the system time TC Min-TC is with difference TS Min-TC gives time variable θ, and execution in step 314 then.
Step 311, whether the time stamp T S in the client recognition data bag is greater than client current system time TC and time variable θ value sum TC+ θ.If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, execution in step 312.Otherwise, if time stamp T S is greater than system time TC and time variable θ value sum TC+ θ, execution in step 313.
Step 312, the client packet discard.Afterwards, do not carry out the flow of present embodiment.
Step 313; Client is saved in packet the relevant position in Streaming Media passage 21, Streaming Media passage 22 or Streaming Media passage 23 corresponding buffer region 31, buffering area 32 or the buffering area 33 of this packet of transmission, and the packet in the buffering area 31,32,33 forms respectively according to the ascending order of time stamp T S and plays formation 41,42,43.
Step 314, client is play formation 41,42,43 to each, and whether monitoring system moment TC and time variable θ value sum TC+ θ reach and respectively play the time stamp T S on first packet in the formation.Do not reach when respectively playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ, do not carry out the flow of present embodiment.When system time TC and time variable θ value sum TC+ θ reach in some broadcast formations the time stamp T S on first packet, execution in step 315.
Step 315, the client packet in will this some broadcast formation is delivered to decoder successively and is carried out decompress(ion), decoding, broadcast, and client is finally exported picture 51,52,53, respectively corresponding Streaming Media passage 21,22,23.
In flow process embodiment illustrated in fig. 3; If owing to the network reason; For example: network speed is slower, causes the packet on the Streaming Media passage 22 that client receives to be abandoned continuously because of TS≤TC+ θ value sum TC+ θ, and client finishes the session connection of Streaming Media passage 22; Stop at receiving stream media packet on this Streaming Media passage 22; Again the Streaming Media that sends based on Streaming Media passage 22 to streaming media server A obtains request, and on Streaming Media passage 22, receives up-to-date flow media data packet again, can skip packet out-of-date on the Streaming Media passage 22 that is:; Receive up-to-date real time flow medium data, avoid constantly repeating receiving the outdated data bag, constantly abandon and cause can't normal play, the broadcasting pictures nonsynchronous problem corresponding with other Streaming Media passage.
Fig. 4 is the structural representation of an embodiment of receiving system of the present invention.The receiving system of this embodiment can be used for realizing the corresponding function of client in the transfer processing method of above-mentioned each the Multi-channel Real-time files in stream media of the present invention.As shown in Figure 4, it comprises memory cell 401, receiving element 402, first recognition unit 403, storage processing unit 404, first monitoring means 405 and playback process unit 406.
Wherein, memory cell 401 comprises a plurality of buffering areas that L Streaming Media passage is corresponding respectively, and stores the time variable θ that is provided with in advance, and wherein, L is the integer greater than 1.
Receiving element 402 is used on L Streaming Media passage, receiving packet to same flow-medium performance; This packet sends after stamping time stamp T S by a streaming media server in N the streaming media server; The system clock of N streaming media server is consistent; Wherein, N is for greater than 1 and be not more than the integer of L.
First recognition unit 403 is used for when the time variable θ of memory cell 401 is non-null, value, and whether the time stamp T S in the packet that identification receiving element 402 receives is greater than receiving system current system time TC and time variable θ value sum TC+ θ.
Storage processing unit 404 is used for the recognition result according to first recognition unit 403, if the time stamp T S in the packet is not more than current system time TC of receiving system and time variable θ value sum TC+ θ, abandons this packet; If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; Packet is saved in the memory cell 401 relevant position in the Streaming Media passage corresponding buffer region of this packet of transmission, the packet in the buffering area forms according to the ascending order of time stamp T S and plays formation.
First monitoring means 405 be used for monitoring system constantly TC and time variable θ value sum TC+ θ whether reach memory cell 401 respectively play the time stamp T S on first packet of formation.
Playback process unit 406 is used for the monitoring result according to first monitoring means 405; Reach when playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ, successively the packet in this broadcast formation in the memory cell 401 is carried out decompress(ion), decoding, broadcast.
The receiving system that provides based on the above embodiment of the present invention; When receiving the same flow-medium performance packet that on L Streaming Media passage, sends by N streaming media server; If the time variable θ that is provided with in advance is a non-null, value, to each packet that receives, whether the time stamp T S in the recognition data bag is greater than receiving system current system time TC and time variable θ value sum TC+ θ; When time stamp T S is not more than system time TC and time variable θ value sum TC+ θ; Abandon this packet, otherwise be saved in the relevant position in the Streaming Media passage corresponding buffer region of transmitting this packet, form and play formation according to the ascending order of time stamp T S; And reach when playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ; Successively the packet of playing in the formation is carried out decompress(ion), decoding, broadcast, under the situation of the system clock unanimity of N streaming media server, abandon the packet of overtime transmission; And play the broadcast formation in each buffering area successively according to the receiving system clock; The synchronous playing of the real time flow medium file of having realized multichannel is transmitted has avoided existing between a plurality of streaming media servers nonsynchronous situation between a plurality of pictures that reasons such as system's time difference, multichannel network transfer speeds be inconsistent cause, and makes that the user can the concrete scene of understanding directly perceived, complete, real; Improve the quality of service of streaming media service, promoted user experience.
Fig. 5 is the structural representation of another embodiment of receiving system of the present invention.The receiving system of this embodiment can be used for realizing the corresponding function of the above-mentioned middle client embodiment illustrated in fig. 2 of the present invention.Referring to Fig. 5; Compare with embodiment shown in Figure 4; The receiving system of this embodiment also comprises transmitting element 407; Be used for respectively sending Streaming Media to N streaming media server and obtain request, N streaming media server comprises L transmission processing unit, and this L transmission processing unit distinguished above-mentioned L the transmission processing unit Streaming Media passage in embodiment illustrated in fig. 4 of correspondence.
Further, again referring to Fig. 5,, can also comprise second recognition unit 408, the 3rd recognition unit 409 and acquiring unit 410 as another embodiment of receiving system of the present invention.Wherein, second recognition unit 408 is used for receiving packet in response to receiving element 402, and whether the time variable θ of storage is non-null, value in the recognition memory cell 401.Accordingly; First recognition unit 403 is specifically according to the recognition result of second recognition unit 408; When the time variable θ of storage was non-null, value in memory cell 401, whether the time stamp T S in the packet that identification receiving element 402 receives was greater than receiving system current system time TC and time variable θ value sum TC+ θ; When time variable θ was null value, indication storage processing unit 404 was saved in this packet the relevant position in the Streaming Media passage corresponding buffer region of transmits data packets in the memory cell 401.Storage processing unit 404 also is used for the indication according to first recognition unit 403, packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of transmits data packets in the memory cell 401.The 3rd recognition unit 409 is used for after storage processing unit 404 is saved in packet the relevant position of Streaming Media passage corresponding buffer region of transmits data packets, in a plurality of buffering areas that L Streaming Media passage is corresponding in the recognition memory cell 401 whether packet is arranged all.Acquiring unit 410 is used for the recognition result according to the 3rd recognition unit 409; When in a plurality of buffering areas, all packet being arranged; According to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas in the memory cell 401; And give time variable θ with time variable θ value, indicate then first monitoring means, 405 monitoring systems constantly TC whether reach the time stamp T S on first packet in the broadcast formation with time variable θ value sum TC+ θ.
Fig. 6 is the structural representation of another embodiment of receiving system of the present invention.The receiving system of this embodiment also can be used for realizing the corresponding function of client in the transfer processing method of above-mentioned each the Multi-channel Real-time files in stream media of the present invention.Referring to Fig. 6, to compare with embodiment shown in Figure 5, the receiving system of this embodiment also comprises second monitoring means 411, statistic unit 412 and session processing unit 413.Wherein, second monitoring means 411 is used to monitor the situation that abandons of packet on 404 pairs of L Streaming Media passages of storage processing unit.Statistic unit 412 is used for the monitoring result according to second monitoring means 411, adds up the packet loss of packet on L the Streaming Media passage respectively, and adds up the packet loss of data packets for transmission on each Streaming Media passage.Session processing unit 413 is used for the monitoring result according to second monitoring means 411; When a continuous N packet that in L Streaming Media passage, transmits on some Streaming Media passages all is dropped; Perhaps; According to the statistics of statistic unit 412, the packet loss of data packets for transmission reaches when presetting the packet loss threshold value on some Streaming Media passages, and indication receiving element 402 finishes the session connection of these some Streaming Media passages; And indication transmitting element 407 sends the request of obtaining again to the corresponding streaming media server of this some Streaming Media passage again; So that the transmission processing unit that some Streaming Media passages is corresponding carries out shooting, collecting, coding to flow-medium performance, obtain files in stream media, the files in stream media of current Streaming Media channel transfer is compressed into a plurality of packets; And in order to sending to receiving element through current Streaming Media passage behind a plurality of packet marking time stamp T S, time stamp T S wherein is the current system time of current Streaming Media passage place streaming media server.
Fig. 7 is the structural representation of an embodiment of transmission treatment system of Multi-channel Real-time files in stream media of the present invention.The transmission treatment system of this embodiment Multi-channel Real-time files in stream media can be used for realizing the flow process of the transfer processing method of above-mentioned each the Multi-channel Real-time files in stream media of the present invention.As shown in Figure 7, it comprises client 1 and N streaming media server 2, and the system clock of this N streaming media server is consistent, and wherein, N is the integer greater than 1.
Wherein, client 1 is used on L Streaming Media passage, receiving packet to same flow-medium performance, and this packet sends after stamping time stamp T S by a streaming media server 2 in N the streaming media server 2, and L is the integer that is not less than N.When the time variable θ that is provided with in advance was non-null, value, whether the time stamp T S in the packet that identification receives was greater than client 1 current system time TC and time variable θ value sum TC+ θ.If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, abandon this packet; If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; This packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of this packet of transmission, the packet in the buffering area forms according to the ascending order of time stamp T S and plays formation.And monitoring system constantly TC whether reach the time stamp T S on first packet in the broadcast formation with time variable θ value sum TC+ θ.Reach when playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ, successively the packet of playing in the formation is carried out decompress(ion), decoding, broadcast.
Streaming media server 2 is used for behind the packet marking time stamp T S, and a Streaming Media passage through in L the Streaming Media passage sends to client 1.
The transmission treatment system of the Multi-channel Real-time files in stream media that provides based on the above embodiment of the present invention; When client receives the same flow-medium performance packet that on L Streaming Media passage, is sent by N streaming media server; If the time variable θ that is provided with in advance is a non-null, value, to each packet that receives, whether the time stamp T S in the recognition data bag is greater than client current system time TC and time variable θ value sum TC+ θ; When time stamp T S is not more than system time TC and time variable θ value sum TC+ θ; Abandon this packet, otherwise be saved in the relevant position in the Streaming Media passage corresponding buffer region of transmitting this packet, form and play formation according to the ascending order of time stamp T S; And reach when playing in the formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ; Successively the packet of playing in the formation is carried out decompress(ion), decoding, broadcast, under the situation of the system clock unanimity of N streaming media server, abandon the packet of overtime transmission; And play the broadcast formation in each buffering area successively according to the client clock; The synchronous playing of the real time flow medium file of having realized multichannel is transmitted has avoided existing between a plurality of streaming media servers nonsynchronous situation between a plurality of pictures that reasons such as system's time difference, multichannel network transfer speeds be inconsistent cause, and makes that the user can the concrete scene of understanding directly perceived, complete, real; Improve the quality of service of streaming media service, promoted user experience.
In addition, corresponding with said method embodiment of the present invention as a specific embodiment of the present invention, client 1 can also be used for sending Streaming Media to N streaming media server 2 respectively and obtain request.N streaming media server 2 comprises L the transmission processing unit that L Streaming Media passage is corresponding altogether; Each transmission processing unit in this L transmission processing unit; Flow-medium performance is carried out shooting, collecting, coding; Obtain files in stream media; The files in stream media of current Streaming Media channel transfer is compressed into a plurality of packets, and in order to sending to client 1 through current Streaming Media passage behind a plurality of packet marking time stamp T S, time stamp T S wherein is the current system time of current Streaming Media passage place streaming media server 2.
As another specific embodiment of the present invention, corresponding with said method embodiment of the present invention, client 1 can also be used to discern whether the time variable θ that is provided with in advance is non-null, value; When time variable θ is non-null, value, carries out recognition time and stab TS whether greater than current system time TC of client 1 and the operation of time variable θ value sum TC+ θ; When time variable θ is null value, packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of transmits data packets, and in a plurality of buffering areas of L Streaming Media passage correspondence of identification, whether packet is arranged all; When in a plurality of buffering areas, all packet being arranged; According to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas; And give time variable θ with time variable θ value, whether TC and time variable θ value sum TC+ θ reach the operation of the time stamp T S on first packet in the broadcast formation constantly to begin to carry out monitoring system then.
As another specific embodiment of the present invention, corresponding with said method embodiment of the present invention, client 1 can also be used to monitor the situation that abandons of packet on L the Streaming Media passage; When a continuous N packet that in L Streaming Media passage, transmits on some Streaming Media passages all is dropped; Perhaps; Add up the packet loss of packet on L the Streaming Media passage respectively; The packet loss of data packets for transmission reaches when presetting the packet loss threshold value on some Streaming Media passages, finishes the session connection of this some Streaming Media passage, sends the request of obtaining again to the corresponding streaming media server 2 of this some Streaming Media passage again then.Accordingly; Corresponding streaming media server 2 also is used for through the corresponding transmission processing unit of this some Streaming Media passage; Again flow-medium performance is carried out shooting, collecting, coding, obtain files in stream media, the files in stream media of this some Streaming Media channel transfer is compressed into a plurality of packets; And in order to sending to client 1 through this some Streaming Media passage behind a plurality of packet marking time stamp T S, time stamp T S wherein is the current system time of corresponding streaming media server 2.
In addition; In the transmission treatment system of the Multi-channel Real-time files in stream media of above-mentioned each embodiment of the present invention; N-1 streaming media server 2 in N streaming media server 2; Can also be used for respectively system clock, the system clock of self is calibrated, make the system clock unanimity of N streaming media server 2 according to another streaming media server 2 beyond N the streaming media server 2 N-1 streaming media server 2.Perhaps, again referring to Fig. 7, the transmission treatment system of embodiment of the invention Multi-channel Real-time files in stream media can also comprise ntp server 3, is used to provide the frame of reference clock.Accordingly, N streaming media server 2 also is used for respectively according to the system clock of ntp server 3 system clock of self being calibrated, and makes that the system clock of N streaming media server 2 is consistent.
In the transmission treatment system of the Multi-channel Real-time files in stream media of above-mentioned each embodiment of the present invention, client 1 specifically can realize to the receiving system of arbitrary embodiment shown in Figure 6 through Fig. 4.As shown in Figure 8, be the structural representation of another embodiment of transmission treatment system of Multi-channel Real-time files in stream media of the present invention.Among this embodiment, client 1 has specifically adopted structure embodiment illustrated in fig. 6.
Each embodiment all adopts the mode of going forward one by one to describe in this specification, and what each embodiment stressed all is and the difference of other embodiment that same or analogous part cross-references gets final product between each embodiment.For device embodiment, because it is similar basically with method embodiment, so description is fairly simple, relevant part gets final product referring to the part explanation of method embodiment.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be accomplished through the relevant hardware of program command; Aforesaid program can be stored in the computer read/write memory medium; This program the step that comprises said method embodiment when carrying out; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
The embodiment of the invention has realized the synchronous playing to the real time flow medium file of multichannel transmission; Avoided existing between a plurality of streaming media servers system's time difference, multichannel network transfer speeds be inconsistent etc. between a plurality of pictures that reason causes nonsynchronous situation; Make that the user can the concrete scene of understanding directly perceived, complete, real; Improve the quality of service of streaming media service, promoted user experience;
Less to the streaming media service change, required cost is lower;
Do not receive the restriction of Streaming Media transmission control protocol; Applicable to various Streaming Media transmission control protocols, for example, real-time streaming protocol (Real Time Streaming Protocol; Hereinafter to be referred as: RTSP), RTP (Real Time Protocol; Hereinafter to be referred as: RTP), the real-time messages transportation protocol ((Real Time Messaging Protocol, hereinafter to be referred as: RTMP) etc., perhaps other special-purpose proprietary protocol;
Under the situation of not considering client self software and hardware decoding capability difference,, can the multichannel picture synchronization precision of client terminal playing be controlled in the 500ms based on existing accuracy of timekeeping.
Description of the invention provides for example with for the purpose of describing, and is not the disclosed form that exhaustively perhaps limit the invention to.A lot of modifications and variation are obvious for those of ordinary skill in the art.Selecting and describing embodiment is for better explanation principle of the present invention and practical application, thereby and makes those of ordinary skill in the art can understand the various embodiment that have various modifications that the present invention's design is suitable for special-purpose.

Claims (17)

1. the transfer processing method of a Multi-channel Real-time files in stream media is characterized in that, comprising:
Client receives packet to same flow-medium performance on L Streaming Media passage; Said packet sends after stamping time stamp T S by a streaming media server in N the streaming media server; The system clock of a said N streaming media server is consistent; Wherein, N is the integer greater than 1, and L is the integer that is not less than N;
When said client was non-null, value at the time variable θ that is provided with in advance, whether recognition time stabbed TS greater than said client current system time TC and time variable θ value sum TC+ θ;
If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, said client abandons said packet;
If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; Said client is saved in said packet the relevant position in the Streaming Media passage corresponding buffer region of transmitting said packet, and the packet in the said buffering area forms according to the ascending order of time stamp T S and plays formation;
Whether said client monitors system time TC and time variable θ value sum TC+ θ reach the time stamp T S on first packet in the said broadcast formation;
When said client reaches in the said broadcast formation time stamp T S on first packet at system time TC and time variable θ value sum TC+ θ, successively the packet in the said broadcast formation is carried out decompress(ion), decoding, broadcast.
2. method according to claim 1 is characterized in that, said client, also comprised before receiving packet on L the Streaming Media passage to same flow-medium performance:
Said client is sent Streaming Media to said N streaming media server respectively and is obtained request, and said L L corresponding transmission processing unit of Streaming Media passage lays respectively on the said N streaming media server;
Each transmission processing unit in the said L transmission processing unit; Said flow-medium performance is carried out shooting, collecting, coding; Obtain files in stream media; The files in stream media of current Streaming Media channel transfer is compressed into a plurality of packets, and in order to sending to said client through current Streaming Media passage behind a plurality of packet marking time stamp T S, said time stamp T S is the current system time of current Streaming Media passage place streaming media server.
3. method according to claim 2 is characterized in that, said client receives after the packet on L Streaming Media passage to same flow-medium performance, also comprises:
Whether said client is discerned said time variable θ is non-null, value;
When said time variable θ is non-null, value, carries out said recognition time and stab TS whether greater than current system time TC of said client and the operation of time variable θ value sum TC+ θ;
When said time variable θ was null value, said client was saved in said packet the relevant position in the Streaming Media passage corresponding buffer region of transmitting said packet;
In a plurality of buffering areas of L Streaming Media passage correspondence of said client identification, whether packet is arranged all;
When in a plurality of buffering areas, all packet being arranged; Said client is according to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas; And give said time variable θ with time variable θ value, carry out the operation whether said client monitors system time TC and time variable θ value sum TC+ θ reach the time stamp T S on first packet in the said broadcast formation then.
4. method according to claim 3 is characterized in that, comprises according to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas:
Time stamp T S in more a plurality of buffering areas on first packet;
Choose in a plurality of buffering areas the minimum time stamp T S of numerical value on first packet Min
Obtain the minimum time stamp T S of numerical value MinAnd the difference TS between the system time TC Min-TC is with difference TS Min-TC is as time variable θ value.
5. according to any described method of claim 1 to 4, it is characterized in that said client, also comprised to same flow-medium performance before receiving packet on L the Streaming Media passage:
Said client is created a plurality of buffering areas respectively to L Streaming Media passage.
6. according to any described method of claim 1 to 4, it is characterized in that, also comprise:
The situation that abandons of packet on said client monitors L Streaming Media passage;
When the continuous N packet that said client is transmitted on some Streaming Media passages in L Streaming Media passage all is dropped; Perhaps; Add up the packet loss of packet on L the Streaming Media passage respectively; The packet loss of data packets for transmission reaches when presetting the packet loss threshold value on some Streaming Media passages; Finish the session connection of this some Streaming Media passage, send to the corresponding streaming media server of this some Streaming Media passage again then and obtain request again, so that the corresponding transmission processing unit of said some Streaming Media passages is carried out the operation of said flow-medium performance being carried out shooting, collecting, coding again.
7. according to any described method of claim 1 to 4, said client, also comprised before receiving packet on L the Streaming Media passage to same flow-medium performance:
A said N streaming media server according to the system clock of same NTP ntp server, is calibrated the system clock of self respectively, makes that the system clock of a said N streaming media server is consistent;
Perhaps; N-1 streaming media server in the said N streaming media server; Respectively according to the system clock of another streaming media server beyond N-1 streaming media server in the said N streaming media server; System clock to self is calibrated, and makes that the system clock of a said N streaming media server is consistent.
8. a receiving system is characterized in that, comprising:
Memory cell comprises a plurality of buffering areas that L Streaming Media passage is corresponding respectively, and stores the time variable θ that is provided with in advance that L is the integer greater than 1;
Receiving element; Be used on L Streaming Media passage, receiving packet to same flow-medium performance; Said packet sends after stamping time stamp T S by a streaming media server in N the streaming media server; The system clock of a said N streaming media server is consistent, and wherein, N is for greater than 1 and be not more than the integer of L;
First recognition unit is used for when said time variable θ is non-null, value, and whether recognition time stabs TS greater than said receiving system current system time TC and time variable θ value sum TC+ θ;
Storage processing unit is used for the recognition result according to said first recognition unit, if time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, abandons said packet; If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; Said packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of the said packet of transmission, the packet in the said buffering area forms according to the ascending order of time stamp T S and plays formation;
First monitoring means is used for monitoring system moment TC and time variable θ value sum TC+ θ and whether reaches the time stamp T S on said first packet of broadcast formation;
The playback process unit; Be used for monitoring result according to said first monitoring means; When system time TC and time variable θ value sum TC+ θ reach in the said broadcast formation time stamp T S on first packet, successively the packet in the said broadcast formation is carried out decompress(ion), decoding, broadcast.
9. device according to claim 8 is characterized in that, also comprises:
Transmitting element is used for sending Streaming Media to said N streaming media server respectively and obtains request, and said L L corresponding transmission processing unit of Streaming Media passage lays respectively on the said N streaming media server.
10. device according to claim 9 is characterized in that, also comprises:
Second recognition unit is used for receiving packet in response to said receiving element, and whether discern said time variable θ is non-null, value;
Specifically according to the recognition result of said second recognition unit, when the time variable θ that is provided with in advance was non-null, value, whether recognition time stabbed TS greater than said receiving system current system time TC and time variable θ value sum TC+ θ to said first recognition unit; When said time variable θ is null value, indicate said storage processing unit said packet to be saved in the relevant position in the Streaming Media passage corresponding buffer region of transmitting said packet;
Said storage processing unit also is used for the indication according to said first recognition unit, said packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of transmitting said packet;
The 3rd recognition unit is used for after said storage processing unit is saved in said packet the relevant position of the Streaming Media passage corresponding buffer region of transmitting said packet, discerns in the corresponding a plurality of buffering areas of L Streaming Media passage whether packet is all arranged;
Acquiring unit; Be used for recognition result according to said the 3rd recognition unit; When in a plurality of buffering areas, all packet being arranged; According to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas, and give said time variable θ with time variable θ value, whether TC and time variable θ value sum TC+ θ reach the time stamp T S on first packet in the said broadcast formation constantly to indicate the said first monitoring means monitoring system then.
11. according to claim 9 or 10 described devices, it is characterized in that, also comprise:
Second monitoring means is used to monitor the abandon situation of said storage processing unit to packet on L the Streaming Media passage;
Statistic unit is used for adding up respectively the packet loss of packet on L the Streaming Media passage, and adds up the packet loss of data packets for transmission on each Streaming Media passage;
The session processing unit; Be used for monitoring result according to said second monitoring means; When a continuous N packet that in L Streaming Media passage, transmits on some Streaming Media passages all is dropped; Perhaps; According to the statistics of said statistic unit, the packet loss of data packets for transmission reaches when presetting the packet loss threshold value on some Streaming Media passages, indicates said receiving element to finish the session connection of this some Streaming Media passage; And indicate said transmitting element to send the request of obtaining again to the corresponding streaming media server of this some Streaming Media passage again; So that the transmission processing unit that said some Streaming Media passage is corresponding carries out shooting, collecting, coding to said flow-medium performance, obtain files in stream media, the files in stream media of current Streaming Media channel transfer is compressed into a plurality of packets; And in order to sending to said receiving element through current Streaming Media passage behind a plurality of packet marking time stamp T S, said time stamp T S is the current system time of current Streaming Media passage place streaming media server.
12. the transmission treatment system of a Multi-channel Real-time files in stream media is characterized in that, comprises a client and N streaming media server, the system clock of a said N streaming media server is consistent, and N is the integer greater than 1;
Said client is used on L Streaming Media passage, receiving packet to same flow-medium performance, and said packet sends after stamping time stamp T S by a streaming media server in N the streaming media server, and L is the integer that is not less than N; When the time variable θ that is provided with in advance was non-null, value, whether recognition time stabbed TS greater than said client current system time TC and time variable θ value sum TC+ θ; If time stamp T S is not more than system time TC and time variable θ value sum TC+ θ, abandon said packet; If time stamp T S is greater than system time TC and time variable θ value sum TC+ θ; Said packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of the said packet of transmission, the packet in the said buffering area forms according to the ascending order of time stamp T S and plays formation; Whether monitoring system moment TC and time variable θ value sum TC+ θ reach the time stamp T S on first packet in the said broadcast formation; When system time TC and time variable θ value sum TC+ θ reach in the said broadcast formation time stamp T S on first packet, successively the packet in the said broadcast formation is carried out decompress(ion), decoding, broadcast;
Said streaming media server is used for behind the packet marking time stamp T S, and a Streaming Media passage through in L the Streaming Media passage sends to said client.
13. system according to claim 12 is characterized in that, said client also is used for sending Streaming Media to said N streaming media server respectively and obtains request;
A said N streaming media server comprises L the transmission processing unit that L Streaming Media passage is corresponding altogether; Each transmission processing unit in the said L transmission processing unit; Said flow-medium performance is carried out shooting, collecting, coding; Obtain files in stream media; The files in stream media of current Streaming Media channel transfer is compressed into a plurality of packets, and in order to sending to said client through current Streaming Media passage behind a plurality of packet marking time stamp T S, said time stamp T S is the current system time of current Streaming Media passage place streaming media server.
14. system according to claim 13 is characterized in that, whether said client also is used to discern said time variable θ is non-null, value; When said time variable θ is non-null, value, carries out said recognition time and stab TS whether greater than current system time TC of said client and the operation of time variable θ value sum TC+ θ; When said time variable θ is null value, said packet is saved in the relevant position in the Streaming Media passage corresponding buffer region of the said packet of transmission, and in a plurality of buffering areas of L Streaming Media passage of identification correspondence, whether packet is arranged all; When in a plurality of buffering areas, all packet being arranged; According to the time stamp T S acquisition time variable θ value on first packet in a plurality of buffering areas; And give said time variable θ with time variable θ value, whether TC and time variable θ value sum TC+ θ reach the operation of the time stamp T S on first packet in the said broadcast formation constantly to begin to carry out monitoring system then.
15. system according to claim 14 is characterized in that, said client also is used to monitor the situation that abandons of packet on L the Streaming Media passage; When a continuous N packet that in L Streaming Media passage, transmits on some Streaming Media passages all is dropped; Perhaps; Add up the packet loss of packet on L the Streaming Media passage respectively; The packet loss of data packets for transmission reaches when presetting the packet loss threshold value on some Streaming Media passages, finishes the session connection of this some Streaming Media passage, sends the request of obtaining again to the corresponding streaming media server of said some Streaming Media passages again then;
The streaming media server of said correspondence also is used for through the corresponding transmission processing unit of some Streaming Media passages; Again said flow-medium performance is carried out shooting, collecting, coding; Obtain files in stream media; The files in stream media of said some Streaming Media channel transfer is compressed into a plurality of packets; And in order to sending to said client through said some Streaming Media passages behind a plurality of packet marking time stamp T S, said time stamp T S is the current system time of the streaming media server of said correspondence.
16. system according to claim 12; It is characterized in that; N-1 streaming media server in the said N streaming media server; Also be used for respectively system clock, the system clock of self is calibrated, make the system clock unanimity of a said N streaming media server according to another streaming media server beyond said N the streaming media server N-1 streaming media server; Perhaps
Said system also comprises ntp server, is used to provide the frame of reference clock;
A said N streaming media server also is used for respectively according to the system clock of said ntp server the system clock of self being calibrated, and makes that the system clock of a said N streaming media server is consistent.
17., it is characterized in that said client is specially any described receiving system of claim 8 to 11 according to any described system of claim 12 to 16.
CN201110097241.9A 2011-04-19 2011-04-19 The transfer processing method of multichannel real time flow medium file and system, receiving system Active CN102752669B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110097241.9A CN102752669B (en) 2011-04-19 2011-04-19 The transfer processing method of multichannel real time flow medium file and system, receiving system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110097241.9A CN102752669B (en) 2011-04-19 2011-04-19 The transfer processing method of multichannel real time flow medium file and system, receiving system

Publications (2)

Publication Number Publication Date
CN102752669A true CN102752669A (en) 2012-10-24
CN102752669B CN102752669B (en) 2015-09-16

Family

ID=47032530

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110097241.9A Active CN102752669B (en) 2011-04-19 2011-04-19 The transfer processing method of multichannel real time flow medium file and system, receiving system

Country Status (1)

Country Link
CN (1) CN102752669B (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104378675A (en) * 2014-12-08 2015-02-25 厦门雅迅网络股份有限公司 Multichannel audio-video synchronized playing processing method
CN104702582A (en) * 2013-12-10 2015-06-10 乐视网信息技术(北京)股份有限公司 Method and device for transmitting data
WO2016101453A1 (en) * 2014-12-22 2016-06-30 中兴通讯股份有限公司 Method and device for compressing time stamp
CN106911589A (en) * 2015-12-22 2017-06-30 阿里巴巴集团控股有限公司 A kind of data processing method and equipment
CN106997620A (en) * 2016-01-26 2017-08-01 滴滴(中国)科技有限公司 Charging method and device based on GPS data point
CN106998478A (en) * 2017-03-15 2017-08-01 青岛海信电器股份有限公司 A kind of offset correction method and device for intelligent television current play list
CN107371061A (en) * 2017-08-25 2017-11-21 普联技术有限公司 A kind of video stream playing method, device and equipment
CN108173897A (en) * 2016-12-07 2018-06-15 北京云中融信网络科技有限公司 Request message processing method and processing device
CN109011507A (en) * 2018-07-13 2018-12-18 辽宁江多科技有限公司 Body-building counting seconds counter and counting meter second method
CN109743397A (en) * 2019-01-11 2019-05-10 广东省气象公共服务中心(广东气象影视宣传中心) Marine information early warning system, method and electronic equipment
CN109769124A (en) * 2018-12-13 2019-05-17 广州华多网络科技有限公司 Mixed flow method, apparatus, electronic equipment and storage medium
CN111107166A (en) * 2019-12-31 2020-05-05 奇安信科技集团股份有限公司 Session synchronization method, device, electronic equipment and medium
CN111381792A (en) * 2020-03-12 2020-07-07 上海曼恒数字技术股份有限公司 Virtual reality data transmission method and system supporting multi-person cooperation
US11449908B2 (en) 2015-07-29 2022-09-20 Beijing Didi Infinity Technology And Development Co., Ltd. Method and system for determining transport service fee

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852431A (en) * 2005-12-23 2006-10-25 华为技术有限公司 System and method for realizing video frequency information sharing
CN101075948A (en) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 Method for realizing realtime fluid-medium programm reliable transmission
WO2010020843A1 (en) * 2008-07-16 2010-02-25 Nokia Corporation Method and apparatus for peer to peer streaming
WO2010049312A1 (en) * 2008-10-30 2010-05-06 Thomson Licensing Data container for transferring high resolution audio/video data in a high speed ip network
CN101951387A (en) * 2010-09-30 2011-01-19 海信集团有限公司 Method and device for transmitting stream media

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1852431A (en) * 2005-12-23 2006-10-25 华为技术有限公司 System and method for realizing video frequency information sharing
CN101075948A (en) * 2006-05-15 2007-11-21 中兴通讯股份有限公司 Method for realizing realtime fluid-medium programm reliable transmission
WO2010020843A1 (en) * 2008-07-16 2010-02-25 Nokia Corporation Method and apparatus for peer to peer streaming
WO2010049312A1 (en) * 2008-10-30 2010-05-06 Thomson Licensing Data container for transferring high resolution audio/video data in a high speed ip network
CN101951387A (en) * 2010-09-30 2011-01-19 海信集团有限公司 Method and device for transmitting stream media

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702582A (en) * 2013-12-10 2015-06-10 乐视网信息技术(北京)股份有限公司 Method and device for transmitting data
CN104378675A (en) * 2014-12-08 2015-02-25 厦门雅迅网络股份有限公司 Multichannel audio-video synchronized playing processing method
WO2016101453A1 (en) * 2014-12-22 2016-06-30 中兴通讯股份有限公司 Method and device for compressing time stamp
CN105791228A (en) * 2014-12-22 2016-07-20 中兴通讯股份有限公司 Method and device for compressing timestamp
CN105791228B (en) * 2014-12-22 2019-12-03 中兴通讯股份有限公司 A kind of method and apparatus of compression time stamp
US11449908B2 (en) 2015-07-29 2022-09-20 Beijing Didi Infinity Technology And Development Co., Ltd. Method and system for determining transport service fee
CN106911589A (en) * 2015-12-22 2017-06-30 阿里巴巴集团控股有限公司 A kind of data processing method and equipment
CN106911589B (en) * 2015-12-22 2020-04-24 阿里巴巴集团控股有限公司 Data processing method and equipment
US11055272B2 (en) 2015-12-22 2021-07-06 Alibaba Group Holding Limited Data processing method and apparatus
CN106997620A (en) * 2016-01-26 2017-08-01 滴滴(中国)科技有限公司 Charging method and device based on GPS data point
CN108173897A (en) * 2016-12-07 2018-06-15 北京云中融信网络科技有限公司 Request message processing method and processing device
CN108173897B (en) * 2016-12-07 2020-09-08 北京云中融信网络科技有限公司 Request message processing method and device
CN106998478A (en) * 2017-03-15 2017-08-01 青岛海信电器股份有限公司 A kind of offset correction method and device for intelligent television current play list
CN107371061A (en) * 2017-08-25 2017-11-21 普联技术有限公司 A kind of video stream playing method, device and equipment
CN107371061B (en) * 2017-08-25 2021-03-19 普联技术有限公司 Video stream playing method, device and equipment
CN109011507A (en) * 2018-07-13 2018-12-18 辽宁江多科技有限公司 Body-building counting seconds counter and counting meter second method
CN109769124A (en) * 2018-12-13 2019-05-17 广州华多网络科技有限公司 Mixed flow method, apparatus, electronic equipment and storage medium
CN109743397A (en) * 2019-01-11 2019-05-10 广东省气象公共服务中心(广东气象影视宣传中心) Marine information early warning system, method and electronic equipment
CN109743397B (en) * 2019-01-11 2022-09-23 广东省气象公共服务中心(广东气象影视宣传中心) Marine information early warning system and method and electronic equipment
CN111107166B (en) * 2019-12-31 2022-05-17 奇安信科技集团股份有限公司 Session synchronization method, device, electronic equipment and medium
CN111107166A (en) * 2019-12-31 2020-05-05 奇安信科技集团股份有限公司 Session synchronization method, device, electronic equipment and medium
CN111381792A (en) * 2020-03-12 2020-07-07 上海曼恒数字技术股份有限公司 Virtual reality data transmission method and system supporting multi-person cooperation
CN111381792B (en) * 2020-03-12 2023-06-02 上海曼恒数字技术股份有限公司 Virtual reality data transmission method and system supporting multi-user cooperation

Also Published As

Publication number Publication date
CN102752669B (en) 2015-09-16

Similar Documents

Publication Publication Date Title
CN102752669A (en) Transfer processing method and system for multi-channel real-time streaming media file and receiving device
KR101927145B1 (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
US11758209B2 (en) Video distribution synchronization
EP2690876A2 (en) Heterogeneous network-based linked broadcast content transmitting/receiving device and method
CN101465996B (en) Method, equipment and system for displaying network television time
US20120033035A1 (en) Method and system for transmitting/receiving 3-dimensional broadcasting service
WO2013144347A1 (en) Marker-based inter-destination media synchronization
KR20130050953A (en) Method for transceiving media files and device for transmitting/receiving using same
CN101202613B (en) Terminal for clock synchronization
KR101640148B1 (en) Device and method for synchronizing an interactive mark to streaming content
WO2014193996A2 (en) Network video streaming with trick play based on separate trick play files
CN109089129B (en) Stable multi-video binding live broadcasting system and method thereof
KR20160110424A (en) Robust live operation of dash
WO2013190787A1 (en) Reception device, and synchronous processing method therefor
Concolato et al. Synchronized delivery of multimedia content over uncoordinated broadcast broadband networks
EP2814256B1 (en) Method and apparatus for modifying a stream of digital content
TWI393431B (en) Mobile tv system and method for synchronizing the rendering of streaming services thereof
CN100544448C (en) A kind of clock system of mobile multimedia network
CN113169969A (en) Multicast to unicast conversion
KR20230154051A (en) Method for providing time-synchronized multi-stream data transmission
CN100571119C (en) A kind of mobile network of utilization realizes the method for clock synchronization
AU2015204359A1 (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant