CN100469072C - Multi-source flow media transmission QoS control method - Google Patents
Multi-source flow media transmission QoS control method Download PDFInfo
- Publication number
- CN100469072C CN100469072C CNB2005100960825A CN200510096082A CN100469072C CN 100469072 C CN100469072 C CN 100469072C CN B2005100960825 A CNB2005100960825 A CN B2005100960825A CN 200510096082 A CN200510096082 A CN 200510096082A CN 100469072 C CN100469072 C CN 100469072C
- Authority
- CN
- China
- Prior art keywords
- media
- transmission
- code rate
- streaming media
- source flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Communication Control (AREA)
Abstract
The method includes five modules: interpreter for description language of multiple source stream media, bandwidth allocation of multiple source stream media, fixed value breadth examination, data transmission control, and RTP/RTCP. Based on MSML file, MSML interpreter obtains URL of each path of stream media, and requirement of transmission quality. Based on requirement of QoS of stream media transmission and bandwidth value obtained by detection module, the bandwidth allocation module determines transmission rate and encoding of each stream media. Based on VCR command and state of buffer, module of data transmission controls media transmission. RTP/RTCP module realizes ordered transmission in real time. The method realizes QoS control to lower transmission delay and packet lose rate. The invention is suitable to application areas such as video on demand in multiwindow, network video monitoring, network instruction on demand, and live programme etc.
Description
Technical field
The invention belongs to Computer Design and applied technical field, relate to computer software, data transmission technology, multimedia technology and IP network, particularly a kind of multi-source flow media transmission QoS control method.
Background technology
At present, the main single channel Streaming Media of main object of convection current matchmaker transmission QoS research, the method for dealing with problems is mainly by methods such as buffer scheduling, network resource reservation based on moving speed.Carrying out single source and course medium when transmitting, effect is better, yet when carrying out multi-source flow media transmission QoS control, above-mentioned technique effect is unsatisfactory.
At multi-source flow media transmission QoS control method, the applicant is new through looking into, and retrieves 4 pieces of documents comparatively closely related to the present invention, and they are respectively:
1, based on the multi-channel video playback of Qos
2, have stream media system structural research and the design that QoS guarantees among the IP network VOD
3、Realtime?multimedia?transport?using?multiple?paths
4.An?application-level?QoS?comparison?of?single-stream?and?multi-streamapproaches?in?a?wireless?ad?hoc?network
Above-mentioned document has proposed the multiple buffer and the dispatching algorithm thereof that are adopted when multi-channel video carries out playback respectively; Realize QoS based on RSVP; Adopt the mode of multipath to realize that the multithread real-time Transmission reaches looking the method that audio frequency is divided into the two-way flow transmission and carries out Synchronization Control at receiving terminal.Wherein, multiple buffer control and dispatching algorithm can solve the jitter problem when playing to a certain extent, but produce powerless aspect Network Transmission; Adopt RSVP RSVP, can be between the Streaming Media transmission in network reserved resource, this needs network support, and can not dynamically adjust according to change of network environment; Adopt the multi-path transmission method can mask the subnetwork fault, but do not judge that can network be satisfied with the transmission requirement of specific Streaming Media; Audio frequency and video are separated transmission has increased overhead, can make problem complicated more when carrying out the multi-source flow media transmission.
In addition, existing language SMIL (the Synchronized Multimedia IntegrationLanguage that describes multi-source flow media, synchronous multimedia integrate language) lays particular emphasis on the presentation information of describing the multi-way stream medium, lack description multi-source flow media QoS control information.Present network bandwidth method of testing, as the Pathchar algorithm or the bag to algorithm, all be by in network the input data detect available bandwidth, the method that this class is initiatively imported data can impact test result, particularly in high speed network environment, will produce than large deviation.In addition, these class methods can only obtain the current maximum available bandwidth of network, can't obtain packet loss.Present bandwidth allocation methods is primarily aimed at the single channel Media Stream, the coordinated allocation that can not carry out the network bandwidth to the multipath media stream of concurrent transmission according to the type and the qos requirement of Media Stream.In addition, existing bandwidth allocation methods is according to maximum available bandwidth, does not consider the packet loss under this bandwidth.
Therefore, carrying out Streaming Media transmits when particularly multi-source flow media transmits, prior art can not solve carries out the problem that the dynamic optimization distribution was accurately detected and when available network bandwidth changes at any time the transmission bandwidth of multi-source flow media was carried out in each department to network availability bandwidth, and this has limited the service quality of Streaming Media transmission to a certain extent.
Summary of the invention
The objective of the invention is to propose a kind of multi-source flow media transmission QoS control method, concrete condition and network availability bandwidth situation according to each road medium in the multi-source flow media, the delay and the packet loss of transfer of data have been reduced on the whole, can be optimized utilization to Internet resources, to improve the transmission quality of multi-source flow media.
The technical solution that realizes foregoing invention is: a kind of multi-source flow media transmission QoS (Quality ofService) control method: carry out according to the following steps:
At first, adopt multi-source flow media language MSML interpreter to obtain the metadata information of multi-source flow media from the MSML file, the Streaming Media type in this information, transmission quality requirements will be used for the QoS control of transmission of flow media data;
Then, adopt the definite value bandwidth detection can transmit the flank speed of data according to RTP/RTCP agreement judgement current network conditions; According to this result, the multi-source flow media bandwidth allocation module is in conjunction with Streaming Media type, transmission quality requirements, the code check supported, obtains the available the highest code rate under current network conditions of every road Streaming Media and the transmission rate of code rate multiple; Definite value bandwidth detection and multi-source flow media bandwidth allocation module alternate run at any time according to the latest network available bandwidth, obtain the highest available code rate and multiple transmission rate;
At last, the Data Transmission Controlling module sends more code rate and the instruction of multiple transmission rate according to user's VCR order and allocated bandwidth result to the RTP/RTCP module; The RTP/RTCP module is carried out the real-time Transmission of Streaming Media under the control of Data Transmission Controlling module.
Described multi-source flow media language MSML is a kind of descriptive language based on XML, the control of support multi-source flow media transmission QoS and synchronous playing; The information that MSML describes comprises three types: one, the essential information of each road Streaming Media comprises title, URL, type; Two, the transmission quality requirements of each road Streaming Media comprises code rate scope, maximum delay, the maximum packet loss that allows of allowing; Three, presentation information in each road streaming media playing process comprises video window initial size, position.
Described definite value bandwidth detection is meant that the minimum speed limit that adopts the RTP/RTCP protocol detection and obtain to support from medium is to the dirty media delivery packet loss of each speed the highest available transmission rate of network, and the maximum packet loss that the transmission of this packet loss and Streaming Media is allowed compares, if it is littler than predetermined packet loss, think that then current network conditions can satisfy the transfer of data under this speed, otherwise just think that current network conditions can not satisfy the transfer of data under this speed.
Described multi-source flow media allocated bandwidth is meant the result according to the definite value bandwidth detection, adjust the code rate and the transmission rate of each road Streaming Media, adjust and divide following two kinds of situations to handle: one, when if certain road Streaming Media comes from the streaming media server different with other Streaming Media, then adopt definite value bandwidth detection algorithm to detect the code rates at different levels of this road Streaming Media from high to low, up to the highest code rate that finds current network state to support, if the difference that buffering area is maximum empty or wherein media data packet and minimum current presentative time stabs PTS (PresentationTimeStamp) then detects times speed of this speed that network state is supported less than certain threshold level; If buffering area be sky or wherein the difference of the maximum of media data packet and minimum PTS greater than certain threshold level, with code rate as a times speed; At last, the highest code rate that current network state is supported is as the code rate of this road Streaming Media, and times speed is as actual transfer rate; Two, if wherein several roads Streaming Media comes from same streaming media server, then determine the candidate set of the total code rate of these Media Streams according to the priority of medium type, and by the highest total code rate of definite value bandwidth detection algorithm selection, if when the difference of buffering area for maximum empty or wherein media data packet and minimum PTS also needs with corresponding times of speed of definite value bandwidth detection greater than certain threshold level, otherwise, with the highest total code rate as total times of speed; At last, the highest code rate that current network state is supported is as the code rate of these medium, and according to the shared proportion of each road Streaming Media speed in total code rate total times of speed correspondingly decomposed each road medium as actual transfer rate.
The present invention adopts said method, can judge that can current network state satisfy the media delivery of set speed according to essential information, synchronizing information, medium type, qos requirement and the presentation information of each road medium in the multi-source flow media.Under the situation of limited bandwidth, according to the type and the QoS demand of Streaming Media, the multipath concurrence media data from the various flows media server is distributed bandwidth, thereby reduce the delay and the packet loss of transfer of data on the whole.By above-mentioned strategy, Internet resources are optimized utilization, to improve the transmission quality of multi-source flow media.
Description of drawings
Fig. 1 is the composition of controlling mechanism of the present invention;
Fig. 2 is the working mechanism of controlling mechanism of the present invention.
Embodiment
In order more to be expressly understood the present invention, the present invention is described in further detail below in conjunction with accompanying drawing.
With reference to shown in Figure 1, at first, multi-source flow media language MSML interpreter is used for obtaining from the MSML file metadata information of multi-source flow media, and the Streaming Media type in this information, transmission quality requirements will be used for the QoS control of transmission of flow media data;
Then, the definite value bandwidth detection adopts RTP/RTCP agreement judgement current network conditions can transmit the flank speed of data; According to this result, the multi-source flow media bandwidth allocation module is adjusted the code rate of every road Streaming Media and the transmission rate of code rate multiple in conjunction with Streaming Media type, transmission quality requirements; Definite value bandwidth detection and multi-source flow media bandwidth allocation module alternate run carry out allocated bandwidth according to the latest network situation at any time;
At last, the Data Transmission Controlling module is according to user's VCR order and allocated bandwidth result, and the convection current media delivery is controlled; The RTP/RTCP module is carried out the real-time Transmission of Streaming Media under the control of Data Transmission Controlling module, and finishes the re-transmission of obliterated data according to the data volume in the buffering area.
1, the composition of multi-source flow media transmission QoS controlling mechanism
The multi-source flow media transmission QoS controlling mechanism is made up of MSML interpreter, definite value bandwidth detection, multi-source flow media allocated bandwidth, Data Transmission Controlling and five modules of RTP/RTCP.
The MSML interpreter is used for obtaining from the MSML file metadata information of multi-source flow media; Wherein, Streaming Media type, the transmission quality requirements QoS control that will be used for transmitting.The definite value bandwidth detection is used to judge that can current network conditions satisfy the transfer of data that certain determines speed.The multi-source flow media bandwidth allocation module is determined the code rate and the transmission rate of medium according to definite value bandwidth detection result and Streaming Media type, transmission quality requirements.The Data Transmission Controlling module is controlled media delivery according to VCR order and allocated bandwidth result.The RTP/RTCP protocol module is used to realize the re-transmission of transmission and lost data packets in order in real time of Streaming Media.
2, the working mechanism of multi-source flow media transmission QoS controlling mechanism
With reference to shown in Figure 2, the multi-source flow media transmission QoS controlling mechanism is mainly with event driven manner work.After the Streaming Media type and qos requirement information from the MSML file, be core with the Data Transmission Controlling module, finish multi-source flow media transmission QoS control by process user VCR control, buffer state and timer three class incidents; In processing procedure, transmission control module calls multi-source flow media distribution module, RTP/RTCP module.Event type and processing procedure are as follows:
■ VCR control
1) when beginning to play, adopts RTSP or MMS (Microsoft Media Server) Protocol to obtain the code rates at different levels of each road Streaming Media, and, carry out the multi-source flow media allocated bandwidth simultaneously with flank speed notice media server transmission data;
2) when suspending broadcast, adopt RTSP or MMS (Microsoft Media Server) Protocol notice media server to suspend the transmission data;
3) when continuing to play, adopt RTSP or MMS (Microsoft Media Server) Protocol notice media server to continue the transmission data with present encoding speed and transmission rate;
4) when stopping to play, adopt RTSP or MMS (Microsoft Media Server) Protocol notice media server to stop to transmit data, and closing passage.
5) when dragging to a certain moment when playing, empty buffering area, and, carry out the multi-source flow media allocated bandwidth simultaneously with flank speed notice media server transmission data.
The ■ buffer state
1) this road medium time delay re-executes the multi-source flow media allocated bandwidth less than certain threshold level (5 seconds) in buffer pool size;
2) this road medium time delay is greater than certain threshold level (30 seconds) in buffer pool size, and the transmission rate of each road medium of multi-source flow media is set to code rate.
The ■ timer
Regularly re-execute the multi-source flow media allocated bandwidth.
In carrying out the multi-source flow media bandwidth allocation, call definite value bandwidth detection check current network state and whether satisfy for the bandwidth of each road media distribution, according to testing result, for every road Streaming Media carries out allocated bandwidth again.
In handling " beginning to play ", " dragging to a certain moment broadcast ", " buffering area holds the medium time delay less than certain threshold level " event procedure, the transmission rate of distributing for Streaming Media generally is the multiple of institute's transmission medium code rate, can fill buffering area fast like this, to reduce period of reservation of number.
3, the interface of each module of multi-source flow media transmission QoS controlling mechanism
The interface of ■ multi-source flow media bandwidth allocation module
Bandinfo[]AllotBand(Mediainfo?MediaArray[])；
This function is determined the transmission rate of multi-path media and the code rate of institute's medium body.
The parameter of function AllotBand is the array of Mediainfo type, and the Mediainfo type definition is as follows:
Struct?Mediainfo{
char[]url，
int?Mediatype，
int?Minband，
int?Maxlost
}
Wherein, url is the URL of Streaming Media; Mediatype is a medium type, comprises three types of audio frequency, video, screen; Minband, Maxlost are the qos requirement of these medium, are respectively minimum bandwidth, the maximum packet loss that allows.
Function AllotBand returns the array of Bandinfo type, and the Bandinfo type definition is as follows:
Struct?Bandinfo{
int?coding_speed，
int?trans_speed
}
Wherein, coding_speed is a code rate; Trans_speed is a transmission rate.
The interface of ■ definite value bandwidth detection
Int?Bandtest(intb，int?lmax，int?pmax，int?pmin)；
This function is used to judge whether current network state satisfies bandwidth requirement.
Wherein, b is certain the road Streaming Media definite value bandwidth that needs to check, maximum packet loss lmax, maximum and minimum PTS pmax and the pmin of this Media Stream in buffering area that this road Streaming Media allows; Be returned as packet loss, when returning-1, illustrate that current network conditions can not satisfy bandwidth b.Definite value bandwidth detection algorithm is called by the multi-source flow media bandwidth allocation algorithm.
The interface of ■ RTSP/MMS module
| Interface definition | Interface specification |
| Void get_description (); | Obtain the code rates at different levels of Streaming Media. |
| Void setup (); | Transmission channel between opening player and the media server. |
| Void vcr_control (vcr_type vcr); | Media delivery is carried out VCR control, comprise time-out, recovery, end, F.F., location etc. |
| Void close (); | Close the transmission channel between player and the media server. |
| Callback receive_control (* byte control) | Mode receiving control information with call back function. |
The interface of ■ RTP/RTCP module
4, based on the multi-source flow media language MSML of XML
MSML is a kind of simply based on the SGML of XML, can be used for describing essential information, synchronizing information, medium type, qos requirement and the presentation information of each road medium of multi-source flow media.
The demonstration separated into two parts of MSML.First is a beginning part (Header Section), the global property that definition here shows, such as the information that the messagewindow in the player will show, window is present condition in each road DST PLAYER process, comprises video window initialization size, position.
Second portion is main part (Body Section), here mainly specify the synchronizing information of Streaming Media, the essential information of medium comprises title, URL, type, the qos requirement of Streaming Media is set, comprises code rate scope, maximum delay time and maximum packet loss.
The frame structure of MSML file is as follows:
<msml>
<head>
<meta/>
... the essential information of each road medium is described ...
<layout>
... be current required initialization information in the definition streaming media playing process ...
</layout>
</head>
<body>
<par>
... the essential information of given Streaming Media ...
... set the required relevant parameter of transmission quality ...
<par>
</body>
</msml>
Label is described as follows table:
| Label | Function |
| <meta/> | Allow the designer to set the medium metadata |
| <layout></layout> | If specified the layout data, it must be included between these two labels so |
| <root-layout/> | It is included in<layout>With</layout>Between, specify the window displayed size |
| <region> | Streaming media video window displayed zone, every road is set |
| <par></par> | The parallel broadcast<par>With</par>Between each road files in stream media |
| <video> | Provide the relevant information of video file and the transmission quality of this road video is set |
| <audio> | Provide the relevant information of audio file and the transmission quality of this road audio frequency is set |
| <screen> | Provide the relevant information of screen and the transmission quality that screen is play is set |
The attribute of meta label is provided with as follows:
The attribute of layout label is provided with as follows:
| Attribute | Value | Function |
| id | Any character string | The name of this window is described |
| width | Pixel is the numerical value or the percentage of unit | The width of regulation window |
| height | Pixel is the numerical value or the percentage of unit | The height of regulation window |
| left，top | Pixel is the numerical value or the percentage of unit | Determine that this zone relatively and the position, the upper left corner of parent window |
| bottom，right | Pixel is the numerical value or the percentage of unit | Determine that this zone relatively and the position, the upper right corner of parent window |
| z-index | Any numerical value | Determine the residing level of each window |
The attribute setting of files in stream media
| Attribute | Value | Function |
| url | Filename or complete URL path | Specify the position of files in stream media |
| region | Any area-name that defines in the demonstration | For Streaming Media distributes play area |
| codespeed_fro m | Any effective numerical value | The starting point of prescribed coding speed value |
| codespeed_to | Any effective numerical value | The terminal point of prescribed coding speed value |
| max_delay | Any effective numerical value | Specify maximum delay time |
| max_lose | Any effective numerical value | Specify maximum packet loss |
| begin | Any legal timing | The reproduction time of specified file |
| end | Any legal timing | The concluding time of specified file |
| dur | Any legal timing | The duration that specified file is play |
| id | Any character string | Give this file id corresponding among the meta |
5, definite value bandwidth detection
In on-demand process, because the code rate of media data is known, therefore, whether we only need the packet loss of these rate media data of transmission under the check current network conditions less than the middle maximum packet loss that allows of this Streaming Media QoS demand, can judge the transmission of media data effect.
Given this, we have designed a kind of definite value bandwidth estimation algorithm, are used to detect under the situation that allows limited secondary data to retransmit the packet loss of certain special speed Media Stream.Definite value bandwidth estimation algorithm is as follows:
Algorithm input: certain the road Streaming Media definite value bandwidth b that needs inspection
v, the maximum packet loss l that allows of this road Streaming Media
Max, maximum and the minimum PTS p of this Media Stream in buffering area
Max, p
Min
Algorithm output: packet loss 1; When returning-1, illustrate that current network conditions can not satisfy bandwidth b
v, i.e. l
Max＜l
r
Intermediate variable:, send duration t
s, time t
sThe RTP bag number m that receives, RTP wraps big or small s, allows number of retransmissions n, fixed delay t in the re-transmission
c
Arthmetic statement is as follows:
STEP1. be empty as if buffering area, or (p
Max-p
Min)/(t
c+ s/b
v)＜1, then n=0; Otherwise n=[(p
Max-p
Min)/(t
c+ s/b
v)], f (x)=[x] is Gaussian function, n 〉=1 expression allows data re-transmission.
STEP2. as if n=0, at t
sIn time, media server is b to the player transmission rate
vThe media data packet number be (t
s* b
v)/s, packet loss is l=1-(t
s* b
v)/(s * m); If l≤l
Max, then current network conditions satisfies the transmission of these rate media data, returns l, otherwise, return-1;
STEP3. if retransmission mechanism is then introduced in n 〉=1, this moment, packet loss was l
n, if l
n≤ l
Max, then current network conditions can satisfy the transmission of these rate media data, returns l
nIf l
nL
Max, current network conditions does not satisfy the transmission of these rate media data, returns-1.
Compare with other algorithm, the main feature of this method is:
1) obtains the ability of a certain pre-determined rate bandwidth of link transmission, and needn't estimate the whole available bandwidths of link;
2) not initiatively to network input data, test process is a unperturbed to network;
3) measuring process has truly reflected the transmission course of link data;
4) there is not the problem that other flow disturbs on the link that is subjected to.
6, multi-source flow media allocated bandwidth
Each road medium of forming multi-source flow media may be from a plurality of media servers, and because the medium type difference is also different to the requirement of media delivery.To the audio stream medium, require lower packet loss and shake, and in Streaming Media, occupy critical positions; For the screen flow medium, requiring has high-resolution, but frame rate is less demanding, the prior position of occupation ratio video in Streaming Media.In addition, every road medium also have concrete qos requirement.
For under limited network state, obtain good apparent mass, we have designed a kind of multi-source flow media bandwidth allocation algorithm, and the multipath concurrence media data from the various flows media server is distributed bandwidth, thereby reduce the delay and the packet loss of transfer of data in integral body.
The multi-source flow media bandwidth allocation algorithm is every road media categories bandwidth according to type, qos requirement, buffering area and the network state of medium in the mode of souning out.The multi-source flow media bandwidth allocation algorithm is as follows:
Algorithm input: the Streaming Media URL of every road medium in the Streaming Media of n road
i, medium type Mediatype
i, minimum bandwidth Minband
i, maximum packet loss Maxlost
i, present encoding speed CodingSpeed
I, t, the multiple Times of current transmission rate and code rate
I, t, the present packet loss Lost of every road medium in the Streaming Media of n road
I, t, the time delay d in buffering area
I, t, d
I, t=p
Max, i, t-p
Min, i, t, p
Max, i, tWith p
Min, i, tBe current maximum and the minimum PTS in buffering area of this Media Stream, i ∈ [l, n].
Algorithm output: the code rate CodingSpeed of every road medium in the Streaming Media of n road
I, t+1, the multiple Times of transmission rate and code rate
I, t+1, i ∈ [l, n].
STEP1. establish the set that M is a n road Streaming Media,
Be the set that meets the following conditions: for M
EIn any Streaming Media, derive from different media servers with other any Streaming Media among the M.To M
EIn the following operation of all Streaming Media executed in parallel:
If the sequence number of Media Stream is j.
The time delay d of STEP1.1 medium in buffering area
J, t=0 o'clock, CodingSpeed then
J, t+1Be set to the highest code rate of this road medium support, Times is set
J, t+1Be 2.
Time delay 0＜the d of STEP1.2 medium in buffering area
J, tDuring≤d:
If Lost
I, t〉=Maxlost
iAnd Times
I, t1.5, CodingSpeed is set
J, t+1Be CodingSpeed
J, t, Times is set
J, t+1Be Times
J, t-0.5;
If Lost
I, t〉=Maxlost
iAnd Times
I, t≤ 1.5 and CodingSpeed
J, tMinband
i, CodingSpeed is set
J, t+1For than CodingSpeed
J, tThe code rate of low one-level is provided with Times
J, t+1Be 2;
If Lost
I, t〉=Maxlost
iAnd Times
I, t≤ 1.5 and CodingSpeed
J, t≤ Minband
i, CodingSpeed is set
J, t+1Be Minband
i, Times is set
J, t+1Be 1;
If Lost
I, t≤ Maxlost
iAnd Times
I, t≤ 2.5, CodingSpeed is set
J, t+1Be CodingSpeed
J, t, Times is set
J, t+1Be Times
J, t+ 0.5;
If Lost
I, t≤ Maxlost
iAnd Times
I, t2.5 and CodingSpeed
J, tNot the highest code rate, CodingSpeed is set
J, t+1For than CodingSpeed
J, tHigher leveled code rate is provided with Times
J, t+1Be 2;
If Lost
I, t≤ Maxlost
iAnd Times
I, t2.5 and CodingSpeed
J, tBe the highest code rate, CodingSpeed is set
J, t+1Be CodingSpeed
J, t, Times is set
J, t+1Be Times
I, t
The time delay d of medium＜d in buffering area
J, tThe time:
If Lost
I, t〉=Maxlos
tI and CodingSpeed
J, tMinband
i, CodingSpeed is set
J, t+1For than CodingSpeed
J, tThe code rate of low one-level is provided with Times
J, i+1Be 1;
If Lost
I, t〉=Maxlos
tI and CodingSpeed
J, t≤ Minband
i, CodingSpeed is set
J, t+1Be Minband
i, Times is set
J, t+1Be 1;
If Lost
I, t≤ Maxlost
iAnd CodingSpeed
J, tNot the highest code rate, CodingSpeed is set
J, t+1For than CodingSpeed
J, tHigher leveled code rate is provided with Times
J, t+1Be 1;
If Lost
I, t≤ Maxlost
iAnd Times
I, t2.5 and CodingSpeed
J, tBe the highest code rate, CodingSpeed is set
J, t+1Be CodingSpeed
J, t, Times is set
J, t+1Be 1.
STEP2. establish M
M=M-M
E, with M
MBe divided into several subclass M
M, k, k ∈ [l, m].Medium in each subclass derive from same media server, and the medium in each subclass derive from different media servers.
STEP3. at M
M, kIn, each road medium should have identical packet loss, identical times speed, has identical time delay at buffering area, establishes M
M, kPresent packet loss be Lost
M, k, t, transmission rate and code rate multiple be Times
M, k, t, time delay is d
M, k, t, M
M, kIn each road medium present encoding speed sum CodingSpeed
M, k, tLost
M, k, t, d
M, k, tWith M
M, kIn packet loss, the buffer delay of any one road medium identical.To each M
M, kThe following operation of executed in parallel:
STEP3.1 determines M
M, kIn the priority of every road medium, wherein audio stream priority is 3, screen Media Stream priority is 2, the video media flow priority is 1, the medium of same type have identical priority.
The time delay d of STEP3.2 medium in buffering area
M, k, t=0 o'clock, to M
M, kIn any one road medium j, with CodingSpeed
J, t+1Be set to the highest code rate of this road medium support, Times is set
J, t+1Be 2.
Time delay 0＜the d of STEP3.3 medium in buffering area
M, k, tDuring≤d:
If M
M, kIn have one road medium j, make Lost
M, k, t〉=Maxlost
jAnd current Times
J, t1.5, then keep M
M, kIn the transmission rate of all medium constant, Times is set
J, t+1Be Times
J, t-0.5;
If M
M, kIn have one road medium j, make Lost
M, k, t〉=Maxlost
jAnd Times
I, t≤ 1.5, then in the Media Stream of all present encoding speed, seek the minimum Media Stream of priority greater than minimum permission speed, be assumed to be medium l, CodingSpeed is set
L, t+1For than CodingSpeed
L, tThe code rate of low one-level is provided with M
M, kTimes speed of all medium is 2.If M
M, kThere is not the Media Stream of code rate, M then is set greater than minimum permission speed
M, kIn the code rate of all medium be that corresponding minimum allows speed, M is set
M, kTimes speed of all medium is 1.
If M
M, kIn arbitrary medium j, all satisfy Lost
M, k, t〉=Maxlost
j, and Times
I, t≤ 2.5, CodingSpeed is set
J, t+1Be CodingSpeed
J, t, Times is set
J, t+1Be Times
J, t+ 0.5;
If M
M, kIn arbitrary medium j, all satisfy Lost
M, k, t〉=Maxlost
j, and Times
I, t2.5, then in not being the Media Stream of the highest code rate, all present encoding speed do not seek the highest Media Stream of priority, be assumed to be medium l, CodingSpeed is set
L, t+1For than CodingSpeed
L, tHigher leveled code rate is provided with M
M, kTimes speed of all medium is 2.If M
M, kThe present encoding speed of all medium all is the highest code rate, keeps the code rate of each road medium and times speed constant.The time delay d of medium＜d in buffering area
M, k, tThe time:
If M
M, kIn have one road medium j, make Lost
M, k, t〉=Maxlost
j, then in the Media Stream of all present encoding speed, seek the minimum Media Stream of priority greater than minimum permission speed, be assumed to be medium l, CodingSpeed is set
L, t+1For than CodingSpeed
L, tThe code rate of low one-level is provided with M
M, kTimes speed of all medium is 1.If M
M, kThere is not the Media Stream of code rate, M then is set greater than minimum permission speed
M, kIn the code rate of all medium be that corresponding minimum allows speed, M is set
M, kTimes speed of all medium is 1.
If M
M, kIn arbitrary medium j, all satisfy Lost
M, k, t〉=Maxlost
j, then in not being the Media Stream of the highest code rate, all present encoding speed do not seek the highest Media Stream of priority, be assumed to be medium l, CodingSpeed is set
L, t+1For than CodingSpeed
L, tHigher leveled code rate is provided with M
M, kTimes speed of all medium is 1.If M
M, kThe present encoding speed of all medium all is the highest code rate, keeps the code rate of each road medium, and M is set
M, kTimes speed of all medium is 1.
Claims (4)
1, a kind of multi-source flow media transmission QoS (Quality of Service) control method is characterized in that, carries out according to the following steps:
At first, adopt multi-source flow media language MSML interpreter to obtain the metadata information of multi-source flow media from the MSML file, the Streaming Media type in this information, transmission quality requirements will be used for the QoS control of transmission of flow media data;
Then, adopt the definite value bandwidth detection can transmit the flank speed of data according to RTP/RTCP agreement judgement current network conditions; According to this result, the multi-source flow media bandwidth allocation module is in conjunction with Streaming Media type, transmission quality requirements, the code rate supported, obtains the available the highest code rate under current network conditions of every road Streaming Media and the transmission rate of code rate multiple; Definite value bandwidth detection and multi-source flow media bandwidth allocation module alternate run at any time according to the latest network available bandwidth, obtain the highest available code rate and multiple transmission rate;
At last, the Data Transmission Controlling module sends renewal code rate and the instruction of multiple transmission rate according to user's VCR order and allocated bandwidth result to the RTP/RTCP module; The RTP/RTCP module is carried out the real-time Transmission of Streaming Media under the control of Data Transmission Controlling module.
2, multi-source flow media transmission QoS control method according to claim 1 is characterized in that: described multi-source flow media language MSML is a kind of descriptive language based on XML, the control of support multi-source flow media transmission QoS and synchronous playing; The information that MSML describes comprises three types: one, the essential information of each road Streaming Media comprises title, URL, type; Two, the transmission quality requirements of each road Streaming Media comprises code rate scope, maximum delay, the maximum packet loss that allows of allowing; Three, the presentation information in each road streaming media playing process comprises video window initial size, position.
3, multi-source flow media transmission QoS control method according to claim 1, it is characterized in that: described definite value bandwidth detection is meant that the minimum code rate that adopts the RTP/RTCP protocol detection and obtain to support from Streaming Media is to the dirty media delivery packet loss of each code rate the highest available transmission rate of network, and the maximum packet loss that the transmission of this packet loss and Streaming Media is allowed compares, if it is littler than predetermined packet loss, think that then current network conditions can satisfy the transfer of data under this speed, otherwise just think that current network conditions can not satisfy the transfer of data under this speed.
4, multi-source flow media transmission QoS control method according to claim 1, it is characterized in that: described multi-source flow media allocated bandwidth is meant the result according to the definite value bandwidth detection, adjust the code rate and the transmission rate of each road Streaming Media, adjust and divide following two kinds of situations to handle: one, when if certain road Streaming Media comes from the streaming media server different with other Streaming Media, then adopt definite value bandwidth detection algorithm to detect the code rates at different levels of this road Streaming Media from high to low, up to the highest code rate that finds current network state to support, if the difference that buffering area is maximum empty or wherein media data packet and minimum current presentative time stabs PTS (Presentation TimeStamp) then detects times speed of this speed that network state is supported less than certain threshold level; If the difference of the maximum of media data packet and minimum PTS is greater than certain threshold level, with this speed as a times speed; At last, the highest code rate that current network state is supported is as the code rate of this road Streaming Media, and times speed is as actual transfer rate; Two, if wherein several roads Streaming Media comes from same streaming media server, then determine the candidate set of the total code rate of these Streaming Medias according to the priority of medium type, and by the highest total code rate of definite value bandwidth detection algorithm selection, if when buffering area be sky or wherein the difference of the maximum of media data packet and minimum PTS less than certain threshold level, adopt corresponding times of speed of definite value bandwidth detection, if the difference of the maximum of media data packet and minimum PTS is greater than certain threshold level, with the highest total code rate as total times of speed; At last, the highest code rate that current network state is supported is as the code rate of these Streaming Medias, and according to the shared proportion of each road Streaming Media speed in total code rate total times of speed correspondingly decomposed each road Streaming Media as actual transfer rate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100960825A CN100469072C (en) | 2005-09-29 | 2005-09-29 | Multi-source flow media transmission QoS control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2005100960825A CN100469072C (en) | 2005-09-29 | 2005-09-29 | Multi-source flow media transmission QoS control method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1744592A CN1744592A (en) | 2006-03-08 |
| CN100469072C true CN100469072C (en) | 2009-03-11 |
Family
ID=36139786
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005100960825A Expired - Fee Related CN100469072C (en) | 2005-09-29 | 2005-09-29 | Multi-source flow media transmission QoS control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100469072C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI696961B (en) * | 2018-12-12 | 2020-06-21 | 財團法人工業技術研究院 | Deep neural networks (dnn) hardware accelerator and operation method thereof |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100382549C (en) * | 2006-04-13 | 2008-04-16 | 中山大学 | System for realizing multi data source flow media on-line view |
| CN100588249C (en) * | 2006-07-27 | 2010-02-03 | 腾讯科技（深圳）有限公司 | Method, system and terminal for adjusting video quality |
| CN101227604B (en) * | 2007-01-18 | 2010-05-19 | 上海未来宽带技术及应用工程研究中心有限公司 | Method for detecting network video quality by network injury tolerance |
| CN101030938B (en) * | 2007-02-05 | 2010-04-14 | 北京大学 | System and method for organizing and transmitting QoS self-adaptive P2P flow medium data |
| KR20090000582A (en) * | 2007-02-27 | 2009-01-08 | 삼성전자주식회사 | Method and apparatus for relay streaming data |
| CN101068236B (en) * | 2007-04-13 | 2011-10-26 | 华为技术有限公司 | Streaming media bit rate control method, system and equipment |
| CN101212647B (en) * | 2007-07-18 | 2010-06-09 | 中国科学技术大学 | Two-way HFC network based stream media service implementation method and device |
| CN101287002B (en) * | 2008-05-21 | 2010-12-29 | 华中科技大学 | Method for enhancing amount of concurrent media flow of flow media server |
| CN101296184B (en) * | 2008-05-30 | 2011-04-13 | 华为技术有限公司 | Method, system and device for data transmission |
| CN101753985B (en) * | 2008-11-27 | 2012-10-03 | 北京中星微电子有限公司 | Video monitoring system, and medium flow transmitting control device and method in the video monitoring system |
| JP4650573B2 (en) * | 2009-01-22 | 2011-03-16 | ソニー株式会社 | COMMUNICATION DEVICE, COMMUNICATION SYSTEM, PROGRAM, AND COMMUNICATION METHOD |
| CN101635830B (en) * | 2009-08-18 | 2011-09-28 | 深圳市同洲电子股份有限公司 | Method of video on demand, server side and client side |
| CN103733633B (en) * | 2011-05-12 | 2017-11-21 | 索林科集团 | Video analytic system |
| CN102891878A (en) | 2011-07-18 | 2013-01-23 | 索尼公司 | Transmission method and transmission system of wireless data, client and service end controller |
| CN105429983B (en) * | 2015-11-27 | 2018-09-14 | 刘军 | Acquire method, media termination and the music lesson system of media data |
| CN106453306A (en) * | 2016-10-08 | 2017-02-22 | 广东欧珀移动通信有限公司 | Media data transmission synchronous method, device and system |
| CN111083094B (en) * | 2018-10-22 | 2022-06-07 | ***通信有限公司研究院 | Code stream switching method and device for streaming media and computer storage medium |
| CN111917662B (en) * | 2019-05-07 | 2024-04-26 | 华为技术有限公司 | Bandwidth reservation method and related equipment |
| CN113726562A (en) * | 2021-08-19 | 2021-11-30 | 中国电子科技集团公司第二十八研究所 | Method for evaluating network communication bandwidth required by monitoring information transmission between air traffic control systems |
-
2005
- 2005-09-29 CN CNB2005100960825A patent/CN100469072C/en not_active Expired - Fee Related
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI696961B (en) * | 2018-12-12 | 2020-06-21 | 財團法人工業技術研究院 | Deep neural networks (dnn) hardware accelerator and operation method thereof |
| US11551066B2 (en) | 2018-12-12 | 2023-01-10 | Industrial Technology Research Institute | Deep neural networks (DNN) hardware accelerator and operation method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1744592A (en) | 2006-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100469072C (en) | Multi-source flow media transmission QoS control method | |
| US8351762B2 (en) | Adaptive media playout method and apparatus for intra-media synchronization | |
| US7652993B2 (en) | Multi-stream pro-active rate adaptation for robust video transmission | |
| Akhshabi et al. | An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP | |
| KR102050816B1 (en) | Systems and methods for using client-side video buffer occupancy for enhanced quality of experience in a communication network | |
| CN101296184B (en) | Method, system and device for data transmission | |
| US20100254462A1 (en) | Method for reducing memory usage with accelerated channel changes | |
| Wijesekera et al. | Quality of service (QoS) metrics for continuous media | |
| Zhou et al. | A control-theoretic approach to rate adaption for DASH over multiple content distribution servers | |
| WO2018165487A1 (en) | Excess bitrate distribution based on quality gain in sabr server | |
| KR20060115216A (en) | Apparatus and method for transmitting multimedia streaming | |
| US8355450B1 (en) | Buffer delay reduction | |
| CN103733632A (en) | Dynamic bit rate adaptation over bandwidth varying connection | |
| CN102946570A (en) | Transmission system and method for multi-stream streaming media of self-adaption network bandwidth | |
| CN102439938A (en) | Method for controlling download rate of real-time streaming as needed by media player | |
| EP4014480A1 (en) | Prediction-based dropped frame handling logic in video playback | |
| Montagud et al. | How to perform AMP? Cubic adjustments for improving the QoE | |
| Huang et al. | Tsync: A new synchronization framework for multi-site 3d tele-immersion | |
| CN102055761B (en) | Control method and system of dynamic feedback of service quality of end-to-end service | |
| KR102304476B1 (en) | Multipath-based block transmission system and streaming method for adaptive streaming service | |
| Din et al. | Synchronization techniques in distributed multimedia presentation | |
| Montagud et al. | Design, development and assessment of control schemes for IDMS in a standardized RTCP-based solution | |
| Qiao et al. | Lip synchronization within an adaptive VOD system | |
| Chang et al. | ATF: an Adaptive Three-layer Framework for inter-stream synchronization of SMIL multimedia presentations | |
| Vargas Hernández | A contribution to video streaming quality and energy efficiency in optical and ethernet networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090311 Termination date: 20140929 |
|
| EXPY | Termination of patent right or utility model |