CN102868666A - Implementation method of streaming media quality monitoring report based on user experience interaction - Google Patents
Implementation method of streaming media quality monitoring report based on user experience interaction Download PDFInfo
- Publication number
- CN102868666A CN102868666A CN2011101893772A CN201110189377A CN102868666A CN 102868666 A CN102868666 A CN 102868666A CN 2011101893772 A CN2011101893772 A CN 2011101893772A CN 201110189377 A CN201110189377 A CN 201110189377A CN 102868666 A CN102868666 A CN 102868666A
- Authority
- CN
- China
- Prior art keywords
- server
- client
- quality
- streaming media
- report
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to an implementation method of a streaming media quality monitoring report based on user experience interaction. The implementation method comprises the steps that: a user-defined two-way-transmission experience quality QoE interaction protocol and relative network environment parameters and business performance parameters are firstly set; a server monitors the streaming media transmission state; a client monitors the streaming media receiving state and estimates the user experience quality; an S-C (server-client) report and a (client-server) report are respectively generated and are transmitted through a network; and the real-time interaction of streaming media quality monitoring reports is realized between the client and the server. In the invention, according to the base of the existing network technology, the multi latest results of the streaming media quality monitoring and monitoring technology are widely absorbed, and the method is comprehensively provided. The method disclosed by the invention has the advantages that the operation steps are simple, the occupied bandwidth resources are few, the computing difficulty is low, the existing network does not need be updated and reformed, and the implementation is easy, the method has an important significance to the operation and management of the streaming media in the existing network, and has a good population and application prospect.
Description
Technical field
The present invention relates to a kind of implementation method of experiencing mutual stream media quality Surveillance based on the user, belong to the multimedia communication technology field.
Background technology
Streaming Media is a kind of technology that audio frequency, video and other multimedia elements are play in mode real-time, that need not to download wait on Internet and wireless network.Stream media technology can provide continual audio and video data streams to the user, satisfies the user and views and admires online dynamically audio-visual demand.
Fast development along with computer network, and the developing rapidly of the wireless networks such as 3G (Third Generation) Moblie technology 3G (3rd-generation) and WLAN WLAN (Wireless Local Area Network), the application of streaming media service is more and more extensive.The key areas of using in cable network is IPTV IPTV (Interactive Personal TV), and is mainly mobile flow medium in the mobile network field.
But, in existing network, especially when frequency spectrum resource wireless network at full stretch provides streaming media service, network delay, the network adverse circumstances such as congested tend to make the transmission of multi-medium data bag to produce time-delay, packet loss, shake or the situation such as out of order, thereby the quality of service of Streaming Media is worsened, experience to the user and cause adverse effect.For Virtual network operator and service provider, needs adopt effectively, accurately stream media quality evaluation and test scheme is monitored its service transmission performance, and then the optimized network performance, improve service quality.
Yet, present stream media quality evaluating method and the actual use of streaming media and control protocol are all undesirable, do not react truly quality of service, also fail streaming media service is realized in real time evaluation and test and monitoring, its main cause is that client and server fail in time to carry out information interaction: on the one hand, client can not in time be known the network environment condition, let alone grasps the impact that network environment causes user experience quality; On the other hand, streaming media server can not be known the user experience quality of client in real time, exactly, in order in time adjust network parameter, this is the two large problems that exists in the current streaming media service quality monitoring.
The below introduces the prior art overview of relevant mobile flow medium quality report:
(1) utilizes network parameter, directly at network side predicted flows media quality.For example, document " Research on Monitoring Quality of 3G Streaming Media Service " [C] (publishing in " International Conference on Communication Systems; Networks and Applications " 2010) utilizes the parameter such as number of dropped packets, packet loss, packet delay, packet jitter of network terminal that stream media quality is evaluated and tested.Document " No-Reference Quality Assessment for Networked Video via Primary Analysis of Bit Stream " [J] (publishing in " IEEE Transactions on circuits and video technology " 2010), coding side quantization step, frame per second and the isoparametric impact of network terminal packet loss have been considered, and be weighted the final objective evaluation of realizing video flow quality in time domain.IETF RFC4445 also proposes a kind of method of the IPTV of measurement transmission quality: MDI (Media Delivery Index), also only uses two kinds of network parameter: DF (Delay Factor) and MLR (Media Loss Rate) to measure.
(2) utilize the form of report, the professional ability of client is reported streaming media server.For example, Chinese invention patent application " a kind of method of reporting ability and associated processing device " (application number 200810056281.7) has been introduced a kind of report method, but the method only limits to the professional ability sign of client is reported to server, does not have interactivity; And the judgement of the professional ability of client is not the standard that is perceived as with the user, and the judged result of this ability can only be adjusted network state for server reference is provided, can not be as complete foundation.Chinese invention patent application " method and apparatus that is used for reporting streaming media quality cross reference to related applications " (application number 200780048832.9) has been introduced the method for another kind of cross reference reporting streaming media quality, the method mainly lays particular emphasis on the method for report, does not relate to content and the obtain manner thereof of report.A kind of TV service management method, system and Service Quality Management node that Chinese invention patent application " TV service management method and system, Service Quality Management node " (application number 201010174116.9) relates to, can overcome the defective that the IPTV operational indicator can't be measured automatically, but the parameter of IPTV terminal to report only has audience ratings, request success rate, packet loss, frame loss rate and shake etc., does not relate to the professional transmission of audio frequency and video own and the Quality of experience of viewing and admiring.
(3) in traditional RTP/RTCP/RTSP protocol family, what service transmission quality was played control action is rtcp protocol, and rtcp protocol utilizes network parameter to judge and the evaluation assignment quality, and adjusts the parameters such as the network bandwidth with this.But rtcp protocol is not monitored and is analyzed user's business experience quality, therefore can not reflect fully truly the streaming media service quality of client.
As seen from the above analysis, independently carry out in client on the basis of Streaming Media Quality of experience evaluation, implement overall merit in conjunction with network parameter, and with the method for client relevant parameter real-time report to streaming media server, so far all yet there are no pertinent literature both at home and abroad delivers, simultaneously, present existing agreement is also having many deficiencies aspect the quality of service judgement of experiencing based on the user and the control.
Summary of the invention
In view of this, the purpose of this invention is to provide a kind of implementation method of experiencing mutual stream media quality Surveillance based on the user.The present invention be directed to the stream media quality monitoring demand of present appearance, and take into full account the enforceable technical foundation of existing network, extensively draw again the newest fruits of present multiple stream media quality monitoring, monitoring technique, carry out complex optimum and propose.Compare with existing various quality monitoring technology schemes, the inventive method is on existing network technology basis, take full advantage of relevant advanced person, the mature technology disposed in the network, user experience quality and the relevant parameter of Quality of experience QoE (Quality of Experience) the protocol transmission Streaming Media by self-defining transmitted in both directions, between client and server, realize real-time, interactive, solved well the two large problems in the above-mentioned streaming media service quality monitoring.
In order to achieve the above object, the present invention proposes a kind of implementation method of experiencing mutual stream media quality Surveillance based on the user, it is characterized in that: Quality of experience QoE interaction protocol and network of relation environmental parameter (Network Environment Parameters) and service feature parameter (Service Performance Parameters) that self-defining transmitted in both directions at first is set, the transmission situation of monitoring server Streaming Media, the reception situation of client monitors Streaming Media is also estimated its user experience quality, generation server reports that to the S-C of client (Server-Client Report) and client arrive the C-S report (Client-Server Report) of server respectively, again via Internet Transmission, between client and server, realize the real-time, interactive of stream media quality Surveillance, thereby the streaming media service quality of transmission is between the two realized Real-Time Monitoring.
The present invention is based on the user and experience the implementation method of mutual stream media quality Surveillance, utilize QoE interaction protocol and the relevant parameter of self-defining transmitted in both directions, network environment parameter when making the Streaming Media client can in time obtain professional transmission, analyze wired and radio network conditions to the transmission impact of streaming media service, and obtain the Quality of experience of service-user in conjunction with the streaming media service quality evaluating method of setting.Streaming media server again by with the real-time, interactive of client, understand, learn the client user to the Quality of experience of streaming media service, in order to network condition or streaming media service parameter are adjusted in good time, improve professional service quality.
From the angle of Virtual network operator, the bandwidth resources that the inventive method takies seldom can directly apply to existing network, need not carry out extra change and upgrading to existing network; From the angle of network client, the transmission of the mutual report of QoE can't affect the transmission of Streaming Media plays, and is conducive on the contrary evaluation and the lifting of quality of service.
Moreover the operating procedure of the inventive method is simple, and difficulty in computation is low, easily realizes, and is significant to the actual operation and management of streaming media service, in the application that promotes the streaming media service quality, has preferably popularizing application prospect and value.
Description of drawings
Fig. 1 the present invention is based on the flow chart that the user experiences mutual Streaming Media monitoring quality method for reporting.
Fig. 2 is that QoE agreement of the present invention realizes schematic diagram.
Fig. 3 is S-C report structural representation of the present invention.
Fig. 4 is C-S report structural representation of the present invention.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, the present invention is described in further detail below in conjunction with drawings and Examples.
The present invention is a kind of method of experiencing mutual stream media quality Surveillance based on the user: Quality of experience QoE interaction protocol and network of relation environmental parameter and service feature parameter that self-defining transmitted in both directions at first is set, the transmission situation of monitoring server Streaming Media, the reception situation of client monitors Streaming Media is also estimated its user experience quality, generation server is to the C-S report that S-C reports and client arrives server of client respectively, again via Internet Transmission, between client and server, realize the real-time, interactive of stream media quality Surveillance, thereby the streaming media service quality of transmission is between the two realized Real-Time Monitoring.
Referring to Fig. 1, introduce each concrete operation step of the inventive method:
Step 1, the QoE interaction protocol of self-defining transmitted in both directions is set, and definition network environment parameter and service feature parameter wherein, the QoE interaction protocol regulation of this transmitted in both directions: the network environment parameter is carried in the S-C report of server to client end, and client is carried the service feature parameter to the C-S report of server.
The transmission situation of the QoE interaction protocol of the self-defining transmitted in both directions of the present invention in network as shown in Figure 2, requires respectively in the structure of the S-C of server and client side's transmission report and C-S report composed as follows:
The S-C report of server to client end is comprised of header and data block, and wherein, header comprises:
Protocol version (Protocol Version): the version number of current QoE agreement, field length: 8bit, the version number in the embodiment of the invention is 1;
Type of data packet (Packet Type): the type of current report: 1 is the S-C report, and 2 are C-S report, field length: 8bit;
Data packet length (Packet Length): the data packet length of current report, unit: byte, field length: 16bit;
Data block is used for carrying following one or more network environment parameter:
Multimedia coding type (Code Type): the encoding format information of audio frequency and/or video data, namely adopt the compress technique of setting, the file conversion of certain audio frequency and video form is become the mode of another kind of audio frequency and video formatted file, field length: 16bit; G.711 the type of coding commonly used of voice data have, G.723, the type of coding commonly used of video data has MPEG-2, H.263, H.264;
Multimedia file length (Length): the length of audio frequency and/or video file, unit: second, field length: 16bit;
Transmitting time stamp (Send Timestamp): send the clock information of current flow media data packet, field length: 32bit;
Server is given out a contract for a project and counted (Packets Sent): server accumulative total sends to the flow media data packet number of client, field length: 32bit;
Send byte number (Bytes Sent): server accumulative total sends to the Streaming Media byte number of client, field length: 32bit;
Transmission rate (Send Rate): server sends the mean bit rate of streaming media service data, unit: bps; Field length: 32bit;
Two-way time delay (Roundtrip Delay): the Streaming Media test pack sends to client from server, and again the transmission time of return service device, unit: second, precision is microsecond; Field length: 32bit;
Server Extension field (Expand): the spare fields when being used for later protocol extension, field length: 256bit;
Client is comprised of header and data block to the C-S report of server, wherein, the protocol version that header comprises, the field bit of type of data packet, length is long all identical with the S-C report with connotation, repeats no more; Data block is used for carrying following one or more service feature parameter:
Receiver packet number (Packets Received): the flow media data packet number that client accumulative total receives, field length: 32bit;
Receive byte number (Bytes Received): the Streaming Media byte number that client accumulative total receives, field length: 32bit;
Packet loss (Packets Loss Rate): the give out a contract for a project ratio of number of number of dropped packets and server, wherein number of dropped packets is the give out a contract for a project difference of number and receiver packet number of server, field length: 8bit;
Shake (Jitter): the difference in two relative transmission times of flow media data packet, i.e. the difference of the difference of the time of reception of two flow media data packet stamp and transmitting time stamp, unit: second, precision is microsecond; Field length: 24bit;
Time of reception stamp (Receive Timestamp): receive the clock information of current flow media data packet, field length: 32bit;
Receiving velocity (Receive Rate): the mean bit rate of receiving stream media business datum, unit: bps, field length: 32bit;
Audio quality QoA (Quality ofAudio): utilize based on the improved E-Model algorithm of shake expansion and estimate audio quality in client, field length: 32bit;
Video quality QoV (Quality of Video): utilize that (application number: modification method 201110021600.2) is in the client evaluates video quality, field length: 32bit based on Chinese invention patent application " based on the no-reference video quality method for objectively evaluating of key frame images quality weighting ";
The audio frequency and video time difference (Time Difference): original synchronous a pair of video packets and audio pack arrive timestamp poor of client in the same flow media file, are used for weighing the synchronism of audio frequency and video, and unit: second, precision is microsecond; Field length: 32bit;
Connect the stand-by period (Time Waiting): begin to present professional delay time from the customer service request to client, unit: second, precision is microsecond; Field length: 32bit;
Client-side extensions field (Expand): the spare fields when being used for later protocol extension, field length: 256bit.
Step 2, server test, record and statistics network environmental parameter, and according to QoE agreement regulation generation S-C report, send to again client.This step 2 comprises following content of operation:
(21) server test, recording multimedia type of coding, multimedia file length and transmitting time stamp, simultaneously statistical server several P that give out a contract for a project
SendWith transmission byte number B
Send, and calculate according to the following equation the network environment parameter that comprises transmission rate and two-way time delay, wherein,
Transmission rate
In the formula, B "
SendAnd B '
SendBe respectively server at T "
Server, sendAnd T "
Server, sendTwo different constantly transmission byte numbers of statistics;
Two-way time delay T
RD=T
Server, recv-T
Server, send, in the formula, T
Server, recvAnd T
Server, sendBe respectively the time of server reception and transmission test pack;
(22) in the corresponding field of server with the above-mentioned network environment parameter read-in QoE protocol massages of the streaming media service that obtains, generate the S-C report, and send to client by network.
Step 3, the stream media information that client test, record and statistics receive, and utilize the S-C report to calculate the service feature parameter of this Streaming Media, simultaneously, estimate the user experience quality of this streaming media service; Then generate the C-S report according to QoE agreement regulation, send to again server.
This step 3 comprises following content of operation:
(31) client test, record time of reception stab and are connected the stand-by period, add up simultaneously receiver packet number P
RecvWith reception byte number B
Recv, and utilize according to the following equation the S-C report information to calculate the service feature parameter that comprises packet loss, shake, receiving velocity and audio frequency and video time difference, wherein,
Packet loss
In the formula, P
Loss=P
Send-P
Recv
Shake
In the formula, natural number subscript m, n are respectively the sequence number of two different pieces of information bags that send Streaming Media;
Receiving velocity
In the formula, B "
RecvAnd B '
RecvBe respectively T "
Client, recvAnd T '
Client, recvTwo different constantly reception byte numbers of statistics;
The audio frequency and video time difference
The moment of original synchronous a pair of video packets in the client same flow media file
With the moment of audio pack
Poor, in the formula, natural number subscript k is the packet sequence number in the files in stream media;
(32) client is estimated the audio frequency of streaming media service and/or the user experience quality of video; Wherein,
The audio quality evaluation method adopts the E-Model algorithm of revising based on the shake expansion: QoA=93.2-I
d-I
e-I
j, namely introduce shake factor I
jThe impact of shaking voice quality is described: in the formula, I
dAnd I
eBe the voice quality damage factor that causes because of transmitting voice signal time-delay and packet loss respectively in the former E-Model algorithm, I
jRevise the effect of jitter factor that increases newly for expanding, and I
j=I
Jd+ I
JlIn the formula,
I
JdThe effect of jitter factor that causes because of network transfer delay: I
Jd=a
1* J+a
2* (J-a
3) * f (J-a
3), in the formula, parameter a
1, a
2Be respectively the empirical parameter of reflection network performance, embodiment is the various parameters according to the quality damage factor that in the former E-Model algorithm propagation delay time is caused: echo loudness, background noise, loudness evaluation and test value calculate: a
1=0.029, a
2=0.194; Parameter a
3For describe the threshold value of the shake order of severity with two-way time delay, its numerical value depends on packet loss R
Loss: work as R
LossDuring≤i,
Work as R
LossDuring＞i, a
3=0; In the formula, i is the threshold value of packet loss, establishes i=5% herein; Function f is step function, and its mathematic(al) representation is: J≤a
3, f (J-a
3)=0, J＞a
3,, f (J-a
3)=1; This formula represents: if shake J is greater than a
3, can cause voice quality to have a strong impact on;
I
JlThe effect of jitter factor that causes because of buffer overflow:
In the formula, b is for choose the coefficient of different numerical value according to different audio coders, because embodiment uses G.723.1.B-6.3 encoder, therefore b=10.3; T is the byte capacity of buffering area, the T=1MB among this embodiment; C is for taking the proportionality coefficient of buffering area, c=10.81% under this audio coding mode; R
RecvBe receiving velocity;
Method for evaluating video quality, (application number: method 201110021600.2) is estimated, and utilizes S-C report and packet loss, shake and/or receiving velocity correction evaluation result to utilize Chinese patent application " based on the no-reference video quality method for objectively evaluating of key frame images quality weighting ".Suppose to use the video quality scoring of original patent application method to be qov, recycling packet loss R
LossRevise, i.e. QoV=qov * (1+d * R
Loss).The video of embodiment of the invention test is Foreman sequence (totalframes is 250 frames), this video resolution is standardized images form QCIF (Quarter Common Intermediate Format commonly used, in protocol family H.323, the size of having stipulated the standard acquisition resolution of video capture device is 176 * 144 pixels), belong to prospect, the background relatively slowly video type of all moving and move, setting parameter d=10.
In this step, audio quality evaluation method and method for evaluating video quality all adopt 5 minutes evaluation qualities processed good and bad, wherein 5 minutes best, 1 minute is the poorest.
(33) client writes the above-mentioned parameter that obtains in the corresponding field of QoE protocol massages, generates the C-S report, is sent to server by network again.
Step 4, a pair of QoE protocol massages corresponding stored that server generates step 2 and 3 respectively is for the user experience quality of subsequent analysis Streaming Media and the relation of network environment, for later stage monitoring flow media business quality provides foundation.This step 4 comprises following content of operation:
(41) server is its S-C report that generates in step 2 and the C-S report that receives in step 3, as a pair of QoE protocol massages corresponding stored in database;
(42) utilize the relation of fuzzy evaluation Algorithm Analysis Streaming Media user experience quality and network environment, for later stage monitoring mobile flow medium service quality provides foundation: at first determine to comprise the various evaluation indexes of network environment parameter and service feature parameter, and the criterion of each evaluation index; Determine respectively again the weight of each evaluation index by analytic hierarchy process (AHP), in order to the correlative factor of evaluation object is rationally quantized; Construct at last fuzzy membership function, use fuzzy mathematics method to carry out categorised decision, obtain the relation of Streaming Media user experience quality and network environment.
The above only is preferred embodiment of the present invention, and is in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of making, is equal to replacement, improvement etc., all should be included within the scope of protection of the invention.
Claims (7)
1. implementation method of experiencing mutual stream media quality Surveillance based on the user, it is characterized in that: Quality of experience QoE interaction protocol and network of relation environmental parameter and service feature parameter that self-defining transmitted in both directions at first is set, the transmission situation of monitoring server Streaming Media, the reception situation of client monitors Streaming Media is also estimated its user experience quality, generation server reports that to the S-C of client (Server-Client Report) and client arrive the C-S report (Client-Server Report) of server respectively, again via Internet Transmission, between client and server, realize the real-time, interactive of stream media quality Surveillance, thereby the streaming media service quality of transmission is between the two realized Real-Time Monitoring.
2. method according to claim 1 is characterized in that, described method comprises following operating procedure:
(1) the QoE interaction protocol of self-defining transmitted in both directions is set, and definition network environment parameter and service feature parameter wherein, the QoE interaction protocol regulation of this transmitted in both directions: the network environment parameter is carried in the S-C report of server to client end, and client is carried the service feature parameter to the C-S report of server;
(2) server test, record and statistics network environmental parameter, and according to QoE agreement regulation generation S-C report, send to again client;
(3) stream media information that client test, record and statistics receive, and utilize the S-C report to calculate the service feature parameter of this Streaming Media, simultaneously, estimate the user experience quality of this streaming media service; Then generate the C-S report according to QoE agreement regulation, send to again server;
(4) server a pair of QoE protocol massages corresponding stored that step (2) and (3) are generated respectively is for the user experience quality of subsequent analysis Streaming Media and the relation of network environment, for later stage monitoring flow media business quality provides foundation.
3. method according to claim 2 is characterized in that: the QoE interaction protocol regulation of described self-defining transmitted in both directions:
(11) S-C of server to client end report is comprised of header and data block, and wherein, header comprises: protocol version (Protocol Version), type of data packet (Packet Type) and length (Packet Length) thereof; Data block is used for carrying following one or more network environment parameter:
Multimedia coding type (Code Type): the encoding format information of audio frequency and/or video data, namely adopt the compress technique of setting, the file conversion of certain audio frequency and video form is become the mode of another kind of audio frequency and video formatted file; G.711 the type of coding commonly used of voice data have, G.723, the type of coding commonly used of video data has MPEG-2, H.263, H.264;
Multimedia file length (Length): the length of audio frequency and/or video file;
Transmitting time stamp (Send Timestamp): the clock information that sends current flow media data packet;
Server is given out a contract for a project and counted (Packets Sent): server accumulative total sends to the flow media data packet number of client;
Send byte number (Bytes Sent): server accumulative total sends to the Streaming Media byte number of client;
Transmission rate (Send Rate): server sends the mean bit rate of streaming media service data;
Two-way time delay (Roundtrip Delay): the Streaming Media test pack sends to client from server, again the transmission time of return service device;
Server Extension field (Expand): the spare fields when being used for later protocol extension;
(12) client is comprised of header and data block to the C-S report of server, and wherein, header comprises: protocol version, type of data packet and length thereof; Data block is used for carrying following one or more service feature parameter:
Receiver packet number (Packets Received): the flow media data packet number that client accumulative total receives;
Receive byte number (Bytes Received): the Streaming Media byte number that client accumulative total receives;
Packet loss (Packets Loss Rate): the give out a contract for a project ratio of number of number of dropped packets and server, wherein number of dropped packets is the give out a contract for a project difference of number and receiver packet number of server;
Time of reception stamp (Receive Timestamp): the clock information that receives current flow media data packet;
Shake (Jitter): the difference in two relative transmission times of flow media data packet, the i.e. difference of the difference of the time of reception of two flow media data packet stamp and transmitting time stamp;
Receiving velocity (Receive Rate): the mean bit rate of receiving stream media business datum;
Audio quality QoA (Quality of Audio): utilize the E-Model algorithm of revising based on the shake expansion to estimate audio quality in client;
Video quality QoV (Quality of Video): (application number: modification method 201110021600.2) is in the client evaluates video quality based on Chinese invention patent application " based on the no-reference video quality method for objectively evaluating of key frame images quality weighting " in utilization;
The audio frequency and video time difference (Time Difference): in the same flow media file originally synchronous a pair of video packets and audio pack arrive timestamp poor of client, be used for the synchronism of measurement audio frequency and video;
Connect the stand-by period (Time Waiting): begin to present professional delay time from the customer service request to client;
Client-side extensions field (Expand): the spare fields when being used for later protocol extension.
4. according to claim 2 or 3 described methods, it is characterized in that: described step (2) comprises following content of operation:
(21) server test and recording multimedia type of coding, multimedia file length and transmitting time stamp, simultaneously statistical server several P that give out a contract for a project
SendWith transmission byte number B
Send, and calculate according to the following equation the network environment parameter that comprises transmission rate and two-way time delay, wherein,
Transmission rate
In the formula, B "
SendAnd B '
SendBe respectively server at T "
Server, sendAnd T '
Server, sendTwo different constantly transmission byte numbers of statistics;
Two-way time delay T
RD=T
Server, recv-T
Server, send, in the formula, T
Server, recvAnd T
Server, sendBe respectively the time of server reception and transmission test pack;
(22) in the corresponding field of server with the above-mentioned network environment parameter read-in QoE protocol massages of the streaming media service that obtains, generate the S-C report, and send to client by network.
5. according to claim 2 or 3 or 4 described methods, it is characterized in that: described step (3) comprises following content of operation:
(31) client test, record time of reception stab and are connected the stand-by period, add up simultaneously receiver packet number P
RecvWith reception byte number B
Recv, and utilize according to the following equation the S-C report information to calculate the service feature parameter that comprises packet loss, shake, receiving velocity and audio frequency and video time difference, wherein,
Packet loss
In the formula, P
Loss=P
Send-P
Recv
Shake
In the formula, natural number subscript m, n are respectively the sequence number of two different pieces of information bags that send Streaming Media;
Receiving velocity
In the formula, B "
RecvAnd B '
RecvBe respectively client at T "
Client, recvAnd T '
Client, recvTwo different constantly reception byte numbers of statistics;
The audio frequency and video time difference
The moment of original synchronous a pair of video packets in the client same flow media file
With the moment of audio pack
Poor, in the formula, natural number subscript k is the packet sequence number in the files in stream media;
(32) client is estimated the audio frequency of streaming media service and/or the user experience quality of video; Wherein,
The audio quality evaluation method adopts the E-Model algorithm of revising based on the shake expansion: QoA=93.2-I
d-I
e-I
j, namely introduce shake factor I
jThe impact of shaking voice quality is described: in the formula, I
dAnd I
eBe the voice quality damage factor that causes because of transmitting voice signal time-delay and packet loss respectively in the former E-Model algorithm, I
jRevise the effect of jitter factor that increases newly for expanding, and I
j=I
Jd+ I
JlWherein,
I
JdThe effect of jitter factor that causes because of network transfer delay: I
Jd=a
1* J+a
2* (J-a
3) * f (J-a
3), in the formula, parameter a
1, a
2Be respectively the empirical parameter of reflection network performance, parameter a
3For describe the threshold value of the shake order of severity with two-way time delay, its numerical value depends on packet loss R
Loss: work as R
LossDuring≤i,
Work as R
LossDuring＞i, a
3=0; In the formula, i is the threshold value of packet loss; Function f is step function, and its mathematic(al) representation is: J≤a
3, f (J-a
3)=0, J＞a
3,, f (J-a
3)=1; This formula represents: if shake J is greater than a
3, can cause voice quality to have a strong impact on;
I
JlThe effect of jitter factor that causes because of buffer overflow:
In the formula, b is for choosing the coefficient of different numerical value according to different audio coders, and T is the byte capacity of buffering area, and c is the proportionality coefficient that takies buffering area under the different audio coding modes, R
RecvBe receiving velocity;
Method for evaluating video quality, (application number: method 201110021600.2) is estimated, and utilizes S-C report and packet loss, shake and/or receiving velocity correction evaluation result to utilize Chinese patent application " based on the no-reference video quality method for objectively evaluating of key frame images quality weighting ";
(33) client writes the above-mentioned parameter that obtains in the corresponding field of QoE protocol massages, generates the C-S report, is sent to server by network again.
6. method according to claim 5 is characterized in that: in the described step (31), audio quality evaluation method and method for evaluating video quality all adopt 5 minutes evaluation qualities processed good and bad, wherein 5 minutes best, 1 minute is the poorest.
7. method according to claim 5, it is characterized in that: described step (4) comprises following content of operation:
(41) server is its S-C report that generates in step (2) and the C-S report that receives in step (3), as a pair of QoE protocol massages corresponding stored in database;
(42) utilize the relation of fuzzy evaluation Algorithm Analysis Streaming Media user experience quality and network environment, for later stage monitoring mobile flow medium service quality provides foundation: at first determine to comprise the various evaluation indexes of network environment parameter and service feature parameter, and the criterion of each evaluation index; Determine respectively again the weight of each evaluation index by analytic hierarchy process (AHP), in order to the correlative factor of evaluation object is rationally quantized; Construct at last fuzzy membership function, use fuzzy mathematics method to carry out categorised decision, obtain the relation of Streaming Media user experience quality and network environment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110189377.2A CN102868666B (en) | 2011-07-07 | 2011-07-07 | Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110189377.2A CN102868666B (en) | 2011-07-07 | 2011-07-07 | Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102868666A true CN102868666A (en) | 2013-01-09 |
| CN102868666B CN102868666B (en) | 2015-09-23 |
Family
ID=47447264
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110189377.2A Expired - Fee Related CN102868666B (en) | 2011-07-07 | 2011-07-07 | Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102868666B (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103269459A (en) * | 2013-05-22 | 2013-08-28 | 中国科学院声学研究所 | Monitoring system directing at user experience quality of stream media service |
| CN103475896A (en) * | 2013-07-24 | 2013-12-25 | 同济大学 | Interactive video and audio experience-quality assessment platform and method based on Qos |
| CN103795589A (en) * | 2013-12-26 | 2014-05-14 | 国家广播电影电视总局广播科学研究院 | Channel damage testing method of radio and television transmission distribution network |
| CN104243441A (en) * | 2014-04-09 | 2014-12-24 | 深圳深讯和科技有限公司 | Method and system for controlling streaming media service quality |
| CN104428777A (en) * | 2013-03-14 | 2015-03-18 | 尼尔森（美国）有限公司 | Methods and systems for reducing crediting errors due to spillover using audio codes and/or signatures |
| WO2015081685A1 (en) * | 2013-12-02 | 2015-06-11 | 中兴通讯股份有限公司 | Processing method and apparatus for quality of service |
| WO2015106557A1 (en) * | 2014-01-17 | 2015-07-23 | 中兴通讯股份有限公司 | Correction method for quality of experience (qoe) of mobile streaming media user, and server |
| WO2017000728A1 (en) * | 2015-06-30 | 2017-01-05 | 腾讯科技（深圳）有限公司 | Flow control method, apparatus and server |
| CN107181644A (en) * | 2017-06-16 | 2017-09-19 | 北京小度信息科技有限公司 | For the method and apparatus for the network performance for monitoring network application |
| CN107659856A (en) * | 2017-07-04 | 2018-02-02 | 中国科学技术大学 | The acquisition method of mobile video business experience qualitative data collection based on user feedback |
| CN108200471A (en) * | 2018-01-08 | 2018-06-22 | 中国科学技术大学 | A kind of construction method for the standard data set for evaluating and testing encrypted video QoE |
| CN110178401A (en) * | 2016-11-29 | 2019-08-27 | Sk电信有限公司 | For providing the method and its equipment of streaming service |
| CN110996097A (en) * | 2017-05-08 | 2020-04-10 | 华为技术有限公司 | VR multimedia experience quality determination method and device |
| CN111800388A (en) * | 2020-06-09 | 2020-10-20 | 盐城网之易传媒有限公司 | Media information processing method and media information processing device |
| CN112367294A (en) * | 2020-10-13 | 2021-02-12 | 成都精灵云科技有限公司 | Network communication method between multiple hosts adapting to edge computing architecture |
| CN112910720A (en) * | 2021-05-06 | 2021-06-04 | 成都云智天下科技股份有限公司 | Intelligent network scheduling method and system based on user experience quantitative index |
| WO2022267720A1 (en) * | 2021-06-23 | 2022-12-29 | 华为技术有限公司 | Data transmission method and communication apparatus |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792146A (en) * | 2016-09-22 | 2017-05-31 | 南京邮电大学 | The method for objectively evaluating of the Consumer's Experience of data-driven in a kind of video traffic |
| CN106332164B (en) * | 2016-09-29 | 2019-07-05 | 北京航空航天大学 | A kind of vehicle self-organizing network data transmission performance assessment method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1839597A (en) * | 2003-08-21 | 2006-09-27 | 维迪亚特企业公司 | Quality of experience (QOE) measurement for wireless communication networks |
| CN101425935A (en) * | 2007-11-01 | 2009-05-06 | 中兴通讯股份有限公司 | VoIP service customer experience quality test and monitoring method and system |
| CN101573941A (en) * | 2006-12-29 | 2009-11-04 | 艾利森电话股份有限公司 | Method and apparatus for reporting streaming media quality cross reference to related applications |
-
2011
- 2011-07-07 CN CN201110189377.2A patent/CN102868666B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1839597A (en) * | 2003-08-21 | 2006-09-27 | 维迪亚特企业公司 | Quality of experience (QOE) measurement for wireless communication networks |
| CN101573941A (en) * | 2006-12-29 | 2009-11-04 | 艾利森电话股份有限公司 | Method and apparatus for reporting streaming media quality cross reference to related applications |
| CN101425935A (en) * | 2007-11-01 | 2009-05-06 | 中兴通讯股份有限公司 | VoIP service customer experience quality test and monitoring method and system |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104428777B (en) * | 2013-03-14 | 2017-05-17 | 尼尔森（美国）有限公司 | Methods and systems for reducing crediting errors due to spillover using audio codes and/or signatures |
| CN104428777A (en) * | 2013-03-14 | 2015-03-18 | 尼尔森（美国）有限公司 | Methods and systems for reducing crediting errors due to spillover using audio codes and/or signatures |
| CN103269459A (en) * | 2013-05-22 | 2013-08-28 | 中国科学院声学研究所 | Monitoring system directing at user experience quality of stream media service |
| CN103475896A (en) * | 2013-07-24 | 2013-12-25 | 同济大学 | Interactive video and audio experience-quality assessment platform and method based on Qos |
| WO2015081685A1 (en) * | 2013-12-02 | 2015-06-11 | 中兴通讯股份有限公司 | Processing method and apparatus for quality of service |
| CN103795589A (en) * | 2013-12-26 | 2014-05-14 | 国家广播电影电视总局广播科学研究院 | Channel damage testing method of radio and television transmission distribution network |
| CN103795589B (en) * | 2013-12-26 | 2017-09-19 | 国家新闻出版广电总局广播科学研究院 | Broadcast television transmissions distribute network channel damage measure method |
| WO2015106557A1 (en) * | 2014-01-17 | 2015-07-23 | 中兴通讯股份有限公司 | Correction method for quality of experience (qoe) of mobile streaming media user, and server |
| CN104243441A (en) * | 2014-04-09 | 2014-12-24 | 深圳深讯和科技有限公司 | Method and system for controlling streaming media service quality |
| US10757033B2 (en) | 2015-06-30 | 2020-08-25 | Tencent Technology (Shenzhen) Company Limited | Traffic control method, traffic control apparatus and server |
| CN106330757A (en) * | 2015-06-30 | 2017-01-11 | 腾讯科技（深圳）有限公司 | Traffic control method and apparatus |
| WO2017000728A1 (en) * | 2015-06-30 | 2017-01-05 | 腾讯科技（深圳）有限公司 | Flow control method, apparatus and server |
| CN106330757B (en) * | 2015-06-30 | 2020-04-21 | 腾讯科技（深圳）有限公司 | Flow control method and device |
| CN110178401A (en) * | 2016-11-29 | 2019-08-27 | Sk电信有限公司 | For providing the method and its equipment of streaming service |
| CN110996097A (en) * | 2017-05-08 | 2020-04-10 | 华为技术有限公司 | VR multimedia experience quality determination method and device |
| US11138715B2 (en) | 2017-05-08 | 2021-10-05 | Huawei Technologies Co., Ltd. | Method and apparatus for determining experience quality of VR multimedia |
| US11694316B2 (en) | 2017-05-08 | 2023-07-04 | Huawei Technologies Co., Ltd. | Method and apparatus for determining experience quality of VR multimedia |
| CN107181644B (en) * | 2017-06-16 | 2019-09-27 | 北京小度信息科技有限公司 | Method and apparatus for monitoring the network performance of network application |
| CN107181644A (en) * | 2017-06-16 | 2017-09-19 | 北京小度信息科技有限公司 | For the method and apparatus for the network performance for monitoring network application |
| CN107659856A (en) * | 2017-07-04 | 2018-02-02 | 中国科学技术大学 | The acquisition method of mobile video business experience qualitative data collection based on user feedback |
| CN108200471A (en) * | 2018-01-08 | 2018-06-22 | 中国科学技术大学 | A kind of construction method for the standard data set for evaluating and testing encrypted video QoE |
| CN111800388A (en) * | 2020-06-09 | 2020-10-20 | 盐城网之易传媒有限公司 | Media information processing method and media information processing device |
| CN112367294A (en) * | 2020-10-13 | 2021-02-12 | 成都精灵云科技有限公司 | Network communication method between multiple hosts adapting to edge computing architecture |
| CN112910720A (en) * | 2021-05-06 | 2021-06-04 | 成都云智天下科技股份有限公司 | Intelligent network scheduling method and system based on user experience quantitative index |
| CN112910720B (en) * | 2021-05-06 | 2021-08-03 | 成都云智天下科技股份有限公司 | Intelligent network scheduling method and system based on user experience quantitative index |
| WO2022267720A1 (en) * | 2021-06-23 | 2022-12-29 | 华为技术有限公司 | Data transmission method and communication apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102868666B (en) | 2015-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102868666B (en) | Based on the implementation method of the mutual stream media quality Surveillance of Consumer's Experience | |
| CN101523916B (en) | A method of determining video quality | |
| KR101464456B1 (en) | Video data quality assessment method and device | |
| AU2007313931B2 (en) | Dynamic modification of video properties | |
| CN102710374B (en) | Speed control method in wireless streaming media transmission | |
| CN101594552B (en) | Testing method for IPTV service quality damage by network transmission | |
| TW201021576A (en) | System and method for dynamic video encoding in multimedia streaming | |
| WO2013159502A1 (en) | Video quality evaluation method and device | |
| WO2010003338A1 (en) | Method, device and system for evaluating quality of video code stream | |
| Li et al. | Real‐Time QoE Monitoring System for Video Streaming Services with Adaptive Media Playout | |
| CN102256183A (en) | Mobile-communication-network-based audio and video signal real-time transmission method | |
| Deng et al. | QoE-oriented rate allocation for multipath high-definition video streaming over heterogeneous wireless access networks | |
| Pentikousis et al. | An experimental investigation of VoIP and video streaming over fixed WiMAX | |
| EP2613541B1 (en) | Server device, video image quality measurement system, video image quality measurement method and program | |
| Jiménez et al. | The upstream matters: impact of uplink performance on YouTube 360 live video streaming in LTE | |
| Khayam et al. | Linear-complexity models for wireless MAC-to-MAC channels | |
| Andrei et al. | Towards an analytical model for characterising behaviour of high-speed VVoIP applications | |
| Sagatov et al. | Influence of distortions of key frames on video transfer in wireless networks | |
| Yuan | Video data wireless transmission method based on cross-layer bitrate adaptation and error control | |
| Bassey et al. | Mitigating the effect of packet losses on real-time video streaming using psnr as video quality assessment metric | |
| Daryanto et al. | Performance Analysis of Adaptive Transcoder Multimedia Streaming In Ad hoc Network | |
| Yang et al. | Design of video transmission and quality evaluation system based on NS-2 | |
| Singh et al. | A Framework for Evaluation of Video Quality of Service in Wireless Networks | |
| Huo et al. | Measurement based modeling and assessment of QoE index in P2P IPTV services | |
| Liu et al. | Applied Technology Based on NS2 the Research of Transmission of Video Streams in 802.11 Network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150923 Termination date: 20160707 |