CN102904755A - Method and device for measuring quality of user experience of mobile-internet services - Google Patents

Method and device for measuring quality of user experience of mobile-internet services Download PDF

Info

Publication number
CN102904755A
CN102904755A CN2012103745680A CN201210374568A CN102904755A CN 102904755 A CN102904755 A CN 102904755A CN 2012103745680 A CN2012103745680 A CN 2012103745680A CN 201210374568 A CN201210374568 A CN 201210374568A CN 102904755 A CN102904755 A CN 102904755A
Authority
CN
China
Prior art keywords
measured values
quality measured
type
key performance
performance indicator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012103745680A
Other languages
Chinese (zh)
Other versions
CN102904755B (en
Inventor
寿国础
罗意
胡怡红
郭志刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Posts and Telecommunications
Original Assignee
Beijing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Posts and Telecommunications filed Critical Beijing University of Posts and Telecommunications
Priority to CN201210374568.0A priority Critical patent/CN102904755B/en
Publication of CN102904755A publication Critical patent/CN102904755A/en
Application granted granted Critical
Publication of CN102904755B publication Critical patent/CN102904755B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention discloses a method and a device for measuring quality of user experience of mobile-internet services. The method provided by the invention comprises the steps of setting at least three kinds of key performance indexes, wherein the key performance index belonging to the first type indicates the performance of a terminal; the key performance index belonging to the second type indicates the performance of a network; and the key performance index belonging to the third type indicates the performance of application services. The method comprises the steps of collecting at least three kinds of key performance indexes of a target mobile-internet service; respectively obtaining the quality measuring value of the corresponding type by using the collected key performance index of each type; and calculating the value of quality of user experience of the target mobile-internet service according to the quality measuring value of each type. According to the technical scheme provided by the invention, the value reflecting the quality of user experience of the mobile-internet services is measured accurately.

Description

A kind of mobile Internet business quality measurement of user experience method and apparatus
Technical field
The present invention relates to communication technical field, particularly relate to a kind of mobile Internet business user experience quality evaluating method and device.
Background technology
In recent years, along with development of Mobile Internet technology is fast-developing, mobile Internet business emerges in an endless stream, and has been penetrated into the various aspects of people's life.Along with mobile Internet is used the day by day fierce of competition, the user experience quality (QoE, Quality ofExperience) that is used for evaluation mobile Internet application quality quality more and more is subject to Virtual network operator and developer's attention.
At present, the evaluating method of QoE mainly contains subjective evaluation method and method for objectively evaluating.Wherein, subjective evaluation method will directly from user awareness, be estimated business exactly; But because subjective evaluation method will be considered too many factor, expend plenty of time and manpower, thereby be not used widely.In addition, existing method for objectively evaluating, in most of researchs that all concentrate on network service, and most QoE method of measurement does not have general applicability for voice and video traffic foundation for general mobile Internet application.And there is deviation in existing method of measurement between the measured value of measuring and actual value, not accurate enough, can not estimate with regard to the user experience quality of a certain mobile Internet business according to measured value.
In sum, the objective evaluating method scope of application of existing QoE is narrower and can not accurately measure the numerical value of the user experience quality that can reflect mobile Internet business.
Summary of the invention
The invention discloses a kind of mobile Internet business quality measurement of user experience method, the method can accurately measure the numerical value of the user experience quality that can reflect various mobile Internet businesss.
The invention provides a kind of mobile Internet business quality measurement of user experience method, wherein, at least the Key Performance Indicator KPI of three types is set, described three types comprises the first kind, Second Type and the 3rd type, the Key Performance Indicator indicating terminal performance that belongs to the first kind, the Key Performance Indicator indication network performance that belongs to Second Type, the Key Performance Indicator that belongs to the 3rd type is indicated the application service performance, and described method comprises:
Gather the Key Performance Indicator of the described at least three types of Suitable For Moving-goal Problems Internet service;
Key Performance Indicator under the utilization collect every type obtains respectively the quality measured values under the respective type, wherein, quality measured values under the first kind that gets access to is the terminal quality measured value, quality measured values under the Second Type that gets access to is the network quality measured value, and the quality measured values under the 3rd type that gets access to is the application service quality measured value;
Calculate the numerical value of the user experience quality of Suitable For Moving-goal Problems Internet service according to described quality measured values under all types of.
The invention also discloses a kind of mobile Internet business quality measurement of user experience device, this device can accurately measure the numerical value of the user experience quality that can reflect mobile Internet business.
The present invention also provides a kind of mobile Internet business quality measurement of user experience device, and this device comprises: module, Key Performance Indicator acquisition module, quality measured values computing module and user experience quality computing module are set; Wherein,
Module is set, be used for arranging at least Key Performance Indicator of three types, described three types comprises the first kind, Second Type and the 3rd type, the Key Performance Indicator indicating terminal performance that belongs to the first kind, the Key Performance Indicator indication network performance that belongs to Second Type, the Key Performance Indicator that belongs to the 3rd type is indicated the application service performance;
The Key Performance Indicator acquisition module, be used for to gather the Suitable For Moving-goal Problems Internet service described at least three types Key Performance Indicator and send to the quality measured values computing module;
The quality measured values computing module, be used for receiving the Key Performance Indicator that the Key Performance Indicator acquisition module sends, obtain respectively quality measured values under the respective type according to the Key Performance Indicator under every type that collects, wherein, quality measured values under the first kind that gets access to is the terminal quality measured value, quality measured values under the Second Type that gets access to is the network quality measured value, and the quality measured values under the 3rd type that gets access to is the application service quality measured value;
The user experience quality computing module is for the numerical value that calculates the user experience quality of Suitable For Moving-goal Problems Internet service according to the quality measured values under described each type.
In sum, technical scheme provided by the invention is by arranging polytype Key Performance Indicator, when measuring, gather set polytype Key Performance Indicator and calculate corresponding quality measured values, calculated the technological means of the user experience quality numerical value of mobile Internet business by quality measured values, can accurately measure the numerical value of the user experience quality of reflection mobile Internet business.
The embodiment of the invention can be from the user experience quality of the current mobile Internet business of the aspects such as end side, network side and application service side integral body reflection, very approaching with actual user's experience by the measurement result that the present invention obtains, thereby the measurement result that can utilize this programme to obtain is improved the correlated performance of mobile Internet business, improves user experience quality.
Description of drawings
Fig. 1 is the flow chart of a kind of mobile Internet business user experience quality assessment method among the present invention;
Fig. 2 is the detail flowchart of a kind of quality measurement of user experience method among the present invention;
Fig. 3 is a kind of flow chart that calculates nondimensionalization KPI weighted value among the present invention;
Fig. 4 is the level schematic diagram of the quality measurement of user experience in a kind of specific embodiment among the present invention;
Fig. 5 is the total weight value schematic diagram of the Key Performance Indicator in a kind of specific embodiment of the present invention;
Fig. 6 is a kind of mobile Internet business quality measurement of user experience device schematic diagram among the present invention.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, embodiment of the present invention is described further in detail below in conjunction with accompanying drawing.
A kind of mobile Internet business quality measurement of user experience scheme provided by the invention, the method is evaluated and tested user experience quality by many factors such as integrated terminal performance, network performance and application service performances comprehensively.The numerical value of the user experience quality that measures by this programme can reflect user's overall experience to concrete mobile Internet business in network.Virtual network operator and developer can be from the angles of self, carry out the QoE evaluation and test according to the present invention, improve the user experience quality of mobile Internet business, thus in keen competition the acquisition advantage.
In the embodiment of the invention, the user is decided by QoE the whole perception degree of mobile Internet business.Mobile Internet business QoE comprises QoT(Quality of Terminal), QoS(Quality of Service) and QoD(Quality of Development), the Key Quality Indicator (KQI) of terminal capabilities, network performance and the service end performance of map network respectively.
QoS represents the overall quality of service of the mobile network environment that Virtual network operator provides.QoS is the index of estimating universe network service quality from application point, depends on the network performance that Virtual network operator provides.For example, send success rate, service building success rate etc. and all belong to the QoS category.
QoD is for weighing the index of application performance.Relevant with the developer who uses, different application developer is different for the development quality with a application program, is different thereby cause the user experience quality of user for different application program the time.QoD comprises programming, algorithm, hardware etc.
QoT represents the intelligent terminal performance to QoE generation effect.QoT mainly depends on the intelligent terminal performance that the user uses, for example, and hardware performance, operating system etc.
Fig. 1 is the flow chart of a kind of mobile Internet business user experience quality assessment method among the present invention; As shown in Figure 1,
Step 101, at least the Key Performance Indicator of three types is set, described three types comprises the first kind, Second Type and the 3rd type, the Key Performance Indicator indicating terminal performance that belongs to the first kind, the Key Performance Indicator indication network performance that belongs to Second Type, the Key Performance Indicator that belongs to the 3rd type is indicated the application service performance.
Step 102, the Key Performance Indicator of the described at least three types of collection Suitable For Moving-goal Problems Internet service.
Step 103, Key Performance Indicator under the utilization collect every type obtains respectively the quality measured values under the respective type, wherein, quality measured values under the first kind that gets access to is the terminal quality measured value, quality measured values under the Second Type that gets access to is the network quality measured value, and the quality measured values under the 3rd type that gets access to is the application service quality measured value.
Step 104 calculates the numerical value of the user experience quality of Suitable For Moving-goal Problems Internet service according to described quality measured values under all types of.
The method of measurement of a kind of user experience quality provided by the invention is by measuring respectively various types of Key Performance Indicators, and calculates corresponding weighted value, draws the quality measured values of corresponding types; Calculate the weighted value corresponding with it according to described quality measured values, draw at last the measured value of the user experience quality of mobile Internet business.The invention provides method of measurement and have the numerical value that the measured value that gets access to approaches actual user experience quality, and for different mobile Internet businesss, every Key Performance Indicator does not need to adjust, and the weighted value that only needs to adjust some Key Performance Indicator gets final product, and has more versatility.
In step 103 as described in Figure 1, utilize Key Performance Indicator under every type that collects to obtain respectively quality measured values under the respective type, can be specially: the KPI that collects is converted to nondimensionalization KPI by the nondimensionalization computing; According to the step analysis mode, utilize nondimensionalization KPI to calculate the weighted value of every type of lower each nondimensionalization KPI; Utilize the weighted value of every type of lower nondimensionalization KPI and nondimensionalization KPI to calculate corresponding quality measured values.
Calculate corresponding quality measured values at the above-mentioned weighted value of every type of lower nondimensionalization KPI and nondimensionalization KPI that utilizes, be specially: according to formula KQI i=ω 1* KPI 1+ ω 2* KPI 2+ ... + ω n* KPI nCalculate corresponding quality measured values; Wherein, KQI iRepresent the quality measured values under the i type; KPI 1Be the 1st nondimensionalization KPI under the i type, ω 1For with KPI 1Corresponding weighted value; KPI 2Be the 2nd nondimensionalization KPI under the i type, ω 2For with KPI 2Corresponding weighted value; KPI nBe n nondimensionalization KPI under the i type, ω nFor with KPI nCorresponding weighted value.
In step 104 as shown in Figure 1, calculate the numerical value of the user experience quality of Suitable For Moving-goal Problems Internet service according to the quality measured values under the described all kinds, be specially: according to the step analysis mode, calculate the weighted value of each quality measured values; Utilize the weighted value of described quality measured values and described quality measured values to calculate the numerical value of described user experience quality.
Calculate the numerical value of described user experience quality at the above-mentioned weighted value that utilizes described quality measured values and described quality measured values, be specially: according to formula QoE=w 1* KQI 1+ w 2* KQI 2+ ... + w i* KQI iCalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1Be the quality measured values of the first kind, w 1For with KQI 1Corresponding weighted value; KQI 2Be the quality measured values of Second Type, w 2For with KQI 1Corresponding weighted value; KQI iBe the quality measured values of i type, w iFor with KQI iCorresponding weighted value.
In the specific embodiment in the present invention, described according to the step analysis mode, the weighted value that utilizes nondimensionalization KPI to calculate each nondimensionalization KPI under all kinds comprises:
According to set judgment rule kilsyth basalt, relatively set up in twos respectively performance index judgment matrix under the described type by the nondimensionalization KPI with each type, wherein, the comparative result and the corresponding relation of judging scale-value of two nondimensionalization KPI of described judgment rule kilsyth basalt indication, described performance index judgment matrix is by judging that the yardstick value obtains;
Calculate the characteristic vector of described performance index judgment matrix
Figure BDA00002222441400051
To characteristic vector
Figure BDA00002222441400052
Carry out normalized and obtain the normalization characteristic vector
Figure BDA00002222441400053
With the normalization characteristic vector
Figure BDA00002222441400054
In each element respectively as the weighted value of described nondimensionalization KPI under all types of;
In the specific embodiment in the present invention, described according to the step analysis mode, the weighted value that calculates each quality measured values comprises:
According to set judgment rule kilsyth basalt, by each quality measured values is relatively set up respectively the quality measured values judgment matrix in twos, wherein, the comparative result and the corresponding relation of judging scale-value of two quality measured values of described judgment rule kilsyth basalt indication, described quality measured values judgment matrix is by judging that the yardstick value obtains;
Calculate the characteristic vector of described quality measured values judgment matrix
Figure BDA00002222441400061
To characteristic vector
Figure BDA00002222441400062
Carry out normalized and obtain the normalization characteristic vector
Figure BDA00002222441400063
With the normalization characteristic vector
Figure BDA00002222441400064
In each element respectively as the weighted value of each quality measured values.
With the normalization characteristic vector In each element respectively before the weighted value as the nondimensionalization KPI under the described all kinds, described method also comprises:
Calculate the eigenvalue of maximum of described performance index judgment matrix;
Eigenvalue of maximum according to described performance index judgment matrix calculates Consistency Ratio, whether judges the numerical value of described Consistency Ratio greater than predetermined threshold, if determine described normalization characteristic vector
Figure BDA00002222441400066
In each element be the weighted value of each nondimensionalization KPI under the type; If not, then not with described normalization characteristic vector
Figure BDA00002222441400067
In each element as the weighted value of each nondimensionalization KPI under the type;
With the normalization characteristic vector
Figure BDA00002222441400068
In each element respectively before the weighted value as each quality measured values, described method also comprises:
Calculate the eigenvalue of maximum of described quality measured values judgment matrix;
Eigenvalue of maximum according to described quality measured values judgment matrix calculates Consistency Ratio, whether judges the numerical value of described Consistency Ratio greater than predetermined threshold, if determine described normalization characteristic vector
Figure BDA00002222441400069
In each element be the weighted value of each quality measured values; If not, then not with described normalization characteristic vector
Figure BDA000022224414000610
In each element as the weighted value of each quality measured values.
In many mobile Internet businesss, the instant messaging business has in real time, transmits the characteristics such as data type is many, interactivity is strong, user data is huge, and is representative in mobile Internet business.Hereinafter with instant messaging as specific embodiment, the mode of the user experience quality of instant messaging service being measured from terminal, network and three aspects of application service performance describes idiographic flow of the present invention in detail.
Fig. 2 is the detail flowchart of a kind of quality measurement of user experience method among the present invention, as shown in Figure 2,
Step 201 arranges the Key Performance Indicator of three types.
In step 201, set three types comprises the first kind, Second Type and the 3rd type, the Key Performance Indicator indicating terminal performance that belongs to the first kind, the Key Performance Indicator indication network performance that belongs to Second Type, the Key Performance Indicator that belongs to the 3rd type is indicated the application service performance.
Wherein, the Key Performance Indicator that belongs to terminal capabilities comprises: the cpu performance of terminal, the i.e. arithmetic speed of the CPU of this terminal.The memory consumption of terminal, the memory consumption ratio of terminal when namely using the application software relevant with described mobile Internet business.The response time of terminal, when namely using terminal, press lower keyboard to the time of screen display.The screen resolution of terminal, i.e. screen resolution.The operating system performance of terminal, the i.e. employed operating system of terminal.
The Key Performance Indicator that belongs to network performance comprises: send success rate, i.e. the IM information that success sends accounts for the ratio of attempting transmission information.Message Time Delay namely sends IM information is received IM information to the purpose terminal time from source terminal.Service building success rate, namely user's successful number of initiating to set up accounts for the ratio of sum.Professional setup delay, namely the user initiates to establish a connection to the time of successfully setting up.Message transmission rate, the i.e. speed of message when transmission.
The Key Performance Indicator that belongs to the application service performance comprises: the EMS memory occupation amount, namely serve user's mean consumption amount of ram.Service end maximum number of connections, the i.e. maximum number of connections that can support of server end.Server cpu performance, the i.e. arithmetic speed of server CPU.The mission critical operating procedure, namely the user finishes the required number of steps of mission critical.Data transfer overhead, the i.e. network traffics of unit of transfer's data consumes.
With tabulating as shown in table 1 behind the above-mentioned all types of Key Performance Indicator label:
Table 1
Figure BDA00002222441400071
Figure BDA00002222441400081
Step 202, the Key Performance Indicator of collection indicating terminal performance, the Key Performance Indicator of collection indication network performance gathers the Key Performance Indicator of indicating the application service performance.
In step 202, according to the every Key Performance Indicator shown in the table 1, every Key Performance Indicator is measured, gather the measured value that measures Key Performance Indicator.
Step 203 is converted to nondimensionalization KPI with the various types of KPI that collect by the nondimensionalization computing.
In step 203, the actual measured value of the every KPI under collect every type is converted to nondimensionalization KPI by the nondimensionalization computing.
Described nondimensionalization computing comprises: linear nondimensionalization, curve nondimensionalization and the compound nondimensionalization of broken line.Linear nondimensionalization method refers to that desired value and evaluation of estimate are linear.Curve nondimensionalization method refers to desired value and the curved relation of evaluation of estimate.Wherein, linear nondimensionalization method comprises: standardization method, efficiency coefficient method and extremum method etc.
In specific embodiments of the invention, adopt the mode of the compound nondimensionalization of broken line to carry out the nondimensionalization computing.KPI-3, KPI-6 in the table 1, KPI-7, KPI-9 describe as example:
At first, set up the nondimensionalization table of comparisons, in the described nondimensionalization table of comparisons, the hundred-mark system interval of correspondence is set for the different measuring value interval of each KPI.As shown in table 2;
Table 2
Figure BDA00002222441400082
According to the nondimensionalization conversion formula: Q f = Q L + ( Q R - Q L ) × | P T - P L | P R - P L KPI under all kinds is converted to nondimensionalization KPI.Wherein, Q fThe value of expression nondimensionalization KPI, Q LThe left margin in hundred-mark system interval, nondimensionalization KPI place, Q RIt is the right margin in hundred-mark system interval, nondimensionalization KPI place; P LThe left margin between the KPI location that collects, P RIt is the right margin between the KPI location that collects; P TThe KPI that collects.
For example: the measured value of the response time that collects is 35ms, then according to table 2 and corresponding nondimensionalization conversion formula, can get Q f = Q L + ( Q R - Q L ) × | P T - P L | P R - P L = 70 + ( 80 - 70 ) × | 35 - 50 | 50 - 10 = 73.75 . Therefore, be the response time of 35ms for measured value, the value of the nondimensionalization KPI that computing obtains through nondimensionalization is 73.75.
Step 204 according to the step analysis mode, utilizes nondimensionalization KPI to calculate the weighted value of every type of lower each nondimensionalization KPI.
In step 204, at first, according to set judgment rule kilsyth basalt, relatively set up in twos respectively performance index judgment matrix under the described type by the nondimensionalization KPI with each type, wherein, the comparative result and the corresponding relation of judging scale-value of two nondimensionalization KPI of described judgment rule kilsyth basalt indication, described performance index judgment matrix is by judging that the yardstick value obtains.
Secondly, calculate the characteristic vector of described performance index judgment matrix
Figure BDA00002222441400092
Again, to characteristic vector Carry out normalized and obtain the normalization characteristic vector
Figure BDA00002222441400094
With the normalization characteristic vector
Figure BDA00002222441400095
In each element respectively as the weighted value of the nondimensionalization KPI under the described all kinds.
After using the step analysis mode to calculate weighted value, need to be to the normalization characteristic vector that calculates
Figure BDA00002222441400096
Carrying out compatibility judges.
In an embodiment of the present invention, to the normalization characteristic vector The process of carrying out the compatibility judgement is specially:
At first, calculate the eigenvalue of maximum of described performance index judgment matrix;
Then the eigenvalue of maximum according to described performance index judgment matrix calculates Consistency Ratio, whether judges the numerical value of described Consistency Ratio greater than predetermined threshold, if determine described normalization characteristic vector In each element be the weighted value of each nondimensionalization KPI under the type; If not, then not with described normalization characteristic vector
Figure BDA00002222441400099
In each element as the weighted value of each nondimensionalization KPI under the type.
Step 205 calculates corresponding quality measured values according to the weighted value of nondimensionalization KPI and nondimensionalization KPI.
In step 205, be specially according to formula KQI i=ω 1* KPI 1+ ω 2* KPI 2+ ... + ω n* KPI nCalculate corresponding quality measured values; Wherein, KQI iRepresent the quality measured values under the i type; KPI 1Be the 1st nondimensionalization KPI under the i type, ω 1For with KPI 1Corresponding weighted value; KPI 2Be the 2nd nondimensionalization KPI under the i type, ω 2For with KPI 2Corresponding weighted value; KPI nBe n nondimensionalization KPI under the i type, ω nFor with KPI nCorresponding weighted value.
Take the listed every KPI of table 1 as example, at KQI 1In, KPI 1Be KPI-1, KPI 5Be KPI-5; At KQI 2In, KPI 1Be KPI-6, KPI 5Be KPI-10; At KQI 3In, KPI 1Be KPI-11, KPI 5Be KPI-15.
According to above-mentioned formula, calculate respectively the KQI of indicating terminal performance 1, the KQI of indication network performance 2And the KQI of indication application service performance 3
Step 206 according to the step analysis mode, is calculated the weighted value of each quality measured values.
In step 206, at first, according to set judgment rule kilsyth basalt, by quality measured values is relatively set up respectively the quality measured values judgment matrix in twos, wherein, the comparative result and the corresponding relation of judging scale-value of two quality measured values of described judgment rule kilsyth basalt indication, described quality measured values judgment matrix is by judging that the yardstick value obtains.
Secondly, calculate the characteristic vector of described quality measured values judgment matrix
Figure BDA00002222441400101
To characteristic vector
Figure BDA00002222441400102
Carry out normalized and obtain the normalization characteristic vector
Figure BDA00002222441400103
With the normalization characteristic vector
Figure BDA00002222441400104
In each element respectively as the weighted value of each quality measured values.
Step 207 calculates the numerical value of described user experience quality according to the weighted value of described quality measured values and quality measured values.
In step 207, according to formula QoE=w 1* KQI 1+ w 2* KQI 2+ w 3* KQI 3Calculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1Be the quality measured values of terminal capabilities, w 1For with KQI 1Corresponding weighted value; KQI 2Be the quality measured values of network performance, w 2For with KQI 1Corresponding weighted value; KQI 3Be the quality measured values of application service performance, w 3For with KQI 3Corresponding weighted value.
Using the step analysis mode to calculate corresponding normalization characteristic vector Afterwards, need to be to the normalization characteristic vector that calculates Carrying out compatibility judges.
In an embodiment of the present invention, to the normalization characteristic vector
Figure BDA00002222441400107
Carrying out the compatibility judgement is specially:
Calculate the eigenvalue of maximum of described quality measured values judgment matrix.
Eigenvalue of maximum according to described quality measured values judgment matrix calculates Consistency Ratio, whether judges the numerical value of described Consistency Ratio greater than predetermined threshold, if determine described normalization characteristic vector
Figure BDA00002222441400111
In each element be the weighted value of each quality measured values; If not, then not with described normalization characteristic vector
Figure BDA00002222441400112
In each element as the weighted value of each quality measured values.
Calculate in the process of weighted value of every KPI in step 204 as shown in Figure 2, need to calculate respectively the weighted value of the KPI that belongs to terminal capabilities, the weighted value of KPI that belongs to network performance and the weighted value that belongs to the KPI of service performance.
The below belongs to the KPI of network performance take calculating weighted value is elaborated as specific embodiment.
Fig. 3 is a kind of flow chart that calculates nondimensionalization KPI weighted value among the present invention; As described in Figure 3,
Step 301 according to set judgment rule kilsyth basalt, is relatively set up respectively the performance index judgment matrix in twos by the nondimensionalization KPI that will belong to network performance, and wherein, table 3 is a kind of judgment rule kilsyth basalt among the present invention.It is as shown in table 3,
Table 3
Judge yardstick Definition Judge yardstick Definition
1 For H, a iAnd a jNo less important 7 For H, a iCompare a jMuch important
3 For H, a iCompare a jImportant a little 9 For H, a iCompare a jDefinitely important
5 For H, a iCompare a jImportant 2，4，6，8 Judge between the yardstick between above-mentioned two
According to the Key Performance Indicator that is used to indicate network performance listed in the table 1: send success rate, Message Time Delay, service building success rate, professional setup delay and message transmission rate, with every Key Performance Indicator respectively as X-axis and Y-axis, compare in twos according to table 3, obtain table 4.The table 4 every Key Performance Indicator of expression significance level between any two.For example: for instant messaging, Message Time Delay is 4 with respect to the judgement numerical value that sends success rate, namely Message Time Delay with respect to the significance level that sends success rate between important a little and important.
Table 4
Send success rate Message Time Delay Service building success rate Professional setup delay Message transmission rate
Send success rate 1 4 3 5 4
Message Time Delay 1/4 1 1/2 4 3
Service building success rate 1/3 2 1 5 3
Professional setup delay 1/5 1/4 1/5 1 1/3
Message transmission rate 1/4 1/3 1/3 3 1
Obtain corresponding judgment matrix A according to table 4:
A = | 1 4 3 5 4 1 / 4 1 1 / 2 4 3 1 / 3 2 1 5 3 1 / 5 1 / 4 1 / 5 1 1 / 3 1 / 4 1 / 3 1 / 3 3 1 |
Step 302 is according to performance index judgment matrix calculated characteristics vector.
In step 302, matrix A is described performance index judgment matrix; Contrast each element in this performance index judgment matrix, according to formula
Figure BDA00002222441400122
Calculate characteristic vector
Figure BDA00002222441400123
Wherein, i=1,2 ... n; Wherein, n is line number or the columns of matrix A, namely belongs to the quantity of every type KPI, in this embodiment, and n=5; The characteristic vector that calculates ω → ( 0 ) = ( 2.9926,1.0844,1.5849,0.3196,0.6084 ) T .
Step 303 is to characteristic vector
Figure BDA00002222441400125
Carry out normalized and obtain the normalization characteristic vector
Figure BDA00002222441400126
In step 303, to vector ω → ( 0 ) = ( 2.9926,1.0844,1.5849,0.3196,0.6084 ) T Carry out obtaining after the normalized ω → ( 0 ) = ( 0 . 4541 , 0.1646,0.2405,0 . 0485 , 0.0923 ) T . Wherein, this normalization characteristic vector
Figure BDA00002222441400129
In element be followed successively by and send success rate, Message Time Delay, service building success rate, professional setup delay and weighted value corresponding to message transmission rate.
Step 304 is calculated eigenvalue of maximum according to the performance index judgment matrix.
In step 304, according to formula λ max = 1 n [ Σ j = 1 n a 1 j ω j ω 1 + Σ j = 1 n a 2 j ω j ω 2 + . . . + Σ j = 1 n a nj ω j ω n ] Calculate corresponding eigenvalue of maximum, obtain eigenvalue of maximum λ Max=5.2883.Wherein, n is line number or the columns of matrix A, namely belongs to the quantity of every type KPI, in this embodiment, and n=5
Step 305 is calculated Consistency Ratio corresponding to this normalization characteristic vector according to the eigenvalue of maximum of described performance index judgment matrix, judges that whether described Consistency Ratio is greater than predetermined threshold value.
In step 305, according to formula
Figure BDA00002222441400131
Calculate corresponding Consistency Ratio C.I, whether judge Consistency Ratio greater than predetermined threshold value, wherein, predetermined threshold value is 0.1.The actual Consistency Ratio that obtains C . I = &lambda; max - n n - 1 = 0.2883 / 4 = 0.0721 < 0.10 . Owing to calculating the value of C.I greater than predetermined threshold value, then this normalization characteristic vector &omega; &RightArrow; = ( 0.4541,0.1646,0.2105,0.0485,0.0923 ) T In each element be the weighted value of each nondimensionalization KPI under the type.Namely for the Key Performance Indicator of indication network performance, wherein, send the weighted value ω of success rate 1=0.4541, the weighted value ω of Message Time Delay 2=0.1646, the weighted value ω of service building success rate 3=0.2405, the weighted value ω of professional setup delay 3=0.0485, message transmission rate ω 5=0.0923.
The weighted value that flow process by is as shown in Figure 3 calculated the KPI of indicating terminal performance below omits detailed process, and the characteristic vector of weighted value that draws the KPI of indicating terminal performance is: &omega; &RightArrow; = ( 0.3089,0.0930,0.3594,0.0730,0.1657 ) T
Calculate the weighted value of the KPI of indication application service performance by flow process as shown in Figure 3, below omit detailed process, the characteristic vector that draws the weighted value of the KPI that indicates the application service performance is: &omega; &RightArrow; ( 0.0543,0.0879,0.1800,0.4083,0.2694 ) T
Calculate the weighted value of each quality measured values of indication by flow process as shown in Figure 3, below omit detailed process, the characteristic vector of weighted value that draws the quality measured values of the quality measured values of quality measured values, indication network performance of indicating terminal performance and indication application service is:
Figure BDA00002222441400136
The weighted value that is the quality measured values of terminal capabilities is 0.1365; The weighted value of the quality measured values of network performance is 0.6250; The weighted value of the quality measured values of application service is 0.2385.According to formula QoE=w 1* KQI 1+ w 2* KQI 2+ w 3* KQI 3Calculate user experience quality that should instant messaging.
Fig. 4 is the level schematic diagram of the quality measurement of user experience in a kind of specific embodiment among the present invention.As shown in Figure 4, in the concrete mobile Internet business for instant messaging, comprise the quality measured values of terminal capabilities, the quality measured values of network performance and the quality measured values of application service performance for the user experience quality of this mobile Internet business.Wherein, the quality measured values of described terminal capabilities calculates by Key Performance Indicators such as cpu performance, memory consumption, response time, screen resolution, operating system performances; The quality measured values of described network performance calculates by sending the Key Performance Indicators such as success rate, descending time delay, service building success rate, professional setup delay, message transmission rate; The quality measured values of application service performance calculates by Key Performance Indicators such as EMS memory occupation amount, service end maximum number of connections, server cpu performance, mission critical operating procedure, data transfer overhead.
The total weight value that obtains after the weighted value of type multiplies each other with the weighted value of every Key Performance Indicator in the table 1 and under it is depicted as block diagram with described total weight value, as shown in Figure 5.Fig. 5 is the total weight value schematic diagram of the Key Performance Indicator in a kind of specific embodiment of the present invention.In Fig. 5, X-axis represents the numbering of every KPI in the table 1, and Y-axis is the total weight value corresponding with every KPI; Described total weight value is multiplied each other by the weighted value of quality measured values under the weighted value of every KPI and this KPI and obtains.Total weight value such as KPI-1 is ω 1* w 1In Fig. 5, can find out that KPI-6 namely sends the total weight value of success rate the highest, namely can be interpreted as for instant messaging, send success rate the most important for the user experiences.
Using the present invention to carry out in the process of quality measurement of user experience, can be according to the total weight value of the every Key Performance Indicator that calculates, improve targetedly the user experience quality of a certain business, if namely want to improve the user experience quality with a certain mobile Internet business, can be by improving the large Key Performance Indicator of total weight value, the mode of then optimizing other Key Performance Indicators improves.Namely by improving the mode of the high Key Performance Indicator of weighted value, with less cost, significantly improve user experience quality.
When using the present invention to carry out the measurement of user experience quality of mobile Internet business, can understand according to the numerical value of the user experience quality that measures the actual mass of current mobile Internet business.The user experience quality of the current mobile Internet business by the reflection of this numerical value is not simple outstanding or good, but from always reflecting on the whole the user experience quality of current mobile Internet business.
In addition, in other embodiments of the invention, for different mobile Internet businesss, only need to realize the measurement operation to the user experience quality of different mobile Internet businesss by adjusting the weighted value between each KPI.For example, for not strong mobile application of terminal dependence, such as speech business, short message service etc. can be made as 0 with the weighted value of indicating terminal performance.For not strong mobile application of mesh dependence, such as single-play game, local video player etc., the weighted value of indication network performance can be made as 0.Be that the present invention can adjust respectively corresponding weighted value for the different degrees of dependence of terminal, network and application service according to mobile Internet business, so that mobile Internet business quality measurement of user experience method provided by the present invention has a versatility.
The present invention also provides a kind of mobile Internet business quality measurement of user experience device, and referring to Fig. 6, this device comprises: module 601, Key Performance Indicator acquisition module 602, quality measured values computing module 603 and user experience quality computing module 604 are set; Wherein,
Module 601 is set, be used for arranging at least Key Performance Indicator of three types, described three types comprises the first kind, Second Type and the 3rd type, the Key Performance Indicator indicating terminal performance that belongs to the first kind, the Key Performance Indicator indication network performance that belongs to Second Type, the Key Performance Indicator that belongs to the 3rd type is indicated the application service performance;
Key Performance Indicator acquisition module 602, be used for to gather the Suitable For Moving-goal Problems Internet service described at least three types Key Performance Indicator and send to quality measured values computing module 603;
Quality measured values computing module 603, be used for receiving the Key Performance Indicator that Key Performance Indicator acquisition module 602 sends, obtain respectively quality measured values under the respective type according to the Key Performance Indicator under every type that collects, wherein, quality measured values under the first kind that gets access to is the terminal quality measured value, quality measured values under the Second Type that gets access to is the network quality measured value, and the quality measured values under the 3rd type that gets access to is the application service quality measured value;
User experience quality computing module 604 is for the numerical value that calculates the user experience quality of Suitable For Moving-goal Problems Internet service according to the quality measured values under described each type.
In said apparatus, quality measured values computing module 603 is used for collecting KPI and is converted to nondimensionalization KPI by the nondimensionalization computing; According to the step analysis mode, utilize nondimensionalization KPI to calculate the weighted value of every type of lower each nondimensionalization KPI; According to following formula, utilize the weighted value of every type of lower nondimensionalization KPI and nondimensionalization KPI to calculate described quality measured values:
KQI i=ω 1* KPI 1+ ω 2* KPI 2+ ... + ω n* KPI nCalculate corresponding quality measured values; Wherein, KQI iRepresent the quality measured values under the i type; KPI 1Be the 1st nondimensionalization KPI under the i type, ω 1For with KPI 1Corresponding weighted value; KPI 2Be the 2nd nondimensionalization KPI under the i type, ω 2For with KPI 2Corresponding weighted value; KPI nBe n nondimensionalization KPI under the i type, ω nFor with KPI nCorresponding weighted value;
User experience quality computing module 604 is used for according to the step analysis mode, calculates the weighted value of each quality measured values; According to following formula, utilize the weighted value of described quality measured values and quality measured values to calculate the numerical value of described user experience quality:
QoE=w 1* KQI 1+ w 2* KQI 2+ ... + w i* KQI iCalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1Be the quality measured values of the first kind, w 1For with KQI 1Corresponding weighted value; KQI 2Be the quality measured values of Second Type, w 2For with KQI 1Corresponding weighted value; KQI iBe the quality measured values of i type, w iFor with KQI iCorresponding weighted value.
In said apparatus, quality measured values computing module 603, be used for according to set judgment rule kilsyth basalt, relatively set up in twos respectively performance index judgment matrix under the described type by the nondimensionalization KPI with each type, wherein, the comparative result and the corresponding relation of judging scale-value of two nondimensionalization KPI of described performance index judgment rule kilsyth basalt indication, described performance index judgment matrix is by judging that the yardstick value obtains; Calculate the characteristic vector of described performance index judgment matrix
Figure BDA00002222441400161
To characteristic vector
Figure BDA00002222441400162
Carry out normalized and obtain the normalization characteristic vector
Figure BDA00002222441400163
With the normalization characteristic vector
Figure BDA00002222441400164
In each element respectively as the weighted value of described nondimensionalization KPI under all types of;
User experience quality computing module 604, be used for according to set judgment rule kilsyth basalt, by each quality measured values is relatively set up respectively judgment matrix in twos, wherein, the comparative result and the corresponding relation of judging scale-value of two quality measured values of described judgment rule kilsyth basalt indication, described quality measured values judgment matrix is by judging that the yardstick value obtains; Calculate the characteristic vector of described quality measured values judgment matrix
Figure BDA00002222441400165
To characteristic vector
Figure BDA00002222441400166
Carry out normalized and obtain the normalization characteristic vector
Figure BDA00002222441400167
With the normalization characteristic vector
Figure BDA00002222441400168
In each element respectively as the weighted value of each quality measured values.
The specific works mode of each module can referring to the related content of embodiment of the method for the present invention, not repeat them here among apparatus of the present invention embodiment.
In sum, technical scheme provided by the invention is by arranging polytype Key Performance Indicator, when measuring, gather set polytype Key Performance Indicator and calculate corresponding quality measured values, calculated the technological means of the user experience quality numerical value of mobile Internet business by quality measured values, can accurately measure the numerical value of the user experience quality of reflection mobile Internet business.
The embodiment of the invention can be from the user experience quality of the current mobile Internet business of the aspects such as end side, network side and application service side integral body reflection, very approaching with actual user's experience by the measurement result that the present invention obtains, thereby the measurement result that can utilize this programme to obtain is improved the correlated performance of mobile Internet business, improves user experience quality.
The above is preferred embodiment of the present invention only, is not for limiting protection scope of the present invention.All any modifications of doing within the spirit and principles in the present invention, be equal to replacement, improvement etc., all be included in protection scope of the present invention.

Claims (10)

1. mobile Internet business quality measurement of user experience method, it is characterized in that, at least the Key Performance Indicator of three types is set, described three types comprises the first kind, Second Type and the 3rd type, the Key Performance Indicator indicating terminal performance that belongs to the first kind, the Key Performance Indicator indication network performance that belongs to Second Type, the Key Performance Indicator that belongs to the 3rd type is indicated the application service performance, and described method comprises:
Gather the Key Performance Indicator of the described at least three types of Suitable For Moving-goal Problems Internet service;
Key Performance Indicator under the utilization collect every type obtains respectively the quality measured values under the respective type, wherein, quality measured values under the first kind that gets access to is the terminal quality measured value, quality measured values under the Second Type that gets access to is the network quality measured value, and the quality measured values under the 3rd type that gets access to is the application service quality measured value;
Calculate the numerical value of the user experience quality of Suitable For Moving-goal Problems Internet service according to described quality measured values under all types of.
2. method according to claim 1 is characterized in that,
The quality measured values that Key Performance Indicator under the described utilization collect every type obtains respectively under the respective type comprises:
The Key Performance Indicator that collects is converted to the nondimensionalization Key Performance Indicator by the nondimensionalization computing;
According to the step analysis mode, utilize the nondimensionalization Key Performance Indicator to calculate the weighted value of every type of lower each nondimensionalization Key Performance Indicator;
Utilize the weighted value of every type of lower nondimensionalization Key Performance Indicator and nondimensionalization Key Performance Indicator to calculate described quality measured values.
3. method according to claim 2 is characterized in that, the described weighted value that utilizes every type of lower nondimensionalization Key Performance Indicator and nondimensionalization Key Performance Indicator calculates described quality measured values and comprises:
According to formula KQI i=ω 1* KPI 1+ ω 2* KPI 2+ ... + ω n* KPI nCalculate corresponding quality measured values; Wherein, KQI iRepresent the quality measured values under the i type; KPI 1Be the 1st nondimensionalization Key Performance Indicator under the i type, ω 1For with KPI 1Corresponding weighted value; KPI 2Be the 2nd nondimensionalization Key Performance Indicator under the i type, ω 2For with KPI 2Corresponding weighted value; KPI nBe n nondimensionalization Key Performance Indicator under the i type, ω nFor with KPI nCorresponding weighted value.
4. method according to claim 3 is characterized in that, the described numerical value that calculates the user experience quality of Suitable For Moving-goal Problems Internet service according to the quality measured values under all types of comprises:
According to the step analysis mode, calculate the weighted value of each quality measured values;
Utilize the weighted value of described quality measured values and described quality measured values to calculate the numerical value of described user experience quality.
5. method according to claim 4 is characterized in that, the numerical value that the described weighted value that utilizes described quality measured values and described quality measured values calculates described user experience quality comprises:
According to formula QoE=w 1* KQI 1+ w 2* KQI 2+ ... + w i* KQI iCalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1Be the quality measured values of the first kind, w 1For with KQI 1Corresponding weighted value; KQI 2Be the quality measured values of Second Type, w 2For with KQI 1Corresponding weighted value; KQI iBe the quality measured values of i type, w iFor with KQI iCorresponding weighted value.
6. method according to claim 5 is characterized in that,
Described according to the step analysis mode, the weighted value that utilizes the nondimensionalization Key Performance Indicator to calculate every type of lower each nondimensionalization Key Performance Indicator comprises:
According to set judgment rule kilsyth basalt, by the nondimensionalization Key Performance Indicator of each type relatively being set up respectively in twos the performance index judgment matrix under the described type, wherein, the comparative result and the corresponding relation of judging scale-value of two nondimensionalization Key Performance Indicators of described judgment rule kilsyth basalt indication, described performance index judgment matrix is by judging that the yardstick value obtains;
Calculate the characteristic vector of described performance index judgment matrix
Figure FDA00002222441300021
To characteristic vector
Figure FDA00002222441300022
Carry out normalized and obtain the normalization characteristic vector
Figure FDA00002222441300023
With the normalization characteristic vector In each element respectively as the weighted value of described nondimensionalization Key Performance Indicator under all types of;
Described according to the step analysis mode, the weighted value that calculates each quality measured values comprises:
According to set judgment rule kilsyth basalt, by each quality measured values is relatively set up respectively the quality measured values judgment matrix in twos, wherein, the comparative result and the corresponding relation of judging scale-value of two quality measured values of described judgment rule kilsyth basalt indication, described quality measured values judgment matrix is by judging that the yardstick value obtains;
Calculate the characteristic vector of described quality measured values judgment matrix
Figure FDA00002222441300031
To characteristic vector
Figure FDA00002222441300032
Carry out normalized and obtain the normalization characteristic vector
Figure FDA00002222441300033
With the normalization characteristic vector
Figure FDA00002222441300034
In each element respectively as the weighted value of each quality measured values.
7. method according to claim 6 is characterized in that,
With the normalization characteristic vector
Figure FDA00002222441300035
In each element respectively before the weighted value as described nondimensionalization Key Performance Indicator under all types of, described method also comprises:
Calculate the eigenvalue of maximum of described performance index judgment matrix;
Eigenvalue of maximum according to described performance index judgment matrix calculates Consistency Ratio, whether judges the numerical value of described Consistency Ratio greater than predetermined threshold, if determine described normalization characteristic vector
Figure FDA00002222441300036
In each element be the weighted value of each nondimensionalization Key Performance Indicator under the type; If not, then not with described normalization characteristic vector
Figure FDA00002222441300037
In each element as the weighted value of each nondimensionalization Key Performance Indicator under the type;
With the normalization characteristic vector In each element respectively before the weighted value as each quality measured values, described method also comprises:
Calculate the eigenvalue of maximum of described quality measured values judgment matrix;
Eigenvalue of maximum according to described quality measured values judgment matrix calculates Consistency Ratio, whether judges the numerical value of described Consistency Ratio greater than predetermined threshold, if determine described normalization characteristic vector
Figure FDA00002222441300039
In each element be the weighted value of each quality measured values; If not, then not with described normalization characteristic vector
Figure FDA000022224413000310
In each element as the weighted value of each quality measured values.
8. a mobile Internet business quality measurement of user experience device is characterized in that, this device comprises: module, Key Performance Indicator acquisition module, quality measured values computing module and user experience quality computing module are set; Wherein,
Module is set, be used for arranging at least Key Performance Indicator of three types, described three types comprises the first kind, Second Type and the 3rd type, the Key Performance Indicator indicating terminal performance that belongs to the first kind, the Key Performance Indicator indication network performance that belongs to Second Type, the Key Performance Indicator that belongs to the 3rd type is indicated the application service performance;
The Key Performance Indicator acquisition module, be used for to gather the Suitable For Moving-goal Problems Internet service described at least three types Key Performance Indicator and send to the quality measured values computing module;
The quality measured values computing module, be used for receiving the Key Performance Indicator that the Key Performance Indicator acquisition module sends, obtain respectively quality measured values under the respective type according to the Key Performance Indicator under every type that collects, wherein, quality measured values under the first kind that gets access to is the terminal quality measured value, quality measured values under the Second Type that gets access to is the network quality measured value, and the quality measured values under the 3rd type that gets access to is the application service quality measured value;
The user experience quality computing module is for the numerical value that calculates the user experience quality of Suitable For Moving-goal Problems Internet service according to the quality measured values under described each type.
9. device according to claim 8 is characterized in that,
Described quality measured values computing module is used for collecting Key Performance Indicator and is converted to the nondimensionalization Key Performance Indicator by the nondimensionalization computing; According to the step analysis mode, utilize the nondimensionalization Key Performance Indicator to calculate the weighted value of every type of lower each nondimensionalization Key Performance Indicator; According to following formula, utilize the weighted value of every type of lower nondimensionalization Key Performance Indicator and nondimensionalization Key Performance Indicator to calculate described quality measured values:
KQI i=ω 1* KPI 1+ ω 2* KPI 2+ ... + ω n* KPI nCalculate corresponding quality measured values; Wherein, KQI iRepresent the quality measured values under the i type; KPI 1Be the 1st nondimensionalization Key Performance Indicator under the i type, ω 1For with KPI 1Corresponding weighted value; KPI 2Be the 2nd nondimensionalization Key Performance Indicator under the i type, ω 2For with KPI 2Corresponding weighted value; KPI nBe n nondimensionalization Key Performance Indicator under the i type, ω nFor with KPI nCorresponding weighted value;
Described user experience quality computing module is used for according to the step analysis mode, calculates the weighted value of each quality measured values; According to following formula, utilize the weighted value of described quality measured values and quality measured values to calculate the numerical value of described user experience quality:
QoE=w 1* KQI 1+ w 2* KQI 2+ ... + w i* KQI iCalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1Be the quality measured values of the first kind, w 1For with KQI 1Corresponding weighted value; KQI 2Be the quality measured values of Second Type, w 2For with KQI 1Corresponding weighted value; KQI iBe the quality measured values of i type, w iFor with KQI iCorresponding weighted value.
10. according to claim 8 or 9 described devices, it is characterized in that,
The quality measured values computing module, be used for according to set judgment rule kilsyth basalt, by the nondimensionalization Key Performance Indicator of each type relatively being set up respectively in twos the performance index judgment matrix under the described type, wherein, the comparative result and the corresponding relation of judging scale-value of two nondimensionalization Key Performance Indicators of described performance index judgment rule kilsyth basalt indication, described performance index judgment matrix is by judging that the yardstick value obtains; Calculate the characteristic vector of described performance index judgment matrix To characteristic vector
Figure FDA00002222441300052
Carry out normalized and obtain the normalization characteristic vector
Figure FDA00002222441300053
With the normalization characteristic vector In each element respectively as the weighted value of described nondimensionalization Key Performance Indicator under all types of;
The user experience quality computing module, be used for according to set judgment rule kilsyth basalt, by each quality measured values is relatively set up respectively judgment matrix in twos, wherein, the comparative result and the corresponding relation of judging scale-value of two quality measured values of described judgment rule kilsyth basalt indication, described quality measured values judgment matrix is by judging that the yardstick value obtains; Calculate the characteristic vector of described quality measured values judgment matrix
Figure FDA00002222441300055
To characteristic vector
Figure FDA00002222441300056
Carry out normalized and obtain the normalization characteristic vector
Figure FDA00002222441300057
With the normalization characteristic vector
Figure FDA00002222441300058
In each element respectively as the weighted value of each quality measured values.
CN201210374568.0A 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services Expired - Fee Related CN102904755B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210374568.0A CN102904755B (en) 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210374568.0A CN102904755B (en) 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services

Publications (2)

Publication Number Publication Date
CN102904755A true CN102904755A (en) 2013-01-30
CN102904755B CN102904755B (en) 2015-03-11

Family

ID=47576804

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210374568.0A Expired - Fee Related CN102904755B (en) 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services

Country Status (1)

Country Link
CN (1) CN102904755B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104394027A (en) * 2014-10-20 2015-03-04 上海海旭软件有限公司 Method and device of detecting network quality based on metadata
CN106797329A (en) * 2014-09-04 2017-05-31 株式会社Kt Special-purpose terminal and its operating method for measuring the Internet wire quality
CN106899448A (en) * 2017-01-22 2017-06-27 中国人民解放军信息工程大学 Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement
CN107666403A (en) * 2016-07-29 2018-02-06 中兴通讯股份有限公司 The acquisition methods and device of a kind of achievement data
CN108270606A (en) * 2016-12-31 2018-07-10 ***通信集团湖北有限公司 Quality of service Forecasting Methodology and quality of service prediction meanss
CN108334440A (en) * 2017-01-19 2018-07-27 阿里巴巴集团控股有限公司 A kind of processing method and processing device, client obtaining application performance test result
CN111626640A (en) * 2020-06-08 2020-09-04 中煤科工集团重庆研究院有限公司 Coal mine safety comprehensive risk evaluation method and system based on neutral reference object

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109359385B (en) * 2018-10-17 2021-11-23 网宿科技股份有限公司 Training method and device for service quality assessment model

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102104900A (en) * 2011-01-27 2011-06-22 大唐移动通信设备有限公司 Method and equipment for analyzing user perception
CN102143507A (en) * 2010-11-23 2011-08-03 北京中创信测科技股份有限公司 Method and system for monitoring service quality, and analytical method and system therefor
CN102457399A (en) * 2010-10-20 2012-05-16 中兴通讯股份有限公司 Service quality monitoring method based on QOE and system thereof
CN102685790A (en) * 2012-05-22 2012-09-19 北京东方文骏软件科技有限责任公司 Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102457399A (en) * 2010-10-20 2012-05-16 中兴通讯股份有限公司 Service quality monitoring method based on QOE and system thereof
CN102143507A (en) * 2010-11-23 2011-08-03 北京中创信测科技股份有限公司 Method and system for monitoring service quality, and analytical method and system therefor
CN102104900A (en) * 2011-01-27 2011-06-22 大唐移动通信设备有限公司 Method and equipment for analyzing user perception
CN102685790A (en) * 2012-05-22 2012-09-19 北京东方文骏软件科技有限责任公司 Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106797329A (en) * 2014-09-04 2017-05-31 株式会社Kt Special-purpose terminal and its operating method for measuring the Internet wire quality
CN104394027A (en) * 2014-10-20 2015-03-04 上海海旭软件有限公司 Method and device of detecting network quality based on metadata
CN104394027B (en) * 2014-10-20 2018-05-15 上海海旭软件有限公司 A kind of network quality detection method and device based on metadata
CN107666403A (en) * 2016-07-29 2018-02-06 中兴通讯股份有限公司 The acquisition methods and device of a kind of achievement data
CN107666403B (en) * 2016-07-29 2022-01-28 中兴通讯股份有限公司 Index data acquisition method and device
CN108270606A (en) * 2016-12-31 2018-07-10 ***通信集团湖北有限公司 Quality of service Forecasting Methodology and quality of service prediction meanss
CN108270606B (en) * 2016-12-31 2021-06-04 ***通信集团湖北有限公司 Service quality prediction method and service quality prediction device
CN108334440A (en) * 2017-01-19 2018-07-27 阿里巴巴集团控股有限公司 A kind of processing method and processing device, client obtaining application performance test result
CN106899448A (en) * 2017-01-22 2017-06-27 中国人民解放军信息工程大学 Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement
CN106899448B (en) * 2017-01-22 2019-06-28 中国人民解放军信息工程大学 Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement
CN111626640A (en) * 2020-06-08 2020-09-04 中煤科工集团重庆研究院有限公司 Coal mine safety comprehensive risk evaluation method and system based on neutral reference object

Also Published As

Publication number Publication date
CN102904755B (en) 2015-03-11

Similar Documents

Publication Publication Date Title
CN102904755B (en) Method and device for measuring quality of user experience of mobile-internet services
CN105357691A (en) LTE (Long Term Evolution) wireless network user sensitive monitoring method and system
CN102685791B (en) Method for evaluating user quality of experience (QoE) of WAP (Wireless Application Protocol) services by simulating user behavior
CN102685790B (en) Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors
CN104023232B (en) Based on the mobile video method for evaluating quality of step analysis and multiple linear regression
CN108337656B (en) Mobile crowd sensing excitation method
CN104618924B (en) User experience quality index system and measurement method based on wireless ubiquitous network
CN102880637B (en) Dynamic Web service trust evaluation method based on user honesty
CN109856515A (en) A kind of direct current cables state of insulation judgment method and system
CN104378220A (en) Method, device, user terminal and network server for evaluating user experience quality
CN105791046A (en) Method, device, terminal and server for evaluating user QoE
CN103577660B (en) Gray scale experiment system and method
CN103152599A (en) Mobile video service user experience quality evaluation method based on ordinal regression
Zhang et al. A QoE test system for vehicular voice cloud services
CN103081403A (en) Method and apparatus for analysis of the operation of a communication system using events
CN111586729A (en) Three-network signal detection method and system based on metering terminal communication
CN113965487A (en) Fault diagnosis system based on network flow data
FI129839B (en) Method for determining a performance indicator of a wireless telecommunications network
CN106656603A (en) Cloud service trust evaluation method based on multi-parameter interval number multi-attribute decision-making
CN110826859A (en) Method and system for remotely identifying electricity consumption property of user based on daily electricity quantity
CN111861246B (en) Rail transit energy-saving assessment method and system based on space-time big data
CN109525455A (en) Hydrological real-time monitoring network state comprehensive evaluation method
CN103973902A (en) Quantizing device and monitoring system and method for business quality of user perception
CN102711061B (en) Evaluation method of multimedia message service user perception and experience QoE for simulating user behavior
CN101072121A (en) System and method for estimating network optimized engineering requirements

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150311

Termination date: 20210927

CF01 Termination of patent right due to non-payment of annual fee