CN101133669A - Large scale measurement of subjective quality in mobile communications systems - Google Patents
Large scale measurement of subjective quality in mobile communications systems Download PDFInfo
- Publication number
- CN101133669A CN101133669A CNA2006800065230A CN200680006523A CN101133669A CN 101133669 A CN101133669 A CN 101133669A CN A2006800065230 A CNA2006800065230 A CN A2006800065230A CN 200680006523 A CN200680006523 A CN 200680006523A CN 101133669 A CN101133669 A CN 101133669A
- Authority
- CN
- China
- Prior art keywords
- quality
- subscriber unit
- voice
- subjective
- handheld
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
Large scale subjective signal quality measurements for a mobile radio communications system are made using a large number of handheld subscriber radio communication units moving at various positions in the mobile radio communications system. Each handheld subscriber unit stores a copy of a test voice or video signal stream as does a quality management network node. An uplink subjective signal quality for each such handheld subscriber unit is determined based on a comparison of the stored test signal and the received test signal from the handheld subscriber unit. A downlink subjective signal quality to each handheld unit is based on the returned test signal stream received from the handheld subscriber unit and the stored test signal stream. Because the handheld units do not perform the subjective quality comparison calculations, ordinary subscriber units that do not require significant extra data processing resources associated with those calculations may be used.
Description
The cross reference of provisional application
[0001] the application requires the U.S. Provisional Patent Application sequence number 60/656903 of the common transfer that is entitled as " the statistics voice/video quality in the large scale measurement mobile system " that is entitled as " the statistics voice quality in the large scale measurement mobile system " and submitted on March 23rd, 2005 submitted on March 1st, 2005 and 60/664192 priority, by reference its content is attached to herein.
Technical field
[0002] technical field is a radio communication.The present invention relates to collect the subjective quality of measurement data with the service determining to provide in the mobile radio communicaltions system, it can be used for improving service and/or optimizes performance or capacity in the mobile radio communicaltions system.
Background
[0003] in mobile radio communicaltions system, the service quality that offers the subscriber is extremely important.In the voice and video service importantly the people to the perception of the quality of speech message or video messaging.A kind of method of measuring this quality is the subjective testing that relates to various people.But the possibility of result is indivedual subjective, and testing cost is high and be not suitable for extensive quality monitoring.
[0004] developed " subjectivity " voice quality that several algorithms are measured institute's transferring voice file.An example is P.862 voice quality perception assessment (PESQ) algorithm of middle definition of ITU-T.According to traditional radio channel quality method of measurement,, can not measure subjective quality as signal to noise ratio (SIR), the error rate (BER), frame error rate (FER) or signal strength signal intensity.On the contrary, PESQ and similar algorithm predicts subjectivity are listened to the result of test.In order to measure voice quality, the degradation version of PESQ use feeling model comes voice signal more original, untreated, not transmission and this known voice signal of communication system output, for example the radio receiver reception because of the signal of radio channel distortion.Relatively reference and degradation voice signal provide the subjective quality scoring.
[0005] the subjective quality Measurement Algorithm, be to need mass data handle to calculate and the resource-intensive of considerable storage resources as PESQ.If continually or even constantly carry out mass measurement and calculating, this googol also can further aggravate according to handling load.Therefore, mobile test unit (MTU) the necessary powerful data processing hardware of measurement data and software of comprising calculating and storage and subjective quality decision algorithm, being associated as the PESQ algorithm.The video quality measurement algorithm may need more resources.Collect about the measurement data under the real conditions of existing radio situation these MTU cars each position in mobile radio communicaltions system.
[0006] still, these MTU are very expensive, heavy and want the considerable electric power of quantity consumed, and this makes them be not suitable for frequently carrying out from a large amount of measuring units the large scale measurement of mass measurement.Though adopting some MTU is feasible in commerce is provided with, and needs to carry out more massive measurement more, perhaps needs approximately hundreds of, thousands of or tens thousand of measuring units.In the future, it is functional to add mass measurement in each commercial user equipment, makes operator to begin and to stop to measure based on time, position or problem types.But this extensive cost height is not only because mass expensive MTU goes back because locate and/or operate the required human resources of these MTU.
General introduction
[0007] the present invention has overcome these obstacles and has reached these and other desired destination.A large amount of handheld subscriber radio communication units that use is arranged in each position of mobile radio communicaltions system have been realized the extensive subjective signal mass measurement of mobile radio communicaltions system.Each handheld subscriber unit picture element buret reason network node is equally stored a tested speech, other audio or video signal flow.Determine the up link subjective signal quality of each handheld subscriber unit at network node according to the test signal of storing and the comparison of the signal of acceptance test that transmits from handheld subscriber unit.According to the test signal of storage and originally transfer to handheld subscriber unit, the test signal stream that is back to network node by handheld subscriber unit subsequently is determined to each handheld unit on network node down link subjective signal quality.Because handheld unit is not carried out strict subjective signal mass ratio and calculated, can use common handheld subscriber unit.
[0008] a plurality of uplink quality values that quality management network node stores is associated with each handheld subscriber unit and down link subjective quality value, thereby definite whole subjective quality that is associated with each handheld subscriber unit.Can also measure position or zone and/or the special time frame of determining in the mobile radio communicaltions system for various subjective qualities.In an example embodiment, test signal stream is voice signal, and the quality that is associated with each handheld subscriber unit uses voice quality perception assessment (PESQ) algorithm to determine.Test stream also can be video or other audio frequency of being determined Algorithm Analysis by other suitable subjective quality.
[0009] database storage signal quality measured values, the time that is associated with the subjective signal quality measured values and the geographical position that is associated with the subjective signal quality measured values.Virtual network operator according to the information in this database of being stored in provide with mobile radio communicaltions system in each time and the subjective quality of service information that is associated of position.
[0010] in alternative example embodiment, handheld subscriber unit acceptance test voice, other audio or video signal become test data stream to this conversion of signals, and test data stream is back to the quality management network node.The quality management node is according to the test signal and the downlink signal quality that relatively is determined to handheld subscriber unit of returning data signal under test that receives from handheld subscriber unit of storage.
[0011] in another example embodiment, in determining, subjective quality considered the speed of handheld subscriber unit.Handheld subscriber unit sends to the quality management network node with its current location and translational speed.Quality management network node and handheld subscriber unit are divided into several portions to predetermined test signal.The part size is based on the position and/or the speed of handheld subscriber unit.Quality management network node and handheld subscriber unit are with send test massage stream rather than send as signal flow of a plurality of parts.Therefore, when handheld subscriber unit returned to the quality management network node to the part of the test signal stream of receiving, network node was from those part of returning reorganization test signal stream.In this or any embodiment, prevent that preferably the echo that returns predetermined testing signal from eliminating.
Summary of drawings
[0012] Fig. 1 is the high level, functional block diagram of mobile radio communicaltions system;
[0013] Fig. 2 is the functional block diagram of the mobile radio communicaltions system of bond quality management system;
[0014] Fig. 3 is the functional block diagram of handheld subscriber test cell;
[0015] Fig. 4 is the functional block diagram that the example implementation of one or more Quality Monitoring Control Systems (QMS) server, QMS database and QMS operator interface is adopted in explanation;
[0016] Fig. 5 illustrates the QMS controller and exchanges according to the signaling between the handheld test unit of example embodiment;
[0017] Fig. 6 illustrates the QMS controller and exchanges according to the signaling between the handheld test unit of another example embodiment;
[0018] Fig. 7 explanation can offer the example of the signal quality demonstration of operator according to signal quality.
Describe in detail
[0019] for ease of illustrating rather than limiting, in below describing detail has been proposed, as specific embodiment, step, technology etc.But, it will be apparent to one skilled in the art that and except that these details, can adopt other embodiment.For example, though the service that provides in the employed unrestricted example for the ease of following explanation and measure is voice service, the invention is not restricted to voice service and can be used for measuring the subjective quality of the radio communication services of any kind, include but not limited to that video, other audio frequency or server side have high processing and memory capacity and have other similar service that lower-performance and storage need in another example.
[0020] in some cases, omitted detailed description, in order to avoid unnecessary details hinders the description of this invention to well-known method, interface, circuit and signaling.In addition, in some figure, shown each frame.Person of skill in the art will appreciate that the function of these frames can be used each hardware circuit, uses software program and data, suitable digital microprocessor or all-purpose computer, the use application-specific integrated circuit (ASIC) (ASIC) of programming of combination and/or use one or more digital signal processors (DSP) to realize.
[0021] Fig. 1 illustrated example mobile radio communicaltions system 10.A plurality of subscriber equipmenies (UE) are communicated by letter with radio access network (RAN) 16 by wave point.The radio access technologies of any kind of, all can adopt as FDMA, TDMA, CDMA, GSM, WCDMA etc.Radio access network is coupled to one or more core net 14.The example core net comprises circuit-switched network, as mobile switching centre (MSC) and packet switching network, as the GPRS node.Core net 14 is coupled to one or more other networks 12, as internet, ISDN, PSTN etc.Radio access network can couple directly to Quality Monitoring Control System (QMS) 20.QMS 20 can also be coupled (or being coupled) to one or more core net 14 and/or one or more other network 12.Subscriber equipment (UE) includes but not limited to subscriber's terminal, portable terminal, mobile phone, mobile phone, travelling carriage, wireless terminal etc.
[0022] Fig. 2 explanation is according to the mobile communication system 20 of the non-limiting example embodiment of implementation quality measurement.The mobile network communicates by letter with a large amount of handheld test unit (HTU) 22 by wave point.The handheld test unit is corresponding to through legacy user's equipment of slightly modified, and is as regular handset etc., as described below.Modification does not require that data processing is calculated or any essence of storage increases.Handheld unit is preferably corresponding to a large amount of these subscriber's terminals that service is provided by the mobile network.The mobile network is coupled to one or more Quality Monitoring Control Systems (QMS) server 24.QMS server 24 is coupled to one or more QMS databases 26 and QMS operator interface 28.QMS server 24 can also be coupled to one or more other networks 12.
[0023] Fig. 3 is with the example of the formal specification handheld test unit (HTU) 22 of functional block diagram, and in preferred embodiment, it is typical mobile subscriber/subscriber's communication equipment, for example UE.Monitoring controller 30 is coupled to transceiving circuit 32, the memory 34 of storage tested speech/video flowing, and HTU position locator 36 is measured memory 38 and timer or real-time clock 39.Transceiving circuit 32 comprises conventional wireless telecommunication and base band signal process.Tested speech/video flowing 34 can be known or predetermined voice, sound or video flowing, and best (but and nonessential) designed so that test the subjective quality of received signal for test-purpose specially.Test stream can be speech sentence of recording or the video segment of recording, and simulates normal voice or video call respectively.
[0024] HTU position locator 36 is determined the current geographic position of HTU 22.For example, position locator 36 can be global positioning system (GPS) receiver/processor that sell the market.Perhaps, HTU position locator 36 can use triangulation in conjunction with the position of determining HTU 22 from a plurality of signal of base station in the radio access network 16.Certainly, also can use other technology to determine the position of HTU.Be used for providing the time value that is associated with the subjective quality measurement event of HTU 22 though timer 39 shows, clocking information can be from external source, as acquisitions such as base station, gps systems.Measure the voice or the video flowing of geographical route that memory 38 is used to store mobile HTU, reception and determine along the radio parameter of the radio environment of each point of route.
[0025] Fig. 4 illustrates the functional block diagram example of the one or more QMS servers 24 that are coupled to one or more QMS databases 26 and QMS operator interface 28.Can adopt other configuration.Suppose for following illustrative purposes, adopt a QMS server 24 and a QMS database 26.But, depend on the size of mobile communication system of monitoring and assessment, troop (bringing onto load is shared mechanism) of server and/or database may be suitable.
[0026] QMS server 24 can comprise file transfer protocol (FTP) (FTP) server 42.QMS ftp server 42 can be used for (1) and sends work order to object, mode, place and/or the time of HTU with specified measurement, and (2) comprise the position of HTU measured value and these measured values and/or the journal file of timing from HTU 22 receptions.Among the non-limiting example embodiment who is described below, the downlink test signal flow that HTU receives can be digitized and be stored in the journal file that sends to QMS ftp server 42.In addition, relevant various HTU incidents, can be included in the journal file as the information of the calling of switching, call drop, prevention etc.
[0027] QMS server 24 also can comprise call generator 47, carries out the calling from HTU of voice or video call or reception to HTU on voice or video line.Then, the calling connection of setting up by these call generators sends to the other end to a tested speech or a video flowing of pre-recording, and calls out the influence that connects quality so that measure.QMS server 34 also comprises the monitoring controller 40 of the integrated operation that is used to control QMS server 34, and be responsible for according to the QMS controller 44 of determining up link and down link subjective signal mass value from the information of QMS call generator 47 and each HTU 22 receptions, as hereinafter describing in detail.For example, QMS controller 44 can be carried out the ITU standard P ESQ subjective quality Measurement Algorithm that is used for voice or other audio frequency, and can use the subjective quality assessment algorithm of the similar type that is used for video.Can use other subjective quality Measurement Algorithm.
[0028] journal file processor 46 is changed the air interface measured value of reception and these measured values arrangements is database format.Then, formative data offer QMS database 26 by the journal file processor, wherein database manager 48 this information stores in archival memory 50.Journal file processor 46 also generates the mobile system incident, as mentioned above.UE event information and radio environment measured value help operator for example to understand the reason that specific low quality situation exists.In non-limiting example the 3rd embodiment (hereinafter describing), the downlink test signal flow that HTU receives is stored in the journal file as data file, and journal file processor 46 returns the conversion of signals in the journal file test signal stream of HTU detection and it is sent to QMS controller 44 and analyzes.
[0029] network interface 41 allows one or more communication the in QMS servers 24 and radio access network 16, core net 14 and/or other network 12.QMS operator interface 28 comprises the control desk of being supported by demoware application 54 and report application software 56 52.Demonstration application shows the subjective quality measurement data that HTU collects on for example map or grid, electrical form, line chart etc.The statistics of being taken from measurement data by demonstration application can be stored in the staqtistical data base.These statisticss can be used for discerning the trend of subjective signal quality measured values in the special time scope, perhaps according to a large amount of reduced data identification signal quality problems zones.Report is used 56 and is used for setting up report according to reduced data.
[0030] now in conjunction with the subjective signal quality deterministic process of Fig. 5 description according to a non-limiting example embodiment.Associated transport between Fig. 5 illustrated example task and QMS server 24 and handheld test unit (HTU) 22.At first, HTU 22 stores the tested speech/video signal flow of pre-recording.Term " voice " comprises any natural-sounding, music or other required audio signal in this article.For the sake of brevity, example is with speech explanation, but but these steps are equally applicable to the video of mankind's subjective evaluation quality or the communication medium of other type.HTU 22 spreads tested speech by wave point and is passed to radio access network (step S1), is sent to QMS controller 44 (step S2) via QMS call generator 47 again.QMS controller 44 is carried out subjective speech quality and is determined algorithm, as PESQ, with voice flow that subjectively relatively receives and the original test stream (step S3) that is stored in QMS server 24.Arithmetic result is the subjective measurement value of subjective uplink quality, is formatd and is stored in the archival memory 50 under the control of database manager 48 by journal file processor 46 subsequently.
[0031] the tested speech stream of pre-recording that is stored in the QMS server 24 sends to handheld test unit 22 (step S4) by QMS call generator 47 in the mode identical with user's (HTU) normal voice calls or video session and by wave point.Handheld test unit 22 receives the tested speech stream because of the transmission distortion of passing through wave point.Be not to allow handheld unit 22 carry out complicated subjective quality determine algorithm (as the PESQ algorithm), but HTU only return to QMS controller 44 (step S5) to the voice flow that receives at uplink direction.QMS controller 44 receives the voice flow (step S6) that returns, comprising the effectiveness (step S7) of the transmission by up link and down link.Then, QMS controller 44 calculates (1) down link subjective quality by subjective uplink signal quality of determining and combination up link and the down link subjective quality that (2) derive from step S8 in step S3.
[0032] in the first non-limiting example embodiment, QMS controller 44 is removed subjective uplink quality to obtain downlink measurement value from combination up link and down link subjective quality value.Because downlink signal quality is calculated by combination up link and downlink signal quality, so uplink signal quality should meet the requirements.
[0033] therefore, the algorithm of PESQ of the permission of the step described in Fig. 5 QMS server execution use ITU and so on is made required intensive data processing operation and the storage of many subjective signal quality decisions.Though not shown in Fig. 5, the handheld test unit also provides target position can be with band that each subjective signal quality measured values is associated the time for QMS controller 44.Then, by journal file processor 46, QMS controller 44 provides up link that calculates and the downlink signal quality that is associated with the ad-hoc location of HTU in special time and mobile radio communicaltions system.The relevant position and the temporal information of the handheld test unit of QMS database 50 storage uplinks and down link subjective signal mass value and requirement.The quantity of handheld test unit may be thousands of between tens thousand of, or more.The frequency that the subjective signal quality is determined is controlled by QMS operator.Because intensive data processing operation is carried out in QMS server 24 rather than HTU, so the complexity that increases and/or the calculated rate of increase can be dealt with by the resource that increases on the QMS server 24, and needn't increase resource for hundreds and thousands of even more handheld tests unit.
[0034] Fig. 6 illustrates the second non-limiting example embodiment of the mobile HTU of compensation.If the whole tested speech stream of this embodiment explanation provides, may influence the mobile HTU of the definite accuracy of subjective quality in individual data " bag ".Move in order to compensate HTU, this second non-limiting example is divided into littler part to tested speech stream according to the speed of HTU 22.Specifically, HTU 22 uses HTU position locator 36 definite its positions and operating speed position to determine its speed.The part size or the sample of the definite tested speech stream that will use of this speed.For example, fast speeds may allow less part size.HTU 22 provides its speed, and may provide the part size to QMS controller 44.Perhaps, HTU 22 can only provide its speed to QMS controller 44, and QMS controller 44 is determined suitable sample size/part.Then, HTU 22 sends the part of tested speech stream to QMS controller 44.Each part of QMS controller 44 acceptance test voice flows and they are grouped together is until rebuilding whole test stream.In case rebuild the up link subjective quality of i.e. comparison described in execution graph 5 steps 3 to determine to measure.
[0035] when the transmission tested speech flowed down line link among the step S4 of QMS controller 44 at Fig. 5, its only sent to HTU 22 to part of this test stream.Then, HTU 22 receives the part of the voice flow that it receives and returns to QMS controller 44 in step S5.These test of returning stream parts of QMS controller 44 combinations are calculated for the down link subjective quality in the step S8 of Fig. 5 then.Like this, just considered that HTU moves, the particularly influence of fast moving.If recording whole stream before the transmission on the uplink channel, the environment of then recording downlink flow will be different with the environment of transmit uplink stream.Block and to help to make current-carrying and download stream environment much at one.Though the size of test signal part depends on many factors, bigger HTU speed will have benefited from less part size usually.
[0036] when HTU 22 returned the tone testing stream that receives from radio net at down link or returns tone testing stream part, the existing echo that adopts in the radio access network 16 is eliminated had problem.In other words, depend on time that the base station actual transmission signal gives HTU and receive the degree of closeness of the time of the signal that returns that near the echo eliminator in one of base station in the radio net HTU may attempt eliminating voice flow or the voice flow part of returning.For avoiding this type of unwanted echo to eliminate, can use distinct methods.An exemplary method is to insert certain enough time delays before HTU can return voice flow/part by wave point.Another exemplary method is to shuffle them again before in reverse order different test signals are partly returned to the QMS controller.This also will be avoided the echo on the base station to eliminate, and be echo because echo eliminator can not detect the part of mixing Xian again.
[0037] in conjunction with Fig. 6 the 3rd non-limiting example embodiment is described now.This embodiment is especially favourable when uplink channel quality is undesirable.In the above-described embodiments, HTU is returned as data file to the voice flow that receives from QMS controller 44.If the uplink radio channels situation is poor, the inverse signal of distortion is accurately removed uplink signal quality information to the QMS controller from the composite signal of returning has adverse effect with the ability of extracting down link subjective signal quality.Therefore, QMS controller 44 uses conventional wireless radio channel quality metrics, waits the uplink radio situation of monitoring as signal interference ratio (SIR), received signal intensity (RSSI), the error rate (BER), frame error rate (FER).
[0038] if the uplink radio channels situation is undesirable, according to some evaluate parameter, QMS controller 44 may signal to the one or more HTU that relate to down link subjective signal mass measurement step, become corresponding data file (step S5) with a test stream translation that receives, and this data file is for example returned to QMS controller 44 as the part of journal file by wave point.As shown in Figure 6, tested speech circulation often connects (that is, the connection of setting up for voice-bearer is shown between step S1 and S2 and step S4 and the S5) via voice and sends.Therefore, step S1-S4 is identical with those steps shown in Fig. 5.But in step S5, the test signal stream of reception is converted into packet and is stored as data file.In step S6, data file connects (that is, for carrying the connection that data rather than voice are set up) part transmission as the HTU journal file via data.Data file more can be resisted abominable radio condition, because can use the redundant digit coding and carry out error detection and/or error correction before it sends on the QMS controller in radio access network.Ftp server 42 is changed back the voice flow of HTU actual reception to data file, and voice flow is sent to QMS controller 44 is used for determining subjective downlink quality (step S6).By the test signal that receives is sent as data file, the influence of the poor radio condition of uplink direction is avoided, make QMS controller 44 can from the inverse signal of combination, accurately remove the up link subjective quality, thereby allow in step S7 and S8, to use similar program shown in Figure 5 to calculate the down link subjective quality more accurately.
[0039] after carrying out a large amount of the measurement, the result who is stored in the QMS archival memory 50 can be handled by demonstration application 54 and/or report application 56, thereby provides Useful Information with the quality in the management of mobile telecommunication system to operator.The subjective quality information that a large amount of HTU provide be preferably in the database 50 with mobile radio communicaltions system in the geographical position and be associated at special time.Demonstration application 54 can generate map at operator's control desk 52 and show, as shown in Figure 7.In the PESQ algorithm, the voice quality of perception can have 1 to 6 MOS value, wherein 1 represents unacceptable quality, and the outstanding quality of 6 representatives.Color is associated with these values, is 1 such as redness, and brown is 2, and yellow is 3, and blueness is 5, and green is 6.Advance the dotted line point of route painted along each travelling carriage according to above scheme.Statistical trends and performance can be examined, and optimizer can be realized based on these statisticss and statistical trends.For example, a large amount of statisticss of relevant subjective signal quality can be used for discerning the position that covers difference or time, as rush hour.Operator can be by adding extra increases such as base station identification time or the signal strength signal intensity of position respond.
[0040] in a preferred embodiment, QMS is a computer system independently.That is to say, the operation of QMS is independent of the infrastructure of the wireless network of wireless service provider, eliminate thus the infrastructure of the wireless network of wireless service provider is carried out the needs of expensive change, and eliminated the needs that allow system carry out the intensive compatibility test of above-mentioned additional functionality.This has reduced realization and maintenance cost.It also allows more simply QMS to be integrated in the prior wireless network.But if needed, QMS is functional can be realized in one or more existing networks.
[0041] the present invention can realize in the combination of hardware, software or hardware and software, and can be in a computer system realizes with centralized system, and perhaps the distribution mode that is dispersed in the computer system of several interconnection with different elements realizes.Can use the computer system of any kind of or be applicable to the miscellaneous equipment of carrying out methods described herein.The typical combination of hardware and software can be the general-purpose computing system with computer program of control computer system execution methods described herein when loading and carry out.
[0042] to such an extent as to above explanation does not hint that all any particular element, step, scope or function are essential must being included in the claim scope.The scope of the theme of applying for a patent is only defined by claim.The scope that protects by law is by the words definition of stating in claim that allows and the coordinate thereof.Have no right requirement and will quote the 6th section of 35USC § 112, unless use word " be used for ... parts ".
Claims (22)
1. method that is used to obtain the extensive subjective signal mass measurement of mobile radio communicaltions system (20), described mobile radio communicaltions system (20) comprising: a large amount of handheld subscriber radio communication units (22) that are arranged in all places of mobile radio communicaltions system and provide radio communication service for the subscriber, store a tested speech or video signal flow at least one group in the described handheld subscriber unit (22); And store a test signal stream, via the quality management network node (24) that radio access network is communicated by letter with handheld subscriber unit, it is characterized in that:
Every group of handheld subscriber unit (22) spreads test signal by wave point delivers to quality management network node (24);
Every group of handheld subscriber unit (22) receives the test signal stream that is sent by matter reason managing network node (42) by wave point, and the test signal stream of receiving is returned to quality management network node (42); And
Quality management network node (42) is according to the up link subjective signal quality of relatively coming to determine every group of handheld subscriber unit (22) of test signal stream with the test signal stream that receives from this group handheld subscriber unit (22) of storage;
Quality management network node (42) is according to the test signal stream and the down link subjective signal quality that test signal stream is determined to every group of hand-hold wireless electric unit (22) of returning that receives from handheld subscriber unit (22) of storage.
2. the method for claim 1, it is characterized in that, a plurality of up link subjective signal mass values and down link subjective signal mass value that described quality management network node (42) storage is associated with every group of handheld subscriber unit (22), the whole subjective signal mass value of all places in definite thus mobile radio communicaltions system (20).
3. the method for claim 1 is characterized in that, described test signal stream is voice signal, and the subjective signal quality that is associated uses voice quality perception assessment (PESQ) algorithm to determine.
4. the method for claim 1 is characterized in that, memory time and geographical position when every group of handheld subscriber unit (22) sends test massage stream in each handheld subscriber unit (22).
5. the method for claim 1 is characterized in that also comprising:
The geographical position of in database (26), storing subjective signal quality measured values, the time that is associated with the subjective signal quality measured values and being associated with the subjective signal quality measured values for every group of handheld subscriber unit (22).
6. method as claimed in claim 5 is characterized in that also comprising:
According to be stored in the database (26) information for operator provide with mobile radio communicaltions system (20) in each time and the signal quality information that is associated of position.
7. the method for claim 1 is characterized in that, handheld subscriber unit (22) group of received test signal stream changes the test signal circulation that receives into data file, and data file is back to quality management network node (42),
Described quality management network node (42) is changed back the acceptance test signal flow that handheld subscriber unit (22) receives to the data file of returning, and according to the voice signal of storage or vision signal and the down link subjective signal quality that relatively is determined to handheld subscriber unit (22) through conversion data file from handheld subscriber unit (22) reception.
8. the method for claim 1 is characterized in that, every group of handheld subscriber unit (22) sends to quality management network node (42) with its current location and translational speed, and
Quality management network node (42) and every group of handheld subscriber unit (22) are the test signal flow point a plurality of parts, the part size is based on the position or the speed of handheld subscriber unit (22), and test signal stream is sent with a plurality of parts rather than as a signal flow, and
Every group of handheld subscriber unit (22) returns to quality management network node (42) to the part of the test signal stream of receiving, and quality management network node (42) uses the part reorganization test signal stream that returns.
9. the system as claimed in claim 1 is characterized in that also comprising:
Stop the echo that returns test signal stream to be eliminated.
10. the method for claim 1, it is characterized in that, described quality management network node (42) is removed the test signal stream of storage from the test signal returned stream, and the test signal stream of relatively residual signal and storage is with definite down link subjective signal quality.
11. a handheld subscriber radio communication unit (22) that is used to measure the subjective quality of the service that mobile radio communicaltions system (22) provides comprising:
Be used for transmitting transceiving circuit (32), memory (38) and the processor (30) of signal, it is characterized in that by wave point:
Memory (38) is configured to store known voice or video flowing, and
Processor (30) is configured to:
Determine the position and the correlation time of handheld subscriber unit (22);
Via transceiving circuit (32) position and temporal information are sent to quality management server (42) with the known voice or the video flowing of storage;
Return the known voice or subjective voice of video flowing associated uplink or the video quality that send with position, time and handheld subscriber unit (22) to allow quality management server (42) to determine via actual known voice that receive from quality management server (42) of transceiving circuit (32) or video flowing, and determine and send down link subjectivity voice or the video quality that known voice that position and time and handheld subscriber unit (22) return or video flowing are associated.
12. handheld subscriber unit as claimed in claim 11 is characterized in that also comprising:
The position locator (36) that is used for the current location of definite handheld subscriber unit.
13. handheld subscriber unit as claimed in claim 11, it is characterized in that, described processor (30) is configured to known voice or video flowing are divided into a plurality of parts, the part size is based on the position or the speed of handheld subscriber unit (22), and the known voice of storage or video flowing are sent with a plurality of parts rather than as a signal flow, and
Described processor (30) is configured to the known voice that receive from quality management server (42) or the receiving unit of video flowing are returned to quality management server (42).
14. handheld subscriber unit as claimed in claim 11 is characterized in that, described processor (30) is configured to the test signal circulation that receives is changed into data file, and data file is back to quality management server (42).
15. a quality management node (42) that is used to measure the subjective quality of the service that mobile radio communicaltions system (20) provides is characterized in that:
Be used to communicating by letter of a plurality of subscriber's hand-hold wireless communication unit (22) interface of interface (41) is provided;
Be used to store the voice of known version or the memory (47) of video flowing and subjective signal quality information; And
Be coupled to the controller (44) of interface (41) and memory (47), be used for:
Determine the position of each handheld subscriber unit (22);
Receive known voice or the video flowing that has transmitted version from each handheld subscriber unit (22);
The voice of known version or relatively determining and each handheld subscriber unit (22) associated uplink subjective quality of video flowing according to the known voice that transmit version or video flowing and storage;
The voice of known version or video flowing are sent to each handheld subscriber unit (22);
Receive known voice or the video flowing that returns version from each handheld subscriber unit (22);
According to the known voice that send version or video flowing and the known voice or the video flowing that return version, determine the down link subjective quality that is associated with each handheld subscriber unit (22).
16. quality management node as claimed in claim 15, it is characterized in that, described controller (44) is configured to the storage a plurality of up link subjective quality values and the down link subjective quality value that are associated with each handheld subscriber unit (22), thus for the special time frame for the definite whole subjective quality that is associated with each handheld subscriber unit (22) in position in the mobile radio communicaltions system (20) or zone.
17. quality management node as claimed in claim 15 is characterized in that, described controller is configured to use voice quality perception assessment (PESQ) algorithm to determine subjective quality.
18. quality management node as claimed in claim 15, it is characterized in that, described controller (44) is configured to when each handheld subscriber unit (22) sends the voice of known version or video flowing from each handheld subscriber unit (22) time of reception and geographical position, and described quality management node (42) also comprises:
The database (26) in the geographical position that is used to each handheld subscriber unit storage subjective signal quality measured values, the time that is associated with the subjective signal quality measured values and is associated with the subjective signal quality measured values.
19. quality management node as claimed in claim 18 is characterized in that also comprising:
Be used for providing a plurality of positions in the mobile radio communicaltions system (20) and operator's interface (28) of the subjective quality of service information of time for operator according to database (26) canned data.
20. quality management node as claimed in claim 15, it is characterized in that, described controller (44) is configured to receive corresponding to handheld unit from the voice of quality management node reception or the data file of vision signal from each handheld subscriber unit (22), and the conversion of described data file turned round and stretched out the hand hold voice or the video flowing that unit (22) receives
Described quality management network node (42) is configured to be determined to according to the voice of storage version or video flowing and switched voice or video flowing the down link subjective signal quality of each hand-hold wireless electric unit (22).
21. quality management node as claimed in claim 15 is characterized in that, described controller (44) is configured to receive from each handheld subscriber unit (22) current location and the translational speed of handheld subscriber unit (22), and
Described controller (44) is configured to the voice of known version or video flowing are divided into a plurality of parts, the part size is based on the position or the speed of handheld subscriber unit (22), and the voice of known version or video flowing are sent with a plurality of parts rather than as a signal flow, and
Described controller (42) is configured to be received in the voice of handheld unit (22) reception or the returning part of video flowing from each handheld subscriber unit (22), and uses part reorganization voice or the video flowing that receives.
22. quality management node as claimed in claim 15, it is characterized in that, described controller (44) is configured to remove the voice or the video flowing of storage version from known voice that return version or video flowing, and relatively remains the voice or the video flowing of voice or video flowing and storage version.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US65690305P | 2005-03-01 | 2005-03-01 | |
| US60/656,903 | 2005-03-01 | ||
| US60/664,192 | 2005-03-23 | ||
| US11/224,307 | 2005-09-13 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101133669A true CN101133669A (en) | 2008-02-27 |
Family
ID=39129926
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006800065230A Pending CN101133669A (en) | 2005-03-01 | 2006-02-03 | Large scale measurement of subjective quality in mobile communications systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101133669A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106030333A (en) * | 2014-02-20 | 2016-10-12 | 雅马哈株式会社 | Communication system, wired communication device, control method, and control program |
| CN106162700A (en) * | 2015-04-27 | 2016-11-23 | ***通信集团公司 | Method of testing, device and the terminal of a kind of terminal speech quality |
| WO2017206554A1 (en) * | 2016-06-03 | 2017-12-07 | 中兴通讯股份有限公司 | Downlink monitoring method and device |
-
2006
- 2006-02-03 CN CNA2006800065230A patent/CN101133669A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106030333A (en) * | 2014-02-20 | 2016-10-12 | 雅马哈株式会社 | Communication system, wired communication device, control method, and control program |
| CN106030333B (en) * | 2014-02-20 | 2019-12-13 | 雅马哈株式会社 | communication system, wired communication device, control method, and control program |
| CN106162700A (en) * | 2015-04-27 | 2016-11-23 | ***通信集团公司 | Method of testing, device and the terminal of a kind of terminal speech quality |
| CN106162700B (en) * | 2015-04-27 | 2019-06-25 | ***通信集团公司 | A kind of test method, device and the terminal of terminal speech quality |
| WO2017206554A1 (en) * | 2016-06-03 | 2017-12-07 | 中兴通讯股份有限公司 | Downlink monitoring method and device |
| CN107466062A (en) * | 2016-06-03 | 2017-12-12 | 中兴通讯股份有限公司 | Descending monitoring method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4829258B2 (en) | Large-scale measurement of subjective quality in mobile communication systems | |
| EP1716714B1 (en) | Method for determining mobile terminal performance in a running wireless network | |
| EP1267555B1 (en) | Measuring speech quality | |
| US9078143B2 (en) | Apparatus and method for evaluating voice quality in a mobile network | |
| CN105376089B (en) | A kind of network plan method and device | |
| JP3588056B2 (en) | Method for maintaining communication quality of service area in mobile communication system, management server system | |
| US6332076B1 (en) | Method and system for identifying and analyzing downlink interference sources in a telecommunications network | |
| CN102448083A (en) | Wireless communication voice quality assessment device, system and method thereof | |
| CN108093427A (en) | A kind of VoLTE evaluation the quality method and system | |
| EP3895393B1 (en) | Technique for user plane traffic quality analysis | |
| CN110536314A (en) | Determination method, apparatus, equipment and the medium of voice quality | |
| US8315630B2 (en) | Handoff metric for multiple transmission technologies | |
| CN110401965A (en) | VoLTE voice quality testing analysis method and system | |
| JP2002514034A (en) | Calculation of service quality for telecommunication services | |
| CN101133669A (en) | Large scale measurement of subjective quality in mobile communications systems | |
| CN105101237B (en) | A kind of speech quality dial testing method, server and auto-dial testing system | |
| GB2378859A (en) | Processing dropped calls in a cellular communications system and storing information about the locations where the calls are dropped | |
| Ramamoorthy et al. | A QoE-driven pricing scheme for inter-vehicular communications with four-stage Stackelberg game | |
| Weissberger et al. | Background service QoS in a UMTS network | |
| KR100726601B1 (en) | System for measuring quality of a wireless communication service and a method the same | |
| RU2407163C2 (en) | Large-scale measurement of subjective quality in mobile communication systems | |
| Qiao | Smarter phone based live QoE measurement | |
| CN107592646A (en) | A kind of detection method and device of cell voice quality | |
| WO2005109932A1 (en) | Method of testing a cellular network system | |
| CN112509603B (en) | Voice quality assessment method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20080227 |