CN113068021B - Delay testing method, device, equipment and storage medium - Google Patents
Delay testing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113068021B CN113068021B CN202110349388.6A CN202110349388A CN113068021B CN 113068021 B CN113068021 B CN 113068021B CN 202110349388 A CN202110349388 A CN 202110349388A CN 113068021 B CN113068021 B CN 113068021B
- Authority
- CN
- China
- Prior art keywords
- data
- time
- difference
- sample
- time difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The embodiment of the invention discloses a delay test method, a delay test device, delay test equipment and a storage medium. The method comprises the following steps: acquiring encoded source time data and decoded source time data corresponding to a first number of target images; acquiring a time difference value sample according to the coding source time data and the decoding source time data; and determining a delay test result according to the time difference value sample and a preset technical index. The embodiment of the invention can improve the accuracy and efficiency of the video delay test and save resources and test cost.
Description
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to a time delay testing method, a time delay testing device, time delay testing equipment and a storage medium.
Background
In the instant video communication process, after a video sending end collects video data, the video data needs to be coded and then transmitted to a video receiving end through a network, and then the video receiving end needs to decode the received coded video data to play the video. The time consumed for encoding and decoding the video data in the above process may cause the delay of video communication, such as the picture delay when watching live video or video call, and therefore, the delay from the video source encoding to the decoding process is one of the important reference indicators of the instant video communication quality.
In the prior art, video coding and decoding time delay is usually tested by a manual method. Fig. 1 is a flowchart of a video codec delay test method in the prior art, and fig. 2 is a scene diagram of a video codec delay test in the prior art. As shown in fig. 1 and fig. 2, testing requires that a tester takes a picture through a mobile phone, records a time stamp of an encoded source image and a time stamp of a decoded image, calculates a difference value between the time stamp of the encoded source image and the time stamp of the decoded image after recording a plurality of results, and takes an arithmetic mean of the difference value as a test result.
However, in the above method, firstly, because the test personnel take a picture manually, the duration of the shooting interval is not stable, and the change of the time delay in a continuous time period cannot be reflected well; secondly, data are manually recorded by a tester, and the delay time is obtained by only adopting a simple average value method, so that the number of recorded samples is limited, and the test result is inaccurate; meanwhile, after the test personnel take a picture, the time in the picture needs to be manually read, statistical software is filled in the picture for calculating the difference value, and then the average value is calculated, so that the time consumption of the test process is long.
Disclosure of Invention
The embodiment of the invention provides a delay test method, a delay test device, delay test equipment and a storage medium, which are used for improving the accuracy and efficiency of video delay test and saving resources and test cost.
In a first aspect, an embodiment of the present invention provides a delay testing method, including:
acquiring encoded source time data and decoded source time data corresponding to a first number of target images;
acquiring a time difference value sample according to the coding source time data and the decoding source time data;
and determining a delay test result according to the time difference value sample and a preset technical index.
In a second aspect, an embodiment of the present invention further provides a delay testing apparatus, including:
the time data acquisition module is used for acquiring coding source time data and decoding source time data corresponding to a first number of target images;
a difference sample obtaining module, configured to obtain a time difference sample according to the encoding source time data and the decoding source time data;
and the test result determining module is used for determining a delay test result according to the time difference value sample and a preset technical index.
In a third aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the latency testing method provided by any embodiment of the invention;
and the image acquisition device is used for acquiring the target image.
In a fourth aspect, an embodiment of the present invention further provides a computer storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the delay testing method provided in any embodiment of the present invention.
According to the embodiment of the invention, the coding source time data and the decoding source time data corresponding to the target image are automatically acquired, the time difference value sample with a certain capacity is established according to the acquired time data, the time difference value sample is tested according to the preset technical index to obtain the time delay test result, the time delay data is automatically identified, the video time delay test result is automatically calculated, the problems that in the prior art, the time consumption is long, the number of the test samples is small, the test result is inaccurate and the like due to the fact that data reading and calculation are carried out only depending on manpower are solved, the accuracy and the efficiency of the video time delay test are improved, and resources and the test cost are saved.
Drawings
Fig. 1 is a flowchart of a video codec delay testing method in the prior art.
Fig. 2 is a schematic view of a video codec delay test in the prior art.
Fig. 3 is a flowchart of a delay testing method according to an embodiment of the present invention.
Fig. 4 is a flowchart of a delay testing method according to a second embodiment of the present invention.
Fig. 5 is a schematic flowchart of a delay testing method according to a second embodiment of the present invention.
Fig. 6 is a schematic structural diagram of a delay testing apparatus according to a third embodiment of the present invention.
Fig. 7 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention.
It should be further noted that, for the convenience of description, only some but not all of the relevant elements of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 3 is a flowchart of a delay testing method according to an embodiment of the present invention, where this embodiment is applicable to a case of performing an automatic test on video codec delay, and the method can be executed by a delay testing apparatus according to an embodiment of the present invention, and the apparatus can be implemented by software and/or hardware, and can be generally integrated in a computer device. Accordingly, as shown in fig. 3, the method includes the following operations:
s110, acquiring encoded source time data and decoded source time data corresponding to the first number of target images.
The first number may be any number greater than zero, which is predetermined according to the accuracy required to be achieved by the test, and specifically, the higher the accuracy required to be achieved by the test is, the larger the first number may be. The target image collected at any moment can be an image collected at the moment and displayed on a terminal in the same instant video communication, and can include an image displayed at the moment by an encoding source terminal which encodes and transmits video data to be transmitted, and an image displayed at the moment by a decoding source terminal which receives and decodes the video data. The encoding source time data may be time data acquired from an image displayed by the encoding source terminal, may be a timestamp of the image, and may mark a time when the encoding source acquires the image. The decoding source time data may be time data acquired from an image displayed by the decoding source terminal, may be a time stamp of the image, and may mark a time when the encoding source acquires the image.
And in the test process, at least one group of encoding source terminals and decoding source terminals in instant video communication is included. The encoding source terminal can be used as a video sending terminal, can collect video data, adds a timestamp to each frame of image when the image is collected, displays the collected moment of the frame of image on each frame of image, encodes the video data and sends the encoded video data to a corresponding video receiving terminal. The decoding source terminal can be used as a corresponding video receiving terminal, and after receiving the video data sent by the encoding source terminal, the decoding source terminal can decode the video data. The encoding source terminal can display the acquired video data, and the decoding source terminal can display the decoded video data. In an ideal state, when the encoding source terminal acquires and displays a frame of image, the decoding source terminal can synchronously receive and display the frame of image, that is, the images displayed by the encoding source terminal and the decoding source terminal can have the same timestamp, but the image displayed on the decoding source terminal lags behind the image displayed on the encoding source terminal due to the time required by the encoding and decoding processes, so that the value of the encoding source time data is slightly larger than that of the decoding source time data in the target image acquired at the same time. Illustratively, in the process of video call between a terminal a and a terminal B, the terminal a collects a call video of a user and sends the call video to the terminal B after video coding, and the terminal B decodes and plays the video after receiving the call video. Due to the time delay caused by encoding and decoding, when the call video collected on the terminal A reaches the 11 th second, the picture of the call video in the 10 th second is displayed on the terminal B, and at the moment, the corresponding encoding source time data of the collected target image is 11 seconds, and the decoding source time data is 10 seconds.
In particular, a first number of target images may be collected for an encoding source terminal and a decoding source terminal. The first number may be any positive integer value set by man. After the first number is determined, image acquisition may be performed a plurality of times at different times with arbitrary time intervals, resulting in a first number of target images. Therefore, the larger the first number is, the more the acquired encoded source time data and decoded source time data are, and the more accurate the delay test result obtained according to the encoded source time data and decoded source time data is. Optionally, the first number of target images may be no less than 10 groups of target images corresponding to different time instants, so as to ensure that an accurate delay test result can be obtained according to the target images.
Further, the target image may be captured by any device having an image capturing function, but it should be noted that it must be ensured that the image displayed by the encoding source terminal and the decoding source terminal is captured at the same time in each captured target image. Alternatively, the same image capturing device (e.g., a camera device) may be used to capture images displayed by the encoding source terminal and the decoding source terminal at the same time, and the obtained target image is a photo image including the images displayed by the encoding source terminal and the decoding source terminal, so as to ensure that the images displayed by the encoding source terminal and the decoding source terminal are captured at the same time.
After the target image is acquired, the encoding source time data and the decoding source time data in the target image may be acquired by any realizable method, for example, image text recognition may be performed on images of the encoding source terminal and the decoding source terminal corresponding to the target image, respectively, time digital texts in the images are extracted, and the time digital texts are determined as the encoding source time data and the decoding source time data, respectively.
And S120, acquiring a time difference value sample according to the encoding source time data and the decoding source time data.
The time difference sample may be a data set composed of a difference between encoding source time data and decoding source time data corresponding to each target image, and may be used as a statistical sample of a video delay condition in a delay test.
Correspondingly, after the encoding source time data and the decoding source time data corresponding to the target images are obtained, the same calculation of the difference value can be performed on the encoding source time data and the decoding source time data corresponding to each target image, and the obtained calculation result is used as a sample observation value of the time difference sample to form the time difference sample. According to the data distribution characteristics of the sample observation values in the time difference value samples, the video delay condition in the delay test can be determined, for example, the average value of the samples can be calculated, so that the average delay amount of the video playing progress of the decoding source terminal compared with the video acquisition progress of the encoding source terminal is obtained.
And S130, determining a delay test result according to the time difference value sample and a preset technical index.
The preset technical index may be a preset technical index representing a requirement for video communication delay, and may correspond to a statistical result obtained by counting the time difference samples, and the specific content of the preset technical index is not limited in this embodiment. The delay test result may be obtained according to the statistical result of the time difference samples and a preset technical index, and may represent a video delay condition, for example, the video delay condition in the delay test may meet or not meet a requirement in the preset technical index.
Correspondingly, the obtained time difference value samples can be counted to obtain the data distribution characteristics of the sample observation values of the time difference value samples, the counting method can be preset, and the corresponding preset technical indexes can be set according to the set counting method. For example, after the time difference samples are obtained, averaging may be performed on the sample observation values in the time difference samples to obtain a sample average value, where the sample average value may represent an average delay amount of video communication in the delay test, and then a maximum allowable average delay amount in the video communication with a qualified quality may be determined as a corresponding preset technical index.
Furthermore, according to the comparison between the statistical result of the time difference sample and the preset technical index, whether the delay condition represented by the statistical result of the time difference sample can meet the requirement of the video communication with qualified quality on the delay can be judged, and a delay test result is obtained. For example, in the above example of performing the sample average value statistics on the time difference value samples, by comparing the sample average value with the preset technical index, when it is determined that the sample average value is smaller than the preset technical index, it may be determined that the average delay amount of video communication in the delay test is smaller than the maximum average delay amount that can be allowed in the video communication with qualified quality, and then it may be determined that the video communication delay condition in the delay test can meet the requirement of normal communication; when the average value of the samples is determined to be larger than the preset technical index, the average delay amount of the video communication in the delay test can be determined to be larger than the maximum allowable average delay amount in the video communication with qualified quality, and the video communication in the delay test can be determined to be serious in delay condition, so that the video communication quality is unqualified.
The embodiment of the invention provides a delay test method, which comprises the steps of automatically acquiring coding source time data and decoding source time data corresponding to a target image, establishing a time difference sample with a certain capacity according to the acquired time data, testing the time difference sample according to a preset technical index to obtain a delay test result, automatically identifying the time data by a machine, and automatically calculating to obtain a video delay test result.
Example two
Fig. 4 is a flowchart of a delay testing method according to a second embodiment of the present invention, and fig. 5 is a flowchart of a delay testing method according to a second embodiment of the present invention. In the embodiment of the present invention, a specific optional implementation manner for acquiring encoded source time data and decoded source time data corresponding to a first number of target images, acquiring a time difference sample according to the encoded source time data and the decoded source time data, and determining a delay test result according to the time difference sample and a preset technical index is provided. As shown in fig. 5, the delay testing method provided by the embodiment of the present invention may be applied to an automatic identification device, where a camera is configured in the automatic identification device, and the camera may be used to collect a target image to obtain a time difference sample, and the sample is analyzed by using t-distribution to obtain a delay testing result.
As shown in fig. 4 and 5, the method of the embodiment of the present invention specifically includes:
s210, acquiring encoded source time data and decoded source time data corresponding to a first number of target images.
In an optional embodiment of the present invention, S210 may specifically include:
s211, at different time points of a first number, simultaneously acquiring an encoding source image and a decoding source image of video data to be encoded and decoded, and determining the encoding source image and the decoding source image acquired at the same time point as a group of target images to obtain the target images of the first number.
The video data to be coded and decoded may be video data transmitted in the current video communication process. The encoding source image may be an image displayed on an encoding source terminal in the current video communication process. The decoded source image may be an image displayed on a decoding source terminal in the current video communication process.
Accordingly, the first number of different time points may be predetermined time points or time points determined according to a predetermined time interval. For example, the image capturing device (e.g., the camera of the automatic recognition device) may be configured to capture the target image every 5 seconds after the video communication starts, and when the first number is set to 5, the encoding source image and the decoding source image may be captured at the 5 th second, the 10 th second, the 15 th second, the 20 th second and the 25 th second after the video communication starts, respectively, so as to obtain five groups of target images.
S212, respectively carrying out image recognition processing on the time mark data of the coding source image and the decoding source image in each target image, determining the image recognition result of the time mark data of the coding source image as the coding source time data, and determining the image recognition result of the time mark data of the decoding source image as the decoding source time data.
The time stamp data may be time stamps displayed in the encoded source image and the decoded source image, and may be time stamps of the images, which mark the time when the encoded source captured the images. The image recognition process may be an operation of performing image recognition on the encoding source image and the decoding source image to recognize the time stamp data therefrom. The image recognition result of the time stamp data may be time data obtained by performing image recognition processing on the encoding source image and the decoding source image.
Correspondingly, when the video data are collected by the encoding source terminal, a timestamp can be added to each frame of image according to the moment when each frame of image is collected, so as to obtain time-stamp data. Optionally, timing may be performed according to a timing device in the encoding source terminal, and a timestamp may be added to the video data according to the time recorded by the timing device, so as to obtain timestamp data of the video data. The precision of timing the playing time of the video data determines the precision of the time stamp data, and for example, a timing tool with a precision of millisecond can be started in the encoding source terminal, so that each frame of image of the video data can be determined in units of milliseconds, and the time stamp data with the precision of millisecond is added in each frame of video image. The decoding source terminal can order the encoded source image for video communication.
It should be noted that the time stamp data in the image corresponds to the time when the image is captured by the encoding source terminal, not the actual time when the video is played to the image. Therefore, when the same frame of image of the video data is displayed at the encoding source terminal and the decoding source terminal, the time stamp data in the encoding source image and the decoding source image are the same. Illustratively, when video data acquisition of the encoding source terminal proceeds to 1 minute 11 seconds, the time stamp data in the encoding source image may be 1 minute 11 seconds. At this time, the decoding source terminal requests video data from the encoding source terminal. Due to the time delay caused by video encoding and decoding, when the image acquired by 1 minute 11 seconds is played on the decoding source terminal, the video data acquisition of the encoding source terminal is already performed for 1 minute 12 seconds, at this time, the time stamp data of the encoding source image is 1 minute 12 seconds, and the time stamp data of the decoding source image is 1 minute 11 seconds.
Further, the encoding source image and the decoding source image may be respectively subjected to image recognition processing to obtain an image recognition result of the time stamp data, and then the image recognition results corresponding to the encoding source image and the decoding source image in the same target image may be respectively determined as the encoding source time data and the decoding source time data corresponding to the target image.
The embodiment provides a specific method for acquiring a target image and acquiring encoded source time data and decoded source time data, so that the target image and the time data are accurately acquired, a time difference value sample obtained in the subsequent step can accurately reflect the video delay condition, and the accuracy of a delay test result is improved.
And S220, acquiring a time difference value sample according to the encoding source time data and the decoding source time data.
In an optional embodiment of the present invention, S220 may specifically include:
s221, obtaining a difference between the encoded source time data and the decoded source time data corresponding to the same target image, respectively, to obtain the first amount of time difference data.
The time difference data may be a difference between encoded source time data and decoded source time data corresponding to a set of target pictures.
Correspondingly, after the encoding source time data and the decoding source time data corresponding to the target images are obtained, the difference between the encoding source time data and the decoding source time data corresponding to each target image can be respectively calculated, each obtained difference can be used as one time difference data, and then the first number of time difference data can be obtained according to the first number of target images.
And S222, generating the time difference sample according to the time difference data.
Accordingly, the time difference samples with the sample capacity of the first data can be formed by using the obtained first amount of time difference data as the sample observation values of the time difference samples. The data distribution characteristics of the time difference data in the time difference sample can reflect the video delay condition in the delay test.
The embodiment provides a specific method for establishing the time difference sample, so that the time difference sample can accurately reflect the video delay condition, and the accuracy of the delay test result is improved.
And S230, determining a delay test result according to the time difference value sample and a preset technical index.
In an optional embodiment of the present invention, S230 may specifically include:
and S231, acquiring target test parameters of the time difference value sample.
The target test parameter may be data characterizing a data distribution of sample observations of the time difference value samples.
Correspondingly, the corresponding target test parameters can be obtained by performing statistical calculation on the time difference data in the time difference sample. The target test parameters correspond to the statistical method, and may be preset, and the specific content of the target test parameters is not limited in this embodiment.
In an optional embodiment of the present invention, the target test parameters may include: a sample average of the time difference samples, a sample variance of the time difference samples, and a sample capacity of the time difference samples.
Accordingly, the sample size may be the number of time difference data in the time difference samples. Further, the sample mean and the sample variance can be obtained according to the sample capacity. The sample average value may be obtained by summing all time difference data in the time difference sample, and dividing the sum by the number of the time difference data. In particular, sample average
Can be calculated by the following formula:
where n is the sample size of the time difference sample, Δ x i I =1,2, \ 8230;, n for the time difference data in the time difference samples.
Further, the sample variance may be used to characterize the deviation degree between the time difference data in the time difference sample and the sample average, and specifically, the sample variance s may be calculated by the following formula:
s232, acquiring difference degree data between the predicted average value of the time difference total and the preset technical index according to the target test parameter and the preset technical index.
Wherein the total time difference may be a delay amount at each time in the video communication under the delay test. The predicted average value may be an average value of a time difference total obtained by estimating according to a data distribution characteristic of a sample observation value of the time difference sample. The difference degree data may be data representing a difference between the predicted average value of the time difference value population and a preset technical index.
Correspondingly, according to the statistical principle, the data distribution characteristics of the sample observation values of the time difference samples can represent the data distribution characteristics of the time difference population, so that the time difference population can be analyzed according to the target test parameters of the time difference samples, and the prediction average value of the time difference population is estimated. The difference degree data may be obtained by calculating a target test parameter and a preset technical index, and the specific content of the difference degree data is not limited in this embodiment.
In an optional embodiment of the present invention, obtaining, according to the target test parameter and the preset technical indicator, difference degree data between a predicted average value of a total time difference and the preset technical indicator may include: and acquiring difference degree data between the predicted average value of the time difference total and the preset technical index by adopting t distribution according to the target test parameter and the preset technical index.
Where t-distribution can be used to estimate the mean of a population that follows a normal distribution and whose standard deviation is unknown.
Correspondingly, the delay amount in the video communication can be determined to be approximately in normal distribution according to the early-stage sampling data, and the standard deviation of the time difference value population is unknown, so that the time difference value population can be analyzed by adopting t distribution.
In an optional embodiment of the present invention, acquiring, according to the target test parameter and the preset technical index, difference degree data between the predicted average value of the time difference population and the preset technical index by using t distribution may include: first, a null hypothesis and an alternative hypothesis are determined.
The null hypothesis may be a hypothesis that the estimated total data falls within a certain interval, and may be that the time difference value generally meets a preset technical index. The time delay test result meeting the preset technical index can be that the total time difference value is less than the preset technical index. An alternative assumption may be that the time difference values do not generally meet a preset specification.
Secondly, calculating the t statistic value of the time difference value sample by adopting the following formula:
wherein t is t statistic of the time difference samples,
is the sample mean, μ 0 And s is the sample variance and n is the sample capacity.
Meanwhile, the degree of freedom of the time difference sample may be calculated using the following formula:
υ＝n-1
and upsilon is the degree of freedom of the time difference value sample.
Further, according to the degree of freedom and a preset unilateral significance level, a check critical value is inquired in a built-in t distribution table.
Wherein the preset one-sided significance level is the probability that an error is likely to be made by estimating the total data to fall within a certain interval in the case of one-sided examination. The test cut-off value may be a parameter determined according to the significance level and the degree of freedom. the t-distribution table may be pre-stored, including a queryable table of correspondence between the check threshold, the significance level, and the degree of freedom.
Accordingly, the form of the one-sided test, and the level of significance set, can be preset. Optionally, right-side inspection can be adopted, and the preset single-side significance level alpha is 0.01, so that an inspection critical value t can be inquired in a built-in t distribution table according to the single-side significance level alpha and the degree of freedom upsilon (α,υ) 。
And finally, acquiring numerical difference data of the t statistic and the inspection critical value according to the zero hypothesis and the alternative hypothesis, and determining the numerical difference data as the difference degree data.
Wherein the numerical difference data may be a difference between the t statistic and the test threshold.
Accordingly, the specific content of the numerical difference data may be determined based on the null hypothesis and the alternative hypothesis. Optionally, when the assumption of zero is that the time difference overall meets the preset technical index, the numerical difference data may be a difference obtained by subtracting the test critical value from the t statistic. The difference data of the t statistic and the detection critical value can be determined as difference degree data, and the difference degree data can represent the difference between the predicted average value of the time difference population and the preset technical index.
Specifically, if the difference degree data is greater than zero, it may indicate that the t statistic is greater than the check threshold, and at this time, the P (P-value) value corresponding to the zero hypothesis is less than the preset unilateral significance level, so that it may be known that the total predicted average value of the time difference values is greater than the preset technical index, the zero hypothesis is rejected, and the alternative hypothesis may be accepted; if the difference degree data is less than zero, it can be shown that the t statistic is less than the inspection critical value, and at this time, the P value corresponding to the zero hypothesis is greater than the preset unilateral significance level, so that it can be known that the total predicted average value of the time difference is less than the preset technical index, and the zero hypothesis is accepted; if the difference degree data is equal to zero, it may indicate that the t statistic is equal to the inspection critical value, and at this time, the P value corresponding to the zero hypothesis is equal to the preset one-sided significance level, so that the difference between the predicted average value of the time difference population and the preset technical index cannot be known, and it cannot be determined to accept or reject the zero hypothesis.
In the embodiment, the delay amount in the video communication is determined to be approximately in normal distribution based on the early-stage sampling data, the standard deviation of the time difference total is unknown, the time difference sample is counted by adopting t distribution, and the relation between the time difference total and the preset technical index can be accurately estimated so as to ensure the accuracy of the delay test result.
And S233, determining a delay test result according to the difference degree data.
Correspondingly, the difference condition between the prediction average value of the time difference value population and the preset technical index can be determined according to the difference degree data, and whether the video communication delay amount in the delay test meets the requirement of the preset technical index can be determined according to the difference condition, so that the delay test result is determined. Specifically, the delay test result may include a meeting of a preset technical index and a non-meeting of the preset technical index. Optionally, in the case that whether the preset technical index is met cannot be determined according to the difference degree data, the delay test may be performed again after the sample capacity is increased.
In an optional embodiment of the present invention, determining a delay test result according to the difference degree data may include: under the condition that the difference degree data meet a first difference condition, determining that the delay test result meets the preset technical index; under the condition that the difference degree data are determined to meet a second difference condition, determining that the delay test result does not meet the preset technical index; and under the condition that the difference degree data are determined not to meet the first difference condition and the second difference condition, acquiring a second number of target images to re-determine a delay test result according to the second number of target images.
Wherein the second number is greater than the first number. The first difference condition may be a characteristic of the corresponding difference degree data when the predicted average value of the time difference value population is smaller than a preset technical index. The second difference condition may be a characteristic of the corresponding difference degree data when the predicted average value of the time difference population is greater than a preset technical index.
Correspondingly, if the difference degree data meets the first difference condition, the predicted average value of the total time difference value can be determined to be smaller than the preset technical index, which indicates that the video communication delay amount in the delay test is smaller, and the video communication quality required by the preset technical index can be ensured, and the delay test result can be in accordance with the preset technical index; if the difference degree data meets the second difference condition, the predicted average value of the time difference value population can be determined to be larger than the preset technical index, the video communication delay amount in the delay test is larger, and the video communication quality required by the preset technical index cannot be ensured, so that the delay test result can be that the delay test result does not meet the preset technical index; if the difference degree data does not satisfy the first difference condition and does not satisfy the second difference condition, it may be determined that, when the predicted average value of the total time difference value is equal to the preset technical index, it is not possible to determine whether the video communication delay amount in the delay test can ensure the video communication quality required by the preset technical index, and the delay test result may be that whether the video communication delay amount satisfies the preset technical index is not determined.
Furthermore, under the condition that the difference degree data are determined not to meet the first difference condition and not to meet the second difference condition, the second number of target images are obtained again, so that the sample capacity of the time difference value sample can be increased, the error of the difference degree data obtained according to the time difference value sample is smaller, and an accurate delay test result is obtained.
Optionally, for difference degree data obtained by using t distribution, if the first difference condition is that the difference degree data is less than zero, the delay test result is a null hypothesis that the received difference degree data meets the preset technical index; the second difference condition may be that the difference degree data is greater than zero, and the delay test result is a null hypothesis that the preset technical index is rejected.
In the embodiment, the sample capacity is automatically increased to obtain the sample again under the condition that the delay test result cannot be determined temporarily, so that a statistical result with smaller error is obtained according to the sample, and the accuracy and reliability of the delay test are further prompted.
The embodiment of the invention provides a delay test method, which comprises the steps of automatically acquiring coding source time data and decoding source time data corresponding to a target image, establishing a time difference sample with a certain capacity according to the acquired time data, testing the time difference sample according to a preset technical index to obtain a delay test result, automatically identifying the time data by a machine, and automatically calculating to obtain a video delay test result, so that the problems of long test time consumption, small number of test samples, inaccurate test result and the like caused by data reading and calculating only depending on manpower in the prior art are solved, the accuracy and efficiency of video delay test are improved, and resources and test cost are saved; further, sample analysis is carried out on the overall data which is approximately in normal distribution by adopting t distribution, and data which accurately reflects the video delay condition is obtained; meanwhile, the data sample with larger sample capacity can be automatically obtained under the condition that the sample capacity is insufficient, the statistical error is reduced, and the accuracy and the reliability of the delay test result are further improved.
EXAMPLE III
Fig. 6 is a schematic structural diagram of a delay testing apparatus according to a third embodiment of the present invention, and as shown in fig. 6, the apparatus includes: a time data acquisition module 310, a difference sample acquisition module 320, and a test result determination module 330.
The time data obtaining module 310 is configured to obtain encoded source time data and decoded source time data corresponding to a first number of target images.
A difference sample obtaining module 320, configured to obtain a time difference sample according to the encoding source time data and the decoding source time data.
And the test result determining module 330 is configured to determine a delay test result according to the time difference sample and a preset technical index.
In an optional implementation manner of the embodiment of the present invention, the time data obtaining module 310 may be specifically configured to: acquiring coding source images and decoding source images of video data to be coded and decoded at different time points of a first number at the same time, and determining the coding source images and the decoding source images acquired at the same time point as a group of target images to obtain the target images of the first number; and respectively carrying out image recognition processing on the coding source image and the time mark data of the decoding source image in each target image, determining the image recognition result of the time mark data of the coding source image as the coding source time data, and determining the image recognition result of the time mark data of the decoding source image as the decoding source time data.
In an optional implementation manner of the embodiment of the present invention, the difference sample obtaining module 320 may be specifically configured to: respectively acquiring a difference value between the encoded source time data and the decoded source time data corresponding to the same target image to obtain the first amount of time difference value data; and generating the time difference value sample according to the time difference value data.
In an optional implementation manner of the embodiment of the present invention, the test result determining module 330 may include: the target test parameter acquisition submodule is used for acquiring target test parameters of the time difference value sample; the difference degree data acquisition submodule is used for acquiring difference degree data between the predicted average value of the time difference value state and the preset technical index according to the target test parameter and the preset technical index; and the delay test result acquisition submodule is used for determining a delay test result according to the difference degree data.
In an optional implementation manner of the embodiment of the present invention, the difference degree data obtaining sub-module may be specifically configured to: and acquiring difference degree data between the predicted average value of the time difference total and the preset technical index by adopting t distribution according to the target test parameter and the preset technical index.
In an optional implementation manner of the embodiment of the present invention, the target test parameter may include: a sample mean of the time difference samples, a sample variance of the time difference samples, and a sample capacity of the time difference samples; the difference degree data obtaining sub-module may be specifically configured to: determining a null hypothesis and an alternative hypothesis; calculating the t statistic of the time difference sample by adopting the following formula:
wherein t is the t statistic of the time difference sample,
is the sample mean, μ 0 Setting s as the sample variance and n as the sample capacity as the preset technical index; calculating the degree of freedom of the time difference value sample by adopting the following formula:
υ＝n-1
wherein upsilon is the degree of freedom of the time difference value sample; inquiring a detection critical value in a built-in t distribution table according to the degree of freedom and a preset unilateral significance level; and acquiring numerical difference data of the t statistic and the check critical value according to the zero hypothesis and the alternative hypothesis, and determining the numerical difference data as the difference degree data.
In an optional implementation manner of the embodiment of the present invention, the delay test result obtaining sub-module may be specifically configured to: under the condition that the difference degree data are determined to meet a first difference condition, determining that the delay test result meets the preset technical index; under the condition that the difference degree data are determined to meet a second difference condition, determining that the delay test result does not meet the preset technical index; under the condition that the difference degree data are determined not to meet the first difference condition and the second difference condition, obtaining a second number of target images so as to re-determine a delay test result according to the second number of target images; wherein the second number is greater than the first number.
The device can execute the delay test method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects for executing the delay test method.
The embodiment of the invention provides a delay testing device, which can automatically acquire coding source time data and decoding source time data corresponding to a target image, establish a time difference sample with a certain capacity according to the acquired time data, test the time difference sample according to a preset technical index to obtain a delay testing result, realize automatic identification of the time data by a machine, and automatically calculate to obtain a video delay testing result.
Example four
Fig. 7 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention. FIG. 7 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention. The computer device 12 shown in fig. 7 is only an example and should not impose any limitation on the scope of use or functionality of embodiments of the invention.
As shown in FIG. 7, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors 16, a memory 28, and a bus 18 that connects the various system components (including the memory 28 and the processors 16). Accordingly, the computer device 12 may further comprise image acquisition means for acquiring an image of the object.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination of which may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The processor 16 executes various functional applications and data processing by running the program stored in the memory 28, so as to implement the delay test method provided by the embodiment of the present invention: acquiring coding source time data and decoding source time data corresponding to a first number of target images; acquiring a time difference value sample according to the coding source time data and the decoding source time data; and determining a delay test result according to the time difference value sample and a preset technical index.
EXAMPLE five
Fifth, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method for testing a delay provided in the embodiment of the present invention is implemented: acquiring encoded source time data and decoded source time data corresponding to a first number of target images; acquiring a time difference value sample according to the coding source time data and the decoding source time data; and determining a delay test result according to the time difference value sample and a preset technical index.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or computer device. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing description is only exemplary of the invention and that the principles of the technology may be employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (7)
1. A method for delay testing, comprising:
acquiring encoded source time data and decoded source time data corresponding to a first number of target images;
acquiring a time difference value sample according to the coding source time data and the decoding source time data;
determining a delay test result according to the time difference value sample and a preset technical index;
determining a delay test result according to the time difference value sample and a preset technical index, wherein the determining comprises the following steps:
acquiring target test parameters of the time difference value sample;
acquiring difference degree data between a predicted average value of the time difference total and the preset technical index according to the target test parameter and the preset technical index;
determining a delay test result according to the difference degree data;
the acquiring of the difference degree data between the predicted average value of the time difference total and the preset technical index according to the target test parameter and the preset technical index comprises:
acquiring difference degree data between a prediction average value of the time difference total and the preset technical index by adopting t distribution according to the target test parameter and the preset technical index;
the target test parameters include: a sample mean of the time difference samples, a sample variance of the time difference samples, and a sample capacity of the time difference samples;
acquiring difference degree data between the predicted average value of the time difference total and the preset technical index by adopting t distribution according to the target test parameter and the preset technical index, wherein the difference degree data comprises the following steps:
determining a null hypothesis and an alternative hypothesis;
calculating the t statistic of the time difference sample by adopting the following formula:
wherein t is the t statistic of the time difference sample,
is the sample mean, μ 0 Setting s as the sample variance and n as the sample capacity as the preset technical index;
calculating the degree of freedom of the time difference value sample by adopting the following formula:
υ＝n-1
wherein upsilon is the degree of freedom of the time difference value sample;
inquiring a detection critical value in a built-in t distribution table according to the degree of freedom and a preset unilateral significance level;
and acquiring numerical difference data of the t statistic and the check critical value according to the zero hypothesis and the alternative hypothesis, and determining the numerical difference data as the difference degree data.
2. The method of claim 1, wherein obtaining encoded source time data and decoded source time data corresponding to a first number of target images comprises:
acquiring coding source images and decoding source images of video data to be coded and decoded at different time points of a first number at the same time, and determining the coding source images and the decoding source images acquired at the same time point as a group of target images to obtain the target images of the first number;
and respectively carrying out image recognition processing on the coding source image and the time mark data of the decoding source image in each target image, determining the image recognition result of the time mark data of the coding source image as the coding source time data, and determining the image recognition result of the time mark data of the decoding source image as the decoding source time data.
3. The method of claim 1, wherein obtaining time difference samples from the encoded source time data and the decoded source time data comprises:
respectively acquiring a difference value between the encoded source time data and the decoded source time data corresponding to the same target image to obtain the first amount of time difference value data;
and generating the time difference value sample according to the time difference value data.
4. The method of claim 1, wherein determining a delay test result based on the difference level data comprises:
under the condition that the difference degree data are determined to meet a first difference condition, determining that the delay test result meets the preset technical index;
under the condition that the difference degree data meet a second difference condition, determining that the delay test result does not meet the preset technical index;
under the condition that the difference degree data are determined not to meet the first difference condition and the second difference condition, obtaining a second number of target images so as to re-determine a delay test result according to the second number of target images; wherein the second number is greater than the first number.
5. A delay test apparatus, comprising:
the time data acquisition module is used for acquiring coding source time data and decoding source time data corresponding to a first number of target images;
a difference sample obtaining module, configured to obtain a time difference sample according to the encoding source time data and the decoding source time data;
the test result determining module is used for determining a delay test result according to the time difference value sample and a preset technical index;
wherein, the test result determining module comprises:
a target test parameter obtaining submodule for obtaining a target test parameter of the time difference value sample; the difference degree data acquisition submodule is used for acquiring difference degree data between the predicted average value of the time difference value state and the preset technical index according to the target test parameter and the preset technical index; the delay test result acquisition submodule is used for determining a delay test result according to the difference degree data;
the difference degree data acquisition submodule is specifically configured to: acquiring difference degree data between a predicted average value of the time difference total and the preset technical index by adopting t distribution according to the target test parameter and the preset technical index;
the target test parameters include: a sample average of the time difference samples, a sample variance of the time difference samples, and a sample capacity of the time difference samples; the difference degree data acquisition submodule is specifically configured to: determining a null hypothesis and an alternative hypothesis; calculating the t statistic of the time difference sample by adopting the following formula:
wherein t is t statistic of the time difference samples,
is the sample mean, μ 0 Setting s as the sample variance and n as the sample capacity as the preset technical index; calculating the degree of freedom of the time difference value sample by adopting the following formula:
υ＝n-1
wherein upsilon is the degree of freedom of the time difference value sample; inquiring a detection critical value in a built-in t distribution table according to the degree of freedom and a preset unilateral significance level; and acquiring numerical difference data of the t statistic and the check critical value according to the zero hypothesis and the alternative hypothesis, and determining the numerical difference data as the difference degree data.
6. A computer device, characterized in that the computer device comprises:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the latency testing method of any one of claims 1-4;
and the image acquisition device is used for acquiring the target image.
7. A computer storage medium on which a computer program is stored, which program, when being executed by a processor, carries out the latency testing method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110349388.6A CN113068021B (en) | 2021-03-31 | 2021-03-31 | Delay testing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110349388.6A CN113068021B (en) | 2021-03-31 | 2021-03-31 | Delay testing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113068021A CN113068021A (en) | 2021-07-02 |
| CN113068021B true CN113068021B (en) | 2023-03-07 |
Family
ID=76564889
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110349388.6A Active CN113068021B (en) | 2021-03-31 | 2021-03-31 | Delay testing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113068021B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115426534A (en) * | 2022-08-25 | 2022-12-02 | 上海久尺网络科技有限公司 | Video stream quality detection method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005184749A (en) * | 2003-12-24 | 2005-07-07 | Nippon Telegr & Teleph Corp <Ntt> | Video delay time measuring method, system and apparatus therefor |
| CN103813161A (en) * | 2012-11-12 | 2014-05-21 | 腾讯科技（深圳）有限公司 | Delayed testing method and device |
| CN107454387A (en) * | 2017-08-28 | 2017-12-08 | 西安万像电子科技有限公司 | Mass parameter acquisition methods and device for image coding and decoding Transmission system |
| CN109309831A (en) * | 2018-12-13 | 2019-02-05 | 苏州科达科技股份有限公司 | The test method and device of video delay in video conference |
| CN110765414A (en) * | 2019-09-11 | 2020-02-07 | 深信服科技股份有限公司 | Performance index data evaluation method, device, equipment and storage medium |
| CN111787312A (en) * | 2020-07-29 | 2020-10-16 | 杭州叙简科技股份有限公司 | Video delay test method, system, electronic equipment and storage medium |
-
2021
- 2021-03-31 CN CN202110349388.6A patent/CN113068021B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005184749A (en) * | 2003-12-24 | 2005-07-07 | Nippon Telegr & Teleph Corp <Ntt> | Video delay time measuring method, system and apparatus therefor |
| CN103813161A (en) * | 2012-11-12 | 2014-05-21 | 腾讯科技（深圳）有限公司 | Delayed testing method and device |
| CN107454387A (en) * | 2017-08-28 | 2017-12-08 | 西安万像电子科技有限公司 | Mass parameter acquisition methods and device for image coding and decoding Transmission system |
| CN109309831A (en) * | 2018-12-13 | 2019-02-05 | 苏州科达科技股份有限公司 | The test method and device of video delay in video conference |
| CN110765414A (en) * | 2019-09-11 | 2020-02-07 | 深信服科技股份有限公司 | Performance index data evaluation method, device, equipment and storage medium |
| CN111787312A (en) * | 2020-07-29 | 2020-10-16 | 杭州叙简科技股份有限公司 | Video delay test method, system, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113068021A (en) | 2021-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110267083B (en) | Audio and video synchronization detection method, device, equipment and storage medium | |
| CN110705651A (en) | Method, device, equipment and medium for testing video identification accuracy | |
| CN113891070B (en) | Method and device for measuring delay time of network camera | |
| CN110826646A (en) | Robot vision testing method and device, storage medium and terminal equipment | |
| CN113068021B (en) | Delay testing method, device, equipment and storage medium | |
| CN111191666A (en) | Method and device for testing image target detection algorithm | |
| CN115757150A (en) | Production environment testing method, device, equipment and storage medium | |
| CN110781063B (en) | Method, device, equipment and storage medium for measuring first screen time of web page | |
| CN114494863A (en) | Animal cub counting method and device based on Blend Mask algorithm | |
| CN113138916B (en) | Automatic testing method and system for picture structuring algorithm based on labeling sample | |
| CN114742992A (en) | Video abnormity detection method and device and electronic equipment | |
| CN111669479A (en) | Method and system for verifying synchronous exposure of camera and electronic equipment | |
| CN113780163A (en) | Page loading time detection method and device, electronic equipment and medium | |
| CN112837640A (en) | Screen dynamic picture testing method, system, electronic equipment and storage medium | |
| CN112153320A (en) | Method and device for measuring size of article, electronic equipment and storage medium | |
| CN116450881A (en) | Method and device for recommending interest segment labels based on user preference and electronic equipment | |
| CN116437068A (en) | Lip synchronization test method and device, electronic equipment and storage medium | |
| CN113055667B (en) | Video quality detection method and device, electronic equipment and storage medium | |
| CN112434717A (en) | Model training method and device | |
| CN113923443A (en) | Network video recorder testing method and device and computer readable storage medium | |
| CN113011742A (en) | Clustering effect evaluation method, system, medium and device | |
| CN111047433A (en) | Method and device for analyzing reasons of user number abnormality, server and storage medium | |
| CN114640608B (en) | Test method and device, electronic equipment and computer readable storage medium | |
| CN113905272B (en) | Control method of set top box, electronic equipment and storage medium | |
| CN117808848B (en) | Identification tracking method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |