CN108924665A - Reduce method, apparatus, computer equipment and the storage medium of video playing delay - Google Patents
Reduce method, apparatus, computer equipment and the storage medium of video playing delay Download PDFInfo
- Publication number
- CN108924665A CN108924665A CN201810539472.2A CN201810539472A CN108924665A CN 108924665 A CN108924665 A CN 108924665A CN 201810539472 A CN201810539472 A CN 201810539472A CN 108924665 A CN108924665 A CN 108924665A
- Authority
- CN
- China
- Prior art keywords
- adjustment
- consumption
- data
- period
- data amount
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000009467 reduction Effects 0.000 claims abstract description 24
- 238000012952 Resampling Methods 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000005070 sampling Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 13
- 238000005259 measurement Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 3
- 230000001965 increasing effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- KCXVZYZYPLLWCC-UHFFFAOYSA-N EDTA Chemical compound OC(=O)CN(CC(O)=O)CCN(CC(O)=O)CC(O)=O KCXVZYZYPLLWCC-UHFFFAOYSA-N 0.000 description 1
- 206010044565 Tremor Diseases 0.000 description 1
- -1 can be set Second Chemical compound 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 229960001484 edetic acid Drugs 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- VIKNJXKGJWUCNN-XGXHKTLJSA-N norethisterone Chemical compound O=C1CC[C@@H]2[C@H]3CC[C@](C)([C@](CC4)(O)C#C)[C@@H]4[C@@H]3CCC2=C1 VIKNJXKGJWUCNN-XGXHKTLJSA-N 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000001568 sexual effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
- H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0823—Errors, e.g. transmission errors
- H04L43/0829—Packet loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/633—Control signals issued by server directed to the network components or client
- H04N21/6332—Control signals issued by server directed to the network components or client directed to client
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
- H04N21/64769—Control signals issued by the network directed to the server or the client directed to the server for rate control
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Environmental & Geological Engineering (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
This application involves method, apparatus, computer equipment and the storage mediums of a kind of reduction video playing delay.The method includes：Obtain in jitter cache queue the corresponding consumption data amount of each period in the current statistic period, target consumer data volume is chosen from corresponding consumption data amount of each period according to preset rules, obtain standard consumer data volume, according to target consumer data volume and standard consumer data volume, determine dynamic consumption data amount, obtain corresponding standard consumption data amount of current adjustment period, it is carried out that corresponding adjustment consumption data amount of current adjustment period is calculated according to corresponding standard consumption data amount of current adjustment period and dynamic consumption data amount, data consumption is carried out in the currently adjustment period according to adjustment consumption data amount, to reduce video playing delay.
Description
Technical field
This application involves field of computer technology, method, apparatus, meter more particularly to a kind of reduction video playing delay
Calculate machine equipment and storage medium.
Background technique
With the development of the technologies such as communication, network and universal, the multi-medium datas such as audio, video have been increasingly becoming at information
Main medium form in reason field, the multimedia communication technology of IP based network have a wide range of applications.In a network, each
Time delay of the data packet from transmitting terminal to receiving end is different, and network jitter is the parameter for measuring time delay.In order to solve
Network jitter increases anti-jitter mechanism, i.e. jitter cache (JitterBuffer) in data receiver, and increasing jitter cache can lead
Cause bigger delay.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of each according to measurement period in jitter cache queue
The consumption data amount of period, determines target consumer data volume, is carried out according to standard consumer data volume and target consumer data volume
Dynamic consumption data amount is calculated, calculate according to the standard consumption data amount in adjustment period and dynamic consumption data amount
To adjustment consumption data amount, data consumption is carried out to adjustment consumption data amount in the adjustment period, to reduce video playing delay
Reduction video playing delay method, apparatus, computer equipment and storage medium.
A method of video playing delay being reduced, method includes：
The corresponding consumption data amount of each period in the current statistic period is obtained in jitter cache queue, according to default rule
Target consumer data volume is then chosen from corresponding consumption data amount of each period；
Standard consumer data volume is obtained, according to target consumer data volume and standard consumer data volume, determines dynamic consumption number
According to amount；
Corresponding standard consumption data amount of current adjustment period is obtained, number is consumed according to corresponding standard of current adjustment period
Be calculated according to amount and dynamic consumption data amount and currently adjusts period corresponding adjustment consumption data amount；
Data consumption is carried out in the currently adjustment period according to adjustment consumption data amount.
Obtaining in jitter cache queue each period in the current statistic period in one of the embodiments, corresponding disappears
Before taking data volume, further include：The delay threshold and packet loss for obtaining the current statistic period, when packet loss is less than or equal to first
When default packet loss threshold value, delay threshold is reduced, default is lost when packet loss is greater than the first default packet loss threshold value, and less than second
When packet rate threshold value, delay threshold is remained unchanged, and the first default packet loss threshold value works as packet loss less than the second default packet loss threshold value
When greater than the second default packet loss threshold value, increase delay threshold.
In one of the embodiments, when the corresponding delay threshold of two continuous cycles meets the second default delay threshold
When, code stream adjustment instruction, which is sent, to terminal, code stream adjustment instruction is sent is used to indicate the transmission code for sending terminal reduction data packet
Rate.
In one of the embodiments, when adjusting the corresponding data of consumption data amount is video data, current adjust is obtained
Complete cycle, corresponding standard consumption data amount, adjusted period corresponding standard consumption data amount and dynamic consumption data according to current
Amount carries out that corresponding adjustment consumption data amount of current adjustment period is calculated, including：When obtaining the adjustment in current adjustment period
Between and corresponding frame per second, the corresponding standard consumption data amount of current period is calculated according to adjustment time and corresponding frame per second,
It is summed according to corresponding standard consumption data amount of current adjustment period and dynamic consumption data amount and is currently adjusted the period
Corresponding adjustment consumption data amount carries out data consumption in the currently adjustment period according to adjustment consumption data amount, including：According to tune
Whole consumption data amount and adjustment time determine the adjustment frame per second of video data, using adjustment frame per second playing video data.
In one of the embodiments, when adjusting the corresponding data of consumption data amount is audio data, method further includes：
The application scenarios for obtaining audio data determine that consumption strategy, consumption strategy include that weight is carried out to audio data according to application scenarios
Sampling abandons quiet data, carries out data consumption in the currently adjustment period according to adjustment consumption data amount, including：When consumption plan
When slightly carrying out resampling to audio data, resampling is carried out to audio data, the sampled audio data after being sampled is being worked as
The preceding adjustment period plays sampled audio data；When consumption policy is to abandon quiet data, the mute number in audio data is obtained
According to the data volume summation of quiet data is identical as consumption data amount.
A kind of device reducing video playing delay, device include：
Target consumer data volume obtains module, for obtaining in jitter cache queue each period in the current statistic period
Corresponding consumption data amount chooses target consumer data according to preset rules from corresponding consumption data amount of each period
Amount；
Dynamic consumption data determining module, for obtaining standard consumer data volume, according to target consumer data volume and standard
Consumption data amount determines dynamic consumption data amount；
Consumption data determining module is adjusted, for obtaining corresponding standard consumption data amount of current adjustment period, according to working as
Preceding adjustment period corresponding standard consumption data amount and dynamic consumption data amount carry out the current adjustment period is calculated corresponding
Adjust consumption data amount；
Data consumable module, for carrying out data consumption in the currently adjustment period according to adjustment consumption data amount.
A kind of computer equipment can be run on a memory and on a processor including memory, processor and storage
Computer program, processor realize following steps when executing computer program：
The corresponding consumption data amount of each period in the current statistic period is obtained in jitter cache queue, according to default rule
Target consumer data volume is then chosen from corresponding consumption data amount of each period；
Standard consumer data volume is obtained, according to target consumer data volume and standard consumer data volume, determines dynamic consumption number
According to amount；
Corresponding standard consumption data amount of current adjustment period is obtained, number is consumed according to corresponding standard of current adjustment period
Be calculated according to amount and dynamic consumption data amount and currently adjusts period corresponding adjustment consumption data amount；
Data consumption is carried out in the currently adjustment period according to adjustment consumption data amount.
A kind of computer readable storage medium is stored thereon with computer program, when computer program is executed by processor
Realize following steps：
The corresponding consumption data amount of each period in the current statistic period is obtained in jitter cache queue, according to default rule
Target consumer data volume is then chosen from corresponding consumption data amount of each period；
Standard consumer data volume is obtained, according to target consumer data volume and standard consumer data volume, determines dynamic consumption number
According to amount；
Corresponding standard consumption data amount of current adjustment period is obtained, number is consumed according to corresponding standard of current adjustment period
Be calculated according to amount and dynamic consumption data amount and currently adjusts period corresponding adjustment consumption data amount；
Data consumption is carried out in the currently adjustment period according to adjustment consumption data amount.
Method, apparatus, computer equipment and the storage medium of above-mentioned reduction video playing delay, obtain jitter cache queue
Each period corresponding consumption data amount in the middle current statistic period, according to preset rules from the corresponding consumption of each period
Target consumer data volume is chosen in data volume, standard consumer data volume is obtained, according to target consumer data volume and standard consumer number
According to amount, dynamic consumption data amount is determined, corresponding standard consumption data amount of current adjustment period is obtained, according to the current adjustment period
Corresponding standard consumption data amount and dynamic consumption data amount carry out that corresponding adjustment consumption number of current adjustment period is calculated
According to amount, data consumption is carried out in the currently adjustment period according to adjustment consumption data amount.By being counted in statistics jitter cache queue
The data volume exported in the jitter cache queue of each period in period, selects one of them from the data volume of each period
Or multiple data bulks are as target consumer data volume, by carrying out real-time statistics to measurement period data, according to real-time statistics
As a result it carries out that dynamic consumption data amount is calculated with standard consumer data volume, according to adjustment cycle criterion consumption data amount and moves
State consumption data amount be calculated dynamic adjustment consumption data amount, the currently adjustment period to adjustment consumption data amount into
Row consumption can effectively reduce video playing delay.
Detailed description of the invention
Fig. 1 is the applied environment figure that the method for video playing delay is reduced in one embodiment；
Fig. 2 is the flow diagram that the method for video playing delay is reduced in one embodiment；
Fig. 3 is the schematic diagram that video playing delay is reduced in one embodiment；
Fig. 4 is the schematic diagram that video playing delay is reduced in another embodiment；
Fig. 5 is the flow diagram that the method for video playing delay is reduced in another embodiment；
Fig. 6 is flow diagram the step of consuming video data in one embodiment；
Fig. 7 is flow diagram the step of consuming audio data in one embodiment；
Fig. 8 A is the schematic diagram that one embodiment sound intermediate frequency data remove quiet data；
Fig. 8 B is the step schematic diagram of one embodiment sound intermediate frequency data resampling；
Fig. 9 is the structural block diagram that the device of video playing delay is reduced in one embodiment；
Figure 10 is the structural block diagram that the device of video playing delay is reduced in another embodiment；
Figure 11 is the structural block diagram that the device of video playing delay is reduced in another embodiment；
Figure 12 is the structural block diagram that the device of video playing delay is reduced in further embodiment；
Figure 13 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
The method provided by the present application for reducing video playing delay, can be applied in application environment as shown in Figure 1.Its
In, terminal 102 is communicated with server 104 by network by network.Terminal 102 obtains currently unites in jitter cache queue
Each period corresponding consumption data amount in the period is counted, according to preset rules from corresponding consumption data amount of each period
Target consumer data volume is chosen, standard consumer data volume is obtained, according to target consumer data volume and standard consumer data volume, is determined
Dynamic consumption data amount obtains corresponding standard consumption data amount of current adjustment period, according to corresponding mark of current adjustment period
Quasi- consumption data amount and dynamic consumption data amount carry out that corresponding adjustment consumption data amount of current adjustment period is calculated, according to
It adjusts consumption data amount and carries out data consumption in the currently adjustment period.
Above-mentioned consumption data amount acquisition, target consumer data decimation, standard consumer data acquisition, dynamic consumption data determine
With adjustment consumption data determine and etc. can be carried out in server 104, determining adjustment data volume is sent to terminal
102。
Wherein, terminal 102 can be, but not limited to be various personal computers, laptop, smart phone, tablet computer
With portable wearable device, server 104 can use the server set of the either multiple server compositions of independent server
Group realizes.
In one embodiment, it as shown in Fig. 2, providing a kind of method of reduction video playing delay, answers in this way
For being illustrated for the terminal in Fig. 1, include the following steps：
Step S202 obtains in jitter cache queue the corresponding consumption data amount of each period in the current statistic period,
Target consumer data volume is chosen from corresponding consumption data amount of each period according to preset rules.
Wherein, during network data transmission, time delay of each data packet from transmitting terminal to receiving end is different, net
Network shake is the parameter for measuring time delay of the data packet from transmitting terminal to receiving end.Data packet generates network after IP network and trembles
It is dynamic, when reaching receiving end, compared with same intervals of the time interval of adjacent tone video data packet when transmission, changed.
If the data packet received is directly decoded and is played by receiving end, it is understood that there may be it is existing that video cardton and labial are asynchronous etc.
As.In order to keep the time interval of adjacent tone video data packet, jitter cache queue is set in data packet receiving end, passes through shake
The data cached packet of buffer queue plays out adjacent data packet with the time interval of transmitting terminal when playing.
The processing of jitter cache queuing data can be divided into multiple data processing cycles, and each data processing cycle includes statistics
Period and adjustment period, the data of jitter cache queue can be counted in measurement period, it is slow in the adjustable shake of adjustment period
Deposit the parameter of queue.Consumption data amount refers to measurement period each period corresponding sound view sent out from jitter cache queue
Frequency data packet can indicate data volume with data duration when data are audio data, can when data are video data
To indicate data volume with duration or video frame.Preset rules refer to pre-set for the corresponding consumption of each period
The data screening rule that data volume is screened.Preset rules can be customized according to demand, can such as choose each period
Minimum value, median or maximum value etc. in corresponding consumption data amount regard minimum value, median, maximum value etc. as target
Consumption data amount
In one embodiment, summation can be weighted to corresponding consumption data amount of each period, weighting is asked
With obtained data volume as target consumer data volume.
Specifically, terminal or server obtain the corresponding sound view of each period in current statistic period in jitter cache queue
The consumption data amount of frequency evidence chooses the consumption number for meeting pre-set rule from corresponding consumption data amount of each period
Target consumer data volume is used as according to amount.Wherein the duration of each period can be customized according to demand, and every 1 milli such as can be set
Second, 5 milliseconds or 10 milliseconds are as period corresponding duration.
Step S204 obtains standard consumer data volume, according to target consumer data volume and standard consumer data volume, determines dynamic
State consumption data amount.
Specifically, standard consumer data volume refers to the pre-set data volume that must be consumed, according to standard consumer data
Dynamic consumption data amount is calculated in amount and above-mentioned target consumer data volume, and target consumer data volume is according to the current statistic period
Determining, it is a dynamic value, dynamic consumption data amount is determined according to target consumer data volume and standard consumer data volume.
In a specific embodiment, as shown in figure 3, periodically accessing Jitter Buffer in the current statistic period
Queue, access time interval are fixed, and every time when access, record corresponding consumption data amount M, if access times are n, are then obtained each
A period corresponding consumption data amount is { M0、M1、M2......Mn-1, choose the smallest value M of data volumeminFor target consumer
Data volume is marked with quasi- consumption data amount T-Low, then has MminSubtracting normal data amount is that T-Low obtains dynamic consumption data amount.
Step S206 obtains corresponding standard consumption data amount of current adjustment period, corresponding according to the current adjustment period
Standard consumption data amount and dynamic consumption data amount carry out that corresponding adjustment consumption data amount of current adjustment period is calculated.
Specifically, standard consumption data amount refers to the data volume that currently the adjustment period should consume, by consuming to standard
Data volume and dynamic consumption data amount carry out that corresponding adjustment consumption data amount of current adjustment period is calculated, and current adjustment disappears
Consumption data volume refers to the data volume that should be consumed obtained after the currently adjustment period is adjusted data.Number is consumed to standard
Calculation is carried out according to the corresponding data type determination of consumption data amount, different data class according to amount and dynamic consumption data amount
Type uses different calculations.
Step S208 carries out data consumption in the currently adjustment period according to adjustment consumption data amount.
Specifically, data consumption strategy is determined according to the corresponding data type of adjustment consumption data amount, in current adjustment week
Phase consumes the corresponding data of strategy consumption adjustment consumption data amount according to data.As shown in figure 4, the data played in the adjustment period
It is more to measure the data volume played relative to measurement period.
In one embodiment, the corresponding data type of adjustment consumption data is audio data, and it is corresponding to obtain audio data
Data consume strategy, according to the data consumption strategy currently adjustment the period to audio data carry out data consumption.
In another embodiment, the corresponding data type of adjustment consumption data is video data, obtains video data pair
The data consumption strategy answered carries out data consumption to video data in the currently adjustment period according to data consumption strategy.
In the method for above-mentioned reduction video playing delay, each time in the current statistic period in acquisition jitter cache queue
The corresponding consumption data amount of section, chooses target consumer data according to preset rules from corresponding consumption data amount of each period
Amount obtains standard consumer data volume according to target consumer data volume and standard consumer data volume and determines dynamic consumption data amount,
Currently adjustment period corresponding standard consumption data amount is obtained, according to corresponding standard consumption data amount of current adjustment period and is moved
State consumption data amount carries out that corresponding adjustment consumption data amount of current adjustment period is calculated, and is existed according to adjustment consumption data amount
The current adjustment period carries out data consumption.Pass through the jitter cache team of measurement period each period in statistics jitter cache queue
The data volume exported in column selects wherein one or more data bulks as target consumer from the data volume of each period
Data volume is counted by carrying out real-time statistics to measurement period data according to real-time statistics result and standard consumer data volume
Calculation obtains dynamic consumption data amount, be calculated according to adjustment cycle criterion consumption data amount and dynamic consumption data amount dynamic
The adjustment consumption data amount of state, the adjustment consumption data amount are able to reflect the real time status of network, exchange in the currently adjustment period
Whole consumption data amount is consumed, and video playing delay can be effectively reduced, so that video playing is more smooth.
In one embodiment, as shown in figure 5, further including before step S202：
Step S302 obtains the delay threshold and packet loss in current statistic period.
Step S304 reduces delay threshold when packet loss is less than or equal to the first default packet loss threshold value.
Step S306 when packet loss is greater than the first default packet loss threshold value, and when less than the second default packet loss threshold value, prolongs
When threshold value remain unchanged, the first default packet loss threshold value is less than the second default packet loss threshold value.
Step S308 increases delay threshold when packet loss is greater than the second default packet loss threshold value.
Specifically, delay threshold refers to that a pre-set critical numerical value, packet loss are that measurement period data are transmitted across
The ratio of the data packet and total transmission data packet lost in journey.According to the packet loss in current statistic period in adjustment period modulation
Delay threshold.First default packet loss threshold value and the second default packet loss threshold value can be customized according to demand, wherein second is pre-
If packet loss threshold value is greater than the first default packet loss threshold value.It is 0 that the first default packet loss threshold value, which is such as arranged, the second default packet loss
Threshold value is 0.3.When packet loss be less than or equal to the first default packet loss threshold value when, indicate transmission process in packet loss a possibility that compared with
It is small, can reduction delay threshold appropriate, such as by delay threshold reduce 10 milliseconds, when packet loss be greater than the first default packet loss threshold
Value, and when less than the second default packet loss threshold value, indicate that the probability of packet loss in data transmission procedure, can in the range of can receive
To continue using the delay threshold, when packet loss is greater than the second default packet loss threshold value, indicate that packet loss has exceeded and can connect
The range of receipts, it should which suitably increase delay threshold, how much delay threshold can be customized according to demand if specifically increasing, such as increases by 50
Millisecond.
In a specific embodiment, for video data, if Dcur is current time delay tolerance value, i.e. delay threshold.
Dcur be for describing after receiving packet from IP network, to be sent to before next link (unpack, assemble video frame etc.) slow
Maximum latency in queue is deposited, i.e., from network reception buffer queue is entered to the longest interval of team out.Maximum delay is received to hold
Bear for Dmax, receiving minimum-time lag tolerance is Dmin, if Dcur is too small to be easy to cause packet loss.According to present packet loss LRcur tune
Whole Dcur, wherein Dcur belongs to Dmin between Dmax, and specific adjustment is as shown in formula (1)：
Dcur=Dcur-a, when 0<=LRcur<=LRmin
Dcur=Dcur works as LRmin<LRcur<LRmax(1)
Dcur=Dcur+b works as LRcur>=LRmax
Wherein LRmin is the first default packet loss threshold value, and LRmax is second threshold packet loss threshold value, and a is that delay waits drop
Low amplitude, b are that delay waits the amplitude increased, it is however generally that, the value of a should be less than the value of b, for example, b is 50ms, a is
10ms.The general value of LRmin is 0.
In one embodiment, the method for above-mentioned reduction video playing delay further includes：
Step S210 sends code stream when the corresponding delay threshold of two continuous cycles meets the second default delay threshold
Adjustment instruction is used to indicate the transmission code rate for sending terminal reduction data packet to terminal, code stream adjustment instruction is sent.
Specifically, when the adjacent corresponding delay threshold of two measurement periods is equal with the second default delay threshold, table
Show that current network is unstable, poor reliability, jitter amplitude is larger, sends terminal to data packet and sends code stream adjustment instruction, the code
Stream adjustment instruction is used to indicate the transmission code rate that data packet sends terminal reduction data packet, and the transmission code rate of data packet refers to data
The data bits that the unit time transmits when transmission, unit kbps, i.e. kilobit are per second.
In a specific embodiment, in two continuous measurement periods, when Dcur reaches Dmax, pass through RTCP
Packet feedback packet loss, notification data packet transmitting terminal carry out flow control, reduce the transmission code rate of data packet.Actual data transfer process
In, there is a situation where that network is poor, but Dcur can not increase always, the increase of Dcur causes delay also to increase, therefore passes through
It informs that data packet transmitting terminal reduces and sends code rate, the reception situation of receiving end can be improved, to reduce the packet loss of receiving end
Rate.
For audio data, receiving end received data packet simultaneously sorts and is inserted into buffer queue, the entrained load of each RTP packet
The play time of content after the decoding is consistent, and packing manner is that each packet has M label.The TU that current video is recorded, is changed
It is counted as the corresponding audio RTP packet timestamp of audio, when scanning audio receiving queue, the submitting less than RTP packet timestamp is trembled
Dynamic buffer queue detects whether the time that RTP packet stores in jitter cache queue surpasses greater than the data packet of RTP packet timestamp
Dcur is crossed, if being more than, RTP packet is sent out into jitter cache queue.
In one embodiment, as shown in fig. 6, when the corresponding data type of adjustment consumption data amount is video data, step
Rapid S206, including：
Step S2062 obtains the adjustment time and corresponding frame per second in current adjustment period, according to adjustment time and corresponding
The corresponding standard consumption data amount of current period is calculated in frame per second.
Step S2064 is asked according to corresponding standard consumption data amount of current adjustment period and dynamic consumption data amount
Adjustment consumption data amount corresponding with the period is currently adjusted.
Specifically, currently the adjustment time in adjustment period refers to that the time span for adjusting the period, adjustment time can be made by oneself
Justice, such as defining adjustment time is 2 seconds, 4 seconds, 5 seconds.Frame per second refers to video playing quantity, if frame per second is that 20 frames are per second, 30 frames are every
Second etc..The corresponding standard consumption data amount of current period is calculated according to frame per second and adjustment time, to standard consumption data amount
Summation, which is carried out, with dynamic consumption data amount is adjusted consumption data amount.
In one embodiment, it is N-consume in the dynamic consumption data amount that measurement period is calculated, adjusts the period
Adjustment time be T-adjust, then T-adjust time internal standard consumption data amount is consumed within the time of T-adjust
With dynamic consumption data amount N-consume.For video data, frame per second fps, then having standard consumption data amount is T-
Adjust*fps, then adjusting consumption data amount is T-adjust*fps+N-consume.
Step S208 includes：
Step S2082 determines the adjustment frame per second of video data according to adjustment consumption data amount and adjustment time, using adjustment
Frame per second playing video data.
Specifically, adjustment frame per second is to adjust the play frame rate in period, is determined according to adjustment consumption data amount and adjustment time
The play frame rate for adjusting the period, using adjustment frame per second playing video data.By taking video data as an example, adjustment frame per second is (T-
Adjust*fps+N-consume)/T-adjust, time the t=1/ ((T-adjust*fps+N- of each frame consumption
consume)/T-adjust).Assuming that the N-consume that measurement period obtains is 10 frames, T-adjust is set as 2s, the frame of video
Rate is that 20 frames are per second.In the case where no dynamic, which adjusts, reduces time delay, when consuming link to each video frame normal consumption
Between be that every 50ms consumes a video frame.Dynamic adjustment is added and is delayed when reducing, 1/ ((2*20+10)/2)=0.04s=40ms.
In one embodiment, as shown in figure 5, when adjusting the corresponding data type of consumption data amount is audio data,
The method of above-mentioned reduction video playing delay further includes：
Step S402 obtains the application scenarios of audio data, determines that consumption strategy, consumption strategy include according to application scenarios
Resampling is carried out to audio data or abandons quiet data.
Step S208, including：
Step S2084 carries out resampling to audio data, obtains when consumption policy is to carry out resampling to audio data
Sampled audio data after to sampling plays sampled audio data in the currently adjustment period.
Step S2086 obtains the quiet data in audio data, mute number when consumption policy is to abandon quiet data
According to data volume summation it is identical as consumption data amount.
Specifically, the application scenarios of audio data include sound be discrete type and sound be continuous type should scene, sound
Sound is that the application scenarios of discrete type include speech, dialogue etc., and sound is that the application scenarios of continuous type include playing an instrument, singing
Deng.It is different should the corresponding consumption policy of scene it is inconsistent, consumption policy refers to the mode of consumption data, including to audio number
According to the quiet data carried out in resampling or discarding audio data.As shown in Figure 8 A, for sound be discrete type should scene
It can be the audio data of continuous type for sound in the quiet data in adjustment period removal audio data, as shown in Figure 8 B
Resampling can be carried out to audio data.
In a specific embodiment, as shown in figure 9, the method for above-mentioned reduction video playing delay includes：
Step S502 obtains the delay threshold and packet loss in current statistic period.
Step S504, judges packet loss, when packet loss is less than or equal to the first default packet loss threshold value, reduces
Delay threshold, when packet loss is greater than the first default packet loss threshold value, and when less than the second default packet loss threshold value, delay threshold is protected
Hold constant, the first default packet loss threshold value is less than the second default packet loss threshold value, when packet loss is greater than the second default packet loss threshold
When value, increase delay threshold.
Step S506 obtains in jitter cache queue the corresponding consumption data amount of each period in the current statistic period,
Target consumer data volume is chosen from corresponding consumption data amount of each period according to preset rules.
Step S508 obtains in jitter cache queue the corresponding consumption data amount of each period in the current statistic period,
Target consumer data volume is chosen from corresponding consumption data amount of each period according to preset rules.
Step S510 obtains standard consumer data volume, according to target consumer data volume and standard consumer data volume, determines dynamic
State consumption data amount.
Step S512a obtains the adjustment time and corresponding frame per second in current adjustment period, according to adjustment time and corresponding
The corresponding standard consumption data amount of current period is calculated in frame per second, according to corresponding standard consumption data amount of current adjustment period
It is summed with dynamic consumption data amount and is currently adjusted period corresponding adjustment consumption data amount.
Step S512b determines the adjustment frame per second of video data according to adjustment consumption data amount and adjustment time, using adjustment
Frame per second playing video data.
Step S514 obtains the application scenarios of audio data, determines the consumption strategy, consumption strategy according to application scenarios
Including carrying out resampling to audio data or abandoning quiet data.
Step S516 carries out resampling to audio data, obtains when consumption policy is to carry out resampling to audio data
Sampled audio data after sampling plays sampled audio data in the currently adjustment period, when consumption policy is to abandon quiet data
When, the quiet data in audio data is obtained, the data volume summation of quiet data is identical as consumption data amount.
This method of above-mentioned reduction video playing delay, by the audio, video data packet received from network and is cached to reception
Queue, timing count the real time data amount of queue, and the speed of consumption data is adjusted according to continually changing buffer data size situation
Rate, so that the delay that network anti-jitter generates can be certain in the case where keeping certain network anti-jitter ability
Time in lower, to improve the real-time sexual experience of audio and video playing.
Although it should be understood that Fig. 2,5-7,9 flow chart in each step successively shown according to the instruction of arrow,
But these steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly state otherwise herein, these
There is no stringent sequences to limit for the execution of step, these steps can execute in other order.Moreover, Fig. 2,5-7, in 9
At least part step may include multiple sub-steps perhaps these sub-steps of multiple stages or stage be not necessarily
Synchronization executes completion, but can execute at different times, and the execution sequence in these sub-steps or stage also need not
Be so successively carry out, but can at least part of the sub-step or stage of other steps or other steps in turn or
Person alternately executes.
In one embodiment, as shown in Figure 10, a kind of device 200 of reduction video playing delay is provided, including：Mesh
It marks consumption data amount and obtains module 202, dynamic consumption data determining module 204, adjustment consumption data determining module 206 and data
Consumable module 208, wherein：
Target consumer data volume obtains module 202, when for obtaining each in the current statistic period in jitter cache queue
Between the corresponding consumption data amount of section, target consumer number is chosen from corresponding consumption data amount of each period according to preset rules
According to amount.
Dynamic consumption data determining module 204, for obtaining standard consumer data volume, according to target consumer data volume and mark
Quasi- consumption data amount determines dynamic consumption data amount.
Consumption data determining module 206 is adjusted, for obtaining corresponding standard consumption data amount of current adjustment period, according to
Currently it is corresponding be calculated the currently adjustment period for adjustment period corresponding standard consumption data amount and dynamic consumption data amount
Adjustment consumption data amount.
Data consumable module 208, for carrying out data consumption in the currently adjustment period according to adjustment consumption data amount.
In one embodiment, as shown in figure 11, the device of above-mentioned reduction video playing delay further includes
Data acquisition module 302, for obtaining the delay threshold and packet loss in current statistic period；
Delay threshold adjusts module 304, for when packet loss is less than or equal to the first default packet loss threshold value, reduction to be prolonged
When threshold value, when packet loss is greater than the first default packet loss threshold value, and when less than the second default packet loss threshold value, delay threshold is kept
Constant, the first default packet loss threshold value is less than the second default packet loss threshold value, when packet loss is greater than the second default packet loss threshold value
When, increase delay threshold.
In one embodiment, when adjustment consumption data determining module 206 is also used to obtain the adjustment in current adjustment period
Between and corresponding frame per second, the corresponding standard consumption data amount of current period is calculated according to adjustment time and corresponding frame per second,
It is summed according to corresponding standard consumption data amount of current adjustment period and dynamic consumption data amount and is currently adjusted the period
Corresponding adjustment consumption data amount.
Data consumable module 208 is also used to determine the adjustment frame of video data according to adjustment consumption data amount and adjustment time
Rate, using adjustment frame per second playing video data.
In one embodiment, as shown in figure 12, when adjusting the corresponding data type of consumption data amount is audio data,
The device of above-mentioned reduction video playing delay further includes：
Tactful determining module 402 is consumed, for obtaining the application scenarios of audio data, is disappeared according to application scenarios determination
Consumption strategy, consumption strategy include that resampling or discarding quiet data are carried out to audio data.
Data consumable module 208 be also used to when consumption policy be to audio data carry out resampling when, to audio data into
Row resampling, the sampled audio data after being sampled play sampled audio data in the currently adjustment period, when consumption policy is
When abandoning quiet data, the quiet data in audio data is obtained, the data volume summation of quiet data is identical as consumption data amount.
Specific restriction about the device for reducing video playing delay may refer to prolong above for reduction video playing
When method restriction, details are not described herein.Modules in the device of above-mentioned reduction video playing delay can whole or portion
Divide and is realized by software, hardware and combinations thereof.Above-mentioned each module can be embedded in the form of hardware or independently of computer equipment
In processor in, can also be stored in a software form in the memory in computer equipment, in order to processor calling hold
The corresponding operation of the above modules of row.
In one embodiment, a kind of computer equipment is provided, which can be terminal, internal structure
Figure can be as shown in figure 13.The computer equipment includes the processor connected by system bus, memory, network interface, shows
Display screen and input unit.Wherein, the processor of the computer equipment is for providing calculating and control ability.The computer equipment
Memory includes non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system and computer
Program.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The meter
The network interface for calculating machine equipment is used to communicate with external terminal by network connection.When the computer program is executed by processor
A kind of method to realize reduction video playing delay.The display screen of the computer equipment can be liquid crystal display or electronics
Ink display screen, the input unit of the computer equipment can be the touch layer covered on display screen, are also possible to computer and set
Key, trace ball or the Trackpad being arranged on standby shell, can also be external keyboard, Trackpad or mouse etc..
It will be understood by those skilled in the art that structure shown in Figure 13, only part relevant to application scheme
The block diagram of structure, does not constitute the restriction for the computer equipment being applied thereon to application scheme, and specific computer is set
Standby may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program realizes following steps when being executed by processor：Each period pair in the current statistic period in acquisition jitter cache queue
The consumption data amount answered chooses target consumer data volume according to preset rules from corresponding consumption data amount of each period,
It obtains standard consumer data volume and dynamic consumption data amount is determined according to target consumer data volume and standard consumer data volume, obtain
It is current to adjust period corresponding standard consumption data amount, disappeared according to corresponding standard consumption data amount of current adjustment period and dynamic
Consumption data volume carries out that corresponding adjustment consumption data amount of current adjustment period is calculated, according to adjustment consumption data amount current
Adjust period progress data consumption.
In one embodiment, the corresponding consumption number of each period in the current statistic period is obtained in jitter cache queue
Before amount, following steps are also realized when computer program is executed by processor：Obtain the current statistic period delay threshold and
Packet loss reduces delay threshold when packet loss is less than or equal to the first default packet loss threshold value, when packet loss is greater than first in advance
If packet loss threshold value, and when less than the second default packet loss threshold value, delay threshold remains unchanged, and the first default packet loss threshold value is small
Increase delay threshold when packet loss is greater than the second default packet loss threshold value in the second default packet loss threshold value.
In one embodiment, when the corresponding delay threshold of two continuous cycles meets the second default delay threshold, hair
Code stream adjustment instruction is sent to be used to indicate the transmission code rate for sending terminal reduction data packet to terminal, code stream adjustment instruction is sent.
In one embodiment, when adjusting the corresponding data of consumption data amount is video data, current adjustment week is obtained
Phase corresponding standard consumption data amount, according to corresponding standard consumption data amount of current adjustment period and dynamic consumption data amount into
Corresponding adjustment consumption data amount of current adjustment period is calculated in row, including：Obtain the current adjustment period adjustment time and
The corresponding standard consumption data amount of current period is calculated according to adjustment time and corresponding frame per second in corresponding frame per second, according to
Currently adjustment period corresponding standard consumption data amount and dynamic consumption data amount, which are summed, is currently adjusted period correspondence
Adjustment consumption data amount, according to adjustment consumption data amount currently adjustment the period carry out data consumption, including：Disappeared according to adjustment
Consumption data volume and adjustment time determine the adjustment frame per second of video data, using adjustment frame per second playing video data.
In one embodiment, when adjusting the corresponding data of consumption data amount is audio data, method further includes：It obtains
The application scenarios of audio data determine that consumption strategy, consumption strategy include carrying out resampling to audio data according to application scenarios
Or quiet data is abandoned, data consumption is carried out in the currently adjustment period according to adjustment consumption data amount, including：When consumption policy is
When carrying out resampling to audio data, resampling is carried out to audio data, the sampled audio data after being sampled is adjusted currently
Complete cycle plays sampled audio data；When consumption policy is to abandon quiet data, the quiet data in audio data is obtained, it is quiet
The data volume summation of sound data is identical as consumption data amount.
In one embodiment, a kind of computer equipment is provided, including memory, processor and storage are on a memory
And the computer program that can be run on a processor, processor realize following steps when executing computer program：It is slow to obtain shake
The corresponding consumption data amount of each period in the current statistic period is deposited in queue, it is corresponding from each period according to preset rules
Consumption data amount in choose target consumer data volume, obtain standard consumer data volume, according to target consumer data volume and standard
Consumption data amount determines dynamic consumption data amount, obtains corresponding standard consumption data amount of current adjustment period, is adjusted according to current
Complete cycle corresponding standard consumption data amount and dynamic consumption data amount be calculated the corresponding adjustment of current adjustment period
Consumption data amount carries out data consumption in the currently adjustment period according to adjustment consumption data amount.
In one embodiment, the corresponding consumption number of each period in the current statistic period is obtained in jitter cache queue
Before amount, following steps are also realized when computer program is executed by processor：Obtain the current statistic period delay threshold and
Packet loss reduces delay threshold when packet loss is less than or equal to the first default packet loss threshold value, when packet loss is greater than first in advance
If packet loss threshold value, and when less than the second default packet loss threshold value, delay threshold remains unchanged, and the first default packet loss threshold value is small
Increase delay threshold when packet loss is greater than the second default packet loss threshold value in the second default packet loss threshold value.
In one embodiment, when the corresponding delay threshold of two continuous cycles meets the second default delay threshold, hair
Code stream adjustment instruction is sent to be used to indicate the transmission code rate for sending terminal reduction data packet to terminal, code stream adjustment instruction is sent.
In one embodiment, when adjusting the corresponding data of consumption data amount is video data, current adjustment week is obtained
Phase corresponding standard consumption data amount, according to corresponding standard consumption data amount of current adjustment period and dynamic consumption data amount into
Corresponding adjustment consumption data amount of current adjustment period is calculated in row, including：Obtain the current adjustment period adjustment time and
The corresponding standard consumption data amount of current period is calculated according to adjustment time and corresponding frame per second in corresponding frame per second, according to
Currently adjustment period corresponding standard consumption data amount and dynamic consumption data amount, which are summed, is currently adjusted period correspondence
Adjustment consumption data amount, according to adjustment consumption data amount currently adjustment the period carry out data consumption, including：Disappeared according to adjustment
Consumption data volume and adjustment time determine the adjustment frame per second of video data, using adjustment frame per second playing video data.
In one embodiment, when adjusting the corresponding data of consumption data amount is audio data, method further includes：It obtains
The application scenarios of audio data determine that consumption strategy, consumption strategy include carrying out resampling to audio data according to application scenarios
Or quiet data is abandoned, data consumption is carried out in the currently adjustment period according to adjustment consumption data amount, including：When consumption policy is
When carrying out resampling to audio data, resampling is carried out to audio data, the sampled audio data after being sampled is adjusted currently
Complete cycle plays sampled audio data；When consumption policy is to abandon quiet data, the quiet data in audio data is obtained, it is quiet
The data volume summation of sound data is identical as consumption data amount.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (10)
1. a kind of method for reducing video playing delay, the method includes：
Obtain in jitter cache queue the corresponding consumption data amount of each period in the current statistic period, according to preset rules from
Target consumer data volume is chosen in each period corresponding consumption data amount；
Standard consumer data volume is obtained, according to the target consumer data volume and the standard consumer data volume, determines that dynamic disappears
Consume data volume；
Corresponding standard consumption data amount of current adjustment period is obtained, according to current adjustment period corresponding standard consumption number
Be calculated corresponding adjustment consumption data amount of the current adjustment period according to amount and the dynamic consumption data amount；
Data consumption is carried out in the current adjustment period according to the adjustment consumption data amount.
2. the method according to claim 1, wherein in the acquisition jitter cache queue in the current statistic period
Before each period corresponding consumption data amount, further include：
Obtain the delay threshold and packet loss in the current statistic period；
When the packet loss is less than or equal to the first default packet loss threshold value, the delay threshold is reduced；
It is described to prolong when the packet loss is greater than the described first default packet loss threshold value, and when less than the second default packet loss threshold value
When threshold value remain unchanged, the first default packet loss threshold value be less than the described second default packet loss threshold value；
When the packet loss is greater than the described second default packet loss threshold value, increase the delay threshold.
3. according to the method described in claim 2, it is characterized in that, the method also includes：
When the corresponding delay threshold of two continuous cycles meets the second default delay threshold, code stream adjustment instruction is sent extremely
Terminal is sent, the code stream adjustment instruction, which is used to indicate the transmission terminal, reduces the transmission code rate of data packet.
4. the method according to claim 1, wherein when the corresponding data type of the adjustment consumption data amount is
When video data, the acquisition is current to adjust period corresponding standard consumption data amount, corresponding according to the current adjustment period
Standard consumption data amount and the dynamic consumption data amount be calculated corresponding adjustment of the current adjustment period and disappear
Data volume is consumed, including：
The adjustment time and corresponding frame per second for obtaining the current adjustment period, calculate according to the adjustment time and corresponding frame per second
To the corresponding standard consumption data amount of the current period；
It is summed to obtain according to the current adjustment period corresponding standard consumption data amount and the dynamic consumption data amount
Current adjustment period corresponding adjustment consumption data amount；
Data consumption is carried out in the current adjustment period according to the adjustment consumption data amount, including：
The adjustment frame per second of the video data is determined according to the adjustment consumption data amount and the adjustment time；
The video data is played using the adjustment frame per second.
5. the method according to claim 1, wherein when the corresponding data type of the adjustment consumption data amount is
When audio data, the method also includes：
The application scenarios for obtaining the audio data determine the consumption strategy, the consumption strategy according to the application scenarios
Including carrying out resampling to audio data or abandoning quiet data；
It is described that data consumption is carried out in the current adjustment period according to the adjustment consumption data amount, including：
When the consumption policy is the progress resampling to audio data, resampling is carried out to the audio data, is obtained
Sampled audio data after sampling plays the sampled audio data in the current adjustment period；
When the consumption policy is to abandon quiet data, the quiet data in the audio data, the quiet data are obtained
Data volume summation it is identical as the consumption data amount.
6. a kind of device for reducing video playing delay, which is characterized in that described device includes：
Target consumer data volume obtains module, and for obtaining, each period is corresponding in the current statistic period in jitter cache queue
Consumption data amount, target consumer data volume is chosen from corresponding consumption data amount of each period according to preset rules；
Dynamic consumption data determining module, for obtaining standard consumer data volume, according to the target consumer data volume and described
Standard consumer data volume determines dynamic consumption data amount；
Consumption data determining module is adjusted, for obtaining corresponding standard consumption data amount of current adjustment period, is worked as according to described
Preceding adjustment period corresponding standard consumption data amount and the dynamic consumption data amount carry out that the current adjustment week is calculated
Phase corresponding adjustment consumption data amount；
Data consumable module, for carrying out data consumption in the current adjustment period according to the adjustment consumption data amount.
7. device according to claim 6, which is characterized in that described device includes：
Data acquisition module, for obtaining the delay threshold and packet loss in the current statistic period；
Delay threshold adjusts module, is used for when the packet loss is less than or equal to the first default packet loss threshold value, described in reduction
Delay threshold, when the packet loss is greater than the described first default packet loss threshold value, and when less than the second default packet loss threshold value, institute
It states delay threshold to remain unchanged, the first default packet loss threshold value is less than the described second default packet loss threshold value, loses when described
When packet rate is greater than the described second default packet loss threshold value, increase the delay threshold.
8. device according to claim 6, which is characterized in that the adjustment consumption data determining module, which is also used to obtain, to be worked as
The adjustment time and corresponding frame per second in preceding adjustment period are calculated described current according to the adjustment time and corresponding frame per second
Period corresponding standard consumption data amount disappears according to the current adjustment period corresponding standard consumption data amount and the dynamic
Consumption data volume is summed to obtain corresponding adjustment consumption data amount of the current adjustment period；
The data consumable module is also used to determine the video counts according to the adjustment consumption data amount and the adjustment time
According to adjustment frame per second, the video data is played using the adjustment frame per second.
9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the processor realizes any one of claims 1 to 5 institute when executing the computer program
The step of stating method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 5 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810539472.2A CN108924665B (en) | 2018-05-30 | 2018-05-30 | Method and device for reducing video playing delay, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810539472.2A CN108924665B (en) | 2018-05-30 | 2018-05-30 | Method and device for reducing video playing delay, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108924665A true CN108924665A (en) | 2018-11-30 |
| CN108924665B CN108924665B (en) | 2020-11-20 |
Family
ID=64419302
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810539472.2A Active CN108924665B (en) | 2018-05-30 | 2018-05-30 | Method and device for reducing video playing delay, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108924665B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111376259A (en) * | 2018-12-30 | 2020-07-07 | 深圳市优必选科技有限公司 | Method and device for determining data sending period, storage medium and robot |
| CN113496705A (en) * | 2021-08-19 | 2021-10-12 | 杭州华橙软件技术有限公司 | Audio processing method and device, storage medium and electronic equipment |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070019931A1 (en) * | 2005-07-19 | 2007-01-25 | Texas Instruments Incorporated | Systems and methods for re-synchronizing video and audio data |
| CN101123622A (en) * | 2006-08-09 | 2008-02-13 | 大唐移动通信设备有限公司 | A method and device for Iub interface traffic control |
| US7873064B1 (en) * | 2007-02-12 | 2011-01-18 | Marvell International Ltd. | Adaptive jitter buffer-packet loss concealment |
| CN102355425A (en) * | 2011-10-26 | 2012-02-15 | 深信服网络科技（深圳）有限公司 | Network traffic control method and device |
| CN102571561A (en) * | 2011-12-16 | 2012-07-11 | 瑞斯康达科技发展股份有限公司 | PWE3 device and method for reading and writing data in jitter buffer of device |
| CN103795755A (en) * | 2012-10-31 | 2014-05-14 | 中国电信股份有限公司 | Streaming media transmission rate control method, streaming media transmission rate control system and streaming media server |
| CN104022967A (en) * | 2013-02-28 | 2014-09-03 | 三菱电机株式会社 | Voice decoding apparatus |
| CN104410483A (en) * | 2014-12-12 | 2015-03-11 | 成都朗锐芯科技发展有限公司 | Received packet sorting and null packet processing system |
| US20150256473A1 (en) * | 2014-03-10 | 2015-09-10 | JamKazam, Inc. | Packet Rate Control And Related Systems For Interactive Music Systems |
| CN106789385A (en) * | 2015-11-23 | 2017-05-31 | 杭州海康威视数字技术股份有限公司 | A kind of sending method of video flowing, dispensing device and web camera |
| CN107613331A (en) * | 2017-11-03 | 2018-01-19 | 中广热点云科技有限公司 | The bit rate control method of video transmitting procedure |
-
2018
- 2018-05-30 CN CN201810539472.2A patent/CN108924665B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070019931A1 (en) * | 2005-07-19 | 2007-01-25 | Texas Instruments Incorporated | Systems and methods for re-synchronizing video and audio data |
| CN101123622A (en) * | 2006-08-09 | 2008-02-13 | 大唐移动通信设备有限公司 | A method and device for Iub interface traffic control |
| US7873064B1 (en) * | 2007-02-12 | 2011-01-18 | Marvell International Ltd. | Adaptive jitter buffer-packet loss concealment |
| CN102355425A (en) * | 2011-10-26 | 2012-02-15 | 深信服网络科技（深圳）有限公司 | Network traffic control method and device |
| CN102571561A (en) * | 2011-12-16 | 2012-07-11 | 瑞斯康达科技发展股份有限公司 | PWE3 device and method for reading and writing data in jitter buffer of device |
| CN103795755A (en) * | 2012-10-31 | 2014-05-14 | 中国电信股份有限公司 | Streaming media transmission rate control method, streaming media transmission rate control system and streaming media server |
| CN104022967A (en) * | 2013-02-28 | 2014-09-03 | 三菱电机株式会社 | Voice decoding apparatus |
| US20150256473A1 (en) * | 2014-03-10 | 2015-09-10 | JamKazam, Inc. | Packet Rate Control And Related Systems For Interactive Music Systems |
| CN104410483A (en) * | 2014-12-12 | 2015-03-11 | 成都朗锐芯科技发展有限公司 | Received packet sorting and null packet processing system |
| CN106789385A (en) * | 2015-11-23 | 2017-05-31 | 杭州海康威视数字技术股份有限公司 | A kind of sending method of video flowing, dispensing device and web camera |
| CN107613331A (en) * | 2017-11-03 | 2018-01-19 | 中广热点云科技有限公司 | The bit rate control method of video transmitting procedure |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111376259A (en) * | 2018-12-30 | 2020-07-07 | 深圳市优必选科技有限公司 | Method and device for determining data sending period, storage medium and robot |
| CN113496705A (en) * | 2021-08-19 | 2021-10-12 | 杭州华橙软件技术有限公司 | Audio processing method and device, storage medium and electronic equipment |
| CN113496705B (en) * | 2021-08-19 | 2024-03-08 | 杭州华橙软件技术有限公司 | Audio processing method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108924665B (en) | 2020-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200266839A1 (en) | Media Controller with Buffer Interface | |
| Bacioccola et al. | User-level performance evaluation of VoIP using ns-2 | |
| CN111107440B (en) | Video transmission control method and device, equipment and storage medium | |
| US7680099B2 (en) | Jitter buffer adjustment | |
| Cizmeci et al. | A multiplexing scheme for multimodal teleoperation | |
| US20080151765A1 (en) | Enhanced Jitter Buffer | |
| US20120250678A1 (en) | Method of scheduling transmission in a communication network, corresponding communication node and computer program product | |
| GB2525948A (en) | Packet loss and bandwidth coordination | |
| US10701124B1 (en) | Handling timestamp inaccuracies for streaming network protocols | |
| US7675946B2 (en) | System and method for managing playout time in packet communication network | |
| JPWO2006009087A1 (en) | Stream data receiving / reproducing apparatus and stream data receiving / reproducing method | |
| CN109495660A (en) | A kind of coding method of audio data, device, equipment and storage medium | |
| CN108924665A (en) | Reduce method, apparatus, computer equipment and the storage medium of video playing delay | |
| CN100359892C (en) | Dynamic Latency management for IP telephone | |
| TWI480861B (en) | Method, apparatus, and system for controlling time-scaling of audio signal | |
| US20070177625A1 (en) | Packet communication system, packet communication method, transmission apparatus, and storage medium having stored therein computer program | |
| Yensen et al. | HMM delay prediction technique for VoIP | |
| US7793202B2 (en) | Loss compensation device, loss compensation method and loss compensation program | |
| Cinar et al. | Improved jitter buffer management for WebRTC | |
| US7370126B2 (en) | System and method for implementing a demand paging jitter buffer algorithm | |
| Oklander et al. | Jitter buffer analysis | |
| US8675495B2 (en) | Communication system | |
| JP3369108B2 (en) | Packet data transmission device | |
| CN114222169B (en) | Video streaming method, communication device and computer readable storage medium | |
| Ranganathan et al. | Neural and fuzzy computation techniques for playout delay adaptation in VoIP networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |