CN109587551A

CN109587551A - A kind of judgment method, device, equipment and the storage medium of live streaming media Caton

Info

Publication number: CN109587551A
Application number: CN201710909775.4A
Authority: CN
Inventors: 武爱敏; 王文博
Original assignee: Beijing Kingsoft Cloud Network Technology Co Ltd; Beijing Kingsoft Cloud Technology Co Ltd
Current assignee: Beijing Kingsoft Cloud Network Technology Co Ltd; Beijing Kingsoft Cloud Technology Co Ltd
Priority date: 2017-09-29
Filing date: 2017-09-29
Publication date: 2019-04-05
Anticipated expiration: 2037-09-29
Also published as: CN109587551B

Abstract

The embodiment of the invention provides judgment method, device, equipment and the storage mediums of a kind of live streaming media Caton, are related to field of communication technology, and solving the problems, such as the prior art, there are streaming medias Caton judgement inaccuracy whether occurs.Wherein, the judgment method of the live streaming media Caton, the equipment for applying receiving stream media during live streaming media, which comprises obtain the streamed audio data in the stream medium data of predetermined time period, calculate the playing duration of acquired streamed audio data；Calculated playing duration is compared with the predetermined time period, obtains a comparison result；According to the comparison result, judge live streaming media whether Caton, accurately judge whether live streaming media Caton occurs to realize.

Description

A kind of judgment method, device, equipment and the storage medium of live streaming media Caton

Technical field

The present invention relates to field of communication technology, more particularly to a kind of live streaming media Caton judgment method, device, set Standby and storage medium.

Background technique

Current Streaming Media refer to using stream transmission by the way of, in internet Internet play media formats.Stream Media are called streaming video, it refers to that businessman issues program as data packet with a video delivery server, are transmitted to net On network.After user decompresses these data by decompression apparatus, program will be shown as before sending.

General live streaming media can pass through many links, since Streaming Media is real-time from signal acquisition terminal to decoding receiving end The characteristic of transmission has very high requirement for network quality, can frequently encounter asking for the similar influence viewing experience such as Caton Topic, so very necessarily live streaming Caton situation is tested and analyzed by some effective means or method.

There are mainly two types of for the more extensive Caton judgment method of application at present:

1, by analyzing the rate of video compression code situation of change in live data；

Obtain the net cast data of Streaming Media；

By the compress mode of CBR (Constant bit rate, fixed bit rate coding), to the net cast data It is compressed；

Compressed net cast data are transmitted, the video bitrate and preset time point of current point in time are compared Difference between corresponding video bitrate；If the difference is greater than the first preset threshold being arranged according to user demand, explanation Transmission speed is insufficient, then judges that Caton occur in net cast data；If the difference is less than first be arranged according to user demand Preset threshold, illustrates that transmission speed is enough, then judges that net cast data do not occur Caton.Aforementioned preset time point is above-mentioned Before current time.

2, by analyzing the video frame rate situation of change in live data:

The theoretical code rate of setting, theoretical frame per second etc. is written in technical foundation based on Video coding, encoder in media head Information, the information are used to that decoder is helped correctly to identify compressed data；

Decoder obtains the net cast data of the Streaming Media in compressed encoding when institute by the information in reading media head The theoretical code rate of setting and theoretical frame per second, theoretical frame per second indicate how many compressed video image each second；

Decoder obtains the practical decoded frame per second of reception each second, and the numerical value and reality for comparing theoretical frame per second receive decoded The difference of frame per second illustrates loss of data occur when the difference is greater than the second preset threshold being configured according to user demand, Then judge that Caton occur in net cast data；When the difference is less than the second preset threshold being configured according to user demand, Illustrate that data occur transmits enough, then judge that net cast data do not occur Caton, wherein this is practical to receive decoded frame per second and be Each second is practical to receive decoded video image number.

Two kinds of Caton judgment methods of the above prior art are all the video information such as videos by video in Streaming Media Bit rate or frame per second, judge whether net cast Caton occurs.But net cast data are in real network transmission process In, network is there may be the state of less stable, and for network in order to guarantee that net cast data can be transmitted, actual treatment can be actively Partial video frame is abandoned, the video that such network actively abandons not is actual Caton, but is sentenced using above two Caton Disconnected method, may be judged as that Caton occur in net cast data, thus, there are streaming medias whether Caton occurs for the prior art Judge the problem of inaccuracy.

Summary of the invention

It a kind of judgment method for being designed to provide live streaming media Caton of the embodiment of the present invention, device, equipment and deposits Storage media accurately judges whether live streaming media Caton occurs to realize.Specific technical solution is as follows:

In a first aspect, applying the embodiment of the invention provides a kind of judgment method of live streaming media Caton in Streaming Media The equipment of receiving stream media, the above method include: during live streaming

The streamed audio data in the stream medium data of predetermined time period are obtained, acquired streamed audio is calculated The playing duration of data；

Calculated playing duration is compared with above-mentioned predetermined time period, obtains a comparison result；

According to above-mentioned comparison result, judge live streaming media whether Caton.

Optionally, the streamed audio data in the stream medium data of above-mentioned acquisition predetermined time period, acquired in calculating Streamed audio data playing duration the step of include:

Obtain the streamed audio data in the stream medium data of above-mentioned predetermined time period；

Record the first time stamp in first packets of audio data of above-mentioned predetermined time period；

Record the second timestamp in the last one packets of audio data of above-mentioned predetermined time period；

Calculate the in the second timestamp in the last one above-mentioned packets of audio data and above-mentioned first packets of audio data The absolute value of difference between one timestamp obtains the playing duration of acquired streamed audio data.

Optionally, above-mentioned according to above-mentioned comparison result, judge live streaming media whether Caton the step of include:

When above-mentioned comparison result shows that calculated playing duration is equal to above-mentioned predetermined time period,

Determine the non-Caton of live streaming media.

When above-mentioned comparison result shows that calculated playing duration is less than or greater than above-mentioned predetermined time period,

Judge whether the data volume of above-mentioned streamed audio data meets preset condition, judges whether live streaming media blocks , wherein above-mentioned preset condition shows the data volume of above-mentioned streamed audio data compared with the data volume of data buffer zone Relationship.

Optionally, when above-mentioned comparison result shows that calculated playing duration is greater than above-mentioned predetermined time period,

Whether the above-mentioned data volume for judging above-mentioned streamed audio data meets preset condition, whether judges live streaming media The step of Caton includes: to judge whether the data volume of the acquired streamed audio data of above-mentioned predetermined time period is greater than The data volume that data buffer zone can accommodate is stated,

If the data volume of the acquired streamed audio data of above-mentioned predetermined time period is greater than above-mentioned data buffer zone The data volume that can be accommodated, determines live streaming media Caton；

If the data volume of the acquired streamed audio data of above-mentioned predetermined time period is less than or equal to above-mentioned data The data volume that buffer area can accommodate determines the non-Caton of live streaming media.

Optionally, if judging live streaming media Caton, the above method further include:

It determines the data volume for overflowing above-mentioned data buffer zone, the data volume overflowed is deleted.

Optionally, when above-mentioned comparison result shows that calculated playing duration is less than above-mentioned predetermined time period,

Whether the above-mentioned data volume for judging above-mentioned streamed audio data meets preset condition, whether judges live streaming media The step of Caton includes: to judge whether the data volume cached in above-mentioned data buffer zone is zero, and acquired streamed audio Whether the data volume of data is zero,

If the data volume cached in above-mentioned data buffer zone is zero, and the data volume of acquired streamed audio data is Zero, determine live streaming media Caton；

If the data volume cached in above-mentioned data buffer zone is greater than zero, and the data volume of acquired streamed audio data Greater than zero, the non-Caton of live streaming media is determined.

Second aspect is applied the embodiment of the invention also provides a kind of judgment means of live streaming media Caton in stream matchmaker The equipment of receiving stream media, above-mentioned apparatus include: during body live streaming

Module, the streamed audio data in stream medium data for obtaining predetermined time period are obtained, calculating is obtained The playing duration of the streamed audio data taken；

Compare acquisition module, for calculated playing duration to be compared with above-mentioned predetermined time period, obtains one Comparison result；

Judgment module, for according to above-mentioned comparison result, judge live streaming media whether Caton.

Optionally, first module, the Streaming Media sound in stream medium data for obtaining above-mentioned predetermined time period are obtained Frequency evidence；

First logging modle, the first time in first packets of audio data for recording above-mentioned predetermined time period Stamp；

Second logging modle, the second time in the last one packets of audio data for recording above-mentioned predetermined time period Stamp；

It calculates and obtains module, for calculating the second timestamp in the last one above-mentioned packets of audio data and above-mentioned first The absolute value of difference between first time stamp in packets of audio data, when obtaining the broadcasting of acquired streamed audio data It is long.

Optionally, the first judging submodule, it is above-mentioned for showing that calculated playing duration is equal in above-mentioned comparison result When predetermined time period, the non-Caton of live streaming media is determined.

Optionally, second judgment submodule, for showing that calculated playing duration is less than or greatly in above-mentioned comparison result When above-mentioned predetermined time period, judge whether the data volume of above-mentioned streamed audio data meets preset condition, judges to flow matchmaker Body live streaming whether Caton, wherein above-mentioned preset condition shows data volume and the data buffer zone of above-mentioned streamed audio data The comparison of data volume.

Optionally, above-mentioned second judgment submodule is specifically used for: showing calculated playing duration in above-mentioned comparison result When greater than above-mentioned predetermined time period, judge that the data volume of the acquired streamed audio data of above-mentioned predetermined time period is The no data volume that can be accommodated greater than above-mentioned data buffer zone,

Optionally, removing module deletes the data volume overflowed for determining the data volume for overflowing above-mentioned data buffer zone It removes.

Optionally, above-mentioned second judgment submodule is specifically used for: showing calculated playing duration in above-mentioned comparison result When less than above-mentioned predetermined time period, judge whether the data volume cached in above-mentioned data buffer zone is zero, and acquired stream Whether the data volume of media audio data is zero,

The third aspect, the embodiment of the invention provides a kind of equipment of receiving stream media during live streaming media, packets Include processor and memory, memory, for storing computer program；

Processor when for executing the program stored on memory, realizes the above-mentioned step of first aspect.

Fourth aspect, the embodiment of the invention also provides a kind of equipment of receiving stream media during live streaming media, Including processor, communication interface, memory and communication bus, wherein processor, communication interface, memory are completed by bus Mutual communication,

Memory, for storing computer program；

5th aspect, it is above-mentioned computer-readable to deposit the embodiment of the invention also provides a kind of computer readable storage medium It is stored with computer program in storage media, first aspect above-mentioned step is realized when above-mentioned computer program is executed by processor.

6th aspect, the embodiment of the invention provides a kind of computer program products comprising instruction, when it is in computer When upper operation, so that computer executes the above-mentioned step of above-mentioned first aspect.

7th aspect, the embodiment of the invention provides a kind of computer programs, when run on a computer, make to succeed in one's scheme Calculation machine executes the above-mentioned step of above-mentioned first aspect.

Judgment method, device, equipment and the storage medium of live streaming media Caton provided in an embodiment of the present invention, by obtaining The streamed audio data in the stream medium data of predetermined time period are taken, the broadcasting of acquired streamed audio data is calculated Duration, compares streamed audio data playback duration and predetermined time period obtains a comparison result, to judge that Streaming Media is straight Broadcast whether Caton.The erroneous judgement using the video data detection Caton in Streaming Media is eliminated in this way, can accurately judge to flow matchmaker Whether body there is Caton.Make basis for subsequent adjustment video fluency, after the later period effectively adjusts video fluency, improves User experience effect.Certainly, any product or method for implementing the embodiment of the present invention must be not necessarily required to reach the above institute simultaneously All advantages stated.

Detailed description of the invention

In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.

Fig. 1 is the first flow diagram of the judgment method of the live streaming media Caton of the embodiment of the present invention；

Fig. 2 is the idiographic flow schematic diagram of step 101 in Fig. 1 of the embodiment of the present invention；

Fig. 3 is second of flow diagram of the judgment method of the live streaming media Caton of the embodiment of the present invention；

Fig. 4 is the structural schematic diagram of the judgment means of the live streaming media Caton of the embodiment of the present invention；

Fig. 5 is the structural schematic diagram of the equipment of receiving stream media during live streaming media of the embodiment of the present invention.

Specific embodiment

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment belongs to the range of protection of the embodiment of the present invention.

Due to be in the prior art by by video in stream medium data video information such as video bitrate or Person's frame per second, to judge whether net cast Caton occurs.It, may be due to net and in actual video live data transmission process There are the states of less stable for network, and network is practical actively to abandon partial video, to guarantee that net cast data can be transmitted.

The prior art is that the video information of video in stream medium data is handled, and judges whether net cast blocks ?.The processing or compression of the prior art and the streamed audio data being not present in streaming media data, judge net cast Whether there is Caton, thus based on above-mentioned streamed audio data it is without any processing on the basis of, inventor is additionally contemplates that stream The Caton of video data has no effect on streamed audio data during media data transmission.It is, in stream medium data reality In the transmission process of border, video data is played out according to the broadcast request of itself, streamed audio data can according to itself Broadcast request plays out, as long as realizing the synchronous transfer of the video data and streamed audio data in stream medium data Complete the transmission of Streaming Media.Wherein, this itself broadcast request is by the actual transmissions demand of network and broadcasting for streaming media playing end Exoergic power determines.For example, the actual transmissions require to include: video code rate；Ability to play includes: network bandwidth, video definition And network throughput.

Above-mentioned streamed audio data are during actual play, once occur interrupting or mistake, then it can be accurately Judge that Caton occurs in live streaming media.Considered based on foregoing invention people, the embodiment of the present invention has stream to solve the prior art The problem of medium living broadcast Caton is judged by accident, judgment method, device, equipment and the storage for providing a kind of live streaming media Caton are situated between Matter carries out the judgement of Caton using the streamed audio data in stream medium data, to realize the standard of live streaming media Caton Really judgement improves Caton for the later period and performs basis, improves the smooth degree of live streaming media, and then improves user experience effect Fruit.

The judgment method for being provided for the embodiments of the invention live streaming media Caton first below is introduced.

It should be noted that the judgment method of live streaming media Caton provided by the embodiment of the present invention can also be applied The equipment of receiving stream media during live streaming media.The equipment is specifically as follows: desktop computer, portable computer, intelligence Energy mobile terminal, mobile terminal, server etc..It can be applied to during live streaming media in the equipment of receiving stream media Client is not limited thereto, any that the equipment of the embodiment of the present invention may be implemented, and belongs to the protection model of the embodiment of the present invention It encloses.

As shown in Figure 1, a kind of judgment method of live streaming media Caton provided by the embodiment of the present invention, is applied in stream matchmaker The equipment of receiving stream media during body live streaming, may include steps of:

Here the equipment for applying transmission Streaming Media during live streaming media, in the subsequent introduction of the embodiment of the present invention Referred to as equipment.

Step 101, the streamed audio data in the stream medium data of predetermined time period are obtained, acquired stream is calculated The playing duration of media audio data.

Stream medium data refers to after the compression of a series of media data, sends compressed Streaming Media number by network segmentation According to.Stream medium data instantaneous transmission on network is audio-visual, so that user is ornamental.Streamed audio data in the stream medium data The sound in frequency range that finger human ear can be heard.

Predetermined time period can be set according to user demand.The predetermined time period is the operating system of the equipment Time.Most short general predetermined time period is 1 second, can increase duration on the basis of this 1 second, in the embodiment of the present invention, Without limitation to the upper limit of the predetermined time period.Any predetermined time period is divided into the case where meeting bandwidth demand, is belonged to In the protection scope of the embodiment of the present invention.The case where bandwidth demand, can refer to that the stream medium data of propagation is less than or equal to Transmission bandwidth.The bandwidth demand is used to guarantee the normal transmission of stream medium data.Illustratively, it is set in the predetermined time period When being set to 1 second, this can refer to that system timestamp is 14 points of Monday on June 26th, 2,017 01 minute and 05 second for 1 second, with system time Stamp is 1 second between 14 points of Monday on June 26th, 2,017 01 minute and 06 second.The embodiment of the present invention, predetermined time period is smaller, It is more accurate then to judge whether live streaming media Caton occurs.

Above-mentioned system timestamp refers to and temporal information is added in a series of data, such as days Time of Day, herein A series of data can be the stream medium data of propagation.

Optionally, in a kind of specific implementation, step 101 includes: to obtain preset time according to predetermined period here Streamed audio data in the stream medium data of length calculate the playing duration of acquired streamed audio data.Wherein, The predetermined period is greater than or equal to the predetermined time period, and guarantee equipment in this way obtains all Streaming Media numbers in the predetermined period Streamed audio data in, so that the streamed audio data are completed with the calculating of playing duration.

The streamed audio data may include the temporal information of each streamed audio data packet, each streamed audio The data volume of data packet and the total amount of data of streamed audio data packet.The temporal information can refer to timestamp, can also be with Refer to the corresponding time span of the normal transmission time of data packet, the corresponding time span of the normal transmission time of the data packet can To be obtained according to experiment, can also need to be configured according to user.When any broadcasting that can obtain streamed audio data Long any time information, belongs to the protection scope of the embodiment of the present invention, herein a different citing.

Step 102, calculated playing duration is compared with the predetermined time period, obtains a comparison result.

Step 103, according to the comparison result, judge live streaming media whether Caton.

Live streaming media refers to that the programme content broadcasted by media such as broadcasting and television network, internets is synchronous with live event The transmission mode of progress.When the Caton is referred to according to fixed frequency or speed transmission data, there is fixed frequency reduction or speed The case where degree reduces, the not viewing experience glibly of initiation.

The judgment method of live streaming media Caton provided in an embodiment of the present invention, by the stream matchmaker for obtaining predetermined time period Streamed audio data in volume data calculate the playing duration of acquired streamed audio data, compare streamed audio Data playback duration and predetermined time period obtain a comparison result, thus judge live streaming media whether Caton.It eliminates in this way Using the erroneous judgement of the video data detection Caton in Streaming Media, it can accurately judge whether Streaming Media occurs Caton.It is rear Continuous adjustment video fluency makees basis, after the later period effectively adjusts video fluency, improves user experience effect.

In order to more quickly determine out the playing duration of streamed audio data, as shown in Fig. 2, optionally, in one kind In specific implementation, above-mentioned steps 101 include the following steps:

Step 201, the streamed audio data in the stream medium data of the predetermined time period are obtained.

During transmission of flow media data carried out data transmission by data packet, realizes above-mentioned streamed audio data Obtaining step it is as follows:

The equipment for sending Streaming Media during live streaming media is applied, by network or is locally stored to obtain Streaming Media Data extract streamed audio data and streaming media video data in the stream medium data.

According to default sample rate set by user, using encoder according to preset sample frequency to the streamed audio data Sample code is carried out, the audio frame per second of streamed audio data per second is obtained, calculates decoder using the audio frame per second Required decoded duration, encoder are packaged a streamed audio data packet periodically with the packing period a length of when this, and Duration is written in this streamed audio data packet, to guarantee in encoder coded data, according to audio frame per second, to each stream Media audio data packet is encoded.

After decoder receives the stream medium data of coding, it can be solved with reference to aforementioned duration streaming media video data packet Code.Under normal circumstances, the time difference of the continuous flow media data packet of every two should not occur significantly in the duration Jump.

The equipment for applying receiving stream media during live streaming media reads the flow media data packet, can obtain this Streamed audio data packet, the default sample rate and the duration in stream medium data.It can guarantee to receive Streaming Media in this way The equipment of data packet can decode received stream medium data.

Illustratively, above-mentioned default sample rate can use AAC (Advanced Audio Coding, advanced audio volume Code) coding compression is carried out, and 44.1kHZ is set by default sample rate.

Sampled point can be packaged by AAC format in compression process.Packing manner is that every 1024 sampled points make a call to one Packet.Each packet is referred to as an AAC audio frame.In this way, 44100 sampled points are packaged according to upper packing manner, will produce Raw 43 audio frames (i.e. 44100 are approximately equal to 43 divided by 1024), it is, obtained audio frame per second is 43fps.Utilize the audio Frame per second, can calculate decoding duration required for each audio frame is about 23 milliseconds (i.e. 1000 are approximately equal to 23 divided by 43).Certainly It is only illustrated by taking the audio encoding and decoding technique of AAC as an example herein, other MP3 audio encoding and decoding techniques are equally applicable, any The audio encoding and decoding technique that can be realized the embodiment of the present invention belongs to the protection scope of the embodiment of the present invention, herein not one by one Citing.

The frame per second of above-mentioned audio refers to that sound can be to fixed quantity in the acquisition conversion process from analog to digital Sampled point is packaged, and is packaged the quantity of audio pack every second, which is such as above-mentioned 1024.

The format of AAC can provide preferable sound quality and higher compression ratio.The most important ginseng of audio gauge quality Examining index is sample rate, i.e., sound from analog waveform to it is digitized during, number that each second does sound wave wave amplitude The quantity of the sample of word information collection.The highest sample rate that human ear can be heard is 20kHz, in order to avoid compressing, transmitting Etc. audio distortions caused by processes, the audio sample rate of application is 44.1kHz, i.e., per second to have 44100 sampled points.

Step 202, the first time stamp in first packets of audio data of the predetermined time period is recorded.

First packets of audio data is mainly by " destination IP (Internet Protocol, Internet protocol) address ", " source IP address ", " carrying data only " and identification division are constituted.First packets of audio data includes packet header and backpack body, and packet header is solid Measured length, the indefinite length of backpack body, each field length are fixed, and the request data package of both sides and the head-coating structure of reply data packet are It is consistent.

Above-mentioned source IP address refers to the sending device address of first packets of audio data, first of the embodiment of the present invention The transmission address of packets of audio data can be signal acquisition coding side.Above-mentioned purpose IP address refers to first packets of audio data Receiving device address.Above-mentioned net load data can be streamed audio data, and it is total that above-mentioned identification division can be data The mark of data volume is also possible to the mark of the data volume of each data packet.

First packets of audio data and the corresponding timestamp of first packets of audio data can recorde in local hard drive, It can be recorded in the network virtual magnetic disk for pre-establishing network connection, any can be realized records the packets of audio data and be somebody's turn to do The position of the corresponding timestamp of audio pack, belongs to the protection scope of the embodiment of the present invention.By recording the timestamp, Ke Yifang Phase user directly uses after an action of the bowels or equipment reads the timestamp in the position of the record and directly used, and does not have to obtain in real time Running memory is occupied when the timestamp, not only alleviates the burden of running memory and bandwidth, but also also improves data processing Efficiency.

First packets of audio data and the corresponding timestamp of first packets of audio data can recorde in temporal cache, this Sample can will use the timestamp of completion to delete, reduce the pressure of memory space after predetermined time period.It is any can It realizes the mode for recording the timestamp, belongs to the protection scope of the embodiment of the present invention, different one illustrate herein.

The timestamp in first packets of audio data will be recorded as the first time in first packets of audio data and stab DS, In first packets of audio data first time stamp DS include: encoder according to default sample rate to the streamed audio data Sample code is carried out, and the initial time stamp of above-mentioned duration is written in this streamed audio data packet.

Step 203, the second timestamp in the last one packets of audio data of the predetermined time period is recorded.

The last one packets of audio data mainly by " destination IP (Internet Protocol, Internet protocol) address ", " source IP address ", " carrying data only " and identification division are constituted.The last one packets of audio data includes packet header and backpack body, packet header It is regular length, the indefinite length of backpack body, each field length is fixed, the request data package of both sides and the packet header knot of reply data packet Structure is consistent.

Above-mentioned source IP address refers to the sending device address of the last one packets of audio data, the embodiment of the present invention it is last The transmission address of one packets of audio data can be signal acquisition coding side.Above-mentioned purpose IP address refers to the last one audio The receiving device address of data packet.Above-mentioned net load data can be streamed audio data, and above-mentioned identification division can be Data count is also possible to the mark of the data volume of each data packet according to the mark of amount.

The last one packets of audio data and the corresponding timestamp of the last one packets of audio data also can recorde local hard In disk, it is also possible to be recorded in the network virtual magnetic disk for pre-establishing network connection, can also be recorded in temporal cache.Appoint What, which can be realized, records the position of the packets of audio data and the corresponding timestamp of the audio pack, belongs to the guarantor of the embodiment of the present invention Protect range.

The timestamp in the last one packets of audio data will be recorded as the second time in the last one packets of audio data Stab DE, the second timestamp DE in the last one packets of audio data include: encoder according to default sample rate to the Streaming Media Audio data carries out sample code, and the ending time stamp of above-mentioned duration is written in this streamed audio data packet.

Step 204, it calculates in the second timestamp and first packets of audio data in the last one packets of audio data First time stamp between difference absolute value, obtain the playing duration of acquired streamed audio data.

Using the playing duration of acquired streamed audio data, and then obtain the playing duration of stream medium data.

Here playing duration of the calculated absolute value as acquired streamed audio data, to obtain stream matchmaker The playing duration of volume data.When the broadcasting of stream medium data is stablized, that is, in the case of normal play, stab at the first time Difference between DS and the second timestamp DE is equal to encoder and is adopting according to default sample rate to the streamed audio data When sample encodes, the duration being written in this streamed audio data packet, it is, the playing duration of stream medium data.It compares It is 30fps, 25fps, 20fps, 15fps etc. in the video frame rate of stream medium data common at present, video frame rate is lower, continuously The smoothness of picture is poorer, but is generally not less than 15 frame per second, and human eye can all be considered smooth picture, and in some applications Under scene, the coding mode or transmission mode for actively abandoning video frame are also had, lower video frame rate is only for spectators Less smooth picture effect can be brought.But as long as sound is continuous, do not have live streaming short interruption etc. Caton phenomenon and Feel, and audio frame is different from video frame, as long as having audio frame loss or exception, spectators can be easy to perceive personage couple It is words or the pause of music, slow play, discontinuous.

Using the embodiment of the present invention, when receiving first packets of audio data and the last one packets of audio data, respectively Corresponding first time stamp and the second timestamp are recorded, the difference of the two can be quickly utilized, determine acquired Streaming Media The playing duration of audio data.The audio data being used herein in most basic streaming media data carries out the audio coding time The comparison of stamp front and back, using the audio frame per second of audio coding and the difference of the two, variation in transmission process, as live streaming media Whether occur the important judgement reference index of Caton in the process, can accurately learn the loss of audio frame, spectators are to more Readily discover the pause of human dialog or music, slow play, discontinuous, equipment, which also facilitates, carries out detection Caton.

In order to more accurately judge whether the playing duration is correct, the judgment method of the live streaming media Caton, upper After stating step 202, the method can also include: to record first audio when receiving first packets of audio data The corresponding operating system timestamp SS of data packet (System_Time_Start, system start time), and

After above-mentioned steps 203, the method can also include: the note when receiving the last one packets of audio data Record the corresponding operating system timestamp SE of the last one packets of audio data (System_Time_End, system finishing time)；

It is corresponding that first packets of audio data is subtracted using the corresponding operating system timestamp SE of the last one packets of audio data The obtained operating system time tolerance of operating system timestamp SS, the operating system time tolerance size with it is upper State the absolute value of DE-DS difference size it is identical when, then show that the transmission of the streamed audio data packet is stablized, and be judged as this Playing duration is correct.Illustrate the frequent data of Streaming Media in transmission process, does not interrupt or delay transport.

Due to during streaming media playing, in fact it could happen that the case where live streaming media Caton, it is also possible to Streaming Media occur The case where non-Caton is broadcast live, in order to accurately judge whether live streaming media the case where Caton occurs.Optionally, in one kind In specific implementation, step 103 may include: to show that calculated playing duration is equal to the preset time in the comparison result When length, the non-Caton of live streaming media is determined.

Here comparison result shows that calculated playing duration is equal to the predetermined time period, it is known that the preset time is long Degree, equipment the streamed audio data of durations such as have had correctly received, i.e., have not occurred streamed audio during live streaming media The problem of loss of data, the data volume cached in data buffer zone at this time are corresponding for the predetermined time period streamed audio data Data volume, then determine the non-Caton of live streaming media.

Illustratively, it is assumed that the first time in the streamed audio data of acquisition in first packets of audio data stabs DS and is In 14 points of Monday 01 minute and 07 second on May 26th, 2017, the second timestamp DE in the last one packets of audio data is in May, 2017 14 points of Monday on the 26th 01 minute and 09 second, first audio number was subtracted using the second timestamp DE in the last one packets of audio data Obtaining the absolute value of difference according to the first time stamp DS in packet is 2 seconds, is used as above-mentioned playing duration for this 2 seconds.

Assuming that predetermined time period is 2 seconds, it is 2017 that equipment, which receives the system timestamp in first packets of audio data, In 14 points of Monday 01 minute and 08 second on May 26, of, just the system timestamp at 2 seconds is 14 points of Monday of May 26 in 2017 01 point 10 seconds, equipment receives the last one packets of audio data SE, it is, utilizing the system in the last one packets of audio data Timestamp subtracts the system timestamp in first packets of audio data, and the absolute value for obtaining difference is 2 seconds, by this 2 seconds as upper Predetermined time period is stated, such predetermined time period is equal with playing duration, illustrates to determine the non-Caton of live streaming media, Streaming Media Audio, video data does not interrupt or delay transport in transmission process.

CBR (the Constants poor by the video quality of coding compression output compared to current video coding technique Bit Rate, cbr (constant bit rate)) technology, become coding later and compresses the video quality exported more preferably VBR (Variable Bit Rate, dynamic bit rate) technology, i.e. video bitrate in the unit time can be with the variation frequent degree of video content itself And the information such as color complexity and the variation that floats up and down.Although overall average bit rate substantially constant, bring are direct Problem be exactly in the unit time video bitrate numerical fluctuations it is very big, the highest possible variation range for occurring 2,3 times or more.This When, using the second preset threshold being configured according to user demand as reference value, and second preset threshold and practical view Frequency bit rate compares, it is understood that there may be relatively large deviation, due in the unit time video bitrate numerical value float up and down variation it is very big, this Sample is not only difficult that accurate second preset threshold is arranged, and as reference value, realizes to entire live streaming media mistake The video bitrate of journey compares and analyzes, and is not actual Caton due to the video that network actively abandons, the dynamic Bit rate algorithm does not identify out the situation, and the video that may actively abandon the network determines that live streaming media goes out Existing Caton.

Stream is determined when being equal to the predetermined time period using the playing duration of streamed audio data using the present embodiment The non-Caton of medium living broadcast does not need identification video frame, do not need yet setting second preset it is preset as reference value, to entire The video bitrate of live streaming process compares and analyzes, and is more not in the video for actively abandoning network, and false judgment is stream The case where Caton of medium living broadcast, improves the accuracy for determining the non-Caton of live streaming media.

In order to accurately judge that live streaming media does not occur Caton, in a kind of specific implementation, step 103 can To include the following steps:

When the comparison result shows that calculated playing duration is less than or greater than the predetermined time period, the stream is judged Whether the data volume of media audio data meets preset condition, judge live streaming media whether Caton, wherein the preset condition table The comparison of the data volume of the data volume and data buffer zone of free flow media audio data.

When the comparison result shows that calculated playing duration is less than the predetermined time period, it is known that equipment does not arrive also When predetermined time period, has been received and complete streamed audio data.When showing that theoretical and actual use is same default Between length, equipment has received the audio frame number evidence fewer than theoretical value.

Illustratively, it is assumed that the first time in the streamed audio data of acquisition in first packets of audio data stabs DS and is In 14 points of Monday 02 minute and 07 second on May 26th, 2017, the second timestamp DE in the last one packets of audio data is in May, 2017 14 points of Monday on the 26th 02 minute and 08 second, first audio number was subtracted using the second timestamp DE in the last one packets of audio data Obtaining the absolute value of difference according to the first time stamp DS in packet is 1 second, is used as above-mentioned playing duration for this 1 second.

Assuming that predetermined time period is 2 seconds, it is 2017 that equipment, which receives the system timestamp in first packets of audio data, 14 points of Monday 02 minute and 08 second on May 26, is 14 points of Monday on May 26th, 2,017 02 minute and 09 second in system timestamp, Equipment receives the last one packets of audio data SE exactly in 1 second, and predetermined time period is 2 seconds, received in 1 second Complete packets of audio data does not receive packets of audio data in remaining 1 second, that is, system timestamp is on May 26th, 2017 14 points of Monday 02 minute and 10 seconds, the received packets of audio data of equipment was zero.

Equipment would generally set a data buffer zone, and the data volume of data buffer zone generally includes: data buffer zone institute The data volume that can be accommodated and the data volume cached in data buffer zone, the data volume which can accommodate can define For CL (Cache_Length, the data volume that data buffer zone can accommodate), for accommodating quantitative data.Illustratively, should Data buffer zone can accommodate the data volume of 2 seconds durations, then CL=TI*2, wherein TI is preset duration.

Here the data volume that data buffer zone can accommodate includes the lower limit value of data volume, the upper limit value of data volume, and It being capable of the data cached data legal range between upper limit value and lower limit value.Optionally, in a kind of specific implementation, When the lower limit value of the data volume deficiency data volume cached in data buffer zone, broadcast since live streaming media needs to read data It puts, and at this time due to, without data cached or be unsatisfactory for the data volume of played data, and also not connect in data buffer zone Streamed audio data are received, will determine that Caton occurs in live streaming media at this time.

Optionally, in another specific implementation, the data cached upper limit value greater than data volume in data buffer area When, since the data volume of data buffer area cannot be played timely, the data of the upper limit value beyond data volume may will lose It loses, just will appear Caton at this time.Therefore the data volume that data buffer area can be used accurately judges whether live streaming media blocks ?.

Specifically, illustrative, network congestion may cause the Caton of live streaming media.What data buffer zone can accommodate The upper limit value of data volume is the corresponding data volume of 3 seconds time spans, due to network congestion, then equipment may receive stream matchmaker at this time The corresponding data volume of less than 1 second time span of body audio data reads the corresponding data of 2 seconds time spans played every time originally Amount, and the data volume cached in data buffer zone at this time is not just enough, can only read the corresponding data volume of 1 second time span, this When device plays complete the corresponding data volume of 1 second time span after, streaming media playing just will appear blank, it is, Streaming Media There is Caton in live streaming.

If the data volume of streamed audio data increases suddenly after network congestion.For example, streamed audio data Data volume be the corresponding data volume of 5s time span because the corresponding data volume of 5s time span be greater than 3 seconds time spans Corresponding data volume, network will voluntarily select to compress, and discard the extra corresponding data volume of 2 seconds time spans, therefore just The corresponding data of 2 seconds time spans are not cached, equipment does not just receive stream medium data amount, and such streaming media playing occurs Breakpoint, it is, Caton occurs in live streaming media.

After network recovery, the data volume of streamed audio data is exactly equal to or is less than former data according to each The upper limit value for the data volume that the data buffer zone of buffer area can accommodate plays out, and live streaming media is just not in Caton.

Specifically, illustrative, when writing code or encoder encodes, the timestamp that data packet is written in encoder occurs Mistake.Assuming that normal time stamp should be configured according to solution code frequency, a data per second.For example, the 1st second correspondence one A data packet 1, one data packet 2 of the 2nd second correspondence, one data packet 3 of the 3rd second correspondence, one data packet the 4, the 5th of the 4th second correspondence A second corresponding data packet 5；

Assuming that the predetermined time period of setting is 5 seconds, that is, equipment can just receive this 5 data packets in 5 seconds. But transmission process when the error occurs, one data packet 1 of the 1st second correspondence, one data packet 2 of the 3rd second correspondence, the 5th second correspondence One data packet 3, one data packet 4 of the 7th second correspondence, one data packet 5 of the 9th second correspondence.In this way in later period actual transmissions, pass The timestamp of transmission of data will elongated be 7 seconds.Therefore, the time span of network actual transmissions is greater than data packet normal time stamp The time span of transmission has sent data packet 1, data packet 2 and data packet 3 then when by the 5th second altogether, but 4 sum number of data packet It issues according to packet 5 and not in time, these data packets 4 and data packet for being issued not in time in the time span of normal time stamp transmission 5, pursuit repeating transmission is carried out after network recovery, then decoding end can not decode 4 sum number of data packet sent out not in time in 5 seconds According to packet 5, so that live streaming media will appear Caton.

The preset condition shows the ratio for the data volume that the data volume of streamed audio data and data buffer zone can accommodate It is to judge whether the data volume of streamed audio data surpasses on the basis of the data volume that data buffer zone can accommodate compared with relationship The upper limit value for the data volume that data buffer zone can accommodate out, it is, the data that can be accommodated with the presence or absence of data buffer zone The relationship that the data of amount are overflowed；Using this relationship, shows that calculated playing duration is less than or greater than in the comparison result and be somebody's turn to do When predetermined time period, it can be determined that overflowed in the data for the data volume that data buffer zone can accommodate, determine live streaming media There is Caton.Alternatively,

Judge whether the data volume of streamed audio data reaches the lower limit value for the data volume that data buffer zone can accommodate, With the presence or absence of the not no relationship of data in data buffer zone.Using this relationship, show calculated broadcasting in the comparison result When duration is less than or greater than the predetermined time period, and when lower limit value is zero, in data buffer zone, the data volume of caching is zero When, determine that Caton occurs in live streaming media.

Using the embodiment of the present invention, whether data are overflowed and Streaming Media sound for the data volume that can be accommodated by data buffer zone The comparison of the data volume of frequency evidence, alternatively, whether being zero and streamed audio by the data volume that data buffer zone caches The comparison of the data volume of data, come can accurately judge live streaming media whether Caton.

Optionally, in a kind of specific implementation, when comparison result shows that calculated playing duration is greater than default Between length when, whether the above-mentioned data volume for judging the streamed audio data meets preset condition, judges that live streaming media is The step of no Caton includes:

Judge whether the data volume of the acquired streamed audio data of the predetermined time period is greater than data buffering The data volume that Qu Suoneng is accommodated.

When playing duration is greater than the predetermined time period, it is known that equipment does not receive still after predetermined time period reaches To streamed audio data are completed, it is likely to result in live streaming media and occurs streamed audio data driven or stream in the process The problem of media data is retransmitted.

Illustratively, it is assumed that the first time in the streamed audio data of acquisition in first packets of audio data stabs DS and is In 14 points of Monday 02 minute and 09 second on May 26th, 2017, the second timestamp DE in the last one packets of audio data is in May, 2017 14 points of Monday on the 26th 02 minute and 12 seconds, first audio number was subtracted using the second timestamp DE in the last one packets of audio data Obtaining the absolute value of difference according to the first time stamp DS in packet is 3 seconds, is used as above-mentioned playing duration for this 3 seconds.

Assuming that predetermined time period is 2 seconds, it is 2017 that equipment, which receives the system timestamp in first packets of audio data, 14 points of Monday 02 minute and 08 second on May 26, is 02 minute and 09 second 14 points of Monday on May 26th, 2017 in system timestamp and is Timestamp of uniting is 14 points of Monday on May 26th, 2,017 02 minute and 10 seconds, equipment still receive the last one packets of audio data with Packets of audio data between first packets of audio data, equipment are not received by the last one packets of audio data, it may be possible to network Stream medium data it is excessive, equipment is not timely received the last one packets of audio data, it is also possible to which network will be selected voluntarily Compression is selected, the last one packets of audio data of 1 second extra time span is discarded, such stream medium data will retransmit this most The latter packets of audio data.

When comparison result shows that calculated playing duration is greater than predetermined time period, at this time need to know default item The comparison for the data volume that the data volume of streamed audio data indicated by part and data buffer zone can accommodate, equipment ability It is enough accurately carry out live streaming media whether the judgement of Caton.

Here comparison result shows that calculated playing duration is greater than predetermined time period, and equipment has received than theory It is worth more streamed audio data, may occurs Caton before this, these is more than the streamed audio number of theoretical value It, should be more than the stream of theoretical value according to the data that network congestion before being issues not in time, and after network congestion restores normal Media audio data driven is retransmitted, therefore the case where playing duration is greater than predetermined time period occurs.

Here whether meet preset condition, illustrate more than theoretical value streamed audio data driven retransmit when, need Judge to pursue whether the streamed audio data retransmitted are in the data volume that data buffer zone can accommodate, to utilize The preset condition can accurately judge whether live streaming media Caton occurs.

If the data volume of the acquired streamed audio data of the predetermined time period is greater than data buffer zone institute energy The data volume of receiving determines live streaming media Caton.

Here the data volume of acquired streamed audio data is greater than the data volume that data buffer zone can accommodate, can Know that streamed audio data have had exceeded the data volume that data buffer zone can accommodate, it may appear that media audio data overflow number The case where according to buffer area, and the problem of the data for occurring overflowing are abandoned by network, live streaming media Caton is determined at this time.

If the data volume of the acquired streamed audio data of the predetermined time period is less than or equal to data buffering The data volume that Qu Suoneng is accommodated determines the non-Caton of live streaming media.

Here the data volume of acquired streamed audio data is less than or equal to the number that data buffer zone can accommodate According to amount, it is known that the data volume of streamed audio data is in the data volume legal range that data buffer zone can accommodate, both not It loses in transmission process, is also dropped without departing from buffer area, determine the non-Caton of live streaming media.

Here the data volume that data buffer zone can accommodate includes the upper limit value of the data volume of data buffer zone, Huo Zhegen The data volume that can be accommodated according to the data buffer zone that user demand is arranged.The data volume that the data buffer zone can accommodate can be According to user's long term test, a default value is obtained, the data volume which can be accommodated as data buffer zone, Thus can be when the data volume of streamed audio data be greater than the default value, there is live streaming media Caton in judgement, more Subtly determine the accuracy of live streaming media Caton.

In order to mitigate data transmission pressure caused by network, optionally, in a kind of specific implementation, if sentencing When Caton is broadcast live in streaming media, the judgment method of the live streaming media Caton further include: determine and overflow the data buffer zone Data volume deletes the data volume overflowed.

Compared at present according to dynamic menu or tableaux, the selection of progress Video coding frame per second, that is, except video is compiled Code frame per second is also divided into constant and dynamic, Video coding frame per second to can be VFR (Variable Frame Rate, variable frame rate) Encryption algorithm, it is similar with VBR.As the degree of picture dynamic change is different, encoder, which can encode, generates different frame per second, such as dynamic Higher video frame rate is used under state picture, lower video frame rate is used under tableaux, in this way for saving Video coding Document size have larger help, but if second preset threshold will be configured according to user demand as comparing ginseng Number may have the video frame rate less than second preset threshold compared with video frame rate.This is less than the second default threshold The video frame rate of value can be judged as live streaming media Caton occurred.But actual conditions are, should be less than second preset threshold Video frame rate, only illustrate the tableaux for having occurred more, live streaming media Caton might not be will appear.It selects in this way Video coding frame per second, do not identify out the situation, may determine that Caton occurs in live streaming media.

Stream is utilized when comparison result shows that calculated playing duration is greater than predetermined time period using the present embodiment Whether the comparison for the data volume that the data volume of media audio data and data buffer zone can accommodate, judge live streaming media Caton, improve judge live streaming media whether the accuracy of Caton, need not move through picture dynamically change setting compare Parameter reduces the difficulty of the suitable relatively parameter of setting.

In order to accurately detect whether live streaming media Caton occurs, in a kind of specific implementation, comparing The result shows that calculated playing duration be less than predetermined time period when, judge the streamed audio data data volume whether Meet preset condition, judge live streaming media whether Caton the step of include:

Judge whether the data volume cached in the data buffer zone is zero, and the number of acquired streamed audio data It whether is zero according to amount.

When comparison result shows that calculated playing duration is less than predetermined time period, at this time need to know default item The comparison of the data volume of streamed audio data indicated by part and the data volume of data buffer zone caching, equipment can be quasi- Really carry out live streaming media whether the judgement of Caton.

If judging, the data volume cached in data buffer zone is zero, and the data volume of acquired streamed audio data is Zero, determine live streaming media Caton.

If judging, the data volume cached in data buffer zone is greater than zero, and the data volume of acquired streamed audio data Greater than zero, the non-Caton of live streaming media is determined.

Here comparison result shows that calculated playing duration is less than predetermined time period, it is known that equipment has received ratio The streamed audio data also to be lacked of theoretical value need to judge again whether the data volume cached in data buffer zone is zero, in number Data volume according to buffer cache is not empty (that is, the data volume cached in data buffer zone is not zero), illustrates data buffer zone Streamed audio data are had, decoding end is had no effect on and decodes the streamed audio data, therefore, it is determined that live streaming media does not block ?；

It is sky in the data volume of the caching of data buffer zone, and is not receiving streamed audio data (that is, acquired The data volumes of streamed audio data be zero), therefore, it is determined that live streaming media Caton.

With utilizing the video data in stream medium data judge that live streaming media whether compared with Caton, is applied in the prior art The embodiment of the present invention, streamed audio data according to an embodiment of the present invention determine live streaming media Caton, evade well The problem of direct interference brought by this existing judgement, can realize the Caton for more accurately determining live streaming media.

As shown in figure 3, the equipment for applying receiving stream media during live streaming media can receive for stream medium data End.The process of the live streaming media process of the embodiment of the present invention is as follows:

Step 301, live streaming media starts；

Step 302, the streamed audio data in signal acquisition coding side acquisition stream medium data；

Step 303, the streamed audio data in signal acquisition coding side coding compression Streaming Media.This has streamed audio There is duration, wherein the duration includes initial time stamp and ending time stamp, it is, by the in the stream medium data of data Second timestamp of the first time stamp DS of one packets of audio data as initial time stamp and the last one packets of audio data DE is as ending time stamp；

Step 304, signal acquisition coding side, which is sent, encodes compressed stream medium data；

Step 305, stream medium data receiving end, which receives, encodes compressed stream medium data, and predetermined time period TI is arranged And the data quantity C L that data buffer zone can accommodate；

Step 306, stream medium data receiving end records the first time stamp DS in first packets of audio data；

Streamed audio data in stream medium data are transmitted by packets of audio data.

Step 307, stream medium data receiving end records the second timestamp DE and record in the last one packets of audio data The total amount of data DL of packets of audio data；

The total amount of data DL of above-mentioned packets of audio data can be the data volume for recording each packets of audio data, by all audios What the data volume of data packet was added, wherein all data packets include: first packets of audio data, the last one audio number According to corresponding all intermediate audio packs between packet and first packets of audio data and the last one packets of audio data.

Step 308, stream medium data receiving end calculates | DE-DS |=DD, wherein | DE-DS | it can refer to for the second time Stamp DE subtracts the absolute value of the difference for stabbing DS at the first time, or stamp DS subtracts the absolute of the difference of the second timestamp DE at the first time Value, and judge data quantity C L, audio data that the absolute value DD, predetermined time period TI, data buffer zone of difference can be accommodated The relationship of the total amount of data DL of packet.

Here playing duration of the absolute value DD of difference as acquired streamed audio data.

Step 309, stream medium data receiving end judges whether the absolute value DD of difference is equal to predetermined time period TI；If It is when illustrating DD=TI, to then follow the steps 310；If not, and when DD < TI, 311 are thened follow the steps, alternatively, if not, and DD When > TI, 313 are thened follow the steps.

Step 310, live streaming media is determined without Caton, until executing step 314.

Step 311, whether the total amount of data DL of audio data packet is greater than zero；If so, illustrating DL=0, step is executed 310；If it is not, illustrating DL=< 0, step 312 is executed.

Step 312, determine live streaming media Caton, execute step 314.

Step 313, whether the total amount of data DL of audio data packet is less than or equal to what data buffer zone can accommodate Data quantity C L thens follow the steps 310 if so, illustrating DL=< CL；If not, data buffer zone has excessive when illustrating DL > CL Out, 312 are thened follow the steps.

Step 314, live streaming media terminates.

Stream medium data can be transferred to stream medium data receiving end by many links from signal acquisition coding side, due to Stream medium data has the characteristic of real-time Transmission, has very high requirement for network quality, can frequently encounter live streaming media The problem of similar influence viewing experience such as Caton.It can not accurately determine to flow matchmaker currently based on the technology of existing Video coding Caton is broadcast live in body, and uses the audio decoding techniques based on the embodiment of the present invention, can accurately judge that live streaming media is No Caton avoids the brought problem of technology of above-mentioned Video coding by the square.So the Streaming Media using the embodiment of the present invention is straight The judgment method for broadcasting Caton is tested by the streamed audio data streams medium living broadcast Caton situation in stream medium data It is very important with analysis.

As shown in figure 4, applying the embodiment of the invention provides a kind of judgment means of live streaming media Caton in Streaming Media The equipment of receiving stream media, above-mentioned apparatus include: during live streaming

Module 401 is obtained, the streamed audio data in stream medium data for obtaining predetermined time period calculate institute The playing duration of the streamed audio data of acquisition；

Compare and obtain module 402, for calculated playing duration to be compared with above-mentioned predetermined time period, obtains One comparison result；

Judgment module 403, for according to above-mentioned comparison result, judge live streaming media whether Caton.

The judgment means of live streaming media Caton provided in an embodiment of the present invention, by the stream matchmaker for obtaining predetermined time period Streamed audio data in volume data calculate the playing duration of acquired streamed audio data, compare streamed audio Data playback duration and predetermined time period obtain a comparison result, thus judge live streaming media whether Caton.It eliminates in this way Using the erroneous judgement of the video data detection Caton in Streaming Media, it can accurately judge whether Streaming Media occurs Caton.It is rear Continuous adjustment video fluency makees basis, after the later period effectively adjusts video fluency, improves user experience effect.

The embodiment of the invention also provides a kind of equipment of receiving stream media during live streaming media, including processor And memory, memory, for storing computer program；

Processor when for executing the program stored on memory, realizes following steps:

Calculated playing duration is compared with the predetermined time period, obtains a comparison result；

According to the comparison result, judge live streaming media whether Caton.

As shown in figure 5, the embodiment of the invention also provides a kind of equipment of receiving stream media during live streaming media, Including processor 501, communication interface 502, memory 503 and communication bus 504, wherein processor, communication interface, memory Mutual communication is completed by bus,

Memory 503, for storing computer program；

Processor 501 when for executing the program stored on memory, realizes following steps:

According to the comparison result, judge live streaming media whether Caton.

The communication bus that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral Component Interconnect, PCI) bus or expanding the industrial standard structure (Extended Industry Standard Architecture, EISA) bus etc..The communication bus can be divided into address bus, data/address bus, control bus etc..For just It is only indicated with a thick line in expression, figure, it is not intended that an only bus or a type of bus.

Communication interface is for the communication between above-mentioned electronic equipment and other equipment.

Memory may include random access memory (Random Access Memory, RAM), also may include non-easy The property lost memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory may be used also To be storage device that at least one is located remotely from aforementioned processor.

Above-mentioned processor can be general processor, including central processing unit (Central Processing Unit, CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital Signal Processing, DSP), it is specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing It is field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete Door or transistor logic, discrete hardware components.

The equipment of the receiving stream media provided in an embodiment of the present invention during live streaming media, by obtaining preset time Streamed audio data in the stream medium data of length calculate the playing duration of acquired streamed audio data, compare Streamed audio data playback duration and predetermined time period obtain a comparison result, to judge whether live streaming media blocks ?.The erroneous judgement using the video data detection Caton in Streaming Media is eliminated in this way, can accurately judge whether Streaming Media goes out Existing Caton.Make basis for subsequent adjustment video fluency, after the later period effectively adjusts video fluency, improves user experience Effect.

The embodiment of the invention also provides a kind of computer readable storage medium, the computer readable storage medium memory Computer program is contained, the computer program realizes following steps when being executed by processor:

According to the comparison result, judge live streaming media whether Caton.

The problem of the most common influence spectators' viewing experience is exactly Caton during live streaming media, but Caton is hair It gives birth to the problem of a kind of mankind of operation layer can perceive, and for providing the net of base support for transmission of flow media data For network, server and application program, the indexs such as speed, integrality of the stream medium data in transmission process can only be perceived, If can be accurately associated with the quality index of transportation level with the quality index of service layer, i.e., application program can lead to The mass change of analysis transmission of flow media data is crossed to determine whether being likely to occur Caton, it is straight that raising Streaming Media will be remarkably contributing to The service quality broadcast.

Therefore, the embodiment of the present invention is provided in a kind of judgment method of live streaming media Caton, applies in current complexity Internet stream media is broadcast live in framework, is the full link Caton investigation analysis of live streaming of multi-stage cascade, provides important and conscientiously may be used Capable judgment method is ready to further promote live streaming media service quality for the later period.

Above-mentioned multi-stage cascade for stream medium data from signal acquisition coding side, by multiple nodes interconnected, Reach stream medium data receiving end.Stream medium data receiving end streaming media live data is decoded.For example, O, P, Q, R this Four forward node, one in every two adjacent node can be used as transmitting terminal, another can be used as receiving end.Tool Body, when forward node O is as transmitting terminal, forward node P is as receiving end；When forward node P is as transmitting terminal, turn Node Q is sent out as receiving end；When forward node Q is as transmitting terminal, forward node R is as receiving end, each sends in this way Adjacent receiving end is held to be known as a link or a rank, then there is multiple links, multiple ranks, multiple grade Multi-stage cascade is not known as it.

Illustratively, the equipment of Beijing area sends equipment of the stream medium data to Xi'an region, the equipment of Beijing area It does not set up and is directly connected to the equipment of Xi'an region, but by distribution network, the equipment of Beijing area sends stream medium data Extremely, the transit node equipment established with the equipment of In Shanxi Area and the equipment of Beijing area, then sets transit node The equipment that the stream medium data of standby forwarding is then forwarded to Xi'an region, in so avoiding the equipment of Beijing area and Xi'an The equipment foundation in area is directly connected to be formed by link and there is a problem of unstable, and the reliability of transmission, Er Qieke can be improved To have checked stream medium data and be transmitted across in multi-stage cascade using the judgment method of the live streaming media Caton of the embodiment of the present invention Caton in journey.

The embodiment of the invention provides a kind of computer program products comprising instruction, when run on a computer, So that computer executes the step of judgment method of above-mentioned live streaming media Caton.

The embodiment of the invention provides a kind of computer programs, when run on a computer, so that computer executes The step of judgment method of above-mentioned live streaming media Caton.

For device/equipment/storage medium embodiment/computer program product/computer program comprising instruction, Since it is substantially similar to the method embodiment, so being described relatively simple, related place is said referring to the part of embodiment of the method It is bright.

It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that There is also other identical elements in process, method, article or equipment including the element.

Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device/ For equipment/storage medium embodiment/computer program product/computer program embodiments comprising instruction, since it is basic It is similar to embodiment of the method, so being described relatively simple, the relevent part can refer to the partial explaination of embodiments of method.

The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention It is interior.

Claims

1. a kind of judgment method of live streaming media Caton, which is characterized in that apply receiving stream matchmaker during live streaming media The equipment of body, which comprises

The streamed audio data in the stream medium data of predetermined time period are obtained, acquired streamed audio data are calculated Playing duration；

According to the comparison result, judge live streaming media whether Caton.

2. the method according to claim 1, wherein in the stream medium data for obtaining predetermined time period Streamed audio data, the step of calculating the playing duration of acquired streamed audio data include:

Obtain the streamed audio data in the stream medium data of the predetermined time period；

Record the first time stamp in first packets of audio data of the predetermined time period；

Record the second timestamp in the last one packets of audio data of the predetermined time period；

When calculating first in the second timestamp and first packets of audio data in the last one described packets of audio data Between between stamp difference absolute value, obtain the playing duration of acquired streamed audio data.

3. judging live streaming media the method according to claim 1, wherein described according to the comparison result Whether Caton the step of include:

When the comparison result shows that calculated playing duration is equal to the predetermined time period,

Determine the non-Caton of live streaming media.

4. judging live streaming media the method according to claim 1, wherein described according to the comparison result Whether Caton the step of include:

When the comparison result shows that calculated playing duration is less than or greater than the predetermined time period,

Judge whether the data volume of the streamed audio data meets preset condition, judge live streaming media whether Caton, In, the preset condition shows the comparison of the data volume of the streamed audio data and the data volume of data buffer zone.

5. according to the method described in claim 4, it is characterized in that,

When the comparison result shows that calculated playing duration is greater than the predetermined time period,

Whether the data volume for judging the streamed audio data meets preset condition, judge live streaming media whether Caton The step of include: to judge whether the data volume of the acquired streamed audio data of the predetermined time period is greater than the number According to the data volume that buffer area can accommodate,

If the data volume of the acquired streamed audio data of the predetermined time period is greater than data buffer zone institute energy The data volume of receiving determines live streaming media Caton；

If the data volume of the acquired streamed audio data of the predetermined time period is less than or equal to the data buffering The data volume that Qu Suoneng is accommodated determines the non-Caton of live streaming media.

6. according to the method described in claim 5, it is characterized in that, if judging live streaming media Caton, the method also includes:

It determines the data volume for overflowing the data buffer zone, the data volume overflowed is deleted.

7. according to the method described in claim 4, it is characterized in that,

When the comparison result shows that calculated playing duration is less than the predetermined time period,

Whether the data volume for judging the streamed audio data meets preset condition, judge live streaming media whether Caton The step of include: to judge whether the data volume cached in the data buffer zone is zero, and acquired streamed audio data Data volume whether be zero,

If the data volume cached in the data buffer zone is zero, and the data volume of acquired streamed audio data is zero, Determine live streaming media Caton；

If the data volume cached in the data buffer zone is greater than zero, and the data volume of acquired streamed audio data is greater than Zero, determine the non-Caton of live streaming media.

8. a kind of judgment means of live streaming media Caton, which is characterized in that apply receiving stream matchmaker during live streaming media The equipment of body, described device include:

Obtain module, the streamed audio data in stream medium data for obtaining predetermined time period calculate acquired The playing duration of streamed audio data；

Compare acquisition module, for calculated playing duration to be compared with the predetermined time period, obtains one and compare As a result；

Judgment module, for according to the comparison result, judge live streaming media whether Caton.

9. device according to claim 8, which is characterized in that the acquisition module includes:

First obtains module, the streamed audio data in stream medium data for obtaining the predetermined time period；

First logging modle, the first time stamp in first packets of audio data for recording the predetermined time period；

Second logging modle, the second timestamp in the last one packets of audio data for recording the predetermined time period；

It calculates and obtains module, for calculating the second timestamp and first audio in the last one described packets of audio data The absolute value of difference, obtains the playing duration of acquired streamed audio data between first time stamp in data packet.

10. device according to claim 8, which is characterized in that the judgment module includes:

First judging submodule, for showing that calculated playing duration is equal to the predetermined time period in the comparison result When, determine the non-Caton of live streaming media.

11. device according to claim 8, which is characterized in that the judgment module includes:

Second judgment submodule, for when the comparison result shows that calculated playing duration is less than or greater than described default Between length when, judge whether the data volume of the streamed audio data meets preset condition, judge whether live streaming media blocks , wherein the preset condition shows the data volume of the streamed audio data compared with the data volume of data buffer zone Relationship.

12. device according to claim 11, which is characterized in that

The second judgment submodule is specifically used for: it is described default to show that calculated playing duration is greater than in the comparison result When time span, judge whether the data volume of the acquired streamed audio data of the predetermined time period is greater than the number According to the data volume that buffer area can accommodate,

13. device according to claim 12, which is characterized in that described device further include:

Removing module deletes the data volume overflowed for determining the data volume for overflowing the data buffer zone.

14. device according to claim 11, which is characterized in that

The second judgment submodule is specifically used for: it is described default to show that calculated playing duration is less than in the comparison result When time span, judge whether the data volume cached in the data buffer zone is zero, and acquired streamed audio data Data volume whether be zero,

15. a kind of equipment of receiving stream media during live streaming media, which is characterized in that including processor and memory, The memory, for storing computer program；

The processor when for executing the program stored on the memory, realizes side as claimed in claim 1 to 7 Method step.

16. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium Program, the computer program realize method and step as claimed in claim 1 to 7 when being executed by processor.