CN113132759A - Method, device, server, system and storage medium for determining video playing time delay - Google Patents

Method, device, server, system and storage medium for determining video playing time delay Download PDF

Info

Publication number
CN113132759A
CN113132759A CN201911396172.4A CN201911396172A CN113132759A CN 113132759 A CN113132759 A CN 113132759A CN 201911396172 A CN201911396172 A CN 201911396172A CN 113132759 A CN113132759 A CN 113132759A
Authority
CN
China
Prior art keywords
video
determining
frame
playing
fixed field
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911396172.4A
Other languages
Chinese (zh)
Inventor
吕万
高爱丽
刘阳
杨晓青
赵旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Group Beijing Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Group Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Group Beijing Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201911396172.4A priority Critical patent/CN113132759A/en
Publication of CN113132759A publication Critical patent/CN113132759A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26208Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
    • H04N21/26241Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the time of distribution, e.g. the best time of the day for inserting an advertisement or airing a children program

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention discloses a method, a device, a server, a system and a storage medium for determining video playing delay. The method for determining the video playing time delay is applied to a server and comprises the following steps: receiving a video acquisition request sent by a user terminal; determining a first moment for receiving the video acquisition request and a data volume required by rendering and playing a first frame of the video based on the video acquisition request; sending data to the user terminal according to the video acquisition request, and determining a second moment when the accumulated data volume is not less than the data volume required by the rendering and playing of the first frame of the video; and determining the video play-starting time delay by using the first time and the second time. According to the embodiment of the invention, the video play-starting time delay can be determined more simply, so that the method and the device have universality and increase application scenes.

Description

Method, device, server, system and storage medium for determining video playing time delay
Technical Field
The invention belongs to the technical field of wireless communication, and particularly relates to a method, a device, a server, a system and a computer storage medium for determining video playing delay.
Background
With the popularization of Long Term Evolution (LTE) 4G services, mobile internet videos become killer-class services of 4G, and while mobile users fully enjoy the high-rate characteristics brought by LTE, video service quality will be the most direct means for users to investigate the applicability of LTE networks. Various user perception indexes caused by video playing carried on an LTE network are key bases for a network optimization maintenance engineer to evaluate user use perception experience and discover network problems in time, especially for Application programs (APP) such as 'jittering sound', 'watermelon' and 'volcano' with the most video flow in the existing network, the videos uniformly adopt an MP4 (which is a set of compression coding standards for audio and video information) format, the characteristics are short videos with the time duration of more than 95% within 15s, and for the videos, the 'playing delay' index is the most direct feedback of user use perception, so that a method capable of accurately determining video playing delay from a network side is needed.
At present, the video playing delay determination methods mainly include the following methods: the method comprises the following steps: by obtaining the rule of embedding code from APP development company. The method 2 comprises the following steps: software Development Kit (SDK) implantation is performed through APP. However, method 1 requires APP development companies to provide relevant feature code plaintext rules, and feature codes may change from time to time; the method 2 can only implant a software development kit into software for APP developed by a company. In a word, the video playing delay determining method in the prior art is complex in operation, has no universality and has few application scenes.
Therefore, how to determine the video start-up delay more simply, and further have universality and increase application scenarios is a technical problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
The embodiment of the invention provides a method, a device, a server, a system and a computer storage medium for determining video play-out delay, which can determine the video play-out delay more simply, thereby having universality and increasing application scenes.
In a first aspect, a method for determining a video play-out delay is provided, which is applied to a server, and includes:
receiving a video acquisition request sent by a user terminal;
determining a first moment for receiving the video acquisition request and a data volume required by rendering and playing a first frame of the video based on the video acquisition request;
sending data to the user terminal according to the video acquisition request, and determining a second moment when the accumulated data volume is not less than the data volume required by the rendering and playing of the first frame of the video;
and determining the video play-starting time delay by using the first time and the second time.
Optionally, determining, based on the video obtaining request, a first time for receiving the video obtaining request and a data amount required for rendering and playing a first frame of the video, includes:
analyzing the video acquisition request, and determining a first fixed field, a second fixed field and a third fixed field;
recording the time point of the data packet where the first fixed field is located, and taking the time point as a first moment;
and determining the data volume required by the rendering and playing of the first frame of the video based on the second fixed field and the third fixed field.
Optionally, determining, based on the second fixed field and the third fixed field, an amount of data required for rendering and playing the first frame of the video, including:
determining video first frame data size information based on the second fixed field;
determining video first frame offset position information based on the third fixed field;
and determining the data volume required by the rendering and playing of the first frame of the video based on the size information of the first frame data of the video and the offset position information of the first frame of the video.
Optionally, the method for determining the video start-up delay further includes:
analyzing the video acquisition request and determining a fourth fixed field;
based on the fourth fixed field, video frame number information is determined.
Optionally, after determining that the accumulated data amount is not less than a second time when the data amount required for playing the first frame of the video in the rendering process is determined, the method further includes:
determining the data volume required by the rendering and playing of the second frame of the video based on the video acquisition request;
and sending data to the user terminal according to the data volume required by the second frame rendering and playing of the video until the accumulated data volume is not less than the data volume required by the second frame rendering and playing of the video.
In a second aspect, there is provided a video play-out delay determining apparatus, applied to a server, including:
the receiving module is used for receiving a video acquisition request sent by a user terminal;
the first determining module is used for determining a first moment for receiving the video obtaining request and the data volume required by the rendering and playing of a first frame of the video based on the video obtaining request;
the second determining module is used for sending data to the user terminal according to the video obtaining request and determining a second moment when the accumulated data volume is not less than the data volume required by the rendering and playing of the first frame of the video;
and the third determining module is used for determining the video play-starting time delay by utilizing the first time and the second time.
Optionally, the first determining module is configured to parse the video obtaining request and determine a first fixed field, a second fixed field, and a third fixed field; recording the time point of the data packet where the first fixed field is located, and taking the time point as a first moment; and determining the data volume required by the rendering and playing of the first frame of the video based on the second fixed field and the third fixed field.
Optionally, the first determining module is configured to determine size information of first frame data of the video based on the second fixed field; determining video first frame offset position information based on the third fixed field; and determining the data volume required by the rendering and playing of the first frame of the video based on the size information of the first frame data of the video and the offset position information of the first frame of the video.
Optionally, the first determining module is further configured to parse the video obtaining request, and determine a fourth fixed field; based on the fourth fixed field, video frame number information is determined.
Optionally, the second determining module is further configured to determine, based on the video obtaining request, a data amount required for rendering and playing a second frame of the video; and sending data to the user terminal according to the data volume required by the second frame rendering and playing of the video until the accumulated data volume is not less than the data volume required by the second frame rendering and playing of the video.
In a third aspect, a server is provided, which includes: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements the video playout delay determination method of the first aspect.
In a fourth aspect, a video start-up delay determination system is provided, and the video start-up delay determination system includes the server and the user terminal in the third aspect.
In a fifth aspect, a computer storage medium is provided, on which computer program instructions are stored, which when executed by a processor implement the video playout delay determination method of the first aspect.
The method, the device, the server, the system and the storage medium for determining the video start-up broadcasting delay can determine the video start-up broadcasting delay more simply, so that the method, the device, the server and the system have universality and increase application scenes. The video playing time delay determining method is applied to a server, and after a video obtaining request sent by a user terminal is received, a first moment for receiving the video obtaining request and the data volume required by the first frame rendering playing of the video are determined based on the video obtaining request; then, sending data to the user terminal according to the video acquisition request, and determining a second moment when the accumulated data volume is not less than the data volume required by the rendering and playing of the first frame of the video; and finally, determining the video play-starting time delay by using the first time and the second time. Therefore, the method can determine the video playing start delay more simply as long as the first moment of receiving the video obtaining request and the second moment of not less than the data amount required by the video first frame rendering playing are determined, and further has universality and application scenes are increased.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the embodiments of the present invention will be briefly described below, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a method for determining a video start-up delay according to an embodiment of the present invention;
fig. 2 is a schematic view of a video playing process according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating specific fields and required values according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating another specific field and required values provided by an embodiment of the present invention;
FIG. 5 is a diagram illustrating another specific field and required values provided by an embodiment of the present invention;
FIG. 6 is a diagram illustrating a time point and specific fields provided by an embodiment of the present invention;
FIG. 7 is a schematic diagram of a point in time provided by an embodiment of the present invention;
fig. 8 is a schematic flowchart of a method for determining a start-up delay of an MP4 video according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a video start-up delay determining apparatus according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a server according to an embodiment of the present invention.
Detailed Description
Features and exemplary embodiments of various aspects of the present invention will be described in detail below, and in order to make objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present invention by illustrating examples of the present invention.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
At present, the video playing delay determination methods mainly include the following methods: the method comprises the following steps: by obtaining the rule of embedding code from APP development company. The method 2 comprises the following steps: software Development Kit (SDK) implantation is performed through APP. However, method 1 requires APP development companies to provide relevant feature code plaintext rules, and feature codes may change from time to time; the method 2 can only implant a software development kit into software for APP developed by a company. In a word, the video playing delay determining method in the prior art is complex in operation, has no universality and has few application scenes.
In order to solve the problem of the prior art, embodiments of the present invention provide a method, an apparatus, a server, a system, and a computer storage medium for determining a video start-up delay. First, a method for determining a video play-out delay according to an embodiment of the present invention is described below.
Fig. 1 is a schematic flowchart of a method for determining a video start-up delay according to an embodiment of the present invention. The method for determining the video start-up playing delay is applied to a server, and as shown in fig. 1, the method for determining the video start-up playing delay comprises the following steps:
s101, receiving a video acquisition request sent by a user terminal.
S102, determining a first moment for receiving the video acquisition request and a data volume required by rendering and playing a first frame of the video based on the video acquisition request.
In order to more accurately determine the data amount required for the first time and the first frame rendering and playing of the video, in one embodiment, the determining the first time for receiving the video obtaining request and the data amount required for the first frame rendering and playing of the video based on the video obtaining request may generally include: analyzing the video acquisition request, and determining a first fixed field, a second fixed field and a third fixed field; recording the time point of the data packet where the first fixed field is located, and taking the time point as a first moment; and determining the data volume required by the rendering and playing of the first frame of the video based on the second fixed field and the third fixed field.
In order to more accurately determine the data amount required for the first frame rendering and playing of the video, in one embodiment, the determining the data amount required for the first frame rendering and playing of the video based on the second fixed field and the third fixed field may generally include: determining video first frame data size information based on the second fixed field; determining video first frame offset position information based on the third fixed field; and determining the data volume required by the rendering and playing of the first frame of the video based on the size information of the first frame data of the video and the offset position information of the first frame of the video.
In addition, in one embodiment, the method for determining the video play-out delay further includes: analyzing the video acquisition request and determining a fourth fixed field; based on the fourth fixed field, video frame number information is determined.
S103, sending data to the user terminal according to the video acquisition request, and determining a second moment when the accumulated data volume is not less than the data volume required by the first frame rendering and playing of the video.
In order to satisfy the continuous playing of the video of the user terminal, in one embodiment, after determining that the accumulated data amount is not less than the second time when the data amount required by the first frame of the video for rendering and playing is not less than the first frame of the video, the method may further include: determining the data volume required by the rendering and playing of the second frame of the video based on the video acquisition request; and sending data to the user terminal according to the data volume required by the second frame rendering and playing of the video until the accumulated data volume is not less than the data volume required by the second frame rendering and playing of the video.
And S104, determining the video play-starting time delay by using the first time and the second time.
The video playing time delay determining method is applied to a server, and after a video obtaining request sent by a user terminal is received, a first moment for receiving the video obtaining request and the data volume required by the first frame rendering playing of the video are determined based on the video obtaining request; then, sending data to the user terminal according to the video acquisition request, and determining a second moment when the accumulated data volume is not less than the data volume required by the rendering and playing of the first frame of the video; and finally, determining the video play-starting time delay by using the first time and the second time. Therefore, the method can determine the video playing start delay more simply as long as the first moment of receiving the video obtaining request and the second moment of not less than the data amount required by the video first frame rendering playing are determined, and further has universality and application scenes are increased.
The above contents are described below with a specific embodiment, which is as follows:
the first fixed field in the embodiment of the present invention is "66747970" fixed field (resolved into ftyp); the second fixed field is the "7374737 a" fixed field (resolved to stsz); the third fixed field is "7374636 f" fixed field (parsed into stco); the fourth fixed field is the "73747373" fixed field (resolved to stss).
First, the summary of MP4 video structure and playing principle:
currently, domestic mainstream short video APPs (buffalo, watermelon, volcano, fast-hand and the like) are short video APPs based on an MP4 format. MP4 is a set of compression coding standards for audio and video information, which is established by the international organization for standardization (ISO) and the "Moving Picture Experts Group" (MPEG) under the International Electrotechnical Commission (IEC), and all data in an MP4 file is contained in a box, i.e., an MP4 file is composed of several boxes, each of which has a type and a length, and can be understood as a data object block; another box may be included in the box, which is called a container box. An MP4 file will first have and only have one "ftyp" type box, which acts as a flag for MP4 format and contains some information about the file; there will be and only one "moov" type box (movie box) later, which is a container box, and the sub-box contains metadata information of the media; the media Data of the MP4 file is contained in a box (midia Data box) of the "mdat" type, which is also a container box, and there may be a plurality of boxes or none (when the media Data all refer to other files), and the structure of the media Data is described by metadata.
Secondly, the video playing signaling flow overview:
when a user uses a client to play an MP4 video on line, the client requests the server for corresponding video information, the server responds to the request to issue the related information of the video, the client initiates a resource downloading request according to the obtained video downloading address, and the server responds to the resource requesting message to send corresponding video data. When the video data received by the client exceeds the initial buffering threshold, the client can start playing the video.
Thirdly, video playing delay principle:
the video start-up delay perceived by the user should be: time point when video starts playing-time point when user clicks on video.
Time when the user clicks on the video: through the research of an internet protocol and the wireshark packet capturing verification, when a user clicks a video, a GET request is synchronously initiated to a network side, wherein specific fields such as a domain name (Host: v6-dy.ixigua.com), a key field (/ video/m), a Content-Type (video/MP4) and the like are carried, so that the time point of the user clicking the video can be obtained by acquiring the time point of the GET request in the signaling interaction between the terminal and the network side.
Fourthly, the video starts to play:
the video playing process comprises the following steps: reading the next frame- > decoding- > playing- > continuously reciprocating, according to the process, after the terminal receives the complete first frame data, sending the first frame data to the player for rendering and playing, and because the parsing and the rendering are both carried out in the terminal, the time is very short and can be ignored, the terminal can be considered to receive the complete first frame data, namely the time for starting playing the video. Fig. 2 is a schematic view of a video playing process according to an embodiment of the present invention, in fig. 2, FFmpeg initialization is performed first, then a next frame is read, demultiplexing is performed to obtain an AVPacket, then the AVPacket is decoded to obtain an AVFrame, then SDL rendering display is performed, video display is refreshed, and finally the next frame is read again, and the process is repeated cyclically. Wherein, FFmpeg is a set of open source computer programs which can be used for recording and converting digital audio and video and converting the digital audio and video into streams; AVPacket is a data structure important in FFmpeg; the AVFrame is stored in the AVFrame and is the decoded original data, and in the decoding process, the AVFrame is the output of the decoder; SDL (simple DirectMedia layer) is a set of open source code cross-platform multimedia development library.
According to the structure, firstly, the frame number of the first frame is inquired through the stss, and then the size and the offset position of the first frame are inquired in the stsz and the stco respectively through the related frame numbers, so that the data volume required from the beginning of signaling interaction to the receiving of the complete first frame by the terminal can be known.
When the network side collects the signaling, each data packet interacted with the terminal has time to be doted, so when the accumulated value of the data amount received by the terminal is larger than the data amount required by the first frame, the time point of the data packet can be regarded as the time point when the video starts to play.
Fifthly, video playing delay algorithm:
taking jittered video as an example, the first "73747373" fixed field (parsed as stss) found after a GET request of a bitstream is followed by a 13 th to 16 th bit field shifted backward starting with the first byte of this field, where the field is an unfixed value, in this case the value read is "00000001" (converted to decimal value of 1), and this field is defined as stss-a field. As shown in FIG. 3, the specific field (73747373) and the desired value (00000001) are indicated in FIG. 3.
The first "7374737 a" fixed field (parsed as stsz) found after a GET request of a codestream is then followed by a "17 +4 x (" stss-a "-1)" to "20 +4 x (" stss-a "-1)" bit field (in this case, bits 17 to 20) offset backward starting with the first byte of this field, where the field is an unfixed value, in this case, the value read is "0000 b 04 d" (converted to decimal value 45133), and this field is defined as the stsz-a field. As shown in FIG. 4, the specific field (7374737 a) and the desired value (0000 b 04 d) are indicated in FIG. 4.
The first "7374636 f" fixed field (parsed as stco) found after a GET request of a codestream is then followed by a field of "13 +4 x (" stss-a "-1)" bits to "16 +4 x (" stss-a "-1)" bits (in this case 13 to 16 bits) shifted backward starting with the first byte of this field, the field at this position being an unfixed value, the value read in this case being "0000 d 78 c" (converted to decimal value 55180), and this field being defined as the stco-a field. As shown in FIG. 5, the specific field (7374636 f) and the desired value (0000 d 78 c) are indicated in FIG. 5.
The first "66747970" fixed field (resolved to ftyp) found after a GET request of a codestream is recorded, and then the time point of the data packet where this field is located is recorded, which is 2019-4-1010: 12:27.731700 in this example, and is defined as "time point a". As shown in fig. 6, time point a and specific fields (66747970) are marked in fig. 6.
The "number of packet bytes" of all downstream packets (packets sent from Source: 121.22.246.103 to Destination: 10.111.250.136 in this case) starting from "time point a" are calculated, and when the accumulated value exceeds stsz-a + stco-a (45133 + 55180-100313 as a sum of the obtained decimal values of stsz-a and stco-a), the time point of this packet is recorded as "time point B", and the value calculated for the No.148 packet shown in the lower graph in this case is 100324>100313, and thus is recorded as "time point B". As shown in fig. 7, time point B is marked in fig. 7.
The MP4 video start time delay is "time point B" - "time point a". In this case: 10:12: 28.265791-10: 12:27.731700 is 0.534091m seconds. The specific process is as shown in FIG. 8, first determining the stss-A field, then calculating two fields of stsz-A and stco-A according to the stss-A field, and determining the 'time point B' according to the result; after determining "time point a", the MP4 video start-up delay is determined based on "MP 4 video start-up delay — time point B-time point a".
The innovation point of the embodiment of the invention is based on code stream characteristic decoding, according to MP4 video format characteristics, a plurality of key fields are searched, relevant values are obtained through offset displacement and calculation, a data volume and a play-starting time point required by the play-starting of an MP4 video are obtained, and finally the play-starting time delay of the MP4 video is calculated according to the video starting time point and the play-starting time point.
An embodiment of the present invention further provides a device for determining a video start-up delay, which is applied to a server, and as shown in fig. 9, the device for determining a video start-up delay includes:
a receiving module 901, configured to receive a video acquisition request sent by a user terminal;
a first determining module 902, configured to determine, based on a video obtaining request, a first time for receiving the video obtaining request and a data amount required for rendering and playing a first frame of a video;
a second determining module 903, configured to send data to the user terminal according to the video obtaining request, and determine a second time when the accumulated data amount is not less than a data amount required for rendering and playing the first frame of the video;
a third determining module 904, configured to determine the video start-playing delay by using the first time and the second time.
Optionally, in an embodiment, the first determining module 902 is configured to parse the video obtaining request, and determine a first fixed field, a second fixed field, and a third fixed field; recording the time point of the data packet where the first fixed field is located, and taking the time point as a first moment; and determining the data volume required by the rendering and playing of the first frame of the video based on the second fixed field and the third fixed field.
Optionally, in an embodiment, the first determining module 902 is configured to determine, based on the second fixed field, size information of first frame data of the video; determining video first frame offset position information based on the third fixed field; and determining the data volume required by the rendering and playing of the first frame of the video based on the size information of the first frame data of the video and the offset position information of the first frame of the video.
Optionally, in an embodiment, the first determining module 902 is further configured to parse the video obtaining request, and determine a fourth fixed field; based on the fourth fixed field, video frame number information is determined.
Optionally, in an embodiment, the second determining module 903 is further configured to determine, based on the video obtaining request, an amount of data required for rendering and playing a second frame of the video; and sending data to the user terminal according to the data volume required by the second frame rendering and playing of the video until the accumulated data volume is not less than the data volume required by the second frame rendering and playing of the video.
Each module in the video start-up delay determining apparatus provided in fig. 9 has a function of implementing each step in the example shown in fig. 1, and achieves the same technical effect as the video start-up delay determining method shown in fig. 1, and for brevity, no further description is given here.
Fig. 10 is a schematic structural diagram of a server according to an embodiment of the present invention.
The server may include a processor 1001 and a memory 1002 storing computer program instructions.
Specifically, the processor 1001 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing an embodiment of the present invention.
Memory 1002 may include mass storage for data or instructions. By way of example, and not limitation, memory 1002 may include a Hard Disk Drive (HDD), a floppy Disk Drive, flash memory, an optical Disk, a magneto-optical Disk, magnetic tape, or a Universal Serial Bus (USB) Drive or a combination of two or more of these. Memory 1002 may include removable or non-removable (or fixed) media, where appropriate. The memory 1002 may be internal or external to the integrated gateway disaster recovery device, where appropriate. In a particular embodiment, the memory 1002 is non-volatile solid-state memory. In a particular embodiment, the memory 1002 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.
The processor 1001 implements the video playout delay determination method shown in fig. 1 by reading and executing computer program instructions stored in the memory 1002.
In one example, the server can also include a communication interface 1003 and a bus 1010. As shown in fig. 10, the processor 1001, the memory 1002, and the communication interface 1003 are connected to each other via a bus 1010 to complete communication therebetween.
The communication interface 1003 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiment of the present invention.
Bus 1010 includes hardware, software, or both to couple the components of the online data traffic billing device to each other. By way of example, and not limitation, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hypertransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus or a combination of two or more of these. Bus 310 may include one or more buses, where appropriate. Although specific buses have been described and shown in the embodiments of the invention, any suitable buses or interconnects are contemplated by the invention.
The embodiment of the invention also provides a system for determining the video start-up playing delay, which comprises the server and the user terminal shown in fig. 10.
In addition, embodiments of the present invention may be implemented by providing a computer storage medium. The computer storage medium having computer program instructions stored thereon; the computer program instructions, when executed by a processor, implement the video playout delay determination method illustrated in fig. 1.
It is to be understood that the invention is not limited to the specific arrangements and instrumentality described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the present invention.
The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the invention are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
As described above, only the specific embodiments of the present invention are provided, and it can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system, the module and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. It should be understood that the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present invention, and these modifications or substitutions should be covered within the scope of the present invention.

Claims (13)

1. A method for determining video playing time delay is applied to a server and comprises the following steps:
receiving a video acquisition request sent by a user terminal;
determining a first moment for receiving the video acquisition request and a data volume required by rendering and playing a first frame of the video based on the video acquisition request;
sending data to the user terminal according to the video acquisition request, and determining a second moment when the accumulated data volume is not less than the data volume required by the first frame rendering and playing of the video;
and determining the video play-starting time delay by using the first time and the second time.
2. The method for determining video start-up delay according to claim 1, wherein the determining, based on the video acquisition request, a first time for receiving the video acquisition request and a data amount required for rendering and playing a first frame of a video comprises:
analyzing the video acquisition request, and determining a first fixed field, a second fixed field and a third fixed field;
recording the time point of the data packet where the first fixed field is located, and taking the time point as the first moment;
and determining the data volume required by the first frame rendering and playing of the video based on the second fixed field and the third fixed field.
3. The method for determining video start-up delay according to claim 2, wherein the determining the amount of data required for rendering and playing the first frame of the video based on the second fixed field and the third fixed field comprises:
determining video first frame data size information based on the second fixed field;
determining video first frame offset location information based on the third fixed field;
and determining the data volume required by the rendering and playing of the first frame of the video based on the size information of the first frame data of the video and the offset position information of the first frame of the video.
4. The method for determining the video start-up delay according to claim 2, further comprising:
analyzing the video acquisition request and determining a fourth fixed field;
determining video frame number information based on the fourth fixed field.
5. The method according to any one of claims 1 to 4, wherein after the second time when the cumulative data amount is determined to be not less than the data amount required for the first frame of the video to render and play, further comprising:
determining the data volume required by the rendering and playing of the second frame of the video based on the video acquisition request;
and sending data to the user terminal according to the data volume required by the second frame rendering and playing of the video until the accumulated data volume is not less than the data volume required by the second frame rendering and playing of the video.
6. A video play-out delay determining device is applied to a server and comprises the following components:
the receiving module is used for receiving a video acquisition request sent by a user terminal;
the first determining module is used for determining a first moment for receiving the video obtaining request and a data volume required by rendering and playing a first frame of a video based on the video obtaining request;
a second determining module, configured to send data to the user terminal according to the video acquisition request, and determine a second time when an accumulated data amount is not less than a data amount required for rendering and playing a first frame of the video;
and the third determining module is used for determining the video play-starting time delay by utilizing the first time and the second time.
7. The apparatus of claim 6, wherein the first determining module is configured to parse the video obtaining request to determine a first fixed field, a second fixed field, and a third fixed field; recording the time point of the data packet where the first fixed field is located, and taking the time point as the first moment; and determining the data volume required by the first frame rendering and playing of the video based on the second fixed field and the third fixed field.
8. The apparatus of claim 7, wherein the first determining module is configured to determine video first frame data size information based on the second fixed field; determining video first frame offset location information based on the third fixed field; and determining the data volume required by the rendering and playing of the first frame of the video based on the size information of the first frame data of the video and the offset position information of the first frame of the video.
9. The apparatus of claim 7, wherein the first determining module is further configured to parse the video obtaining request to determine a fourth fixed field; determining video frame number information based on the fourth fixed field.
10. The apparatus according to any one of claims 6 to 9, wherein the second determining module is further configured to determine, based on the video obtaining request, an amount of data required for rendering and playing a second frame of a video; and sending data to the user terminal according to the data volume required by the second frame rendering and playing of the video until the accumulated data volume is not less than the data volume required by the second frame rendering and playing of the video.
11. A server, characterized in that the server comprises: a processor and a memory storing computer program instructions;
the processor, when executing the computer program instructions, implements a video playout delay determination method as claimed in any one of claims 1-5.
12. A video playout delay determination system, said video playout delay determination system comprising:
the server and user terminal of claim 11.
13. A computer storage medium having computer program instructions stored thereon, which when executed by a processor implement the video playout delay determination method of any one of claims 1-5.
CN201911396172.4A 2019-12-30 2019-12-30 Method, device, server, system and storage medium for determining video playing time delay Pending CN113132759A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911396172.4A CN113132759A (en) 2019-12-30 2019-12-30 Method, device, server, system and storage medium for determining video playing time delay

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911396172.4A CN113132759A (en) 2019-12-30 2019-12-30 Method, device, server, system and storage medium for determining video playing time delay

Publications (1)

Publication Number Publication Date
CN113132759A true CN113132759A (en) 2021-07-16

Family

ID=76767816

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911396172.4A Pending CN113132759A (en) 2019-12-30 2019-12-30 Method, device, server, system and storage medium for determining video playing time delay

Country Status (1)

Country Link
CN (1) CN113132759A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115174924A (en) * 2022-07-20 2022-10-11 天翼数字生活科技有限公司 Set top box, video play-out delay calculation method, system, equipment and medium
CN115243030A (en) * 2022-06-14 2022-10-25 天翼数字生活科技有限公司 Terminal capability test system, method, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105183632A (en) * 2015-07-21 2015-12-23 四川长虹电器股份有限公司 Automatic testing method for video playback starting
CN105721953A (en) * 2016-04-28 2016-06-29 乐视控股(北京)有限公司 Stream media video start playing abnormity analyzing method and system
CN106162226A (en) * 2016-08-31 2016-11-23 珠海迈科智能科技股份有限公司 The transmission method of a kind of TS stream and system
CN109587517A (en) * 2018-12-07 2019-04-05 咪咕视讯科技有限公司 A kind of playback method and device, server and storage medium of multimedia file
CN109697156A (en) * 2018-11-19 2019-04-30 北京奇艺世纪科技有限公司 A kind of starting time obtaining method, device, terminal device and storage medium
CN110324680A (en) * 2018-03-30 2019-10-11 腾讯科技(深圳)有限公司 A kind of video pushing method, device and server, client, storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105183632A (en) * 2015-07-21 2015-12-23 四川长虹电器股份有限公司 Automatic testing method for video playback starting
CN105721953A (en) * 2016-04-28 2016-06-29 乐视控股(北京)有限公司 Stream media video start playing abnormity analyzing method and system
CN106162226A (en) * 2016-08-31 2016-11-23 珠海迈科智能科技股份有限公司 The transmission method of a kind of TS stream and system
CN110324680A (en) * 2018-03-30 2019-10-11 腾讯科技(深圳)有限公司 A kind of video pushing method, device and server, client, storage medium
CN109697156A (en) * 2018-11-19 2019-04-30 北京奇艺世纪科技有限公司 A kind of starting time obtaining method, device, terminal device and storage medium
CN109587517A (en) * 2018-12-07 2019-04-05 咪咕视讯科技有限公司 A kind of playback method and device, server and storage medium of multimedia file

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115243030A (en) * 2022-06-14 2022-10-25 天翼数字生活科技有限公司 Terminal capability test system, method, equipment and storage medium
CN115243030B (en) * 2022-06-14 2024-03-01 天翼数字生活科技有限公司 Terminal capability test system, method, equipment and storage medium
CN115174924A (en) * 2022-07-20 2022-10-11 天翼数字生活科技有限公司 Set top box, video play-out delay calculation method, system, equipment and medium
CN115174924B (en) * 2022-07-20 2024-05-28 天翼数字生活科技有限公司 Set top box, video playing time delay calculation method, system, equipment and medium

Similar Documents

Publication Publication Date Title
EP2888844B1 (en) Device and method for adaptive rate multimedia communications on a wireless network
CN105379293B (en) Media quality informa instruction in dynamic self-adapting Streaming Media based on hyper text protocol
TWI642283B (en) Method and apparatus for packet header compression
CA2909906C (en) Method and apparatus for transmitting media data in multimedia transport system
EP2888845B1 (en) Device and method for adaptive rate multimedia communications on a wireless network
US8935424B2 (en) Method and apparatus for signaling presentation description updates in HTTP streaming
EP2962469A1 (en) Just-in-time dereferencing of remote elements in dynamic adaptive streaming over hypertext transfer protocol
KR20120036901A (en) Method, system and network equipment for implementing http-based streaming media service
MX2015004596A (en) Method and apparatus for media data delivery control.
WO2012162995A1 (en) Method and device for transmitting stream media
CN113132759A (en) Method, device, server, system and storage medium for determining video playing time delay
CN108259998B (en) Player, play control method and device, electronic equipment and play system
CN109587517B (en) Multimedia file playing method and device, server and storage medium
CN101296166A (en) Method for measuring multimedia data based on index
CN109982151B (en) Video-on-demand method, device, equipment and medium
KR20150000844A (en) Method and apparatus for converting a content in a multimedia system
WO2018021950A1 (en) Device and method for controlling media streaming from a server to a client
US20180343207A1 (en) Streaming Media Data Transmission Method and Apparatus
KR20170043972A (en) Method and apparatus for transmitting and receiving packet in multimedia system
CN112491937A (en) Data transmission method, device, equipment and storage medium
CN116866676A (en) Cross-network screen throwing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210716

RJ01 Rejection of invention patent application after publication