CN115297364B - Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment - Google Patents

Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment Download PDF

Info

Publication number
CN115297364B
CN115297364B CN202210889658.7A CN202210889658A CN115297364B CN 115297364 B CN115297364 B CN 115297364B CN 202210889658 A CN202210889658 A CN 202210889658A CN 115297364 B CN115297364 B CN 115297364B
Authority
CN
China
Prior art keywords
system time
cloud game
time information
information
data packet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210889658.7A
Other languages
Chinese (zh)
Other versions
CN115297364A (en
Inventor
周志伟
印体亮
代品品
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN202210889658.7A priority Critical patent/CN115297364B/en
Publication of CN115297364A publication Critical patent/CN115297364A/en
Application granted granted Critical
Publication of CN115297364B publication Critical patent/CN115297364B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738—Monitoring network characteristics, e.g. bandwidth, congestion level

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The embodiment of the invention provides a method, a system and electronic equipment for determining cloud game video transmission delay, wherein the method comprises the following steps: the cloud game playing end receives a video frame data packet sent by the cloud game server end, wherein the video frame data packet carries first system time information when the cloud game server end sends the video frame data packet; acquiring system time when receiving the video frame data packet is completed, and acquiring second system time information; and determining the transmission delay of the video frame data packet based on the first system time information, the second system time information and the system time difference information between the cloud game playing end and the cloud game service end. The embodiment of the invention can accurately measure the transmission delay of the video frame data packet in real time.

Description

Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment
Technical Field
The present invention relates to the field of video transmission technologies, and in particular, to a method, a system, and an electronic device for determining a video transmission delay of a cloud game.
Background
In recent years, with rapid development of network live video, VR/AR (Virtual Reality/Augmented Reality), competitive game, video conference, cloud game and the like, the real-time audio and video communication technology has moved to a high tide of historical development, and the requirements of users on the actual transmission effect of real-time audio and video are higher and higher. In the real-time audio and video communication process, the playing end plays real-time audio and video, and the real delay time of the audio and video data transmission is generally used for measuring the quality of a transmission network for transmitting the audio and video data and measuring the influence of network transmission on the audio and video data delay experience.
Therefore, how to accurately measure the transmission delay of real-time audio and video data becomes a problem to be solved in the prior art.
Disclosure of Invention
The embodiment of the invention aims to provide a method, a system and electronic equipment for determining the video transmission delay of a cloud game so as to accurately measure the video transmission delay of the cloud game. The specific technical scheme is as follows:
in a first aspect of the present invention, there is provided a method for determining a cloud game video transmission delay, applied to a cloud game playing end, the method including:
receiving a video frame data packet sent by a cloud game server, wherein the video frame data packet carries first system time information when the cloud game server sends the video frame data packet;
acquiring system time when receiving the video frame data packet is completed, and acquiring second system time information;
and determining the transmission delay of the video frame data packet based on the first system time information, the second system time information and the system time difference information between the cloud game playing end and the cloud game service end, wherein the system time difference information between the cloud game playing end and the cloud game service end represents the difference between the cloud game playing end and the cloud game service end when the system time is synchronous.
Optionally, the determining, based on the first system time information, the second system time information, and system time difference information between the cloud game playing end and the cloud game service end, the transmission delay of the video frame data packet includes:
calculating the difference value between the second system time information and the first system time information to obtain target time difference information;
and determining the sum value of the target time difference information and the system time difference information as the transmission delay of the video frame data packet.
Optionally, the video frame data packet is a real-time transport protocol RTP extension data packet, and the first system time information is located in a header extension of a last data packet of the video frame data packet.
Optionally, the determining of the system time difference information between the cloud game playing end and the cloud game service end includes:
network Time Protocol (NTP) information containing third system time information is sent to the cloud game server, wherein the third system time information is the system time information when the NTP information is sent to the cloud game server;
receiving NTP response information which is fed back by the cloud game server and contains the third system time information, the fourth system time information and the fifth system time information, and acquiring current sixth system time information; the fourth system time information is system time information when the cloud game server receives the NTP message, and the fifth system time information is system time information when the cloud game server feeds back the NTP response message;
And determining system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
Optionally, the determining the system time difference information between the cloud game playing end and the cloud game service end further includes:
acquiring the third system time information, the fourth system time information, the fifth system time information and the sixth system time information for a plurality of times according to a preset time interval;
and determining the average value of the obtained system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information which are acquired for a plurality of times as the final system time difference information between the cloud game playing end and the cloud game service end.
In a second aspect of the present invention, a method for determining a cloud game video transmission delay is further provided, and the method is applied to a cloud game server, and includes:
Transmitting a video frame data packet to a cloud game playing end, wherein the video frame data packet carries first system time information when the video frame data packet is transmitted; and determining the transmission delay of the video frame data packet by using the cloud game playing end to acquire second system time information when the receiving of the video frame data packet is completed, and determining the transmission delay of the video frame data packet based on the first system time information, the second system time information and the system time difference information between the cloud game playing end and the cloud game service end, wherein the system time difference information between the cloud game playing end and the cloud game service end represents the difference between the cloud game playing end and the cloud game service end when the system time is synchronous.
Optionally, the video frame data packet is a real-time transport protocol RTP extension data packet, and the first system time information is located in a header extension of a last data packet of the video frame data packet.
Optionally, the determining of the system time difference information between the cloud game playing end and the cloud game service end includes:
receiving Network Time Protocol (NTP) information which is sent by the cloud game playing end and contains third system time information, wherein the third system time information is the system time information when the cloud game playing end sends the NTP information;
Transmitting an NTP response message containing the third system time information, fourth system time information and fifth system time information to the cloud game playing end, wherein the fourth system time information is the system time information when the NTP message is received, and the fifth system time information is the system time information when the NTP response message is transmitted; and the cloud game playing end acquires sixth system time information when the NTP response message is received, and determines system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
In still another aspect of the implementation of the present invention, a system for determining a cloud game video transmission delay is provided, where the system includes a cloud game playing end and a cloud game service end;
the cloud game server side is used for sending a video frame data packet to the cloud game playing side, and the video frame data packet carries first system time information when the video frame data packet is sent;
the cloud game playing end is configured to receive a video frame data packet sent by the cloud game server end, obtain system time when receiving the video frame data packet is completed, obtain second system time information, and determine a transmission delay of the video frame data packet based on the first system time information, the second system time information, and system time difference information between the cloud game playing end and the cloud game server end, where the system time difference information between the cloud game playing end and the cloud game server end indicates a difference between the cloud game playing end and the cloud game server end when the system time is synchronous.
Optionally, the video frame data packet is a real-time transport protocol RTP extension data packet, and the first system time information is located in a header extension of a last data packet of the video frame data packet.
Optionally, the cloud game playing end is specifically configured to:
calculating the difference value between the second system time information and the first system time information to obtain target time difference information; and determining the sum value of the target time difference information and the system time difference information as the transmission delay of the video frame data packet.
Optionally, the cloud game playing end is further configured to send a network time protocol NTP message including third system time information to the cloud game server, where the third system time information is system time information when the NTP message is sent to the cloud game server;
the cloud game server is further configured to receive an NTP message including third system time information sent by the cloud game playing end, send an NTP response message including the third system time information, fourth system time information and fifth system time information to the cloud game playing end, where the fourth system time information is system time information when the NTP message is received, and the fifth system time information is system time information when the NTP response message is sent;
The cloud game playing end is further configured to receive an NTP response message including the third system time information, the fourth system time information and the fifth system time information, which is fed back by the cloud game server end, and acquire current sixth system time information; and determining system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
In yet another aspect of the present invention, there is also provided an electronic device including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory perform communication with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the steps of any one of the cloud game video transmission delay determining methods when executing the programs stored in the memory.
In still another aspect of the implementation of the present invention, there is further provided a computer readable storage medium, where a computer program is stored, where the computer program when executed by a processor implements the steps of the method for determining a video transmission delay of a cloud game as described in any one of the above.
In yet another aspect of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of the method of determining a cloud game video transmission delay as described in any of the above.
According to the method, the system and the electronic equipment for determining the cloud game video transmission delay, which are provided by the embodiment of the invention, a cloud game playing end receives a video frame data packet sent by a cloud game server, and determines the transmission delay of the video frame data packet according to first system time information carried in the video frame data packet and sent by the cloud game server, second system time information when the cloud game playing end finishes receiving the video frame data packet, and system time difference information between the cloud game playing end and the cloud game server. In the embodiment of the invention, the system time difference information between the cloud game playing end and the cloud game service end represents the difference when the cloud game playing end and the cloud game service end are in system time synchronization, and on the basis of the difference, the transmission time required in the real-time transmission process of the video frame data packet, namely the difference between the sending time and the receiving time of the video frame data packet is combined, so that the transmission time delay of the video frame data packet can be accurately measured in real time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a flow chart of a method for determining a video transmission delay of a cloud game according to an embodiment of the present invention;
fig. 2 is a flow chart of a system time difference information determining method according to an embodiment of the present invention;
FIG. 3 is an interactive schematic diagram of a method for determining a video transmission delay of a cloud game according to an embodiment of the present invention;
FIG. 4 is an interactive schematic diagram of a system time difference information determining method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a cloud game video transmission delay determining system according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.
In order to accurately measure the transmission delay of real-time audio and video data, the embodiment of the invention provides a method, a system and electronic equipment for determining the transmission delay of cloud game video. The method for determining the cloud game video transmission time delay provided by the embodiment of the invention is applied to a cloud game playing end and comprises the following steps:
Receiving a video frame data packet sent by a cloud game server, wherein the video frame data packet carries first system time information when the cloud game server sends the video frame data packet;
acquiring system time when receiving the video frame data packet is completed, and acquiring second system time information;
and determining the transmission delay of the video frame data packet based on the first system time information, the second system time information and the system time difference information between the cloud game playing end and the cloud game service end, wherein the system time difference information between the cloud game playing end and the cloud game service end represents the difference between the cloud game playing end and the cloud game service end when the system time is synchronous.
According to the method for determining the transmission time delay of the cloud game video, the system time difference information between the cloud game playing end and the cloud game service end shows the difference when the cloud game playing end and the cloud game service end are in system time synchronization, and on the basis of the difference, the transmission time required in the real-time transmission process of the video frame data packet, namely the difference between the sending time and the receiving time of the video frame data packet, is combined, so that the transmission time delay of the video frame data packet can be accurately measured in real time.
The following describes a method for determining the video transmission delay of a cloud game in detail, which is provided by the embodiment of the invention:
the cloud game is a game mode based on cloud computing, and in the running mode of the cloud game, all games run at a server side, and rendered game pictures are compressed and then transmitted to a user through a network. Cloud computing is an internet-based computing approach by which shared software and hardware resources and information can be provided to computers and other devices as needed.
As shown in fig. 1, the method for determining the cloud game video transmission time delay provided by the embodiment of the invention is applied to a cloud game playing end, and can be implemented by the following steps:
s101, receiving a video frame data packet sent by a cloud game server, wherein the video frame data packet carries first system time information when the cloud game server sends the video frame data packet.
The cloud game playing end may be any electronic device capable of playing a cloud game, such as a client, a laptop, an intelligent terminal, a server, and the like. The cloud game server may be any electronic device capable of running a cloud game, such as a cloud handset, server, etc. The cloud mobile phone is a mobile phone which applies a cloud computing technology to network terminal services and realizes cloud services through a cloud server.
The video frame data packet may be a video data packet in a cloud game data stream, where the cloud game server transmits the video frame data packet to the cloud game playing end in real time for playing, and in the process of transmitting the video frame data packet, the video frame data packet may carry first system time information when the cloud game server sends the video frame data packet, so that the cloud game playing end knows the sending time of the video frame data packet.
S102, acquiring the system time when receiving the video frame data packet, and obtaining second system time information.
When receiving the video frame data packet sent by the cloud game server, the cloud game playing end obtains the current system time of the self-equipment when the video frame data packet is received, namely, the receiving time of the video frame data packet is known.
S103, determining the transmission delay of the video frame data packet based on the first system time information, the second system time information and the system time difference information between the cloud game playing end and the cloud game service end.
Under the condition that the system time difference information between the cloud game playing end and the cloud game service end is known, the cloud game playing end can accurately calculate the transmission delay of the video frame data packet by using the system time information (namely the transmission time of the video frame data packet) when the cloud game service end transmits the video frame data packet and the system time information (namely the receiving time of the video frame data packet) when the cloud game playing end receives the video frame data packet. The system time difference information between the cloud game playing end and the cloud game service end represents the difference between the cloud game playing end and the cloud game service end when the system time is synchronous.
In a possible implementation manner, step S103 may include determining a transmission delay of the video frame data packet based on the first system time information, the second system time information, and the system time difference information between the cloud game playing end and the cloud game service end:
calculating the difference value between the second system time information and the first system time information to obtain target time difference information;
and determining the sum of the target time difference information and the system time difference information as the transmission delay of the video frame data packet.
The second system time information when the cloud game playing end receives the video frame data packet sent by the cloud game server end is shown as Tr, the first system time information when the cloud game server end sends the video frame data packet is shown as Ts, the corresponding target time difference information is Tr-Ts, the system time difference information between the cloud game playing end and the cloud game server end is shown as Dc, and then the transmission delay=tr-ts+dc of the video frame data packet.
According to the method for determining the transmission time delay of the cloud game video, the system time difference information between the cloud game playing end and the cloud game service end shows the difference when the cloud game playing end and the cloud game service end are in system time synchronization, and on the basis of the difference, the transmission time required in the real-time transmission process of the video frame data packet, namely the difference between the sending time and the receiving time of the video frame data packet, is combined, so that the transmission time delay of the video frame data packet can be accurately measured in real time.
In one possible implementation manner, the video frame data packet may be a RTP extension data packet of a real-time transmission protocol, and the first system time information may be located in a header extension of a last data packet of the video frame data packet.
In the embodiment of the invention, the transmission of the video frame data packet can be realized by using a custom RTP (Transport Protocol for Real-Time Applications, real-time transmission protocol) extension data packet, and specifically, the system time when the cloud game server sends the video frame data packet can be carried in the packet header extension of the last data packet of the video frame data packet when the video frame data packet is packed into the RTP extension data packet.
By way of example, the system time may be time information from a custom point in time, such as from 1 month, 1 day, 0 minutes, 0 seconds in 1970 to the current millisecond count, and so forth.
In one example, a custom RTP single byte extension packet, for example, http:// www.xxx.com/rtcdn/experimenters/RTP-hdrext/timing-info, may be used, when the video frame packet is packaged into the RTP extension packet, in the packet header extension of the last packet of the video frame packet, carry the system time when the cloud game server sends the video frame packet, and in particular, the packet header extension of the packet during packaging may include the system time, the length occupied by the system time, and the identifier of the system time.
In the embodiment of the invention, the transmission of the video frame data packet is realized by using the RTP extension data packet, so that the cloud game playing end can accurately know the sending time of the video frame data packet.
In one possible implementation manner, as shown in fig. 2, the determining the system time difference information between the cloud game playing end and the cloud game service end may include:
s201, a Network Time Protocol (NTP) message containing third system time information is sent to a cloud game server.
In the embodiment of the invention, the cloud game playing end and the cloud game service end are synchronized by utilizing NTP (Network Time Protocol ) in a message transmission mode so as to determine the system time difference information between the cloud game playing end and the cloud game service end.
In one example, the cloud game playing end may send, to the cloud game server end, an NTP message including third system time information, which is system time information when the NTP message is sent to the cloud game server end, through a network using a message transmission mechanism (such as a data channel, TCP (Transmission Control Protocol, transmission control protocol), etc.).
S202, receiving NTP response information which is fed back by the cloud game server and contains third system time information, fourth system time information and fifth system time information, and acquiring current sixth system time information.
The fourth system time information is system time information when the cloud game server receives the NTP message, and the fifth system time information is system time information when the cloud game server feeds back the NTP response message.
After the cloud game playing end sends the NTP message containing the current third system time information to the cloud game server end, the cloud game playing end receives an NTP response message fed back by the cloud game server end, wherein the NTP response message carries the third system time information, fourth system time information when the cloud game server end receives the NTP message, fifth system time information when the cloud game server end feeds back the NTP response message, and further the cloud game playing end obtains sixth system time information when the cloud game playing end receives the NTP response message.
S203, determining the system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
The cloud game playing end can calculate the difference value between the fourth system time information and the third system time information to obtain first time difference information, calculate the difference value between the fifth system time information and the sixth system time information to obtain second time difference information, and determine the average value of the first time difference information and the second time difference information as the system time difference information between the cloud game playing end and the cloud game service end.
For example, the third system time information is denoted as T1, the fourth system time information is denoted as T2, the fifth system time information is denoted as T3, and the sixth system time information is denoted as T4, the system time difference information Dc between the cloud game playing end and the cloud game service end is: (T2-T1+T3-T4)/2.
In the embodiment of the invention, the cloud game playing end and the cloud game service end are synchronized by utilizing an NTP time synchronization mechanism in a message transmission mode, and the system time difference information between the cloud game playing end and the cloud game service end is determined.
In one possible implementation manner, the determining the system time difference information between the cloud game playing end and the cloud game service end may further include:
acquiring third system time information, fourth system time information, fifth system time information and sixth system time information for a plurality of times according to a preset time interval;
and determining the average value of the obtained system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information which are acquired for a plurality of times as the final system time difference information between the cloud game playing end and the cloud game service end.
In order to avoid errors in single measurement, in the embodiment of the present invention, the steps S201 to S203 may be repeatedly performed at preset time intervals, and an average value of the system time difference information between the cloud game playing end and the cloud game service end, which is obtained by multiple times of calculation, is determined as the final system time difference information between the cloud game playing end and the cloud game service end. The preset time interval may be set according to actual requirements, for example, 50 ms, 100 ms, 200 ms, etc.
In the embodiment of the invention, the average value of the system time difference information between the cloud game playing end and the cloud game service end, which is obtained by multiple times of calculation, is determined as the final system time difference information between the cloud game playing end and the cloud game service end, so that the error of single measurement is avoided, and the determined system time difference information between the cloud game playing end and the cloud game service end is more accurate.
The embodiment of the invention also provides a method for determining the cloud game video transmission time delay, which is applied to the cloud game server and can comprise the following steps:
transmitting a video frame data packet to a cloud game playing end, wherein the video frame data packet carries first system time information when the video frame data packet is transmitted; and determining the transmission delay of the video frame data packet based on the first system time information, the second system time information and the system time difference information between the cloud game playing end and the cloud game service end, wherein the system time difference information between the cloud game playing end and the cloud game service end represents the difference between the cloud game playing end and the cloud game service end when the cloud game playing end and the cloud game service end are in system time synchronization.
The implementation modes of the embodiments of the invention can be mutually referred, and the cloud game service end and the cloud game playing end are mutually used for determining the transmission time delay of the video frame data packet.
According to the method for determining the transmission time delay of the cloud game video, the system time difference information between the cloud game playing end and the cloud game service end shows the difference when the cloud game playing end and the cloud game service end are in system time synchronization, and on the basis of the difference, the transmission time required in the real-time transmission process of the video frame data packet, namely the difference between the sending time and the receiving time of the video frame data packet, is combined, so that the transmission time delay of the video frame data packet can be accurately measured in real time.
In one possible implementation manner, the video frame data packet is a RTP extension data packet of a real-time transmission protocol, and the first system time information is located in a header extension of a last data packet of the video frame data packet.
In one possible implementation manner, the determining of the system time difference information between the cloud game playing end and the cloud game service end may include:
receiving Network Time Protocol (NTP) information which is sent by a cloud game playing end and contains third system time information, wherein the third system time information is the system time information when the cloud game playing end sends the NTP information;
Transmitting an NTP response message containing third system time information, fourth system time information and fifth system time information to a cloud game playing end, wherein the fourth system time information is the system time information when the NTP message is received, and the fifth system time information is the system time information when the NTP response message is transmitted; and the cloud game playing end acquires the sixth system time information when the NTP response message is received, and determines the system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
As shown in fig. 3, a method for determining a cloud game video transmission delay according to an embodiment of the present invention may include:
the cloud game server side sends a video frame data packet to the cloud game playing side, wherein the video frame data packet carries first system time information when the video frame data packet is sent.
The cloud game playing end receives a video frame data packet sent by the cloud game server end, acquires system time when the video frame data packet is received, obtains second system time information, and determines transmission delay of the video frame data packet based on the first system time information, the second system time information and system time difference information between the cloud game playing end and the cloud game server end, wherein the system time difference information between the cloud game playing end and the cloud game server end represents difference when the cloud game playing end and the cloud game server end are in system time synchronization.
As shown in fig. 4, a method for determining system time difference information between a cloud game playing end and a cloud game service end according to an embodiment of the present invention may include:
the cloud game playing end sends NTP information containing third system time information to the cloud game server end, wherein the third system time information is the system time information when the NTP information is sent to the cloud game server end.
The cloud game server receives the NTP message which is sent by the cloud game playing end and contains the third system time information, and sends an NTP response message which contains the third system time information, the fourth system time information and the fifth system time information to the cloud game playing end, wherein the fourth system time information is the system time information when the NTP message is received, and the fifth system time information is the system time information when the NTP response message is sent.
The cloud game playing end receives NTP response information which is fed back by the cloud game server end and contains third system time information, fourth system time information and fifth system time information, and acquires current sixth system time information; and determining system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
Corresponding to the method embodiment, the embodiment of the invention also provides a corresponding system embodiment.
As shown in fig. 5, an embodiment of the present invention provides a system for determining a cloud game video transmission delay, where the system 500 includes a cloud game playing end 520 and a cloud game service end 510;
the cloud game server 510 is configured to send a video frame data packet to the cloud game play end 520, where the video frame data packet carries first system time information when the video frame data packet is sent;
the cloud game playing end 520 is configured to receive the video frame data packet sent by the cloud game server end 510, obtain a system time when the video frame data packet is received, obtain second system time information, and determine a transmission delay of the video frame data packet based on the first system time information, the second system time information, and system time difference information between the cloud game playing end 520 and the cloud game server end 510, where the system time difference information between the cloud game playing end 520 and the cloud game server end 510 indicates a difference when the cloud game playing end 520 and the cloud game server end 510 are in system time synchronization.
The system time difference information between the cloud game playing end and the cloud game service end provided by the embodiment of the invention shows the difference between the cloud game playing end and the cloud game service end when the system time is synchronous, and on the basis of the difference, the transmission time required in the real-time transmission process of the video frame data packet, namely the difference between the sending time and the receiving time of the video frame data packet is combined, so that the transmission time of the video frame data packet can be accurately measured in real time.
In one possible implementation manner, the video frame data packet is a RTP extension data packet of a real-time transmission protocol, and the first system time information is located in a header extension of a last data packet of the video frame data packet.
In one possible implementation manner, the cloud game playing end is specifically configured to: calculating the difference value between the second system time information and the first system time information to obtain target time difference information; and determining the sum of the target time difference information and the system time difference information as the transmission delay of the video frame data packet.
In a possible implementation manner, the cloud game playing end is further configured to send a network time protocol NTP message including third system time information to the cloud game server, where the third system time information is system time information when the NTP message is sent to the cloud game server;
the cloud game server is further configured to receive an NTP message including third system time information sent by the cloud game playing end, send an NTP response message including third system time information, fourth system time information and fifth system time information to the cloud game playing end, where the fourth system time information is system time information when the NTP message is received, and the fifth system time information is system time information when the NTP response message is sent;
The cloud game playing end is also used for receiving NTP response messages which are fed back by the cloud game server end and contain third system time information, fourth system time information and fifth system time information, and acquiring current sixth system time information; and determining system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
The embodiment of the invention also provides an electronic device, as shown in fig. 6, which comprises a processor 601, a communication interface 602, a memory 603 and a communication bus 604, wherein the processor 601, the communication interface 602 and the memory 603 complete communication with each other through the communication bus 604,
a memory 603 for storing a computer program;
the processor 601 is configured to implement the steps of any of the above method embodiments when executing the program stored in the memory 603, so as to achieve the same technical effects.
The communication bus mentioned by the above terminal may be a peripheral component interconnect standard (Peripheral Component Interconnect, abbreviated as PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, abbreviated as EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the terminal and other devices.
The memory may include random access memory (Random Access Memory, RAM) or non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processor, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
In yet another embodiment of the present invention, there is further provided a computer readable storage medium having a computer program stored therein, where the computer program when executed by a processor implements the steps of the method for determining a cloud game video transmission delay according to any one of the foregoing embodiments.
In yet another embodiment of the present invention, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps of the method for determining a cloud game video transmission delay as described in any of the above embodiments.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system/electronic device embodiments, since they are substantially similar to method embodiments, the description is relatively simple, with reference to the description of method embodiments in part.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims (14)

1. The method for determining the transmission delay of the cloud game video is characterized by being applied to a cloud game playing end, and comprises the following steps:
receiving a video frame data packet sent by a cloud game server, wherein the video frame data packet carries first system time information when the cloud game server sends the video frame data packet;
acquiring system time when receiving the video frame data packet is completed, and acquiring second system time information;
determining a transmission delay of the video frame data packet based on the first system time information, the second system time information and system time difference information between the cloud game playing end and the cloud game service end, wherein the system time difference information between the cloud game playing end and the cloud game service end represents a difference between the cloud game playing end and the cloud game service end when the system time is synchronous; the system time difference information between the cloud game playing end and the cloud game service end is obtained by calculating an expression (T2-T1 + T3-T4)/2, T1 represents the system time information when the cloud game playing end sends a Network Time Protocol (NTP) message to the cloud game service end, T2 represents the system time information when the cloud game service end receives the NTP message, T3 represents the system time information when the cloud game service end feeds back an NTP response message to the cloud game playing end, and T4 represents the system time information when the cloud game playing end receives the NTP response message.
2. The method of claim 1, wherein determining the transmission delay of the video frame data packet based on the first system time information, the second system time information, and system time difference information between the cloud gaming player and the cloud gaming server comprises:
calculating the difference value between the second system time information and the first system time information to obtain target time difference information;
and determining the sum value of the target time difference information and the system time difference information as the transmission delay of the video frame data packet.
3. The method of claim 1, wherein the video frame data packet is a real-time transport protocol RTP extension data packet, and wherein the first system time information is located in a header extension of a last data packet of the video frame data packet.
4. The method of claim 1, wherein the determining of the system time difference information between the cloud gaming player and the cloud gaming server comprises:
network Time Protocol (NTP) information containing third system time information is sent to the cloud game server, wherein the third system time information is the system time information when the NTP information is sent to the cloud game server;
Receiving NTP response information which is fed back by the cloud game server and contains the third system time information, the fourth system time information and the fifth system time information, and acquiring current sixth system time information; the fourth system time information is system time information when the cloud game server receives the NTP message, and the fifth system time information is system time information when the cloud game server feeds back the NTP response message;
and determining system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
5. The method of claim 4, wherein the determining system time difference information between the cloud gaming player and the cloud gaming server further comprises:
acquiring the third system time information, the fourth system time information, the fifth system time information and the sixth system time information for a plurality of times according to a preset time interval;
and determining the average value of the obtained system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information which are acquired for a plurality of times as the final system time difference information between the cloud game playing end and the cloud game service end.
6. The method for determining the cloud game video transmission delay is characterized by being applied to a cloud game server, and comprises the following steps:
transmitting a video frame data packet to a cloud game playing end, wherein the video frame data packet carries first system time information when the video frame data packet is transmitted; the cloud game playing end obtains second system time information when receiving the video frame data packet is completed, and determines transmission time delay of the video frame data packet based on the first system time information, the second system time information and system time difference information between the cloud game playing end and the cloud game service end, wherein the system time difference information between the cloud game playing end and the cloud game service end represents differences when the cloud game playing end and the cloud game service end are in system time synchronization; the system time difference information between the cloud game playing end and the cloud game service end is obtained by calculating an expression (T2-T1 + T3-T4)/2, T1 represents the system time information when the cloud game playing end sends a Network Time Protocol (NTP) message to the cloud game service end, T2 represents the system time information when the cloud game service end receives the NTP message, T3 represents the system time information when the cloud game service end feeds back an NTP response message to the cloud game playing end, and T4 represents the system time information when the cloud game playing end receives the NTP response message.
7. The method of claim 6, wherein the video frame data packet is a real-time transport protocol RTP extension data packet, and wherein the first system time information is located in a header extension of a last data packet of the video frame data packet.
8. The method of claim 6, wherein the determining of the system time difference information between the cloud gaming player and the cloud gaming server comprises:
receiving Network Time Protocol (NTP) information which is sent by the cloud game playing end and contains third system time information, wherein the third system time information is the system time information when the cloud game playing end sends the NTP information;
transmitting an NTP response message containing the third system time information, fourth system time information and fifth system time information to the cloud game playing end, wherein the fourth system time information is the system time information when the NTP message is received, and the fifth system time information is the system time information when the NTP response message is transmitted; and the cloud game playing end acquires sixth system time information when the NTP response message is received, and determines system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
9. The cloud game video transmission time delay determining system is characterized by comprising a cloud game playing end and a cloud game service end;
the cloud game server side is used for sending a video frame data packet to the cloud game playing side, and the video frame data packet carries first system time information when the video frame data packet is sent;
the cloud game playing end is configured to receive a video frame data packet sent by the cloud game server end, acquire system time when the video frame data packet is received, obtain second system time information, and determine a transmission delay of the video frame data packet based on the first system time information, the second system time information, and system time difference information between the cloud game playing end and the cloud game server end, where the system time difference information between the cloud game playing end and the cloud game server end indicates a difference between the cloud game playing end and the cloud game server end when the system time is synchronous; the system time difference information between the cloud game playing end and the cloud game service end is obtained by calculating an expression (T2-T1 + T3-T4)/2, T1 represents the system time information when the cloud game playing end sends a Network Time Protocol (NTP) message to the cloud game service end, T2 represents the system time information when the cloud game service end receives the NTP message, T3 represents the system time information when the cloud game service end feeds back an NTP response message to the cloud game playing end, and T4 represents the system time information when the cloud game playing end receives the NTP response message.
10. The system of claim 9, wherein the video frame data packet is a real-time transport protocol RTP extension data packet and the first system time information is located in a header extension of a last data packet of the video frame data packet.
11. The system of claim 9, wherein the cloud game playing end is specifically configured to:
calculating the difference value between the second system time information and the first system time information to obtain target time difference information; and determining the sum value of the target time difference information and the system time difference information as the transmission delay of the video frame data packet.
12. The system of claim 9, wherein the system further comprises a controller configured to control the controller,
the cloud game playing end is further configured to send a network time protocol NTP message including third system time information to the cloud game server end, where the third system time information is system time information when the third system time information is when the NTP message is sent to the cloud game server end;
the cloud game server is further configured to receive an NTP message including third system time information sent by the cloud game playing end, send an NTP response message including the third system time information, fourth system time information and fifth system time information to the cloud game playing end, where the fourth system time information is system time information when the NTP message is received, and the fifth system time information is system time information when the NTP response message is sent;
The cloud game playing end is further configured to receive an NTP response message including the third system time information, the fourth system time information and the fifth system time information, which is fed back by the cloud game server end, and acquire current sixth system time information; and determining system time difference information between the cloud game playing end and the cloud game service end based on the third system time information, the fourth system time information, the fifth system time information and the sixth system time information.
13. The electronic equipment is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program;
a processor for carrying out the method steps of any one of claims 1-8 when executing a program stored on a memory.
14. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored therein a computer program which, when executed by a processor, implements the method steps of any of claims 1-8.
CN202210889658.7A 2022-07-27 2022-07-27 Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment Active CN115297364B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210889658.7A CN115297364B (en) 2022-07-27 2022-07-27 Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210889658.7A CN115297364B (en) 2022-07-27 2022-07-27 Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment

Publications (2)

Publication Number Publication Date
CN115297364A CN115297364A (en) 2022-11-04
CN115297364B true CN115297364B (en) 2024-01-23

Family

ID=83824299

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210889658.7A Active CN115297364B (en) 2022-07-27 2022-07-27 Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment

Country Status (1)

Country Link
CN (1) CN115297364B (en)

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101435181B1 (en) * 2013-10-18 2014-09-01 한전케이디엔주식회사 Time synchronization and transmission delay time correction method between the master and the slave of intelligent power distribution system
JP2014160899A (en) * 2013-02-19 2014-09-04 Nippon Telegr & Teleph Corp <Ntt> Delay measurement method and delay measurement system
CN106162860A (en) * 2015-04-27 2016-11-23 华为技术有限公司 The method and system of a kind of time synchronized, the network equipment
WO2017005055A1 (en) * 2015-07-08 2017-01-12 杭州海康威视数字技术股份有限公司 Method, server side and system for computing bandwidth of network transmission of streaming media
CN108881955A (en) * 2017-05-08 2018-11-23 Tcl新技术（惠州）有限公司 A kind of method and system for realizing the output of distributed node equipment audio video synchronization
JP6704548B1 (en) * 2019-03-28 2020-06-03 三菱電機株式会社 Communication system, communication device and program
CN111245680A (en) * 2020-01-10 2020-06-05 腾讯科技（深圳）有限公司 Method, device, system, terminal and server for detecting cloud game response delay
CN112087398A (en) * 2020-08-28 2020-12-15 西安万像电子科技有限公司 Video frame sending method, device, equipment and storage medium
WO2021114795A1 (en) * 2019-12-11 2021-06-17 厦门雅基软件有限公司 Cloud game live broadcast method, cloud game anchor end, viewer end and computer-readable storage medium
CN113179441A (en) * 2021-03-26 2021-07-27 卡莱特云科技股份有限公司 Synchronous playing method, device, system and computer equipment
CN113301397A (en) * 2021-02-19 2021-08-24 阿里巴巴集团控股有限公司 CDN-based audio and video transmission, playing and delay detection method and device
CN113491083A (en) * 2019-02-26 2021-10-08 松下知识产权经营株式会社 Video camera image transmission/reproduction system, video camera constituting the system, and viewer
WO2021223123A1 (en) * 2020-05-06 2021-11-11 深圳市大疆创新科技有限公司 Time synchronization method and apparatus, and movable platform and storage medium
CN113645291A (en) * 2021-08-04 2021-11-12 百度在线网络技术（北京）有限公司 Data communication method and device, electronic equipment and storage medium
CN113839829A (en) * 2020-06-24 2021-12-24 北京字节跳动网络技术有限公司 Cloud game delay testing method, device and system and electronic equipment

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109429325B (en) * 2017-08-24 2021-03-26 阿里巴巴集团控股有限公司 Data transmission method, device, base station and server
US11190836B2 (en) * 2018-12-20 2021-11-30 Hisense Visual Technology Co., Ltd. Audio playing and transmitting methods and apparatuses

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014160899A (en) * 2013-02-19 2014-09-04 Nippon Telegr & Teleph Corp <Ntt> Delay measurement method and delay measurement system
KR101435181B1 (en) * 2013-10-18 2014-09-01 한전케이디엔주식회사 Time synchronization and transmission delay time correction method between the master and the slave of intelligent power distribution system
CN106162860A (en) * 2015-04-27 2016-11-23 华为技术有限公司 The method and system of a kind of time synchronized, the network equipment
WO2017005055A1 (en) * 2015-07-08 2017-01-12 杭州海康威视数字技术股份有限公司 Method, server side and system for computing bandwidth of network transmission of streaming media
CN108881955A (en) * 2017-05-08 2018-11-23 Tcl新技术（惠州）有限公司 A kind of method and system for realizing the output of distributed node equipment audio video synchronization
CN113491083A (en) * 2019-02-26 2021-10-08 松下知识产权经营株式会社 Video camera image transmission/reproduction system, video camera constituting the system, and viewer
JP6704548B1 (en) * 2019-03-28 2020-06-03 三菱電機株式会社 Communication system, communication device and program
WO2021114795A1 (en) * 2019-12-11 2021-06-17 厦门雅基软件有限公司 Cloud game live broadcast method, cloud game anchor end, viewer end and computer-readable storage medium
CN111245680A (en) * 2020-01-10 2020-06-05 腾讯科技（深圳）有限公司 Method, device, system, terminal and server for detecting cloud game response delay
WO2021223123A1 (en) * 2020-05-06 2021-11-11 深圳市大疆创新科技有限公司 Time synchronization method and apparatus, and movable platform and storage medium
CN113839829A (en) * 2020-06-24 2021-12-24 北京字节跳动网络技术有限公司 Cloud game delay testing method, device and system and electronic equipment
CN112087398A (en) * 2020-08-28 2020-12-15 西安万像电子科技有限公司 Video frame sending method, device, equipment and storage medium
CN113301397A (en) * 2021-02-19 2021-08-24 阿里巴巴集团控股有限公司 CDN-based audio and video transmission, playing and delay detection method and device
CN113179441A (en) * 2021-03-26 2021-07-27 卡莱特云科技股份有限公司 Synchronous playing method, device, system and computer equipment
CN113645291A (en) * 2021-08-04 2021-11-12 百度在线网络技术（北京）有限公司 Data communication method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN115297364A (en) 2022-11-04

Similar Documents

Publication Publication Date Title
US10255035B2 (en) Audio data buffering
CN110430457B (en) Method and device for playing different-end audio and video and audio playing system
CN111050185B (en) Live broadcast room wheat-connected video mixing method, storage medium, electronic equipment and system
WO2020192152A1 (en) Video transmission method, root node, child node, p2p server, and system
CN108810657B (en) Method and system for setting video cover
WO2008147578A1 (en) System and/or method for client- driven server load distribution
CN112968747B (en) Time calibration method and device, computer equipment and storage medium
WO2022017007A1 (en) Audio data processing method, server, and storage medium
WO2020125074A1 (en) Message arrival rate determination method and device, data statistics server and storage medium
CN110278047A (en) The method, device and equipment of synchronous for clock, setting Streaming Media frame pts value
WO2019044065A1 (en) Video playback bit rate estimation device and method, non-transitory computer-readable medium containing program, and communication quality measurement device
CN113949741B (en) Scheduling method, scheduling device, electronic equipment and storage medium
CN115297364B (en) Cloud game video transmission time delay determining method, cloud game video transmission time delay determining system and electronic equipment
CN109194706B (en) Network resource dial testing method and terminal
KR20230116903A (en) Methods and Heterogeneous Computing Systems for Clock Synchronization
CN106303754A (en) A kind of audio data play method and device
CN112804574A (en) Multimedia content transmission and playing method and device
CN109587517B (en) Multimedia file playing method and device, server and storage medium
CN111600808A (en) Information processing method and device for instant messaging
JP2012083805A (en) Information distribution system, information distribution method, and information distribution program
CN109495319A (en) The fault message of CDN node determines method, device and equipment
CN114629826B (en) Network maximum bandwidth estimation method and device, electronic equipment and storage medium
CN112086095B (en) Data processing method, device, equipment and storage medium
CN108156474A (en) A kind of video broadcasting method and device
CN112449366B (en) Message forwarding method and device, wireless AP equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant