CN112073363A - Cloud rendering low-delay high-guarantee transmission protocol operation method - Google Patents
Cloud rendering low-delay high-guarantee transmission protocol operation method Download PDFInfo
- Publication number
- CN112073363A CN112073363A CN202010649866.0A CN202010649866A CN112073363A CN 112073363 A CN112073363 A CN 112073363A CN 202010649866 A CN202010649866 A CN 202010649866A CN 112073363 A CN112073363 A CN 112073363A
- Authority
- CN
- China
- Prior art keywords
- data
- image
- frame
- packet
- data packet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Physics & Mathematics (AREA)
- Discrete Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a cloud rendering low-delay high-guarantee transmission protocol operation method, and particularly relates to the field of VR, and the method comprises the following steps: s1, acquiring game images: acquiring the current running game picture data through NVIDIA CUDA at the cloud; s2, H264 coding: performing H264 encoding on the image data acquired in the S1; s3, cutting the single-frame image: and (4) subpackaging the data in the S2 according to a LetinRTP protocol, segmenting a data packet of the single-frame image, inserting a label into the data packet, marking the initial point of the image and the total packet number, and repeatedly encapsulating the single-packet data. According to the invention, the problem of image stagnation caused by data transmission blockage can be solved by cutting single-frame images, the VR experience is smoother, the user satisfaction is higher, and the development of the VR industry is promoted.
Description
Technical Field
The invention relates to the technical field of VR (virtual reality), in particular to a cloud rendering low-delay high-guarantee transmission protocol operation method.
Background
Each layer in the transmission protocol provides service function for the previous layer, in order to provide the service function, the next layer incorporates the data in the previous layer into the data field of the current layer, and then the service function of the current layer is realized by adding a header or a trailer, the process is called data encapsulation, the data of a user needs to be packaged once and again, and finally, the data is converted into a signal which can be transmitted on the network and is sent to the network. When the target computer is reached, the reverse unpacking process is performed.
RTP: real-time Transport Protocol (Real-time Transport Protocol), RTP/RTCP is a Protocol for actually transmitting data, RTP transmits audio/video data, if PLAY, Server sends to Client, if RECORD, Client can send to Server, the whole RTP Protocol consists of two closely related parts: RTP data protocol and RTP control protocol, wherein, RTSP: real Time Streaming Protocol (RTSP), RTSP requests mainly include DESCRIBE, SETUP, PLAY, PAUSE, TEARDOWN, OPTIONS, etc., which can be known as a conversation and control function as the name suggests, SETUP can determine the port used by RTP/RTCP during RTSP conversation, and PLAY/PAUSE/TEARDOWN can start or stop the sending of RTP; RTP/RTCP is a protocol for actually transmitting data, and RTCP includes Sender Report and Receiver Report, which is used for audio/video synchronization and other purposes, and is a control protocol.
The current image transmission protocol is developed based on the traditional field, the biggest defect of the traditional transmission protocol in VR cloud rendering is that the time delay is high, the traditional transmission protocol cannot be used in VR cloud rendering, and the video transmission time delay reaches within 30ms for VR, so that the visual display of the traditional transmission protocol applied to VR cloud rendering is that a user has picture lag and dizziness in the experience process, the control event response is slow, and the overall experience is poor.
Disclosure of Invention
In order to overcome the defects in the prior art, embodiments of the present invention provide a cloud rendering low-latency high-assurance transport protocol operation method, which can solve the problem of image stagnation caused by data transmission blockage by segmenting a single frame image, so that VR experience is smoother, user satisfaction is higher, and the issue of the VR industry is promoted, so as to solve the problem provided in the background art.
In order to achieve the purpose, the invention provides the following technical scheme: a cloud rendering low-delay high-guarantee transport protocol operation method comprises the following steps:
s1, acquiring game images: acquiring the current running game picture data through NVIDIA CUDA at the cloud;
s2, H264 coding: performing H264 encoding on the image data acquired in the S1;
s3, cutting the single-frame image: subpackaging the data in S2 according to a LetinRTP protocol, segmenting a data packet from a single-frame image, inserting a label into the data packet, marking the initial point of the image and the total packet number, and repeatedly encapsulating the single-packet data;
s4, UDP sending: the Server sends a data packet in a UDP mode;
s5, UDP reception: a client receives a UDP data packet;
s6, single-frame image synthesis: assembling a data packet according to the tag, discarding repeated data, discarding a fixed data packet in one frame of image, discarding all frame data and not displaying the frame data;
s7, image rendering: and H264 decoding the packaged image and rendering the image to a screen.
In a preferred embodiment, the VR image resolution in S3 is 4096 × 2048, the code rate is 30M, and the frame rate is 60 FPS.
In a preferred embodiment, the UDP supports a connectionless transport protocol for the Internet protocol suite.
The invention has the technical effects and advantages that:
according to the invention, the problem of image stagnation caused by data transmission blockage can be solved by cutting single-frame images, the VR experience is smoother, the user satisfaction is higher, and the development of the VR industry is promoted.
Drawings
FIG. 1 is an overall flow chart of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, a cloud rendering low-latency high-security transport protocol operation method includes the following steps:
s1, acquiring game images: acquiring the current running game picture data through NVIDIA CUDA at the cloud;
s2, H264 coding: performing H264 encoding on the image data acquired in the S1;
s3, cutting the single-frame image: the data in the S2 are split according to the LetinRTP protocol, a single-frame image is split into data packets, labels are inserted into the data packets, the initial point of the image and the total packet number are marked, and the single-packet data are repeatedly encapsulated, so that the image assembly is still complete and the phenomenon of screen splash is avoided when packet loss occurs;
s4, UDP sending: the Server sends a data packet in a UDP mode;
s5, UDP reception: a client receives a UDP data packet;
s6, single-frame image synthesis: assembling a data packet according to the tag, discarding repeated data, discarding a fixed data packet in one frame of image, discarding all frame data and not displaying the frame data;
s7, image rendering: and H264 decoding the packaged image and rendering the image to a screen.
In a preferred embodiment, the VR image resolution in S3 is 4096 × 2048, the code rate is 30M, and the frame rate is 60 FPS.
In a preferred embodiment, the UDP supports a connectionless transport protocol for the Internet protocol suite.
The specific implementation mode is as follows: according to the invention, the problem of image stagnation caused by data transmission blockage can be solved by cutting single-frame images, the VR experience is smoother, the user satisfaction is higher, and the development of the VR industry is promoted.
The points to be finally explained are: first, in the description of the present application, it should be noted that, unless otherwise specified and limited, the terms "mounted," "connected," and "connected" should be understood broadly, and may be a mechanical connection or an electrical connection, or a communication between two elements, and may be a direct connection, and "upper," "lower," "left," and "right" are only used to indicate a relative positional relationship, and when the absolute position of the object to be described is changed, the relative positional relationship may be changed;
secondly, the method comprises the following steps: in the drawings of the disclosed embodiments of the invention, only the structures related to the disclosed embodiments are referred to, other structures can refer to common designs, and the same embodiment and different embodiments of the invention can be combined with each other without conflict;
and finally: the above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that are within the spirit and principle of the present invention are intended to be included in the scope of the present invention.
Claims (3)
1. A cloud rendering low-delay high-guarantee transmission protocol operation method is characterized by comprising the following steps: the method comprises the following steps:
s1, acquiring game images: acquiring the current running game picture data through NVIDIA CUDA at the cloud;
s2, H264 coding: performing H264 encoding on the image data acquired in the S1;
s3, cutting the single-frame image: subpackaging the data in S2 according to a LetinRTP protocol, segmenting a data packet from a single-frame image, inserting a label into the data packet, marking the initial point of the image and the total packet number, and repeatedly encapsulating the single-packet data;
s4, UDP sending: the Server sends a data packet in a UDP mode;
s5, UDP reception: a client receives a UDP data packet;
s6, single-frame image synthesis: assembling a data packet according to the tag, discarding repeated data, discarding a fixed data packet in one frame of image, discarding all frame data and not displaying the frame data;
s7, image rendering: and H264 decoding the packaged image and rendering the image to a screen.
2. The cloud rendering low-latency high-assurance transport protocol operation method according to claim 1, characterized in that: in S3, VR image resolution is 4096 × 2048, code rate is 30M, and frame rate is 60 FPS.
3. The cloud rendering low-latency high-assurance transport protocol operation method according to claim 1, characterized in that: the UDP supports a connectionless transport protocol for the Internet protocol suite.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010649866.0A CN112073363A (en) | 2020-07-08 | 2020-07-08 | Cloud rendering low-delay high-guarantee transmission protocol operation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010649866.0A CN112073363A (en) | 2020-07-08 | 2020-07-08 | Cloud rendering low-delay high-guarantee transmission protocol operation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112073363A true CN112073363A (en) | 2020-12-11 |
Family
ID=73656399
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010649866.0A Pending CN112073363A (en) | 2020-07-08 | 2020-07-08 | Cloud rendering low-delay high-guarantee transmission protocol operation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112073363A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103051978A (en) * | 2012-12-16 | 2013-04-17 | 华南理工大学 | H264-based real-time mobile video service control method |
| CN103986941A (en) * | 2014-05-28 | 2014-08-13 | 深圳市智英实业发展有限公司 | Wireless audio and video transmission system |
| CN109889847A (en) * | 2019-01-18 | 2019-06-14 | 昆山优尼电能运动科技有限公司 | Low delay is wirelessly transferred coding/decoding system |
| CN110351533A (en) * | 2019-08-12 | 2019-10-18 | 桂林电子科技大学 | The network transmission monitoring system and its implementation of video image processing based on Linux |
| CN110505532A (en) * | 2019-09-04 | 2019-11-26 | 睿魔智能科技（深圳）有限公司 | Low delay image transfer method, device, equipment and storage medium |
| CN110730335A (en) * | 2019-11-14 | 2020-01-24 | 深圳市高巨创新科技开发有限公司 | Unmanned aerial vehicle video real-time preview method and system |
| CN110827380A (en) * | 2019-09-19 | 2020-02-21 | 北京铂石空间科技有限公司 | Image rendering method and device, electronic equipment and computer readable medium |
| CN111298427A (en) * | 2020-02-04 | 2020-06-19 | 南京大学 | Method for reducing picture jitter in virtual reality cloud game system |
-
2020
- 2020-07-08 CN CN202010649866.0A patent/CN112073363A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103051978A (en) * | 2012-12-16 | 2013-04-17 | 华南理工大学 | H264-based real-time mobile video service control method |
| CN103986941A (en) * | 2014-05-28 | 2014-08-13 | 深圳市智英实业发展有限公司 | Wireless audio and video transmission system |
| CN109889847A (en) * | 2019-01-18 | 2019-06-14 | 昆山优尼电能运动科技有限公司 | Low delay is wirelessly transferred coding/decoding system |
| CN110351533A (en) * | 2019-08-12 | 2019-10-18 | 桂林电子科技大学 | The network transmission monitoring system and its implementation of video image processing based on Linux |
| CN110505532A (en) * | 2019-09-04 | 2019-11-26 | 睿魔智能科技（深圳）有限公司 | Low delay image transfer method, device, equipment and storage medium |
| CN110827380A (en) * | 2019-09-19 | 2020-02-21 | 北京铂石空间科技有限公司 | Image rendering method and device, electronic equipment and computer readable medium |
| CN110730335A (en) * | 2019-11-14 | 2020-01-24 | 深圳市高巨创新科技开发有限公司 | Unmanned aerial vehicle video real-time preview method and system |
| CN111298427A (en) * | 2020-02-04 | 2020-06-19 | 南京大学 | Method for reducing picture jitter in virtual reality cloud game system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102204257B (en) | Low latency video encoder | |
| US20160337424A1 (en) | Transferring media data using a websocket subprotocol | |
| CN107846633A (en) | A kind of live broadcasting method and system | |
| EP2469853A1 (en) | Method and device for processing video image data, system and terminal for video conference | |
| CN110784740A (en) | Video processing method, device, server and readable storage medium | |
| CN107613029A (en) | A kind of virtual desktop remote method and system suitable for mobile terminal or Web ends | |
| CN103581699A (en) | Video playing method, streaming media server and streaming media playing system | |
| CN104918133A (en) | Method and device for playing video streams in articulated naturality web | |
| JP7486527B2 (en) | Immersive media content presentation and interactive 360° video communication | |
| US20180176278A1 (en) | Detecting and signaling new initialization segments during manifest-file-free media streaming | |
| KR20110058739A (en) | Video data receiving and sending systems for videophone and video data processing method thereof | |
| KR20160110424A (en) | Robust live operation of dash | |
| CN112073809A (en) | Method for supporting browser to play video with any coding format | |
| US20210160552A1 (en) | Media data transmission method, client, and server | |
| CN110418189A (en) | A kind of low latency can be used for transmitting game, high frame per second audio/video transmission method | |
| CN104079870A (en) | Video monitoring method and system for single-channel video and multiple-channel audio frequency | |
| US20170331666A1 (en) | Real-time control interface for broadcast object streaming | |
| CN109756744B (en) | Data processing method, electronic device and computer storage medium | |
| EP2563038A1 (en) | Method for transmitting video signals from an application on a server over an IP network to a client device | |
| CN112073363A (en) | Cloud rendering low-delay high-guarantee transmission protocol operation method | |
| WO2020137766A1 (en) | Transmission device, transmission method, encoding device, encoding method, receiving device, and receiving method | |
| CN109104635A (en) | The method and system of instant delivery screen picture | |
| US20160205156A1 (en) | Method for the Processing of a Multimedia Stream, Corresponding Device and Computer Program | |
| WO2023062271A1 (en) | A method, an apparatus and a computer program product for video coding | |
| CN117397227A (en) | Real-time augmented reality communication session |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20201211 |