CN114077508A - Remote image rendering method and device, electronic equipment and medium - Google Patents

Remote image rendering method and device, electronic equipment and medium Download PDF

Info

Publication number
CN114077508A
CN114077508A CN202210059015.XA CN202210059015A CN114077508A CN 114077508 A CN114077508 A CN 114077508A CN 202210059015 A CN202210059015 A CN 202210059015A CN 114077508 A CN114077508 A CN 114077508A
Authority
CN
China
Prior art keywords
image
rendering
instruction
remote
node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210059015.XA
Other languages
Chinese (zh)
Other versions
CN114077508B (en
Inventor
沈标标
刘现坤
陈友旭
邹懋
陈飞
王鲲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vita Technology Beijing Co ltd
Original Assignee
Vita Technology Beijing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vita Technology Beijing Co ltd filed Critical Vita Technology Beijing Co ltd
Priority to CN202210059015.XA priority Critical patent/CN114077508B/en
Publication of CN114077508A publication Critical patent/CN114077508A/en
Application granted granted Critical
Publication of CN114077508B publication Critical patent/CN114077508B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/543User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/546Message passing systems or structures, e.g. queues
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)

Abstract

The invention discloses a remote image rendering method, a remote image rendering device, electronic equipment and a medium. The method is applied to a client node and comprises the following steps: transmitting an image rendering instruction to a remote node; obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes the image rendering instruction; if the transmission of the image rendering instruction corresponding to one frame of image is completed, transmitting an image display instruction to the remote node; and acquiring the image data transmitted by the remote node responding to the image display instruction. By using the method, the remote node can be asynchronously controlled to render the image and return rendered image data by transmitting the image rendering instruction to the remote node and transmitting the image display instruction to the remote node, so that the remote image rendering efficiency is improved.

Description

Remote image rendering method and device, electronic equipment and medium
Technical Field
The embodiment of the invention relates to the technical field of graphic processors, in particular to a remote image rendering method, a remote image rendering device, electronic equipment and a medium.
Background
Graphics Processing Units (GPUs) are gradually applied to the field of general-purpose computing due to their efficient many-core computing power, and in application scenes such as modeling and games, GPUs are mainly responsible for image rendering functions. With the rapid development of network technologies, a new generation of network technologies has the characteristics of low delay, high bandwidth and the like, and provides an application basis for remote image rendering.
The existing remote image rendering is usually in a synchronous rendering mode, a client node forwards a rendering instruction to a remote node, the remote node receives an execution instruction, and the client node continues to initiate a next instruction after receiving a result of a previous rendering instruction. And after the new frame of image data is rendered, the application program of the client node calls an image display instruction, at the moment, the remote node copies the new frame of image data from the GPU to the memory, and then sends the image data in the memory and the rendering instruction result to the client node so that the client node displays the image corresponding to the image data on the screen of the client node.
However, since the image data is copied from the GPU to the memory, the problem of synchronization between instructions and data inside the GPU is involved, so that the operation delay is high, and the image return delay is high due to the high time-consuming real-time image copy operation, so that the overall image rendering performance of the application program is reduced, the display frame rate of the client application program is low, and the requirements of high-performance rendering scenes such as games and modeling cannot be met.
Disclosure of Invention
The embodiment of the invention provides a remote image rendering method, a remote image rendering device, electronic equipment and a remote image rendering medium, which are used for solving the problem of performance bottleneck caused by high-delay image real-time return operation and improving the efficiency of remote image rendering.
In a first aspect, an embodiment of the present invention provides a remote image rendering method, where the method is applied to a client node, and includes:
transmitting an image rendering instruction to a remote node;
obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes the image rendering instruction;
if the transmission of the image rendering instruction corresponding to one frame of image is completed, transmitting an image display instruction to the remote node;
and acquiring the image data transmitted by the remote node responding to the image display instruction.
In a second aspect, an embodiment of the present invention further provides a remote image rendering method, where the method is applied to a remote node, and includes:
acquiring an image rendering instruction transmitted by a client node;
executing the image rendering instruction, and obtaining and transmitting a corresponding rendering operation result;
and if an image display instruction is received, transmitting image data corresponding to the image display instruction to the client node.
In a third aspect, an embodiment of the present invention further provides a remote image rendering apparatus, configured at a client node, including:
a first transmission module for transmitting the image rendering instruction to a remote node;
a first obtaining module, configured to obtain a rendering operation result transmitted by the remote node, where the rendering operation result is a result obtained after the remote node executes the image rendering instruction;
the second transmission module is used for transmitting an image display instruction to the remote node if the transmission of the image rendering instruction corresponding to one frame of image is completed;
and the second acquisition module is used for acquiring the image data transmitted by the remote node responding to the image display instruction.
In a fourth aspect, an embodiment of the present invention further provides a remote image rendering apparatus, configured at a remote node, including:
the first acquisition module is used for acquiring an image rendering instruction transmitted by the client node;
the second acquisition module is used for executing the image rendering instruction, and acquiring and transmitting a corresponding rendering operation result;
and the transmission module is used for transmitting the image data corresponding to the image display instruction to the client node if the image display instruction is received.
In a fifth aspect, an embodiment of the present invention further provides an electronic device, including:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the remote image rendering method provided by the embodiment of the invention.
In a sixth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the remote image rendering method provided by the embodiment of the present invention.
The embodiment of the invention provides a remote image rendering method and device, electronic equipment and a medium. The method is applied to a client node and comprises the following steps: transmitting an image rendering instruction to a remote node; obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes the image rendering instruction; if the transmission of the image rendering instruction corresponding to one frame of image is completed, transmitting an image display instruction to the remote node; and acquiring the image data transmitted by the remote node responding to the image display instruction. By the aid of the technical scheme, the remote node can be asynchronously controlled to render images and return rendered image data by transmitting the image rendering instruction to the remote node and transmitting the image display instruction to the remote node, and remote image rendering efficiency is improved.
Drawings
Fig. 1 is a schematic flowchart of a remote image rendering method according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a remote image rendering method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of remote image rendering performed by a client node and a remote node according to a second embodiment of the present invention;
fig. 4 is a schematic structural diagram of remote image rendering performed by a client node and a remote node according to a second embodiment of the present invention;
fig. 5 is a schematic flowchart of performing remote image rendering by a client node and a remote node according to a second embodiment of the present invention;
fig. 6 is a schematic structural diagram of a remote image rendering apparatus according to a third embodiment of the present invention;
fig. 7 is a schematic structural diagram of a remote image rendering apparatus according to a third embodiment of the present invention;
fig. 8 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like. In addition, the embodiments and features of the embodiments in the present invention may be combined with each other without conflict.
The term "include" and variations thereof as used herein are intended to be open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment".
It should be noted that the concepts of "first", "second", etc. mentioned in the present invention are only used for distinguishing corresponding contents, and are not used for limiting the order or interdependence relationship.
It is noted that references to "a", "an", and "the" modifications in the present invention are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that reference to "one or more" unless the context clearly dictates otherwise.
It can be understood that, with the continuous evolution and development of computer architecture, GPUs are gradually applied to the general computing field, such as scenes of numerical analysis, mass data processing, three-dimensional modeling, games, and the like, due to their efficient many-core computing power. In application scenes such as modeling and games, the GPU is mainly responsible for an image rendering function, receives an image rendering instruction and image data initiated by a client application program, renders a target image, and then displays the target image on a client screen.
The rendering operation of the local GPU requires that GPU hardware resources must be provisioned on the client's computer. With the rapid development of network technologies, a new generation of network technologies has the characteristics of low delay, high bandwidth and the like, and provides an application basis for remote image rendering.
In a remote image rendering scene, an image rendering instruction of a client application program is forwarded to a remote node (with GPU resources) for execution, and after the remote node executes image rendering operation, the rendered image is transmitted back to a client side application program and displayed on a local screen terminal of a client.
Remote image rendering does not require a client to locally configure GPU resources, and only requires a screen terminal to display images.
The present invention does not limit the communication mode between the local node and the remote node.
In one embodiment, the client local node and the remote node can establish a data interaction channel through network connection, the image rendering operation of the client side application program is forwarded to the remote node to be executed, and the remote node transmits the rendering result back to the client side.
In one embodiment, the local node and the remote node may be virtual machines, the local node and the remote node may establish a data interaction channel through a shared memory mode, an image rendering operation of a client-side application program is forwarded to the remote node for execution, and the remote node returns a rendering result to the client side.
The existing remote image rendering is usually in a synchronous rendering mode, a client node forwards a rendering instruction to a remote node, the remote node receives an execution instruction, and the client node continues to initiate a next instruction after receiving a result of a previous rendering instruction.
The application program of the client node calls an image display command to display a new frame of image (e.g., Present of Direct 3D), and when the remote node receives and processes the image display command, the remote node transmits the new frame of image data back to the client node in real time, and the client node receives the new frame of image data and displays the new frame of image data on the screen terminal of the client node.
Through the above description, it can be found that image return in the existing remote image rendering scene is usually real-time return operation, and as the image return operation is executed on a rendering path, a subsequent image rendering instruction needs to wait for a long time, so that the overall image rendering performance of an application program is reduced, the display frame rate of the application program is reduced, and the requirements of high-performance rendering scenes such as games and modeling cannot be met.
Based on this, the embodiment of the present invention provides an image asynchronous return method in a remote image rendering scene, in which an image return operation is separated from a critical path of a rendering operation, and the image return operation is asynchronously processed by a specific thread, so that an image display operation is decoupled from the image rendering operation, parallelism of image display and image decoupling is improved, meanwhile, the image rendering operation does not need to be continuously executed after the image return is completed, rendering performance and display frame rate of an application program are improved, and requirements of high-performance rendering scenes such as games and modeling are further met.
Example one
Fig. 1 is a flowchart of a remote image rendering method according to an embodiment of the present invention, where the method is applied to a client node, and is applicable to a case of rendering an image, and the method may be executed by a remote image rendering apparatus, where the apparatus may be implemented by software and/or hardware and is generally integrated on an electronic device, where the electronic device includes, but is not limited to: computers, notebook computers, tablet computers, mobile phones and other devices.
As shown in fig. 1, a remote image rendering method according to an embodiment of the present invention includes the following steps:
and S110, transmitting the image rendering instruction to a remote node.
The image rendering instruction may be used to represent an instruction for rendering an image, and the image rendering instruction may include one or more instructions, and the image rendering instruction may indicate rendering of an image color, an image shape, and/or an image pixel point, and the like.
Specifically, the client node may transmit the image rendering instruction to the remote node, and the embodiment does not limit the step of transmitting the image rendering instruction to the remote node, for example, a plurality of image rendering instructions may be packaged and all transmitted to the remote node, or one image rendering instruction may be transmitted to the remote node each time until all image rendering instructions corresponding to the image are transmitted to the remote node. For example, when a client node needs to render a triangle, an image rendering instruction for creating a set of points in an image may be transmitted to a remote node, then image rendering instructions for splicing according to the created points are transmitted to the remote node to be connected into a triangle, and finally an image rendering instruction for image colors is transmitted to the remote node to render the colors of the triangle; and an image rendering instruction for creating a point set in the image, an image rendering instruction for splicing according to the created points and an image rendering instruction for image colors can be packaged and transmitted to the remote node.
In this embodiment, the manner of transmitting the image rendering instruction to the remote node is not limited, and optionally, for example, the client node may directly transmit the image rendering instruction to the remote node, and the client node may also transmit the image rendering instruction to an intermediate node, and the intermediate node transmits the image rendering instruction to the remote node.
It will be appreciated that the client node may first initiate a connection request to the remote node to establish a communication pipe, where the connection request may refer to a request by the client node to connect to the remote node, before transmitting the image rendering instructions to the remote node, and the communication pipe may be a pipe for the client node and the remote node to communicate. The present embodiment does not limit the means for initiating the connection request as long as a communication pipe between the two can be established.
And S120, obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes an image rendering instruction.
The rendering operation result can be understood as a result obtained after the remote node executes the image rendering instruction, and is used for representing whether the rendering operation corresponding to the image rendering instruction is executed or not. Optionally, the result of the rendering operation may be regarded as a return value of the rendering operation, and different return values represent different information.
In one embodiment, a return value of 1 indicates that the rendering operation corresponding to the image rendering instruction is completed, and a return value of 0 indicates that the rendering operation corresponding to the image rendering instruction is not completed.
In one embodiment, a return value of 0 represents that the rendering operation corresponding to the image rendering instruction is completed, and return values of 1-N may correspond to a reason that the rendering operation corresponding to the image rendering instruction is not completed. N is a positive integer.
In this step, the manner of obtaining the rendering operation result is not limited, and optionally, the manner of obtaining the rendering operation result may be a remote procedure call or a message queue.
After transmitting the image rendering instruction to the remote node, the client node may obtain a rendering operation result transmitted by the remote node, so as to perform subsequent steps according to the rendering operation result. For example, when the rendering operation result indicates that the image rendering instruction is executed completely, it indicates that the current image rendering instruction has been executed successfully, and at this time, the client node may continue to transmit the next image rendering instruction; when the rendering operation result indicates that the current image rendering instruction is not executed completely, which indicates that the current image rendering instruction is failed to be executed, the remote node may repeatedly send the image rendering instruction until the image rendering instruction is executed successfully.
It can be understood that a frame of image may need to be rendered by a plurality of image rendering instructions, for example, a frame of image needs n image rendering instructions, and the image rendering instructions are transmitted in sequence, and after all the image rendering instructions corresponding to a frame of image are transmitted, the client node may send an image display instruction to call image data of the frame of image; correspondingly, if the image rendering instruction corresponding to one frame of image is not completely transmitted, the client node continues to transmit the next image rendering instruction to complete the transmission of all the image rendering instructions corresponding to the image.
And S130, if the transmission of the image rendering instruction corresponding to one frame of image is finished, transmitting an image display instruction to the remote node.
The image display instruction may be understood as an instruction for calling image data to the client node to display an image of a latest frame on the screen terminal of the client node, and the embodiment does not limit the image display instruction, and may be, for example, Present of Direct3D, or the like.
Specifically, after the image rendering instruction corresponding to one frame of image is transmitted, the client node may transmit the image display instruction to the remote node, so as to implement the remote node to return the image data. The present embodiment does not further expand the step of transmitting an image display instruction to a remote node.
In an embodiment, if the transmission of the image rendering instruction corresponding to one frame of image is completed, after the client node transmits the image display instruction to the remote node, the image rendering instruction corresponding to the next frame of image may be transmitted to the remote node, that is, the client node may continue to execute the transmission of the image rendering instruction of the next frame of image without waiting for the completion of the image data return, thereby improving the rendering performance and the display frame rate of the application program.
And S140, acquiring the image data transmitted by the remote node responding to the image display instruction.
In this embodiment, the image data may be image data obtained by rendering an image by a remote node. After transmitting the image display instruction to the remote node, the client node may acquire the image data transmitted by the remote node in response to the image display instruction to display an image corresponding to the acquired image data on a screen.
The time for acquiring the image data transmitted by the remote node in response to the image display instruction may be the same as or different from the time for acquiring the rendering operation result transmitted by the remote node, and this embodiment does not limit this.
It should be noted that, the client node may create an image display thread to display the acquired image data on the screen, and this step does not limit the timing for creating the image display thread as long as the client node is ensured to be able to display the image data, for example, after the client node establishes a communication pipe to the remote node, before transmitting an image display instruction to the remote node, or after transmitting an image display instruction to the remote node.
The embodiment of the invention provides a remote image rendering method, which is applied to a client node and comprises the following steps: transmitting an image rendering instruction to a remote node; obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes the image rendering instruction; if the transmission of the image rendering instruction corresponding to one frame of image is completed, transmitting an image display instruction to the remote node; and acquiring the image data transmitted by the remote node responding to the image display instruction. By the method, the remote node can be asynchronously controlled to render the image and return rendered image data by transmitting the image rendering instruction to the remote node and transmitting the image display instruction to the remote node, so that the remote image rendering efficiency is improved.
On the basis of the above-described embodiment, a modified embodiment of the above-described embodiment is proposed, and it is to be noted herein that, in order to make the description brief, only the differences from the above-described embodiment are described in the modified embodiment.
In one embodiment, if the image rendering instruction corresponding to one frame of image is not transmitted, the next image rendering instruction is continuously transmitted, and the rendering operation result corresponding to the next image rendering instruction is obtained.
It can be understood that, when the transmission of the image rendering instruction corresponding to one frame of image is not completed, which indicates that the transmission of other image rendering instructions corresponding to the image is currently required, at this time, the remote node may continue to transmit the next image rendering instruction to obtain a rendering operation result corresponding to the next image rendering instruction until all the image rendering instructions corresponding to the image are completely transmitted.
The image rendering instructions corresponding to one frame of image, and the transmission sequence of each image rendering instruction is not limited herein and may be determined based on the needs of the application program.
In one embodiment, further comprising:
displaying an image corresponding to the acquired image data on a screen based on the created image display thread; the image display thread is an independent thread.
In this embodiment, the image display thread is an independent thread, and after the client node acquires the image data, the client node may display an image corresponding to the acquired image data on the screen based on the created image display thread. In this step, a means for displaying an image corresponding to the acquired image data on a screen is not limited, and for example, an image corresponding to the acquired image data may be directly displayed on the screen; and after the image corresponding to the acquired image data is verified, displaying the verified image on a screen.
Example two
Fig. 2 is a flowchart of a remote image rendering method according to a second embodiment of the present invention, where the method is applied to a remote node, and is applicable to a case of rendering an image, and the method may be executed by a remote image rendering apparatus, where the apparatus may be implemented by software and/or hardware, and is generally integrated on an electronic device, where the electronic device in this embodiment includes but is not limited to: computers, notebook computers, tablet computers, mobile phones and other devices.
As shown in fig. 2, a remote image rendering method provided by the second embodiment of the present invention includes the following steps:
and S210, acquiring an image rendering instruction transmitted by the client node.
In this embodiment, a manner of obtaining the image rendering instruction transmitted by the client node is not limited, and optionally, for example, the remote node may directly obtain the transmitted image rendering instruction from the client node, or may obtain the image rendering instruction transmitted by the client node from an intermediate node.
And S220, executing the image rendering instruction, and obtaining and transmitting a corresponding rendering operation result.
After the image rendering instruction transmitted by the client node is acquired, the remote node can execute the acquired image rendering instruction to obtain a corresponding rendering operation result and image data, and transmit the rendering operation result to the client node.
Optionally, in this step, the image rendering instruction is executed, and the corresponding rendering operation result is obtained and transmitted, which may be executed by an image rendering thread.
And S230, if an image display instruction is received, transmitting image data corresponding to the image display instruction to the client node.
The remote node may continue to receive and execute the next image rendering instruction after transmitting the corresponding rendering operation result. The image display instruction of the client node can be waited, and after the image display instruction is received, the image data corresponding to the image display instruction can be transmitted to the client node. Likewise, the manner of transmitting the image data corresponding to the image display instruction to the client node in the present embodiment is not limited as long as the image data can be transmitted to the client node. For example, the image data corresponding to the image display instruction may be first copied to the memory, and then the image data corresponding to the image display instruction stored in the memory may be transmitted to the client node; it is also possible to directly read image data corresponding to the image display instruction and then transmit the read image data to the client node.
It is to be noted that the operation of acquiring an image rendering instruction, executing the image rendering instruction, and transmitting the result of the corresponding rendering operation and the operation of acquiring an image display instruction, and transmitting the corresponding image data may be asynchronous operations.
In this embodiment, the thread for the remote node to transmit the image data corresponding to the image display instruction to the client node may be an independent image return thread.
The second embodiment of the invention provides a remote image rendering method, which is applied to a remote node and comprises the following steps: acquiring an image rendering instruction transmitted by a client node; executing the image rendering instruction, and obtaining and transmitting a corresponding rendering operation result; and if an image display instruction is received, transmitting image data corresponding to the image display instruction to the client node. By using the method, the corresponding rendering operation result can be obtained and transmitted by executing the image rendering instruction, and when the image display instruction is received, the image data corresponding to the image display instruction can be transmitted to the client node, so that the asynchronous return of the image data by an independent thread is realized, and the remote image rendering performance is improved.
In one embodiment, transmitting image data corresponding to the image display instructions to the client node comprises:
copying image data corresponding to the image display instruction in the image processor to a memory;
and transmitting the image data which is stored in the memory and corresponds to the image display instruction to the client node.
It can be understood that, the image data obtained after the remote node executes the image rendering instruction is automatically stored in the GPU, so that when the remote node transmits the image data corresponding to the image display instruction to the client node, the image data corresponding to the image display instruction in the GPU may be copied to the memory first, and then the image data corresponding to the image display instruction stored in the memory is transmitted to the client node, so as to complete the return of the image data.
In one embodiment, the execution of the image rendering instructions is performed by an image rendering thread, and the transmission of image data corresponding to the image display instructions to the client node is performed by an image passback thread, the image rendering thread and the image passback thread being two separate threads.
Wherein, the thread corresponding to the execution operation of the image rendering instruction and the thread for transmitting the image data operation corresponding to the image display instruction to the client node can be different.
Specifically, the execution operation of the image rendering instruction can be executed by an image rendering thread, the operation of transmitting the image data corresponding to the image display instruction to the client node can be executed by an image return thread, and the image rendering thread and the image return thread are two independent threads.
It should be noted that the remote node may create an image return thread to transmit the image data corresponding to the image display instruction to the client node, and this step does not limit the timing of creating the image return thread, as long as it is ensured that the remote node can return the image data after acquiring the image display instruction.
The interaction of the client node and the remote node is illustratively described below.
Fig. 3 is a schematic structural diagram of remote image rendering performed by a client node and a remote node according to a second embodiment of the present invention, where as shown in fig. 3, the client node forwards an image rendering instruction to the remote node, and after the remote node executes the image rendering instruction, the remote node may transmit a rendering operation result to the client node, and after the client node transmits all image rendering instructions corresponding to one frame of image to the remote node, the client node sends an image display instruction to the remote node; after receiving the image display instruction, the remote node may transmit the frame image (i.e., image data) back to the client node. The embodiment of the invention can separate the image data returning operation from the key path of the image rendering instruction execution operation, so that the image data returning operation can be asynchronously returned by a specific thread (namely an image returning thread), and the remote image rendering performance is improved.
Fig. 4 is a schematic diagram of an architecture for performing remote image rendering by a client node and a remote node according to a second embodiment of the present invention, and as shown in fig. 4, a client node includes an image application program, an image display module, and an image rendering instruction forwarding module, where the image application program may be an application program that needs to perform image display, an image rendered by the remote node may be an image required by the image application program, the image display module is an independent thread and is configured to receive image data sent by the remote node image returning module and display the image data on a client node screen, and the image rendering instruction forwarding module is configured to forward an image rendering instruction to the remote node;
the remote node end comprises an image return module and an image rendering instruction execution module, the image return module is an independent thread and is used for informing the thread to start image return operation after the remote node executes the operation corresponding to the image display instruction so as to send the image data in the GPU to the client node, and the image rendering instruction execution module is used for receiving and executing the image rendering instruction.
Fig. 5 is a schematic flowchart of a remote image rendering process performed by a client node and a remote node according to a second embodiment of the present invention, as shown in fig. 5, at a client node, the client node may first initiate a connection request to the remote node to establish a communication pipe; then, the client node creates an image display thread, waits for image data sent from the remote node and displays the image data on a screen of the client node; the client node forwards an image rendering instruction of the application program to the remote node so as to instruct the remote node to execute an image rendering operation; then the client node waits for receiving a rendering operation result executed by the remote node, and continues to forward the image rendering instruction to the remote node according to the rendering operation result until the image rendering instruction corresponding to one frame of image is transmitted to the remote node, and then sends an image display instruction of an application program to the remote node so as to carry out return work of image data; and finally, after the remote node finishes rendering the image data and asynchronously sends the image data to the client node, after the image display thread of the client node receives the image data, displaying the image corresponding to the image data on a screen of the client node, and continuously waiting for new image data.
At a remote node end, firstly, the remote node receives a connection request sent by a client node, and establishes a communication pipeline with the client node for transmitting an image rendering instruction and image data; then, the remote node creates an image returning thread to wait for the image rendering thread to inform the execution of image returning operation; the remote node receives an image rendering instruction sent by the client node, executes the image rendering instruction and obtains a rendering operation result; the remote node may determine whether the currently rendered image is the latest display image data (i.e., determine whether an image display instruction, such as Present in Direct3D, is received), and if so, return the rendering operation result to the client node, and simultaneously send a return notification to the image return thread, so that the image return thread starts the image return operation; if not, the rendering operation result is returned and continues to wait for receipt of the next image rendering instruction. After receiving the return notification, the image return thread may send the image data corresponding to the current rendered image to the client node, and wait for the next return notification. If the image data is copied from the GPU space to the memory space, the image returning thread sends the image data in the memory to the client node.
The time of the new image display thread and the new image return thread is not limited, as long as the image display thread can be established before the image data is received, and the image return thread is established before the image display instruction is received.
The image display thread may not be established prior to forwarding the image rendering instructions to the remote node. The image passback thread may not be established prior to executing the image rendering instructions.
Through the above description, it can be found that the image return operation can be separated from the image rendering key path, the image return operation is executed by a specific thread, the image return performance is improved, meanwhile, the image display and the image rendering operation are decoupled, the parallelism of the image display and the image rendering is improved, the expansibility of the image return operation under multiple display terminals is further improved, the performance bottleneck caused by the high-delay image real-time return operation in the existing application program image remote rendering scene is solved, the image rendering performance and the display frame rate of the application program are improved, and the requirement of the high-performance image rendering scene is met.
EXAMPLE III
Fig. 6 is a schematic structural diagram of a remote image rendering apparatus according to a third embodiment of the present invention, where the apparatus is configured at a client node and is suitable for rendering an image, where the apparatus may be implemented by software and/or hardware and is generally integrated on an electronic device.
As shown in fig. 6, the apparatus includes:
a first transmission module 310 for transmitting image rendering instructions to a remote node;
a first obtaining module 320, configured to obtain a rendering operation result transmitted by the remote node, where the rendering operation result is a result obtained after the remote node executes the image rendering instruction;
a second transmission module 330, configured to transmit an image display instruction to the remote node if transmission of the image rendering instruction corresponding to one frame of image is completed;
a second obtaining module 340, configured to obtain image data transmitted by the remote node in response to the image display instruction.
The third embodiment of the present invention provides a remote image rendering apparatus, which transmits an image rendering instruction to a remote node through a first transmission module 310; obtaining, by a first obtaining module 320, a rendering operation result transmitted by the remote node, where the rendering operation result is a result obtained after the remote node executes the image rendering instruction; transmitting an image display instruction to the remote node through the second transmission module 330 if the transmission of the image rendering instruction corresponding to one frame of image is completed; the image data transmitted by the remote node in response to the image display instruction is acquired by the second acquiring module 340. By using the device, the remote node can be asynchronously controlled to render the image and return rendered image data by transmitting the image rendering instruction to the remote node and transmitting the image display instruction to the remote node, so that the remote image rendering efficiency is improved.
Further, if the image rendering instruction corresponding to one frame of image is not transmitted, the next image rendering instruction is continuously transmitted, and the rendering operation result corresponding to the next image rendering instruction is obtained.
Further, the method further comprises:
displaying an image corresponding to the acquired image data on a screen based on the created image display thread; the image display thread is an independent thread.
The remote image rendering device can execute the remote image rendering method provided by the embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example four
Fig. 7 is a schematic structural diagram of a remote image rendering apparatus according to a fourth embodiment of the present invention, the apparatus is configured at a remote node and is applicable to rendering an image, wherein the apparatus can be implemented by software and/or hardware and is generally integrated on an electronic device.
As shown in fig. 7, the apparatus includes:
a first obtaining module 410, configured to obtain an image rendering instruction transmitted by a client node;
a second obtaining module 420, configured to execute the image rendering instruction, obtain and transmit a corresponding rendering operation result;
a transmission module 430, configured to transmit image data corresponding to an image display instruction to the client node if the image display instruction is received.
The fourth embodiment of the present invention provides a remote image rendering apparatus, where the apparatus obtains an image rendering instruction transmitted by a client node through a first obtaining module 410; executing the image rendering instruction through a second obtaining module 420, and obtaining and transmitting a corresponding rendering operation result; if an image display instruction is received through the transmission module 430, image data corresponding to the image display instruction is transmitted to the client node. By using the device, the corresponding rendering operation result can be obtained and transmitted by executing the image rendering instruction, and when the image display instruction is received, the image data corresponding to the image display instruction can be transmitted to the client node, so that the asynchronous return of the image data by an independent thread is realized, and the remote image rendering performance is improved.
Further, transmitting image data corresponding to the image display instruction to the client node includes:
copying image data corresponding to the image display instruction in the image processor to a memory;
and transmitting the image data which is stored in the memory and corresponds to the image display instruction to the client node.
Further, the execution operation of the image rendering instruction is executed by an image rendering thread, the operation of transmitting the image data corresponding to the image display instruction to the client node is executed by an image returning thread, and the image rendering thread and the image returning thread are two independent threads.
The remote image rendering device can execute the remote image rendering method provided by the second embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
EXAMPLE five
Fig. 8 is a schematic structural diagram of an electronic device according to a fifth embodiment of the present invention. As shown in fig. 8, an electronic device provided in the fifth embodiment of the present invention includes: one or more processors 51 and storage 52; the number of the processors 51 in the electronic device may be one or more, and one processor 51 is taken as an example in fig. 8; storage 52 is used to store one or more programs; the one or more programs are executed by the one or more processors 51, so that the one or more processors 51 implement the remote image rendering method according to any of the embodiments of the present invention.
The electronic device may further include: an input device 53 and an output device 54.
The processor 51, the storage device 52, the input device 53 and the output device 54 in the electronic apparatus may be connected by a bus or other means, and the bus connection is exemplified in fig. 8.
The storage device 52 in the electronic device may be used as a computer-readable storage medium for storing one or more programs, which may be software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the remote image rendering method according to one or two embodiments of the present invention (for example, the modules in the remote image rendering device shown in fig. 6 include the first transmission module 310, the first obtaining module 320, the second transmission module 330, and the second obtaining module 340, or the modules in the remote image rendering device shown in fig. 7 include the first obtaining module 410, the second obtaining module 420, and the transmission module 430). The processor 51 executes various functional applications and data processing of the electronic device by executing software programs, instructions and modules stored in the storage device 52, namely, implements the remote image rendering method in the above method embodiment.
The storage device 52 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device, and the like. Further, the storage 52 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 52 may further include memory located remotely from the processor 51, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 53 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus. The output device 54 may include a display device such as a display screen.
And, when the one or more programs included in the above electronic device are executed by the one or more processors 51, the programs perform the following operations:
transmitting an image rendering instruction to a remote node;
obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes the image rendering instruction;
if the transmission of the image rendering instruction corresponding to one frame of image is completed, transmitting an image display instruction to the remote node;
and acquiring the image data transmitted by the remote node responding to the image display instruction.
EXAMPLE six
An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, is configured to perform a remote image rendering method, where the method is applied to a client node, and the method includes:
transmitting an image rendering instruction to a remote node;
obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes the image rendering instruction;
if the transmission of the image rendering instruction corresponding to one frame of image is completed, transmitting an image display instruction to the remote node;
and acquiring the image data transmitted by the remote node responding to the image display instruction.
The computer executable instructions, when executed by a computer processor, are further for performing a remote image rendering method, the method being applied to a remote node, the method comprising:
acquiring an image rendering instruction transmitted by a client node;
executing the image rendering instruction, and obtaining and transmitting a corresponding rendering operation result;
and if an image display instruction is received, transmitting image data corresponding to the image display instruction to the client node.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a flash Memory, an optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. A computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take a variety of forms, including, but not limited to: an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, Radio Frequency (RF), etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (10)

1. A remote image rendering method applied to a client node, the method comprising:
transmitting an image rendering instruction to a remote node;
obtaining a rendering operation result transmitted by the remote node, wherein the rendering operation result is a result obtained after the remote node executes the image rendering instruction;
if the transmission of the image rendering instruction corresponding to one frame of image is completed, transmitting an image display instruction to the remote node;
and acquiring the image data transmitted by the remote node responding to the image display instruction.
2. The method of claim 1,
and if the image rendering instruction corresponding to one frame of image is not transmitted, continuously transmitting the next image rendering instruction to obtain the rendering operation result corresponding to the next image rendering instruction.
3. The method of claim 1, further comprising:
displaying an image corresponding to the acquired image data on a screen based on the created image display thread; the image display thread is an independent thread.
4. A remote image rendering method applied to a remote node, the method comprising:
acquiring an image rendering instruction transmitted by a client node;
executing the image rendering instruction, and obtaining and transmitting a corresponding rendering operation result;
and if an image display instruction is received, transmitting image data corresponding to the image display instruction to the client node.
5. The method of claim 4, wherein transmitting image data corresponding to the image display instructions to the client node comprises:
copying image data corresponding to the image display instruction in the image processor to a memory;
and transmitting the image data which is stored in the memory and corresponds to the image display instruction to the client node.
6. The method of claim 4, wherein the operations for executing the image rendering instructions are performed by an image rendering thread, and the operations for transmitting image data corresponding to the image display instructions to the client node are performed by an image passback thread, the image rendering thread and the image passback thread being two separate threads.
7. A remote image rendering apparatus, configured at a client node, comprising:
a first transmission module for transmitting the image rendering instruction to a remote node;
a first obtaining module, configured to obtain a rendering operation result transmitted by the remote node, where the rendering operation result is a result obtained after the remote node executes the image rendering instruction;
the second transmission module is used for transmitting an image display instruction to the remote node if the transmission of the image rendering instruction corresponding to one frame of image is completed;
and the second acquisition module is used for acquiring the image data transmitted by the remote node responding to the image display instruction.
8. A remote image rendering apparatus, disposed at a remote node, comprising:
the first acquisition module is used for acquiring an image rendering instruction transmitted by the client node;
the second acquisition module is used for executing the image rendering instruction, and acquiring and transmitting a corresponding rendering operation result;
and the transmission module is used for transmitting the image data corresponding to the image display instruction to the client node if the image display instruction is received.
9. An electronic device, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-6.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-6.
CN202210059015.XA 2022-01-19 2022-01-19 Remote image rendering method and device, electronic equipment and medium Active CN114077508B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210059015.XA CN114077508B (en) 2022-01-19 2022-01-19 Remote image rendering method and device, electronic equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210059015.XA CN114077508B (en) 2022-01-19 2022-01-19 Remote image rendering method and device, electronic equipment and medium

Publications (2)

Publication Number Publication Date
CN114077508A true CN114077508A (en) 2022-02-22
CN114077508B CN114077508B (en) 2022-10-11

Family

ID=80284705

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210059015.XA Active CN114077508B (en) 2022-01-19 2022-01-19 Remote image rendering method and device, electronic equipment and medium

Country Status (1)

Country Link
CN (1) CN114077508B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114581580A (en) * 2022-02-28 2022-06-03 维塔科技(北京)有限公司 Method and device for rendering image, storage medium and electronic equipment
WO2023173516A1 (en) * 2022-03-18 2023-09-21 维塔科技(北京)有限公司 Data exchange method and apparatus, and storage medium and electronic device
CN116893913A (en) * 2023-09-08 2023-10-17 北京趋动智能科技有限公司 Remote program execution method, device, system, electronic equipment and storage medium
CN117634369A (en) * 2023-12-13 2024-03-01 摩尔线程智能科技(北京)有限责任公司 Simulation method, model, electronic device, and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2511040A1 (en) * 2004-09-23 2006-03-23 The Governors Of The University Of Alberta Method and system for real time image rendering
CN1845177A (en) * 2006-05-17 2006-10-11 浙江大学 Three-dimensional remote rendering system and method based on image transmission
US20110063285A1 (en) * 2009-09-14 2011-03-17 International Business Machines Corporation Rendering of stereoscopic images with multithreaded rendering software pipeline
CN102592315A (en) * 2011-01-12 2012-07-18 上海库达数字信息技术有限公司 3D rendering platform based on GPU cloud cluster
CN103870674A (en) * 2012-12-14 2014-06-18 辉达公司 Implementing a remote gaming server on a desktop computer
CN106127844A (en) * 2016-06-22 2016-11-16 民政部零研究所 Mobile phone users real-time, interactive access long-range 3D scene render exchange method
CN111627116A (en) * 2020-05-29 2020-09-04 联想(北京)有限公司 Image rendering control method and device and server
CN111866065A (en) * 2020-06-03 2020-10-30 西安万像电子科技有限公司 Rendering image returning method and device
CN112169322A (en) * 2019-07-04 2021-01-05 广州虎牙科技有限公司 Remote rendering method and device, electronic equipment and readable storage medium
CN112383539A (en) * 2020-11-11 2021-02-19 视若飞信息科技(上海)有限公司 Method and device for calling cloud browser based on remote process and electronic equipment
CN112614202A (en) * 2020-12-24 2021-04-06 北京元心科技有限公司 GUI rendering display method, terminal, server, electronic device and storage medium
CN112774193A (en) * 2021-01-14 2021-05-11 江苏卫健信息科技有限公司 Image rendering method of cloud game

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2511040A1 (en) * 2004-09-23 2006-03-23 The Governors Of The University Of Alberta Method and system for real time image rendering
CN1845177A (en) * 2006-05-17 2006-10-11 浙江大学 Three-dimensional remote rendering system and method based on image transmission
US20110063285A1 (en) * 2009-09-14 2011-03-17 International Business Machines Corporation Rendering of stereoscopic images with multithreaded rendering software pipeline
CN102592315A (en) * 2011-01-12 2012-07-18 上海库达数字信息技术有限公司 3D rendering platform based on GPU cloud cluster
CN103870674A (en) * 2012-12-14 2014-06-18 辉达公司 Implementing a remote gaming server on a desktop computer
CN106127844A (en) * 2016-06-22 2016-11-16 民政部零研究所 Mobile phone users real-time, interactive access long-range 3D scene render exchange method
CN112169322A (en) * 2019-07-04 2021-01-05 广州虎牙科技有限公司 Remote rendering method and device, electronic equipment and readable storage medium
CN111627116A (en) * 2020-05-29 2020-09-04 联想(北京)有限公司 Image rendering control method and device and server
CN111866065A (en) * 2020-06-03 2020-10-30 西安万像电子科技有限公司 Rendering image returning method and device
CN112383539A (en) * 2020-11-11 2021-02-19 视若飞信息科技(上海)有限公司 Method and device for calling cloud browser based on remote process and electronic equipment
CN112614202A (en) * 2020-12-24 2021-04-06 北京元心科技有限公司 GUI rendering display method, terminal, server, electronic device and storage medium
CN112774193A (en) * 2021-01-14 2021-05-11 江苏卫健信息科技有限公司 Image rendering method of cloud game

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
张晓芬等: "基于GPU的并行加速渲染算法的研究", 《计算机测量与控制》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114581580A (en) * 2022-02-28 2022-06-03 维塔科技(北京)有限公司 Method and device for rendering image, storage medium and electronic equipment
WO2023173516A1 (en) * 2022-03-18 2023-09-21 维塔科技(北京)有限公司 Data exchange method and apparatus, and storage medium and electronic device
CN116893913A (en) * 2023-09-08 2023-10-17 北京趋动智能科技有限公司 Remote program execution method, device, system, electronic equipment and storage medium
CN116893913B (en) * 2023-09-08 2024-01-23 北京趋动智能科技有限公司 Remote program execution method, device, system, electronic equipment and storage medium
CN117634369A (en) * 2023-12-13 2024-03-01 摩尔线程智能科技(北京)有限责任公司 Simulation method, model, electronic device, and storage medium

Also Published As

Publication number Publication date
CN114077508B (en) 2022-10-11

Similar Documents

Publication Publication Date Title
CN114077508B (en) Remote image rendering method and device, electronic equipment and medium
JP7100154B6 (en) Processor core scheduling method, device, terminal and storage medium
WO2020063040A1 (en) Processor core configuration method and apparatus, terminal, and storage medium
CN115600629B (en) Vehicle information two-dimensional code generation method, electronic device and computer readable medium
CN111338808B (en) Collaborative computing method and system
WO2023045973A1 (en) Method and apparatus for performing cloud rendering on live streaming gift, and electronic device and storage medium
CN116319790A (en) Rendering method, device, equipment and storage medium of full-true scene
CN111381749A (en) Image display and processing method, device, equipment and storage medium
CN112418389A (en) Data processing method and device, electronic equipment and computer readable storage medium
CN114040189A (en) Multimedia test method, device, storage medium and electronic equipment
US11195248B2 (en) Method and apparatus for processing pixel data of a video frame
CN113535371A (en) Method and device for multithreading asynchronous loading of resources
CN115695383A (en) Screen sharing method and system, electronic device and android device
CN114051024A (en) File background continuous transmission method and device, storage medium and electronic equipment
CN112948129A (en) Data transmission optimization method and device based on federal learning and readable storage medium
CN113014961A (en) Video pushing and transmitting method, visual angle synchronizing method and device and storage medium
WO2023241575A1 (en) Voice chat establishment method and apparatus, and device, storage medium and program product
WO2024002334A1 (en) View rendering method and apparatus, electronic device, storage medium, and program product
WO2019079940A1 (en) Graphics processing method, and related apparatus and device
CN113589927B (en) Split screen display method, head-mounted display device and computer readable medium
CN111522605B (en) Local procedure calling method, device, equipment and medium
WO2023197897A1 (en) Method and apparatus for processing live-streaming audio and video stream, and device and medium
CN112486700B (en) Communication method, device and storage medium
CN113132480B (en) Data transmission method, device and system
TW202340942A (en) System for deploying high availability service, method and computer readable medium thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant