WO2020253871A1 - 一种线上的视频数据输出方法、***及云平台 - Google Patents

一种线上的视频数据输出方法、***及云平台 Download PDF

Info

Publication number
WO2020253871A1
WO2020253871A1 PCT/CN2020/097440 CN2020097440W WO2020253871A1 WO 2020253871 A1 WO2020253871 A1 WO 2020253871A1 CN 2020097440 W CN2020097440 W CN 2020097440W WO 2020253871 A1 WO2020253871 A1 WO 2020253871A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
information
rendering
video data
client
Prior art date
Application number
PCT/CN2020/097440
Other languages
English (en)
French (fr)
Inventor
游晶
邱振谋
余昌弘
Original Assignee
广州虎牙科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201910551828.9A external-priority patent/CN112118213B/zh
Priority claimed from CN201910547506.7A external-priority patent/CN112118212B/zh
Priority claimed from CN201910547507.1A external-priority patent/CN112118463A/zh
Application filed by 广州虎牙科技有限公司 filed Critical 广州虎牙科技有限公司
Publication of WO2020253871A1 publication Critical patent/WO2020253871A1/zh
Priority to US17/556,182 priority Critical patent/US20220210520A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35—Details of game servers
    • A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/45—Controlling the progress of the video game
    • A63F13/49—Saving the game status; Pausing or ending the game
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42653—Internal components of the client ; Characteristics thereof for processing graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/654—Transmission by server directed to the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server

Definitions

  • This application relates to the field of Internet technology. Specifically, it provides an online video data output method, system and cloud platform.
  • cloud servers that can bring the above effects are generally collectively referred to as cloud platforms.
  • the above-mentioned cloud platform can be applied in game scenarios, and accordingly, the software stored in the cloud platform can be game software.
  • the cloud platform running software as game software as an example
  • the game software when the game software is run, a large amount of underlying data, audio data, and video data will be generated in the cloud platform.
  • the total data information is relatively mixed.
  • the user enters the corresponding interactive instructions the total data information will become more mixed, which leads to the problem of high resource granularity (ie high degree of data mixing), and increases to a certain extent.
  • the difficulty of communication is relatively mixed.
  • the purpose of the embodiments of the present application is to provide an online video data output method and system, which can reduce the resource granularity generated in the cloud platform, avoid certain communication obstacles, and can be applied online.
  • the embodiment of the present application provides an online video data output method.
  • the online video data output method is applied to a cloud platform, and the method includes:
  • the real-time information is sent from the server to the client so that the client can forward it to the cloud platform;
  • the rendered video is processed to obtain video data, and the video data is output.
  • the real-time information sent by the client can be received by the cloud platform in real time, and the real-time information can be sent by the server to the client and then forwarded by the client to the cloud platform.
  • the above real-time information is real-time data in the server, and the real-time data may include underlying information, audio and video information, and so on.
  • the cloud platform receives the real-time information, it performs corresponding data processing on the real-time information to obtain image information related to the display in the real-time information.
  • the image information is real-time image information, and the image information includes rendering data used to render the video. Obtain the rendering data from the image information and perform rendering based on the rendering data to obtain the rendered rendered video; process the rendered video (which may include encoding processing) to obtain the video data for transmission.
  • online interactive tasks can be completed in real time and real-time video data can be transmitted, thereby ensuring the progress of online tasks.
  • real-time information can also be extracted and classified to complete the acquisition of image information and even rendering data, and then complete the generation of rendered video through the combination of resource scheduling in the cloud platform and rendering data, thereby A dedicated rendering video generation process is formed, which reduces the granularity of resources in the cloud platform, that is, reduces the degree of resource data in the cloud platform. Avoid system crashes and downtimes caused by high degree of data mixing.
  • a second aspect of the embodiments of the present application provides a cloud platform, and the cloud platform includes:
  • the receiving unit is configured to receive real-time information sent by the client;
  • the processing unit is configured to perform data processing according to the real-time information to obtain image information; the real-time information is sent from the server to the client, so that the client is forwarded to the cloud platform;
  • An acquiring unit configured to acquire rendering data in the image information
  • the rendering unit is configured to perform rendering according to the rendering data to obtain a rendered video
  • the output unit is configured to process the rendered video to obtain video data, and output the video data.
  • the cloud platform includes five units: receiving unit, processing unit, acquisition unit, rendering unit, and output unit. These five units perform their duties and complete their corresponding work content, so that the above five units Can form a complete whole organically.
  • each work content can be well controlled, thereby ensuring a low degree of crossover of work and ensuring the smooth progress of the cloud platform work, that is, enhancing the stability of the cloud platform work and reducing The granularity of resources generated by the cloud platform.
  • the cloud platform communicates with the client, and the client communicates with the server. From this, in combination with the above receiving unit and output unit, it can be known that the cloud platform is applied to a server, a client, and a cloud platform.
  • the cloud platform can be used in online scenarios.
  • the third aspect of the embodiments of the present application provides an online video data output system.
  • the online video data output system includes a client and a cloud platform, where:
  • the client is configured to receive real-time information and send the real-time information to the cloud platform; wherein the real-time information is sent from the server to the client;
  • the cloud platform is configured to receive the real-time information, and perform data processing according to the real-time information to obtain image information;
  • the cloud platform is further configured to obtain rendering data from the image information, and perform rendering according to the rendering data to obtain a rendered video;
  • the cloud platform is also configured to process the rendered video to obtain video data, and output the video data.
  • the online video data output system includes a client and a cloud platform.
  • the system may also include a server.
  • the client receives the real-time information sent by the server, and forwards the real-time information to the cloud platform.
  • the cloud platform receives the above real-time information, it performs data processing according to the real-time information to obtain image information, and obtains the rendering data from the image information, and then renders according to the rendering data to obtain a rendered video, and further processes the rendered video (can be (Encoding process) to obtain video data and output the video data.
  • the output of online video data can be completed through the interaction between the client and the cloud platform and the work of the cloud platform.
  • the processing of real-time information by the cloud platform involves image information and rendering data, and the work of the cloud platform is targeted (that is, for images and rendering). Therefore, compared with the traditional cloud platform, the resource granularity generated in the cloud platform is lower, and there will be no obstacles that affect communication such as system crashes and shutdowns caused by high data congestion or similar reasons, thereby improving the system stability. Moreover, the system is still applied to the online system. Compared with the traditional cloud platform, it can complete online interactive tasks in real time.
  • the fourth aspect of the embodiments of the present application provides a live broadcast device, including a memory and a processor, the memory is configured to store a computer program, and the processor runs the computer program to make the live broadcast device execute the implementation according to the present application.
  • a live broadcast device including a memory and a processor
  • the memory is configured to store a computer program
  • the processor runs the computer program to make the live broadcast device execute the implementation according to the present application.
  • An example is the online video data output method described in any one of the first aspect.
  • the fifth aspect of the embodiments of the present application provides a computer-readable storage medium that stores computer program instructions.
  • the computer program instructions When the computer program instructions are read and run by a processor, they execute any one of the first aspect of the embodiments of the present application.
  • FIG. 1 is a schematic flowchart of an online video data output method provided by an embodiment of the application
  • FIG. 2 is a schematic flowchart of another online video data output method provided by an embodiment of the application.
  • FIG. 3 is a schematic structural diagram of a cloud platform provided by an embodiment of the application.
  • FIG. 4 is a system schematic diagram of an online video data output system provided by an embodiment of the application.
  • FIG. 5 is a system schematic diagram of another online video data output system provided by an embodiment of the application.
  • FIG. 1 is a schematic flowchart of an online video data output method provided by an embodiment of the application.
  • the online video data output method is applied online.
  • the method can be applied to live broadcast scenes, video conference scenes, or other scenes of multiple types that require image display or screen projection.
  • the online video data output method is applied to the cloud platform, specifically including:
  • the cloud platform receives real-time information sent by the client, and performs data processing according to the real-time information to obtain image information; the real-time information is sent from the server to the client, so that the client can forward it to the cloud platform.
  • the client can be software.
  • the client has input and output functions and the client can also have certain data output functions.
  • the video display function in this embodiment There are no restrictions.
  • the client when the client is used as software, the client can select any qualified device as its carrier, and its conditions can include data transmission conditions.
  • the carrier may be any one of a data box, a switch, and a data transmission terminal, and the type of the carrier in this embodiment is not limited in any way.
  • the client when used as software, it may also have data input conditions or output conditions.
  • the carrier may be a terminal device with communication function such as a handle and a button terminal, which is not limited in this embodiment.
  • the client when used as software, it may also have display conditions.
  • the carrier may be an electronic device such as a mobile phone, a platform, or a computer, which is not limited in this embodiment.
  • the client may be hardware, for example, the client may be a handle, a mobile phone, a projector, and so on.
  • the type or type of the client is not limited in this embodiment.
  • real-time information is real-time operating information generated and stored in the server.
  • the real-time information can be conference information or game information.
  • the content of real-time information is not limited. Only the real-time information is limited. Therefore, the real-time information is the basic condition for running the method online.
  • the real-time information is sent from the server, which means that the method requires follow-up of information from the server, that is, the method can be applied online.
  • the server there is no connection between the server and the cloud platform.
  • the cloud platform has no permission to connect with the server, that is, the server does not want to connect with the cloud platform, so the server does not give The corresponding communication authorization of the cloud platform.
  • the client has server authorization and software, but the client does not perform rendering operations or even interactive operations, which allows the cloud platform to perform tasks that the client does not perform.
  • the client can retrieve data from the server when it is operated and send it to the cloud platform for processing, thus forming a chained data transmission from the server to the client to the cloud platform, so no service is required
  • the terminal interacts with the cloud platform. It can be seen that this method is based on online operations, but also client-based.
  • the cloud platform performs data processing based on real-time information
  • the step of obtaining image information may include:
  • the cloud platform can process the information of the corresponding category, thereby avoiding cross-processing of data.
  • information division can be divided according to GUI (Graphical User Interface, graphical user interface).
  • application logic, audio data, and video data ie image information
  • GUI Graphical User Interface
  • the real-time information does not include the input information in the GUI, and the input information is the interactive information described later.
  • the cloud platform obtains rendering data from the image information, and performs rendering according to the rendering data to obtain a rendered video.
  • the image information may include multiple types of image-related information such as texture information, coordinate information, RGB information, and rendering data, which is not limited in this embodiment.
  • the rendering data may include various image information used for rendering and rendering rule methods.
  • the content specifically included in the rendering data is not specifically limited in this embodiment.
  • the cloud platform when the cloud platform has image resources, the cloud platform only needs to obtain the rendering rules in the rendering data to complete the rendering.
  • the rendering data may include image resources.
  • the rendering rules in the cloud platform when there are higher-order rendering rules in the cloud platform, only the most basic image information can be transmitted.
  • the cloud platform processes the rendered video to obtain video data, and output the video data.
  • the step of processing the rendered video to obtain video data may include:
  • a unique identification code or other authentication means can be set in the foregoing processing process, which is not limited in this embodiment.
  • the client can be a mobile phone
  • the server can be a game server
  • the cloud platform can be a game cloud platform.
  • the game server sends real-time information to the mobile phone.
  • the mobile phone receives the real-time information but does not process the real-time information, but forwards the real-time information to
  • the game cloud platform enables the game cloud platform to process according to the received real-time information to obtain the rendered video, and output the encoded rendered video stream to the corresponding device, so that the corresponding device can watch.
  • the mobile phone can display or not display the rendered video, and the rendered video displayed by the mobile phone can be sent back by the game cloud platform (it can be self-rendered display).
  • the rendered video online game video
  • the cloud platform can perform the basic processing and transmission display of the game.
  • the cloud platform sends video data to the client, the client will complete the cloud game process on the basis of no games.
  • the server is still connected to the client.
  • the connection between the client and the server can be cut off, without the need to go through the cloud platform, so that the real-time operation can be increased.
  • the operation, display, etc. do not have a delay or the delay is maintained within an allowable range, so it does not have any influence on the user's use.
  • the execution subject can be a cloud platform, or a cloud server with special capabilities, or even a data transmission terminal based on certain technologies (terminals with corresponding data processing capabilities). In this embodiment, There are no restrictions.
  • the online video data output method described in FIG. 1 is implemented, and the cloud platform can complete online interactive tasks in real time and transmit real-time video data, thereby ensuring the progress of online tasks.
  • the cloud platform can also complete the acquisition of image information and even rendering data by extracting and classifying real-time information, and then complete the generation of rendered video through the combination of resource scheduling and rendering data in the cloud platform , So as to form a dedicated and dedicated rendering video generation process, thereby reducing the resource granularity in the cloud platform, that is, reducing the degree of resource data in the cloud platform. It avoids problems such as system crashes and downtime caused by high degree of data mixing, and improves the stability of the system.
  • FIG. 2 is a schematic flowchart of another online video data output method provided by an embodiment of the application.
  • the schematic flow chart of the online video data output method described in FIG. 2 is improved based on the schematic flow chart of the online video data output method described in FIG. 1.
  • the online video data output method is applied to a cloud platform, which is composed of a first device and a second device.
  • the first device is an operating server
  • the second device is a rendering server.
  • the first device is an operating platform
  • the second device is a rendering platform.
  • the operating platform may be any one of multiple operating platforms included in the operating server
  • the rendering platform may be any one of multiple rendering platforms included in the rendering server.
  • the online video data output method includes the following steps:
  • the first device receives the interaction information and real-time information sent by the client; the real-time information is sent from the server to the client, so that the client can forward it to the cloud platform.
  • the cloud platform may receive interaction information and real-time information sent by the client, and optionally, may be executed by the first device in the cloud platform.
  • the client can be software.
  • the client has input and output functions and the client can also have certain data output functions.
  • the video display function in this embodiment There are no restrictions.
  • the client when the client is used as software, the client can select any qualified device as its carrier, and the condition can include data transmission conditions.
  • the client can also have data input conditions or output conditions, and the client can also have display conditions.
  • the first device and the second device are two servers of a cloud platform or sub-platforms in a server.
  • the first device and the second device may not be located on the same carrier.
  • the first device and other first devices can use one carrier, and the second device can use the same carrier with other second devices to achieve The effect of specializing in special affairs, thereby reducing the resource granularity generated by the cloud platform, that is, reducing the data interference caused by cross information.
  • the first device is used for interaction and running programs, and the second device is used for rendering, which will not be repeated in this embodiment.
  • the interactive information is information input by the user through the client, that is, interactive information in which online users participate.
  • the interaction information may be operation information performed by the user when playing a cloud game.
  • the interactive information may also be page turning operation information when the user is projecting on a public screen or when PPT is speaking.
  • the real-time information can refer to the content described in the foregoing, which will not be further described in this embodiment.
  • the interaction information may be input information in the aforementioned GUI decomposition.
  • the first device performs data processing according to the interaction information to obtain operation information, and sends the operation information to the client; so that the client forwards the operation information to the server, and triggers the operation of the server to update real-time information according to the operation information.
  • the interactive information may be an operation instruction input by the user at the client, that is to say, the interactive information is information used for interaction without any influence on the software. Therefore, the operating information obtained by processing the interactive information in the software is the information that affects the software itself.
  • the first device may obtain the operation information generated by the software according to the interaction information, and the operation information is used to feed back to the server, so that the content in the server is changed according to the interaction information input by the user.
  • the content described above is the basic operation content of online interaction.
  • the cloud platform processes the interaction information received from the client to obtain the operation information, and then forwards the operation information to the server through the client.
  • the server can perform data replacement and screen replacement according to the results of the underlying software operation in the cloud platform, thereby completing the replacement of real-time information, thereby ensuring the uninterrupted and stable online interaction.
  • the implementation of the foregoing implementation process can continuously implement online interaction behavior when the cloud platform is not in communication with the server, thereby ensuring the stability and universality of online interaction.
  • the operation information that affects the software itself can be sent back to the server, so the operation information passes the client back to the server to update real-time information.
  • the user's operation affects the factors in the software world, and the operation information will adjust the affected factors according to the rules of the software world, so that new real-time information appears in the software world, and then other subsequent operations are promoted.
  • the updated real-time information is the real-time information in the process, and the updated information can be applied to the current process in the next frame. It can be seen that the method is a method that runs in real time when operating online.
  • the information that the user watches every time is a picture corresponding to the real-time information.
  • the refresh frequency is high enough, multiple pictures watched by the user are connected to form a video, so that the player is playing Avoid watching discomfort during the game.
  • the method can also use softening, sharpening and other means to ensure the normal operation of the real-time picture, and even, in the case of a bad network, automatically adjust the picture quality of its output display to ensure the player's playing experience .
  • the first device performs data processing according to the interactive information and real-time information to obtain image information.
  • the above-mentioned interactive information may be an operation instruction input by the user, which generally affects the transformation of the image. Therefore, the image information may be obtained after data processing is performed based on the interactive information and real-time information. With this implementation, the acquisition of image information becomes closely related to the interactive information sent by the client. It can be seen that in an online system, image information is comprehensively determined through both interactive information and real-time information. Therefore, this step can add user factors on the basis of obtaining image information, so that the above image information can be combined with user behavior, and then image information based on user operations and even corresponding rendered videos can be obtained, realizing online users and cloud The function of platform interaction.
  • the first device may perform data splitting processing according to the received real-time information sent by the client to obtain scene information corresponding to the game software And the game architecture data information, the first device adjusts the scene information according to the acquired interaction information of the client and the game architecture data information to obtain image information.
  • the cloud platform when the cloud platform runs the game software, the cloud platform can obtain the interactive information input by the user and the real-time information sent by the server, and split the real-time information to obtain the scene information and game architecture corresponding to the game software.
  • Data information data information at the bottom of the game, an information group used to specify the basic rules of the game content.
  • the content in the interactive information is converted into operation control information according to the game architecture data information, and the scene information is adjusted according to the operation control information, thereby obtaining image information for controlling image display. It can be seen that the implementation of this embodiment can ensure that no data disorder or data collapse occurs in the image information acquisition process, thereby improving the stability of the image information acquisition.
  • the first device obtains rendering data from the image information, and sends the rendering data to the second device.
  • the image information may include various information about the image, such as texture information, coordinate information, RGB information, and rendering data, which is not limited in this embodiment.
  • the rendering data may include various image information used for rendering and rendering rule methods.
  • the content specifically included in the rendering data is not specifically limited in this embodiment.
  • the rendering data is used for rendering, so the content included in the rendering data can meet the rendering conditions, which is not limited in this embodiment.
  • the method of rendering based on the rendering data to obtain the rendered video is not limited.
  • the rendering method may include sub-frame rendering (single frame or multi-frame rendering method) and full frequency rendering (integrated rendering method) And other methods.
  • the first device receives the interaction information and real-time information sent by the client, and performs data processing according to the interaction information and the real-time information, and when image information is obtained, the obtained image information includes control information.
  • the first device When the first device obtains the rendering data in the image information and sends the rendering data to the second device, the first device may decouple the control information in the image information, obtain the rendering data, and send the rendering data to the second device .
  • the first device may obtain the interaction information of the client, and perform data processing according to the interaction information to obtain control information.
  • the interactive information is the information input by the user through the client
  • the control information is the information that acts on the application program running on the first device, which usually couples a variety of information.
  • the control information couples rendering data and other data, and the other data may be business logic data of the corresponding application.
  • the rendering data may include various image information used for screen rendering and rendering rule methods.
  • the first device decouples the various information contained in the control information to obtain the rendering data, that is, extracting the rendering data from the control information. And send the rendering data to the second device, and the second device implements rendering processing. This implementation method can avoid excessive loss of virtual machines.
  • the first device can run multiple applications, and the second device can perform video rendering on multiple application screens, which is convenient for data management and control management of the cloud platform, and greatly The resource utilization rate of the cloud platform is greatly improved, so that the cloud platform can have better applications and facilitate the realization of larger-scale operations.
  • the step of decoupling the control information in the image information by the first device, obtaining rendering data, and sending the rendering data to the second device includes:
  • the first device decouples the control information in the image information to obtain business logic data and rendering data
  • the first device extracts the rendering data and sends the rendering data to the second device.
  • the first device can process business logic data to advance the business logic process of the first device.
  • the first device performs decoupling processing on the control information in the image information to obtain business logic data and rendering data.
  • the business logic data is the information that acts on the application running on the first device.
  • the business logic data is processed by the first device to advance the business logic process of the first device.
  • the first device uses business logic data to advance the business logic process of the application instead of control information, which can improve the efficiency of the business logic process, so that the first device can have a better operating effect, which is more convenient for the cloud platform Data management and control management.
  • the second device receives the rendering data, and performs rendering according to the rendering data to obtain a rendered video.
  • the second device may receive the rendering data, obtain the network material corresponding to the rendering data, and render the rendering data and the network material to obtain the rendered video.
  • the second device may perform rendering according to both the network material and the rendering data, so as to obtain the rendered video.
  • the implementation of this implementation manner can improve the display accuracy of the rendered video, and can save the memory space occupied in the cloud platform.
  • the second device processes the rendered video to obtain video data, and outputs the video data to a display terminal corresponding to the cloud platform for processing and display.
  • the second device may perform encoding processing or other forms of processing on the rendered video to obtain video data for transmission, and output the video data to the display terminal corresponding to the cloud platform.
  • the display terminal may be connected to the second device correspondingly, so that the display terminal can receive the video data and perform decoding operations or other operations on the video data to obtain the rendered video, and then the display terminal can display the rendered video. It can be seen that, by implementing this embodiment, the rendered video can be displayed on the display terminal connected to the cloud platform, thereby realizing the operation of outputting the video.
  • the display terminal and the client may be two different software, and their carriers may be the same or different.
  • the display terminal is used to display the rendered video.
  • the processing of the second device may be encoding processing, and the processing of the display end may be decoding processing, and the two processings are corresponding, and specifically may also include processing such as encryption and identification.
  • step S201 is placed in a near-user server in the first device to receive real-time information faster; for another example, Steps S202 to S203 are placed in an idle server to obtain higher processing efficiency; for another example, step S205 is placed in a multi-threaded high-capability server to obtain a better rendering effect. It can be seen that using this method can effectively run each step more perfectly, thereby obtaining a better cloud platform use effect.
  • the client is a mobile phone
  • the server is a game server
  • the display is a viewer device
  • the first device is an interactive server
  • the second device is a rendering server.
  • the mobile phone obtains the data of the game server, and receives the user's operation for online play.
  • the processing of the underlying data is processed in the first device, and the second device is used for screen acquisition, rendering and Output so that the viewer's device can watch the user's play.
  • the mobile phone can perform real-time display based on the data of the game service, thereby forming a dual-end display of the mobile phone and the viewer's device, avoiding the traditional screen recording operation.
  • the dual-platform working mode of the first device and the second device can obtain video data more effectively and output the video data for the viewer's device to watch.
  • the cloud platform is decomposed into a first device and a second device, and operations such as obtaining real-time information, data processing, data extraction, rendering video, and outputting data can be put into the corresponding operating platform respectively.
  • the first device may be configured to obtain real-time information and perform data processing on the real-time information to obtain image information, then perform data extraction on the image information to obtain rendering data, and send the rendering data to the second device.
  • the second device receives the aforementioned rendering data
  • the second device performs corresponding image rendering according to the rendering data to obtain the corresponding rendered video, and then performs corresponding operations such as encoding processing on the rendered video to obtain the video data and output the video data.
  • the first device can also perform multiple operations of rendering video and outputting video data, so as to ensure that the first device and the second device perform their duties.
  • the work content of the first device and the second device is very clear and does not overlap. Therefore, in the process of using the cloud platform, there will be no high degree of data mixing, thus ensuring that the resource granularity in the cloud platform will not be too high, thereby improving the operation ability of the cloud platform and the ability to be coordinated and supervised (because the first The first device and the second device are two platforms. In the management process, only the unified management of multiple first devices or the unified management of multiple second devices is enough).
  • the cloud platform is divided into two parts: the first device and the second device.
  • the first device and the second device are organically combined to form the cloud platform, and the carrier of the first device and the second device can be Is different.
  • the operating server and the rendering server can constitute a complete cloud platform.
  • the organic composition is realized by the communication between the first device and the second device. After splitting the cloud platform, the first device and the second device each complete all the work of the original cloud platform.
  • the first device starts to receive real-time information, processes real-time information, and completes the acquisition and transmission of image data, while the second device renders, processes (such as encoding, encryption, and other types of processing) and outputs the image data.
  • splitting the cloud platform can effectively separate the interactive function, running function and rendering function, so as to achieve the effect of each high-precision work, thereby reducing the granularity of resources generated when the cloud platform is working.
  • this method can also improve the management, operation and maintenance capabilities of the cloud platform, and thus better complete the cloud The work of the platform.
  • control information is obtained by the first device performing data processing on the acquired interaction information of the first client.
  • the second device may send the video data to the first client, so that the first client displays the video corresponding to the video data.
  • the second device may send video data to the first client and the second client, so that the first client and the second client display videos corresponding to the video data.
  • the interaction information of the client includes the interaction information of the first client.
  • the second device sends the video data to The first client, so that the first client displays the video corresponding to the video data.
  • the application program is run on the first device of the cloud platform, and the user sends the input interaction information to the first device of the cloud platform through the first client, which promotes the business logic process of running the application program on the first device.
  • this situation can be cloud gaming or cloud office, etc.
  • the second device after receiving the rendering data through the second device and processing according to the rendering data to obtain the rendered video data, the second device sends the video data to the first client and the second client , So that the first client and the second client display videos corresponding to the video data.
  • a second client is added that can also receive the video data of the corresponding application screen and display the video.
  • the user's operation of the application is broadcast live.
  • the second device sends out video data, which can improve the operating capability and operating efficiency of the first device, thereby better achieving data management and control management of the cloud platform.
  • the aforementioned interaction information may include game operation information
  • the control information may be obtained by the first device performing data processing on the acquired game operation information of the client.
  • the video data includes game video data.
  • the second device may receive the rendering data, perform rendering according to the rendering data to obtain the rendered video, process the rendered video, obtain the rendered game video data, and output the game video data.
  • the interaction information includes game operation information
  • the video data includes game video data, that is, the application corresponding to the client is a game.
  • the cloud platform can better realize data management and control management, and the resource utilization rate is high, and it can realize the operation of more people and larger-scale cloud games.
  • the interaction information may include working software information
  • the control information is obtained by the first device performing data processing on the acquired working software information of the client.
  • the second device may receive the rendering data, perform rendering according to the rendering data, obtain the rendered video, process the rendered video, obtain the rendered working video data, and output the working video data.
  • the interactive information includes working software operation information
  • the video data includes working video data, that is, the application corresponding to the client is the working software.
  • the cloud platform can better realize data management and control management, and the resource utilization rate is high, and it can realize the operation of more people and larger-scale cloud office.
  • the interaction information includes remote conference communication information
  • the control information is obtained by the first device performing data processing on the acquired remote conference communication information of the client.
  • the video data includes remote meeting video data.
  • the second device may receive the rendering data, perform rendering according to the rendering data, obtain the rendered video, process the rendered video, obtain the rendered remote meeting video data, and output the remote meeting video data.
  • the interaction information includes remote conference communication information
  • the video data includes remote conference video data, that is, the application corresponding to the client is a remote conference.
  • the cloud platform can better realize data management and control management, and the resource utilization rate is high, and it can realize the operation of more people and larger-scale cloud conferences.
  • the online video data output method provided in this embodiment can complete online interactive tasks in real time and transmit real-time video data, thereby ensuring the progress of online tasks.
  • a dedicated rendering video generation process is formed, which reduces the granularity of resources in the cloud platform.
  • the method can also integrate the interaction between the client and the server and the interaction between the client and the cloud platform to form a complete interactive system, thereby completing online data interaction and the generation and output of video data in parallel, thereby obtaining
  • the implementation of video data based on user operations and underlying data ensures that while online operations are performed, it also has the ability to take into account external display.
  • FIG. 3 is a schematic structural diagram of a cloud platform 500 provided by an embodiment of the application.
  • the cloud platform 500 includes:
  • the receiving unit 311 is configured to receive real-time information sent by the client 400;
  • the processing unit 312 is configured to perform data processing according to real-time information to obtain image information; the real-time information is sent from the server 300 to the client 400 so that the client can forward it to the cloud platform 500;
  • the obtaining unit 313 is configured to obtain rendering data in the image information
  • the rendering unit 321 is configured to perform rendering according to the rendering data to obtain a rendered video
  • the output unit 322 is configured to process the rendered video, obtain video data, and output the video data.
  • the receiving unit 311, the processing unit 312, and the acquiring unit 313 can be mounted on the first device 510 included in the cloud platform 500, and the rendering unit 321 and the output unit 322 can be mounted on the second device 520 included in the cloud platform 500.
  • the client can be software.
  • the client has an input and output function and the client can also have a certain data output function.
  • the video display function there is no limitation in this embodiment. .
  • the client when the client is used as software, the client can select any qualified device as its carrier, and the condition may include data transmission conditions.
  • the carrier may be any one of a data box, a switch, and a data transmission terminal, and the type of the carrier in this embodiment is not limited in any way.
  • the client when used as software, it may also have data input conditions or output conditions.
  • the carrier may be a terminal device with communication function such as a handle and a button terminal, which is not limited in this embodiment.
  • the client when used as software, it may also have display conditions.
  • the carrier may be an electronic device such as a mobile phone, a platform, or a computer, which is not limited in this embodiment.
  • the client can be hardware.
  • the client can be a handle, mobile phone, projector, etc.
  • the client has the above capabilities, nothing is done about the type or type of the client in this embodiment. limited.
  • multiple units included in the cloud platform 500 can be deployed separately.
  • the receiving unit 311 that receives real-time information is arranged near the user, so that the receiving unit 311 can receive real-time information faster.
  • separate deployment of the processing unit 312, the acquisition unit 313, and the rendering 321 can make each unit perform a completely different job, so that the result obtained by each job is accurate and reliable.
  • the output unit 322 can still be arranged near the user, so that the user can receive video data faster. It can be seen that this method can reduce the data transmission process outside the cloud platform 500, thereby effectively reducing the use delay and improving the use effect of the cloud platform 500.
  • real-time information is real-time operating information generated and stored on the server.
  • the real-time information can be conference information or game information. For this reason, nothing is done about the content of real-time information in this embodiment. Restriction only restricts the fact that the information is real-time, and that is why the real-time information is the basic condition for running the method online.
  • the real-time information is sent by the server, which means that the method can be followed up with the information of the server, that is, the method can be applied online.
  • the server does not exist or the real-time information does not exist, this method will be difficult to follow up.
  • the server there is no connection between the server and the cloud platform, that is, the cloud platform has no permission to connect with the server, that is, the server does not want to connect with the cloud platform, so the server is not connected.
  • the client has server authorization and software, but the client does not perform rendering operations or even interactive operations, which allows the cloud platform to perform tasks that the client does not perform.
  • the client can retrieve data from the server when it is operated and send it to the cloud platform for processing, thereby forming a chained data transmission from the server to the client to the cloud platform, so the server does not need to communicate with the cloud platform Interactive. It can be seen that this method is based on online operations, but also client-based.
  • the cloud platform 500 can apply any of the explanations and descriptions described in the foregoing embodiment, and details are not repeated in this embodiment.
  • the cloud platform 500 described in FIG. 3 includes five units: a receiving unit 311, a processing unit 312, an acquiring unit 313, a rendering unit 321, and an output unit 322. These five units each perform their duties and complete their corresponding work content, so that the above five units can organically form a complete whole. Through the five independently operating units, each work content can be well controlled, thereby ensuring a low degree of crossover of work and ensuring the smooth progress of the work of the cloud platform 500, that is, enhancing the stability of the cloud platform 500 and reducing the cloud The granularity of resources generated by the platform 500.
  • the cloud platform 500 communicates with the client, and the client communicates with the server.
  • the cloud platform 500 is applied to a server, a client, and In the system of the cloud platform 500, the cloud platform 500 is therefore applied in an online scenario.
  • the cloud platform 500 in practice can improve the use effect of the cloud platform 500 by deploying units to different locations.
  • FIG. 4 is a schematic diagram of the system structure of an online video data output system provided by an embodiment of the application.
  • the online video data output system includes a client 400 and a cloud platform 500.
  • the client 400 is configured to receive real-time information and send the real-time information to the cloud platform 500; the real-time information is sent from the server 300 to the client 400;
  • the cloud platform 500 is configured to receive real-time information, and perform data processing according to the real-time information to obtain image information;
  • the cloud platform 500 is also configured to obtain rendering data from the image information, and perform rendering according to the rendering data to obtain a rendered video;
  • the cloud platform 500 is also configured to process the rendered video, obtain video data, and output the video data.
  • the cloud platform 500 included in the online video data output system may be the cloud platform 500 described in Embodiment 3, which will not be repeated in this embodiment.
  • the online video data output system can be applied to any of the explanations and descriptions described in the above-mentioned embodiment, which will not be repeated in this embodiment.
  • the output of online video data can be completed through the interaction between the client and the cloud platform 500 and the work of the cloud platform 500.
  • the processing of real-time information by the cloud platform 500 may include processing of image information and rendering data, and the work of the cloud platform 500 is targeted (that is, for images and rendering). Therefore, compared with the traditional cloud platform 500, the resource granularity generated in the cloud platform 500 is lower, and the system will not produce system crashes and downtimes caused by high data congestion or similar reasons that will affect communication. Obstacles to improve the stability of the system. Compared with the traditional cloud platform 500, the system can also be applied online.
  • FIG. 5 is a schematic diagram of the system structure of another online video data output system provided by an embodiment of the application.
  • the schematic structural diagram of the online video data output system described in FIG. 5 is an improvement based on the structural schematic diagram of the online video data output system described in FIG. 4.
  • the cloud platform 500 is composed of a first device 510 and a second device 520 together.
  • the first device 510 is configured to receive real-time information, and perform data processing according to the real-time information to obtain image information;
  • the first device 510 is further configured to obtain rendering data in the image information, and send the rendering data to the second device 520;
  • the second device 520 is configured to receive rendering data, and perform rendering according to the rendering data to obtain a rendered video;
  • the second device 520 is also configured to process the rendered video to obtain video data, and output the video data.
  • the online video data output system can be applied to any of the explanations and descriptions described in the above-mentioned embodiment, which will not be repeated in this embodiment.
  • the resource granularity generated by the cloud platform 500 is bound to be relatively low.
  • it can also be compatible with online operations (referring to the server 300 , Interaction between the client 400 and the cloud platform 500).
  • the client 400 may be configured to receive real-time information, obtain interactive information based on the client 400, and send the interactive information and real-time information to the first device 510;
  • the first device 510 is configured to receive real-time information and perform data processing according to the real-time information.
  • the operation of obtaining image information includes: receiving interactive information and real-time information, and performing data processing according to the interactive information and real-time information to obtain image information.
  • the first device 510 may also perform processing and acquisition according to the interaction information sent by the client 400 to obtain the image information related to the interaction information input by the user in real time. As a result, it is possible to strengthen online interaction capabilities while increasing the ability to interact with users.
  • the online video data output system further includes a server 300, where:
  • the first device 510 is also configured to perform data processing according to the interaction information to obtain operation information;
  • the first device 510 is also configured to send operation information to the client 400;
  • the client 400 is also configured to receive operation information and send the operation information to the server 300;
  • the server 300 is configured to receive operation information and update real-time information according to the operation information.
  • the online video data output system further includes the server 300, that is, the online video data output system may include the server 300, the client 400, the first device 510, and the second device 520.
  • the online interaction process can interact between these four, and the content described in the above-mentioned realization process is part of the content of the real-time interaction in which the real-time information is replaced according to the user's operation information.
  • real-time information will also be updated based on the clock or underlying data in the server. Therefore, this part of the content is used to indicate the online video data output system, and it can also include interactive information (or operation information) The interactive process, thereby improving the compatibility and versatility of the system, thereby enhancing the interactive ability.
  • the online video data output system further includes a display terminal 600, where:
  • the display terminal 600 is configured to receive video data, and process the video data to obtain a display video;
  • the display terminal 600 is also configured to output display videos.
  • the online video data output system further includes a display terminal 600, which may be a display terminal of a rendered video (ie, a display video) corresponding to the video data.
  • the display terminal can be mainly configured to display rendered video, so as to ensure the integrity of the system and provide an output device for rendered video.
  • the client 400 is also configured to process real-time information to obtain real-time video, and output the real-time video.
  • the client 400 may also perform rendering and output real-time video according to the real-time information after receiving the real-time information.
  • the client 400 may be a device having a display function and an image processing function. In the system, it can be ensured that the system can be displayed during the user's use and output display on the outside, thereby ensuring the comfort of the user's interactive use, and can also meet the real-time requirements and effect requirements of other personnel .
  • a barrage or icon can be added to the video data by the built-in software of a second device 520.
  • system can be applied to live broadcast and data sharing, which is not limited in this embodiment.
  • the cloud platform included in the online video data output system may be the cloud platform described in the above-mentioned embodiment, which will not be repeated in this embodiment.
  • the online video data output system can be applied to any of the explanations and descriptions described in the above-mentioned embodiment, which will not be repeated in this embodiment.
  • the online video data output system described in FIG. 5 can complete the output of online video data through the interaction between the client and the cloud platform and the work of the cloud platform.
  • the processing of real-time information by the cloud platform involves image information and rendering data, that is, the work of the cloud platform is targeted (that is, for images and rendering). Therefore, compared with the traditional cloud platform, the resource granularity generated in the cloud platform is lower, and the system will not produce system crashes and downtimes that affect communication due to the high degree of data mixing or similar reasons. Thereby improving the stability of the system.
  • the system can also be applied online. It can also be compatible with various display peripherals and client carriers, so that the system can be organically compatible with various related equipment or scenes, so that the system has corresponding universality.
  • An embodiment of the present application also provides a live broadcast device, including a memory and a processor, the memory is used to store a computer program, and the processor runs the computer program so that the live broadcast device executes according to the foregoing embodiments of the present application Any one of the online video data output methods.
  • the embodiment of the present application provides a computer-readable storage medium that stores computer program instructions.
  • the computer program instructions When the computer program instructions are read and run by a processor, they execute the line described in any one of the foregoing embodiments of the present application.
  • the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist alone, or two or more modules may be integrated to form an independent part.
  • the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network). Equipment, etc.) execute all or part of the steps of the methods described in the embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .
  • online interactive tasks can be completed in real time, and real-time video data can be transmitted to ensure online tasks.
  • real-time video data can be transmitted to ensure online tasks.
  • the acquisition of image information and even rendering data is completed, and the generation of rendering videos is completed through the combination of resource scheduling and rendering data in the cloud platform, thus forming a special project. Render the video generation process, thereby reducing the granularity of resources in the cloud platform.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本申请实施例提供一种线上的视频数据输出方法、***及云平台，涉及互联网技术领域，该线上的视频数据输出方法应用于云平台，包括：接收客户端发送的实时信息，并根据实时信息进行数据处理，得到图像信息；实时信息是由服务端发送至客户端，以使客户端转发至云平台的；在图像信息中获取渲染数据，并根据渲染数据进行渲染，得到渲染视频；对渲染视频进行处理，得到视频数据，并输出视频数据。实施这种实施方式，能够降低云平台中所产生的资源粒度，避免一定的通讯障碍，并能够在线上进行应用。

Description

一种线上的视频数据输出方法、***及云平台
相关申请的交叉引用
本申请要求于2019年6月21日提交中国专利局的申请号为2019105518289、名称为“一种线上的视频数据输出方法、***及云平台”的中国专利申请的优先权、于2019年6月21日提交中国专利局的申请号为2019105475071、名称为“一种信息处理方法、云平台及信息处理***”的中国专利申请的优先权，以及要求于2019年6月21日提交中国专利局的申请号为2019105475067、名称为“一种基于云平台的视频数据输出方法、***及云平台”，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及互联网技术领域，具体而言，提供一种线上的视频数据输出方法、***及云平台。
背景技术
目前，存在一种将软件存储在云服务器中进行运行的方法，用户在使用上述的软件时可不必通过自己的硬件设备进行相应的运行，使得用户可以使用云服务器的强大功能且避免强化本地设备的资金投入和维护成本。在实践中，能带来上述效果的云服务器一般被统称为云平台。
上述的云平台可应用在游戏场景中，相应地，云平台中存储的软件可为游戏软件。以云平台运行软件为游戏软件为例，当该游戏软件被运行时，云平台中会产生大量的底层数据、音频数据以及视频数据。使得总的数据信息相对混杂，当用户再输入相应的交互指令时，总的数据信息将变得更加混杂，从而导致了资源粒度高(即数据混杂程度高)的问题，并在一定程度上增加了通讯难度。
发明内容
本申请实施例的目的在于提供一种线上的视频数据输出方法及***，能够降低云平台中所产生的资源粒度，避免一定的通讯障碍，并能够在线上进行应用。
本申请实施例提供了一种线上的视频数据输出方法，所述线上的视频数据输出方法应用于云平台，所述方法包括：
接收客户端发送的实时信息，并根据所述实时信息进行数据处理，得到图像信息；所述实时信息是由服务端发送至客户端，以使客户端转发至所述云平台的；
在所述图像信息中获取渲染数据，并根据所述渲染数据进行渲染，得到渲染视频；
对所述渲染视频进行处理，得到视频数据，并输出所述视频数据。
在上述实现过程中，首先，可以由云平台实时接收客户端发送的实时信息，该实时信息可以是由服务端发给客户端再由客户端转发给云平台的。其中，上述实时信息为服务端中的实时数据，而该实时数据可以包括底层信息及音视频信息等。在云平台接收到实时信息之后，对实时信息进行相应的数据处理，得到实时信息中与显示相关的图像信息。其中，图像信息是实时的图像信息，而该图像信息中包括用于渲染视频的渲染数据。在图像信息中获取渲染数据并根据该渲染数据进行渲染，得到渲染后的渲染视频；并对渲染视频进行 处理(可以包括编码处理)，得到用于传输的视频数据。
实施这种实施方式，可以实时完成线上的交互任务，并传输实时的视频数据，从而保证线上任务的进行。此外，实施这种实施方式，还可以通过对实时信息进行提取分类处理，完成对图像信息甚至于渲染数据的获取，进而通过云平台内资源的调度与渲染数据的结合完成渲染视频的生成，从而形成一种专事专项专办的渲染视频生成流程，进而降低了云平台中的资源粒度，即降低了云平台中资源数据混杂程度。避免了因数据混杂程度高等导致的***崩溃及停机等问题。
本申请实施例第二方面提供了一种云平台，所述云平台包括：
接收单元，被配置成接收客户端发送的实时信息；
处理单元，被配置成根据所述实时信息进行数据处理，得到图像信息；所述实时信息是由服务端发送至客户端，以使客户端转发至所述云平台的；
获取单元，被配置成在所述图像信息中获取渲染数据；
渲染单元，被配置成根据所述渲染数据进行渲染，得到渲染视频；
输出单元，被配置成对所述渲染视频进行处理，得到视频数据，并输出所述视频数据。
在上述实现过程中，云平台包括接收单元、处理单元、获取单元、渲染单元以及输出单元五个单元，这五个单元各司其职，各自完成其对应的工作内容，从而使得上述五个单元可以有机地构成一个完整的整体。可选地，通过五个独立运行的单元，可以很好的控制各自的工作内容，从而保证工作的交叉程度较低，保证云平台工作的顺利进行，即增强了云平台工作的稳定性，降低了云平台产生的资源粒度。在上述实现过程中，云平台与客户端通讯连接，而客户端与服务端通讯连接，由此结合上述的接收单元和输出单元可知，该云平台是应用于具有服务端、客户端和云平台的***中的，因此该云平台可应用于在线的场景中。
本申请实施例第三方面提供了一种线上的视频数据输出***，所述线上的视频数据输出***包括客户端和云平台，其中，
所述客户端，被配置成接收实时信息，并发送所述实时信息至所述云平台；其中，所述实时信息是服务端发送至客户端的；
所述云平台，被配置成接收所述实时信息，并根据所述实时信息进行数据处理，得到图像信息；
所述云平台，还被配置成在所述图像信息中获取渲染数据，并根据所述渲染数据进行渲染，得到渲染视频；
所述云平台，还被配置成对所述渲染视频进行处理，得到视频数据，并输出所述视频数据。
在上述实现过程中，线上的视频数据输出***包括客户端和云平台，可选地，该***还可以包括服务端。其中客户端接收服务端发送来的实时信息，并转发该实时信息至云平台。云平台在接收到上述实时信息时根据实时信息进行数据处理得到图像信息，并在该图像信息中获取渲染数据，进而再根据渲染数据进行渲染，得到渲染视频，进一步地对渲染 视频进行处理(可以为编码处理)得到视频数据并输出该视频数据。
实施这种实施方式，可以通过客户端和云平台两者的交互和云平台的工作完成线上视频数据的输出。云平台对实时信息的处理涉及到图像信息和渲染数据，云平台的工作是有针对性的(即针对图像和渲染的)。因此相对于传统的云平台，该云平台中所产生的资源粒度是更低的，不会产生因数据混杂程度高或相似原因导致的***崩溃与停机等会影响通讯的障碍，从而提高***的稳定性。且该***还是应用于线上的***，相对于传统的云平台来说，可以实时完成线上的交互任务。
本申请实施例第四方面提供了一种直播设备，包括存储器以及处理器，所述存储器被配置成存储计算机程序，所述处理器运行所述计算机程序以使所述直播设备执行根据本申请实施例第一方面中任一项所述的线上的视频数据输出方法。
本申请实施例第五方面提供了一种计算机可读存储介质，其存储有计算机程序指令，所述计算机程序指令被一处理器读取并运行时，执行本申请实施例第一方面中任一项所述的线上的视频数据输出方法。
附图说明
为了更清楚地说明本申请实施例的技术方案，下面将对本申请实施例中所需要使用的附图作简单地介绍，应当理解，以下附图仅示出了本申请的某些实施例，因此不应被看作是对范围的限定，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他相关的附图。
图1为本申请实施例提供的一种线上的视频数据输出方法的流程示意图；
图2为本申请实施例提供的另一种线上的视频数据输出方法的流程示意图；
图3为本申请实施例提供的一种云平台的结构示意图；
图4为本申请实施例提供的一种线上的视频数据输出***的***示意图；
图5为本申请实施例提供的另一种线上的视频数据输出***的***示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行描述。
请参看图1，图1为本申请实施例提供的一种线上的视频数据输出方法的流程示意图。该线上的视频数据输出方法应用于线上，可选地，该方法可以应用于直播场景、视频会议场景或者其他需要图像显示或投屏的多类场景。其中，该线上的视频数据输出方法应用于云平台，具体包括：
S101、云平台接收客户端发送的实时信息，并根据实时信息进行数据处理，得到图像信息；实时信息是由服务端发送至客户端，以使客户端转发至云平台的。
作为一种可能的实现方式，客户端可以为软件，当客户端为软件时，该客户端具有输入输出功能并且该客户端还可以具有一定数据输出功能，而对于视频显示功能，本实施例中不作任何限定。
在一种可能的实现方式中，客户端作为软件时，客户端可以选取任何符合条件的设备作为其载体，其条件可以包括数据传输条件。在上述描述的基础上，该载体可以为数据盒、 交换机以及数据传输终端中的任意一种，本实施例中载体的类型不作任何限定。
在本实施例中，客户端作为软件时，还可以具有数据输入条件或输出条件。在上述描述的基础上，其载体可以为手柄、按键终端等具有通讯功能的终端设备，对此本实施例中不作任何限定。
在本实施例中，客户端作为软件时，还可以具有显示条件。在上述描述的基础上，其载体可以为手机、平台或者电脑等电子设备，对此本实施例中不作任何限定。
另外，在一些可能的实现方式中，客户端可以为硬件，例如，客户端可以为手柄、手机、投影仪等等。在该客户端具有上述能力时，本实施例中对于客户端的类型或种类不做任何限定。
本实施例中，实时信息为服务端中产生并存储的实时运行信息，可选地，该实时信息可以为会议信息，还可以为游戏信息，本实施例中对于实时信息的内容不作任何限定，仅仅对信息是具有实时性这一点进行限定，也正是因此，该实时信息是线上运行该方法的基础条件。
在本实施例中，实时信息是由服务端中发送出来的，这也就说明，在该方法中需要服务器的信息跟进，也就是说，该方法可以是应用于线上的。
本实施例中，服务端与云平台之间是不相连接的，可以是云平台没有与服务端连接的权限，也就是说，服务端并不希望与云平台相连接，所以服务端未给予云平台相应的通讯授权。举例来说，客户端具有服务端授权且具有软件，但是客户端并不进行渲染操作甚至不进行交互操作，这就使得云平台可进行客户端不进行的工作。举例来说，客户端在***作的时候可以从服务端调取数据，并发送至云平台进行处理，从而形成了服务端至客户端至云平台的链式数据传输，因此也就不需要服务端与云平台进行交互了。可见，该方法是基于线上操作的，更是基于客户端的。
作为一种可选的实施方式，云平台根据实时信息进行数据处理，得到图像信息的步骤可以包括：
根据实时信息进行信息划分，得到图像信息、音频信息以及数据信息；
获取上述的图像信息。
实施这种实施方式，云平台可以对对应的门类的信息进行处理，从而避免了数据的交叉处理。
在本实施例中，信息划分可以根据GUI(Graphical User Interface，图形用户界面)进行划分，可选地，根据GUI可以划分出运用逻辑、音频数据和视频数据(即图像信息)。
本实施例中，实时信息不包括GUI中的输入信息，而该输入信息为后面叙述的交互信息。
S102、云平台在图像信息中获取渲染数据，并根据渲染数据进行渲染，得到渲染视频。
本实施例中，图像信息可以包括贴图信息、坐标信息、RGB信息以及渲染数据等多类关于图像的信息，对此本实施例中不作任何限定。
本实施例中，渲染数据可以包括用于渲染的多种图像信息和渲染的规则方法，对于渲 染数据具体包括的内容，本实施例中不作具体限定。
作为一种可能的实现方式，当云平台中具有图像资源的时候，云平台只需要获取渲染数据中的渲染规则便可以完成渲染。作为另一种可能的实现方式，当云平台中图像资源不足的时候，渲染数据可以包括图像资源。此外，在另一些可能的实现方式中，当云平台中具有更高阶的渲染规则时，可以只传输最基本的图像信息。
S103、云平台对渲染视频进行处理，得到视频数据，并输出视频数据。
作为一种可选的实施方式，对渲染视频进行处理，得到视频数据的步骤可以包括：
对渲染视频进行编码处理，得到视频数据。
实施这种实施方式，可以便于传输。
在本实施例中，上述的处理过程可以设置唯一识别码或者其他认证手段，对此本实施例中不作任何限定。
本实施例中，对于输出视频数据的方法不作任何限定。
作为一种可能的实现方式，客户端可以为手机，服务端可以为游戏服务器，云平台可以为游戏云平台。其中，用户在使用手机玩游戏时，手机中运行的游戏连接着游戏服务器，此时游戏服务器发送实时信息给手机，手机接收实时信息但并不对该实时信息进行处理，而是转发该实时信息至游戏云平台，以使游戏云平台根据接收到的实时信息进行处理，得到渲染视频，并输出编码后的渲染视频流至相应的设备，以使相应的设备可以进行观看。在此之中，手机可以显示、也可以不显示渲染视频，手机显示的渲染视频可以是游戏云平台发送回来的(可以为自我渲染显示)。而渲染视频(线上的游戏视频)可以在线上进行展示播放，以便更多人观看。
在本实施例中，云平台可以进行游戏的基本处理和传输展示，当云平台发送视频数据至客户端的时候，客户端在无游戏的基础上将完成云游戏的过程。其中，服务器连接的仍是客户端，在用户不想进行云游戏的时候，可以切断客户端与服务器的连接，而不需要通过云平台，从而可以增加操作的实时性。
在本实施例中，在实践情况下，操作、显示等是不具有延迟或者延迟维持在允许的范围内，因此对于用户使用并不具有任何影响。
本实施例中，执行主体可以为云平台，也可以为具有特殊能力的云端服务器，甚至还可以为基于某些技术的数据传输终端(具有相应数据处理能力的终端)，对此本实施例中不作任何限定。
本实施例中，实施图1所描述的线上的视频数据输出方法，云平台能够实时完成线上的交互任务，并传输实时的视频数据，从而保证线上任务的进行。此外，实施这种实施方式，云平台还可以通过对实时信息进行提取分类处理，完成对图像信息甚至于渲染数据的获取，进而通过云平台内资源的调度与渲染数据的结合完成渲染视频的生成，从而形成一种专事专项专办的渲染视频生成流程，进而降低云平台中的资源粒度，即降低了云平台中资源数据混杂程度。避免出现因数据混杂程度高等导致的***崩溃及停机等问题，提高了***的稳定性。
请参看图2，图2为本申请实施例提供的另一种线上的视频数据输出方法的流程示意图。图2所描述的线上的视频数据输出方法的流程示意图是根据图1所描述的线上的视频数据输出方法的流程示意图进行改进得到的。其中，该线上的视频数据输出方法应用于云平台中，该云平台由第一设备以及第二设备共同构成。其中，在一种可能的实施方式中，第一设备为运行服务器、第二设备为渲染服务器。在另一种可能的实施方式中，第一设备为运行平台、第二设备为渲染平台。其中，运行平台可为运行服务器包含的多个运行平台中的任意一个，渲染平台可为渲染服务器包含的多个渲染平台中的任意一个。该线上的视频数据输出方法的包括以下步骤：
S201、第一设备接收客户端发送的交互信息和实时信息；实时信息是由服务端发送至客户端，以使客户端转发至云平台的。
本实施例中，云平台可接收客户端发送的交互信息和实时信息，可选地，可为云平台中的第一设备来执行。作为一种可能的实施方式，客户端可以为软件，当客户端为软件时，该客户端具有输入输出功能并且该客户端还可以具有一定数据输出功能，而对于视频显示功能，本实施例中不作任何限定。
在本实施例中，客户端作为软件时，客户端可以选取任何符合条件的设备作为其载体，该条件可以包括数据传输条件。客户端还可以具有数据输入条件或输出条件，且客户端还可以具有显示条件。
本实施例中，第一设备和第二设备为云平台的两服务器或者是服务器中的子平台。可选地，第一设备和第二设备可以不位于同一载体上，例如第一设备可以和其他的第一设备共同使用一个载体，第二设备可以与其他第二设备使用一个载体，从而可以实现专事专办的效果，进而降低云平台产生的资源粒度，即降低交叉信息带来数据干扰。
本实施例中，第一设备用于交互与运行程序，而第二设备用于渲染，对此本实施例中不再多加赘述。
本实施例中，交互信息为用户通过客户端输入的信息，即线上用户参与的交互信息。作为一种实施方式，该交互信息可以为用户在游玩云游戏时所进行的操作信息。作为另一种实施方式，该交互信息还可以为用户在公屏投影时或PPT讲述时的翻页操作信息。
本实施例中，实时信息可以参照前述中描述的内容，本实施例中将不再多加描述。本实施例中，交互信息可以为上述GUI分解中的输入信息。
S202、第一设备根据交互信息进行数据处理得到操作信息，并发送操作信息至客户端；以使客户端转发操作信息至服务端，触发服务端根据操作信息更新实时信息的操作。
本实施例中，交互信息可以是用户在客户端输入的操作指令，也就是说交互信息是用于交互的信息，而并未对软件产生任何影响。因此，在软件中对交互信息进行处理得到的操作信息是影响了软件本身的信息。
第一设备可以获取软件根据交互信息而产生的操作信息，该操作信息用于反馈至服务器，以使服务器中内容根据用户输入的交互信息进行更迭。上述描述的内容为线上交互的基本操作内容，在上述实现过程中，云平台在对从客户端接收到的交互信息进行处理得到 操作信息之后，再通过客户端转发该操作信息至服务端，从而使得服务端可以根据云平台中软件底层操作的结果进行数据更替以及画面更替，从而完成实时信息的更迭，进而可以保证线上交互的不间断性和稳定性。从另一方面来说，实施上述实现过程可以在云平台不与服务端通讯连接时，无间断地实现线上的交互行为，从而也可以保证线上交互的稳定性和普适性。
在本实施例中，影响了软件本身的操作信息可被发回服务端，因此操作信息途径客户端回到服务端对实时信息进行更新。举例来说，用户的操作影响了软件世界的因素，该操作信息将根据软件世界的规则对被影响的因素进行调整，从而使得软件世界对应出现新的实时信息，进而促进后续的其他操作。
本实施例中，被更新的实时信息是正处于流程的实时信息，更新后的信息可以应用于下一帧的本流程，由此可见，该方法是在线上操作时，实时运行的方法。
举例来说，玩家在玩游戏时，用户每次观看到的信息都是实时信息对应的图片，在刷新频率足够高的时候，用户观看到的多个图片连接起来形成视频，以使玩家在玩游戏的过程中避免观看的不适感。在本方案中，该方法还可以使用柔化、锐化等手段来保证实时画面的正常运转，甚至，在网络不好的情况下，自动调节其输出显示的画质，从而保障玩家的游玩体验。
S203、第一设备根据交互信息和实时信息进行数据处理，得到图像信息。
上述的交互信息可以是由用户输入的操作指令，该操作指令一般会影响到图像的变换，因此，图像信息可以是根据交互信息和实时信息进行数据处理后得到。实施这种实施方式，图像信息的获取变得与客户端发送的交互信息息息相关，可见，在在线的***中，图像信息是通过交互信息和实时信息两者综合确定的。因此，该步骤可以在获取图像信息基础上，添加用户因素，从而使得上述图像信息可以与用户行为相结合，进而可以获取基于用户操作的图像信息甚至相应的渲染视频，实现了线上用户与云平台交互的功能。
可选地，作为一种可能的实施方式，当云平台用于运行游戏软件时，第一设备可根据接收到的客户端发送的实时信息进行数据拆分处理，得到与游戏软件对应的场景信息和游戏架构数据信息，第一设备根据获取的客户端的交互信息和游戏架构数据信息对场景信息进行调整，得到图像信息。
在上述实现过程中，当云平台运行游戏软件时，云平台可以获取到用户输入的交互信息和服务器发送的实时信息，并对实时信息进行数据拆分，得到游戏软件对应的场景信息和游戏架构数据信息(游戏底层数据信息，用于指定游戏内容的基本规则的信息群)。将交互信息中的内容根据游戏架构数据信息转换为操作控制信息，并根据该操作控制信息对场景信息进行调整，从而得到用于控制图像显示的图像信息。可见，实施这种实施方式，可以保证图像信息的获取过程不会出现数据紊乱和数据崩溃，从而提高了该图像信息获取的稳定性。
S204、第一设备在图像信息中获取渲染数据，并发送渲染数据至第二设备。
本实施例中，图像信息可以包括贴图信息、坐标信息、RGB信息以及渲染数据等多种 关于图像的信息，对此本实施例中不作任何限定。
本实施例中，渲染数据可以包括用于渲染的多种图像信息和渲染的规则方法，对于渲染数据具体包括的内容，本实施例中不作具体限定。
本实施例中，渲染数据用于渲染，因此渲染数据包括的内容可以满足渲染的条件，对此本实施例中不作任何限定。
本实施例中，根据渲染数据进行渲染得到渲染视频的方法不作任何限定，可选地，渲染方法可以包括分帧渲染(单帧或多帧渲染的方法)、全频渲染(综合渲染的方法)等方法。
可选地，作为一种可能的实施方式，第一设备接收客户端发送的交互信息和实时信息，并根据交互信息和实时信息进行数据处理，得到图像信息时，得到的图像信息包括控制信息。
而第一设备在图像信息中获取渲染数据，并发送渲染数据至第二设备时，可以是第一设备对图像信息中的控制信息进行解耦，获得渲染数据，并发送渲染数据至第二设备。
在上述实现过程中，第一设备可获取客户端的交互信息，并根据交互信息进行数据处理，得到控制信息。交互信息即用户通过客户端输入的信息，控制信息即作用于第一设备所运行的应用程序的信息，其通常耦合了多种信息。本实施例中，控制信息耦合了渲染数据和其他数据，该其他数据可以是对应应用程序的业务逻辑数据等。渲染数据可以包括用于画面渲染的多种图像信息和渲染的规则方法，通过第一设备对控制信息包含的多种信息进行解耦，获得渲染数据，即从控制信息中提取出渲染数据。并发送渲染数据至第二设备，由第二设备实现渲染处理。该种实现方式，可避免虚拟机的过多损耗，第一设备能够运行多个应用程序，第二设备能够对多个应用程序画面进行视频渲染，能便于云平台的数据管理及控制管理，大大地提高了云平台的资源利用率，使得云平台能有更好的应用，便于实现更大规模化的运营。
在本实施例中，可选地，作为一种可能的实施方式，上述第一设备对图像信息中的控制信息进行解耦，获得渲染数据，并发送渲染数据至第二设备的步骤，包括：
第一设备对图像信息中的控制信息进行解耦处理，得到业务逻辑数据及渲染数据；
第一设备提取渲染数据，并发送渲染数据至第二设备。
在此基础上，第一设备可处理业务逻辑数据，以推进第一设备的业务逻辑进程。
在上述实现过程中，通过第一设备对图像信息中的控制信息进行解耦处理，得到业务逻辑数据及渲染数据，业务逻辑数据即作用于第一设备所运行的应用程序的信息。通过第一设备处理业务逻辑数据，以推进第一设备的业务逻辑进程。第一设备以业务逻辑数据来推进应用程序的业务逻辑进程，而不以控制信息来推进，能提高业务逻辑进程的推进效率，使第一设备能有更优的运行效果，以更便于云平台的数据管理及控制管理。
S205、第二设备接收渲染数据，并根据渲染数据进行渲染，得到渲染视频。
可选地，作为一种可能的实施方式，第二设备可接收渲染数据，获取与渲染数据对应的网络素材，对渲染数据和网络素材进行渲染，得到渲染视频。
在上述实现过程中，第二设备可以根据网络素材和渲染数据两者进行渲染，从而得到 渲染视频。实施这种实施方式，可以提高渲染视频的显示精度，并且可以节省云平台中占用的内存空间。
S206、第二设备对渲染视频进行处理，得到视频数据，并输出视频数据至与云平台相对应的显示端中进行处理和显示。
在上述实现过程中，第二设备可以对渲染视频进行编码处理或其他形式的处理，得到用于传输的视频数据，并输出该视频数据至与云平台相对应的显示端。可选地，显示端可以是与第二设备对应连接的，从而可以使得显示端接收到视频数据并对视频数据进行解码操作或者其他操作得到渲染视频，进而显示端可以显示渲染视频。可见，实施这种实施方式，可以通过与云平台相连接的显示端显示渲染视频，从而实现输出视频的操作。
本实施例中，显示端是与客户端可以是不同的两个软件，其载体可以相同也可以不同，可选地，显示端用于显示渲染视频。
在本实施例中，第二设备的处理可以为编码处理，显示端的处理可以为解码处理，其两个处理是相对应的，具体的还可以包括加密、识别等处理。
本实施例中，上述的多个步骤可以部署至不同的运行载体中进行执行，例如将步骤S201置入第一设备中的某一近用户服务器，以更快地接收实时信息；再例如，将步骤S202～S203置入空闲服务器，以获取更高的处理效率；再例如，将步骤S205置入多线程高能力的服务器以获取更好的渲染效果。可见，使用这种方法，可以有效地将各个步骤运行的更加完美，从而获取更佳的云平台使用效果。
在一种可能的实现方式中，客户端是手机，服务端是游戏服务器，显示端是观看者设备，第一设备是交互服务器，第二设备是渲染服务器。在实践的过程中，手机获取游戏服务器的数据，并接收用户的操作进行线上游玩，其中，底层数据的处理过程在第一设备中进行处理，并通过第二设备进行画面的获取、渲染及输出，以使观看者设备可以观看到用户的游玩。可选地，手机可以根据游戏服务的数据进行实时显示，从而形成手机和观看者设备的双端显示，避免了传统的录屏操作。第一设备和第二设备的双平台工作模式，可以更有效地获取视频数据，并输出视频数据以使观看者设备进行观看。
在上述实现过程中，将云平台分解为第一设备和第二设备，可以将获取实时信息、数据处理、数据提取、渲染视频以及输出数据等操作分别置入相应的操作平台。其中，第一设备可被配置成获取实时信息并对实时信息进行数据处理得到图像信息，继而对图像信息进行数据提取得到渲染数据，并发送该渲染数据至第二设备。当第二设备接收到上述的渲染数据时，第二设备根据该渲染数据进行相应的画面渲染，从而得到相应的渲染视频，进而对渲染视频进行编码处理等相应操作，得到视频数据并输出该视频数据。可见，实施这种实施方式，可以通过第一设备做获取实时信息、对实时信息进行数据处理和对渲染数据的处理的多个操作。还可以通过第二设备做渲染视频和输出视频数据的多个操作，从而保证第一设备和第二设备各司其职。进而使得第一设备和第二设备的工作内容十分清楚且不相交叉。因此在该云平台使用的过程中，不会出现数据混杂程度较高的情况，从而保证了云平台中资源粒度不会过高，进而提高了云平台的运作能力和被统筹监管能力(因为第一 设备和第二设备为两个平台，在管理的过程中，只需要对多个第一设备统一管理或者对多个第二设备统一管理便可以了)。
在上述实现过程中，划分云平台为第一设备和第二设备两部分组成，可选地，第一设备与第二设备是有机组合成云平台的，第一设备与第二设备的载体可以是不同的。例如，当存在一具有多个运行平台的运行服务器和具有多个渲染平台的渲染服务器时，运行服务器和渲染服务器可构成一个完整的云平台。或者在两个服务器中提取一个运行平台和一个渲染平台便可以构成一个完整的云平台。其中有机组成是由第一设备和第二设备之间的通讯实现的。在拆分云平台之后，第一设备和第二设备各自完成原本云平台全部的工作。其中，第一设备开始接收实时信息、处理实时信息并完成图像数据的获取与传输，而第二设备对图像数据进行渲染、处理(如编码、加密等类型的处理)以及输出。由此可见，拆分云平台可以有效地将交互功能、运行功能与渲染功能相剥离开来，从而实现各自高精度工作的效果，进而降低云平台工作时产生的资源粒度。参照上述的内容可以得知，当一个服务器中只存在一种类型平台时，其管理运维的消耗将大大降低，因此该方法还可以提高云平台的管理运维能力，进而更好地完成云平台的工作。
可选地，作为一种可能的实施方式，上述控制信息为第一设备对获取的第一客户端的交互信息进行数据处理得到。
上述的第二设备对渲染视频进行处理，得到视频数据，并输出视频数据的步骤之后，第二设备可发送视频数据至第一客户端，以使第一客户端显示对应视频数据的视频。或者，第二设备可发送视频数据至第一客户端和第二客户端，以使第一客户端和第二客户端显示对应视频数据的视频。
在上述实现过程中，客户端的交互信息包括第一客户端的交互信息，在通过第二设备接收渲染数据，并根据渲染数据进行处理，得到渲染后的视频数据之后，通过第二设备发送视频数据至第一客户端，以使第一客户端显示对应视频数据的视频。此种情形是将应用程序放在云平台的第一设备里运行，用户通过第一客户端将输入的交互信息发送至云平台的第一设备，推进第一设备运行应用程序的业务逻辑进程。并通过第一客户端接收对应应用程序画面的视频数据，显示视频的情形。作为一种可能的实现方式，此种情形可以是云游戏或云办公等等。
此外，作为另一种实现方式，在通过第二设备接收渲染数据，并根据渲染数据进行处理，得到渲染后的视频数据之后，通过第二设备发送视频数据至第一客户端和第二客户端，以使第一客户端和第二客户端显示对应视频数据的视频。此种情形是在上述情形的基础上，增加了第二客户端也能接收对应应用程序画面的视频数据，显示视频。此种情形是将用户操作应用程序的过程进行直播。该种实现方式，通过第二设备发出视频数据，能提高第一设备的运行能力及运行效率，从而更好地实现云平台的数据管理及控制管理。
可选地，作为一种可能的实施方式，上述的交互信息可包括游戏操作信息，控制信息可为第一设备对获取的客户端的游戏操作信息进行数据处理得到。
视频数据包括游戏视频数据，第二设备可接收渲染数据，并根据渲染数据进行渲染， 得到渲染视频，对渲染视频进行处理，得到渲染后的游戏视频数据，并输出游戏视频数据。
在上述实现过程中，交互信息包括游戏操作信息，视频数据包括游戏视频数据，即对应客户端的应用程序为游戏。在该种实现方式下，云平台能更好地实现数据管理及控制管理，且资源利用率高，能实现更多人次、更大规模的云游戏的运营。
可选地，作为一种可能的实施方式，交互信息可包括工作软件信息，控制信息为第一设备对获取的客户端的工作软件信息进行数据处理得到。第二设备可接收渲染数据，并根据渲染数据进行渲染，得到渲染视频，对渲染视频进行处理，得到渲染后的工作视频数据，并输出工作视频数据。
在上述实现过程中，交互信息包括工作软件操作信息，视频数据包括工作视频数据，即对应客户端的应用程序为工作软件。在该种实现方式下，云平台能更好地实现数据管理及控制管理，且资源利用率高，能实现更多人次、更大规模的云办公的运营。
可选地，作为一种可能的实施方式，交互信息包括远程会议交流信息，控制信息为第一设备对获取的客户端的远程会议交流信息进行数据处理得到。
视频数据包括远程会议视频数据，第二设备可接收渲染数据，并根据渲染数据进行渲染，得到渲染视频，对渲染视频进行处理，得到渲染后的远程会议视频数据，并输出远程会议视频数据。
在上述实现过程中，交互信息包括远程会议交流信息，视频数据包括远程会议视频数据，即对应客户端的应用程序为远程会议。在该种实现方式下，云平台能更好地实现数据管理及控制管理，且资源利用率高，能实现更多人次、更大规模的云会议的运营。
本实施例所提供的线上的视频数据输出方法，能够实时完成线上的交互任务，并传输实时的视频数据，从而保证线上任务的进行。实施这种实施方式，还可以通过对实时信息进行提取分类处理，完成对图像信息甚至于渲染数据的获取，进而通过云平台内资源的调度与渲染数据的结合完成渲染视频的生成。从而形成一种专事专项专办的渲染视频生成流程，进而降低了云平台中的资源粒度。该方法还能够集中客户端与服务端的交互及客户端与云平台之间的交互为一体，构成一个完整的交互***，从而并行完成线上的数据交互和视频数据的产生与输出，进而可以得到基于用户操作和底层数据的实施视频数据，保证了在线上操作的同时，还具有了兼顾外联显示等能力。
请参看图3，图3为本申请实施例提供的一种云平台500的结构示意图。其中，该云平台500包括：
接收单元311，被配置成接收客户端400发送的实时信息；
处理单元312，被配置成根据实时信息进行数据处理，得到图像信息；实时信息是由服务端300发送至客户端400，以使客户端转发至云平台500的；
获取单元313，被配置成在图像信息中获取渲染数据；
渲染单元321，被配置成根据渲染数据进行渲染，得到渲染视频；
输出单元322，被配置成对渲染视频进行处理，得到视频数据，并输出视频数据。
本实施例中，接收单元311、处理单元312及获取单元313可以搭载于云平台500包括的第一设备510，而渲染单元321和输出单元322可以搭载于云平台500包括的第二设备520。
本实施例中，客户端可以为软件，当客户端为软件时，该客户端具有输入输出功能并且该客户端还可以具有一定数据输出功能，而对于视频显示功能，本实施例中不作任何限定。
在一种可能的实施方式中，客户端作为软件时，客户端可以选取任何符合条件的设备作为其载体，该条件可包括数据传输条件。在上述描述的基础上，该载体可以为数据盒、交换机以及数据传输终端中的任意一种，本实施例中载体的类型不作任何限定。
在本实施例中，客户端作为软件时，还可以具有数据输入条件或输出条件。在上述描述的基础上，其载体可以为手柄、按键终端等具有通讯功能的终端设备，对此本实施例中不作任何限定。
在本实施例中，客户端作为软件时，还可以具有显示条件。在上述描述的基础上，其载体可以为手机、平台或者电脑等电子设备，对此本实施例中不作任何限定。
本实施例中，客户端可以为硬件，可选地，客户端可以为手柄、手机、投影仪等等，在该客户端具有上述能力时，本实施例中对于客户端的类型或种类不做任何限定。
本实施例中，云平台500中所包括的多个单元可以分离部署，例如将接收实时信息的接收单元311设置在用户附近，以使接收单元311可以更快的接收实时信息。再例如，将处理单元312、获取单元313以及渲染321进行分离部署，可以使得每个单元完全不同的工作，以使每项工作获取到的结果精准可靠。另外，输出单元322依然可以设置在用户附近，以使用户可以更快地接收视频数据。可见，该种方法可以降低云平台500外部的数据传输流程，从而有效地降低使用时延，提高云平台500的使用效果。
本实施例中，实时信息为服务端中产生并存储的实时运行信息，可选地，该实时信息可以为会议信息，还可以为游戏信息，对此本实施例中对于实时信息的内容不作任何限定，仅仅对信息是具有实时性这一点进行限定，也正是因此，该实时信息是线上运行该方法的基础条件。
在本实施例中，实时信息是由服务端发送出来的，这也就说明，在该方法中可以利用服务器的信息跟进，也就是说，在该方法中可应用于线上。当服务器不存在或者实时信息不存在的时候，该方法将难以进一步跟进执行。
本实施例中，服务端与云平台之间是不相连接的，即云平台是没有与服务端连接的权限的，也就是说，服务端并不希望与云平台相连接，所以服务端未给予云平台相应的通讯授权。举例来说，客户端具有服务端授权且具有软件，但是客户端并不进行渲染操作甚至不进行交互操作，这就使得云平台可进行客户端不进行的工作。例如，客户端在***作的时候可以从服务端调取数据，并发送至云平台进行处理，从而形成了服务端至客户端至云平台的链式数据传输，因此服务端可不与云平台进行交互。可见，该方法是基于线上操作的，更是基于客户端的。
本实施例中，该云平台500可以应用上述实施例所描述的任何解释与说明，对此本实施例中不再多加赘述。
本实施例中，图3所描述的云平台500包括接收单元311、处理单元312、获取单元313、渲染单元321以及输出单元322五个单元。这五个单元各司其职，各自完成其对应的工作内容，从而使得上述五个单元可以有机地构成一个完整的整体。通过五个独立运行的单元，可以很好的控制各自的工作内容，从而保证工作的交叉程度较低，保证云平台500工作的顺利进行，即增强了云平台500工作的稳定性，降低了云平台500产生的资源粒度。在上述实现过程中，云平台500与客户端通讯连接，而客户端与服务端通讯连接，由此结合上述的接收单元和输出单元可见，该云平台500是应用于具有服务端、客户端和云平台500的***中的，因此该云平台500应用于在线的场景中。实践中的这种云平台500可以通过将单元部署到不同位置，以提高云平台500的使用效果。
请参看图4，图4为本申请实施例提供的一种线上的视频数据输出***的***结构示意图。其中，该线上的视频数据输出***包括客户端400和云平台500。
客户端400，被配置成接收实时信息，并发送实时信息至云平台500；实时信息是服务端300发送至客户端400的；
云平台500，被配置成接收实时信息，并根据实时信息进行数据处理，得到图像信息；
云平台500，还被配置成在图像信息中获取渲染数据，并根据渲染数据进行渲染，得到渲染视频；
云平台500，还被配置成对渲染视频进行处理，得到视频数据，并输出视频数据。
本实施例中，该线上的视频数据输出***中所包括的云平台500可以为实施例3中描述的云平台500，对此本实施例中不再多加赘述。
本实施例中，该线上的视频数据输出***可以应用于上述实施例所描述的任何解释与说明，对此本实施例中不再多加赘述。
实施图4所描述的线上的视频数据输出***，能够通过客户端和云平台500两者的交互，以及云平台500的工作完成线上视频数据的输出。云平台500对实时信息的处理可包含对图像信息和渲染数据的处理，云平台500的工作是有针对性的(即针对图像和渲染的)。因此相对于传统的云平台500，该云平台500中所产生的资源粒度是更低的，并且该***中不会产生因数据混杂程度高或相似原因导致的***崩溃与停机等会影响通讯的障碍，从而提高***的稳定性。且相对于传统的云平台500来说，该***还能够应用于线上。
请参看图5，图5为本申请实施例提供的另一种线上的视频数据输出***的***结构示意图。图5所描述的线上的视频数据输出***的结构示意图是根据图4所描述的线上的视频数据输出***的结构示意图进行改进得到的。其中，云平台500由第一设备510以及第二设备520共同构成。
第一设备510，被配置成接收实时信息，并根据实时信息进行数据处理，得到图像信 息；
第一设备510，还被配置成在图像信息中获取渲染数据，并发送渲染数据至第二设备520；
第二设备520，被配置成接收渲染数据，并根据渲染数据进行渲染，得到渲染视频；
第二设备520，还被配置成对渲染视频进行处理得到视频数据，并输出视频数据。
本实施例中，该线上的视频数据输出***可以应用于上述实施例所描述的任何解释与说明，对此本实施例中不再多加赘述。
实施这种实施方式，可以将数据交互、运行软件两者和渲染工作区分开来，从而使得第一设备510处理数据交互的能力更强(相对于全数据内容处理，由于硬件工作内容更专一从而可以提高工作能力)，使得第二设备520对渲染数据的渲染更专业(可以理解为渲染的效果更好)。因此，在专业化的工作***中，该云平台500所产生的资源粒度势必会相对较低，应用在上述实现过程描述的***中时，还可以兼容线上的操作(指的是服务端300、客户端400以及云平台500之间的交互操作)。
作为一种可选的实施方式，客户端400，可以被配置成接收实时信息，获取基于客户端400的交互信息，并发送交互信息和实时信息至第一设备510；
第一设备510被配置成接收实时信息，并根据实时信息进行数据处理，得到图像信息的操作包括：接收交互信息和实时信息，并根据交互信息和实时信息进行数据处理得到图像信息。
实施这种实施方式，第一设备510在获取图像信息的过程中，还可根据客户端400发送的交互信息进行处理获取，得到实时地、与用户输入的交互信息相关的图像信息。从而，可以强化线上交互能力，同时增加与用户交互的能力。
作为一种可选的实施方式，线上的视频数据输出***还包括服务端300，其中：
第一设备510，还被配置成根据交互信息进行数据处理得到操作信息；
第一设备510，还被配置成发送操作信息至客户端400；
客户端400，还被配置成接收操作信息，并发送操作信息至服务端300；
服务端300，被配置成接收操作信息并根据操作信息更新实时信息。
实施这种实施方式，线上的视频数据输出***还包括服务端300，即该线上的视频数据输出***可以包括服务端300、客户端400、第一设备510以及第二设备520四者。相应的，线上交互过程可以在这四者之间进行交互，而上述的实现过程描述的内容便是实时交互中，实时信息根据用户的操作信息进行更替的部分内容。在此基础上，实时信息还会根据服务端中的时钟或者底层数据等内容进行更新，因此该部分内容用于表示在线上的视频数据输出***中，还可包括对交互信息(或操作信息)的交互过程，从而提高该***的兼容性和泛用性，从而提高交互能力。
作为一种可选的实施方式，线上的视频数据输出***还包括显示端600，其中：
显示端600，被配置成接收视频数据，并对视频数据进行处理得到展示视频；
显示端600，还被配置成输出展示视频。
实施这种实施方式，线上的视频数据输出***还包括显示端600，该显示端600可以为视频数据对应的渲染视频(即展示视频)的展示端。该展示端在上述的***中，主要可以被配置成显示渲染视频，从而可以保证***的完整性，提供一种渲染视频的输出装置。
作为一种可选的实施方式，客户端400，还被配置成根据实时信息进行处理得到实时视频，并输出实时视频。
实施这种实施方式，客户端400还可以在接收实时信息后，根据实时信息进行渲染输出实时视频。客户端400可以是具有显示功能和具有图像处理功能的装置。在该***中，可以保证该***可以在用户使用的过程中进行显示还可以在外侧进行输出显示，从而保证了用户的交互使用的舒适程度，并且还可以满足其他人员观看的实时要求和效果要求。
本实施例中，在***运行的过程中，可以添加其他的软件或者其他装置来增添输出的视频数据的效果。举例来说，可以由一个第二设备520的内置软件在视频数据中增加弹幕或者图标。
本实施例中，该***可以应用于直播、可以应用于资料分享，对此本实施例中不作任何限定。
本实施例中，该线上的视频数据输出***中所包括的云平台可以为上述实施例中描述的云平台，对此本实施例中不再多加赘述。
本实施例中，该线上的视频数据输出***可以应用于上述实施例所描述的任何解释与说明，对此本实施例中不再多加赘述。
可见，实施图5所描述的线上的视频数据输出***，能够通过客户端和云平台两者的交互和云平台的工作完成线上视频数据的输出。云平台对实时信息的处理涉及到图像信息和渲染数据，即云平台的工作是有针对性的(即针对图像和渲染的)。因此相对于传统的云平台，该云平台中所产生的资源粒度是更低的，并且该***中不会产生因数据混杂程度高或相似原因导致的***崩溃与停机等会影响通讯的障碍，从而提高***的稳定性。并且，相对于传统的云平台来说，该***还能够应用于线上。且还能够兼容各种显示外设和客户端载体，从而使得该***可以有机兼容与各类与此相关的设备或场景中，从而该***具有相应的普适性。
本申请实施例还提供了一种直播设备，包括存储器以及处理器，所述存储器用于存储计算机程序，所述处理器运行所述计算机程序以使所述直播设备执行根据本申请上述实施例中任一项所述的线上的视频数据输出方法。
本申请实施例提供了一种计算机可读存储介质，其存储有计算机程序指令，所述计算机程序指令被一处理器读取并运行时，执行本申请上述实施例中任一项所述的线上的视频数据输出方法。
在本申请各个实施例中的各功能模块可以集成在一起形成一个独立的部分，也可以是各个模块单独存在，也可以两个或两个以上模块集成形成一个独立的部分。
所述功能如果以软件功能模块的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案可以以软件产品的 形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应所述以权利要求的保护范围为准。
工业实用性
基于该方案可实时完成线上的交互任务，并传输实时的视频数据，保障线上任务的进行。且通过对实时信息进行提取分类处理，完成对图像信息甚至于渲染数据的获取，进而通过云平台内资源的调度与渲染数据的结合完成渲染视频的生成，从而形成一种专事专项专办的渲染视频生成流程，进而降低云平台中的资源粒度。

Claims (23)

  1. 一种线上的视频数据输出方法，其特征在于，所述线上的视频数据输出方法应用于云平台，所述方法包括：
    接收客户端发送的实时信息，并根据所述实时信息进行数据处理，得到图像信息；所述实时信息是由服务端发送至客户端，以使客户端转发至所述云平台的；
    在所述图像信息中获取渲染数据，并根据所述渲染数据进行渲染，得到渲染视频；
    对所述渲染视频进行处理，得到视频数据，并输出所述视频数据。
  2. 根据权利要求1所述的线上的视频数据输出方法，其特征在于，所述接收客户端发送的实时信息，并根据所述实时信息进行数据处理，得到图像信息的步骤包括：
    接收客户端发送的交互信息和实时信息；
    根据所述交互信息和所述实时信息进行数据处理，得到图像信息。
  3. 根据权利要求2所述的线上的视频数据输出方法，其特征在于，所述接收客户端发送的交互信息和实时信息的步骤之后，所述方法还包括：
    根据所述交互信息进行数据处理得到操作信息，并发送所述操作信息至所述客户端；以使所述客户端转发所述操作信息至所述服务端，触发所述服务端根据所述操作信息更新所述实时信息的操作。
  4. 根据权利要求1所述的线上的视频数据输出方法，其特征在于，所述对所述渲染视频进行处理，得到视频数据，并输出所述视频数据的步骤包括：
    对所述渲染视频进行处理，得到视频数据，并输出所述视频数据至与所述云平台相对应的显示端中进行处理和显示。
  5. 根据权利要求1所述的线上的视频数据输出方法，其特征在于，所述云平台包括第一设备和第二设备，所述第一设备为运行服务器、所述第二设备为渲染服务器，或者所述第一设备为运行平台、所述第二设备为渲染平台，所述运行平台为所述运行服务器包含的多个运行平台中的任意一个，所述渲染平台为所述渲染服务器包含的多个渲染平台中的任意一个。
  6. 根据权利要求5所述的线上的视频数据输出方法，其特征在于，所述接收客户端发送的实时信息，并根据所述实时信息进行数据处理，得到图像信息的步骤包括：
    通过所述第一设备接收客户端发送的实时信息，并根据所述实时信息进行数据处理，得到图像信息；
    所述在所述图像信息中获取渲染数据，并根据所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到视频数据，并输出所述视频数据的步骤包括：
    通过所述第一设备在所述图像信息中获取渲染数据，并发送所述渲染数据至所述第二设备；
    通过所述第二设备接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到视频数据，并输出所述视频数据。
  7. 根据权利要求6所述的线上的视频数据输出方法，其特征在于，所述通过所述第一 设备接收客户端发送的实时信息，并根据所述实时信息进行数据处理，得到图像信息的步骤，包括：
    通过所述第一设备获取客户端的交互信息并接收客户端发送的实时信息，并根据所述实时信息和交互信息进行处理，得到图像信息，所述图像信息包括控制信息；
    所述通过所述第一设备在所述图像信息中获取渲染数据，并发送所述渲染数据至所述第二设备的步骤，包括：
    通过所述第一设备对所述图像信息中的控制信息进行解耦，获得渲染数据，并发送渲染数据至所述第二设备。
  8. 根据权利要求7所述的线上的视频数据输出方法，其特征在于，所述通过所述第一设备对所述图像信息中的控制信息进行解耦，获得渲染数据，并发送渲染数据至所述第二设备的步骤，包括：
    通过所述第一设备对所述图像信息中的控制信息进行解耦处理，得到业务逻辑数据及渲染数据；
    通过所述第一设备提取所述渲染数据，并发送所述渲染数据至所述第二设备；
    所述方法还包括：
    通过所述第一设备处理所述业务逻辑数据，以推进所述第一设备的业务逻辑进程。
  9. 根据权利要求7所述的线上的视频数据输出方法，其特征在于，所述控制信息为所述第一设备对获取的第一客户端的交互信息进行数据处理得到；
    所述通过所述第二设备对所述渲染视频进行处理，得到视频数据，并输出所述视频数据的步骤之后，所述方法还包括：
    通过所述第二设备发送所述视频数据至所述第一客户端，以使所述第一客户端显示对应所述视频数据的视频；
    或，通过所述第二设备发送所述视频数据至所述第一客户端和第二客户端，以使所述第一客户端和所述第二客户端显示对应所述视频数据的视频。
  10. 根据权利要求7所述的线上的视频数据输出方法，其特征在于，所述交互信息包括游戏操作信息，所述控制信息为所述第一设备对获取的客户端的游戏操作信息进行数据处理得到；
    所述视频数据包括游戏视频数据，所述通过所述第二设备接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到视频数据，并输出所述视频数据的步骤，包括：
    通过所述第二设备接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到渲染后的游戏视频数据，并输出所述游戏视频数据。
  11. 根据权利要求7所述的线上的视频数据输出方法，其特征在于，所述交互信息包括工作软件信息，所述控制信息为所述第一设备对获取的客户端的工作软件信息进行数据处理得到；
    所述视频数据包括工作视频数据，所述通过所述第二设备接收所述渲染数据，并根据 所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到视频数据，并输出所述视频数据的步骤，包括：
    通过所述第二设备接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到渲染后的工作视频数据，并输出所述工作视频数据。
  12. 根据权利要求7所述的线上的视频数据输出方法，其特征在于，所述交互信息包括远程会议交流信息，所述控制信息为所述第一设备对获取的客户端的远程会议交流信息进行数据处理得到；
    所述视频数据包括远程会议视频数据，所述通过所述第二设备接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到视频数据，并输出所述视频数据的步骤，包括：
    通过所述第二设备接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频，对所述渲染视频进行处理，得到渲染后的远程会议视频数据，并输出所述远程会议视频数据。
  13. 根据权利要求7所述的线上的视频数据输出方法，其特征在于，当所述云平台用于运行游戏软件时，所述通过所述第一设备获取客户端的交互信息并接收客户端发送的实时信息，并根据所述实时信息和交互信息进行处理，得到图像信息的步骤，包括：
    通过所述第一设备根据接收到的客户端发送的实时信息进行数据拆分处理，得到与所述游戏软件对应的场景信息和游戏架构数据信息；
    通过所述第一设备根据获取的客户端的交互信息和所述游戏架构数据信息对所述场景信息进行调整，得到图像信息。
  14. 根据权利要求6所述的线上的视频数据输出方法，其特征在于，所述通过所述第二设备接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频的步骤，包括：
    通过所述第二设备接收所述渲染数据，获取与所述渲染数据对应的网络素材，对所述渲染数据和所述网络素材进行渲染，得到渲染视频。
  15. 一种云平台，其特征在于，所述云平台包括：
    接收单元，被配置成接收客户端发送的实时信息；
    处理单元，被配置成根据所述实时信息进行数据处理，得到图像信息；所述实时信息是由服务端发送至客户端，以使客户端转发至所述云平台的；
    获取单元，被配置成在所述图像信息中获取渲染数据；
    渲染单元，被配置成根据所述渲染数据进行渲染，得到渲染视频；
    输出单元，被配置成对所述渲染视频进行处理，得到视频数据，并输出所述视频数据。
  16. 一种线上的视频数据输出***，其特征在于，所述线上的视频数据输出***包括客户端和云平台，其中，
    所述客户端，被配置成接收实时信息，并发送所述实时信息至所述云平台；其中，所述实时信息是服务端发送至客户端的；
    所述云平台，被配置成接收所述实时信息，并根据所述实时信息进行数据处理，得到 图像信息；
    所述云平台，还被配置成在所述图像信息中获取渲染数据，并根据所述渲染数据进行渲染，得到渲染视频；
    所述云平台，还被配置成对所述渲染视频进行处理，得到视频数据，并输出所述视频数据。
  17. 根据权利要求16所述的线上的视频数据输出***，其特征在于，所述云平台由第一设备以及第二设备共同构成，其中，所述第一设备为运行服务器、所述第二设备为渲染服务器，或者所述第一设备为运行平台、所述第二设备为渲染平台，所述运行平台为所述运行服务器包含的多个运行平台中的任意一个，所述第二设备为所述渲染服务器包含的多个渲染平台中的任意一个；
    所述第一设备，被配置成接收所述实时信息，并根据所述实时信息进行数据处理，得到图像信息；
    所述第一设备，还被配置成在所述图像信息中获取渲染数据，并发送所述渲染数据至所述第二设备；
    所述第二设备，被配置成接收所述渲染数据，并根据所述渲染数据进行渲染，得到渲染视频；
    所述第二设备，还被配置成对所述渲染视频进行处理得到视频数据，并输出所述视频数据。
  18. 根据权利要求17所述的线上的视频数据输出***，其特征在于，
    所述客户端，被配置成接收所述实时信息，获取基于所述客户端的交互信息，并发送所述交互信息和所述实时信息至所述第一设备；
    所述第一设备被配置成接收所述实时信息，并根据所述实时信息进行数据处理，得到图像信息的操作包括：接收所述交互信息和所述实时信息，并根据所述交互信息和所述实时信息进行数据处理得到图像信息。
  19. 根据权利要求18所述的线上的视频数据输出***，其特征在于，所述线上的视频数据输出***还包括服务端，其中，
    所述第一设备，还被配置成根据所述交互信息进行数据处理得到操作信息；
    所述第一设备，还被配置成发送所述操作信息至所述客户端；
    所述客户端，还被配置成接收所述操作信息，并发送所述操作信息至所述服务端；
    所述服务端，被配置成接收所述操作信息并根据所述操作信息更新所述实时信息。
  20. 根据权利要求16所述的线上的视频数据输出***，其特征在于，所述线上的视频数据输出***还包括显示端，其中，
    所述显示端，被配置成接收所述视频数据，并对所述视频数据进行处理得到展示视频；
    所述显示端，还被配置成输出所述展示视频。
  21. 根据权利要求16所述的线上的视频数据输出***，其特征在于，
    所述客户端，还被配置成根据所述实时信息进行处理得到实时视频，并输出所述实时 视频。
  22. 一种直播设备，其特征在于，所述直播设备包括存储器以及处理器，所述存储器用于存储计算机程序，所述处理器运行所述计算机程序以使所述计算机设备执行权利要求1至14中任一项所述的线上的视频数据输出方法中的步骤。
  23. 一种可读存储介质，其特征在于，所述可读取存储介质中存储有计算机程序指令，所述计算机程序指令被一处理器读取并运行时，执行权利要求1至14中任一项所述的线上的视频数据输出方法中的步骤。
PCT/CN2020/097440 2019-06-21 2020-06-22 一种线上的视频数据输出方法、***及云平台 WO2020253871A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/556,182 US20220210520A1 (en) 2019-06-21 2021-12-20 Online video data output method, system, and cloud platform

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN201910551828.9A CN112118213B (zh) 2019-06-21 2019-06-21 一种线上的视频数据输出方法、***及云平台
CN201910551828.9 2019-06-21
CN201910547507.1 2019-06-21
CN201910547506.7 2019-06-21
CN201910547506.7A CN112118212B (zh) 2019-06-21 2019-06-21 一种基于云平台的视频数据输出方法、***及云平台
CN201910547507.1A CN112118463A (zh) 2019-06-21 2019-06-21 一种信息处理方法、云平台及信息处理***

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/556,182 Continuation-In-Part US20220210520A1 (en) 2019-06-21 2021-12-20 Online video data output method, system, and cloud platform

Publications (1)

Publication Number Publication Date
WO2020253871A1 true WO2020253871A1 (zh) 2020-12-24

Family

ID=74036911

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/097440 WO2020253871A1 (zh) 2019-06-21 2020-06-22 一种线上的视频数据输出方法、***及云平台

Country Status (2)

Country Link
US (1) US20220210520A1 (zh)
WO (1) WO2020253871A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117978995A (zh) * 2023-08-01 2024-05-03 广州通则康威科技股份有限公司 一种基于cpe的xr数据处理方法、装置、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297516A (zh) * 2013-05-16 2013-09-11 北京新思易佳科技有限公司 一种应用的多类型提供方法、***及装置
CN103297393A (zh) * 2012-02-27 2013-09-11 洛阳圈圈堂商贸有限公司 客户端视觉呈现的实现方法和***
CN105263050A (zh) * 2015-11-04 2016-01-20 山东大学 基于云平台的移动终端实时渲染***及其方法
CN107241654A (zh) * 2017-06-27 2017-10-10 苏州蜗牛数字科技股份有限公司 一种云端加速渲染集群全景游戏直播***及方法
US9823819B1 (en) * 2013-08-30 2017-11-21 Parallels IP Holdings GmbH Method for launching remote applications from a mobile device using cloud cache

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10913003B2 (en) * 2012-03-13 2021-02-09 Sony Interactive Entertainment LLC Mini-games accessed through a sharing interface
US10616086B2 (en) * 2012-12-27 2020-04-07 Navidia Corporation Network adaptive latency reduction through frame rate control
GB2583511B (en) * 2019-05-02 2024-01-10 Sony Interactive Entertainment Inc Method of and system for controlling the rendering of a video game instance

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297393A (zh) * 2012-02-27 2013-09-11 洛阳圈圈堂商贸有限公司 客户端视觉呈现的实现方法和***
CN103297516A (zh) * 2013-05-16 2013-09-11 北京新思易佳科技有限公司 一种应用的多类型提供方法、***及装置
US9823819B1 (en) * 2013-08-30 2017-11-21 Parallels IP Holdings GmbH Method for launching remote applications from a mobile device using cloud cache
CN105263050A (zh) * 2015-11-04 2016-01-20 山东大学 基于云平台的移动终端实时渲染***及其方法
CN107241654A (zh) * 2017-06-27 2017-10-10 苏州蜗牛数字科技股份有限公司 一种云端加速渲染集群全景游戏直播***及方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117978995A (zh) * 2023-08-01 2024-05-03 广州通则康威科技股份有限公司 一种基于cpe的xr数据处理方法、装置、设备及介质

Also Published As

Publication number Publication date
US20220210520A1 (en) 2022-06-30

Similar Documents

Publication Publication Date Title
CN110597774B (zh) 一种文件分享方法、***、装置、计算设备及终端设备
US8571956B2 (en) System architecture and methods for composing and directing participant experiences
US10332296B2 (en) Overlaying multi-source media in VRAM
CN1609780A (zh) 用于投影来自计算装置的内容的***和方法
CN102375687A (zh) 在无线显示表面上显示计算机桌面
CN112104880A (zh) 网络连线直播控制、显示方法及装置、设备、存储介质
CN113209632A (zh) 一种云游戏的处理方法、装置、设备及存储介质
US11363088B1 (en) Methods and apparatus for receiving virtual relocation during a network conference
US11689749B1 (en) Centralized streaming video composition
CN107409237A (zh) 针对输出装置和网络质量的云游戏数据流动态调整
WO2020253871A1 (zh) 一种线上的视频数据输出方法、***及云平台
CN113645476B (zh) 画面处理方法、装置、电子设备及存储介质
US20210227005A1 (en) Multi-user instant messaging method, system, apparatus, and electronic device
WO2024061243A1 (en) Live stream interactive method, device, apparatus and storage medium
US20230199037A1 (en) Virtual relocation during network conferences
CN111541905B (zh) 一种直播方法、装置、计算机设备和存储介质
CN112118213B (zh) 一种线上的视频数据输出方法、***及云平台
US11758086B2 (en) Scene layouts in video conferences
CN111988633A (zh) 一种多独立场景直播内容共享***
CN115314727A (zh) 基于虚拟对象的直播互动方法、装置及电子设备
US12047430B2 (en) Receiving virtual relocation during a network conference
KR101844931B1 (ko) 분할 디스플레이를 위한 데이터 관리 장치, 시스템 및 방법과 그 기록 매체
CN111866491B (zh) 一种多人场景下主从交互式的3d视频展示方法及***
WO2023274094A1 (zh) 一种处理视频会议中媒体流的方法及相关产品
CN110286994A (zh) 远程桌面的共享方法、***、介质、及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20826335

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20826335

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20826335

Country of ref document: EP

Kind code of ref document: A1