CN113014961A - Video pushing and transmitting method, visual angle synchronizing method and device and storage medium - Google Patents
Video pushing and transmitting method, visual angle synchronizing method and device and storage medium Download PDFInfo
- Publication number
- CN113014961A CN113014961A CN201911320510.6A CN201911320510A CN113014961A CN 113014961 A CN113014961 A CN 113014961A CN 201911320510 A CN201911320510 A CN 201911320510A CN 113014961 A CN113014961 A CN 113014961A
- Authority
- CN
- China
- Prior art keywords
- video
- mec server
- video resource
- user terminal
- fov
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 102
- 230000000007 visual effect Effects 0.000 title abstract description 6
- 230000005540 biological transmission Effects 0.000 claims abstract description 37
- 238000009877 rendering Methods 0.000 claims abstract description 24
- 230000004044 response Effects 0.000 claims description 5
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W36/00—Hand-off or reselection arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a video resource pushing method and module, a visual angle synchronization method and module, a video resource transmission method and module, a VR (virtual reality) master control end, a cloud computing center platform, an MEC (media independent component) server and a computer readable storage medium. The video resource pushing method is applied to a Virtual Reality (VR) main control end of a cloud computing center, and comprises the following steps: inquiring a mobile edge computing MEC server accessed by a user terminal establishing connection with a current VR main control end; and pushing the video resources to the MEC server. The video resource pushing method provided by the invention can reduce the consumption of network bandwidth and computing resources, reduce network delay caused by video resource transmission and rendering, and ensure the VR service quality.
Description
Technical Field
The present disclosure relates to the field of network video technologies, and in particular, to a video resource pushing method and module, a view angle synchronization method and module, a video resource transmission method and module, a VR master control end, a cloud computing center server, an MEC server, and a computer-readable storage medium.
Background
In the 5G era, users can enjoy high-rate, low-latency network experience. The characteristics of high speed, large capacity and low time delay of the 5G network provide a foundation for large outbreaks of various high-definition and ultra-definition video applications. However, with the increasing number of service applications with huge bandwidth consumption, Virtual Reality (VR), Augmented Reality (AR), etc., a huge challenge will be brought to the 5G network. For example, in the prior art, rendering and Field Of View (FOV) synchronization Of VR video resources are performed in a cloud computing center, and when a large number Of terminals perform VR video rendering and FOV synchronization in a 5G network at the same time, a large amount Of consumption Of bandwidth and computing resources is inevitably generated, thereby bringing a huge risk to the 5G core network, and the large consumption Of 5G network resources also causes an increase Of data transmission delay, which degrades the service quality Of the 5G network.
Disclosure of Invention
In order to solve at least one aspect of the above problems in the prior art, the present disclosure provides a video resource pushing method and module, a view angle synchronization method and module, a video resource transmission method and module, a VR master control end, a cloud computing center server, an MEC server, and a computer-readable storage medium.
As a first aspect of the present disclosure, a video resource pushing method is provided, where the video resource pushing method is applied to a virtual reality VR master control end of a cloud computing center, and the video resource pushing method includes:
inquiring a mobile edge computing MEC server accessed by a user terminal establishing connection with the VR main control terminal;
and pushing the video resources to the MEC server.
Optionally, before the step of pushing the video resource to the MEC server, the video resource pushing method further includes:
detecting whether video resources to be pushed to the user terminal exist on the MEC server;
and if the video resources to be pushed to the user terminal do not exist on the MEC server, executing a step of pushing the video resources to the MEC server.
Optionally, the step of detecting whether the video resource to be pushed to the user terminal exists on the MEC server includes:
detecting whether historical video resources exist on the MEC server;
if the historical video resource exists on the MEC server, detecting whether the historical video resource is overtime;
when any one of the following conditions is satisfied, it is determined that the video resource to be pushed to the user terminal does not exist on the MEC server:
the historical video assets are not present on the MEC server;
the historical video assets are present on the MEC server and stored on the MEC server for more than a predetermined time.
Optionally, after the step of pushing the video resource to the MEC server, the method for pushing the video resource further includes:
and sending the view angle FOV information to a cloud computing center server of the cloud computing center.
As a second aspect of the present disclosure, there is provided a FOV synchronizing method applied to a cloud computing center server of a cloud computing center, the FOV synchronizing method including:
receiving FOV information sent by a VR main control end and generating FOV synchronous information;
and transmitting the FOV synchronization information to an MEC server accessed by a user terminal establishing connection with the VR main control terminal.
Optionally, a VR video resource transmission method is applied to an MEC server, and includes:
receiving video resources pushed by a VR main control end through the pushing method provided by the disclosure;
rendering the video resource in response to a request of the user terminal for pulling a media stream to obtain a VR video resource;
and transmitting the VR video resource to the user terminal.
Optionally, after the step of transmitting the VR video resource to the user terminal, the video resource transmission method further includes:
receiving FOV synchronization information transmitted by a cloud computing center server;
and synchronizing the FOV of the user terminal according to the FOV synchronization information.
As a third aspect of the present disclosure, a video resource pushing module is provided, where the video resource pushing module is applied to a virtual reality VR main control end of a cloud computing center, and the video resource pushing module includes:
the query unit is used for querying a mobile edge computing MEC server accessed by a user terminal which establishes connection with the current VR main control terminal;
and the video pushing unit is used for pushing the video resources to the MEC server.
As a fourth aspect of the present disclosure, there is provided a view angle FOV synchronizing module applied to a cloud computing center server of a cloud computing center, the FOV synchronizing module including:
the data processing unit is used for receiving the switched FOV sent by the VR main control end and generating FOV synchronization information;
and the synchronizing unit is used for transmitting the FOV synchronizing information to an MEC server accessed by a user terminal which establishes connection with the VR main control terminal.
As a fifth aspect of the present disclosure, there is provided a video asset transmission module applied to an MEC server, the video asset transmission module including:
a receiving unit, configured to receive a video resource pushed by a VR master control end through the video resource pushing method provided by the present disclosure;
the rendering unit is used for responding to a request of the user terminal for pulling the media stream, and rendering the video resource to obtain a VR video resource;
a transmitting unit, configured to transmit the VR video resource to the user terminal.
As a sixth aspect of the present disclosure, there is provided a VR master control terminal, including:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the above-described video asset pushing method provided by the present disclosure.
As a seventh aspect of the present disclosure, there is provided a cloud computing center server including:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the above-described FOV synchronization method provided by the present disclosure.
As an eighth aspect of the present disclosure, there is provided an MEC server, the MEC server
The server includes:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the above VR video asset transmission method provided by the present disclosure.
As a ninth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon an executable program which, when executed, is capable of implementing one of the following methods:
the video resource pushing method provided by the present disclosure;
the FOV synchronization method provided by the present disclosure;
the video resource transmission method provided by the disclosure.
According to the video resource pushing method provided by the disclosure, unrendered video resources are pushed to the MEC server accessed by the user terminal in a directional manner, and the MEC server provides video rendering for the user terminal, so that the storage and rendering of the video resources are closer to the user terminal, the consumption of network bandwidth and computing resources can be reduced, the network delay caused by video resource transmission and rendering is reduced, and the VR service quality is ensured.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a flowchart of an embodiment of a video resource pushing method in the present disclosure;
FIG. 2 is a schematic diagram of a cloud computing center and network architecture;
fig. 3 is a flowchart of another embodiment of a video resource pushing method in the present disclosure;
fig. 4 is a flowchart of another embodiment of a video resource pushing method in the present disclosure;
fig. 5 is a flowchart of still another embodiment of a video asset pushing method in the present disclosure;
FIG. 6 is a flow chart of one embodiment of a FOV synchronization method in the present disclosure;
fig. 7 is a flow chart of an embodiment of a video resource transmission method in the present disclosure;
fig. 8 is a flow chart of another embodiment of a video asset transmission method in the present disclosure;
fig. 9 is a module schematic diagram of a video resource pushing module in the present disclosure;
FIG. 10 is a block schematic diagram of a FOV synchronization module in the present disclosure;
fig. 11 is a block diagram of a video resource transmission module in the present disclosure.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present invention, are given by way of illustration and explanation only, not limitation.
As a first aspect of the present disclosure, a video resource pushing method is provided, where the video resource pushing method is applied to a virtual reality VR master control end of a cloud computing center, and as shown in fig. 1, the video resource pushing method includes:
in step S110, a Mobile Edge Computing (MEC) server accessed by a user terminal that establishes a connection with a current VR master control end is queried;
in step S120, a video resource is pushed to the MEC server.
In the present disclosure, the cloud computing center performs transmission of video resources through a 5G network. As shown in fig. 2, the 5G network has a plurality of MEC servers, each having certain computing, storage and processing capabilities, so as to store the pushed video resources in the present disclosure and provide video rendering for the user terminal.
When the user terminal is connected with the cloud computing center, the user terminal needs to be simultaneously registered to the cloud computing center and the MEC server, and is connected with the VR main control end of the cloud computing center. When video resources need to be pushed, instead of pushing the video resources directly to the user terminal, the VR master control in this disclosure determines, in step S110, an MEC server to which the user terminal connected to the current VR master control is connected through querying, and pushes the video resources to the MEC server in step S120. And after the video resources are pushed to the MEC server, rendering the video resources by utilizing the computing power of the MEC server to obtain VR video resources, and transmitting the VR video resources obtained after rendering to the user terminal by the MEC server.
In the present disclosure, the specific time for executing step S110 is not particularly limited, for example, step S110 may be directly executed after the VR master creates a VR service.
Step S110 may also be executed after the VR master terminal creates the VR service and responds that the user terminal accesses the VR service. Specifically, when the VR service is a VR multi-party conference, the VR master control end may provide a conference list to the user terminal that establishes a connection with the current VR master control end, and after a user selects and joins a certain conference, the VR master control end only pushes video resources to the MEC node to which the user terminal that joined the conference is accessed.
Therefore, in the present disclosure, video resources are pushed only to the MEC server accessed by the user terminal that is registered to the cloud computing center and the MEC server at the same time and establishes a connection with the VR master terminal of the cloud computing center. Furthermore, when the VR service is a VR multi-party conference, different video resources are pushed according to different conferences selected by the user terminal, and directional pushing of the video resources is achieved, so that privacy and safety in the process of pushing the video resources are enhanced. Meanwhile, due to the directional pushing of the video resources, the VR main control end does not need to push the video resources to each user terminal or each MEC server, so that the bandwidth consumption of the 5G core network is reduced.
As described above, in step S120 of the present disclosure, the video resource pushed to the MEC server is an unrendered video resource, that is, the cloud computing center does not render the video resource, and the MEC server renders the video resource and transmits the video resource to the user terminal, instead of transmitting the video resource through the backbone network, so as to further reduce consumption of network bandwidth and computing resources. Meanwhile, as the user terminal directly obtains the video resources from the MEC server, the problems of high time delay and low reliability caused by the fact that the user terminal needs to pass through a plurality of links, a plurality of network elements and a plurality of networks when interacting with the cloud computing center in the prior art are solved, and the quality of VR service is ensured.
According to the video resource pushing method provided by the disclosure, unrendered video resources are pushed to the MEC server accessed by the user terminal in a directional manner, and the MEC server provides video rendering for the user terminal, so that the storage and rendering of the video resources are closer to the user terminal, the consumption of network bandwidth and computing resources can be reduced, the network delay caused by video resource transmission and rendering is reduced, and the VR service quality is ensured.
In this disclosure, each MEC server may have access to a plurality of user terminals, and therefore, when the VR master control terminal pushes a video resource to a certain MEC server in response to an application of a current user terminal, the MEC server may already have a video resource to be pushed because of a previous application of a user terminal other than the current user terminal. In the disclosure, before pushing a video resource to an MEC server, the MEC server is detected, so that unnecessary waste of network bandwidth and computing resources caused by repeated pushing of the video resource is avoided. Accordingly, in addition to the above step S110 and step S120, as shown in fig. 3, before step S120, the method for pushing a video resource further includes:
in step S130, detecting whether a video resource to be pushed to the user terminal exists on the MEC server;
if the video resource to be pushed to the user terminal does not exist on the MEC server, step S120 is executed.
It should be noted that, when the step S130 is executed to find that the video resource to be pushed to the user terminal exists on the MEC server, the user terminal may directly obtain the video resource from the MEC, and at this time, the process of pushing the video resource is ended.
In this disclosure, there is no particular limitation on a method for detecting whether the MEC server has the video resource to be pushed to the user terminal, and all methods capable of determining whether the MEC server has the video resource to be pushed to the user terminal belong to the protection scope of the present disclosure.
Alternatively, as shown in fig. 4, step S130 may include:
in step S131, detecting whether a historical video resource exists on the MEC server;
if the historical video resources exist on the MEC server, executing step S132: detecting whether the historical video resource is overtime.
When any one of the following conditions is satisfied, it is determined that the video resource to be pushed to the user terminal does not exist on the MEC server:
the historical video assets are not present on the MEC server;
the historical video assets are present on the MEC server and stored on the MEC server for more than a predetermined time.
For convenience of description, the "time the historical video asset is stored on the MEC server exceeds a predetermined time" may be referred to as "the historical video asset has timed out".
In the present disclosure, the determination condition for determining that the historical video resource on the MEC server has timed out is not particularly limited. For example, when the time of the historical video resource on the MEC server exceeds 1min, the historical video resource is determined to be overtime.
In the actual application of VR services, a VR master control end needs to switch the FOV according to a service, and further needs to synchronize the FOV of a user terminal accessing the current VR service. Accordingly, in addition to the above step S110 and step S120, as shown in fig. 5, after step S120, the method for pushing the video resource further includes:
in step S140, the FOV information is transmitted to a cloud computing center server of the cloud computing center.
It should be noted that the FOV herein refers to the current display viewing angle of the object.
As an alternative embodiment, as shown in fig. 4, the step S140 is executed after the step S132. Specifically, step S131 is executed to find that the historical video resources exist on the MEC server, and then step S132 is executed to find that the historical video resources on the MEC server are not timed out, at this time, the process of pushing the video resources is ended, and step S140 may be further executed to synchronize the FOV.
It should be noted that, in practical applications, different steps in each video resource pushing method provided in the embodiments of the present disclosure may be combined to obtain a new technical solution, and the new technical solution also belongs to the scope of the present disclosure.
As a second aspect of the present disclosure, there is provided a FOV synchronizing method applied to a cloud computing center server of a cloud computing center, as shown in fig. 6, the FOV synchronizing method including:
in step S210, receiving FOV information sent by the VR master and generating FOV synchronization information;
in step S220, the FOV synchronization information is transmitted to an MEC server accessed by a user terminal that establishes a connection with the VR master.
Here, "FOV synchronization information" refers to synchronization control information obtained by performing coordinate conversion based on the received FOV information.
After receiving the FOV synchronization information, the MEC server may perform corresponding processing on the video when rendering the received video resource, so that the view angle of the VR video resource received by the user terminal may be consistent with the view angle of the VR master control terminal. In other words, by the FOV synchronization method, the visual angle of the VR video seen by the user terminal is ensured to be the same as the visual angle of the VR main control terminal, and the user experience is improved.
As an optional implementation manner to perform step S220, in the present disclosure, the FOV synchronization information is transmitted to an MEC server accessed by a user terminal that establishes a connection with the VR master through a communication layer of the cloud computing center.
As a third aspect of the present disclosure, there is provided a VR video resource transmission method applied to an MEC server, as shown in fig. 7, the VR video resource transmission method including:
in step S310, receiving a video resource pushed by the VR master through the pushing method provided by the present disclosure;
in step S320, in response to a request for pulling a media stream by the user terminal, rendering the video resource to obtain a VR video resource;
in step S330, the VR video resource is transmitted to the user terminal.
It should be explained that the "user terminal" here is a user terminal that accesses the current MEC server and establishes a connection with the VR master.
In the VR video resource transmission method provided by the disclosure, the MEC server renders the video resource and transmits the video resource to the user terminal, and the video resource is not transmitted through the backbone network, so that the consumption of network bandwidth and computing resource is further reduced. Meanwhile, as the user terminal directly obtains the video resources from the MEC server, the problems of high time delay and low reliability caused by the fact that the user terminal needs to pass through a plurality of links, a plurality of network elements and a plurality of networks when interacting with the cloud computing center in the prior art are solved, and the quality of VR service is ensured.
In the present disclosure, FOV synchronization to the user terminal is also performed by the MEC server. Accordingly, in addition to the steps S310 and S320, as shown in fig. 8, after step S330, the method for transmitting video resources further includes:
in step S340, receiving FOV synchronization information transmitted by the cloud computing center server;
in step S350, the FOV of the user terminal is synchronized according to the FOV synchronization information.
As a fourth aspect of the present disclosure, a video resource pushing module 100 is provided, where the video resource pushing module 100 is applied to a virtual reality VR master control end of a cloud computing center, as shown in fig. 9, the video resource pushing module 100 includes an inquiry unit 110 and a video pushing unit 120. The video resource pushing module 100 provided by the present aspect is configured to execute the video resource pushing method provided by the first aspect of the present disclosure, specifically:
the querying unit 110 is configured to perform step S110, that is, the querying unit 110 is configured to query a mobile edge computing MEC server accessed by a user terminal that establishes a connection with a current VR master;
the video pushing unit 120 is configured to perform step S120, that is, the video pushing unit 120 is configured to push the video resource to the MEC server.
The principle and the beneficial effects of the video resource pushing method have been described in detail above, and are not repeated here.
As a fifth aspect of the present disclosure, there is provided a FOV synchronization module 200, where the FOV synchronization module 200 is applied to a cloud computing center server of a cloud computing center, as shown in fig. 10, and the FOV synchronization module 200 includes a data processing unit 210 and a synchronization unit 220. The FOV synchronization module is configured to perform the FOV synchronization method provided by the second aspect of the present disclosure, specifically:
the data processing unit 210 is configured to perform step S210, that is, the data processing unit 210 is configured to receive FOV information sent by the VR master and generate FOV synchronization information;
the synchronization unit 220 is configured to perform step S220, that is, the synchronization unit 220 is configured to transmit the FOV synchronization information to an MEC server accessed by a user terminal that establishes a connection with the VR master.
The working principle and the beneficial effects of the FOV synchronization method have been described in detail above, and are not described in detail here.
As a sixth aspect of the present disclosure, there is provided a video asset transmission module 300, the video asset transmission module 300 is applied to an MEC server, as shown in fig. 11, the video asset transmission module 300 includes a receiving unit 310, a rendering transmission unit 320, and a transmission unit 330.
The receiving unit 310 is configured to perform step S310, that is, the receiving unit 310 is configured to receive a video resource pushed by the VR master through the video resource pushing method provided by the first aspect of the disclosure;
the rendering unit 320 is configured to perform step S320, that is, the rendering unit 320 is configured to render the video resource in response to a request of the user terminal to pull a media stream;
the transmission unit 330 is configured to perform step S330, that is, the transmission unit 330 is configured to transmit the rendered video resource to the user terminal.
The working principle and the beneficial effects of the VR video resource transmission method have been described in detail above, and are not repeated here.
As a seventh aspect of the present disclosure, there is provided a VR master, including:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the video asset pushing method provided by the first aspect of the disclosure.
As an eighth aspect of the present disclosure, there is provided a cloud computing center server including:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the above-described FOV synchronization method provided by the second aspect of the present disclosure.
As a ninth aspect of the present disclosure, there is provided an MEC server including:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the above VR video asset transmission method provided by the present disclosure.
As a tenth aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon an executable program that, when executed, is capable of implementing any one of the video resource pushing method described above, the FOV synchronizing method described above, and the VR video resource transmission method described above.
Computer-readable storage media include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer-readable storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage media, or any other medium which can be used to store the desired information and which can be accessed by a computer.
In the present disclosure, specific application scenarios of the video resource pushing method, the FOV synchronizing method, and the VR video resource transmission method are not particularly limited. As described above, the above method may be applied in VR video conferencing. The video resource pushing method, the FOV synchronizing method, and the VR video resource transmission method provided by the present disclosure are described in detail below with reference to specific scenarios of a VR video conference.
The VR video conference flow is as follows:
the first step, the user terminal access, includes the following steps:
a user terminal (which can be a tablet computer, a desktop computer, VR equipment, a smart phone and the like) accesses a VR service and registers to a cloud computing center of a provider;
a VR main control end of a cloud computing center is connected with a user terminal;
the user terminal is registered with the MEC server.
And step two, establishing a conference, comprising the following steps:
after a user terminal is accessed to a cloud computing center provided by a VR service, a VR main control end creates a VR multiparty conference;
the user terminal inquires a conference list created by the current VR main control terminal;
the user terminal selects a conference to be joined;
after the user terminal selects to join the conference, the cloud computing center calls the universal user terminal, and the user terminal joins the conference.
Step three, VR control, including the following steps:
after the VR main control end successfully establishes the conference, applying for VR video resources to a resource server, and after relevant information of the video resources is obtained, pushing VR media streams (namely, the video resources) to an MEC server;
the user terminal pulls the VR video resource to the MEC server;
and the MEC server renders the video pushed by the VR main control end to obtain VR video resources, and pushes the VR video resources to the user terminal.
Fourthly, synchronizing the FOV, comprising the following steps:
after the MEC server finishes rendering, the VR main control end switches the visual angle to display or introduce the service according to the service requirement;
the VR main control end sends the FOV information to a cloud computing center server;
the method comprises the steps that a cloud computing center server initiates FOV synchronization to all user terminals accessing a VR conference, and concretely, FOV synchronization information is sent to each MEC server through a communication layer;
the MEC server sends the rendered VR video to the terminal and synchronizes the FOV;
and finally, the user sees the FOV of the VR main control end through the user terminal and develops services.
It will be understood that the above embodiments are merely exemplary embodiments taken to illustrate the principles of the present invention, which is not limited thereto. It will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the spirit and substance of the invention, and these modifications and improvements are also considered to be within the scope of the invention.
Claims (14)
1. A video resource pushing method is applied to a Virtual Reality (VR) main control end of a cloud computing center and comprises the following steps:
inquiring a mobile edge computing MEC server accessed by a user terminal establishing connection with the VR main control terminal;
and pushing the video resources to the MEC server.
2. The video asset pushing method according to claim 1, wherein before the step of pushing the video asset to the MEC server, the video asset pushing method further comprises:
detecting whether video resources to be pushed to the user terminal exist on the MEC server;
and if the video resources to be pushed to the user terminal do not exist on the MEC server, executing a step of pushing the video resources to the MEC server.
3. The video resource pushing method according to claim 2, wherein the step of detecting whether the video resource to be pushed to the user terminal exists on the MEC server comprises:
detecting whether historical video resources exist on the MEC server;
if the historical video resource exists on the MEC server, detecting whether the historical video resource is overtime;
when any one of the following conditions is satisfied, it is determined that the video resource to be pushed to the user terminal does not exist on the MEC server:
the historical video assets are not present on the MEC server;
the historical video assets are present on the MEC server and stored on the MEC server for more than a predetermined time.
4. The video asset pushing method according to claim 1, wherein after the step of pushing the video asset to the MEC server, the video asset pushing method further comprises:
and sending the view angle FOV information to a cloud computing center server of the cloud computing center.
5. A FOV synchronization method applied to a cloud computing center server of a cloud computing center, the FOV synchronization method comprising:
receiving FOV information sent by a VR main control end and generating FOV synchronous information;
and transmitting the FOV synchronization information to an MEC server accessed by a user terminal establishing connection with the VR main control terminal.
6. A VR video resource transmission method is applied to an MEC server, and comprises the following steps:
receiving a video resource pushed by the VR master control end through the pushing method of any one of claims 1 to 4;
rendering the video resource in response to a request of the user terminal for pulling a media stream to obtain a VR video resource;
and transmitting the VR video resource to the user terminal.
7. The VR video resource transmission method of claim 6, wherein after the step of transmitting the VR video resource to the user terminal, the video resource transmission method further comprises:
receiving FOV synchronization information transmitted by a cloud computing center server;
and synchronizing the FOV of the user terminal according to the FOV synchronization information.
8. The utility model provides a video resource push module, video resource push module is applied to cloud computing center's virtual reality VR main control end, video resource push module includes:
the query unit is used for querying a mobile edge computing MEC server accessed by a user terminal which establishes connection with the current VR main control terminal;
and the video pushing unit is used for pushing the video resources to the MEC server.
9. A view FOV synchronization module applied to a cloud computing center server of a cloud computing center, the FOV synchronization module comprising:
the data processing unit is used for receiving the switched FOV sent by the VR main control end and generating FOV synchronization information;
and the synchronizing unit is used for transmitting the FOV synchronizing information to an MEC server accessed by a user terminal which establishes connection with the VR main control terminal.
10. A video asset delivery module for application to an MEC server, the video asset delivery module comprising:
a receiving unit, configured to receive a video resource pushed by the VR master through the video resource pushing method according to any one of claims 1 to 4;
the rendering unit is used for responding to a request of the user terminal for pulling the media stream, and rendering the video resource to obtain a VR video resource;
a transmitting unit, configured to transmit the VR video resource to the user terminal.
11. A VR master, comprising:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the video asset pushing method of any of claims 1 to 4.
12. A cloud computing center server, the cloud computing center server comprising:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the FOV synchronization method of claim 5.
13. An MEC server, the MEC server comprising:
the storage module is used for storing an application program;
one or more processors that, when executed by the one or more processors, cause the one or more processors to implement the VR video asset transmission method of claim 6 or 7.
14. A computer readable storage medium having stored thereon an executable program that when executed is capable of implementing one of the following methods:
the video asset pushing method of any one of claims 1 to 4;
the FOV synchronization method of claim 5;
the video asset transmission method of claim 6 or 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911320510.6A CN113014961A (en) | 2019-12-19 | 2019-12-19 | Video pushing and transmitting method, visual angle synchronizing method and device and storage medium |
| PCT/CN2020/137800 WO2021121413A1 (en) | 2019-12-19 | 2020-12-18 | Video pushing and transmission methods, angle of view synchronization method and apparatus, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911320510.6A CN113014961A (en) | 2019-12-19 | 2019-12-19 | Video pushing and transmitting method, visual angle synchronizing method and device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113014961A true CN113014961A (en) | 2021-06-22 |
Family
ID=76382364
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911320510.6A Pending CN113014961A (en) | 2019-12-19 | 2019-12-19 | Video pushing and transmitting method, visual angle synchronizing method and device and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113014961A (en) |
| WO (1) | WO2021121413A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115037958B (en) * | 2022-03-22 | 2023-06-23 | 电子科技大学 | MEC collaborative transmission VR video method based on 5G network |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108063773A (en) * | 2018-02-11 | 2018-05-22 | 清华大学 | A kind of application service cut-in method and device based on mobile edge calculations |
| CN108521436A (en) * | 2018-02-01 | 2018-09-11 | 上海交通大学 | The mobile virtual reality transmission method and system of storage are calculated based on terminal |
| CN109831659A (en) * | 2018-11-29 | 2019-05-31 | 北京邮电大学 | A kind of caching method and system of VR video |
| CN110166764A (en) * | 2018-02-14 | 2019-08-23 | 阿里巴巴集团控股有限公司 | Visual angle synchronous method and device in Virtual Reality live streaming |
| CN110266664A (en) * | 2019-06-05 | 2019-09-20 | 中国联合网络通信有限公司广州市分公司 | A kind of Cloud VR video living transmission system based on 5G and MEC |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10536515B2 (en) * | 2016-12-23 | 2020-01-14 | Kausik Majumdar | Method and program product for robot communications |
| CN108337691A (en) * | 2018-01-19 | 2018-07-27 | 南京邮电大学 | A kind of services migrating method and system of mobile edge user oriented movement |
| CN108174421B (en) * | 2018-03-05 | 2020-07-31 | 重庆邮电大学 | Data distribution method based on MEC assistance in 5G network |
| CN110545307B (en) * | 2019-07-19 | 2022-09-27 | 中移（杭州）信息技术有限公司 | Edge computing platform, calling method and computer readable storage medium |
-
2019
- 2019-12-19 CN CN201911320510.6A patent/CN113014961A/en active Pending
-
2020
- 2020-12-18 WO PCT/CN2020/137800 patent/WO2021121413A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108521436A (en) * | 2018-02-01 | 2018-09-11 | 上海交通大学 | The mobile virtual reality transmission method and system of storage are calculated based on terminal |
| CN108063773A (en) * | 2018-02-11 | 2018-05-22 | 清华大学 | A kind of application service cut-in method and device based on mobile edge calculations |
| CN110166764A (en) * | 2018-02-14 | 2019-08-23 | 阿里巴巴集团控股有限公司 | Visual angle synchronous method and device in Virtual Reality live streaming |
| CN109831659A (en) * | 2018-11-29 | 2019-05-31 | 北京邮电大学 | A kind of caching method and system of VR video |
| CN110266664A (en) * | 2019-06-05 | 2019-09-20 | 中国联合网络通信有限公司广州市分公司 | A kind of Cloud VR video living transmission system based on 5G and MEC |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021121413A1 (en) | 2021-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2013206552A1 (en) | Application discovery | |
| CN113923470B (en) | Live stream processing method and device | |
| CN108055304B (en) | Remote data synchronization method, device, server, equipment and storage medium | |
| US20150088995A1 (en) | Method and apparatus for sharing contents using information of group change in content oriented network environment | |
| CN112291316B (en) | Connection processing method and device, electronic equipment and computer readable storage medium | |
| CN105743958A (en) | Terminal-to-terminal communication method and device | |
| CN103167327A (en) | Method, device and system of information interaction | |
| WO2017071356A1 (en) | Client-based network data synchronization method, apparatus and system | |
| EP2974159B1 (en) | Method, device and system for voice communication | |
| CN105516638A (en) | Video call method, device and system | |
| CN113766270A (en) | Video playing method, system, server, terminal equipment and electronic equipment | |
| CN113014961A (en) | Video pushing and transmitting method, visual angle synchronizing method and device and storage medium | |
| CN109889922A (en) | Method, device, equipment and storage medium for forwarding streaming media data | |
| EP2457348A1 (en) | Efficient host management protocol on multicast capable router | |
| WO2016173086A1 (en) | Multi-terminal interaction relation maintenance system and method | |
| CN111818010B (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN106657172A (en) | Method and device for realizing information push | |
| CN108616760B (en) | Live broadcasting method based on browser, server, anchor terminal and user terminal | |
| CN108668151B (en) | Audio and video interaction method and device | |
| CN112040328B (en) | Data interaction method and device and electronic equipment | |
| WO2014015795A1 (en) | Method and device for providing communication connection for multiple candidate applications in mobile device | |
| CN110324377B (en) | Push interaction method and device, electronic equipment and medium | |
| WO2024131383A1 (en) | Data processing method and related apparatus | |
| CN113727183B (en) | Live push method, apparatus, device, storage medium and computer program product | |
| CN114900710B (en) | Multi-device synchronization method and device, electronic device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |