CN112087642B - Cloud guide playing method, cloud guide server and remote management terminal - Google Patents
Cloud guide playing method, cloud guide server and remote management terminal Download PDFInfo
- Publication number
- CN112087642B CN112087642B CN202010927155.5A CN202010927155A CN112087642B CN 112087642 B CN112087642 B CN 112087642B CN 202010927155 A CN202010927155 A CN 202010927155A CN 112087642 B CN112087642 B CN 112087642B
- Authority
- CN
- China
- Prior art keywords
- video frame
- replacement
- video
- cloud
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000004519 manufacturing process Methods 0.000 claims abstract description 20
- 238000004891 communication Methods 0.000 claims description 29
- 238000012545 processing Methods 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 4
- 230000002035 prolonged effect Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23106—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
- H04N21/26233—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving content or additional data duration or size, e.g. length of a movie, size of an executable file
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application discloses a cloud guide playing method, a cloud guide server and a remote management terminal, wherein the method comprises the following steps: receiving video frames transmitted by a camera terminal, and storing the video frames with preset duration into a buffer queue; when a video frame replacement instruction sent by a remote management terminal is received, replacing the video frames in a cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction; and transmitting the replaced video frames to a playing terminal for playing. According to the cloud broadcasting video content production method and device, the production time of cloud broadcasting production video content can be prolonged, the possibility of error occurrence of broadcasting video is reduced, and the watching experience of a user is improved.
Description
Technical Field
The application relates to the technical field of audio and video live broadcasting, in particular to a cloud guide broadcasting method, a cloud guide broadcasting server and a remote management terminal.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
With the rise of the mobile internet and the popularization of mobile terminals, mobile internet video live broadcasting becomes more and more convenient. The mobile internet video live broadcast has high requirement on real-time performance, so that the production speed of the video live broadcast content is required to be increased, and a viewer can obtain live broadcast pictures with rich content.
In recent years, live video broadcasting is realized by adopting cloud broadcasting, live programs are produced by adopting a plurality of cameras or mobile phones and other camera terminals to push the internet, and then processing and producing are carried out by adopting cloud broadcasting, such as machine position switching, logo superposition, subtitle superposition, scene processing, background music addition, picture addition and the like. In order to meet the playing requirement of live video, the cloud guide needs to process and manufacture video content by using short time, and then the video content is transmitted to a viewer.
Disclosure of Invention
In a first aspect, an embodiment of the present application provides a method for playing a cloud guide, configured to prolong a time for playing video content by cloud guide, reduce possibility of errors in playing video, and improve viewing experience of a user, where the method is applied to a cloud guide server, and the cloud guide server is connected to a camera terminal and a remote management terminal, respectively, and the method includes:
receiving video frames transmitted by a camera terminal, and storing the video frames with preset duration into a buffer queue; when a video frame replacement instruction sent by a remote management terminal is received, replacing the video frames in a cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction; and transmitting the replaced video frames to a playing terminal for playing.
In a second aspect, an embodiment of the present application provides a cloud director playing method, configured to prolong a time for producing video content by cloud director, reduce possibility of error in playing video, and improve viewing experience of a user, where the method is applied to a remote management terminal, and the remote management terminal is connected to a cloud director server, where the method includes:
receiving video frames with preset time length stored in a cache queue sent by a cloud broadcasting guide server; providing video frame previews in a buffer queue for a user, and receiving a video frame replacement position and replacement content input by the user; generating a video frame replacement instruction according to the replacement position and the replacement content; and sending the video frame replacement instruction to the cloud guide server so that the cloud guide server can replace the video frames in the cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction, and transmitting the replaced video frames to the playing terminal for playing.
In a third aspect, an embodiment of the present application provides a cloud broadcasting server for prolonging a time for producing video content by cloud broadcasting, reducing possibility of errors in broadcasting video, and improving viewing experience of a user, where the cloud broadcasting server includes:
the server communication module is used for receiving the video frames transmitted by the camera terminal; the cache module is used for storing the video frames with preset time length received by the server communication module into a cache queue; the replacing module is used for replacing the video frames in the cache queue according to the replacing positions and the replacing contents in the video frame replacing instruction when the server communication module receives the video frame replacing instruction sent by the remote management terminal; and the server communication module is also used for transmitting the video frames replaced by the replacing module to the playing terminal for playing.
In a fourth aspect, an embodiment of the present application provides a remote management terminal, configured to prolong a production time of producing video content by cloud broadcasting, reduce possibility of errors in broadcasting video, and improve viewing experience of a user, where the remote management terminal includes:
the terminal communication module is used for receiving video frames with preset duration stored in a cache queue sent by the cloud broadcasting guide server; the terminal communication module is also used for receiving the video frame replacement position and the replacement content input by the user; the instruction generation module is used for generating a video frame replacement instruction according to the replacement position and the replacement content received by the terminal communication module; the terminal communication module is further used for sending the video frame replacement instruction generated by the instruction generation module to the cloud guide server so that the cloud guide server can replace the video frames in the cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction, and the replaced video frames are transmitted to the playing terminal to be played.
In a fifth aspect, an embodiment of the present application provides a cloud director playing system, configured to prolong a production time of producing video content by using cloud director, reduce possibility of playing video in error, and improve viewing experience of a user, where the cloud director playing system includes a cloud director server according to the third aspect and a remote management terminal according to the fourth aspect.
In a sixth aspect, an embodiment of the present application provides a computer device, configured to extend a production time of producing video content by cloud broadcasting, reduce a possibility of occurrence of errors in a broadcast video, and improve a viewing experience of a user, where the computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the processor implements the method according to any one of the first aspect and the second aspect.
In a seventh aspect, an embodiment of the present application provides a computer readable storage medium, configured to extend a production time of producing video content by cloud broadcasting, reduce a possibility of occurrence of errors in a broadcast video, and improve a viewing experience of a user, where the computer readable storage medium stores a computer program for executing the method according to any one of the first aspect and the second aspect.
In the embodiment of the application, the cache queue is set in the cloud broadcasting guide server, video frames with preset time length can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for manufacturing video contents by cloud broadcasting is prolonged, management staff has enough time to modify the video frames with problems, the possibility of error in broadcasting video is reduced, and the watching experience of users is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. In the drawings:
fig. 1 is a flowchart of a cloud director playing method in an embodiment of the present application;
fig. 2 is a flowchart of another method for playing a cloud director according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a cloud director player in an embodiment of the present application;
fig. 4 is a schematic structural diagram of a remote management terminal according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a cloud director playing system in an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings. The illustrative embodiments of the present application and their description are presented herein to illustrate the application and not to limit the application.
The embodiment of the application provides a cloud guide playing method, which is applied to a cloud guide server, wherein the cloud guide server is respectively connected with a camera terminal and a remote management terminal, as shown in fig. 1, and the method comprises steps 101 to 103:
The set time period may be set by a manager according to the need, for example, the preset time period may be set to 30 minutes or 1 hour, or the like.
It should be noted that, when the buffer queue is full of video frames, the video frames are transmitted to the playing terminal. For example, if the preset duration is 30 minutes, starting to store the 1 st frame of video frame in the buffer queue, and after the video frame is stored for 30 minutes, starting to transmit the video frame from the 1 st frame of video frame to the playing terminal for playing.
The method comprises the steps that the video frames in the buffer queue enter and exit according to a first-in first-out principle, the coded video frames are stored in the buffer queue, after the buffer queue is full of the video frames, the video frames at the head of the current buffer queue are transmitted to a playing terminal for playing, the video frames transmitted by the received camera terminal are coded, and the coded video frames are stored at the tail of the buffer queue.
If the manager sets a preset live broadcast content processing rule of overlaying logo, caption and the like in the video frame, before storing the video frame code to the tail of the queue of the buffer queue, processing and manufacturing the video frame according to the preset live broadcast content processing rule, and then encoding the processed and manufactured video frame, and storing the encoded video frame code in the buffer queue.
And 102, when a video frame replacement instruction sent by the remote management terminal is received, replacing the video frames in the cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction.
The replacement content comprises materials such as video on demand, live video streaming or pictures. The replacement content may also be empty, and when the replacement content is empty, the video frame of the replacement location is deleted.
If a preset live broadcast content processing rule is set in the cloud guide server, processing and manufacturing the replacement content according to the preset live broadcast content processing rule after the cloud guide server receives the replacement content; and then coding the processed and manufactured replacement content, and replacing the video frame codes at the positions indicated by the replacement positions in the video frame replacement instruction with the codes of the processed and manufactured replacement content.
In order to solve the problem of accurately positioning video frames, in the embodiment of the application, an H264/H265 Nal unit for describing the ID of the video frame is added in each video frame, ID information of the video frame which is added is stored in the Nal unit, a cloud broadcasting server or a remote management terminal can read the Nal unit to obtain the ID of the video frame, the ID information on the video frame is used for determining the replacement position of the video frame, and the video frame with the same ID in the replacement content is used for replacing the video frame with the same ID in the original buffer queue. And, the addition of the Nal unit does not affect the decoding of the video frame by the playing terminal.
It should be noted that, after the original video frame is replaced by the replacement content, the video frame ID of the replacement content is modified to the ID of the original video frame, so that if the manager is not satisfied with the replacement content for the first time, a video frame replacement instruction can be generated according to the same video frame ID and the new replacement content and sent to the cloud multicast server for replacement, thereby facilitating realization of multiple times of replacement of the video frame.
And step 103, transmitting the replaced video frames to a playing terminal for playing.
And the cloud guide server transmits the video frames to the playing terminal for playing according to the storage sequence of the video frames in the buffer queue. Illustratively, if the 5 th frame of the 1 st to 30 th frames of video frames counted from the head of the queue is replaced, the 1 st, 2 nd, 3 rd and 4 th frames of video frames are sequentially transmitted first, and then the 5 th frame of video frame is transmitted to the playback terminal.
The buffer queue judges whether the head of the queue reaches the broadcasting time according to the time stamp of the video frame, and sends the video frame at the head of the queue to the broadcasting terminal for push stream broadcasting; and placing the video frames sent by the camera terminal at the tail of the queue.
In the embodiment of the application, the cache queue is set in the cloud broadcasting guide server, video frames with preset time length can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for manufacturing video contents by cloud broadcasting is prolonged, management staff has enough time to modify the video frames with problems, the possibility of error in broadcasting video is reduced, and the watching experience of users is improved.
The embodiment of the application also provides a cloud guide playing method, which is applied to a remote management terminal, wherein the remote management terminal is connected with a cloud guide server, as shown in fig. 2, and the method comprises steps 201 to 204:
And when the video frames in the cloud guide server change, for example, the video frames at the head of the queue are transmitted to the playing terminal, or the tail of the queue is stored into a new video frame, the video frames in the remote management terminal are updated in real time, so that the video frames in the remote management terminal are synchronous with the video frames cached in the cloud guide server, and a user can monitor the latest video frames cached.
Specifically, the cloud director server encapsulates the video frames encoded in the buffer queue into flv format, and sends the flv over http streaming protocol to the remote management terminal for previewing, and the remote management terminal can drag the video frames at any time point in the buffer queue for viewing.
And 203, generating a video frame replacement instruction according to the replacement position and the replacement content.
In the embodiment of the application, the cache queue is set in the cloud broadcasting guide server, video frames with preset time length can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for manufacturing video contents by cloud broadcasting is prolonged, management staff has enough time to modify the video frames with problems, the possibility of error in broadcasting video is reduced, and the watching experience of users is improved.
In this embodiment, as shown in fig. 3, a cloud multicast server 300 includes a server communication module 301, a cache module 302, and a replacement module 303.
The server communication module 301 is configured to receive a video frame transmitted by the camera terminal.
The buffer module 302 is configured to store the video frames received by the server communication module 301 into a buffer queue.
And a replacing module 303, when the server communication module 301 receives the video frame replacing instruction sent by the remote management terminal, replacing the video frame in the buffer queue according to the replacing position and the replacing content in the video frame replacing instruction.
The server communication module 301 is further configured to transmit the video frame replaced by the replacing module 303 to a playing terminal for playing.
In one implementation of the embodiment of the present application, the buffer module 302 is configured to:
after the buffer queue is full of video frames, waiting for the video frames at the head of the current buffer queue to be transmitted to the playing terminal for playing, encoding the video frames transmitted by the received camera terminal, and storing the encoded video frames at the tail of the buffer queue.
In one implementation manner of the embodiment of the present application, the cloud director server 300 further includes: the video processing module 304 is configured to process and make the replacement content received by the server communication module 301 according to a preset live content processing rule.
A replacement module 303 for: and encoding the processed and manufactured replacement content, and replacing the video frame encoding of the position indicated by the replacement position in the video frame replacement instruction with the encoding of the processed and manufactured replacement content.
In one implementation manner of the embodiment of the application, an H264/H265 Nal unit is added to each video frame, and the H264/H265 Nal unit is used for describing the ID of the video frame, and the replacement position of the video frame is determined by using the ID information on the video frame.
In the embodiment of the application, the cache queue is set in the cloud broadcasting guide server, video frames with preset time length can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for manufacturing video contents by cloud broadcasting is prolonged, management staff has enough time to modify the video frames with problems, the possibility of error in broadcasting video is reduced, and the watching experience of users is improved.
In the embodiment of the application, a remote management terminal is further provided, as shown in fig. 4, where the remote management terminal 400 includes a terminal communication module 401 and an instruction generating module 402.
The terminal communication module 401 is configured to receive a video frame in a buffer queue sent by the cloud multicast server.
The terminal communication module 401 is further configured to receive a video frame replacement location and replacement content input by a user.
The instruction generating module 402 is configured to generate a video frame replacement instruction according to the replacement position and the replacement content received by the terminal communication module 401.
The terminal communication module 401 is further configured to send the video frame replacement instruction generated by the instruction generating module 402 to the cloud multicast server, so that the cloud multicast server replaces the video frame in the buffer queue according to the replacement position and the replacement content in the video frame replacement instruction, and transmits the replaced video frame to the playing terminal for playing.
In the embodiment of the application, the cache queue is set in the cloud broadcasting guide server, video frames with preset time length can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for manufacturing video contents by cloud broadcasting is prolonged, management staff has enough time to modify the video frames with problems, the possibility of error in broadcasting video is reduced, and the watching experience of users is improved.
The embodiment of the application also provides a cloud guide playing system, as shown in fig. 5, the cloud guide playing system 500 includes a cloud guide server 300 and a remote management terminal 400.
The cloud broadcasting guide server can realize the following functions: input sources (including on-demand sources, live sources, etc.) are managed, input sources are switched in multiple machine positions, and PVM/PGM is supported; the method supports multi-picture synthesis, arbitrary editing scenes, picture splicing, video transition special effects and the like; the multi-element superposition of captions, corner marks, logo, clocks and the like can be performed; the interactive connection, the remote interactive connection with multiple sites and the like can be realized; video pre-monitoring, emergency cut-broadcasting, scene switching in emergency and the like can also be performed.
The remote management terminal adopts a B/S page mode for development, and is easy to deploy and maintain.
The embodiments of the present application further provide a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements any of the methods described in the various implementations of steps 101 to 103 and 201 to 204 when executing the computer program.
Embodiments of the present application also provide a computer-readable storage medium storing a computer program for executing any of the methods described in steps 101 to 103, 201 to 204, and various implementations thereof.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing embodiments have been provided for the purpose of illustrating the general principles of the present application and are not meant to limit the scope of the invention, but to limit the scope of the invention.
Claims (9)
1. The cloud guide playing method is characterized by being applied to a cloud guide server, wherein the cloud guide server is respectively connected with a camera terminal and a remote management terminal, and the method comprises the following steps:
receiving video frames transmitted by a camera terminal, and storing the video frames with preset duration into a buffer queue;
when a video frame replacement instruction sent by a remote management terminal is received, replacing the video frames in a cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction; an H264/H265 Nal unit is added in each video frame, the H264/H265 Nal unit is used for describing the ID of the video frame, the ID information on the video frame is utilized to determine the replacement position of the video frame, and the video frame with the same ID in the replacement content is utilized to replace the video frame with the same ID in the original buffer queue; after the original video frame is replaced by the replacement content, modifying the video frame ID of the replacement content into the ID of the original video frame, and when the first replacement content is unsatisfactory, generating a video frame replacement instruction according to the same video frame ID and the new replacement content and sending the video frame replacement instruction to the cloud broadcasting guiding server for replacement;
transmitting the replaced video frames to a playing terminal for playing;
before replacing the video frames in the buffer queue according to the replacement positions and the replacement contents in the video frame replacement instruction, the method further comprises: processing and manufacturing the replacement content according to a preset live broadcast content processing rule;
the replacing the video frames in the buffer queue according to the replacing positions and the replacing contents in the video frame replacing instruction comprises the following steps: and encoding the processed and manufactured replacement content, and replacing the video frame encoding of the position indicated by the replacement position in the video frame replacement instruction with the encoding of the processed and manufactured replacement content.
2. The method of claim 1, wherein storing the video frames in a buffer queue comprises:
after the buffer queue is full of video frames, waiting for the video frames at the head of the current buffer queue to be transmitted to the playing terminal for playing, encoding the video frames transmitted by the received camera terminal, and storing the encoded video frames at the tail of the buffer queue.
3. The cloud guide playing method is characterized by being applied to a remote management terminal, wherein the remote management terminal is connected with a cloud guide server, and the method comprises the following steps:
receiving video frames with preset time length stored in a cache queue sent by a cloud broadcasting guide server;
providing video frame previews in a buffer queue for a user, and receiving a video frame replacement position and replacement content input by the user; an H264/H265 Nal unit is added in each video frame, the H264/H265 Nal unit is used for describing the ID of the video frame, the ID information on the video frame is utilized to determine the replacement position of the video frame, and the video frame with the same ID in the replacement content is utilized to replace the video frame with the same ID in the original buffer queue; after the original video frame is replaced by the replacement content, modifying the video frame ID of the replacement content into the ID of the original video frame, and when the first replacement content is unsatisfactory, generating a video frame replacement instruction according to the same video frame ID and the new replacement content and sending the video frame replacement instruction to the cloud broadcasting guiding server for replacement;
generating a video frame replacement instruction according to the replacement position and the replacement content;
the video frame replacement instruction is sent to the cloud guide server so that the cloud guide server can replace video frames in the cache queue according to the replacement position and the replacement content in the video frame replacement instruction, and the replaced video frames are transmitted to the playing terminal for playing; before replacing the video frames in the cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction, the cloud broadcasting server processes and manufactures the replacement contents according to a preset live broadcast content processing rule; and encoding the processed and manufactured replacement content, and replacing the video frame encoding of the position indicated by the replacement position in the video frame replacement instruction with the encoding of the processed and manufactured replacement content.
4. A cloud director server, comprising:
the server communication module is used for receiving the video frames transmitted by the camera terminal;
the cache module is used for storing the video frames with preset time length received by the server communication module into a cache queue;
the replacing module is used for replacing the video frames in the cache queue according to the replacing positions and the replacing contents in the video frame replacing instruction when the server communication module receives the video frame replacing instruction sent by the remote management terminal; an H264/H265 Nal unit is added in each video frame, the H264/H265 Nal unit is used for describing the ID of the video frame, the ID information on the video frame is utilized to determine the replacement position of the video frame, and the video frame with the same ID in the replacement content is utilized to replace the video frame with the same ID in the original buffer queue; after the original video frame is replaced by the replacement content, modifying the video frame ID of the replacement content into the ID of the original video frame, and when the first replacement content is unsatisfactory, generating a video frame replacement instruction according to the same video frame ID and the new replacement content and sending the video frame replacement instruction to the cloud broadcasting guiding server for replacement;
the server communication module is also used for transmitting the video frames replaced by the replacing module to the playing terminal for playing;
the cloud broadcasting guide server further comprises: the video processing module is used for processing and manufacturing the replacement content received by the server communication module according to a preset live broadcast content processing rule;
the replacing the video frames in the buffer queue according to the replacing positions and the replacing contents in the video frame replacing instruction comprises the following steps: and encoding the processed and manufactured replacement content, and replacing the video frame encoding of the position indicated by the replacement position in the video frame replacement instruction with the encoding of the processed and manufactured replacement content.
5. The cloud director server of claim 4, wherein the caching module is configured to:
after the buffer queue is full of video frames, waiting for the video frames at the head of the current buffer queue to be transmitted to the playing terminal for playing, encoding the video frames transmitted by the received camera terminal, and storing the encoded video frames at the tail of the buffer queue.
6. A remote management terminal, comprising:
the terminal communication module is used for receiving video frames with preset duration stored in a cache queue sent by the cloud broadcasting guide server;
the terminal communication module is also used for receiving the video frame replacement position and the replacement content input by the user; an H264/H265 Nal unit is added in each video frame, the H264/H265 Nal unit is used for describing the ID of the video frame, the ID information on the video frame is utilized to determine the replacement position of the video frame, and the video frame with the same ID in the replacement content is utilized to replace the video frame with the same ID in the original buffer queue; after the original video frame is replaced by the replacement content, modifying the video frame ID of the replacement content into the ID of the original video frame, and when the first replacement content is unsatisfactory, generating a video frame replacement instruction according to the same video frame ID and the new replacement content and sending the video frame replacement instruction to the cloud broadcasting guiding server for replacement;
the instruction generation module is used for generating a video frame replacement instruction according to the replacement position and the replacement content received by the terminal communication module;
the terminal communication module is also used for sending the video frame replacement instruction generated by the instruction generation module to the cloud guide server so that the cloud guide server can replace the video frames in the cache queue according to the replacement positions and the replacement contents in the video frame replacement instruction, and the replaced video frames are transmitted to the playing terminal for playing; the cloud guide server is also used for processing and manufacturing the replacement content received by the server communication module according to a preset live content processing rule; and encoding the processed and manufactured replacement content, and replacing the video frame code of the position indicated by the replacement position in the video frame replacement instruction with the code of the processed and manufactured replacement content.
7. A cloud director playing system, comprising the cloud director server according to any one of claims 4 to 5 and the remote management terminal according to claim 6.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of claims 1 to 3 when executing the computer program.
9. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program for executing the method of any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010927155.5A CN112087642B (en) | 2020-09-07 | 2020-09-07 | Cloud guide playing method, cloud guide server and remote management terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010927155.5A CN112087642B (en) | 2020-09-07 | 2020-09-07 | Cloud guide playing method, cloud guide server and remote management terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112087642A CN112087642A (en) | 2020-12-15 |
| CN112087642B true CN112087642B (en) | 2023-04-28 |
Family
ID=73732867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010927155.5A Active CN112087642B (en) | 2020-09-07 | 2020-09-07 | Cloud guide playing method, cloud guide server and remote management terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112087642B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112702624B (en) * | 2020-12-22 | 2023-04-07 | 山东鲁软数字科技有限公司 | Method, system, medium and device for optimizing short video playing efficiency |
| WO2022217416A1 (en) * | 2021-04-12 | 2022-10-20 | 苏州思萃人工智能研究所有限公司 | Mobile phone multi-camera switchable virtual camera |
| CN113784210B (en) * | 2021-09-03 | 2023-09-22 | 上海哔哩哔哩科技有限公司 | Pre-monitoring frequency playing method and cloud broadcasting guide table service system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017060423A1 (en) * | 2015-10-08 | 2017-04-13 | Koninklijke Kpn N.V. | Enhancing a region of interest in video frames of a video stream |
| CN109561318A (en) * | 2017-09-26 | 2019-04-02 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus of video playing |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9118744B2 (en) * | 2012-07-29 | 2015-08-25 | Qualcomm Incorporated | Replacing lost media data for network streaming |
| CN104186014B (en) * | 2013-02-18 | 2018-08-21 | 华为技术有限公司 | A kind of method and device that net cast synchronizes |
| CN104519310B (en) * | 2013-09-29 | 2017-12-08 | 深圳锐取信息技术股份有限公司 | A kind of long-range instructor in broadcasting's control system |
| CN203761520U (en) * | 2013-11-20 | 2014-08-06 | 韩巍 | Multimedia video data processing device |
| CN104954633A (en) * | 2014-03-28 | 2015-09-30 | 北京中投视讯文化传媒有限公司 | Live broadcasting instruction method, client and system |
| CN104869466B (en) * | 2015-05-14 | 2018-12-21 | 无锡天脉聚源传媒科技有限公司 | A kind of video broadcast control method and device |
| CN105847862A (en) * | 2016-03-30 | 2016-08-10 | 乐视控股（北京）有限公司 | Cloud program directing station and cutoff continued broadcasting method thereof |
| CN108289159B (en) * | 2017-05-25 | 2020-12-04 | 广州华多网络科技有限公司 | Terminal live broadcast special effect adding system and method and terminal live broadcast system |
| US10469859B2 (en) * | 2017-12-08 | 2019-11-05 | Hulu, LLC | Accelerated re-encoding of video for video delivery |
| CN111182322B (en) * | 2019-12-31 | 2021-04-06 | 北京达佳互联信息技术有限公司 | Director control method and device, electronic equipment and storage medium |
| CN111246126A (en) * | 2020-03-11 | 2020-06-05 | 广州虎牙科技有限公司 | Direct broadcasting switching method, system, device, equipment and medium based on live broadcasting platform |
-
2020
- 2020-09-07 CN CN202010927155.5A patent/CN112087642B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017060423A1 (en) * | 2015-10-08 | 2017-04-13 | Koninklijke Kpn N.V. | Enhancing a region of interest in video frames of a video stream |
| CN109561318A (en) * | 2017-09-26 | 2019-04-02 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus of video playing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112087642A (en) | 2020-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11330311B2 (en) | Transmission device, transmission method, receiving device, and receiving method for rendering a multi-image-arrangement distribution service | |
| US10123070B2 (en) | Method and system for central utilization of remotely generated large media data streams despite network bandwidth limitations | |
| CN112087642B (en) | Cloud guide playing method, cloud guide server and remote management terminal | |
| US9591361B2 (en) | Streaming of multimedia data from multiple sources | |
| JP6562992B2 (en) | Trick playback in digital video streaming | |
| TWI473016B (en) | Method and apparatus for processing a multi-view video bitstream and computer-readable medium | |
| US11930250B2 (en) | Video assets having associated graphical descriptor data | |
| CN103039087A (en) | Signaling random access points for streaming video data | |
| US20110043524A1 (en) | Method and system for converting a 3d video with targeted advertisement into a 2d video for display | |
| US11128897B2 (en) | Method for initiating a transmission of a streaming content delivered to a client device and access point for implementing this method | |
| CN111182322B (en) | Director control method and device, electronic equipment and storage medium | |
| US11205456B2 (en) | Methods and apparatus for using edit operations to perform temporal track derivations | |
| CN103081488A (en) | Signaling video samples for trick mode video representations | |
| CN113225585A (en) | Video definition switching method and device, electronic equipment and storage medium | |
| CN114245153A (en) | Slicing method, device, equipment and readable storage medium | |
| US20240107087A1 (en) | Server, terminal and non-transitory computer-readable medium | |
| WO2022116822A1 (en) | Data processing method and apparatus for immersive media, and computer-readable storage medium | |
| US20220201342A1 (en) | Methods and systems for providing a user with an image content | |
| WO2024114519A1 (en) | Point cloud encapsulation method and apparatus, point cloud de-encapsulation method and apparatus, and medium and electronic device | |
| WO2023273675A1 (en) | Method for processing video scene of free visual angle, and client and server | |
| CN114125501A (en) | Interactive video generation method and playing method and device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |