CN108965918B - Streaming media processing method, device, system and computer readable storage medium - Google Patents
Streaming media processing method, device, system and computer readable storage medium Download PDFInfo
- Publication number
- CN108965918B CN108965918B CN201810802170.XA CN201810802170A CN108965918B CN 108965918 B CN108965918 B CN 108965918B CN 201810802170 A CN201810802170 A CN 201810802170A CN 108965918 B CN108965918 B CN 108965918B
- Authority
- CN
- China
- Prior art keywords
- streaming media
- streaming
- service
- live
- media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 106
- 230000002159 abnormal effect Effects 0.000 claims abstract description 38
- 238000012544 monitoring process Methods 0.000 claims abstract description 32
- 230000005856 abnormality Effects 0.000 claims abstract description 22
- 238000001514 detection method Methods 0.000 claims description 52
- 238000000034 method Methods 0.000 claims description 30
- 238000004891 communication Methods 0.000 claims description 19
- 230000003993 interaction Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 claims 4
- 238000010586 diagram Methods 0.000 description 18
- 230000003111 delayed effect Effects 0.000 description 10
- 230000006870 function Effects 0.000 description 4
- 230000003068 static effect Effects 0.000 description 3
- 230000003139 buffering effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/2625—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for delaying content or additional data distribution, e.g. because of an extended sport event
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a streaming media processing method, which comprises the following steps: receiving a first stream media and a second stream media which are coded; calling a streaming media identification algorithm to detect and identify the first streaming media, carrying out time delay processing on the first streaming media, and sending the first streaming media to a client based on a streaming protocol; under the condition that the first streaming media are detected and identified to be abnormal, searching an early warning strategy corresponding to the abnormality of the first streaming media; triggering and executing early warning according to the found early warning strategy so as to switch the first streaming media after delay processing into second streaming media and send the second streaming media to the client based on the streaming protocol, thereby ensuring that the streaming data with problems cannot be received by the client; the invention also discloses a streaming media processing device and a system, which solve the problems that the traditional live broadcast needs manual monitoring and switching by a director, and the monitoring is easy to fail or the switching is not timely; the technical problem that various new characteristic requirements of network live broadcast are difficult to meet.
Description
Technical Field
The present invention relates to the field of computers, and in particular, to a streaming media processing method, apparatus, system, and computer-readable storage medium.
Background
The traditional definition of live broadcasting is a broadcasting mode in which the later synthesis and broadcasting of broadcast television programs are carried out simultaneously, and the traditional definition of live broadcasting can be divided into live broadcasting, broadcasting room or studio live broadcasting and other forms according to the broadcasting occasions. With the continuous development of network science and technology, live webcasting has appeared in the years, and the live webcasting is a whole set of solution for showing rich elements such as images, sounds and characters to users through the internet and vivid, visual and real pictures through a streaming media technology, and comprises a coding tool, streaming media data, a server, a network and a player.
For live broadcast content, whether there is an abnormal or illegal situation, the prior art often detects an abnormal signal or illegal content by manually monitoring the signal in a studio through an implementation principle schematic diagram of live broadcast safety broadcast in the prior art as shown in fig. 1, and then switches the abnormal signal through a switching station. The method specifically comprises the steps that (1) after a live broadcast signal passes through a distribution board 1, the live broadcast signal is divided into two parts, one part of the live broadcast signal enters a monitor 1, and the other part of the live broadcast signal enters a distribution board 3 through a delayer; (2) after the live broadcast signal enters the distribution board 3, the live broadcast signal is divided into two parts, one part enters the monitor 3, and the other part carries out switching; (3) the emergency signal is divided into two parts through the distribution board, one part enters the monitor 2, and the other part enters the distribution board 4 through the delayer; (4) after the emergency signal enters the distribution board 4, the emergency signal is divided into two parts, one part enters the monitor 4, and the other part carries out switching; (5) when normally broadcasting directly, switch over the platform and export the live broadcast signal to the live broadcast encoder as live broadcast output signal, live broadcast encoder code is the live broadcast stream, and the propelling movement is broadcast the broadcast to the live broadcast platform and is carried out the live broadcast. (6) When a director finds that abnormal signals or illegal contents occur in live broadcasting through the monitor 1, manual intervention starts to switch emergency signal operation emergently, the current broadcast contents displayed through the monitor 3 are switched into live broadcast output signals through the switching table when the monitor 3 prepares to broadcast the abnormal signals or the illegal contents, and the live broadcast contents are switched into the contents of the emergency signals at the moment, and the live broadcast is in emergency broadcast. (7) When the director finds that the live broadcast signal is recovered to be normal through the monitor 1, manual intervention starts signal recovery operation, the current broadcast content displayed through the monitor 3 is switched to the live broadcast output signal through the switching station when the monitor 3 prepares to broadcast a normal signal, and at the moment, the live broadcast content is switched to the content of the live broadcast signal, and the live broadcast is recovered to be normal.
The traditional live broadcast needs manual monitoring and switching by a broadcaster, so that the condition of monitoring error or untimely switching is easy to occur; in addition, the monitoring and switching of the live broadcast are processed based on signals, so professional hardware equipment is required for support, and the cost is high; in addition, the current live broadcast safety broadcasting mechanism has low expansibility, and is difficult to meet various new characteristic requirements of network live broadcast.
Disclosure of Invention
The technical problem to be solved by the embodiments of the present invention is to provide a streaming media processing method, a streaming media processing apparatus, a streaming media processing system, and a computer readable storage medium, which solve the problem that the traditional live broadcast needs to be monitored and switched manually by a director, and is prone to monitor a fault or switch in time; in addition, the monitoring and switching of the live broadcast are processed based on signals, so professional hardware equipment is required for support, and the cost is high; in addition, the current live broadcast safety broadcasting mechanism has low expansibility, and is difficult to meet various new characteristic requirements of network live broadcast.
In order to solve the above technical problem, a first aspect of an embodiment of the present invention discloses a streaming media processing method, including:
receiving a first stream media and a second stream media which are coded;
calling a streaming media identification algorithm to detect and identify the first streaming media, and sending the first streaming media to a client based on a streaming protocol after delay processing;
under the condition that the first streaming media are detected and identified to be abnormal, searching an early warning strategy corresponding to the abnormality of the first streaming media;
and triggering and executing early warning according to the found early warning strategy so as to switch the first streaming media after delay processing into the second streaming media and send the second streaming media to a client based on a streaming protocol.
Specifically, based on the first aspect, in one implementation manner, the method further includes:
receiving a broadcast control instruction input by a broadcast control device based on a cloud streaming media broadcast control platform;
and performing broadcast control on the received streaming media according to the broadcast control instruction.
Specifically, based on the first aspect, in an implementation manner, after the sending the first streaming media after the time delay processing to the client based on the streaming protocol, the method further includes: receiving report information aiming at the first streaming media, and/or monitoring bullet screen information aiming at the first streaming media;
and calling a streaming media identification algorithm to detect and identify the first streaming media, wherein the step of calling the report bullet screen identification algorithm to detect and identify the first streaming media is carried out according to the report information and/or the bullet screen information.
Specifically, based on the first aspect, in one implementation manner, the method further includes:
receiving a configuration instruction input by a streaming media playing and controlling platform based on a cloud end of a playing and controlling device;
and grading different anomalies occurring in the streaming media according to the configuration instruction, and configuring a corresponding early warning strategy for each grade.
Specifically, based on the first aspect, in an implementation manner, the invoking a streaming media identification algorithm to detect and identify the first streaming media further includes:
calling an abnormal signal detection and identification algorithm to detect whether the first streaming media has abnormal signals;
and calling an illegal content detection and identification algorithm to detect whether the first streaming media has illegal content.
Specifically, based on the first aspect, in an implementation manner, the triggering, according to the found early warning policy, execution of early warning to switch the first streaming media after the delay processing to the second streaming media and send the second streaming media to the client based on a streaming protocol includes:
under the condition that the found early warning strategy is a first early warning strategy, automatically switching the first streaming media after delay processing into the second streaming media and sending the second streaming media to the client based on a streaming protocol;
sending alarm information to the broadcast control equipment under the condition that the found early warning strategy is a second early warning strategy; and receiving a switching instruction input by the cloud-based streaming media playing and controlling platform of the playing and controlling equipment, switching the first streaming media after the delay processing into the second streaming media according to the switching instruction, and sending the second streaming media to the client based on a streaming protocol.
Specifically, based on the first aspect, in an implementation manner, the triggering, according to the found early warning policy, execution of early warning to switch the first streaming media after the delay processing to the second streaming media and send the second streaming media to the client based on a streaming protocol includes:
and under the condition that the found early warning strategy is a third early warning strategy, warning the user corresponding to the first streaming media sending end, prohibiting the first streaming media sending end from sending the first streaming media, and/or reporting the user corresponding to the first streaming media sending end to an alarm platform.
A second aspect of the present invention discloses a streaming media processing apparatus, which includes a unit configured to execute the method in any implementation manner of the first aspect.
The third aspect of the embodiment of the invention discloses a streaming media processing system, which comprises a processor, a memory and a communication module, wherein the processor, the memory and the communication module are connected with each other, the memory is used for storing data processing codes, and the communication module is used for carrying out information interaction with external equipment; the processor is configured to invoke the program code to perform the method of any of the implementations of the first aspect.
A fourth aspect of the present embodiments discloses a computer-readable storage medium, which stores program instructions that, when executed by a processor, cause the processor to perform the method of any one of the implementation manners of the first aspect.
The embodiment of the invention is implemented, and the first streaming media and the second streaming media which are coded are received; calling a streaming media identification algorithm to detect and identify the first streaming media, and searching an early warning strategy corresponding to the abnormality of the first streaming media when the abnormality of the first streaming media is detected and identified; and triggering and executing early warning according to the found early warning strategy so as to switch the first streaming media after delay processing into second streaming media and send the second streaming media to the client based on the streaming protocol, thereby ensuring that the streaming data with problems cannot be received by the client. The automatic identification through a machine is realized, the active switching can be realized, and the condition that the traditional live broadcast needs to be monitored and switched manually by a director, so that monitoring errors or untimely switching is easy to occur is avoided; the embodiment of the invention processes based on the streaming media, thereby solving the problem that in the prior art, the monitoring and switching of the live broadcast are based on the signal processing and need to be supported by professional hardware equipment, and the cost is higher; and different early warning strategies can be configured according to different exceptions of the streaming media to trigger early warning, so that the configurability of live broadcast safety is realized, a grading early warning plan of a user-defined grade is supported, corresponding early warning is carried out according to different grades, the expansibility is improved, and the technical problem that various new characteristic requirements of network live broadcast are met and difficult to meet is solved.
In addition, the embodiment of the invention can receive the broadcast control instruction input by the broadcast control equipment based on the stream media broadcast control platform at the cloud end, and broadcast and control the received stream media according to the broadcast control instruction, thereby realizing the safe broadcast control of the live broadcast to the cloud end, and the broadcast control manager can carry out online safe broadcast control through terminal broadcast control equipment such as a mobile phone, a computer, an ipad and the like only in a place allowing network access, and is not limited to be carried out on-site manual watching in a studio.
And under the condition that the found early warning strategy is a third early warning strategy (for example, the sender is warned for many times, or the streaming media content uploaded by the sender belongs to serious law violation or crime), the user corresponding to the first streaming media sender can be warned, the first streaming media sender is prohibited from sending the first streaming media, and the user corresponding to the first streaming media sender is reported to the warning platform, so that the function of live broadcast safety is improved.
Drawings
In order to illustrate embodiments of the present invention or technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a schematic diagram of an implementation principle of live secure broadcasting in the prior art;
fig. 2 is a schematic system architecture diagram of a streaming media processing method according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of a streaming media processing method according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a broadcast page provided in an embodiment of the present invention;
FIG. 5 is a schematic diagram of a playback page according to another embodiment of the present invention;
FIG. 6 is a schematic diagram of a playback page according to another embodiment of the present invention;
fig. 7 is a schematic diagram of an early warning policy configuration provided by an embodiment of the present invention;
fig. 8 is a schematic diagram illustrating an implementation principle of a streaming media processing method according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a streaming media processing device according to an embodiment of the present invention;
FIG. 10 is a schematic structural diagram of a streaming media processing device according to another embodiment of the present invention;
fig. 11 is a schematic structural diagram of a streaming media processing system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
In a specific implementation, the streaming media described in the embodiment of the present invention may also be referred to as streaming media, which refers to a media format that is transmitted or played in a network in a streaming manner, and includes multimedia files such as audio and video files, for example, a live stream of a live video.
In order to better understand the streaming media processing method, the streaming media processing device, and the streaming media processing system provided in the embodiments of the present invention, a system architecture of the streaming media processing method according to the embodiments of the present invention is described below. Fig. 2 is a schematic system architecture diagram of a streaming media processing method according to an embodiment of the present invention, which may include a streaming media sending end or uploading end, a streaming media processing system, a broadcast control device, and a client. The sending end of the streaming media may include multiple sending ends, and sends the collected streaming media signal (such as a live signal) to the streaming media processing system, and sends a streaming media desired signal for emergency processing to the streaming media processing system; the stream media processing system processes the received stream media through the stream media processing method of the embodiment of the invention to monitor the safe playing, and the method comprises the steps that a play control manager logs in a stream media play control platform of the stream media processing system from a cloud end through a play control device to input a play control instruction so as to control the play control of the stream media, so that the processed stream media is sent to a client, and the client plays the stream media after receiving the stream media.
The sending end of the streaming media, the broadcast control device and the client in the embodiment of the present invention include, but are not limited to, a desktop computer, a laptop computer, a tablet computer, an intelligent terminal, and the like. The streaming media processing system includes, but is not limited to, a processing server.
With reference to the flow diagram of the streaming media processing method provided in the embodiment of the present invention shown in fig. 3, how the streaming media processing system of the embodiment of the present invention processes received streaming media is specifically described below, which may include the following steps:
step S300: receiving a first stream media and a second stream media which are coded;
specifically, in this embodiment of the present invention, the first streaming media may be streaming media for current playing, and the second streaming media may be streaming media for standby playing or emergency playing. Taking live broadcast as an example, the first streaming media may be live broadcast streaming media encoded by live broadcast.
In one embodiment, the second streaming media may be one or more streaming media associated with the first streaming media, for example, live broadcast, a plurality of image capturing devices may perform live broadcast shooting from different angles for live broadcast, that is, generate multiple live broadcast signals, and may default to one or select one live broadcast signal as the first streaming media, and use the remaining live broadcast signals as the second streaming media. The second streaming media may also be streaming media that is not associated with the first streaming media, for example, live streaming, that is, streaming media that is not associated with the first streaming media, that is, streaming media with different live contents. That is, the second streaming media of the embodiment of the present invention may be 1-way or multi-way streaming media.
After the collected or stored streaming media are coded by one or more streaming media sending ends according to the streaming media coding rules, the streaming media are sent to a streaming media processing system, and then the streaming media processing system receives the coded first streaming media and the coded second streaming media.
Step S302: calling a streaming media identification algorithm to detect and identify the first streaming media, and sending the first streaming media to a client based on a streaming protocol after delay processing;
specifically, the streaming media processing system invokes a preset streaming media identification algorithm to detect and identify the first streaming media, which may include identifying an abnormal streaming media signal, identifying whether streaming media content is illegal, and the like. The streaming media identification algorithm of the embodiment of the invention can comprise a sound intensity detection algorithm, a noise signal detection algorithm, a black screen detection algorithm, a still frame detection algorithm, a mosaic detection algorithm and the like for audio and video data in the streaming media, and a yellow identification algorithm, a mode identification algorithm, a voice identification algorithm and the like for streaming media contents.
The Streaming media processing system delays the first Streaming media to obtain delayed Streaming media, and then the delayed Streaming media can be sent to the client based on Streaming protocols such as a hypertext transfer protocol video Live Streaming (HTTP Live Streaming, HLS) and the like. Moreover, the streaming media processing system may send the delayed streaming media to the client through a Content Delivery Network (CDN).
Step S304: under the condition that the first streaming media are detected and identified to be abnormal, searching an early warning strategy corresponding to the abnormality of the first streaming media;
specifically, the streaming media processing system stores a plurality of early warning strategies, and each early warning strategy corresponds to different anomalies occurring in the streaming media. And under the condition that the first streaming media are detected and identified to be abnormal, the streaming media processing system searches the early warning strategy corresponding to the abnormality of the first streaming media.
The first streaming media abnormal condition in the embodiment of the present invention may include an abnormal signal of the first streaming media, such as an abnormal signal of a black screen, a mute, a static frame, a mosaic, and the like; or may include the presence of illegal content in the first streaming media, such as the presence of illegal content in pornography, violence, infringement, and so on.
Step S306: and triggering and executing early warning according to the found early warning strategy so as to switch the first streaming media after delay processing into the second streaming media and send the second streaming media to a client based on a streaming protocol.
Specifically, the streaming media processing system triggers and executes the early warning according to the found early warning policy, for example, performs automatic switching of the media stream, or sends an alarm signal to a sending end of the media stream, or sends an alarm signal to a broadcast control device of the streaming media, and the like, and finally switches the first streaming media after the delay processing to the second streaming media and sends the second streaming media to the client based on the streaming protocol. The streaming media switching in the embodiment of the invention is seamless switching, the playing of the client is not interrupted, that is, the phenomena of playing failure, buffering or jamming do not occur, and the user at the client side switches the content without perception.
In one embodiment, if the second streaming media includes multiple paths of streaming media, the streaming media processing system may select 1 path of streaming media from the multiple paths of streaming media to perform switching, that is, switch the delayed first streaming media to the selected 1 path of streaming media and send the selected 1 path of streaming media to the client based on the streaming protocol.
The embodiment of the invention is implemented, and the first streaming media and the second streaming media which are coded are received; calling a streaming media identification algorithm to detect and identify the first streaming media, and searching an early warning strategy corresponding to the abnormality of the first streaming media when the abnormality of the first streaming media is detected and identified; and triggering and executing early warning according to the found early warning strategy so as to switch the first streaming media after delay processing into second streaming media and send the second streaming media to the client based on the streaming protocol. The automatic identification through a machine is realized, the active switching can be realized, and the condition that the traditional live broadcast needs to be monitored and switched manually by a director, so that monitoring errors or untimely switching is easy to occur is avoided; the embodiment of the invention processes based on the streaming media, thereby solving the problem that in the prior art, the monitoring and switching of the live broadcast are based on the signal processing and need to be supported by professional hardware equipment, and the cost is higher; and different early warning strategies can be configured according to different exceptions of the streaming media to trigger early warning, so that the configurability of live broadcast safety is realized, a grading early warning plan of a user-defined grade is supported, corresponding early warning is carried out according to different grades, the expansibility is improved, and the technical problem that various new characteristic requirements of network live broadcast are met and difficult to meet is solved.
In one embodiment, the streaming media processing method according to the embodiment of the present invention may further include: receiving a broadcast control instruction input by a broadcast control device based on a cloud streaming media broadcast control platform; and performing broadcast control on the received streaming media according to the broadcast control instruction.
Specifically, the streaming media processing system can correspondingly operate a streaming media playing and controlling platform, the streaming media playing and controlling platform can be arranged at a cloud end, a playing and controlling manager can log in the streaming media playing and controlling platform at any time and any place through the playing and controlling equipment which can be networked, and online safe playing control is carried out, including monitoring, alarming, switching and the like of streaming media.
As shown in fig. 4, in the schematic view of the broadcast control page provided in the embodiment of the present invention, after the broadcast control device logs in the cloud-based streaming media broadcast control platform, multiple different currently input streaming media can be played in the page to be provided for the broadcast control administrator to monitor.
As shown in fig. 5, in the schematic view of the broadcast control page according to another embodiment of the present invention, after the broadcast control device logs in the cloud-based streaming media broadcast control platform, the current streaming media can be displayed in the page in the form of a comparison picture, for example, the upper part is the streaming media that is normally played, and the lower part is the streaming media that is abnormal or illegal, so as to facilitate the broadcast control administrator to perform broadcast control.
As shown in fig. 6, in the schematic view of the broadcast control page according to another embodiment of the present invention, after the broadcast control device logs in the cloud-based streaming media broadcast control platform, the broadcast control device may perform broadcast control on a single-channel streaming media, including source streaming media playing (i.e., a current non-delayed first streaming media playing interface), delayed streaming media playing (i.e., a delayed streaming media playing interface), external streaming media playing (i.e., a second streaming media playing interface), a switch button, and alarm information. The broadcast control administrator can click the switching button to manually intervene to switch the streaming media. The alarm information may include screenshot information of abnormal streaming media and list information of the abnormal streaming media, so that the broadcast control administrator can track and review the abnormal streaming media.
The page layouts in fig. 4, 5 and 6 are but one embodiment of the present invention, and the present invention is not limited thereto.
In one embodiment, the streaming media processing method according to the embodiment of the present invention may further include: receiving a configuration instruction input by a streaming media playing and controlling platform based on a cloud end of a playing and controlling device; and grading different anomalies occurring in the streaming media according to the configuration instruction, and configuring a corresponding early warning strategy for each grade. Fig. 7 is a schematic diagram illustrating an early warning policy configuration according to an embodiment of the present invention, which may analyze and summarize abnormalities occurring in streaming media, and then rank the abnormalities, that is, set different levels, where one level may correspond to one or more abnormalities, and each level configures a corresponding early warning policy.
The embodiment of the invention realizes that the safe broadcast control of the live broadcast is played to the cloud, and the broadcast control manager can perform online safe broadcast control, such as monitoring the broadcast of source streaming media, monitoring the broadcast of delayed streaming media, manually switching streaming media and the like, through terminal broadcast control equipment such as a mobile phone, a computer, an ipad and the like only in a place allowing network access, and is not only limited to be performed on site and manual watching in a studio.
The following describes the streaming media processing method according to the embodiment of the present invention, taking a live scene as an example (that is, the first streaming media or the source streaming media is a live stream as an example), and as shown in fig. 8, an implementation principle schematic diagram of the streaming media processing method according to the embodiment of the present invention is shown:
firstly, after live broadcast signals and emergency signals are subjected to live broadcast coding, live broadcast streams and emergency streams are generated, namely first stream media and second stream media, and then the streams are pushed to live broadcast streaming service. The second streaming media in fig. 8 is illustrated by taking an input 1-way signal as an example, and the live streaming service may be an access program or an access code for accessing the streaming media in the streaming media processing system in the embodiment of the present invention.
Then, the live broadcast stream receiving service analyzes the identification ID of the live broadcast stream or generates the ID of the live broadcast stream, and analyzes the stream type of the live broadcast stream, and on one hand, the live broadcast stream receiving service reports the ID and the stream type of the live broadcast stream to a main Master scheduling service, and on the other hand, the received live broadcast stream and the received urgent stream are forwarded to a live broadcast hub service. The Master scheduling service may be a control program or code for performing broadcast control processing on streaming media in the streaming media processing system in the embodiment of the present invention; the live hub service may be a program or code for implementing internal distribution of streaming media in the streaming media processing system in the embodiment of the present invention.
Then, after receiving the live stream and the urgent stream, the live pivot service can provide external monitoring play to realize the monitoring of the broadcast control manager on the source signal and also can provide live stream to live stream detection service, that is, the live stream is forwarded to the live stream detection service to realize the detection of abnormal live signals or illegal contents; meanwhile, the live stream and the emergency stream are forwarded to live time shifting service; the live stream detection service may be a detection program or an identification program for detecting streaming media in the streaming media processing system in the embodiment of the present invention to see whether an abnormality occurs; the live time shifting service may be a program or code used in the streaming media processing system in the embodiment of the present invention to delay the live stream and/or the emergency stream and provide the delay monitoring play.
After receiving the live stream and the urgent stream, the live time shifting service can only perform time delay processing on the transcoded stream media of the live stream, can also perform time delay processing on the transcoded stream media of the live stream and the urgent stream, and provides time delay monitoring and playing for the live stream after time delay processing, so that a play control manager can monitor time delay signals. The live broadcast time shift service forwards the live broadcast stream and the urgent stream (which can be delayed or not) after delay processing to the live broadcast stream switching service. The live stream switching service may be a program or a code for switching between a live stream and an emergency stream in the streaming media processing system in the embodiment of the present invention, and the live stream or the emergency stream is sent to the client for playing in a CDN manner based on an HLS protocol.
After receiving the live stream, the live stream detection service can realize the detection of the live stream by calling a stream media identification algorithm and report the detection result to the Master scheduling service. Specifically, an abnormal signal detection and identification algorithm can be called to detect whether an abnormal signal occurs in a first streaming media (live streaming) or not, so as to detect abnormal signals such as black screen, silence, static frame, mosaic and the like, and return a detection result to a live streaming detection service; and calling an illegal content detection and identification algorithm to detect whether illegal contents exist in the first streaming media (live streaming) or not so as to realize the detection of illegal contents such as pornography and the like, and returning a detection result to the live streaming detection service.
The client can receive information fed back by the user in the process of playing the live stream, and the information of violation or crime of pornography, violence, infringement and the like of the live stream played by the user is received through a feedback system, such as a reporting system; and monitoring and identifying keywords (such as keywords of pornography, violence and the like) in the bullet screen information input by the user through the bullet screen monitoring system, and reporting a feedback result to the Master scheduling service. The report system or the bullet screen monitoring system can be a program or a code used for receiving report information or detecting, identifying or monitoring and identifying the streaming media through a report bullet screen identification algorithm in the streaming media processing system in the embodiment of the invention; the reporting system or the bullet screen monitoring system can also be a program or a code which is used for receiving reporting information on a live broadcast platform running on a client or detecting, identifying or monitoring and identifying a streaming media through a reporting bullet screen identification algorithm, and then reporting the reporting information and bullet screen monitoring result information to a Master scheduling service.
Finally, after receiving the ID and stream type of the live stream reported by the live stream receiving service, the detection result reported by the live stream detection service, and the feedback result for the first streaming media (live stream) reported by the feedback system, the Master scheduling service searches for a corresponding early warning policy or a pre-set according to a plurality of configured early warning policies, such as configured hierarchical pre-sets, and then issues a corresponding warning, automatic switching and recovery processing, or receives a broadcast control instruction for manual forced intervention of a broadcast control administrator, and the like.
In one embodiment, the Master scheduling service may further receive report information for the first streaming media (live streaming) reported by a report system or a barrage monitoring system, and/or monitor barrage information for the first streaming media (live streaming); and then calling a report bullet screen recognition algorithm to detect and recognize the first streaming media according to the report information and/or the bullet screen information.
In one embodiment, for example, when the found early warning policy is a first early warning policy, the Master scheduling service automatically switches the first streaming media after the delay processing to the second streaming media and sends the second streaming media to the client based on a streaming protocol. For example, the live stream has an abnormality such as a black screen, silence, a static frame, a mosaic, and the like, the abnormality corresponds to a first early warning policy, the first early warning policy indicates that the live stream switching service is triggered to automatically switch the streaming media, and then the Master scheduling service automatically issues a switching instruction to the live stream switching service, so that the live stream switching service completes the switching of the streaming media according to the switching instruction, and switches the live stream into an emergency stream.
In one embodiment, for example, in a case that the found early warning policy is the second early warning policy, the Master scheduling service sends warning information to the broadcast control device; and receiving a switching instruction input by the cloud-based streaming media playing and controlling platform of the playing and controlling equipment, switching the first streaming media after the delay processing into the second streaming media according to the switching instruction, and sending the second streaming media to the client based on a streaming protocol. For example, the live stream has illegal information such as pornography or violence, the abnormality corresponds to a second early warning policy, and the second early warning policy may be to instruct the warning system to actively send warning information to the broadcast control device so as to remind the broadcast control manager to perform management and control. And then, receiving a switching instruction input by a cloud-based streaming media playing and controlling platform of the playing and controlling equipment, triggering the live streaming switching service to automatically switch the streaming media according to the switching instruction, so that the live streaming switching service completes the switching of the streaming media according to the switching instruction, and switching the live streaming into an emergency stream. Or the second early warning policy may instruct the warning system to simultaneously send warning information to the broadcast control device and the first streaming media sending end, and instruct to trigger the live stream switching service to automatically switch the streaming media at the same time, and so on.
In one embodiment, for example, when the found early warning policy is a third early warning policy, the Master scheduling service alerts a user corresponding to the first streaming media sending end and prohibits the first streaming media sending end from sending the first streaming media (such as a live streaming), and/or reports the user corresponding to the first streaming media sending end to the alert platform. For example, the Master scheduling service analyzes that the number of times that the content of the illegal live stream is sent by the live stream sending terminal reaches a threshold value according to the ID of the live stream, the exception corresponds to a third early warning policy, the third early warning policy instructs the Master scheduling service to trigger an alarm system to alarm, the Master scheduling service triggers the alarm system to send alarm information to the live stream sending terminal, the live stream sending terminal is prohibited from sending the live stream, and a user corresponding to the live stream sending terminal can be reported to an alarm platform according to the information of a registered user corresponding to the live stream sending terminal.
In one embodiment, the Master scheduling service may trigger resuming playback of the live stream. For example, if it is detected that the abnormality of the original live stream is resolved, the live stream switching service may be triggered to complete the switching of the stream media according to the switching instruction, and the emergency stream is switched to the live stream.
The embodiment of the invention realizes the safe broadcast of the live broadcast, can detect abnormal signals or illegal contents in the live broadcast stream in real time, automatically switch and alarm in real time through a preset early warning strategy, notify manual intervention and the like, support a graded emergency plan with a user-defined level, and perform corresponding treatment according to different levels, namely, the safe broadcast function of the live broadcast can be configured, and the expansibility is improved; the method can select one path of live stream to output the multiple paths of input live streams; the direct broadcasting stream can be cached and delayed for broadcasting; the abnormal signals or illegal contents are ensured to be switched into safe live broadcast streams before being broadcast, so that the safe broadcast of live broadcast is realized; in the whole processing process, the terminal user has no perception, the user plays normally, and the situations of playing failure, buffering, jamming and the like can not occur. Moreover, the live broadcast control is put to the cloud, so that the online safe broadcast control can be carried out through terminal equipment such as a mobile phone, a computer, an ipad and the like only in a place where network access is allowed, and the live broadcast control is not limited to be carried out on site in a studio by manual watching; the monitoring of the abnormal live broadcast signals and the detection of illegal contents are realized by automatic machine identification, real-time alarm and active switching.
In order to better implement the above solution of the embodiments of the present invention, the present invention further provides a streaming media processing apparatus, which is described in detail below with reference to the accompanying drawings:
as shown in fig. 9, which is a schematic structural diagram of a streaming media processing apparatus provided in an embodiment of the present invention, the streaming media processing apparatus 90 may include: a receiving unit 900, a detection and identification unit 902, a sending unit 904, a searching unit 906 and a triggering unit 908, wherein,
the receiving unit 900 is configured to receive a first encoded streaming media and a second encoded streaming media;
the detection and identification unit 902 is configured to invoke a streaming media identification algorithm to perform detection and identification on the first streaming media;
the sending unit 904 is configured to send the first streaming media to the client based on a streaming protocol after performing delay processing;
the searching unit 906 is configured to search, when detecting and identifying that the first streaming media is abnormal, an early warning policy corresponding to the abnormality of the first streaming media;
the triggering unit 908 is configured to trigger execution of an early warning according to the found early warning policy, so as to switch the first streaming media after the delay processing to the second streaming media, and send the second streaming media to the client based on a streaming protocol.
Specifically, as shown in fig. 10, which is a schematic structural diagram of a streaming media processing apparatus according to another embodiment of the present invention, the streaming media processing apparatus 90 includes a receiving unit 900, a detection and identification unit 902, a sending unit 904, a searching unit 906, and a triggering unit 908, and may further include: a broadcast control unit 9010 and a configuration unit 9012, wherein,
the receiving unit 900 may also be configured to receive a broadcast control instruction input by the broadcast control device based on the cloud-based streaming media broadcast control platform;
the broadcast control unit 9010 is configured to perform broadcast control on the received streaming media according to the broadcast control instruction.
After the sending unit 904 performs delay processing on the first streaming media and sends the first streaming media to a client based on a streaming protocol, the receiving unit 900 may further be configured to receive report information for the first streaming media and/or monitor bullet screen information for the first streaming media;
the detection and identification unit 902 may specifically invoke a report bullet screen identification algorithm to perform detection and identification on the first streaming media according to the report information and/or the bullet screen information.
The receiving unit 900 may also be configured to receive a configuration instruction input by the cloud-based streaming media playing and controlling platform of the playing and controlling device;
the configuration unit 9012 is configured to rank different anomalies occurring in the streaming media according to the configuration instruction, and configure a corresponding early warning policy for each rank.
The detection and identification unit 902 may further be configured to invoke an abnormal signal detection and identification algorithm to detect whether an abnormal signal occurs in the first streaming media; and calling an illegal content detection and identification algorithm to detect whether the first streaming media has illegal content.
The triggering unit 908 may be configured to, when the found early warning policy is a first early warning policy, automatically switch the first streaming media after the delay processing to the second streaming media, and send the second streaming media to the client based on a streaming protocol;
the triggering unit 908 may be further configured to send warning information to the broadcast control device when the found warning policy is the second warning policy; and receiving a switching instruction input by the cloud-based streaming media playing and controlling platform of the playing and controlling equipment, switching the first streaming media after the delay processing into the second streaming media according to the switching instruction, and sending the second streaming media to the client based on a streaming protocol.
The triggering unit 908 may also be configured to, when the found early warning policy is a third early warning policy, warn the user corresponding to the first streaming media sending end and prohibit the first streaming media sending end from sending the first streaming media, and/or report the user corresponding to the first streaming media sending end to an alarm platform.
It should be noted that the streaming media processing device 90 in the embodiment of the present invention may be a streaming media processing system in the foregoing method embodiment, and the functions of each module in the streaming media processing device 90 may refer to the specific implementation manner of the streaming media processing system in the embodiments of fig. 1 to fig. 8 in the foregoing method embodiments, which is not described herein again.
In order to better implement the above solution of the embodiments of the present invention, the present invention further provides a streaming media processing system, which is described in detail below with reference to the accompanying drawings:
as shown in fig. 11, which is a schematic structural diagram of the streaming media processing system provided in the embodiment of the present invention, the streaming media processing system 11 may include a processor 111, a memory 114, and a communication module 115, and the processor 111, the memory 114, and the communication module 115 may be connected to each other through a bus 116. The memory 114 may be a Random Access Memory (RAM) memory or a non-volatile memory (non-volatile memory), such as at least one disk memory, and the memory 114 includes a flash in an embodiment of the present invention. The memory 114 may optionally be at least one memory system located remotely from the aforementioned processor 111. The memory 114 is used for storing application program codes and may include an operating system, a network communication module, a user interface module and a data processing program, and the communication module 115 is used for information interaction with an external device; the processor 111 is configured to call the program code, and perform the following steps:
receiving the encoded first and second streaming media through the communication module 115;
calling a streaming media identification algorithm in the memory 114 to detect and identify the first streaming media, and sending the first streaming media to a client based on a streaming protocol after performing delay processing on the first streaming media through a communication module 115;
under the condition that the first streaming media are detected and identified to be abnormal, searching an early warning strategy corresponding to the abnormality of the first streaming media;
and triggering and executing early warning according to the found early warning strategy so as to switch the first streaming media after delay processing into the second streaming media and send the second streaming media to a client based on a streaming protocol.
In one embodiment, the processor 111 may further perform:
receiving a broadcast control instruction input by a cloud-based streaming media broadcast control platform of the broadcast control equipment through a communication module 115;
and performing broadcast control on the received streaming media according to the broadcast control instruction.
In one embodiment, after the processor 111 sends the first streaming media to the client based on the streaming protocol after performing the delay processing, the following may be further performed: receiving, by the communication module 115, report information for the first streaming media, and/or monitoring bullet screen information for the first streaming media;
and calling a streaming media identification algorithm to detect and identify the first streaming media, wherein the step of calling the report bullet screen identification algorithm to detect and identify the first streaming media is carried out according to the report information and/or the bullet screen information.
In one embodiment, the processor 111 may further perform:
receiving a configuration instruction input by a cloud-based streaming media playing and controlling platform of the playing and controlling device through a communication module 115;
and grading different anomalies occurring in the streaming media according to the configuration instruction, and configuring a corresponding early warning strategy for each grade.
In one embodiment, the processor 111 invokes a streaming media identification algorithm to perform detection and identification on the first streaming media, and may further include:
calling an abnormal signal detection and identification algorithm in the memory 114 to detect whether an abnormal signal occurs in the first streaming media;
an illegal content detection and identification algorithm in the memory 114 is called to detect whether illegal content exists in the first streaming media.
In one embodiment, the triggering, by the processor 111, the performing of the early warning according to the found early warning policy to switch the first streaming media after the delay processing to the second streaming media, and sending the second streaming media to the client based on a streaming protocol includes:
under the condition that the found early warning strategy is a first early warning strategy, automatically switching the first streaming media after the delay processing into the second streaming media, and sending the second streaming media to the client through the communication module 115 based on a streaming protocol;
sending alarm information to the broadcast control equipment under the condition that the found early warning strategy is a second early warning strategy; receiving a switching instruction input by the cloud-based streaming media playing and controlling platform of the playing and controlling device through the communication module 115, switching the first streaming media after the delay processing into the second streaming media according to the switching instruction, and sending the second streaming media to the client through the communication module 115 based on a streaming protocol.
And under the condition that the found early warning strategy is a third early warning strategy, the communication module 115 warns the user corresponding to the first streaming media sending end, prohibits the first streaming media sending end from sending the first streaming media, and/or reports the user corresponding to the first streaming media sending end to an alarm platform.
It should be noted that, for the execution steps of the processor in the streaming media processing system 11 in the embodiment of the present invention, reference may be made to the specific implementation manner of the streaming media processing system in the embodiments of fig. 1 to fig. 8 in the foregoing method embodiments, and details are not described here again.
The embodiment of the invention is implemented, and the first streaming media and the second streaming media which are coded are received; calling a streaming media identification algorithm to detect and identify the first streaming media, and searching an early warning strategy corresponding to the abnormality of the first streaming media when the abnormality of the first streaming media is detected and identified; and triggering and executing early warning according to the found early warning strategy so as to switch the first streaming media after delay processing into second streaming media and send the second streaming media to the client based on the streaming protocol, thereby ensuring that the streaming data with problems cannot be received by the client. The automatic identification through a machine is realized, the active switching can be realized, and the condition that the traditional live broadcast needs to be monitored and switched manually by a director, so that monitoring errors or untimely switching is easy to occur is avoided; the embodiment of the invention processes based on the streaming media, thereby solving the problem that in the prior art, the monitoring and switching of the live broadcast are based on the signal processing and need to be supported by professional hardware equipment, and the cost is higher; and different early warning strategies can be configured according to different exceptions of the streaming media to trigger early warning, so that the configurability of live broadcast safety is realized, a grading early warning plan of a user-defined grade is supported, corresponding early warning is carried out according to different grades, the expansibility is improved, and the technical problem that various new characteristic requirements of network live broadcast are met and difficult to meet is solved.
In addition, the embodiment of the invention can receive the broadcast control instruction input by the broadcast control equipment based on the stream media broadcast control platform at the cloud end, and broadcast and control the received stream media according to the broadcast control instruction, thereby realizing the safe broadcast control of the live broadcast to the cloud end, and the broadcast control manager can carry out online safe broadcast control through terminal broadcast control equipment such as a mobile phone, a computer, an ipad and the like only in a place allowing network access, and is not limited to be carried out on-site manual watching in a studio.
And under the condition that the found early warning strategy is a third early warning strategy (for example, the sender is warned for many times, or the streaming media content uploaded by the sender belongs to serious law violation or crime), the user corresponding to the first streaming media sender can be warned, the first streaming media sender is prohibited from sending the first streaming media, and the user corresponding to the first streaming media sender is reported to the warning platform, so that the function of live broadcast safety is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.
Claims (15)
1. A streaming media processing method, comprising:
receiving encoded first streaming media and second streaming media through a live streaming service; analyzing or generating the ID of the first streaming media through the live streaming service, and analyzing the stream type of the first streaming media;
forwarding the ID of the first streaming media and the stream type to a master scheduling service through the live streaming service; forwarding the first streaming media and the second streaming media to a live hub service through the live streaming service;
providing the first streaming media to a live streaming detection service through the live hub service; forwarding the first streaming media and the second streaming media to a live time-shifting service through the live hub service;
calling a streaming media identification algorithm through the live streaming detection service to detect and identify the first streaming media; the first streaming media is subjected to time delay processing through the live time shifting service and then is sent to a client based on a streaming protocol;
reporting a detection result to the main scheduling service through the live stream detection service; under the condition that the first streaming media are detected and identified to be abnormal, searching an early warning strategy corresponding to the abnormality of the first streaming media through the main scheduling service;
and triggering and executing early warning according to the found early warning strategy, and triggering live stream switching service through the main scheduling service so as to switch the first stream media after delay processing into the second stream media and send the second stream media to a client based on a stream transmission protocol.
2. The method of claim 1, further comprising:
receiving a broadcast control instruction input by a broadcast control device based on a cloud streaming media broadcast control platform;
and performing broadcast control on the received streaming media through the main scheduling service according to the broadcast control instruction.
3. The method of claim 1, wherein after the delaying the first streaming media and sending the first streaming media to the client based on a streaming protocol, further comprising: receiving report information aiming at the first streaming media, and/or monitoring bullet screen information aiming at the first streaming media;
and calling a streaming media identification algorithm to detect and identify the first streaming media, wherein the step of calling the report bullet screen identification algorithm to detect and identify the first streaming media is carried out according to the report information and/or the bullet screen information.
4. The method of any one of claims 1-3, further comprising:
receiving a configuration instruction input by a streaming media playing and controlling platform based on a cloud end of a playing and controlling device;
and grading different anomalies occurring in the streaming media according to the configuration instruction through the main scheduling service, and configuring a corresponding early warning strategy for each grade.
5. The method of claim 4, wherein said invoking a streaming media recognition algorithm to detect and recognize the first streaming media comprises:
calling an abnormal signal detection and identification algorithm to detect whether the first streaming media has abnormal signals;
and calling an illegal content detection and identification algorithm to detect whether the first streaming media has illegal content.
6. The method of claim 5, wherein the triggering execution of the pre-warning according to the found pre-warning policy and triggering live streaming switching service through the master scheduling service to switch the first streaming media after the delay processing to the second streaming media is sent to the client based on a streaming protocol, comprises:
under the condition that the found early warning strategy is a first early warning strategy, triggering live stream switching service through the main scheduling service to automatically switch the first stream media after delay processing into the second stream media and sending the second stream media to a client based on a stream transmission protocol;
under the condition that the found early warning strategy is a second early warning strategy, alarm information is sent to the broadcast control equipment through the main scheduling service; receiving a switching instruction input by the broadcast control equipment based on a cloud streaming media broadcast control platform, triggering a live streaming switching service according to the switching instruction, switching the first streaming media after the delay processing into the second streaming media, and sending the second streaming media to a client based on a streaming protocol.
7. The method of claim 5, wherein the triggering execution of the pre-warning according to the found pre-warning policy and triggering live streaming switching service through the master scheduling service to switch the first streaming media after the delay processing to the second streaming media is sent to the client based on a streaming protocol, comprises:
and under the condition that the found early warning strategy is a third early warning strategy, the main scheduling service warns the user corresponding to the first streaming media sending end, prohibits the first streaming media sending end from sending the first streaming media and/or reports the user corresponding to the first streaming media sending end to an alarm platform.
8. A streaming media processing apparatus, comprising:
a receiving unit, a detection and identification unit, a sending unit, a searching unit and a triggering unit, wherein,
the receiving unit is used for receiving the encoded first streaming media and the encoded second streaming media through a live streaming service; analyzing or generating the ID of the first streaming media through the live streaming service, and analyzing the stream type of the first streaming media;
the detection identification unit is used for forwarding the ID of the first streaming media and the stream type to a main scheduling service through the live streaming service; forwarding the first streaming media and the second streaming media to a live hub service through the live streaming service; providing the first streaming media to a live streaming detection service through the live hub service; forwarding the first streaming media and the second streaming media to a live time-shifting service through the live hub service; calling a streaming media identification algorithm through the live streaming detection service to detect and identify the first streaming media;
the sending unit is used for sending the first streaming media to a client based on a streaming protocol after carrying out time delay processing on the first streaming media through the live time shifting service;
the searching unit is used for reporting a detection result to the main scheduling service through the live stream detection service; under the condition that the first streaming media are detected and identified to be abnormal, searching an early warning strategy corresponding to the abnormality of the first streaming media through the main scheduling service;
the triggering unit is used for triggering execution of early warning according to the found early warning strategy, and triggering live stream switching service through the main scheduling service so as to switch the first stream media after delay processing into the second stream media and send the second stream media to the client based on a stream transmission protocol.
9. The apparatus of claim 8, wherein the receiving unit is further configured to receive a broadcast control instruction input by a cloud-based streaming media broadcast control platform of a broadcast control device;
the streaming media processing device further comprises: and the broadcast control unit is used for carrying out broadcast control on the received streaming media through the main scheduling service according to the broadcast control instruction.
10. The apparatus according to claim 8, wherein after the sending unit sends the first streaming media to the client based on a streaming protocol after performing the delay processing, the receiving unit is further configured to receive report information for the first streaming media, and/or monitor bullet screen information for the first streaming media;
the detection identification unit is specifically used for calling a report bullet screen identification algorithm to detect and identify the first streaming media according to the report information and/or the bullet screen information.
11. The apparatus according to any one of claims 8 to 10, wherein the receiving unit is further configured to receive a configuration instruction input by a cloud-based streaming media playing platform of a playing device;
the streaming media processing device further comprises: and the configuration unit is used for grading different anomalies occurring in the streaming media according to the configuration instruction through the main scheduling service and configuring a corresponding early warning strategy for each grade.
12. The apparatus of claim 11,
the detection and identification unit is also used for calling an abnormal signal detection and identification algorithm to detect whether the first streaming media has abnormal signals; calling an illegal content detection and identification algorithm to detect whether the first streaming media has illegal content;
the triggering unit is used for triggering a live stream switching service to automatically switch the first stream media subjected to time delay processing into the second stream media and sending the second stream media to the client based on a stream transmission protocol through the main scheduling service under the condition that the found early warning strategy is a first early warning strategy;
the triggering unit is also used for sending alarm information to the broadcast control equipment through the main scheduling service under the condition that the found early warning strategy is a second early warning strategy; receiving a switching instruction input by the broadcast control equipment based on a cloud streaming media broadcast control platform, triggering a live streaming switching service according to the switching instruction, switching the first streaming media after the delay processing into the second streaming media, and sending the second streaming media to a client based on a streaming protocol.
13. The apparatus of claim 12,
the triggering unit is further configured to, when the found early warning policy is a third early warning policy, warn a user corresponding to the first streaming media sending end through the master scheduling service, prohibit the first streaming media sending end from sending the first streaming media, and/or report the user corresponding to the first streaming media sending end to an alarm platform.
14. The streaming media processing system is characterized by comprising a processor, a memory and a communication module, wherein the processor, the memory and the communication module are connected with each other, the memory is used for storing data processing codes, and the communication module is used for carrying out information interaction with an external device; the processor is configured to invoke the data processing code to perform the method of any of claims 1-7.
15. A computer-readable storage medium, characterized in that the computer-readable storage medium stores program instructions that, when executed by a processor, cause the processor to perform the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810802170.XA CN108965918B (en) | 2018-07-19 | 2018-07-19 | Streaming media processing method, device, system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810802170.XA CN108965918B (en) | 2018-07-19 | 2018-07-19 | Streaming media processing method, device, system and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108965918A CN108965918A (en) | 2018-12-07 |
| CN108965918B true CN108965918B (en) | 2020-04-03 |
Family
ID=64497665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810802170.XA Active CN108965918B (en) | 2018-07-19 | 2018-07-19 | Streaming media processing method, device, system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108965918B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109714605A (en) * | 2018-12-28 | 2019-05-03 | 广州华多网络科技有限公司 | Report data processing method, device, terminal device and server |
| CN110602483B (en) * | 2019-08-23 | 2021-05-25 | 北京奇艺世纪科技有限公司 | Video fault determination method, device and computer readable storage medium |
| CN112752033B (en) * | 2019-10-31 | 2022-03-22 | 上海哔哩哔哩科技有限公司 | Broadcasting directing method and system |
| CN110944217A (en) * | 2019-12-12 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Live broadcast information processing method and device, server and storage medium |
| CN111246126A (en) * | 2020-03-11 | 2020-06-05 | 广州虎牙科技有限公司 | Direct broadcasting switching method, system, device, equipment and medium based on live broadcasting platform |
| CN111711867A (en) * | 2020-05-19 | 2020-09-25 | 腾讯科技（深圳）有限公司 | Index collection method, device, medium and electronic equipment of streaming media service |
| CN111479125A (en) * | 2020-05-22 | 2020-07-31 | 上海港聚信息科技有限公司 | Live broadcast code plug flow receiving and distributing system and method based on cloud management platform |
| CN113891175B (en) * | 2021-09-29 | 2023-09-12 | 上海哔哩哔哩科技有限公司 | Live broadcast push flow method, device and system |
| CN116600067A (en) * | 2023-03-16 | 2023-08-15 | 杭州雅顾科技有限公司 | Audio and video stream data pushing method, device, equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106686395A (en) * | 2016-12-29 | 2017-05-17 | 北京奇艺世纪科技有限公司 | Illegal-video live-broadcast detection method and system |
| CN106973317A (en) * | 2016-12-30 | 2017-07-21 | 华为软件技术有限公司 | Multimedia data processing method, multimedia data providing method, apparatus and system |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101146215B (en) * | 2007-10-09 | 2011-08-10 | 华为技术有限公司 | Video service redundant backup method, device and system based on multicast |
| US8239888B2 (en) * | 2009-10-29 | 2012-08-07 | Ineoquest Technologies, Inc. | Advertising metrics system and method |
| CN102131109A (en) * | 2010-10-14 | 2011-07-20 | 华为技术有限公司 | Method, system and device for monitoring stream media broadcast |
| CN105635811A (en) * | 2014-11-06 | 2016-06-01 | 中广美意文化传播控股有限公司 | Advertisement playing method and device based on broadcast and TV wireless live broadcast signal |
| CN106101819A (en) * | 2016-06-21 | 2016-11-09 | 武汉斗鱼网络科技有限公司 | A kind of live video sensitive content filter method based on speech recognition and device |
| CN106131668A (en) * | 2016-06-30 | 2016-11-16 | 杭州当虹科技有限公司 | A kind of audio-video monitoring warning system pushing alarm based on mobile device message |
| CN108012161B (en) * | 2017-11-10 | 2021-10-01 | 广州华多网络科技有限公司 | Video live broadcast method, system and terminal equipment |
-
2018
- 2018-07-19 CN CN201810802170.XA patent/CN108965918B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106686395A (en) * | 2016-12-29 | 2017-05-17 | 北京奇艺世纪科技有限公司 | Illegal-video live-broadcast detection method and system |
| CN106973317A (en) * | 2016-12-30 | 2017-07-21 | 华为软件技术有限公司 | Multimedia data processing method, multimedia data providing method, apparatus and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108965918A (en) | 2018-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108965918B (en) | Streaming media processing method, device, system and computer readable storage medium | |
| US10592640B2 (en) | System and method for analyzing a device | |
| CN110519177B (en) | Network traffic identification method and related equipment | |
| CA3078998C (en) | Embedded appliance for multimedia capture | |
| US8019200B2 (en) | Method and system for media file conversion | |
| WO2017101488A1 (en) | Real-time transcoding monitoring method and real-time transcoding system | |
| US12019716B2 (en) | Multimedia content recognition with local and cloud-assisted machine learning | |
| CN112969049A (en) | Intelligent detection system for ship violation behaviors | |
| CN107743228A (en) | Video quality detection method, monitoring device and storage medium | |
| CN103124368A (en) | Fault processing method and fault processing device in IPTV (internet protocol television) system | |
| US20200074842A1 (en) | Communication apparatus and data processing method | |
| KR101857716B1 (en) | Network Separation Device and Video Surveillance System Employing the Same | |
| US20100333158A1 (en) | Analysis of Packet-Based Video Content | |
| CA3010007C (en) | Systems and methods for bandwidth estimation in oscillating networks | |
| CN107835192B (en) | Method and system for detecting whether HLS live streaming in real-time transcoding system is normal | |
| TWI582732B (en) | Automatic display of multimedia monitoring system and its information processing method | |
| JP2010152708A (en) | Electronic device, information display system and information display method | |
| CN106453522A (en) | Set top box intelligent fault detection system | |
| CN106331757B (en) | Method and device for controlling audio and video data playing | |
| CN117676079A (en) | Video monitoring system, method and storage medium | |
| KR102590136B1 (en) | Cloud server for monitoring live videos, and operating method thereof | |
| CN111787418B (en) | Audio and video stream docking processing method based on artificial intelligence AI and related equipment | |
| CN108377411A (en) | The method of transmission media data, the method and device for showing media data | |
| AU2019204751B2 (en) | Embedded appliance for multimedia capture | |
| US10250431B2 (en) | System and methods thereof for optimizing communication between a civilian and different dispatchers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |