CN117459760A - Audio and video playing method and system for streaming media on-demand streaming - Google Patents
Audio and video playing method and system for streaming media on-demand streaming Download PDFInfo
- Publication number
- CN117459760A CN117459760A CN202311315905.3A CN202311315905A CN117459760A CN 117459760 A CN117459760 A CN 117459760A CN 202311315905 A CN202311315905 A CN 202311315905A CN 117459760 A CN117459760 A CN 117459760A
- Authority
- CN
- China
- Prior art keywords
- stream
- client
- time
- audio
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 6
- 238000012544 monitoring process Methods 0.000 claims abstract description 5
- 230000004044 response Effects 0.000 claims description 10
- 238000005070 sampling Methods 0.000 claims description 8
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 230000009191 jumping Effects 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 239000012634 fragment Substances 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/254—Management at additional data server, e.g. shopping server, rights management server
- H04N21/2541—Rights Management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/61—Network physical structure; Signal processing
- H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
- H04N21/6125—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses an audio and video playing method and a system for streaming media on demand, wherein the method comprises the steps of creating websocket service when a user requests a media stream, establishing websocket connection between a streaming media service end and a client through the websocket service, monitoring a port of the websocket service, and processing request data from the client; acquiring and analyzing on-demand information, acquiring play request information, and inquiring whether the play request information contains legal data in a database; if the audio and video data is contained, the packaged audio and video data is transmitted to the client in real time through websocket connection according to the state of the media stream, the playing request information and the private stream format, and the client analyzes, decodes and plays the audio and video data received in real time based on the private stream format; wherein the state of the media stream includes a real-time stream and a playback stream; if not, returning request failure information. The embodiment realizes the audio and video playing of the stream media according to the stream demand, reduces the complexity of the stream demand, reduces the playing delay and improves the experience of users.
Description
Technical Field
The invention relates to the field of streaming media data playing, in particular to an audio and video playing method and system for streaming media on-demand streaming.
Background
With the development of modern technology, the network brings various information to people, the streaming media technology adopts a media format that the streaming media technology contacts with the network for real-time playing, and the streaming media technology can enable users to see along with the transmission, so that the streaming media technology breaks through the transmission limit of bandwidth and the like to media to a certain extent, and is widely applied to various fields such as security and protection, medical treatment, video conference, electronic commerce and the like.
In streaming media, streaming media on demand has important significance in modern digital media transmission, not only saves resources, but also meets personalized requirements, and the streaming media on demand can dynamically adjust the transmission rate according to the network performance of users, thereby ensuring the playing requirements under different conditions. The existing on-demand streaming technology comprises the following steps: the video is segmented into a plurality of different bit rate fragments according to the self-adaptive bit rate, the proper fragments are dynamically selected to play according to the network condition, the size of a dynamic GOP is adjusted to balance the coding efficiency and the transmission quality, the loss of frames caused by the overlarge GOP is avoided, the dynamic resolution is adjusted, the push stream resolution is dynamically adjusted according to the resolution capability of a receiving end, and the stream taking quality and the playing fluency according to the requirement are ensured.
The on-demand streaming technology dynamically adjusts the transmission rate of push-pull streaming according to the capacity of a receiving end and the network condition, thereby effectively utilizing the bandwidth to provide smooth playing experience. In the prior art, on-demand streaming of streaming media involves dynamic adjustment of parameters such as code rate and resolution, and needs to be set in an encoder and decoding, which increases complexity of a system, on the other hand, adjusting coding parameters may affect coding efficiency, requires higher computing resources, and excessively adjusts parameters to cause image quality loss and the like under low bandwidth condition, and undergoes changes such as image quality and resolution change during playing, which may affect viewing experience of users.
Disclosure of Invention
The invention provides an audio and video playing method and system for streaming media on demand, which realize audio and video playing of streaming media on demand, reduce complexity of streaming on demand, reduce playing delay and promote experience of users.
In order to solve the above technical problems, an embodiment of the present invention provides an audio/video playing method for streaming media on demand, including:
when a user of a client requests a current media stream, creating a websocket service, establishing websocket connection between a streaming media service end and the client through the websocket service, monitoring a port of the websocket service, and processing request data from the client;
Acquiring and analyzing on-demand information of a client to acquire play request information, and inquiring whether the play request information contains legal data in a database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub-code stream type of the channel number and a playback time period; legal data comprises legal device id and legal channel information;
if the audio and video data is contained, the encapsulated audio and video data is transmitted to the client in real time through websocket connection according to the state of the media stream, the playing request information and the private stream format, so that the client performs format analysis, decoding and playing on the audio and video data received in real time based on the private stream format; wherein the state of the media stream includes a real-time stream and a playback stream;
and if the first request failure information is not contained, returning the first request failure information to the client.
When the embodiment of the invention is implemented, when a user of the client requests a current media stream, a websocket service is created, the streaming media service end and the client are connected through the websocket service, a port of the websocket service is monitored, and request data from the client is processed; acquiring and analyzing on-demand information of a client to acquire play request information, and inquiring whether the play request information contains legal data in a database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub-code stream type of the channel number and a playback time period; legal data comprises legal device id and legal channel information; if the audio and video data is contained, the encapsulated audio and video data is transmitted to the client in real time through websocket connection according to the state of the media stream, the playing request information and the private stream format, so that the client performs format analysis, decoding and playing on the audio and video data received in real time based on the private stream format; wherein the state of the media stream includes a real-time stream and a playback stream; and if the first request failure information is not contained, returning the first request failure information to the client. The websocket connection is established, the websocket transmission protocol is used for transmitting the audio and video private stream format and playing the audio and video private stream format at the player end, the server end and the player end cooperate to realize audio and video data playing of stream taking on demand together, stream taking on demand of a simple private code stream transmission protocol is realized, complexity of stream taking on demand is reduced, complex operation and calculation are not needed, simple, low-delay and smooth streaming media service is realized, stream taking on demand is a solution scheme between balanced bandwidth utilization and playing experience, personalized requirements are met, playing delay is reduced, and experience sense of users is improved.
Preferably, the private stream format includes a data header and audio/video payload data;
the data head comprises an audio and video identifier, a key frame and a display time stamp of audio and video load data;
when the audio and video load data are video load data, the coding of the video load data is packaged into an AVCC format; the AVCC format is obtained by adding a prefix of a specified length of a large-end format to each video coding packet.
As a preferred solution, according to the state of the media stream, the playing request information and the private stream format, the encapsulated audio and video data are connected to the client in real time through websocket, specifically:
when the state of the media stream is real-time stream, checking the existing state of the current real-time stream publisher according to the playing request information, if the existing state exists, subscribing stream data information published by the current real-time stream publisher, and adding 1 to the reference count of the current real-time stream publisher; if the real-time streaming media server does not exist, creating a current publisher of the real-time streaming media, maintaining websocket connection between the streaming media server and the client, and connecting the packaged first audio and video data to the client in real time through websocket connection based on a read command request of the client and a private streaming format;
When the state of the media stream is playback stream, inquiring whether a channel of equipment in a playback time period contains video according to the playing request information, if not, failing to play back, and returning second request failure information to the client; if the video is contained, a current playback stream publisher is constructed according to the playing request information, the websocket connection between the streaming media server and the client is maintained, and the packaged second audio and video data is transmitted to the client in real time through the websocket connection based on the read command request, the seek command request and the private stream format of the client.
As a preferred solution, based on a read command request and a private stream format of a client, the packaged first audio/video data is sent to the client in real time through websocket connection, which specifically includes:
the streaming media server side performs streaming according to the playing request information to obtain first package data and current first audio/video data, and sends the first package data to the client side, so that the client side receives the first package data, initializes the information of the player according to the first package data, dynamically adjusts the current read command request according to the time variable, and sends the current read command request to the streaming media server side; wherein the first packet data includes a coding type of video, a coding type of audio, and sampling rate information of audio; the current read command request includes specifying a number of gops for the current read command request as needed;
The method comprises the steps of receiving a current read command request through a streaming media server, obtaining the quantity of the gops corresponding to the current read command request, obtaining the current quantity of the gops, packaging current first audio and video data according to a private stream format and the current quantity of the gops, and connecting the packaged first audio and video data to a client in real time through websocket.
As a preferred solution, based on the read command request, the seek command request and the private stream format of the client, the encapsulated second audio/video data is sent to the client in real time through websocket connection, specifically:
the streaming media server side performs streaming according to the playing request information to obtain second package data and current second audio/video data, and sends the second package data to the client side, so that the client side receives the second package data, initializes the information of the player according to the second package data, dynamically adjusts the current read command request according to the time variable, sends the current read command request to the streaming media server side, and sends the current seek command request to the streaming media server side according to the designated time stamp in the playback stream; wherein the seek command requests to jump to a specified timestamp for playback of the stream to continue playing; the second packet data includes the coding type of the video, the coding type of the audio and the sampling rate information of the audio;
The method comprises the steps that a streaming media server receives a seek command request, clears a currently existing read command request operation, finds out a first key frame after the seek operation according to the seek command request, and sends a seek response to a client, so that the client receives the seek response, clears a data cache, dynamically adjusts the current read command request according to a time variable, and sends the current read command request to the streaming media server; wherein the current read command request includes specifying a number of gops for the current read command request as needed;
and receiving the current read command request through the streaming media server, acquiring the number of the gops corresponding to the current read command request, obtaining the current number of the gops, packaging the current second audio/video data according to the private stream format and the current number of the gops, and connecting the packaged second audio/video data to the client in real time through websocket.
As a preferred solution, the current read command request is dynamically adjusted according to the time variable, and the current read command request is sent to the streaming media server, specifically:
the time variable of the client comprises a first time variable, a second time variable and a third time variable; the first time variable is the number of read commands which are sent, the second time variable is the time which is remained and is to be received, and the third time variable is the time which is remained and is to be played and is received;
When the time variable of the client meets a first adjustment condition, the client pauses sending a current read command request to the streaming media server; the first adjusting condition is that the third time variable is larger than a first preset threshold value;
when the time variable of the client side meets the second first adjustment condition, the client side increases the quantity of the gops in the current read command request and sends the current read command request to the streaming media server side; the second first adjustment condition is that the second time variable is smaller than a second preset threshold value, the third time variable is smaller than a third preset threshold value, and the first time variable is smaller than a fourth preset threshold value;
when the time variable of the client does not meet the first adjustment condition and does not meet the second adjustment condition, the client sets the number of the gops of the current read command request based on the preset number of the gops, and sends the current read command request to the streaming media server.
As a preferred solution, according to the play request information, the present presence state of the current real-time stream publisher is checked, specifically:
inquiring whether key value information corresponding to the play request information exists in the map table; the key value information of the map table is formed by splicing the id of the on-demand equipment, the channel number of the on-demand equipment and the main sub code stream type of the channel number of the on-demand equipment;
If so, the current real-time stream publisher already exists;
if not, the current real-time stream publisher does not exist.
As a preferred solution, the publisher that creates the current real-time stream is specifically:
taking the device id of the on-demand streaming media service and the main sub code stream type of the channel number as the current key value, taking the object of the current real-time stream publisher as the value corresponding to the current key value, creating the publisher object, and storing the current key value and the value corresponding to the current key value in a map table;
acquiring real-time stream according to the current key value through the publisher object, if the real-time stream data is not acquired within the preset time threshold, returning third request failure information to the client, removing the created publisher object in the map table, and releasing the resource of the publisher of the current path;
if the real-time stream data is acquired within the preset time threshold, the current real-time stream publisher is successfully created.
In order to solve the same technical problem, the embodiment of the present invention further provides an audio/video playing system for streaming media on demand, including: establishing a connection module, a legal inquiry module, an on-demand playing module and a video-on-demand failure module;
the connection establishment module is used for establishing websocket service when a user of the client requests a current media stream, establishing websocket connection between the streaming media server and the client through the websocket service, monitoring a port of the websocket service and processing request data from the client;
The legal inquiry module is used for acquiring and analyzing the on-demand information of the client to acquire the playing request information, and inquiring whether the playing request information contains legal data in the database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub-code stream type of the channel number and a playback time period; legal data comprises legal device id and legal channel information;
the on-demand playing module is used for carrying out format analysis and decoding playing on the audio and video data received in real time by the client based on the private stream format by connecting the packaged audio and video data to the client through websocket according to the state of the media stream, the playing request information and the private stream format if the playing request information contains legal data; wherein the state of the media stream includes a real-time stream and a playback stream;
and the on-demand failure module is used for returning first request failure information to the client if the playing request information does not contain legal data.
As a preferred solution, the on-demand playing module includes a real-time stream playing unit and a playback stream playing unit;
the real-time stream playing unit is used for checking the existing state of the current real-time stream publisher according to the playing request information when the state of the media stream is the real-time stream, subscribing the stream data information published by the current real-time stream publisher if the current real-time stream publisher already exists, and adding 1 to the reference count of the current real-time stream publisher; if the real-time streaming media server does not exist, creating a current publisher of the real-time streaming media, maintaining websocket connection between the streaming media server and the client, and connecting the packaged first audio and video data to the client in real time through websocket connection based on a read command request of the client and a private streaming format;
The playback stream playing unit is used for inquiring whether a channel of the equipment in the playback time period contains video according to the playing request information when the state of the media stream is the playback stream, if not, the playback fails, and returning second request failure information to the client; if the video is contained, a current playback stream publisher is constructed according to the playing request information, the websocket connection between the streaming media server and the client is maintained, and the packaged second audio and video data is transmitted to the client in real time through the websocket connection based on the read command request, the seek command request and the private stream format of the client.
Drawings
Fig. 1: the flow diagram of one embodiment of the audio/video playing method for streaming media on demand is provided by the invention;
fig. 2: the invention provides a structural schematic diagram of an embodiment of an audio/video playing system for streaming media on demand.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Referring to fig. 1, a flow chart of an audio/video playing method for streaming media on demand according to an embodiment of the present invention is shown. According to the embodiment, the websocket connection is established, the websocket transmission protocol is used for transmitting the audio and video private stream format and playing the audio and video private stream format at the player end, so that the audio and video playing of stream media according to the requirement is realized, the complexity of stream acquisition according to the requirement is reduced, the playing delay is reduced, and the experience of a user is improved. The audio and video playing method comprises steps 101 to 104, wherein the steps are as follows:
step 101: when a user of a client requests a current media stream, a websocket service is created, the streaming media service end and the client are connected through the websocket service, a port of the websocket service is monitored, and request data from the client is processed.
In this embodiment, the method for playing audio and video of a stream media on demand is implemented through a streaming media server, when a client plays a certain path of media stream, it may be a real-time stream or a playback stream, when the client plays a certain path of real-time stream, a websocket server is created at a streaming media server end of the streaming media server and a port is monitored, connection from the client is processed, when the client plays a certain path of playback stream, a websocket server is created at the streaming media server end like the real-time stream and the port is monitored, and connection from the client is processed.
Step 102: acquiring and analyzing on-demand information of a client to acquire play request information, and inquiring whether the play request information contains legal data in a database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub-code stream type of the channel number and a playback time period; legal data includes legal device id and legal channel information.
In this embodiment, when a client requests a real-time stream on a certain channel, according to the on-demand information transmitted from the client, the on-demand information mainly includes an id of a certain device under the on-demand streaming media service, a subordinate video channel number of the device and a code stream type (a main code stream and a subcode stream) of the channel number of the on-demand, and the streaming media server parses the information and queries whether the play request information includes legal device ids and channel information from a database of the streaming media server. When a client requests a certain path of playback stream, according to the on-demand information transmitted by the client, the on-demand information mainly comprises the id of a certain device under the on-demand streaming media service, the subordinate video channel number and the playback time period (the starting time and the ending time of the playback stream) of the device, the streaming media server analyzes the information, and queries whether the request contains legal device id and channel information from a database of the streaming media server.
Step 103: if the playing request information contains legal data, the encapsulated audio and video data are connected to the client in real time through websocket according to the state of the media stream, the playing request information and the private stream format, so that the client performs format analysis, decoding and playing on the audio and video data received in real time based on the private stream format; wherein the state of the media stream includes a real-time stream and a playback stream.
Optionally, the private stream format includes a data header and audio video payload data;
the data head comprises an audio and video identifier, a key frame and a display time stamp of audio and video load data;
when the audio and video load data are video load data, the coding of the video load data is packaged into an AVCC format; the AVCC format is obtained by adding a prefix of a specified length of a large-end format to each video coding packet.
In this embodiment, the data format of the private stream format is: data head + audio/video load data two parts are constituteed, data head: in total 6 bytes, the first byte is an audio-video identification, an identification indicating whether the payload data is audio or video, 0 indicates video, and 1 indicates audio. The second byte is a key frame, indicating whether the payload data is a key frame, 1 indicating a key frame, and 0 indicating a non-key frame. The 3 rd to 6 th bytes are a display time stamp of the audio/video payload data, for indicating when the data is displayed to the user. For video data in an audio/video payload, encoding of the video payload data needs to be encapsulated into an AVCC format for transmission, where each NALU packet (video encoding packet) is prefixed with a specified length (NALU packet size) of a big-end format, so that packet parsing in this format is very easy. The NALU refers to a packet into which video is encoded, and is a basic unit for dividing and encapsulating video encoded data.
Optionally, according to the state of the media stream, the playing request information and the private stream format, the step 1031 to step 1032 of connecting the packaged audio and video data to the client in real time through websocket specifically includes the following steps:
step 1031: when the state of the media stream is real-time stream, checking the existing state of the current real-time stream publisher according to the playing request information, if the existing state exists, subscribing stream data information published by the current real-time stream publisher, and adding 1 to the reference count of the current real-time stream publisher; if the first audio and video data does not exist, creating a current publisher of the real-time stream, maintaining websocket connection between the streaming media server and the client, and connecting the packaged first audio and video data to the client in real time through the websocket connection based on a read command request and a private stream format of the client.
In this embodiment, when a client end plays a path of real-time stream, if legal data can be queried, whether the path of real-time stream publisher already exists is checked according to the incoming playing request information, if the real-time stream publisher already exists, the real-time stream publisher does not need to be created again, and only the publisher reference count of the real-time stream needs to be increased by 1.
Optionally, according to the playing request information, checking the current existence state of the real-time stream publisher, specifically:
inquiring whether key value information corresponding to the play request information exists in the map table; the key value information of the map table is formed by splicing the id of the on-demand equipment, the channel number of the on-demand equipment and the main sub code stream type of the channel number of the on-demand equipment;
if so, the current real-time stream publisher already exists;
if not, the current real-time stream publisher does not exist.
In this embodiment, the process of determining whether a real-time stream already exists determines by querying a map table, and when a stream is created, a map mapping table is used to store information of the stream, and the map is stored in a Key-value Key value pair mapping manner. The key value (key) of the map table is formed by splicing the id of the device, the channel number of the on-demand device and the main sub-code stream of the channel number, and the value (value) corresponding to the key value is stored as a publisher object. When a new client (subscriber) subscribes to a stream, firstly, the map table is queried through key values, and if the map table is queried to have corresponding key value information, the fact that the real-time stream of the path is published before is proved, and the fact that the publisher of the real-time stream of the path exists is shown.
Optionally, the publisher that creates the current real-time stream specifically is:
taking the device id of the on-demand streaming media service and the main sub code stream type of the channel number as the current key value, taking the object of the current real-time stream publisher as the value corresponding to the current key value, creating the publisher object, and storing the current key value and the value corresponding to the current key value in a map table;
acquiring real-time stream according to the current key value through the publisher object, if the real-time stream data is not acquired within the preset time threshold, returning third request failure information to the client, removing the created publisher object in the map table, and releasing the resource of the publisher of the current path;
if the real-time stream data is acquired within the preset time threshold, the current real-time stream publisher is successfully created.
In this embodiment, when the client applies for on-demand of a certain path of stream to the streaming media server, the necessary information that the client transmits to the streaming media server is: the on-demand device id, the on-demand channel number and whether the on-demand is the main code stream or the subcode stream, the streaming media server inquires whether the map table of the publisher has the publication of the stream according to the information, if so, the publisher directly subscribes, the publisher forwards the stream information to different subscribers, and if not, the publisher needs to create the publication of a real-time stream. The real-time stream publisher is created by only taking the device id, the channel number and the main sub code stream type as key values, the publisher object as a value, recording as pub and storing. The publisher object includes an object that needs to pull the stream to the channel of the device, and records the object as an avin, wherein the avin attempts to acquire real-time stream from the designated device and the channel designated code stream type, the object waits for a timeout period, if the stream data is not acquired yet by a preset time threshold (for example: 5 seconds), the request fails, a third request failure message is returned to the client, the just created publisher information is removed from the map table, and the resource of the publisher is released. If the stream data can be normally acquired within 5 seconds, the publisher is proved to publish the stream successfully.
Optionally, based on the read command request and the private stream format of the client, the encapsulated first audio/video data is sent to the client in real time through websocket connection, and the specific steps S11-S12 are as follows:
s11, carrying out streaming according to the playing request information through a streaming media server to obtain first package data and current first audio/video data, and sending the first package data to a client, so that the client receives the first package data, initializes the information of a player according to the first package data, dynamically adjusts a current read command request according to a time variable, and sends the current read command request to the streaming media server; wherein the first packet data includes a coding type of video, a coding type of audio, and sampling rate information of audio; the current read command request includes a number of gops that specify the current read command request as needed.
In this embodiment, after the streaming media server successfully creates the real-time streaming publisher, the client and the server remain connected, and the server sends first packet data to the client, where the first packet data indicates information such as an audio/video coding type to be transmitted to the client, and the method includes: the coding type of the video, the coding type of the audio, and the sampling rate information of the audio. After the client receives the information, initializing relevant information of the player, and preparing to decode and display the audio and video data sent by the streaming media service in real time.
In this embodiment, after a websocket connection is established between a client and a streaming media server, the streaming media server pulls a stream to the streaming media server according to on-demand play request information, and after the streaming media server sends a first packet (first packet data), waits for an instruction of the client, and when the client sends a read instruction request (a read command request) to the streaming media server (the read instruction indicates the number of gops to be sent), the streaming media server starts to send the specified number of gops to the client after receiving the request instruction of the client.
It should be noted that, the data information of the first packet (first packet data) is audio/video data coding information to be transmitted by the real-time stream, for example, whether the audio to be transmitted subsequently is in aac format or g711a format, and whether the video is h264 coding or h265 coding, which is used to tell the client that these information are used to initialize the player. The audio and video data comprise audio load data and video load data, when the audio and video data are transmitted to the client, the video load data are encapsulated in an AVCC format, and the audio load data are directly encapsulated in an original format and transmitted to the client.
S12, receiving a current read command request through a streaming media server, obtaining the number of the gops corresponding to the current read command request, obtaining the current number of the gops, packaging the current first audio/video data according to the private stream format and the current number of the gops, and connecting the packaged first audio/video data to a client in real time through websocket.
In this embodiment, from the 2 nd packet, after the package is performed according to the private stream format, the stream data of the streaming media server is sent to the client through the websocket, and the client parses according to the private stream format and decodes and plays the stream data. For video streaming, it is also necessary to encapsulate the encoding of the video payload data into AVCC format transmission, where the AVCC format is to prefix a specified length of a large end format (NALU packet size) in each NALU packet, making packet parsing in this format very easy. NALU refers to a packet into which video is encoded, and is the basic unit of video encoded data for partitioning and encapsulation. For the real-time stream, the playback of the real-time stream is realized by transmitting the private code stream through the established websocket.
Step 1032: when the state of the media stream is playback stream, inquiring whether a channel of equipment in a playback time period contains video according to the playing request information, if not, failing to play back, and returning second request failure information to the client; if the video is contained, a current playback stream publisher is constructed according to the playing request information, the websocket connection between the streaming media server and the client is maintained, and the packaged second audio and video data is transmitted to the client in real time through the websocket connection based on the read command request, the seek command request and the private stream format of the client.
In this embodiment, when the state of the media stream is a playback stream, if legal data can be queried, then query whether the channel of the device in the playback time period contains video, if yes, playback fails, response request failure is sent to the client, and second request failure information is sent to the client without video. If the video exists in the time period, the server establishes a publisher of the playback stream, maintains websocket connection between the streaming media server and the client, and sends the packaged second audio and video data to the client in real time through websocket connection based on a read command request, a seek command request and a private stream format of the client.
Optionally, based on the read command request, the seek command request and the private stream format of the client, the packaged second audio/video data is sent to the client in real time through websocket connection, and the specific steps S21-S23 are as follows:
s21: the streaming media server side performs streaming according to the playing request information to obtain second package data and current second audio/video data, and sends the second package data to the client side, so that the client side receives the second package data, initializes the information of the player according to the second package data, dynamically adjusts the current read command request according to the time variable, sends the current read command request to the streaming media server side, and sends the current seek command request to the streaming media server side according to the designated time stamp in the playback stream; wherein the seek command requests to jump to a specified timestamp for playback of the stream to continue playing; the second packet data includes the coding type of the video, the coding type of the audio and the sampling rate information of the audio;
In this embodiment, if there is a video in the period, the server establishes a publisher of the playback stream, and simultaneously, includes: the coding type of the video, the coding type of the audio and the sampling rate information of the audio are sent to the client, and the client analyzes the information after receiving the information and initializes the player resources of the client. Starting from the 2 nd packet, the server side sends the audio and video private format data to the client side. Unlike real-time streaming, playback streaming requires operations such as seek, and thus, different processing is required, and a current seek command request is sent to a streaming media server according to the need (a specified time stamp in the playback streaming), and the seek command request is used for jumping to the specified time stamp for playback streaming to continue playing, and the time stamp is specified.
S22: the method comprises the steps that a streaming media server receives a seek command request, clears a currently existing read command request operation, finds out a first key frame after the seek operation according to the seek command request, and sends a seek response to a client, so that the client receives the seek response, clears a data cache, dynamically adjusts the current read command request according to a time variable, and sends the current read command request to the streaming media server; wherein the current read command request includes specifying a number of gops for the current read command request as needed;
In this embodiment, for seek operation, the flow is also implemented by on-demand streaming, specifically: when a seek operation is needed, the client sends a seek command to the server, and indicates in the command which time stamp the seek is to the playback stream, after receiving the seek request, the server firstly empties the rest of read command request operation, then executes the seek operation on the playback stream, and finds the first key frame (I frame) after the seek operation, then the seek responds to the client, the responding message format is 2 bytes, the first byte is 2, the second byte is whether the seek operation is successful, 1 indicates failure, and 0 indicates success. After receiving the response of seek, the client side immediately empties the data cache and resends the read request to the server side, so that the continuous playing of the data after seek can be realized, and the method of streaming playing according to the requirement is realized. It should be noted that, for seek operation, the streaming media server always sends a seek success response to the client, and after receiving the success response, the client immediately empties the data already cached by the client, and resends the read request command to the streaming media server.
S23: and receiving the current read command request through the streaming media server, acquiring the number of the gops corresponding to the current read command request, obtaining the current number of the gops, packaging the current second audio/video data according to the private stream format and the current number of the gops, and connecting the packaged second audio/video data to the client in real time through websocket.
In this embodiment, two commands are provided at the streaming server for use by the client, one is "read" and one is "seek", i.e. read and jump, respectively. The Read command takes GOP as a unit, the GOP refers to the frame number interval between two I frames, the client dynamically adjusts the request Read command sent to the server according to the actual condition of time variable, if the client plays normally, the client can dynamically send the Read command and appoint the number of the gos requested by the command to the server, and the server sends the appointed number of the gos stream data to the client for playing as required after receiving the command.
Optionally, the current read command request is dynamically adjusted according to the time variable, and the current read command request is sent to the streaming media server, specifically:
the time variable of the client comprises a first time variable, a second time variable and a third time variable; the first time variable is the number of read commands which are sent, the second time variable is the time which is remained and is to be received, and the third time variable is the time which is remained and is to be played and is received;
when the time variable of the client meets a first adjustment condition, the client pauses sending a current read command request to the streaming media server; the first adjusting condition is that the third time variable is larger than a first preset threshold value;
When the time variable of the client side meets the second first adjustment condition, the client side increases the quantity of the gops in the current read command request and sends the current read command request to the streaming media server side; the second first adjustment condition is that the second time variable is smaller than a second preset threshold value, the third time variable is smaller than a third preset threshold value, and the first time variable is smaller than a fourth preset threshold value;
when the time variable of the client does not meet the first adjustment condition and does not meet the second adjustment condition, the client sets the number of the gops of the current read command request based on the preset number of the gops, and sends the current read command request to the streaming media server.
In this embodiment, the client has 3 time variables, the first time variable is the number of read instructions that have been sent, recorded as t1, the second time variable is the time remaining to be received, recorded as t2, and the third time variable is the time remaining to be played, recorded as t3. If t3 is more, the buffer memory is enough to play for a period of time, and a read request is not needed to be sent to the server temporarily, so that the overlarge data buffer memory caused by frequent sending is avoided. When t2 is too small, t3 is too small and t1 is too small, a read request is timely sent, data is timely obtained from a media server, and certain cache of client data is guaranteed.
Step 104: and if the playing request information does not contain legal data, returning first request failure information to the client.
In this embodiment, when legal data cannot be queried in the play request information, the request stream is directly returned to fail, and the first request failure information is returned to the client.
When the embodiment of the invention is implemented, when a user of the client requests a current media stream, a websocket service is created, the streaming media service end and the client are connected through the websocket service, a port of the websocket service is monitored, and request data from the client is processed; acquiring and analyzing on-demand information of a client to acquire play request information, and inquiring whether the play request information contains legal data in a database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub-code stream type of the channel number and a playback time period; legal data comprises legal device id and legal channel information; if the audio and video data is contained, the encapsulated audio and video data is transmitted to the client in real time through websocket connection according to the state of the media stream, the playing request information and the private stream format, so that the client performs format analysis, decoding and playing on the audio and video data received in real time based on the private stream format; wherein the state of the media stream includes a real-time stream and a playback stream; and if the first request failure information is not contained, returning the first request failure information to the client. The websocket connection is established, the websocket transmission protocol is used for transmitting the audio and video private stream format and playing the audio and video private stream format at the player end, the server end and the player end cooperate to realize audio and video data playing of stream taking on demand together, stream taking on demand of a simple private code stream transmission protocol is realized, complexity of stream taking on demand is reduced, complex operation and calculation are not needed, simple, low-delay and smooth streaming media service is realized, stream taking on demand is a solution scheme between balanced bandwidth utilization and playing experience, personalized requirements are met, playing delay is reduced, and experience sense of users is improved.
Example two
Accordingly, referring to fig. 2, fig. 2 is a schematic structural diagram of a second embodiment of an audio/video playing system for streaming media on demand according to the present invention. As shown in fig. 2, the audio/video playing system for streaming media on demand includes a connection establishment module 201, a legal inquiry module 202, an on demand playing module 203, and an on demand failure module 204;
the connection establishment module 201 is configured to establish a websocket service when a user of a client requests a current media stream, establish a websocket connection between a streaming media server and the client through the websocket service, monitor a port of the websocket service, and process request data from the client;
the legal inquiry module 202 is used for acquiring and analyzing the on-demand information of the client to acquire the play request information, and inquiring whether the play request information contains legal data in the database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub-code stream type of the channel number and a playback time period; legal data comprises legal device id and legal channel information;
the on-demand playing module 203 is configured to, if the playing request information includes legal data, connect, in real time, the encapsulated audio and video data to the client through websocket according to the state of the media stream, the playing request information and the private stream format, so that the client performs format analysis and decoding playing on the audio and video data received in real time based on the private stream format; wherein the state of the media stream includes a real-time stream and a playback stream;
The on-demand playback module 203 includes a real-time stream playback unit 2031 and a playback stream playback unit 2032;
the real-time stream playing unit 2031 is configured to, when the state of the media stream is a real-time stream, check, according to the playing request information, the presence state of a current real-time stream publisher, and if the presence state exists, subscribe to stream data information published by the current real-time stream publisher, and increment a reference count of the current real-time stream publisher by 1; if the real-time streaming media server does not exist, creating a current publisher of the real-time streaming media, maintaining websocket connection between the streaming media server and the client, and connecting the packaged first audio and video data to the client in real time through websocket connection based on a read command request of the client and a private streaming format;
the playback stream playing unit 2032 is configured to query whether a channel of the device in a playback time period contains a video according to the play request information when the state of the media stream is a playback stream, and if not, playback fails, and return second request failure information to the client; if the video is contained, a current playback stream publisher is constructed according to the playing request information, the websocket connection between the streaming media server and the client is maintained, and the packaged second audio and video data is transmitted to the client in real time through the websocket connection based on the read command request, the seek command request and the private stream format of the client.
The on-demand failure module 204 is configured to return first request failure information to the client if the play request information does not contain legal data.
The embodiment of the invention realizes the on-demand streaming by adopting a simple streaming media private protocol transmission mode, has simple realization, does not need complex operation and calculation, and cooperates with a server side and a client side, thereby realizing simple, low-delay and smooth streaming media service.
The audio/video playing system capable of streaming media on demand can implement the audio/video playing method capable of streaming media on demand according to the above method embodiment. The options in the method embodiments described above are also applicable to this embodiment and will not be described in detail here. The rest of the embodiments of the present application may refer to the content of the method embodiments described above, and in this embodiment, no further description is given.
The foregoing embodiments have been provided for the purpose of illustrating the general principles of the present invention, and are not to be construed as limiting the scope of the invention. It should be noted that any modifications, equivalent substitutions, improvements, etc. made by those skilled in the art without departing from the spirit and principles of the present invention are intended to be included in the scope of the present invention.
Claims (10)
1. An audio and video playing method for streaming media to be fetched according to requirements is characterized by comprising the following steps:
when a user of a client requests a current media stream, creating a websocket service, establishing websocket connection between a streaming media server and the client through the websocket service, monitoring a port of the websocket service, and processing request data from the client;
acquiring and analyzing on-demand information of the client to acquire play request information, and inquiring whether the play request information contains legal data in a database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub code stream type of the channel number and a playback time period; the legal data comprises legal equipment id and legal channel information;
if the audio and video data is contained, the packaged audio and video data is connected to the client in real time through the websocket according to the state of the media stream, the playing request information and the private stream format, so that the client analyzes, decodes and plays the audio and video data received in real time based on the private stream format; wherein the state of the media stream includes a real-time stream and a playback stream;
And if not, returning first request failure information to the client.
2. The method for playing audio and video on demand streaming according to claim 1, wherein the private streaming format includes a header and audio and video payload data;
the data head comprises an audio and video identifier, a key frame and a display time stamp of audio and video load data;
when the audio and video load data are video load data, the codes of the video load data are packaged into an AVCC format; wherein, the AVCC format is obtained by adding a prefix of a specified length of a big end format to each video coding packet.
3. The method for playing audio and video according to on-demand streaming of claim 1, wherein the real-time streaming of the encapsulated audio and video data to the client through the websocket connection according to the state of the media stream, the playing request information and the private streaming format is specifically as follows:
when the state of the media stream is the real-time stream, checking the existing state of the current real-time stream publisher according to the playing request information, if the existing state exists, subscribing the stream data information published by the current real-time stream publisher, and adding 1 to the reference count of the current real-time stream publisher; if the current real-time stream does not exist, creating a publisher of the current real-time stream, maintaining websocket connection between the streaming media server and the client, and real-time transmitting the packaged first audio and video data to the client through the websocket connection based on a read command request of the client and the private stream format;
When the state of the media stream is the playback stream, inquiring whether a channel of the equipment in the playback time period contains video according to the playing request information, if not, failing to play back, and returning second request failure information to the client; if the video is contained, a current playback stream publisher is constructed according to the play request information, the websocket connection between the streaming media server and the client is maintained, and the packaged second audio and video data is transmitted to the client in real time through the websocket connection based on the read command request, the seek command request and the private stream format of the client.
4. The method for playing audio and video according to on-demand streaming of claim 3, wherein the real-time sending the packaged first audio and video data to the client through the websocket connection based on the read command request of the client and the private streaming format specifically comprises:
the streaming media server side performs streaming according to the playing request information to obtain first package data and current first audio/video data, and sends the first package data to the client side, so that the client side receives the first package data, initializes the information of a player according to the first package data, dynamically adjusts a current read command request according to a time variable, and sends the current read command request to the streaming media server side; wherein the first packet data includes an encoding type of video, an encoding type of audio, and sampling rate information of audio; the current read command request comprises the step of specifying the quantity of gos of the current read command request according to the requirement;
And receiving the current read command request through the streaming media server, obtaining the number of the gops corresponding to the current read command request, obtaining the current number of the gops, packaging the current first audio/video data according to the private stream format and the current number of the gops, and connecting the packaged first audio/video data to the client in real time through the websocket.
5. The method for playing audio and video according to on-demand streaming of claim 3, wherein the real-time sending the second audio and video data after being packaged to the client through the websocket connection based on the read command request, the seek command request and the private streaming format of the client specifically comprises:
pulling stream according to the playing request information through a streaming media server to obtain second packet data and current second audio/video data, and sending the second packet data to the client so that the client receives the second packet data, initializes information of a player according to the second packet data, dynamically adjusts a current read command request according to a time variable, sends the current read command request to the streaming media server, and sends the current seek command request to the streaming media server according to a specified time stamp in the playback stream; wherein the seek command requests that playback be continued with the playback stream jumping to the specified timestamp; the second packet data comprises the coding type of the video, the coding type of the audio and the sampling rate information of the audio;
Receiving the seek command request by the streaming media server, clearing the currently existing read command request operation, finding out the first key frame after the seek operation according to the seek command request, sending a seek response to the client so that the client receives the seek response, clearing the data cache, dynamically adjusting the current read command request according to a time variable, and sending the current read command request to the streaming media server; wherein the current read command request includes specifying a number of gops of the current read command request as needed;
and receiving the current read command request through the streaming media server, obtaining the number of the gops corresponding to the current read command request, obtaining the current number of the gops, packaging the current second audio/video data according to the private stream format and the current number of the gops, and connecting the packaged second audio/video data to the client in real time through the websocket.
6. The method for playing audio and video according to on-demand streaming of claim 4 or 5, wherein the dynamically adjusting the current read command request according to the time variable and sending the current read command request to the streaming server comprises:
The time variable of the client comprises a first time variable, a second time variable and a third time variable; the first time variable is the number of read commands which are sent, the second time variable is the time which is remained and is to be received, and the third time variable is the time which is remained and is to be played and is to be received;
when the time variable of the client side meets a first adjustment condition, the client side pauses sending the current read command request to the streaming media server side; wherein the first adjustment condition is that the third time variable is greater than a first preset threshold;
when the time variable of the client side meets a second first adjustment condition, the client side increases the quantity of the gops in the current read command request and sends the current read command request to the streaming media server side; the second first adjustment condition is that the second time variable is smaller than a second preset threshold, the third time variable is smaller than a third preset threshold, and the first time variable is smaller than a fourth preset threshold;
when the time variable of the client does not meet the first adjustment condition and does not meet the second adjustment condition, the client sets the number of the gops requested by the current read command based on the preset number of the gops, and sends the current read command request to the streaming media server.
7. The method for playing audio and video according to on-demand streaming of claim 3, wherein the checking the existing state of the current real-time streaming publisher according to the playing request information specifically comprises:
inquiring whether key value information corresponding to the playing request information exists in a map table; the key value information of the map table is formed by splicing an id of an on-demand device, a channel number of the on-demand device and a main code stream type of the channel number of the on-demand device;
if so, the current real-time stream publisher exists;
if not, the current real-time stream publisher does not exist.
8. The method for playing audio and video of streaming media on demand according to claim 7, wherein the creating the current real-time stream publisher specifically comprises:
taking the main sub code stream type of the device id and the channel number of the on-demand streaming media service as a current key value, taking the object of the publisher of the current real-time stream as a value corresponding to the current key value, creating a publisher object, and storing the current key value and the value corresponding to the current key value in the map table;
acquiring a real-time stream according to the current key value through the publisher object, if real-time stream data is not acquired within a preset time threshold, returning third request failure information to the client, removing the created publisher object in the map table, and releasing the resource of the publisher of the current path;
If the real-time stream data is acquired within the preset time threshold, the current real-time stream publisher is successfully created.
9. An audio/video playing system for streaming media on demand, comprising: establishing a connection module, a legal inquiry module, an on-demand playing module and a video-on-demand failure module;
the connection establishment module is used for establishing websocket service when a user of the client requests a current media stream, establishing websocket connection between a streaming media server and the client through the websocket service, monitoring a port of the websocket service, and processing request data from the client;
the legal inquiry module is used for acquiring and analyzing the on-demand information of the client to acquire play request information, and inquiring whether the play request information contains legal data in a database; the on-demand information comprises an equipment id of an on-demand streaming media service, a subordinate video channel number of the equipment, a main sub code stream type of the channel number and a playback time period; the legal data comprises legal equipment id and legal channel information;
the on-demand playing module is used for carrying out format analysis and decoding playing on the audio and video data received in real time by the client based on the private stream format by connecting the packaged audio and video data to the client through the websocket according to the state of the media stream, the playing request information and the private stream format if the playing request information contains legal data; wherein the state of the media stream includes a real-time stream and a playback stream;
And the on-demand failure module is used for returning first request failure information to the client if the play request information does not contain legal data.
10. The audio-video playing system of streaming media on demand according to claim 9, wherein the on demand playing module includes a real-time streaming playing unit and a playback streaming playing unit;
the real-time stream playing unit is used for checking the existing state of the current real-time stream publisher according to the playing request information when the state of the media stream is the real-time stream, subscribing the stream data information published by the current real-time stream publisher if the current real-time stream publisher exists, and adding 1 to the reference count of the current real-time stream publisher; if the current real-time stream does not exist, creating a publisher of the current real-time stream, maintaining websocket connection between the streaming media server and the client, and real-time transmitting the packaged first audio and video data to the client through the websocket connection based on a read command request of the client and the private stream format;
the playback stream playing unit is used for inquiring whether a channel of the equipment in the playback time period contains video according to the playing request information when the state of the media stream is the playback stream, if not, the playback is failed, and returning second request failure information to the client; if the video is contained, a current playback stream publisher is constructed according to the play request information, the websocket connection between the streaming media server and the client is maintained, and the packaged second audio and video data is transmitted to the client in real time through the websocket connection based on the read command request, the seek command request and the private stream format of the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311315905.3A CN117459760A (en) | 2023-10-11 | 2023-10-11 | Audio and video playing method and system for streaming media on-demand streaming |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311315905.3A CN117459760A (en) | 2023-10-11 | 2023-10-11 | Audio and video playing method and system for streaming media on-demand streaming |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117459760A true CN117459760A (en) | 2024-01-26 |
Family
ID=89584544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311315905.3A Pending CN117459760A (en) | 2023-10-11 | 2023-10-11 | Audio and video playing method and system for streaming media on-demand streaming |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117459760A (en) |
-
2023
- 2023-10-11 CN CN202311315905.3A patent/CN117459760A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10250659B2 (en) | Contextually aware client buffer thresholds | |
| US10263875B2 (en) | Real-time processing capability based quality adaptation | |
| US20160337424A1 (en) | Transferring media data using a websocket subprotocol | |
| CN107743703B (en) | Method, apparatus and computer-readable storage medium for media data transmission | |
| RU2622621C2 (en) | System and method for flow transfer of reproduced content | |
| US10938872B2 (en) | Processing interactivity events for streaming media data | |
| EP2086240A1 (en) | A method and a system for supporting media data of various coding formats | |
| US20050123042A1 (en) | Moving picture streaming file, method and system for moving picture streaming service of mobile communication terminal | |
| US20110302618A1 (en) | Fragmented file structure for live media stream delivery | |
| US20110116772A1 (en) | Method and apparatus for providing trick play service | |
| WO2019062050A1 (en) | Live broadcast control method, apparatus, and electronic device | |
| US20180176278A1 (en) | Detecting and signaling new initialization segments during manifest-file-free media streaming | |
| KR20080045276A (en) | Rtp payload format for vc-1 | |
| WO2011153001A1 (en) | Quality adjustment using a fragmented media stream | |
| JP2001204001A (en) | Moving picture distribution system, reproduction terminal and distributor | |
| US20230045876A1 (en) | Video Playing Method, Apparatus, and System, and Computer Storage Medium | |
| KR20230030589A (en) | Streaming of Media Data Containing an Addressable Resource Index Track with Switching Sets | |
| CN114501052B (en) | Live broadcast data processing method, cloud platform, computer equipment and storage medium | |
| CN110086797B (en) | Real-time receiving method of media stream, client, computer device and storage medium | |
| KR101164746B1 (en) | System and method for compensating consecutive palyback delay of video playback service based on real-time streaming protocol | |
| CN110881018B (en) | Real-time receiving method and client of media stream | |
| CN115643426B (en) | Universal video playing method and system for space application field | |
| KR101625663B1 (en) | Method and Apparatus for Receiving Content | |
| US8811478B2 (en) | Data transmission method and apparatus | |
| CN117459760A (en) | Audio and video playing method and system for streaming media on-demand streaming |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |