CN106790030B - Multi-screen cooperative audio transmission server, client, system and processing method thereof - Google Patents

Multi-screen cooperative audio transmission server, client, system and processing method thereof Download PDF

Info

Publication number
CN106790030B
CN106790030B CN201611159671.8A CN201611159671A CN106790030B CN 106790030 B CN106790030 B CN 106790030B CN 201611159671 A CN201611159671 A CN 201611159671A CN 106790030 B CN106790030 B CN 106790030B
Authority
CN
China
Prior art keywords
transmission
client
server
audio transmission
screen cooperative
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201611159671.8A
Other languages
Chinese (zh)
Other versions
CN106790030A (en
Inventor
龚翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Changhong Electric Co Ltd
Original Assignee
Sichuan Changhong Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Changhong Electric Co Ltd filed Critical Sichuan Changhong Electric Co Ltd
Priority to CN201611159671.8A priority Critical patent/CN106790030B/en
Publication of CN106790030A publication Critical patent/CN106790030A/en
Application granted granted Critical
Publication of CN106790030B publication Critical patent/CN106790030B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention relates to the technology of intelligent equipment. The invention provides a multi-screen cooperative audio transmission server, a client, a system and a processing method thereof, aiming at solving the problem that an audio file needs to be downloaded or copied to an intelligent device end for playing, and the technical scheme can be summarized as follows: the multi-screen cooperative audio transmission server comprises a server session module and a sending module, the server session module is connected with the sending module, the multi-screen cooperative audio transmission client comprises a client session module, a receiving module, a transmission quality control module and a player, the receiving module is connected with the client session module, the transmission quality control module is connected with the receiving module, the player is connected with the transmission quality control module, and the transmission quality control module is connected with the client session module. The method and the device have the advantages of being convenient for users and suitable for multi-screen cooperation of the intelligent equipment.

Description

Multi-screen cooperative audio transmission server, client, system and processing method thereof
Technical Field
The invention relates to an intelligent device technology, in particular to a multi-screen cooperation technology of an intelligent device.
Background
With the development of network communication technology and the popularization of household intelligent equipment, the position of the intelligent television in the aspect of household entertainment is increasingly prominent, the interactive application of the intelligent television and the intelligent equipment is realized by utilizing a wireless network, an audio file needs to be downloaded or copied to an intelligent television terminal for playing in a traditional mode, and the traditional mode cannot meet the principle of rapidness and convenience in the interactive application.
Disclosure of Invention
The invention aims to solve the problem that an audio file needs to be downloaded or copied to an intelligent equipment terminal for playing at present, and provides a multi-screen cooperative audio transmission server terminal, a client terminal, a system and a processing method thereof.
The invention solves the technical problem, adopts the technical scheme that the multi-screen cooperative audio transmission server is characterized by comprising a server session module and a sending module, wherein the server session module is connected with the sending module,
the server session module is used for connecting with the client through a network and providing communication between the server and the client, wherein the communication comprises an RTSP report, an RTP data packet and a transmission flow control management data packet;
and the sending module is used for encapsulating the corresponding audio data stream into an RTP packet and sending the RTP packet to the client, and receiving and processing a transmission flow control management data packet sent by the client.
Specifically, the transport flow control management packet is an RTCP packet.
Further, the RTSP report includes a play command and/or a pause command and/or a stop command.
The multi-screen collaborative audio transmission client is characterized by comprising a client session module, a receiving module, a transmission quality control module and a player, wherein the receiving module is connected with the client session module, the transmission quality control module is connected with the receiving module, the player is connected with the transmission quality control module, the transmission quality control module is connected with the client session module,
the client session module is used for connecting with the server through a network and providing communication between the server and the client, and the communication comprises an RTSP report, an RTP data packet and a transmission flow control management data packet;
the receiving module is used for receiving and analyzing an RTP packet sent by the server;
the transmission quality control module is used for carrying out transmission flow control management according to the RTP packet received by the receiving module and sending a transmission flow control management data packet to the server;
the player is used for playing the audio data stream obtained after analysis.
Specifically, the transport flow control management packet is an RTCP packet.
Further, the RTSP report includes a play command and/or a pause command and/or a stop command.
The multi-screen cooperative audio transmission system is characterized by comprising the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client, wherein the server session module is connected with the client session module through a network.
A processing method of a multi-screen cooperative audio transmission system is applied to the multi-screen cooperative audio transmission system, and is characterized by comprising the following steps:
step 1, a multi-screen cooperative audio transmission client sends a request for establishing session connection to a multi-screen cooperative audio transmission server through an RTSP (real time streaming protocol), and the multi-screen cooperative audio transmission server establishes session connection;
step 2, the multi-screen cooperative audio transmission client sends an audio data transmission request to the multi-screen cooperative audio transmission server through an RTSP (real time streaming protocol);
step 3, the multi-screen cooperative audio transmission server encapsulates the corresponding audio data streams into RTP packets, prints corresponding timestamp information and sequence numbers and sends the timestamp information and the sequence numbers to the multi-screen cooperative audio transmission client;
step 4, the multi-screen cooperative audio transmission client decodes the audio data stream in the received RTP packet according to the timestamp information in the RTP packet and stores the decoded audio data stream into a data buffer pool;
step 5, a transmission quality control module of the multi-screen cooperative audio transmission client extracts audio data streams from the data buffer pool, sorts the audio data streams according to sequence numbers and transmits the audio data streams to a player for playing, playing synchronization information is fed back to the multi-screen cooperative audio transmission server through a transmission flow control management data packet, and the multi-screen cooperative audio transmission server adjusts a strategy of sending an RTP packet according to the received transmission flow control management data packet so as to realize audio synchronization;
and step 6, during playing, the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client monitor the received RTSP report at all times and perform corresponding processing on the RTSP report.
Specifically, the step 1 comprises the following specific steps:
101, starting a multi-screen cooperative audio transmission server, and creating a transmission flow control real-time service thread, an RTP real-time service thread and an RTSP real-time service thread;
102, a multi-screen cooperative audio transmission server creates a UDP socket and binds the UDP socket to an address of a provided service, an RTP packet uses an even number □, and a corresponding transmission flow control data packet uses an odd number port;
103, the multi-screen cooperative audio transmission server monitors and receives RTSP reports from the multi-screen cooperative audio transmission client at a moment, if the RTSP reports sent by the multi-screen cooperative audio transmission client are session connection requests, the step 104 is executed, and if the RTSP reports sent by the multi-screen cooperative audio transmission client are session connection requests, the step 6 is executed;
and step 104, the multi-screen cooperative audio transmission server responds to the session connection request, establishes session connection with the multi-screen cooperative audio transmission client, and enters step 2.
Further, step 3 comprises the following steps:
step 301, a multi-screen cooperative audio transmission server determines the size of each audio data frame in a corresponding audio data stream, and if the length of one frame exceeds a maximum transmission unit, the frame is subjected to fragment packaging;
step 302, the multi-screen cooperative audio transmission server converts an audio data frame into an RTP packet, and sets a sequence number and timestamp information in the RTP packet header according to each frame of information, so as to perform play synchronization and packet loss processing;
step 303, the multi-screen cooperative audio transmission server stores the RTP packet in a sending buffer pool and sends the RTP packet to the multi-screen cooperative audio transmission client according to a sending strategy;
step 4 comprises the following steps:
step 401, the multi-screen collaborative audio transmission client receives an RTP packet, analyzes the RTP packet, removes RTP packet header information, and stores an audio data frame, a sequence number and timestamp information obtained by analysis into a data buffer pool;
step 5 comprises the following steps:
step 501, a transmission quality control module of a multi-screen cooperative audio transmission client extracts an audio data stream from a data buffer pool;
step 502, sequencing the extracted audio data streams according to corresponding sequence numbers, analyzing RTP packets lost in UPD transmission, and feeding back control management data packets to a multi-screen cooperative audio transmission server through transmission flow control;
step 503, establishing absolute time axis information by using the extracted timestamp information corresponding to the audio data streams, comparing the current time information with the absolute time information and transmitting the result to a player for playing, and feeding back the comparison difference value to the multi-screen cooperative audio transmission server through a transmission flow control management data packet;
and step 504, the multi-screen cooperative audio transmission server side adjusts a strategy of sending an RTP packet according to the received transmission flow control management data packet so as to realize audio synchronization.
The multi-screen cooperative audio transmission server, the multi-screen cooperative audio transmission client, the multi-screen cooperative audio transmission system and the multi-screen cooperative audio transmission processing method have the advantages that through the multi-screen cooperative audio transmission server, the multi-screen cooperative audio transmission client, the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client transmit audio data through data streams through a network, the client does not need to download or copy audio files needing to be played to the local, users are facilitated, and processing is rapid.
Drawings
Fig. 1 is a system block diagram of a multi-screen cooperative audio transmission server according to the present invention.
FIG. 2 is a system block diagram of a multi-screen cooperative audio transmission client according to the present invention.
Fig. 3 is a system block diagram of a multi-screen cooperative audio transmission system.
Detailed Description
The technical solution of the present invention is described in detail below with reference to the accompanying drawings and embodiments.
The system block diagram of the multi-screen collaborative audio transmission server is shown in figure 1, and the multi-screen collaborative audio transmission server comprises a server session module and a sending module, wherein the server session module is connected with the sending module, the server session module is used for being connected with a client through a network and providing communication between the server and the client, and the communication comprises an RTSP report, an RTP data packet and a transmission flow control management data packet; the sending module is used for encapsulating the corresponding audio data stream into an RTP packet and sending the RTP packet to the client, and receiving and processing a transmission flow control management data packet sent by the client.
The invention relates to a multi-screen collaborative audio transmission client, a system block diagram of which is shown in figure 2, and the multi-screen collaborative audio transmission client comprises a client session module, a receiving module, a transmission quality control module and a player, wherein the receiving module is connected with the client session module, the transmission quality control module is connected with the receiving module, the player is connected with the transmission quality control module, and the transmission quality control module is connected with the client session module, wherein the client session module is used for being connected with a server through a network and providing communication between the server and the client, and comprises an RTSP report, an RTP data packet and a transmission flow control management data packet; the receiving module is used for receiving and analyzing an RTP packet sent by the server; the transmission quality control module is used for carrying out transmission flow control management according to the RTP packet received by the receiving module and sending a transmission flow control management data packet to the server; the player is used for playing the audio data stream obtained after analysis.
The multi-screen cooperative audio transmission system comprises the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client, wherein the server session module is connected with the client session module through a network.
The invention relates to a processing method of a multi-screen cooperative audio transmission system, which is applied to the multi-screen cooperative audio transmission system and specifically comprises the following steps: firstly, a multi-screen cooperative audio transmission client sends a session connection establishment request to a multi-screen cooperative audio transmission server through an RTSP protocol, the multi-screen cooperative audio transmission server establishes session connection, the multi-screen cooperative audio transmission client sends an audio data transmission request to the multi-screen cooperative audio transmission server through the RTSP protocol, then the multi-screen cooperative audio transmission server encapsulates corresponding audio data streams into RTP packets, prints corresponding timestamp information and sequence numbers and sends the RTP packets to the multi-screen cooperative audio transmission client, the multi-screen cooperative audio transmission client decodes and stores the audio data streams in the RTP packets into a data buffer pool according to the received timestamp information, then a transmission quality control module of the multi-screen cooperative audio transmission client extracts the audio data streams from the data buffer pool and transmits the audio data streams to a player for playing after the audio data streams are sequenced according to the sequence numbers, feeding back the playing synchronization information to the multi-screen cooperative audio transmission server through the transmission flow control management data packet, and adjusting a strategy of sending an RTP packet by the multi-screen cooperative audio transmission server according to the received transmission flow control management data packet to realize audio synchronization; during playing, the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client both monitor the received RTSP report at any moment and perform corresponding processing on the RTSP report.
Examples
The multi-screen collaborative audio transmission server of the embodiment of the invention has the system block diagram shown in fig. 1, and comprises a server session module and a sending module, wherein the server session module is connected with the sending module, and the server session module is used for being connected with a client through a network and providing communication between the server and the client, and comprises an RTSP report, an RTP data packet and a transmission flow control management data packet; the sending module is used for encapsulating the corresponding audio data stream into an RTP packet and sending the RTP packet to the client, and receiving and processing a transmission flow control management data packet sent by the client.
In this example, the tcp packet is preferably an RTCP packet, and the RTSP report may further include a play command and/or a pause command and/or a stop command, which correspond to audio operations such as play, pause and stop of the player.
The multi-screen collaborative audio transmission client comprises a client session module, a receiving module, a transmission quality control module and a player, wherein the receiving module is connected with the client session module, the transmission quality control module is connected with the receiving module, the player is connected with the transmission quality control module, the transmission quality control module is connected with the client session module, the client session module is used for being connected with a server through a network to provide communication between the server and the client, and the communication comprises an RTSP report, an RTP data packet and a transmission flow control management data packet; the receiving module is used for receiving and analyzing an RTP packet sent by the server; the transmission quality control module is used for carrying out transmission flow control management according to the RTP packet received by the receiving module and sending a transmission flow control management data packet to the server; the player is used for playing the audio data stream obtained after analysis.
In this example, the tcp packet is preferably an RTCP packet, and the RTSP report may further include a play command and/or a pause command and/or a stop command, which correspond to audio operations such as play, pause and stop of the player.
The multi-screen cooperative audio transmission system of the embodiment of the present invention, with reference to fig. 3, includes the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client, where the server session module is connected to the client session module through a network.
When in use, the concrete processing steps are as follows:
step 1, the multi-screen cooperative audio transmission client sends a session connection establishment request to the multi-screen cooperative audio transmission server through an RTSP (real time streaming protocol), and the multi-screen cooperative audio transmission server establishes session connection.
The method comprises the following specific steps:
101, starting a multi-screen cooperative audio transmission server, and creating a transmission flow control real-time service thread, an RTP real-time service thread and an RTSP real-time service thread;
102, a multi-screen cooperative audio transmission server creates a UDP socket and binds the UDP socket to an address of a provided service, an RTP packet uses an even number □, and a corresponding transmission flow control data packet uses an odd number port;
103, the multi-screen cooperative audio transmission server monitors and receives RTSP reports from the multi-screen cooperative audio transmission client at a moment, if the RTSP reports sent by the multi-screen cooperative audio transmission client are session connection requests, the step 104 is executed, and if the RTSP reports sent by the multi-screen cooperative audio transmission client are session connection requests, the step 6 is executed;
and step 104, the multi-screen cooperative audio transmission server responds to the session connection request, establishes session connection with the multi-screen cooperative audio transmission client, and enters step 2.
And step 2, the multi-screen cooperative audio transmission client sends an audio data transmission request to the multi-screen cooperative audio transmission server through the RTSP.
And 3, the multi-screen cooperative audio transmission server encapsulates the corresponding audio data streams into RTP packets, prints corresponding timestamp information and sequence numbers and sends the timestamp information and the sequence numbers to the multi-screen cooperative audio transmission client.
The method comprises the following specific steps:
step 301, a multi-screen cooperative audio transmission server determines the size of each audio data frame in a corresponding audio data stream, and if the length of one frame exceeds a maximum transmission unit, the frame is subjected to fragment packaging;
step 302, the multi-screen cooperative audio transmission server converts an audio data frame into an RTP packet, and sets a sequence number and timestamp information in the RTP packet header according to each frame of information, so as to perform play synchronization and packet loss processing;
and step 303, the multi-screen cooperative audio transmission server stores the RTP packet in a sending buffer pool and sends the RTP packet to the multi-screen cooperative audio transmission client according to a sending strategy.
And 4, decoding the audio data stream in the multi-screen cooperative audio transmission client according to the timestamp information in the received RTP packet and storing the decoded audio data stream into a data buffer pool.
The method comprises the following specific steps:
step 401, the multi-screen cooperative audio transmission client receives the RTP packet, analyzes the RTP packet, removes the header information of the RTP packet, and stores the audio data frame, the sequence number, and the timestamp information obtained by the analysis into a data buffer pool.
And step 5, extracting audio data streams from the data buffer pool by a transmission quality control module of the multi-screen cooperative audio transmission client, sequencing the audio data streams according to the sequence numbers, transmitting the sequenced audio data streams to a player for playing, feeding playing synchronization information back to the multi-screen cooperative audio transmission server through the transmission flow control management data packet, and adjusting a strategy of sending an RTP packet by the multi-screen cooperative audio transmission server according to the received transmission flow control management data packet to realize audio synchronization.
The method comprises the following specific steps:
step 501, a transmission quality control module of a multi-screen cooperative audio transmission client extracts an audio data stream from a data buffer pool;
step 502, sequencing the extracted audio data streams according to corresponding sequence numbers, analyzing RTP packets lost in UPD transmission, and feeding back control management data packets to a multi-screen cooperative audio transmission server through transmission flow control; here, the analysis may be: because the sequence numbers are continuous, if the sequence number of the audio data stream played before and the sequence number of the audio data stream fetched before are not continuous, it is considered that there is a lost RTP packet, and then step 503 is not entered, but the data packet is fed back to the multi-screen cooperative audio transmission server through the transmission flow control management, otherwise step 503 is entered;
step 503, establishing absolute time axis information by using the extracted timestamp information corresponding to the audio data streams, comparing the current time information with the absolute time information and transmitting the result to a player for playing, and feeding back the comparison difference value to the multi-screen cooperative audio transmission server through a transmission flow control management data packet;
and step 504, the multi-screen cooperative audio transmission server side adjusts a strategy of sending an RTP packet according to the received transmission flow control management data packet so as to realize audio synchronization. If the received transmission flow control management data packet records the lost RTP packet, the retransmission is carried out according to the strategy, otherwise, the transmission strategy of the RTP packet is adjusted according to the comparison difference.
And step 6, during playing, the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client monitor the received RTSP report at all times and perform corresponding processing on the RTSP report.
Here, the corresponding processing includes audio operations of play, pause, and stop, etc. corresponding to the RTSP report.

Claims (3)

1. The processing method of the multi-screen cooperative audio transmission system is applied to the multi-screen cooperative audio transmission system, the multi-screen cooperative audio transmission system comprises a multi-screen cooperative audio transmission server and a multi-screen cooperative audio transmission client, and a server session module is connected with a client session module through a network;
the multi-screen cooperative audio transmission server comprises a server session module and a sending module, wherein the server session module is connected with the sending module, and the server session module is used for being connected with the client through a network and providing communication between the server and the client, wherein the communication comprises an RTSP report, an RTP data packet and a transmission flow control management data packet; the sending module is used for encapsulating the corresponding audio data stream into an RTP packet and sending the RTP packet to the client, and receiving and processing a transmission flow control management data packet sent by the client;
the multi-screen collaborative audio transmission client comprises a client session module, a receiving module, a transmission quality control module and a player, wherein the receiving module is connected with the client session module, the transmission quality control module is connected with the receiving module, the player is connected with the transmission quality control module, the transmission quality control module is connected with the client session module, the client session module is used for being connected with a server through a network and providing communication between the server and the client, and the communication comprises an RTSP report, an RTP data packet and a transmission flow control management data packet; the receiving module is used for receiving and analyzing an RTP packet sent by the server; the transmission quality control module is used for carrying out transmission flow control management according to the RTP packet received by the receiving module and sending a transmission flow control management data packet to the server; the player is used for playing the audio data stream obtained after analysis;
the method is characterized by comprising the following steps:
step 1, a multi-screen cooperative audio transmission client sends a request for establishing session connection to a multi-screen cooperative audio transmission server through an RTSP (real time streaming protocol), and the multi-screen cooperative audio transmission server establishes session connection;
step 2, the multi-screen cooperative audio transmission client sends an audio data transmission request to the multi-screen cooperative audio transmission server through an RTSP (real time streaming protocol);
step 3, the multi-screen cooperative audio transmission server encapsulates the corresponding audio data streams into RTP packets, prints corresponding timestamp information and sequence numbers and sends the timestamp information and the sequence numbers to the multi-screen cooperative audio transmission client;
step 4, the multi-screen cooperative audio transmission client decodes the audio data stream in the received RTP packet according to the timestamp information in the RTP packet and stores the decoded audio data stream into a data buffer pool;
step 5, a transmission quality control module of the multi-screen cooperative audio transmission client extracts audio data streams from the data buffer pool, sorts the audio data streams according to sequence numbers and transmits the audio data streams to a player for playing, playing synchronization information is fed back to the multi-screen cooperative audio transmission server through a transmission flow control management data packet, and the multi-screen cooperative audio transmission server adjusts a strategy of sending an RTP packet according to the received transmission flow control management data packet so as to realize audio synchronization;
and step 6, during playing, the multi-screen cooperative audio transmission server and the multi-screen cooperative audio transmission client monitor the received RTSP report at all times and perform corresponding processing on the RTSP report.
2. A processing method for a multi-screen cooperative audio transmission system according to claim 1, wherein the step 1 comprises the following specific steps:
101, starting a multi-screen cooperative audio transmission server, and creating a transmission flow control real-time service thread, an RTP real-time service thread and an RTSP real-time service thread;
102, the multi-screen cooperative audio transmission server side creates a UDP socket and binds the UDP socket to the address of the provided service, and an RTP packet uses an even number
Figure FDA0002327903130000021
The corresponding transmission flow control data packet uses the odd port;
103, the multi-screen cooperative audio transmission server monitors and receives RTSP reports from the multi-screen cooperative audio transmission client at a moment, if the RTSP reports sent by the multi-screen cooperative audio transmission client are session connection requests, the step 104 is executed, and if the RTSP reports sent by the multi-screen cooperative audio transmission client are session connection requests, the step 6 is executed;
and step 104, the multi-screen cooperative audio transmission server responds to the session connection request, establishes session connection with the multi-screen cooperative audio transmission client, and enters step 2.
3. A processing method for a multi-screen cooperative audio transmission system according to claim 1, wherein the step 3 comprises the steps of:
step 301, a multi-screen cooperative audio transmission server determines the size of each audio data frame in a corresponding audio data stream, and if the length of one frame exceeds a maximum transmission unit, the frame is subjected to fragment packaging;
step 302, the multi-screen cooperative audio transmission server converts an audio data frame into an RTP packet, and sets a sequence number and timestamp information in the RTP packet header according to each frame of information, so as to perform play synchronization and packet loss processing;
step 303, the multi-screen cooperative audio transmission server stores the RTP packet in a sending buffer pool and sends the RTP packet to the multi-screen cooperative audio transmission client according to a sending strategy;
step 4 comprises the following steps:
step 401, the multi-screen collaborative audio transmission client receives an RTP packet, analyzes the RTP packet, removes RTP packet header information, and stores an audio data frame, a sequence number and timestamp information obtained by analysis into a data buffer pool;
step 5 comprises the following steps:
step 501, a transmission quality control module of a multi-screen cooperative audio transmission client extracts an audio data stream from a data buffer pool;
step 502, sequencing the extracted audio data streams according to corresponding sequence numbers, analyzing RTP packets lost in UPD transmission, and feeding back control management data packets to a multi-screen cooperative audio transmission server through transmission flow control;
step 503, establishing absolute time axis information by using the extracted timestamp information corresponding to the audio data streams, comparing the current time information with the absolute time information and transmitting the result to a player for playing, and feeding back the comparison difference value to the multi-screen cooperative audio transmission server through a transmission flow control management data packet;
and step 504, the multi-screen cooperative audio transmission server side adjusts a strategy of sending an RTP packet according to the received transmission flow control management data packet so as to realize audio synchronization.
CN201611159671.8A 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof Active CN106790030B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611159671.8A CN106790030B (en) 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611159671.8A CN106790030B (en) 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof

Publications (2)

Publication Number Publication Date
CN106790030A CN106790030A (en) 2017-05-31
CN106790030B true CN106790030B (en) 2020-05-19

Family

ID=58887479

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611159671.8A Active CN106790030B (en) 2016-12-15 2016-12-15 Multi-screen cooperative audio transmission server, client, system and processing method thereof

Country Status (1)

Country Link
CN (1) CN106790030B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112449224B (en) * 2019-09-05 2023-02-17 深圳Tcl新技术有限公司 Method, system and storage medium for controlling smart television by voice
CN110943977B (en) * 2019-11-11 2022-10-14 普联技术有限公司 Multimedia service data transmission method, server, equipment and storage medium
CN116471351B (en) * 2022-01-10 2024-04-09 荣耀终端有限公司 Method and device for transmitting call audio data

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7356687B2 (en) * 2002-05-21 2008-04-08 General Instrument Corporation Association of security parameters for a collection of related streaming protocols
CN102340506A (en) * 2011-09-29 2012-02-01 广东高新兴通信股份有限公司 Multimedia data transmission system and application method thereof
CN102917212A (en) * 2012-10-29 2013-02-06 合肥移瑞通信技术有限公司 3G (The 3rd Generation Telecommunication) wireless video monitoring implementation method and 3G wireless video monitoring system based on RTP (Real Time Protocol) and RTSP (Real Time Streaming Protocol)
CN103248956B (en) * 2013-05-20 2016-12-28 浙江传媒学院 A kind of realization method and system of the wired home video traffic of multi-screen collaboration mode

Also Published As

Publication number Publication date
CN106790030A (en) 2017-05-31

Similar Documents

Publication Publication Date Title
EP2364017B1 (en) Method, system and user device for obtaining key frame in streaming media service
JP2008530835A (en) On-demand multi-channel streaming sessions over packet-switched networks
CN106911699B (en) Method for realizing I frame retransmission based on RTP protocol
CN105072506B (en) The transmission method and system of live teaching broadcast video
US10477282B2 (en) Method and system for monitoring video with single path of video and multiple paths of audio
JP2014535196A (en) Apparatus and method for transmitting multimedia data in a hybrid network
CN106790030B (en) Multi-screen cooperative audio transmission server, client, system and processing method thereof
CN105471869A (en) Internet television content request connection reuse method and system thereof
CN105791884A (en) Streaming media live broadcast method and streaming media live broadcast system
CN102065269A (en) Method for carrying out video session, video session system and set top boxes (STBs)
WO2013155766A1 (en) Transmitting and receiving method of multimedia video data and corresponding device
CN108683683A (en) The method and apparatus of transmission characteristic information for transferring multimedia data
WO2014033729A3 (en) A system, method, and platform, for embedding video feeds captured during a surgery, with multimedia data, in real-time
CN110113662A (en) A kind of video monitor client system adapting to multiple network situation
CN102404646A (en) Wireless television live broadcasting system and live broadcasting method thereof
CN112866199A (en) Method for viewing device supporting GB/T28181 protocol in main stream browser
EP2207354B1 (en) Method and device for ensuring reliability during transmission of television data in a television system based on internet protocol
WO2023071290A1 (en) Multicast retransmission method and apparatus, and server and storage medium
US20090268730A1 (en) Data transmitting apparatus and method and program for controlling transmission rate
US9674515B2 (en) Endpoint information for network VQM
CN101188601B (en) A method for quickly sending and receiving multimedia data
CN101094159B (en) Method for penetrating through private network of media stream
US8412840B2 (en) Live media serving system and method
CN201123043Y (en) Household wireless multimedia game system
CN210129959U (en) Wireless local area network audio stream transmission system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant