CN114268806A - Signal processing method of high-smoothness live broadcast control system - Google Patents

Signal processing method of high-smoothness live broadcast control system Download PDF

Info

Publication number
CN114268806A
CN114268806A CN202111594353.5A CN202111594353A CN114268806A CN 114268806 A CN114268806 A CN 114268806A CN 202111594353 A CN202111594353 A CN 202111594353A CN 114268806 A CN114268806 A CN 114268806A
Authority
CN
China
Prior art keywords
live broadcast
equipment
network connection
network
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111594353.5A
Other languages
Chinese (zh)
Inventor
施云青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Naga Software Co ltd
Original Assignee
Nanjing Naga Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Naga Software Co ltd filed Critical Nanjing Naga Software Co ltd
Priority to CN202111594353.5A priority Critical patent/CN114268806A/en
Publication of CN114268806A publication Critical patent/CN114268806A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to the technical field of video live broadcast, in particular to a signal processing method of a high-smoothness live broadcast control system; establishing network connection between the live broadcast equipment and a server through an aggregation network, and establishing network connection between the additional equipment and the live broadcast equipment; network connection is established for live broadcast equipment, a server and additional equipment through an aggregation network, and multiple networks are overlapped for use, so that the equipment can be smoothly connected and switched among different signals, the throughput and the transmission reliability of data are expanded, and the live broadcast delay is further reduced; after the network connection is completed, live broadcast equipment and additional equipment generate live broadcast data, a plurality of machine positions are formed through the live broadcast equipment and the additional equipment, the live broadcast data generated by the tail of the machine are edited locally, the live broadcast data are transmitted to a server after the live broadcast data are edited, the pressure of the server is reduced, and the live broadcast ornamental value is improved.

Description

Signal processing method of high-smoothness live broadcast control system
Technical Field
The invention relates to the technical field of video live broadcast, in particular to a signal processing method of a high-smoothness live broadcast control system.
Background
With the continuous progress of mobile communication networks and mobile terminal technologies, mobile video live broadcast starts to enter various aspects of social life, and mobile education of the video live broadcast technology draws attention of people. For example, teachers and students use mobile terminals, and an environment capable of live broadcasting teaching and live course watching is achieved through a mobile video live broadcasting system at any time and any place. The mobile technology is combined with education, and the method plays an important role in lifelong education. The current multi-channel video live broadcast system changes the traditional live broadcast into a novel media interaction mode, the identities of the anchor broadcast and the user are also changed into the identity of an initiator and the identity of a participant, and compared with the traditional one-way live broadcast, the live broadcast system has an obvious effect on the liveness and the stickiness of live broadcast watching.
The existing live broadcast is often connected with a server by adopting a single network, and the influence on the live broadcast fluency is large after the network fluctuates.
Disclosure of Invention
The invention aims to provide a signal processing method of a high-smoothness live broadcast control system, and aims to solve the technical problem that in the prior art, live broadcast often adopts a single network to be connected with a server, and the influence on live broadcast smoothness is large after the network fluctuates.
In order to achieve the above object, the present invention provides a signal processing method of a high-smoothness live broadcast control system, comprising the following steps:
establishing network connection between the live broadcast equipment and a server through a converged network;
establishing network connection between the additional equipment and the live broadcast equipment;
after the network connection is completed, the live broadcast equipment and the additional equipment generate live broadcast data;
synchronizing and editing audio and video by using the live broadcast equipment;
and the edited live broadcast data is transmitted to a server through the aggregation network, and is transcoded in real time and then transmitted to a playing end.
Wherein, in the step of establishing network connection between the live broadcast equipment and the server through the aggregation network:
the connection port of the aggregation network comprises an AP hotspot shared by a 4G full-network SIM card, a field WIFI, a wired network, a mobile network, a USB and a 5G mobile phone.
The step of establishing network connection between the live broadcast equipment and the server through the aggregation network comprises the following steps:
CPE sends a link establishment request of MPTCP to gNB, generates and transmits Key value in the TCP option of the message after the message interaction is completed, and judges and identifies the adding authority of sub-stream according to the TOKEN generated by the Key;
the CPE is connected with the gNB, multi-path data sub-flows are established, and the multi-path data sub-flows are established according to SYN, SYN + ACK message information marked by MP _ JOIN fields in TCP options and sub-flow IP information added into the links;
establishing TCP connection with a server according to different IP addresses, acquiring the IP address of an application server with access by the gNB, and establishing TCP links of a plurality of sub-streams between the CPE and the application server and performing TCP data transmission according to the IP address of the application server and the IP address information of the established multi-path data sub-streams;
the live broadcast equipment establishes connection with the CPE, and correspondingly accesses the data sub-stream of the MPTCP through the change of the IP address when the live broadcast equipment is switched from one network connection to another network connection, so as to realize uninterrupted signal switching.
Wherein, in the step of establishing network connection between the additional device and the live broadcast device:
the additional equipment comprises a recording device, a camera, a smart phone and an encoder.
Wherein, in the step of establishing network connection between the additional device and the live broadcast device:
and connecting the additional equipment with the live equipment through an NDDIP protocol, wherein the additional equipment and the live equipment form a plurality of machine positions.
After the network connection is completed, the live broadcast equipment and the additional equipment generate live broadcast data, wherein in the step of:
and a plurality of machine positions work simultaneously to generate multi-channel live broadcast data, and the multi-channel live broadcast data are transmitted to the live broadcast equipment.
Wherein, in the step of synchronizing and editing audio and video using the live device:
and synchronizing the audio and video in the multi-channel live broadcast data according to a time axis.
According to the signal processing method of the high-smoothness live broadcast control system, network connection is established for the live broadcast equipment, the server and the additional equipment through the aggregation network, multiple networks are overlapped for use, so that the equipment can be smoothly connected and switched among different signals, the throughput and the transmission reliability of data are expanded, and the live broadcast delay is further reduced; through live equipment with additional equipment forms a plurality of stands, locally edits the live broadcast data that the tail produced, transmits to the server after the edition is accomplished, has reduced server pressure, has improved the sight of live broadcast.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating steps of a signal processing method of a high-smoothness live broadcast control system according to the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
Referring to fig. 1, the present invention provides a signal processing method of a high-smoothness live broadcast control system, including the following steps:
s1: establishing network connection between the live broadcast equipment and a server through a converged network;
s2: establishing network connection between the additional equipment and the live broadcast equipment;
s3: after the network connection is completed, the live broadcast equipment and the additional equipment generate live broadcast data;
s4: synchronizing and editing audio and video by using the live broadcast equipment;
s5: and the edited live broadcast data is transmitted to a server through the aggregation network, and is transcoded in real time and then transmitted to a playing end.
In step S1, the connection port of the aggregation network includes an AP hotspot shared by a 4G full-network SIM card, a field WIFI, a wired network, a mobile network, a USB, and a 5G mobile phone; CPE sends a link establishment request of MPTCP to gNB, generates and transmits Key value in the TCP option of the message after the message interaction is completed, and judges and identifies the adding authority of sub-stream according to the TOKEN generated by the Key; the CPE is connected with the gNB, multi-path data sub-flows are established, and the multi-path data sub-flows are established according to SYN, SYN + ACK message information marked by MP _ JOIN fields in TCP options and sub-flow IP information added into the links; establishing TCP connection with a server according to different IP addresses, acquiring the IP address of an application server with access by the gNB, and establishing TCP links of a plurality of sub-streams between the CPE and the application server and performing TCP data transmission according to the IP address of the application server and the IP address information of the established multi-path data sub-streams; the method comprises the steps that connection between live broadcast equipment and CPE is established, when the live broadcast equipment is switched from one network connection to another network connection, data sub-streams of MPTCP are correspondingly accessed through change of IP addresses, and the data sub-streams are used for achieving uninterrupted signal switching; and when the live broadcast equipment is disconnected from the WiFi connection and switched to the 5G network connection, the CPE carries out switching of the sub-streams according to the IP addresses of different signals.
In step S2, the additional device includes a recording device, a camera, a smart phone, and an encoder, and is connected to the live device through an NDDIP protocol, the additional device and the live device form a plurality of bays, and network connections are established for the live device, the server, and the additional device through the aggregation network, and multiple networks are used in an overlapping manner, so that devices can be smoothly connected and switched among different signals, and meanwhile, throughput and transmission reliability of data are increased, and live delay is further reduced.
In step S3, the stations operate simultaneously to generate multi-channel live data, and the multi-channel live data is transmitted to the live device, where the live data includes audio and video, and the audio is preprocessed by a sound card built in the live device to eliminate noise and adjust tone.
In step S4, audio and video in the multichannel live broadcast data are synchronized according to a time axis, when editing is carried out, the live broadcast picture is layered and partitioned, video data generated by each machine position are placed at the bottommost layer and partitioned by the bottom layer, the video data generated by each machine position correspond to one region, the upper layer of the live broadcast picture can cover the bottom layer, a template material is arranged in the live broadcast equipment and supports the introduction of an external material, the external material comprises a BMP/JPG/GIF/PNG/TGA format and is used for column packaging, the live broadcast is more design-oriented, when the live broadcast content is a match, a score is added at the top layer of the video picture, the sports live broadcast is more professional, the operation is more convenient, and the watching is more visual.
In step S5, the live broadcast data after the editing is completed is transmitted to the server through the aggregation network, is transcoded in real time and then is transmitted to the playing terminal, and a plurality of machine positions are formed by the live broadcast device and the additional device, so that the live broadcast data generated by the tail of the machine is edited locally, and is transmitted to the server after the editing is completed, thereby reducing the pressure of the server and improving the ornamental value of the live broadcast.
While the invention has been described with reference to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (7)

1. A signal processing method of a high-flow live broadcast control system is characterized by comprising the following steps:
establishing network connection between the live broadcast equipment and a server through a converged network;
establishing network connection between the additional equipment and the live broadcast equipment;
after the network connection is completed, the live broadcast equipment and the additional equipment generate live broadcast data;
synchronizing and editing audio and video by using the live broadcast equipment;
and the edited live broadcast data is transmitted to a server through the aggregation network, and is transcoded in real time and then transmitted to a playing end.
2. The signal processing method of a high-fluency live broadcast control system as claimed in claim 1, wherein in the step of establishing the network connection between the live broadcast device and the server through the aggregation network:
the connection port of the aggregation network comprises an AP hotspot shared by a 4G full-network SIM card, a field WIFI, a wired network, a mobile network, a USB and a 5G mobile phone.
3. The signal processing method of a high-fluency live broadcast control system as claimed in claim 2, wherein the step of establishing the network connection between the live broadcast device and the server through the aggregation network comprises:
CPE sends a link establishment request of MPTCP to gNB, generates and transmits Key value in the TCP option of the message after the message interaction is completed, and judges and identifies the adding authority of sub-stream according to the TOKEN generated by the Key;
the CPE is connected with the gNB, multi-path data sub-flows are established, and the multi-path data sub-flows are established according to SYN, SYN + ACK message information marked by MP _ JOIN fields in TCP options and sub-flow IP information added into the links;
establishing TCP connection with a server according to different IP addresses, acquiring the IP address of an application server with access by the gNB, and establishing TCP links of a plurality of sub-streams between the CPE and the application server and performing TCP data transmission according to the IP address of the application server and the IP address information of the established multi-path data sub-streams;
the live broadcast equipment establishes connection with the CPE, and correspondingly accesses the data sub-stream of the MPTCP through the change of the IP address when the live broadcast equipment is switched from one network connection to another network connection, so as to realize uninterrupted signal switching.
4. A signal processing method of a high-fluency live broadcast control system as recited in claim 3, wherein in the step of establishing a network connection between the additional device and the live broadcast device:
the additional equipment comprises a recording device, a camera, a smart phone and an encoder.
5. The signal processing method of a high-flow live broadcast control system according to claim 4, wherein in the step of establishing a network connection between the additional device and the live broadcast device:
and connecting the additional equipment with the live equipment through an NDDIP protocol, wherein the additional equipment and the live equipment form a plurality of machine positions.
6. The signal processing method of a high-fluency live broadcast control system as claimed in claim 5, wherein after the network connection is completed, the live broadcast device and the additional device generate live broadcast data in the steps of:
and a plurality of machine positions work simultaneously to generate multi-channel live broadcast data, and the multi-channel live broadcast data are transmitted to the live broadcast equipment.
7. The signal processing method of a high-flow live broadcast control system according to claim 5, wherein in the step of synchronizing and editing audio and video with the live broadcast device:
and synchronizing the audio and video in the multi-channel live broadcast data according to a time axis.
CN202111594353.5A 2021-12-24 2021-12-24 Signal processing method of high-smoothness live broadcast control system Pending CN114268806A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111594353.5A CN114268806A (en) 2021-12-24 2021-12-24 Signal processing method of high-smoothness live broadcast control system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111594353.5A CN114268806A (en) 2021-12-24 2021-12-24 Signal processing method of high-smoothness live broadcast control system

Publications (1)

Publication Number Publication Date
CN114268806A true CN114268806A (en) 2022-04-01

Family

ID=80829467

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111594353.5A Pending CN114268806A (en) 2021-12-24 2021-12-24 Signal processing method of high-smoothness live broadcast control system

Country Status (1)

Country Link
CN (1) CN114268806A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104853258A (en) * 2014-02-14 2015-08-19 上海精视信息技术有限责任公司 Video-audio data transmission system
CN105392020A (en) * 2015-11-19 2016-03-09 广州华多网络科技有限公司 Internet video direct broadcasting method and system
CN105657440A (en) * 2016-01-05 2016-06-08 福建星网智慧科技股份有限公司 Video broadcast method and system
CN106790532A (en) * 2016-12-21 2017-05-31 清华大学深圳研究生院 A kind of online live method for uploading and system based on edge network polymerization
CN108260016A (en) * 2018-03-13 2018-07-06 北京小米移动软件有限公司 Processing method, device, equipment, system and storage medium is broadcast live
CN112994946A (en) * 2021-03-11 2021-06-18 浪潮软件科技有限公司 Link aggregation method
CN113783963A (en) * 2021-09-16 2021-12-10 阿里巴巴达摩院(杭州)科技有限公司 Data transmission method, server node, gateway device and network system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104853258A (en) * 2014-02-14 2015-08-19 上海精视信息技术有限责任公司 Video-audio data transmission system
CN105392020A (en) * 2015-11-19 2016-03-09 广州华多网络科技有限公司 Internet video direct broadcasting method and system
CN105657440A (en) * 2016-01-05 2016-06-08 福建星网智慧科技股份有限公司 Video broadcast method and system
CN106790532A (en) * 2016-12-21 2017-05-31 清华大学深圳研究生院 A kind of online live method for uploading and system based on edge network polymerization
CN108260016A (en) * 2018-03-13 2018-07-06 北京小米移动软件有限公司 Processing method, device, equipment, system and storage medium is broadcast live
CN112994946A (en) * 2021-03-11 2021-06-18 浪潮软件科技有限公司 Link aggregation method
CN113783963A (en) * 2021-09-16 2021-12-10 阿里巴巴达摩院(杭州)科技有限公司 Data transmission method, server node, gateway device and network system

Similar Documents

Publication Publication Date Title
US10743038B2 (en) Live broadcast processing method, apparatus, device, and storage medium
CN108600815A (en) A kind of online method and system chorused in real time
US10368258B2 (en) Interactions among mobile devices in a wireless network
CN105763832A (en) Video interaction and control method and device
CN112752109B (en) Video playing control method and system
CN101516057B (en) Method for realizing streaming media through mobile terminal
CN110943977B (en) Multimedia service data transmission method, server, equipment and storage medium
CN100405748C (en) Contents providing system and mobile communication terminal therefor
KR101730115B1 (en) Apparatus and method for processing image
CN103338346A (en) Method and system for realizing multimedia digital conference
EP3316593B1 (en) Method and device for implementing synchronous playing
CN103731339B (en) Online multimedia resource share method in digital living network alliance system and system
US10244207B2 (en) Videoconference communication device
CN108391161A (en) A kind of cross-platform wireless throwing screen method
CN114268806A (en) Signal processing method of high-smoothness live broadcast control system
CN101527153A (en) Method of synchronously displaying asynchronous transmitted text and audio and video data on mobile terminal
JPH09222848A (en) Remote lecture system and network system
CN111385590A (en) Live broadcast data processing method and device and terminal
CN108495076A (en) A kind of method and system of live video stream embedded in real-time session
CN107135407A (en) Synchronous method and system in a kind of piano video teaching
KR101906396B1 (en) Method, device and non-trnasitory computer-readable recording media for supporting relay broadcasting
CN105141914B (en) Video broadcasting method and system
KR100783668B1 (en) Media streaming service apparatus and method for multimedia on demand in mobile telecommunication system
CN110661760A (en) Data processing method and device
TWI811148B (en) Method for achieving latency-reduced one-to-many communication based on surrounding video and associated computer program product set

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination