CN114173144A - Live broadcast equipment, control method thereof and live broadcast backpack - Google Patents
Live broadcast equipment, control method thereof and live broadcast backpack Download PDFInfo
- Publication number
- CN114173144A CN114173144A CN202111467050.7A CN202111467050A CN114173144A CN 114173144 A CN114173144 A CN 114173144A CN 202111467050 A CN202111467050 A CN 202111467050A CN 114173144 A CN114173144 A CN 114173144A
- Authority
- CN
- China
- Prior art keywords
- module
- code stream
- unit
- network
- network channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000005540 biological transmission Effects 0.000 claims abstract description 141
- 230000002776 aggregation Effects 0.000 claims abstract description 65
- 238000004220 aggregation Methods 0.000 claims abstract description 65
- 238000006243 chemical reaction Methods 0.000 claims abstract description 23
- 238000012544 monitoring process Methods 0.000 claims abstract description 16
- 238000004806 packaging method and process Methods 0.000 claims abstract description 7
- 238000006116 polymerization reaction Methods 0.000 claims description 5
- 239000000047 product Substances 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 3
- 239000013589 supplement Substances 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 3
- 238000004891 communication Methods 0.000 abstract description 2
- 230000008054 signal transmission Effects 0.000 description 7
- 230000008901 benefit Effects 0.000 description 5
- 239000002699 waste material Substances 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000010354 integration Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application relates to a live broadcast device, a control method thereof and a live broadcast backpack, belonging to the technical field of communication, wherein the live broadcast device comprises a main control board, a coding module and an aggregation transmission module; the main control board is used for connecting with an external camera device, receiving a video signal acquired by the camera device and performing format conversion; the coding module is used for carrying out video coding on the video signal after format conversion and transmitting a coded code stream to the main control board; the aggregation transmission module is used for receiving the coded code stream and sequentially packaging the coded code stream into a plurality of data packets; the aggregation transmission module is further used for providing a plurality of network channels; the main control board is used for monitoring the network state of each network channel in real time; the aggregation transmission module is also used for sequentially transmitting data packets to the transmission cache region corresponding to the network channel in the online state; the network channel is used for transmitting the data packet to the streaming media cloud platform while receiving the data packet in the sending buffer area. The method and the device have the effect of improving the user experience.
Description
Technical Field
The application relates to the technical field of communication, in particular to live broadcast equipment, a control method thereof and a live broadcast backpack.
Background
Live broadcast is a form of internet broadcast content with remarkable real-time and interactivity, is different from the traditional broadcast forms of characters, pictures, videos and the like, and closely interacts users with the live broadcast content.
At present, with the popularization of live video service, the demand of video rebroadcasting is also more and more extensive, and common video rebroadcasting system is mostly based on large-scale rebroadcasting car or on-vehicle rebroadcasting hardware equipment, and all camera positions all need connect through optic fibre and cable, and the wiring is loaded down with trivial details and the cost is higher, and removal convenience is restricted greatly. Therefore, for some application scenes with higher mobility requirements, integrated live broadcast equipment can be completely adopted, coding and transmission are integrated, and meanwhile, remote editing and broadcasting are realized by utilizing cloud editing, so that the cost input of a live broadcast system is reduced.
To the above-mentioned correlation technique, the inventor finds that most of common live broadcast devices adopt a single network transmission mode, which is inconvenient for meeting the transmission requirements in different scenes, and leads the live broadcast devices to be likely to have live broadcast card pause after changing scenes, thereby reducing the user experience.
Disclosure of Invention
In order to improve user experience, the live broadcast equipment, the control method thereof and the live broadcast backpack are provided, the number of data packets transmitted by each network channel is dynamically adjusted and distributed by monitoring the network state of each network channel, and the signal transmission bandwidth and the transmission stability are greatly improved.
In a first aspect, the present application provides a live broadcast device, which adopts the following technical scheme:
a live broadcast device comprises a main control board, a coding module and an aggregation transmission module;
the main control board is used for being connected with an external camera device, receiving a video signal acquired by the camera device and performing format conversion; the coding module is connected with the main control board and is used for carrying out video coding on the video signals after format conversion and transmitting coded code streams to the main control board;
the aggregation transmission module is connected to the main control board and used for receiving the coded code stream and sequentially packaging the coded code stream into a plurality of data packets; the aggregation transmission module is further configured to provide a plurality of network channels;
the main control board is used for monitoring the network state of each network channel in real time; wherein the network status comprises an online status and an offline status;
the aggregation transmission module is further used for sequentially transmitting data packets to the transmission cache regions corresponding to the network channels in the online state; the network channel is used for transmitting the data packet to the streaming media cloud platform while receiving the data packet in the sending buffer area.
By adopting the technical scheme, the main control board monitors the network state of each network channel in real time, the aggregation transmission module sequentially transmits the data packets to the sending cache region corresponding to the network channel in the online state, and then transmits the data packets in the sending cache region to the streaming media cloud platform through each network channel in the online state, so that the aggregation transmission of each network channel in the online state is realized; the number of data packets transmitted by each network channel is dynamically adjusted and distributed according to the network state of each network channel, so that the transmission requirements under different scenes are met, the signal transmission bandwidth and the transmission stability are greatly improved, the condition of live broadcast blockage is reduced, and the user experience is improved.
Optionally, the aggregation transmission module includes a transmission unit, a code stream receiving unit, a code stream processing unit, and a code stream data packet sending unit;
the transmission unit is used for providing a plurality of network channels;
the code stream receiving unit is used for receiving the coded code stream;
the code stream processing unit is connected with the code stream receiving unit and is used for sequentially packaging the coded code stream into a plurality of data packets;
and the code stream data packet sending unit is respectively connected with the code stream processing unit and the transmission unit and is used for sequentially sending the data packets to a sending cache region corresponding to the network channel in an online state.
By adopting the technical scheme, the code stream receiving unit receives the coded code stream, the code stream processing unit is used for sequentially packaging the coded code stream into a plurality of data packets, and the code stream data packet sending unit is used for sequentially sending the packaged data packets to the sending cache region corresponding to the network channel in the online state, so that the aggregation transmission of the plurality of network channels is realized.
Optionally, the transmission unit includes two at least in 4G module, 5G module, WIFI module, ethernet RJ45 module, the USB module.
By adopting the technical scheme, the network modules are arranged, and each network module corresponds to the corresponding network channel, so that various choices of network channels are provided, and the adaptability is improved.
Optionally, the main control board includes a CPU control unit, an input processing unit, a coding interface unit, and a transmission interface unit;
the input processing unit is used for receiving the video signal collected by the camera device and performing format conversion;
the coding interface unit is respectively connected with the input processing unit and the coding module and is used for transmitting the video signal after format conversion to the coding module and receiving a coding code stream coded by the coding module;
the transmission interface unit is connected with the coding interface unit and the aggregation transmission module and is used for transmitting the coded code stream to the aggregation transmission module;
the CPU control unit is respectively connected with the input processing unit, the coding interface unit, the transmission interface unit and the aggregation transmission module and is used for controlling the main control board and the aggregation transmission module; the CPU control unit is also used for monitoring the network state of each network channel in real time and controlling the aggregation transmission module to transmit data packets to the transmission cache region corresponding to the network channel in the online state.
By adopting the technical scheme, under the control of the CPU control unit, the input processing unit receives the video signal acquired by the camera device and carries out format conversion, the coding interface unit transmits the video signal after format conversion to the coding module for coding, receives the coded code stream coded by the coding module and transmits the coded code stream to the aggregation transmission module by using the transmission interface unit, the CPU control unit monitors the network state of each network channel in real time and controls the aggregation transmission module to transmit a data packet to a transmission cache region corresponding to the network channel in an online state, so that the data packet transmitted by each network channel is dynamically adjusted and distributed according to the network state of each network channel.
Optionally, the live broadcasting device further includes a display operation module, where the display operation module includes a display unit and a touch screen operation unit, the display unit is connected to the main control board and is configured to receive and display the format-converted video signal, and the touch screen operation unit is configured to respond to the touch screen signal to perform operation configuration on the live broadcasting device.
By adopting the technical scheme, the display interface unit is used for outputting the format-converted 4K ultrahigh-definition video signal, the display unit is used for displaying the format-converted 4K ultrahigh-definition video signal, and the touch screen operation unit is used for a user to perform touch screen operation, so that different operation configuration requirements of the user can be met conveniently.
In a second aspect, the present application provides a method for controlling a live device, which adopts the following technical scheme:
a control method of a live device, applied to a live device described in the first aspect, the control method comprising,
acquiring a video signal acquired by a camera device and carrying out format conversion on the video signal;
sending the video signal after format conversion to a coding module, and controlling the coding module to code the video signal after format conversion;
sending the coded code stream to a polymerization transmission module, and controlling the polymerization transmission module to sequentially package the coded code stream into a plurality of data packets;
monitoring the network state of each network channel in real time, and if the network state of each network channel is online, controlling an aggregation transmission module to transmit a data packet to a transmission cache region corresponding to the network channel, wherein the network channel is used for transmitting the data packet to a streaming media cloud platform while receiving the data packet in the transmission cache region; and if the network state of the network channel is offline, controlling the aggregation transmission module to stop transmitting the data packet to the transmission cache region corresponding to the network channel.
By adopting the technical scheme, the collected video signals are coded into the coded code streams, the coded code streams are sequentially packaged into a plurality of data packets, the network state of each network channel is monitored in real time, the data packets are sequentially sent to the sending cache region corresponding to the network channel in the online state, and then the data packets in the sending cache region are transmitted to the streaming media cloud platform through the network channel in the online state, so that the aggregate transmission of the network channels in the online state is realized; the number of data packets transmitted by each network channel is dynamically adjusted and distributed according to the network state of each network channel, so that the transmission requirements under different scenes are met, the signal transmission bandwidth and the transmission stability are greatly improved, the condition of live broadcast blockage is reduced, and the user experience is improved.
Optionally, the step of controlling the aggregation transmission module to send the data packet to the sending buffer corresponding to the network channel further includes,
monitoring the space size of the sending buffer area in an idle state in real time, judging whether the space size in the idle state is larger than or equal to a preset size, and if so, controlling an aggregation transmission module to supplement and send a data packet into the sending buffer area; and if the space size in the idle state is smaller than the preset size, controlling the aggregation transmission module to stop sending the data packet to the sending cache region.
By adopting the technical scheme, the space size of the sending buffer area in the idle state is monitored in real time, and the data packets are distributed according to the space size of the idle state, so that the resource waste is reduced, and the transmission rate is improved.
Optionally, the control method further comprises,
acquiring the coding code rate of the coding code stream, monitoring the Round Trip Time (RTT) value of data sent by the network channel in real time, and calculating the product of the RTT value and the coding code rate to obtain the data volume;
and adjusting the space size of the sending buffer area in real time according to the data volume.
By adopting the technical scheme, the space size of the sending buffer is optimized and adjusted in real time according to the round trip delay RTT value and the coding code rate of the network channel, so that the resource waste caused by overlarge configuration space of the sending buffer or the reduction of the transmission rate caused by undersize configuration space of the sending buffer is reduced.
In a third aspect, the present application provides a computer-readable storage medium, which adopts the following technical solutions:
a computer-readable storage medium storing a computer program that can be loaded by a processor and executes a control method of the second aspect.
In a fourth aspect, the present application provides a live broadcast backpack, which adopts the following technical scheme:
a live broadcast backpack comprising a live broadcast device of the above first aspect.
In summary, the present application includes at least one of the following beneficial technical effects: the main control board monitors the network state of each network channel in real time, the aggregation transmission module sequentially transmits data packets to the sending cache region corresponding to the network channel in the online state, and then transmits the data packets in the sending cache region to the streaming media cloud platform through each network channel in the online state, so that the aggregation transmission of each network channel in the online state is realized; the number of data packets transmitted by each network channel is dynamically adjusted and distributed according to the network state of each network channel, so that the transmission requirements under different scenes are met, the signal transmission bandwidth and the transmission stability are greatly improved, the condition of live broadcast blockage is reduced, and the user experience is improved.
Drawings
Fig. 1 is a block diagram of a live device according to an embodiment of the present application.
Fig. 2 is a schematic flow chart of a control method according to an embodiment of the present application.
Fig. 3 is a flowchart illustrating a control method according to another embodiment of the present application.
Fig. 4 is a flowchart illustrating a control method according to another embodiment of the present application.
Description of reference numerals: 1. a live broadcast device; 11. a main control board; 111. a CPU control unit; 112. a display interface unit; 113. an input processing unit; 114. an encoding interface unit; 115. a transmission interface unit; 116. a power supply processing unit; 12. an encoding module; 13. a polymerization transmission module; 131. a transmission unit; 132. a code stream receiving unit; 133. a code stream processing unit; 134. a code stream data packet transmitting unit; 14. a display operation module; 141. a display unit; 142. a touch screen operation unit; 15. and a power supply module.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is further described in detail below with reference to fig. 1-4 and the embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
With the rapid popularization of the 4K ultra-high definition encoding and decoding technology, the live broadcast transmission technology also faces the urgent need of updating, in recent years, incoming television stations are greatly impacted by new media platforms, the operation is increasingly carried out, the equipment investment cost is limited, the traditional television relay car is greatly invested, the large investment required by the upgrade of the 4K equipment is forbidden by the traditional television stations, and therefore the difference between the traditional television stations and the new media platforms is further increased.
The embodiment of the application discloses live equipment.
Referring to fig. 1, a live broadcast device 1 includes a main control board 11, an encoding module 12, and an aggregation transmission module 13; the main control board 11 is used for connecting with an external camera device, receiving a video signal acquired by the camera device and performing format conversion; the encoding module 12 is connected to the main control board 11, and is configured to perform video encoding on the format-converted video signal, and transmit an encoded code stream to the main control board 11;
the aggregation transmission module 13 is connected to the main control board 11 and is configured to receive the encoded code stream and sequentially encapsulate the encoded code stream into a plurality of data packets; the aggregation transmission module 13 is further configured to provide a plurality of network channels;
the aggregation transmission module 13 encapsulates the encoded code stream according to TS packets, and every seven TS packets are a data packet;
the main control board 11 is used for monitoring the network state of each network channel in real time; the network state comprises an online state and an offline state;
the aggregation transmission module 13 is further configured to sequentially send data packets to a sending buffer corresponding to the network channel in the online state; the network channel is used for transmitting the data packet to the streaming media cloud platform while receiving the data packet in the sending buffer area;
each network channel is correspondingly provided with a temporary sending buffer area, and the space size of the sending buffer area can be adjusted in real time according to the actual condition of the current channel; and the receiving of TS packets, the recovery of code streams and live broadcast distribution can be realized through the streaming media cloud platform.
In the above embodiment, the main control board 11 monitors the network state of each network channel in real time, the aggregation transmission module 13 sequentially sends data packets to the sending buffer corresponding to the network channel in the online state, and then transmits the data packets in the sending buffer to the streaming media cloud platform through each network channel in the online state, thereby implementing aggregation transmission of each network channel in the online state; the number of data packets transmitted by each network channel is dynamically adjusted and distributed according to the network state of each network channel, so that the transmission requirements under different scenes are met, the signal transmission bandwidth and the transmission stability are greatly improved, the condition of live broadcast blockage is reduced, and the user experience is improved.
As an implementation of the video signal, the video signal may be a 4K ultra high definition video signal, the camera device may employ a 4K camera for acquiring the 4K ultra high definition video signal, and may employ SDI and HDMI interface specifications to connect with the main control board 11; the encoding module 12 performs h.265/h.2644k video encoding on the format-converted 4K ultra high definition video signal, and transmits the encoded h.265/h.2644k video code stream to the main control board 11.
In addition, as another embodiment of the video signal, the video signal may also be a high-definition video signal, and the encoding module 12 performs h.264 high-definition video encoding on the format-converted high-definition video signal and transmits an encoded h.264 high-definition video code stream to the main control board 11.
As an embodiment of the encoding module 12, the encoding module 12 employs a suoxi SC2M30 chip; the Soxhlet SC2M30 chip provides video and audio coding, decoding and transcoding supporting HEVC/H.265, AVC/H.264 and MPEG2 standards, supports 4K/60p HEVC/H.265 or AVC/H.264 real-time coding/decoding, supports 10ms ultra-low delay 4K/60p HEVC/H.265 coding, supports the HEVC/H.265 coding algorithm of HDR (high dynamic range) video, and embeds four DRAMs in a package to achieve high density of a system and has the advantage of low power consumption.
Referring to fig. 1, as an embodiment of the aggregation transmission module 13, the aggregation transmission module 13 includes a transmission unit 131, a code stream receiving unit 132, a code stream processing unit 133, and a code stream packet sending unit 134;
the transmission unit 131 is configured to provide a plurality of network channels;
a code stream receiving unit 132, configured to receive an encoded code stream after encoding;
a code stream processing unit 133, connected to the code stream receiving unit 132, for sequentially packaging the encoded code stream into a plurality of data packets;
and a code stream data packet sending unit 134, respectively connected to the code stream processing unit 133 and the transmission unit 131, for sequentially sending the data packets to the sending buffer corresponding to the network channel in the online state.
In the above embodiment, the code stream receiving unit 132 receives the encoded code stream, the code stream processing unit 133 sequentially encapsulates the encoded code stream into a plurality of data packets, and the code stream data packet sending unit 134 sequentially sends the encapsulated data packets to the sending cache region corresponding to the online network channel, thereby implementing aggregation transmission of the plurality of network channels.
As an embodiment of the transmission unit 131, the transmission unit 131 includes at least two of a 4G module, a 5G module, a WIFI module, an ethernet RJ45 module, and a USB module.
In the above embodiment, a plurality of network modules are provided, and each network module corresponds to a corresponding network channel, so that various choices of network channels are provided, and the adaptability is improved.
As an implementation manner of the 4G module and the 5G module, the 4G module and the 5G module correspond to a 4G card slot and a 5G card slot, respectively, for inserting a 4G SIM card and a 5G SIM card of any operator.
As an implementation mode of the WIFI module, the WIFI module can be a 2.4G/5G dual-mode WIFI module, and simultaneously supports a 2.4G mode with strong penetrability but low signal frequency and a 5G mode with poor penetrability but high signal frequency, so that the WIFI module has strong anti-interference capability and more stable WIFI wireless signals, and is convenient for meeting the requirement of high-speed data transmission.
As an embodiment of the RJ Ethernet 45 module, the RJ Ethernet 45 module is a conventional Ethernet interface capable of automatically detecting and supporting 10M/100M/1000M full duplex mode networking.
As an implementation of the USB module, the USB module may be a USB3.0 interface or a USB 2.0 interface for accessing a USB network card; compared with the USB 2.0 interface, the transmission rate of the USB3.0 interface is faster, and the USB 2.0 device can be downward compatible.
Referring to fig. 1, as an embodiment of the main control board 11, the main control board 11 includes a CPU control unit 111, an input processing unit 113, an encoding interface unit 114, and a transmission interface unit 115;
an input processing unit 113, configured to receive a video signal acquired by the camera and perform format conversion;
the encoding interface unit 114 is respectively connected to the input processing unit 113 and the encoding module 12, and is configured to transmit the format-converted video signal to the encoding module 12 and receive an encoded code stream encoded by the encoding module 12;
the transmission interface unit 115 is connected to the encoding interface unit 114 and the aggregation transmission module 13, and is configured to transmit the encoded code stream to the aggregation transmission module 13;
the CPU control unit 111 is respectively connected to the input processing unit 113, the encoding interface unit 114, the transmission interface unit 115 and the aggregation transmission module 13, and is configured to control the main control board 11 and the aggregation transmission module 13; the CPU control unit 111 is further configured to monitor the network status of each network channel in real time and control the aggregation transmission module 13 to send a data packet to the sending buffer corresponding to the network channel in the online status.
In the above embodiment, under the control of the CPU control unit 111, the input processing unit 113 receives and converts the format of the video signal acquired by the camera device, the coding interface unit 114 transmits the video signal after format conversion to the coding module 12 for coding, receives the coded code stream coded by the coding module 12, and transmits the coded code stream to the aggregation transmission module 13 by using the transmission interface unit 115, and the CPU control unit 111 monitors the network state of each network channel in real time, and controls the aggregation transmission module 13 to send a data packet to a sending buffer corresponding to the network channel in the online state, so as to dynamically adjust the data packet allocated to each network channel for transmission according to the network state of each network channel.
As an implementation manner of the input processing unit 113, the encoding interface unit 114, and the transmission interface unit 115, the input processing unit 113, the encoding interface unit 114, and the transmission interface unit 115 adopt FPGA chips as integrated circuit chips capable of implementing specific functions, the wiring and logic layout of the bottom layer logic operation unit of the FPGA chips are not solidified, and a user can perform functional configuration on the logic unit and the switch array programming through EDA software, and the method has the advantages of convenience and flexibility in programming, high integration level, high processing speed, low power consumption, and the like.
As an implementation manner of the CPU control unit 111, the CPU control unit 111 adopts an iMX8M chip, and the iMX8M chip is constructed by using an advanced 14nm LPC FinFET process technology, so that the CPU control unit has rich interface peripherals, can provide various systems, documents and technical support services, can provide higher processing speed and higher power efficiency, and has the advantages of high performance and high cost performance.
Referring to fig. 1, as a further embodiment of the live device 1, the live device 1 further includes a display operation module 14, where the display operation module 14 includes a display unit 141 and a touch screen operation unit 142, the display unit 141 is connected to the main control board 11 and is configured to receive and display the format-converted video signal, and the touch screen operation unit 142 is configured to perform operation configuration on the live device 1 in response to the touch screen signal.
Referring to fig. 1, as a further embodiment of the main control board 11, the main control board 11 further includes a display interface unit 112, and the display interface unit 112 is respectively connected to the input processing unit 113, the CPU control unit 111, and the display unit 141, and is configured to output the format-converted video signal to the display unit 141 under the control of the CPU control unit 111.
In the above embodiment, the display interface unit 112 is used to output the format-converted video signal, the display unit 141 is used to display the format-converted video signal, and the touch screen operation unit 142 is used for the user to perform the touch screen operation, so as to facilitate the operation configuration of the live broadcast device 1; in addition, the display unit 141 may also display encoding information, encoding and transmission parameter configuration menus of the audio/video code stream, and the user may also perform menu interactive control such as parameter configuration through the touch screen operation unit 142.
Referring to fig. 1, in order to ensure normal operation of the live broadcast device 1, the live broadcast device 1 further includes a power supply module 15, the main control board 11 further includes a power supply processing unit 116, the power supply module 15 is connected to the power supply processing unit 116, and the power supply module 15 supplies power to the live broadcast device 1 through the power supply processing unit 116.
In the foregoing embodiment, the display interface unit 112 is used to output the format-converted video signal, the display unit 141 is used to display the format-converted video signal, and the touch screen operation unit 142 is used for the user to perform the touch screen operation, so as to meet different operation configuration requirements of the user.
The embodiment of the application also discloses a control method of the live broadcast equipment based on the side of the main control board 11.
Referring to fig. 2, a control method of a live device, applied to the above-mentioned live device, includes,
acquiring a video signal acquired by a camera device and performing format conversion on the video signal;
sending the format-converted video signal to the encoding module 12, and controlling the encoding module 12 to encode the format-converted video signal;
sending the encoded code stream to the aggregation transmission module 13, and controlling the aggregation transmission module 13 to sequentially encapsulate the encoded code stream into a plurality of data packets;
monitoring the network state of each network channel in real time, and if the network state of each network channel is online, controlling the aggregation transmission module 13 to transmit a data packet to a transmission cache region corresponding to the network channel, wherein the network channel is used for transmitting the data packet to the streaming media cloud platform while receiving the data packet in the transmission cache region; and if the network state of the network channel is offline, controlling the aggregation transmission module 13 to stop transmitting the data packet to the transmission cache region corresponding to the network channel.
In the above embodiment, the collected video signals are encoded into encoded code streams, and the encoded code streams are sequentially encapsulated into a plurality of data packets, so as to monitor the network state of each network channel in real time, sequentially send the data packets to the sending cache region corresponding to the network channel in the online state, and transmit the data packets in the sending cache region to the streaming media cloud platform through each network channel in the online state, thereby realizing the aggregate transmission of each network channel in the online state; the number of data packets transmitted by each network channel is dynamically adjusted and distributed according to the network state of each network channel, so that the transmission requirements under different scenes are met, the signal transmission bandwidth and the transmission stability are greatly improved, the condition of live broadcast blockage is reduced, and the user experience is improved.
Referring to fig. 3, as a further embodiment of the control method, after the step of controlling the aggregation transmission module 13 to transmit the data packet to the transmission buffer corresponding to the network channel,
monitoring the space size of the sending buffer area in an idle state in real time, judging whether the space size in the idle state is larger than or equal to a preset size, and if so, controlling the aggregation transmission module 13 to supplement and send a data packet into the sending buffer area; and if the size of the space in the idle state is smaller than the preset size, controlling the aggregation transmission module 13 to stop sending the data packet to the sending buffer area.
In this embodiment, the preset size may be preset according to actual situations, for example, the preset size may be set to the size of one data packet, that is, the size of seven TS packets; it can be understood that, the data packet is sent to the sending buffer, and if the size of the space in the idle state is larger than or equal to the size of one data packet, the data packet is supplemented to the sending buffer; and if the space size in the idle state is smaller than the size of one data packet, stopping sending the data packet to the sending buffer area.
In the above embodiment, the size of the space of the sending buffer in the idle state is monitored in real time, and the data packets are allocated according to the size of the space of the idle state, so that the occurrence of resource waste caused by that part of the space in the sending buffer is in the idle state for a long time is reduced, and the transmission rate is further improved.
Referring to fig. 4, as a further embodiment of the control method, the control method further includes,
acquiring the coding code rate of a coding code stream, monitoring the Round Trip Time (RTT) value of data sent by a network channel in real time, and calculating the product of the RTT value and the coding code rate to obtain the data volume;
and adjusting the space size of the sending buffer area in real time according to the data size.
RTT (Round-Trip Time), i.e., Round-Trip Time, is an important performance indicator in a computer network, and indicates the total Time delay from the Time when a sender sends data to the Time when the sender receives an acknowledgment from a receiver (the receiver immediately sends an acknowledgment after receiving the data). Round trip delay (RTT) is determined by three components: i.e. propagation time of the link, processing time of the end system and queuing and processing time in the cache of the router; the values of the first two parts are relatively fixed as a TCP connection, but the queuing and processing time in the cache of the router changes with the change of the congestion degree of the whole network, so the change of RTT reflects the change of the congestion degree of the network to a certain extent.
For example, if the RTT is monitored to be 50ms and the coding rate is 8Mbps (high definition) or 30Mbps (4K), the product of the RTT and the coding rate is calculated to obtain a data size of 0.4Mbit or 1.5Mbit, so that the space size of the transmission buffer can be adjusted to 0.4Mbit or 1.5 Mbit.
In the above embodiment, the space size of the sending buffer is optimized and adjusted in real time according to the round trip delay RTT value and the coding rate of the network channel, so that resource waste caused by an excessively large configuration space of the sending buffer is reduced, or a transmission rate is reduced caused by an excessively small configuration space of the sending buffer.
It should be noted that, in the foregoing embodiments, descriptions of the respective embodiments have respective emphasis, and reference may be made to relevant descriptions of other embodiments for parts that are not described in detail in a certain embodiment.
In the several embodiments provided in the present application, it should be understood that the provided apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative; for example, a module may be divided into only one logical function, and another division may be implemented in practice, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not implemented.
The embodiment of the application also discloses a computer readable storage medium.
A computer-readable storage medium storing a computer program that can be loaded by a processor and executes a control method of a live device as described above.
Wherein the computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device; program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
The embodiment of the application further discloses a live broadcast backpack.
A live broadcast backpack comprises the live broadcast equipment.
According to the live broadcast backpack, the number of data packets transmitted by each network channel can be dynamically adjusted and distributed according to the network state of each network channel, the data packets are transmitted to the streaming media cloud platform in real time through the aggregation channel, the receiving of TS packets, the recovery of code streams and the live broadcast distribution are realized in the streaming media cloud platform, and the signal transmission bandwidth and the transmission stability are greatly improved; meanwhile, the embedded SOC chip realizes high integration and low cost of a live broadcast backpack, has the advantages of small volume, light weight and convenience in movement, and can be widely applied to news reports, live broadcast of sports events, video streaming, video acquisition and transmission, remote live broadcast reports, various live broadcast activities and the like.
The foregoing is a preferred embodiment of the present application and is not intended to limit the scope of the application in any way, and any features disclosed in this specification (including the abstract and drawings) may be replaced by alternative features serving equivalent or similar purposes, unless expressly stated otherwise. That is, unless expressly stated otherwise, each feature is only an example of a generic series of equivalent or similar features.
Claims (10)
1. A live device, characterized in that: the live broadcast equipment (1) comprises a main control board (11), a coding module (12) and an aggregation transmission module (13);
the main control board (11) is used for being connected with an external camera device, receiving video signals collected by the camera device and carrying out format conversion; the coding module (12) is connected with the main control board (11) and is used for carrying out video coding on the video signals after format conversion and transmitting the coded code streams to the main control board (11);
the aggregation transmission module (13) is connected to the main control board (11) and is used for receiving the coded code stream and sequentially packaging the coded code stream into a plurality of data packets; the aggregate transmission module (13) is further configured to provide a plurality of network channels;
the main control board (11) is used for monitoring the network state of each network channel in real time; wherein the network status comprises an online status and an offline status;
the aggregation transmission module (13) is further configured to sequentially send data packets to a sending buffer corresponding to the network channel in the online state; the network channel is used for transmitting the data packet to the streaming media cloud platform while receiving the data packet in the sending buffer area.
2. A live device according to claim 1, characterized in that: the aggregation transmission module (13) comprises a transmission unit (131), a code stream receiving unit (132), a code stream processing unit (133) and a code stream data packet sending unit (134);
the transmission unit (131) is configured to provide a plurality of network channels;
the code stream receiving unit (132) is used for receiving the coded code stream;
the code stream processing unit (133) is connected to the code stream receiving unit (132) and is used for sequentially packaging the coded code stream into a plurality of data packets;
and the code stream data packet sending unit (134) is respectively connected to the code stream processing unit (133) and the transmission unit (131), and is used for sequentially sending the data packets to sending cache regions corresponding to the network channels in the online state.
3. A live device according to claim 2, characterized in that: the transmission unit (131) comprises at least two of a 4G module, a 5G module, a WIFI module, an Ethernet RJ45 module and a USB module.
4. A live device as claimed in any one of claims 1 to 3, wherein: the main control board (11) comprises a CPU control unit (111), an input processing unit (113), a coding interface unit (114) and a transmission interface unit (115);
the input processing unit (113) is used for receiving the video signal collected by the camera device and performing format conversion;
the coding interface unit (114) is respectively connected to the input processing unit (113) and the coding module (12), and is used for transmitting the video signal after format conversion to the coding module (12) and receiving a coding code stream coded by the coding module (12);
the transmission interface unit (115) is connected to the coding interface unit (114) and the aggregation transmission module (13) and is used for transmitting the coded code stream to the aggregation transmission module (13);
the CPU control unit (111) is respectively connected to the input processing unit (113), the coding interface unit (114), the transmission interface unit (115) and the aggregation transmission module (13), and is used for controlling the main control board (11) and the aggregation transmission module (13); the CPU control unit (111) is also used for monitoring the network state of each network channel in real time and controlling the aggregation transmission module (13) to transmit data packets to the transmission buffer area corresponding to the network channel in the online state.
5. A live device according to claim 4, characterized in that: the live broadcasting equipment (1) further comprises a display operation module (14), the display operation module (14) comprises a display unit (141) and a touch screen operation unit (142), the display unit (141) is connected to the main control board (11) and used for receiving and displaying the video signal after format conversion, and the touch screen operation unit (142) is used for responding to the touch screen signal to perform operation configuration on the live broadcasting equipment (1).
6. A method for controlling a live device, applied to a live device as claimed in any one of claims 1 to 5, characterized by: the control method comprises the following steps of,
acquiring a video signal acquired by a camera device and carrying out format conversion on the video signal;
sending the video signal after format conversion to an encoding module (12), and controlling the encoding module (12) to encode the video signal after format conversion;
sending the coded code stream to a polymerization transmission module (13), and controlling the polymerization transmission module (13) to sequentially package the coded code stream into a plurality of data packets;
monitoring the network state of each network channel in real time, and if the network state of each network channel is online, controlling an aggregation transmission module (13) to transmit a data packet to a transmission cache region corresponding to the network channel, wherein the network channel is used for transmitting the data packet to a streaming media cloud platform while the transmission cache region receives the data packet; and if the network state of the network channel is offline, controlling an aggregation transmission module (13) to stop sending the data packet to a sending cache region corresponding to the network channel.
7. The method of claim 6, wherein the method comprises: the method also comprises the steps of controlling the aggregation transmission module (13) to transmit the data packet to the transmission buffer zone corresponding to the network channel,
monitoring the space size of the sending buffer area in an idle state in real time, judging whether the space size in the idle state is larger than or equal to a preset size, and controlling an aggregation transmission module (13) to supplement and send a data packet into the sending buffer area if the space size in the idle state is larger than or equal to the preset size; and if the space size in the idle state is smaller than the preset size, controlling the aggregation transmission module (13) to stop sending the data packet to the sending buffer area.
8. The method of claim 6, wherein the method comprises: the control method further comprises the step of controlling the power supply,
acquiring the coding code rate of the coding code stream, monitoring the Round Trip Time (RTT) value of data sent by the network channel in real time, and calculating the product of the RTT value and the coding code rate to obtain the data volume;
and adjusting the space size of the sending buffer area in real time according to the data volume.
9. A computer-readable storage medium characterized by: a computer program which can be loaded by a processor and which performs the method according to any one of claims 6 to 8.
10. A live knapsack which characterized in that: comprising a live device as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111467050.7A CN114173144A (en) | 2021-12-02 | 2021-12-02 | Live broadcast equipment, control method thereof and live broadcast backpack |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111467050.7A CN114173144A (en) | 2021-12-02 | 2021-12-02 | Live broadcast equipment, control method thereof and live broadcast backpack |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114173144A true CN114173144A (en) | 2022-03-11 |
Family
ID=80482764
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111467050.7A Pending CN114173144A (en) | 2021-12-02 | 2021-12-02 | Live broadcast equipment, control method thereof and live broadcast backpack |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114173144A (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1798085A (en) * | 2004-12-28 | 2006-07-05 | 华为技术有限公司 | Method for adjusting size of transmission buffer in control sub layer of wireless link |
| US20090092142A1 (en) * | 2007-10-04 | 2009-04-09 | Barrett Kreiner | Methods, systems and computer program products for dynamic communication data routing by a multi-network remote communication terminal |
| CN201590871U (en) * | 2009-10-14 | 2010-09-22 | 赵玉峰 | Digital video live broadcast transmission equipment based on 3G mobile network |
| CN102457486A (en) * | 2010-10-19 | 2012-05-16 | 华为技术有限公司 | Method and device for transmitting media content |
| CN104038844A (en) * | 2014-06-25 | 2014-09-10 | 浙江工业大学 | Mobile live broadcast system based on MPEG-2 standard |
| CN104219509A (en) * | 2014-10-11 | 2014-12-17 | 四川九洲电器集团有限责任公司 | Vehicle-mounted intelligent terminal and data transmission method thereof |
| CN104780469A (en) * | 2015-05-25 | 2015-07-15 | 国家电网公司 | Link switching and resource allocation method of audio/video data in multi-network transmission |
| CN105432054A (en) * | 2014-06-25 | 2016-03-23 | 华为技术有限公司 | Method and device for determining transmission buffer size |
| CN105472477A (en) * | 2015-12-08 | 2016-04-06 | 广州华多网络科技有限公司 | Data transmission method, device and equipment |
| CN106411838A (en) * | 2016-06-14 | 2017-02-15 | 青岛乾元通数码科技有限公司 | Multi-channel load balancing audio/video transmission method and system |
| CN108322708A (en) * | 2018-02-12 | 2018-07-24 | 福州大学 | Real-time video transmission system and method based on multi-channel parallel transmission technology |
| CN108769726A (en) * | 2018-06-14 | 2018-11-06 | 腾讯科技（深圳）有限公司 | Multi-medium data method for pushing, device, storage medium and equipment |
| CN110365643A (en) * | 2019-06-04 | 2019-10-22 | 菜鸟智能物流控股有限公司 | Communication method and device |
| CN113507622A (en) * | 2021-07-08 | 2021-10-15 | 海南史塔克科技有限公司 | Video interaction method, device and system, live broadcast backpack and interaction receiver |
-
2021
- 2021-12-02 CN CN202111467050.7A patent/CN114173144A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1798085A (en) * | 2004-12-28 | 2006-07-05 | 华为技术有限公司 | Method for adjusting size of transmission buffer in control sub layer of wireless link |
| US20090092142A1 (en) * | 2007-10-04 | 2009-04-09 | Barrett Kreiner | Methods, systems and computer program products for dynamic communication data routing by a multi-network remote communication terminal |
| CN201590871U (en) * | 2009-10-14 | 2010-09-22 | 赵玉峰 | Digital video live broadcast transmission equipment based on 3G mobile network |
| CN102457486A (en) * | 2010-10-19 | 2012-05-16 | 华为技术有限公司 | Method and device for transmitting media content |
| CN105432054A (en) * | 2014-06-25 | 2016-03-23 | 华为技术有限公司 | Method and device for determining transmission buffer size |
| CN104038844A (en) * | 2014-06-25 | 2014-09-10 | 浙江工业大学 | Mobile live broadcast system based on MPEG-2 standard |
| CN104219509A (en) * | 2014-10-11 | 2014-12-17 | 四川九洲电器集团有限责任公司 | Vehicle-mounted intelligent terminal and data transmission method thereof |
| CN104780469A (en) * | 2015-05-25 | 2015-07-15 | 国家电网公司 | Link switching and resource allocation method of audio/video data in multi-network transmission |
| CN105472477A (en) * | 2015-12-08 | 2016-04-06 | 广州华多网络科技有限公司 | Data transmission method, device and equipment |
| CN106411838A (en) * | 2016-06-14 | 2017-02-15 | 青岛乾元通数码科技有限公司 | Multi-channel load balancing audio/video transmission method and system |
| CN108322708A (en) * | 2018-02-12 | 2018-07-24 | 福州大学 | Real-time video transmission system and method based on multi-channel parallel transmission technology |
| CN108769726A (en) * | 2018-06-14 | 2018-11-06 | 腾讯科技（深圳）有限公司 | Multi-medium data method for pushing, device, storage medium and equipment |
| CN110365643A (en) * | 2019-06-04 | 2019-10-22 | 菜鸟智能物流控股有限公司 | Communication method and device |
| CN113507622A (en) * | 2021-07-08 | 2021-10-15 | 海南史塔克科技有限公司 | Video interaction method, device and system, live broadcast backpack and interaction receiver |
Non-Patent Citations (1)
| Title |
|---|
| 斯纳德: "《高级TCP/IP编程》" * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104394486B (en) | A kind of video stream processing method and device based on cloud desktop | |
| CN105472477B (en) | A kind of data transmission method, device and equipment | |
| CN102946570B (en) | Transmission system and method for multi-stream streaming media of self-adaption network bandwidth | |
| US8873560B2 (en) | Multipath video streaming over a wireless network | |
| CN108282671B (en) | Streaming media data transmission method | |
| US10171815B2 (en) | Coding manner switching method, transmit end, and receive end | |
| CN104040992A (en) | Media streaming in mobile networks with improved efficiency | |
| CN106375790A (en) | QoE-driven adaptive scheduling method of multichannel HAS code rate | |
| CN104320716A (en) | A video uplink transmission method based on collaborative multiple terminals | |
| CN101883097A (en) | Method and device for realizing that server equipment shares screen of client equipment | |
| CN102148964A (en) | Three-generation (3G) mobile internet video monitoring system | |
| CN105577819A (en) | Sharing system, sharing method and sharing device for virtual desktop | |
| CN111031389B (en) | Video processing method, electronic device and storage medium | |
| CN104427286A (en) | Method and system for making video call | |
| CA2859342C (en) | Multipath data streaming over a wireless network | |
| CN106961625A (en) | A kind of channel switching method and its device | |
| CN107566855A (en) | Method, server and the set top box that channel is switched fast | |
| WO2014204180A1 (en) | Method and apparatus for rate adaptation in motion picture experts group media transport | |
| CN110418167A (en) | A kind of broadcast TV program Transmission system based on 5G | |
| CN100527699C (en) | Server system for performing communication over wireless network | |
| CN114173144A (en) | Live broadcast equipment, control method thereof and live broadcast backpack | |
| CN103428493A (en) | Light wireless transmission system for high-definition videos | |
| CN107071356A (en) | A kind of multimedia optimization server and its video information processing method | |
| CN110798688A (en) | High-definition video compression coding system based on real-time transmission | |
| CN201123043Y (en) | Household wireless multimedia game system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220311 |