CN114302149B - Audio and video transmission method, device and system - Google Patents
Audio and video transmission method, device and system Download PDFInfo
- Publication number
- CN114302149B CN114302149B CN202111600643.6A CN202111600643A CN114302149B CN 114302149 B CN114302149 B CN 114302149B CN 202111600643 A CN202111600643 A CN 202111600643A CN 114302149 B CN114302149 B CN 114302149B
- Authority
- CN
- China
- Prior art keywords
- decoder
- audio
- forwarding
- video
- identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000005540 biological transmission Effects 0.000 title claims abstract description 57
- 238000013507 mapping Methods 0.000 claims abstract description 23
- 238000004891 communication Methods 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 7
- 230000000694 effects Effects 0.000 abstract description 6
- 230000005236 sound signal Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides an audio and video transmission method, device and system. The method comprises the following steps: acquiring an audio and video signal to be transmitted; transmitting the audio and video signals to a decoder; if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance. The invention can distribute the pressure of the retransmission audio and video signals to a plurality of decoders for carrying out on average, thereby achieving the technical effect of retransmission equalization.
Description
Technical Field
The invention relates to the technical field of audio and video transmission, in particular to an audio and video transmission method, device and system.
Background
In the current distributed audio and video transmission field, there is an application scenario in which audio and video of one encoder is transmitted to a plurality of decoders. Under such application prospect, because of the limited performance and bandwidth of the encoder, the audio and video data cannot be duplicated in multiple copies through unicast (point-to-point connection between the client and the server), and simultaneously, the multiple copies of the audio and video data are respectively sent to multiple decoders. At present, a multicast mode is adopted to realize distributed audio and video transmission, an encoder sends the audio and video to a switch in a multicast mode, the switch distributes the audio and video to a plurality of decoders, and the decoders receive multicast streams and then decode and display the multicast streams.
Because the multicast mode is used, the common switch processes the multicast in a broadcast mode, if the number of codes is large, bandwidth congestion of an outgoing interface of the switch is necessarily caused, and therefore the switch with the multicast function is needed to be used, and certain requirements are set for the switch. In addition, the audio and video streams are transmitted in a multicast mode, and requirements are also set for network segments, so that a codec generally needs to be in one subnet, and if the subnets need to be crossed, namely vlan (Virtual Local Area Network), multicast cross vlan needs to be configured, and the requirements on a switch are higher. Each time these devices are deployed, the switch needs to be configured, and certain requirements are also put forward for on-site deployment personnel, so that the multicast configuration of the switch needs to be understood.
Disclosure of Invention
Accordingly, the present invention aims to provide an audio/video transmission method, apparatus and system, which can distribute audio/video of one encoder to a plurality of decoders, thereby achieving the technical effect of forwarding equalization.
In a first aspect, the present invention provides an audio/video transmission method, which includes:
acquiring an audio and video signal to be transmitted;
transmitting the audio and video signals to a decoder;
if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction;
the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance.
In an embodiment, before the obtaining the audio and video signal to be transmitted, the method further includes:
determining an identifier corresponding to a decoder for receiving the audio and video signals;
establishing a forwarding list according to the identifiers corresponding to the at least two decoders respectively; wherein, the forwarding list stores the mapping relation between the mark corresponding to each decoder and the mark of the lower forwarding decoder corresponding to the decoder;
and sending the forwarding list to each decoder.
In an embodiment, if the forwarding instruction containing the identifier sent by the decoder is received, the sending the audio and video signal to the subordinate forwarding decoder corresponding to the identifier according to the forwarding instruction includes:
and if the forwarding instruction sent by the decoder is received, determining a lower forwarding decoder corresponding to the decoder according to the forwarding instruction and the forwarding list, and sending the audio and video signal to the lower forwarding decoder.
In an embodiment, after determining the identifier corresponding to the decoder that receives the audio and video signal, the method further includes:
receiving a control division signal;
dividing the corresponding identifiers of the decoders into at least two groups according to the control dividing signals; wherein each group contains the respective identifications of at least two decoders;
correspondingly, the forwarding list is built according to the identifiers corresponding to the at least two decoders respectively, and the forwarding list comprises:
and establishing a forwarding list by using the identifiers corresponding to at least two decoders in each group.
In an embodiment, the sending the audio-video signal to a decoder includes:
and transmitting the audio and video signals to a decoder in a unicast mode.
In an embodiment, the sending the audio and video signal to the subordinate forwarding decoder corresponding to the identifier includes:
copying the audio and video signals for preset times, and sending each copy of copied audio and video signals to each subordinate forwarding decoder; the preset times are the numbers corresponding to the lower-level forwarding decoders.
In a second aspect, the present invention provides an audio/video transmission apparatus, including:
the acquisition unit is used for acquiring the audio and video signals to be transmitted;
a transmitting unit for transmitting the audio/video signal to a decoder;
the forwarding unit is used for sending the audio and video signals to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction if the forwarding instruction containing the identifier sent by the decoder is received;
the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance.
In an embodiment, further comprising:
the acquisition unit is used for determining an identifier corresponding to a decoder for receiving the audio and video signals;
a list unit, configured to establish a forwarding list according to the identifiers corresponding to the at least two decoders; wherein, the forwarding list stores the mapping relation between the mark corresponding to each decoder and the mark of the lower forwarding decoder corresponding to the decoder;
and the issuing unit is used for sending the forwarding list to each decoder.
In an embodiment, the transmitting unit includes:
and the unicast module is used for sending the audio and video signals to the decoder in a unicast mode.
In a third aspect, the present invention provides an audio/video transmission system, including: a client, a plurality of encoders, a plurality of decoders, and a switch;
the client is connected with the switch through a network; each encoder is connected with the audio-video terminal through a video cable; each encoder is connected with the switch through a network; each decoder is connected with the switch through a network;
the client is used for sending a control signal to the switch; the control signal contains a target identifier, and is used for controlling the switch to send an audio/video signal of a target encoder corresponding to the target identifier to the decoder;
the encoder is used for receiving the audio and video signals sent by the audio and video terminal, carrying out encoding processing on the audio and video signals and sending the encoded audio and video signals to the switch through the network;
the decoder is used for receiving the encoded audio and video signals sent by the switch, decoding the audio and video signals and sending the decoded audio and video signals to the playing equipment; the forwarding instruction is also used for receiving the forwarding instruction containing the identifier and sent after the audio and video signals are received;
the switch is used for acquiring the audio and video signals to be transmitted, which are sent by the encoder; transmitting the audio and video signals to a decoder; if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder pre-stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower forwarding decoder corresponding to the decoder;
the switch is also used for acquiring the audio and video signals sent by the target encoder according to the control signals; and sending the audio and video signals to a decoder.
In a fourth aspect, the present invention provides an electronic device, comprising: a processor, a memory, a communication interface, and a communication bus; wherein,,
the processor, the communication interface and the memory complete communication with each other through a communication bus;
the processor is used for calling the computer instructions in the memory to execute the steps of the audio/video transmission method.
In a fifth aspect, the present invention provides a computer readable storage medium storing computer instructions that, when executed, cause the computer to perform the steps of the above-described audio video transmission method.
As can be seen from the above description, the audio/video transmission method, apparatus and system according to the present invention obtain an audio/video signal to be transmitted; transmitting the audio and video signals to a decoder; if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance. The pressure of the forwarding audio and video signals can be evenly distributed to a plurality of decoders for forwarding and balancing, and the technical effect of forwarding and balancing is achieved.
In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
For a clearer description of embodiments of the invention or of solutions in the prior art, reference will be made below for a brief description of the drawings used in the embodiments or in the prior art, it being understood that the following drawings illustrate only some embodiments of the invention and are therefore not to be considered limiting of the scope, from which other relevant drawings can be obtained, without the inventive effort of a person skilled in the art.
Fig. 1 is a schematic flow chart of a first audio/video transmission method according to the present invention;
fig. 2 is a schematic diagram of a second flow of an audio/video transmission method according to the present invention;
fig. 3 is a schematic diagram of a third flow chart of an audio/video transmission method according to the present invention;
fig. 4 is a schematic structural diagram of a tree list in an audio/video transmission method according to the present invention;
fig. 5 is a schematic diagram of data transmission of an audio/video transmission system in an audio/video transmission method according to the present invention;
fig. 6 is a schematic structural diagram of an audio/video transmission device according to the present invention;
fig. 7 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. The components of the embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be made by a person skilled in the art without making any inventive effort, are intended to be within the scope of the present invention.
The embodiment of the invention provides an audio and video transmission method, which is shown in fig. 1, and specifically comprises the following steps:
s101: acquiring an audio and video signal to be transmitted;
the encoder is communicated with the audio-video terminal through the video cable, receives signals of the audio-video terminal, and encodes the signals of the received video terminal to obtain audio-video signals to be transmitted.
In this step, the audio/video signal to be transmitted generated by the encoder is acquired by means of a network.
S102: transmitting the audio and video signals to a decoder;
in this step, the audio/video signal is transmitted to the decoder by way of a network. And in the specific transmission, the audio and video signals are transmitted to a decoder in a unicast mode.
The decoder receives the audio and video signals in a network mode, decodes the audio and video signals, respectively transmits the decoded audio signals to a playing device (such as a sound device, an earphone and the like) connected with the decoder, and transmits the video signals to a display device.
In this step, if the decoder has stored locally in advance an identifier corresponding to the decoder itself, an identifier of a lower-level forwarding decoder corresponding to the decoder itself, and a mapping relationship between the identifier corresponding to the decoder itself and the identifier of the lower-level forwarding decoder. The decoder can feed back a forwarding instruction containing the identifier after acquiring the audio/video signal. The identification in the forwarding instruction is the identification of the lower forwarding decoder corresponding to the decoder itself.
If the decoder does not store the identifier of the lower-level forwarding decoder corresponding to the decoder itself or the mapping relationship between the identifier corresponding to the decoder itself and the identifier of the lower-level forwarding decoder in advance. The decoder cannot feed back a forwarding instruction containing the identifier after acquiring the audio/video signal.
As can be seen from the above description, the decoder receives the audio and video signals, and forwards the audio and video signals of UDP (User Datagram Protocol) to other decoders (subordinate forwarding decoders) in a unicast mode, so that the audio and video stream of one encoder is transmitted to a plurality of decoders for decoding, playing and displaying. The pressure of the forwarding audio and video signals is equally distributed to a plurality of decoders, and the technical effect of forwarding equalization is achieved.
S103: if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction;
in this step, if a forwarding instruction containing an identifier sent by the decoder is received, the audio/video signal is sent to the next forwarding decoder by way of a network. And in the specific transmission, transmitting the audio and video signals to a lower-level forwarding decoder in a unicast mode. And further, a plurality of decoders can forward the audio and video signals.
When the audio and video signals are specifically forwarded, the audio and video signals are required to be copied for a preset number of times, and each copy of the audio and video signals is sent to each subordinate forwarding decoder; the preset times are the numbers corresponding to the lower-level forwarding decoders.
As can be seen from the above description, the audio/video transmission method provided by the embodiment of the present invention obtains the audio/video signal to be transmitted; transmitting the audio and video signals to a decoder; if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance. The pressure of the forwarding audio and video signals can be evenly distributed to a plurality of decoders for forwarding and balancing, and the technical effect of forwarding and balancing is achieved.
In an embodiment of the present invention, referring to fig. 2, before step S101 in the embodiment of the audio/video transmission method, the method specifically includes the following steps:
s201: determining an identifier corresponding to a decoder for receiving the audio and video signals;
in this step, the number of decoders that need to receive the audio/video signal is acquired, and the identifier corresponding to each decoder is determined.
S202: establishing a forwarding list according to the identifiers corresponding to the at least two decoders respectively; wherein, the forwarding list stores the mapping relation between the mark corresponding to each decoder and the mark of the lower forwarding decoder corresponding to the decoder;
in this step, the identifiers corresponding to the decoders are ordered to form a tree forwarding list, which may be a binary balanced tree, for example. The forwarding list is established so as to be able to determine the decoder currently receiving the audio/video signal and the lower forwarding decoder corresponding to the decoder according to the forwarding list.
S203: and sending the forwarding list to each decoder.
In this step, the forwarding list is sent to each decoder, so that each decoder can determine its own corresponding lower forwarding decoder according to its own identifier. Namely, the method realizes that the decoder stores the corresponding identifier of the decoder, the identifier of the lower-level forwarding decoder corresponding to the decoder and the mapping relation between the corresponding identifier of the decoder and the identifier of the lower-level forwarding decoder in advance.
In a specific implementation, only the identifier of the decoder and the identifier of the lower forwarding decoder corresponding to the identifier of the decoder may be sent to the decoder, and the whole forwarding list does not need to be sent to each decoder. The efficiency of transmitting the forwarding list is improved, the transmission content is reduced, and the stability of transmission can be improved.
As can be seen from the above description, the present embodiment can build a forwarding list according to the identifiers corresponding to at least two decoders, and send the forwarding list to each decoder. The method realizes that the decoder stores the corresponding identifier of the decoder, the corresponding identifier of the lower-level forwarding decoder of the decoder and the mapping relation between the corresponding identifier of the decoder and the identifier of the lower-level forwarding decoder in advance.
On the basis of the foregoing embodiment, step S103 in the audio/video transmission method specifically includes the following:
and if the forwarding instruction sent by the decoder is received, determining a lower forwarding decoder corresponding to the decoder according to the forwarding instruction and the forwarding list, and sending the audio and video signal to the lower forwarding decoder.
In this embodiment, a forwarding list is established according to the identifiers corresponding to at least two decoders, the forwarding list is stored locally, and after receiving a forwarding instruction sent by a decoder, a lower forwarding decoder corresponding to the decoder (a decoder sending the forwarding instruction) can be determined according to the forwarding instruction and the forwarding list, so that an audio/video signal is sent to the lower forwarding decoder.
In this embodiment, the forwarding instruction sent by the decoder does not need to include the identifier of the lower forwarding decoder corresponding to the decoder, so as to improve the efficiency of sending the audio and video signals, reduce the sending content, and further improve the stability of transmission.
In an embodiment of the present invention, referring to fig. 3, after step S201 in the audio/video transmission method, the method specifically includes the following steps:
s204: receiving a control division signal;
s205: dividing the corresponding identifiers of the decoders into at least two groups according to the control dividing signals; wherein each group contains the respective identifications of at least two decoders;
correspondingly, step S202 establishes a forwarding list according to the identifiers corresponding to the at least two decoders, including:
s2021: and establishing a forwarding list by using the identifiers corresponding to at least two decoders in each group.
In the present embodiment, a control division signal for switching of a video signal and an audio signal is received.
Based on the video signal and the audio signal after switching, the identifiers corresponding to the decoders are divided into two groups, and a specific grouping standard is to divide the identifiers corresponding to the decoders playing the same signal source into the same group. Each group should contain respective identifications of at least two decoders so that respective identifications of at least two decoders in each group are built into a forwarding list to obtain two forwarding lists.
In this embodiment, different forwarding lists can be divided according to signal sources. When the audio and video signals are forwarded, the received audio and video signals can be copied and forwarded to a forwarding list corresponding to the signal source according to the different signal sources corresponding to the audio and video signals, so that the forwarding of the audio and video signals of different signal sources is realized.
In order to further explain the scheme, the invention provides an audio and video transmission system applying an audio and video transmission method, which specifically comprises the following contents:
a client, a plurality of encoders, a plurality of decoders, and a switch;
the client is connected with the switch through a network; each encoder is connected with the audio-video terminal through a video cable; each encoder is connected with the switch through a network; each decoder is connected with the switch through a network;
the client is used for sending a control signal to the switch; the control signal contains a target identifier, and is used for controlling the switch to send an audio/video signal of a target encoder corresponding to the target identifier to the decoder;
the encoder is used for receiving the audio and video signals sent by the audio and video terminal, carrying out encoding processing on the audio and video signals and sending the encoded audio and video signals to the switch through the network;
specifically, each encoder has an audio and video coding function, is communicated with an audio and video terminal (a terminal for sending audio and video signals) through a video cable, receives the audio and video signals (specifically including audio signals and video signals) of the audio and video terminal, respectively carries out coding processing on the audio signals and the video signals in the audio and video signals, and is responsible for sending the coded audio signals and video signals to a switch through a network.
The decoder is used for receiving the encoded audio and video signals sent by the switch, decoding the audio and video signals and sending the decoded audio and video signals to the playing equipment; the forwarding instruction is also used for receiving the forwarding instruction containing the identifier and sent after the audio and video signals are received;
specifically, each decoder has an audio/video decoding function, is communicated with the switch through a network, receives the encoded audio signals and video signals sent by the switch, the audio signals and the video signals are sent to the decoder in a unicast mode by the switch, the decoder decodes the audio/video signals, and the decoded audio signals are respectively transmitted to a playing device (such as a sound device, an earphone and the like) connected with the decoder, and sends the video signals to a display device.
The switch is used for acquiring the audio and video signals to be transmitted, which are sent by the encoder; transmitting the audio and video signals to a decoder; if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder pre-stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower forwarding decoder corresponding to the decoder;
the switch is also used for acquiring the audio and video signals sent by the target encoder according to the control signals; and sending the audio and video signals to a decoder.
It should be noted that, the switch in this embodiment can execute the processing flow of the embodiment of the audio/video transmission method in the above embodiment, and the functions thereof are not described herein again, and reference may be made to the detailed description of the above method embodiment.
The invention also provides a forwarding process of the audio and video transmission system, which specifically comprises the following steps:
s1: the decoder groups the switched signal sources, and the same signal sources are grouped.
S2: the decoders within the group are ordered according to a certain rule to form a tree list (which may be a binary balanced tree). For example, there are 12 decoders a to L, and the arrangement diagram is shown in fig. 4:
s3: the decoder A arranged at the first position decodes, displays and plays the unicast audio and video stream from the exchange receiving encoder. Meanwhile, after receiving the unicast stream, the decoder a immediately forwards (forwards after replication) the unicast stream with 2 (may be any multiple paths less than a certain number) unicast code streams to the switch, and the 2 unicast streams are forwarded to the decoder B and the decoder C. The decoder B and decoder C then forward according to the above tree structure and rules, and do not stop forwarding until no decoder is below the decoder.
As shown in fig. 5, the method specifically includes: the audio-video terminal transmits the audio signal and the video signal to the encoder A through the video cable, and the audio-video terminal transmits the audio signal and the video signal to the encoder B through the video cable. The encoder a is described below as an example:
the encoder A sends the audio and video stream to the decoder A in a unicast mode, the decoder A decodes, displays and plays the audio and video stream, the audio and video stream is forwarded to the decoder B and the decoder C in a unicast mode according to a forwarding tree in fig. 5, the decoder B receives the unicast audio and video stream sent by the decoder A, decodes and displays the unicast audio and video stream, and the audio and video stream is forwarded to the decoder D and the decoder E in a unicast mode according to the forwarding tree. The decoder C receives the unicast audio and video stream forwarded by the decoder A for decoding and displaying, and meanwhile, the decoder C forwards the unicast audio and video stream to the decoder F. The decoder D receives the unicast audio/video stream sent by the decoder B and decodes and displays the unicast audio/video stream. The decoder E receives the unicast audio/video stream sent by the decoder B and decodes and displays the unicast audio/video stream. The decoder F receives the unicast audio and video stream forwarded by the decoder C and decodes and displays the unicast audio and video stream. The code stream passing through the encoder A is sent to the switch through unicast, and is forwarded among the multi-level decoders, so that the audio/video stream of the decoder A is sent to 6 decoders from the decoder A to the decoder F.
An audio video transmission system may have a plurality of encoders and a plurality of decoders. The audio and video signals can be switched to any one or more decoders by any one encoder, and all the encoders and the decoders are interconnected through a switch, so that omnibearing switching can be realized.
The embodiment of the invention provides a specific implementation manner of an audio/video transmission device capable of realizing all contents in the audio/video transmission method, and referring to fig. 6, the audio/video transmission device specifically comprises the following contents:
an acquiring unit 10, configured to acquire an audio/video signal to be transmitted;
a transmitting unit 20 for transmitting the audio and video signal to a decoder;
a forwarding unit 30, configured to, if a forwarding instruction containing an identifier and sent by the decoder is received, send the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction;
the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance.
In an embodiment of the present invention, further includes:
the acquisition unit is used for determining an identifier corresponding to a decoder for receiving the audio and video signals;
a list unit, configured to establish a forwarding list according to the identifiers corresponding to the at least two decoders; wherein, the forwarding list stores the mapping relation between the mark corresponding to each decoder and the mark of the lower forwarding decoder corresponding to the decoder;
and the issuing unit is used for sending the forwarding list to each decoder.
In an embodiment of the present invention, the forwarding unit 30 is further configured to determine a lower forwarding decoder corresponding to the decoder according to the forwarding instruction and the forwarding list if the forwarding instruction sent by the decoder is received, and send the audio/video signal to the lower forwarding decoder.
In an embodiment of the present invention, further includes:
a signal unit to which a reception control division signal is applied;
a group unit for dividing the respective identifications of the plurality of decoders into at least two groups according to the control division signal; wherein each group contains the respective identifications of at least two decoders;
in one embodiment of the present invention, the transmitting unit includes:
and the unicast module is used for sending the audio and video signals to the decoder in a unicast mode.
The embodiment of the audio/video transmission device provided by the invention can be specifically used for executing the processing flow of the embodiment of the audio/video transmission method in the above embodiment, and the functions of the embodiment of the audio/video transmission device are not repeated herein, and reference can be made to the detailed description of the embodiment of the method.
As can be seen from the above description, the audio/video transmission device provided by the embodiment of the present invention obtains the audio/video signal to be transmitted; transmitting the audio and video signals to a decoder; if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance. The invention can distribute the pressure of the retransmission audio and video signals to a plurality of decoders for carrying out on average, thereby achieving the technical effect of retransmission equalization.
The embodiment of the invention provides an embodiment of an electronic device for implementing all or part of the content in the embodiment of the audio/video transmission method, referring to fig. 7, the electronic device specifically includes the following contents:
acquiring an audio and video signal to be transmitted;
transmitting the audio and video signals to a decoder;
if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance.
An embodiment of the present invention provides a computer readable storage medium for implementing all or part of the content in the embodiment of the audio/video transmission method, where the computer readable storage medium stores computer instructions, where the computer instructions when executed cause the computer to perform all steps of the audio/video transmission method in the above embodiment, for example, where the processor implements the following steps when executing the computer instructions:
acquiring an audio and video signal to be transmitted;
transmitting the audio and video signals to a decoder;
if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance.
Although the invention provides method operational steps as described in the examples or flowcharts, more or fewer operational steps may be included based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When implemented by an actual device or client product, the instructions may be executed sequentially or in parallel (e.g., in a parallel processor or multi-threaded processing environment) as shown in the embodiments or figures.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the device (system) embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the section of the method embodiments for relevance.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. The orientation or positional relationship indicated by the terms "upper", "lower", etc. are based on the orientation or positional relationship shown in the drawings, are merely for convenience of description and to simplify the description, and are not indicative or implying that the apparatus or elements in question must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as limiting the present invention. Unless specifically stated or limited otherwise, the terms "mounted," "connected," and "coupled" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
It should be noted that, without conflict, the embodiments of the present invention and features of the embodiments may be combined with each other. The present invention is not limited to any single aspect, nor to any single embodiment, nor to any combination and/or permutation of these aspects and/or embodiments. Moreover, each aspect and/or embodiment of the invention may be used alone or in combination with one or more other aspects and/or embodiments.
Finally, it should be noted that: the above examples are only specific embodiments of the present invention, and are not intended to limit the scope of the present invention, but it should be understood by those skilled in the art that the present invention is not limited thereto, and that the present invention is described in detail with reference to the foregoing examples: any person skilled in the art may modify or easily conceive of the technical solution described in the foregoing embodiments, or perform equivalent substitution of some of the technical features, while remaining within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the corresponding technical solutions. Are intended to be encompassed within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. An audio/video transmission method, comprising:
acquiring an audio and video signal to be transmitted;
transmitting the audio and video signals to a decoder;
if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction;
the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance.
2. The audio-video transmission method according to claim 1, further comprising, before the acquiring the audio-video signal to be transmitted:
determining an identifier corresponding to a decoder for receiving the audio and video signals;
establishing a forwarding list according to the identifiers corresponding to the at least two decoders respectively; wherein, the forwarding list stores the mapping relation between the mark corresponding to each decoder and the mark of the lower forwarding decoder corresponding to the decoder;
and sending the forwarding list to each decoder.
3. The audio/video transmission method according to claim 2, wherein if a forwarding instruction containing an identifier sent by the decoder is received, the audio/video signal is sent to a subordinate forwarding decoder corresponding to the identifier according to the forwarding instruction, and the method comprises:
and if the forwarding instruction sent by the decoder is received, determining a lower forwarding decoder corresponding to the decoder according to the forwarding instruction and the forwarding list, and sending the audio and video signal to the lower forwarding decoder.
4. The audio-video transmission method according to claim 2, further comprising, after said determining an identification corresponding to a decoder that receives the audio-video signal:
receiving a control division signal;
dividing the corresponding identifiers of the decoders into at least two groups according to the control dividing signals; wherein each group contains the respective identifications of at least two decoders;
correspondingly, the forwarding list is built according to the identifiers corresponding to the at least two decoders respectively, and the forwarding list comprises:
and establishing a forwarding list by using the identifiers corresponding to at least two decoders in each group.
5. The audio-video transmission method according to claim 1, wherein the transmitting the audio-video signal to a decoder includes:
and transmitting the audio and video signals to a decoder in a unicast mode.
6. The audio/video transmission method according to claim 1, wherein transmitting the audio/video signal to the lower-level forwarding decoder corresponding to the identifier comprises:
copying the audio and video signals for preset times, and sending each copy of copied audio and video signals to each subordinate forwarding decoder; the preset times are the numbers corresponding to the lower-level forwarding decoders.
7. An audio/video transmission apparatus, comprising:
the acquisition unit is used for acquiring the audio and video signals to be transmitted;
a transmitting unit for transmitting the audio/video signal to a decoder;
the forwarding unit is used for sending the audio and video signals to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction if the forwarding instruction containing the identifier sent by the decoder is received;
the decoder stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower-level forwarding decoder corresponding to the decoder in advance.
8. An audio and video transmission system, comprising: a client, a plurality of encoders, a plurality of decoders, and a switch;
the client is connected with the switch through a network; each encoder is connected with the audio-video terminal through a video cable; each encoder is connected with the switch through a network; each decoder is connected with the switch through a network;
the client is used for sending a control signal to the switch; the control signal contains a target identifier, and is used for controlling the switch to send an audio/video signal of a target encoder corresponding to the target identifier to the decoder;
the encoder is used for receiving the audio and video signals sent by the audio and video terminal, carrying out encoding processing on the audio and video signals and sending the encoded audio and video signals to the switch through the network;
the decoder is used for receiving the encoded audio and video signals sent by the switch, decoding the audio and video signals and sending the decoded audio and video signals to the playing equipment; the forwarding instruction is also used for receiving the forwarding instruction containing the identifier and sent after the audio and video signals are received;
the switch is used for acquiring the audio and video signals to be transmitted, which are sent by the encoder; transmitting the audio and video signals to a decoder; if a forwarding instruction containing an identifier and sent by the decoder is received, sending the audio and video signal to a lower forwarding decoder corresponding to the identifier according to the forwarding instruction; the decoder pre-stores a mapping relation between an identifier corresponding to the decoder and an identifier of a lower forwarding decoder corresponding to the decoder;
the switch is also used for acquiring the audio and video signals sent by the target encoder according to the control signals; and sending the audio and video signals to a decoder.
9. An electronic device, comprising: a processor, a memory, a communication interface, and a communication bus; wherein,,
the processor, the communication interface and the memory complete communication with each other through a communication bus;
the processor is configured to invoke computer instructions in the memory to perform the steps of the audio video transmission method of any of claims 1-6.
10. A computer readable storage medium storing computer instructions which, when executed, cause the computer to perform the steps of the audio video transmission method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111600643.6A CN114302149B (en) | 2021-12-24 | 2021-12-24 | Audio and video transmission method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111600643.6A CN114302149B (en) | 2021-12-24 | 2021-12-24 | Audio and video transmission method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114302149A CN114302149A (en) | 2022-04-08 |
| CN114302149B true CN114302149B (en) | 2023-05-09 |
Family
ID=80970568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111600643.6A Active CN114302149B (en) | 2021-12-24 | 2021-12-24 | Audio and video transmission method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114302149B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4800376A (en) * | 1986-01-13 | 1989-01-24 | Sony Corporation | Multiple display system |
| US8010692B1 (en) * | 2009-11-05 | 2011-08-30 | Adobe Systems Incorporated | Adapting audio and video content for hardware platform |
| WO2013159663A1 (en) * | 2012-04-28 | 2013-10-31 | 广州九游信息技术有限公司 | Content reproduction method and device, and mobile terminal |
| CN111669610A (en) * | 2020-05-27 | 2020-09-15 | 北京奇艺世纪科技有限公司 | Live video transmission method, system, device, server, electronic equipment and storage medium |
| CN111757123A (en) * | 2020-07-07 | 2020-10-09 | 杭州海康威视数字技术股份有限公司 | Distributed video decoding system, video decoding output method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10045089B2 (en) * | 2011-08-02 | 2018-08-07 | Apple Inc. | Selection of encoder and decoder for a video communications session |
| US11561797B2 (en) * | 2019-08-19 | 2023-01-24 | Ati Technologies Ulc | Decompression engine for decompressing compressed input data that includes multiple streams of data |
-
2021
- 2021-12-24 CN CN202111600643.6A patent/CN114302149B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4800376A (en) * | 1986-01-13 | 1989-01-24 | Sony Corporation | Multiple display system |
| US8010692B1 (en) * | 2009-11-05 | 2011-08-30 | Adobe Systems Incorporated | Adapting audio and video content for hardware platform |
| WO2013159663A1 (en) * | 2012-04-28 | 2013-10-31 | 广州九游信息技术有限公司 | Content reproduction method and device, and mobile terminal |
| CN111669610A (en) * | 2020-05-27 | 2020-09-15 | 北京奇艺世纪科技有限公司 | Live video transmission method, system, device, server, electronic equipment and storage medium |
| CN111757123A (en) * | 2020-07-07 | 2020-10-09 | 杭州海康威视数字技术股份有限公司 | Distributed video decoding system, video decoding output method and device |
Non-Patent Citations (1)
| Title |
|---|
| 远程同步大屏幕显示***构建技术与应用;王猛 等;《第八届中国指挥控制大会论文集》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114302149A (en) | 2022-04-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6689511B2 (en) | Apparatus and method for transmitting and receiving packets using forward error correction scheme | |
| CN101895718B (en) | Video conference system multi-image broadcast method, and device and system thereof | |
| EP2241067B1 (en) | Multiway peer-to-peer media streaming | |
| CN101656863A (en) | Conference control method, device and system | |
| CN106227492B (en) | Combination and mobile intelligent terminal interconnected method and device | |
| JP2011508546A5 (en) | ||
| KR101131374B1 (en) | Scalable video coding/multiplexing compatible with non-scalable decoders | |
| CN102334309A (en) | Distributed routing of conferences using conference identifier | |
| CN104009991A (en) | Audio communication system and method | |
| WO2018121584A1 (en) | Data stream transmission method, apparatus, related devices and storage medium | |
| CN110602338B (en) | Audio processing method, device, system, storage medium and equipment | |
| CN114302149B (en) | Audio and video transmission method, device and system | |
| US20120260122A1 (en) | Video conferencing with multipoint conferencing units and multimedia transformation units | |
| CN101502043B (en) | Method for carrying out a voice conference, and voice conference system | |
| EP2890081B1 (en) | Aggregated adaptive bit rate streaming | |
| US9143737B2 (en) | Data distribution | |
| CN112019488B (en) | Voice processing method, device, equipment and storage medium | |
| JP2008306683A (en) | Conference management server, and multipoint connection device | |
| US20060159126A1 (en) | Real time optimization over a shared communication channel | |
| CN101924641A (en) | Method, device and system for processing multicast source information | |
| CA2645524A1 (en) | Multi-address message addressing | |
| JP4425887B2 (en) | VIDEO CONFERENCE SYSTEM, TERMINAL USED FOR VIDEO CONFERENCE SYSTEM, TERMINAL PROCESSING METHOD, AND ITS PROGRAM | |
| JP2014068295A (en) | Distribution server, system, and program for distributing multicast data suitable for wireless environment | |
| CN114520687B (en) | Audio data processing method, device and equipment applied to satellite system | |
| CN110636244A (en) | Video conference server, system, control method and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |