WO2013007145A1 - Multimedia data transmission method and system - Google Patents

Multimedia data transmission method and system Download PDF

Info

Publication number
WO2013007145A1
WO2013007145A1 PCT/CN2012/077349 CN2012077349W WO2013007145A1 WO 2013007145 A1 WO2013007145 A1 WO 2013007145A1 CN 2012077349 W CN2012077349 W CN 2012077349W WO 2013007145 A1 WO2013007145 A1 WO 2013007145A1
Authority
WO
WIPO (PCT)
Prior art keywords
multimedia data
data
rtp
ssrc
module
Prior art date
Application number
PCT/CN2012/077349
Other languages
French (fr)
Chinese (zh)
Inventor
郑可馨
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2013007145A1 publication Critical patent/WO2013007145A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation

Definitions

  • the present invention relates to the field of multimedia transmission technologies, and in particular, to a method and system for transmitting multimedia data, and more particularly to a method and system for transmitting multimedia data using a real-time transmission RTP protocol in a remote presentation system.
  • Background technique
  • a set of camera arrays is typically used to capture a panoramic view of a conference room.
  • the video signal of each camera belongs to a spatial segment of the panoramic view.
  • these video signals are Time and space are closely related at both latitudes.
  • all component video signals in the camera array need to be processed, encoded, transmitted, decoded, and displayed almost simultaneously, and logically all component video signals can be treated as one logical video signal. Therefore, usually during the network transmission phase, the logical video signal is transmitted through a Real-time Transmission Protocol (RTP) or multiple RTP sessions.
  • RTP Real-time Transmission Protocol
  • using an RTP session to transport media streams not only saves RTP address resources, but also simplifies forwarding processing of intermediate devices, such as proxy servers, and its network address translation (NAT, Network) Devices such as Address Translation are more friendly, but on the other hand, the way in which media streams are transmitted using a single RTP session also involves the problem of media stream multiplexing.
  • intermediate devices such as proxy servers, and its network address translation (NAT, Network) Devices such as Address Translation are more friendly, but on the other hand, the way in which media streams are transmitted using a single RTP session also involves the problem of media stream multiplexing.
  • NAT Network address translation
  • TIP Telepresence Interoperability
  • each RTP stream has an independent synchronization source identifier (SSRC, Synchronization source), timestamp, and packet sequence number, so it can be considered as multiple independent RTP streams, as shown in Figure 1, between each component media stream. It is done by means of parallel transmission.
  • SSRC synchronization source identifier
  • timestamp timestamp
  • packet sequence number packet sequence number
  • the disadvantages of the TIP protocol are: Since each RTP stream has an independent packet sequence number and timestamp, the receiving end must separately perform quality of service (Qos, Quality Of Service) processing for each independent RTP stream; Inter-synchronization requires the support of the Real-Time Transport Control Protocol (RTCP, RTP Control Protocol). Summary of the invention
  • a method for transmitting multimedia data comprising:
  • the step C includes: periodically acquiring one frame of video data from the plurality of the multimedia data streams, and performing RTP packetization according to the corresponding SSRC identifiers.
  • the step C includes: periodically acquiring audio data of the same duration from the multiple multimedia data streams, and performing RTP packaging according to the corresponding SSRC identifiers. .
  • the method further includes:
  • the multimedia data of the encoder corresponding to the plurality of media data collection devices is obtained before all the steps are performed.
  • the multi-frame video data has the same time stamp.
  • the method further includes:
  • the method includes:
  • the unpacked media packet is sent to the corresponding decoder for decoding according to the correspondence between the SSRC identification information included in the RTP header information and the location information transmitted by the in-band or out-of-band signaling.
  • a device for transmitting multimedia data comprising a data composite module and a data sending module, wherein: the data composite module is configured to: acquire multimedia data from a plurality of encoders, and periodically acquire the multimedia data streams from the plurality of channels; The multimedia data of the same duration is RTP-packed according to the corresponding SSRC identifier, and then the RTP packet is sent to the data sending module; the data sending module is configured to: send the RTP packet through an RTP channel.
  • the data composite module is configured to periodically acquire multimedia data of the same duration from the multiple multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers.
  • the multi-frame video data has the same time stamp.
  • the data composite module is configured to periodically acquire multimedia data of the same duration from the plurality of the multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers.
  • the data composite module periodically acquires audio data of the same duration from the plurality of multimedia data streams and performs RTP packing according to the corresponding SSRC identifiers.
  • a receiving device for multimedia data comprising: a data receiving module and a data splitting module, wherein: the data receiving module is configured to: periodically receive an RTP packet;
  • the data splitting module is configured to: unpack the received RTP packet according to the SSRC identifier information in the RTP header information of the RTP packet, and send the unpacked media packet to the corresponding The decoder performs decoding.
  • the receiving device further includes a Qos processing module, where:
  • the Qos processing module is connected between the data receiving module and the data splitting module, and is configured to: preprocess the received RTP packet.
  • the pre-processing includes: sorting, eliminating jitter and disorder of the network.
  • a transmission system of multimedia data comprising any one of the transmission means of multimedia data as described above and any one of the means for receiving multimedia data as described above.
  • multimedia data for example, video signals
  • synchronization recovery can be performed independently of time stamping, and it is possible to easily associate multiple multimedia data together, thereby avoiding out-of-band Signaling interaction.
  • the unified time stamp and packet sequence number simplify the Qos processing, and it is not necessary to do QoS processing for each multimedia data stream.
  • FIG. 1 is a schematic diagram of the RTP data flow of the TIP protocol
  • FIG. 2 is a schematic diagram of a method for transmitting multimedia data according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a multimedia data transmission system according to an embodiment of the present invention.
  • the implementation, functional features and advantageous effects of the object of the present invention will be further described below in conjunction with the specific embodiments and the accompanying drawings.
  • the method for transmitting multimedia data includes the following steps:
  • the transmitting device of the multimedia data transmission system first needs to acquire the multimedia data sent by the encoder corresponding to the plurality of media data collecting devices, and then send the multimedia data to the receiving device at the opposite end.
  • the multimedia data is video data
  • the step C periodically acquiring one frame of video data from the plurality of the multimedia data and respectively corresponding to each
  • the SSRC identifies RTP packetization, and the multi-frame multimedia data such as video data has the same time stamp.
  • video data acquired simultaneously from multiple multimedia data streams have the same time stamp and have the same duration.
  • the data composite module when the multimedia data is audio data, the data composite module periodically acquires audio data of the same duration from the multiple multimedia data streams, and performs RTP packaging according to the corresponding SSRC identifiers. .
  • the method further includes:
  • the correspondence between the SSRC identification information included in the RTP header information and the location information transmitted by the in-band or out-of-band signaling manner is used.
  • the relationship sends the unpacked media packet to the corresponding decoder for decoding.
  • an embodiment of the present invention further provides a multimedia data transmission system, including a multimedia data transmitting apparatus and a receiving apparatus, where
  • the sending device includes:
  • a data multiplexing module configured to periodically acquire multimedia data of the same duration from the plurality of the multimedia data, and perform RTP packaging according to the corresponding SSRC identifier, and then send the RTP packet to the data sending module;
  • the multimedia data is obtained from an encoder corresponding to a plurality of media data collection devices.
  • a data sending module configured to send the RTP packet by using an RTP channel
  • the receiving device includes:
  • a data receiving module configured to periodically receive an RTP packet
  • the data splitting module is configured to unpack the received RTP packet according to the SSRC identifier information in the RTP header information, and send the unpacked media packet to a corresponding decoder for decoding.
  • the data composite module periodically acquires one frame of video data from the plurality of the multimedia data streams, and performs RTP packaging according to the corresponding SSRC identifiers, where The multi-frame video data has the same time stamp.
  • the data composite module When the multimedia data is audio data, the data composite module periodically acquires audio data of the same duration from the plurality of multimedia data streams and performs RTP packing according to the corresponding SSRC identifiers.
  • the receiving device further includes:
  • the Qos processing module is connected between the data receiving module and the data splitting module, and is configured to perform preprocessing on the received RTP packet.
  • the preprocessing performed by the Qos processing module on the RTP packet includes: sorting, eliminating network jitter and out of order.
  • the embodiment of the invention further provides a method for transmitting multimedia data, including:
  • the step C includes: periodically acquiring one frame of video data from the plurality of the multimedia data streams, and performing RTP packetization according to the corresponding SSRC identifiers.
  • the step C includes: periodically acquiring audio data of the same duration from the multiple multimedia data streams, and performing RTP packaging according to the corresponding SSRC identifiers. .
  • the method further includes:
  • the multimedia data of the encoder corresponding to the plurality of media data collection devices is obtained before all the steps are performed.
  • the multi-frame video data has the same time stamp.
  • the method further includes:
  • the method includes:
  • the unpacked media packet is sent to the corresponding decoder for decoding according to the correspondence between the SSRC identification information included in the RTP header information and the location information transmitted by the in-band or out-of-band signaling.
  • the embodiment of the invention further provides a device for transmitting multimedia data, comprising a data composite module and a data sending module, wherein:
  • the data composite module is configured to: acquire multimedia data from a plurality of encoders, and periodically acquire multimedia data of the same duration from the plurality of the multimedia data streams, and according to respective corresponding
  • the SSRC identifier performs RTP packetization, and then sends the RTP packet to the data sending module.
  • the data sending module is configured to: send the RTP packet through an RTP channel.
  • the data composite module is configured to periodically acquire multimedia data of the same duration from the multiple multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers.
  • the multi-frame video data has the same time stamp.
  • the data composite module is configured to periodically acquire multimedia data of the same duration from the plurality of the multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers.
  • the data composite module periodically acquires audio data of the same duration from the plurality of multimedia data streams and performs RTP packing according to the corresponding SSRC identifiers.
  • An embodiment of the present invention further provides a multimedia data receiving apparatus, including a data receiving module and a data splitting module, where:
  • the data receiving module is configured to: periodically receive an RTP packet
  • the data splitting module is configured to: unpack the received RTP packet according to the SSRC identifier information in the RTP header information of the RTP packet, and send the unpacked media packet to a corresponding decoder for decoding. .
  • the receiving device further includes a Qos processing module, where:
  • the Qos processing module is connected between the data receiving module and the data splitting module, and is configured to: preprocess the received RTP packet.
  • the pre-processing includes: sorting, eliminating jitter and disorder of the network.
  • the embodiment of the present invention further provides a multimedia data transmission system, including any one of the multimedia data transmitting apparatuses as described above, and any one of the multimedia data receiving apparatuses as described above.
  • the corresponding multimedia data transmission system includes at least: a transmitting device 10 and a receiving device 20, wherein:
  • the sending device 10 is configured to: combine the multimedia data of each component, and then perform RTP encapsulation on the plurality of multimedia data, and then send the same to the network;
  • the receiving device 20 is configured to: receive the data packet, according to the SSRC information of the RTP header.
  • the composite code stream is separated, and the separated data is sent to the corresponding decoder for decoding.
  • the location information of the left, middle, and right screens may be transmitted in an outband manner (such as using signaling), or in an inband manner (such as a CSRC or an extended header using an RTP header).
  • an outband manner such as using signaling
  • an inband manner such as a CSRC or an extended header using an RTP header.
  • the data transmission step included in the method for transmitting multimedia data includes the steps 101 to 104:
  • Step 101 Create an RTP channel for media transmission, and assign an SSRC identifier to the left, middle, and right screens.
  • the SSRC corresponding to the left, middle, and right screens is SSRC left, SSRC, and SSRC right.
  • Step 102 The data composite module 101 acquires one frame of encoded data from an encoder of an encoder (left), an encoder (middle), and an encoder (right).
  • the encoded data of the three screens collected at the same time has the same time stamp, which can be logically regarded as one frame of data from the same encoder, and can also be regarded as three frames of data having the same time stamp. .
  • the RTP packing and data sending module 102 in this embodiment, Think of it as three frames of data with the same timestamp.
  • the data multiplexing module 101 obtains one frame of encoded data from the encoders of the encoder (left), the encoder (middle), and the encoder (right), respectively, which are periodically acquired, that is, The data synthesizing module 101 acquires one frame of encoded data from the encoders of the encoder (left), the encoder (middle), and the encoder (right) at every fixed or custom time interval.
  • Step 103 Perform RTP packing on the three frames of data.
  • the three frames of data sent by the SSRC left, SSRC, SSRC right encoder (left), encoder (middle), and encoder (right) screens are respectively RTP-packed, and the three frames of data have the same
  • the RTP timestamp, and the RTP packet sequence number are sequentially sorted according to the order in which the data transmission module 102 sends the RTP packets.
  • Step 104 Send the RTP packet.
  • the data receiving step included in the method for transmitting multimedia data includes step 201 - step
  • Step 201 The data receiving module 201 receives an RTP packet on the network.
  • Step 202 The data receiving module 201 sends the received RTP packet to the Qos processing module 202 process 202.
  • the Qos processing module 202 sorts the RTP packets, eliminates the jitter and disorder of the network, and it is not difficult to understand that the Qos processing module 202 can add other methods for processing the RTP packets. I will not do this here - enumeration.
  • Step 203 The Qos processing module 202 outputs the processed RTP packet and sends it to the data splitting module 203.
  • Step 204 The data splitting module 203 unpacks and separates the RTP packet according to the SSRC information in the RTP header information.
  • Step 205 The data splitting module 203 sends the separated media packet to the corresponding decoder according to the corresponding relationship between the SSRC and the position information of the three screens, for example, the corresponding decoder in FIG. 3 (left), Decoder (middle), decoder (right).
  • the multimedia data transmission method provided by the embodiment of the present invention the multimedia data of each component (for example, a video signal) is synchronously transmitted through an RTP channel, and the data recovery process can be synchronously restored without relying on the timestamp. It is very easy to associate multiple multimedia data together to avoid out-of-band signaling interactions.
  • a unified time stamp and a packet sequence number are used for the composite process of multimedia data, thereby simplifying the Qos processing step in the process of recovering data at the receiving end, and does not have to be used for each multimedia data stream. Do Qos processing.
  • synchronization between multiple media data streams does not need RTCP support, and therefore, the embodiment of the present invention has applicability while ensuring the integrity of the function. Stronger advantage.
  • the multimedia data of each component is synchronously transmitted, and the synchronization recovery can be performed independently of the time stamp, and the plurality of multimedia data can be easily associated together, and the outband signaling interaction can be avoided.
  • the unified time stamp and the packet sequence number simplify the QoS processing, and it is not necessary to perform QoS processing on each multimedia data stream. Therefore, the present invention has strong industrial applicability.

Abstract

A multimedia data transmission method and system. The method includes: creating a single RTP channel; respectively allocating an SSRC identifier to each of a plurality of paths of multimedia data streams; and respectively acquiring multimedia data with an equal duration from the plurality of paths of multimedia data streams periodically and performing RTP packaging according to the respectively corresponding SSRC identifier, and sending the RTP packages via the single RTP channel. In the abovementioned technical solution, the multimedia data of each component is transmitted synchronously, and synchronous recovery can be performed without depending upon time stamps. It is possible to associate an amount of multimedia data together very easily, and the out-of-band signalling interaction can be avoided. And, during multimedia data transmission, using a unified time stamp and package number simplifies the QoS processing without performing QoS processing on each path of multimedia data streams.

Description

多媒体数据的传输方法及***  Multimedia data transmission method and system
技术领域 Technical field
本发明涉及多媒体传输技术领域， 尤其涉及一种多媒体数据的传输方法 及***， 更为具体地， 涉及在远程呈现***中使用实时传输 RTP协议对多媒 体数据进行传输的方法及***。 背景技术  The present invention relates to the field of multimedia transmission technologies, and in particular, to a method and system for transmitting multimedia data, and more particularly to a method and system for transmitting multimedia data using a real-time transmission RTP protocol in a remote presentation system. Background technique
在远程呈现***中，一般使用一组摄像机阵列来捕获会议室的全景视图， 每个摄像机的视频信号属于全景视图的一个空间片断， 为了在远端恢复一种 沉浸式的效果，这些视频信号在时间和空间两个纬度上是紧密相关的。为此， 摄像机阵列中所有的分量视频信号需要几乎同步地被釆集、 编码、 传送、 解 码及显示等处理， 逻辑上所有的分量视频信号可视为一个逻辑视频信号。 因 此， 通常在网络传送阶段， 该逻辑视频信号通过一个实时传输协议（RTP, Real-time Transmission Protocol )或多个 RTP会话进行传输。 相对于使用多 个 RTP会话传输媒体流的方法， 使用一个 RTP会话传输媒体流不但可以节 省 RTP地址资源， 还可以简化中间设备的转发处理， 如代理服务器， 并且其 对网络地址转换 ( NAT, Network Address Translation )等设备更加友好， 但 另一方面，釆用单个 RTP会话传输媒体流的方式也涉及到媒体流复用的问题。  In a telepresence system, a set of camera arrays is typically used to capture a panoramic view of a conference room. The video signal of each camera belongs to a spatial segment of the panoramic view. In order to restore an immersive effect at the far end, these video signals are Time and space are closely related at both latitudes. To this end, all component video signals in the camera array need to be processed, encoded, transmitted, decoded, and displayed almost simultaneously, and logically all component video signals can be treated as one logical video signal. Therefore, usually during the network transmission phase, the logical video signal is transmitted through a Real-time Transmission Protocol (RTP) or multiple RTP sessions. Compared to the method of transmitting media streams using multiple RTP sessions, using an RTP session to transport media streams not only saves RTP address resources, but also simplifies forwarding processing of intermediate devices, such as proxy servers, and its network address translation (NAT, Network) Devices such as Address Translation are more friendly, but on the other hand, the way in which media streams are transmitted using a single RTP session also involves the problem of media stream multiplexing.
目前，思科提出了一种网真互操作协议（ TIP , Telepresence Interoperability Currently, Cisco proposes a telepresence interoperability protocol (TIP, Telepresence Interoperability).
Protocol ) , 该协议是将多个具有相同编码类型的分量媒体流（如三屏远程呈 现的左、 中、 右的三路视频流） 复用在一个用户数据包协议（UDP , User Datagram Protocol )端口上， 每个 RTP流有独立的同步源标识符（ SSRC, Synchronization source )、 时间戳和包序号， 因此可以认为是多个独立的 RTP 流， 如图 1所示， 各分量媒体流之间是釆用并行传输的方式进行的。 Protocol), which multiplexes multiple component media streams (such as three-screen telepresence left, right, and right three-way video streams) with the same encoding type into a User Datagram Protocol (UDP). On the port, each RTP stream has an independent synchronization source identifier (SSRC, Synchronization source), timestamp, and packet sequence number, so it can be considered as multiple independent RTP streams, as shown in Figure 1, between each component media stream. It is done by means of parallel transmission.
但该 TIP协议的缺点是： 由于每个 RTP流有独立的包序号和时间戳，接 收端必须为每个独立的 RTP流单独做服务质量（ Qos, Quality Of Service )处 理； 多个媒体流之间的同步需要实时传输控制协议 （RTCP , RTP Control Protocol ) 的支持。 发明内容 However, the disadvantages of the TIP protocol are: Since each RTP stream has an independent packet sequence number and timestamp, the receiving end must separately perform quality of service (Qos, Quality Of Service) processing for each independent RTP stream; Inter-synchronization requires the support of the Real-Time Transport Control Protocol (RTCP, RTP Control Protocol). Summary of the invention
本发明的目的在于提供一种多媒体数据的传输方法及***， 以简化多媒 体数据的传输。  It is an object of the present invention to provide a method and system for transmitting multimedia data to simplify the transmission of multimedia data.
为了达到上述目的， 本发明釆用以下技术方案：  In order to achieve the above object, the present invention uses the following technical solutions:
一种多媒体数据的传输方法， 包括：  A method for transmitting multimedia data, comprising:
A、 创建单个 RTP信道； A. Create a single RTP channel;
B、 为多路多媒体数据流分别分配 SSRC标识；  B. respectively assigning SSRC identifiers to the multi-channel multimedia data streams;
C、 周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体数 据并依据各自对应的 SSRC标识进行 RTP打包；  C. periodically acquiring multimedia data of the same duration from the plurality of multimedia data streams and performing RTP packetization according to the corresponding SSRC identifiers;
D、 通过所述单个 RTP信道发送所述 RTP包。  D. Send the RTP packet through the single RTP channel.
可选地， 当所述多媒体数据为视频数据时， 所述步骤 C包括： 周期性地从多路所述多媒体数据流中分别同时获取一帧视频数据并依据 各自对应的 SSRC标识进行 RTP打包。  Optionally, when the multimedia data is video data, the step C includes: periodically acquiring one frame of video data from the plurality of the multimedia data streams, and performing RTP packetization according to the corresponding SSRC identifiers.
可选地， 当所述多媒体数据为音频数据时， 在所述步骤 C包括： 周期性地从多路所述多媒体数据流中分别获取相同时长的音频数据并依 据各自对应的 SSRC标识进行 RTP打包。  Optionally, when the multimedia data is audio data, the step C includes: periodically acquiring audio data of the same duration from the multiple multimedia data streams, and performing RTP packaging according to the corresponding SSRC identifiers. .
可选地， 该方法还包括：  Optionally, the method further includes:
在执行所有步骤之前， 获取多个媒体数据釆集设备对应的编码器的所述 多媒体数据。  The multimedia data of the encoder corresponding to the plurality of media data collection devices is obtained before all the steps are performed.
可选地， 所述多帧视频数据具有相同的时间戳。  Optionally, the multi-frame video data has the same time stamp.
可选地， 该方法还包括：  Optionally, the method further includes:
在执行所有步骤之后， 执行以下步骤：  After performing all the steps, perform the following steps:
E、 周期性地接收所述 RTP包；  E. periodically receiving the RTP packet;
F、 依据所述 RTP包的 RTP包头信息中的 SSRC标识信息对接收到的所 述 RTP包进行解包； G、 将解包后的媒体包发送至对应的解码器进行解码。 F. Unpack the received RTP packet according to the SSRC identification information in the RTP header information of the RTP packet. G. Send the unpacked media packet to the corresponding decoder for decoding.
可选地， 在所述步骤 G包括：  Optionally, in the step G, the method includes:
依据所述 RTP头信息中包括的所述 SSRC标识信息与通过带内或带外信 令方式传递过来的位置信息之间的对应关系将解包后的媒体包发送至对应的 解码器进行解码。  The unpacked media packet is sent to the corresponding decoder for decoding according to the correspondence between the SSRC identification information included in the RTP header information and the location information transmitted by the in-band or out-of-band signaling.
一种多媒体数据的发送装置，包括数据复合模块和数据发送模块，其中： 所述数据复合模块设置成： 从多个编码器获取多媒体数据， 周期性地从 多路所述多媒体数据流中分别获取相同时长的多媒体数据并依据各自对应的 SSRC标识进行 RTP打包， 之后将所述 RTP包发送至所述数据发送模块； 所述数据发送模块设置成： 通过一个 RTP信道发送所述 RTP包。 A device for transmitting multimedia data, comprising a data composite module and a data sending module, wherein: the data composite module is configured to: acquire multimedia data from a plurality of encoders, and periodically acquire the multimedia data streams from the plurality of channels; The multimedia data of the same duration is RTP-packed according to the corresponding SSRC identifier, and then the RTP packet is sent to the data sending module; the data sending module is configured to: send the RTP packet through an RTP channel.
可选地， 当所述多媒体数据为视频数据时， 所述数据复合模块设置成按 照以下方式周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体 数据并依据各自对应的 SSRC标识进行 RTP打包：  Optionally, when the multimedia data is video data, the data composite module is configured to periodically acquire multimedia data of the same duration from the multiple multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers. RTP packaging:
周期性地从多路所述多媒体数据流中分别同时获取一帧视频数据并依据 各自对应的 SSRC标识进行 RTP打包，  Periodically acquiring one frame of video data from the plurality of the multimedia data streams and performing RTP packing according to the corresponding SSRC identifiers.
其中， 所述多帧视频数据具有相同的时间戳。  The multi-frame video data has the same time stamp.
可选地， 当所述多媒体数据为音频数据时， 所述数据复合模块设置成按 照以下方式周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体 数据并依据各自对应的 SSRC标识进行 RTP打包：  Optionally, when the multimedia data is audio data, the data composite module is configured to periodically acquire multimedia data of the same duration from the plurality of the multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers. RTP packaging:
所述数据复合模块周期性地从多路所述多媒体数据流中分别获取相同时 长的音频数据并依据各自对应的 SSRC标识进行 RTP打包。  The data composite module periodically acquires audio data of the same duration from the plurality of multimedia data streams and performs RTP packing according to the corresponding SSRC identifiers.
一种多媒体数据的接收装置，包括数据接收模块和数据拆分模块，其中： 所述数据接收模块设置成： 周期性地接收 RTP包； A receiving device for multimedia data, comprising: a data receiving module and a data splitting module, wherein: the data receiving module is configured to: periodically receive an RTP packet;
所述数据拆分模块设置成：依据所述 RTP包的 RTP包头信息中的 SSRC 标识信息对所接收到的 RTP包进行解包，并将解包后的媒体包发送至对应的 解码器进行解码。 The data splitting module is configured to: unpack the received RTP packet according to the SSRC identifier information in the RTP header information of the RTP packet, and send the unpacked media packet to the corresponding The decoder performs decoding.
可选地， 所述接收装置还包括 Qos处理模块， 其中：  Optionally, the receiving device further includes a Qos processing module, where:
所述 Qos处理模块， 连接于所述数据接收模块与数据拆分模块之间， 设 置成： 对接收到的所述 RTP包作预处理。  The Qos processing module is connected between the data receiving module and the data splitting module, and is configured to: preprocess the received RTP packet.
可选地， 所述预处理包括： 排序、 消除网络的抖动和乱序。  Optionally, the pre-processing includes: sorting, eliminating jitter and disorder of the network.
一种多媒体数据的传输***， 包括如上所述的任意一种多媒体数据的发 送装置以及如上所述的任意一种多媒体数据的接收装置。 A transmission system of multimedia data, comprising any one of the transmission means of multimedia data as described above and any one of the means for receiving multimedia data as described above.
通过上述技术方案可以看出， 与相关技术相比， 本发明实施例的主要区 别及其有益效果在于： It can be seen from the above technical solutions that the main differences of the embodiments of the present invention and their beneficial effects are compared with the related technologies:
上述多媒体数据的传输方法， 其各分量的多媒体数据（例如视频信号） 被同步地传输， 且可以不依赖时间戳进行同步恢复， 能够非常容易地将多个 多媒体数据关联在一起， 可以避免带外的信令交互。 在多媒体数据的传输过 程中， 使用统一的时间戳和包序号简化了 Qos处理， 不必对每一路多媒体数 据流都做 Qos处理。  In the above method for transmitting multimedia data, multimedia data (for example, video signals) of each component thereof are synchronously transmitted, and synchronization recovery can be performed independently of time stamping, and it is possible to easily associate multiple multimedia data together, thereby avoiding out-of-band Signaling interaction. In the process of transmitting multimedia data, the unified time stamp and packet sequence number simplify the Qos processing, and it is not necessary to do QoS processing for each multimedia data stream.
附图概述 BRIEF abstract
图 1是 TIP协议 RTP数据流示意图；  Figure 1 is a schematic diagram of the RTP data flow of the TIP protocol;
图 2是本发明一实施例提供的多媒体数据的传输方法示意图；  2 is a schematic diagram of a method for transmitting multimedia data according to an embodiment of the present invention;
图 3是本发明一实施例提供的多媒体数据的传输***的结构示意图。 本发明目的的实现、 功能特点及优异效果， 下面将结合具体实施例以及 附图做进一步的说明。  FIG. 3 is a schematic structural diagram of a multimedia data transmission system according to an embodiment of the present invention. The implementation, functional features and advantageous effects of the object of the present invention will be further described below in conjunction with the specific embodiments and the accompanying drawings.
本发明的较佳实施方式 Preferred embodiment of the invention
下面结合附图和具体实施例对本发明所述技术方案作进一步的详细描述, 以使本领域的技术人员可以更好的理解本发明并能予以实施， 但所举实施例 不作为对本发明的限定。 本发明实施例提供的多媒体数据的传输方法， 包括如下步骤： The technical solutions of the present invention are further described in detail below in conjunction with the accompanying drawings and specific embodiments, so that those skilled in the art can understand the invention and can implement the present invention. It is not intended to limit the invention. The method for transmitting multimedia data provided by the embodiment of the present invention includes the following steps:
A、 创建单个 RTP信道；  A. Create a single RTP channel;
B、 为多路多媒体数据流分别分配 SSRC标识；  B. respectively assigning SSRC identifiers to the multi-channel multimedia data streams;
C、 周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体数 据并依据各自对应的 SSRC标识进行 RTP打包；  C. periodically acquiring multimedia data of the same duration from the plurality of multimedia data streams and performing RTP packetization according to the corresponding SSRC identifiers;
D、 通过所述单个 RTP信道发送所述 RTP包。  D. Send the RTP packet through the single RTP channel.
按照理解， 在执行所有步骤之前， 还包括如下步骤：  According to the understanding, before performing all the steps, the following steps are also included:
获取多个媒体数据釆集设备对应的编码器发送的多媒体数据， 即所述多 媒体数据是从多个媒体数据釆集设备对应的编码器获取的。 在本发明的实施 例中， 其多媒体数据的传输***包括的发送装置首先需要获取与多个媒体数 据釆集设备对应的编码器发送的多媒体数据， 再发送至对端的接收装置。  Obtaining multimedia data sent by an encoder corresponding to the plurality of media data collection devices, that is, the multimedia data is acquired from an encoder corresponding to the plurality of media data collection devices. In the embodiment of the present invention, the transmitting device of the multimedia data transmission system first needs to acquire the multimedia data sent by the encoder corresponding to the plurality of media data collecting devices, and then send the multimedia data to the receiving device at the opposite end.
具体实施方式中， 一种情况下， 当所述多媒体数据为视频数据时， 在所 述步骤 C中， 周期性地从多路所述多媒体数据中分别同时获取一帧视频数据 并依据各自对应的 SSRC标识进行 RTP打包，所述多帧多媒体数据如视频数 据具有相同的时间戳。 一般而言， 从多路多媒体数据流中分别同时获取的视 频数据具有同样地时间戳， 也具有相同的时长。  In a specific implementation, in a case, when the multimedia data is video data, in the step C, periodically acquiring one frame of video data from the plurality of the multimedia data and respectively corresponding to each The SSRC identifies RTP packetization, and the multi-frame multimedia data such as video data has the same time stamp. In general, video data acquired simultaneously from multiple multimedia data streams have the same time stamp and have the same duration.
另一种情况下， 当所述多媒体数据为音频数据时， 所述数据复合模块周 期性地从多路所述多媒体数据流中分别获取相同时长的音频数据并依据各自 对应的 SSRC标识进行 RTP打包。  In another case, when the multimedia data is audio data, the data composite module periodically acquires audio data of the same duration from the multiple multimedia data streams, and performs RTP packaging according to the corresponding SSRC identifiers. .
优选地， 在执行上述所记载的所有步骤之后， 还包括：  Preferably, after performing all the steps recited above, the method further includes:
E、 周期性地接收所述 RTP包；  E. periodically receiving the RTP packet;
F、依据 RTP包头信息中的 SSRC标识信息对所述接收到的 RTP包进行 解包；  F. Unpacking the received RTP packet according to the SSRC identification information in the RTP header information;
G、 将解包后的媒体包发送至对应的解码器进行解码。  G. Send the unpacked media packet to the corresponding decoder for decoding.
更为优选的实施方式下， 在所述步骤 G中， 依据 RTP头信息中包括的 SSRC 标识信息与通过带内或带外信令方式传递过来的位置信息之间的对应 关系将解包后的媒体包发送至对应的解码器进行解码。 In a more preferred embodiment, in the step G, the correspondence between the SSRC identification information included in the RTP header information and the location information transmitted by the in-band or out-of-band signaling manner is used. The relationship sends the unpacked media packet to the corresponding decoder for decoding.
相应地， 本发明实施例还提供了一种多媒体数据的传输***， 包括多媒 体数据的发送装置以及接收装置， 其中， Correspondingly, an embodiment of the present invention further provides a multimedia data transmission system, including a multimedia data transmitting apparatus and a receiving apparatus, where
所述发送装置包括：  The sending device includes:
数据复合模块， 用于周期性地从多路所述多媒体数据中分别获取相同时 长的多媒体数据并依据各自对应的 SSRC标识进行 RTP打包， 之后将所述 RTP包发送至数据发送模块； 其中， 所述多媒体数据是从多个媒体数据釆集 设备对应的编码器获取的。  a data multiplexing module, configured to periodically acquire multimedia data of the same duration from the plurality of the multimedia data, and perform RTP packaging according to the corresponding SSRC identifier, and then send the RTP packet to the data sending module; The multimedia data is obtained from an encoder corresponding to a plurality of media data collection devices.
数据发送模块， 用于通过一个 RTP信道发送所述 RTP包；  a data sending module, configured to send the RTP packet by using an RTP channel;
所述接收装置包括：  The receiving device includes:
数据接收模块： 用于周期性地接收 RTP包；  a data receiving module: configured to periodically receive an RTP packet;
数据拆分模块，用于依据 RTP包头信息中的 SSRC标识信息对所述接收 到的 RTP包进行解包， 并将解包后的媒体包发送至对应的解码器进行解码。  The data splitting module is configured to unpack the received RTP packet according to the SSRC identifier information in the RTP header information, and send the unpacked media packet to a corresponding decoder for decoding.
优选地， 当所述多媒体数据为视频数据时， 所述数据复合模块周期性地 从多路所述多媒体数据流中分别同时获取一帧视频数据并依据各自对应的 SSRC标识进行 RTP打包， 其中， 所述多帧视频数据具有相同的时间戳。  Preferably, when the multimedia data is video data, the data composite module periodically acquires one frame of video data from the plurality of the multimedia data streams, and performs RTP packaging according to the corresponding SSRC identifiers, where The multi-frame video data has the same time stamp.
当所述多媒体数据为音频数据时， 所述数据复合模块周期性地从多路所 述多媒体数据流中分别获取相同时长的音频数据并依据各自对应的 SSRC标 识进行 RTP打包。  When the multimedia data is audio data, the data composite module periodically acquires audio data of the same duration from the plurality of multimedia data streams and performs RTP packing according to the corresponding SSRC identifiers.
优选地， 所述接收装置还包括：  Preferably, the receiving device further includes:
Qos处理模块， 连接于所述数据接收模块与数据拆分模块之间， 用于对 接收的 RTP包作预处理。 具体实施过程中， 所述 Qos处理模块对所述 RTP 包所作的预处理包括： 排序、 消除网络的抖动和乱序。  The Qos processing module is connected between the data receiving module and the data splitting module, and is configured to perform preprocessing on the received RTP packet. In a specific implementation process, the preprocessing performed by the Qos processing module on the RTP packet includes: sorting, eliminating network jitter and out of order.
本发明实施例还提供了一种多媒体数据的传输方法， 包括： The embodiment of the invention further provides a method for transmitting multimedia data, including:
A、 创建单个 RTP信道； B、 为多路多媒体数据流分别分配 SSRC标识； A. Create a single RTP channel; B. Assigning SSRC identifiers to multiple multimedia data streams respectively;
C、 周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体数 据并依据各自对应的 SSRC标识进行 RTP打包；  C. periodically acquiring multimedia data of the same duration from the plurality of multimedia data streams and performing RTP packetization according to the corresponding SSRC identifiers;
D、 通过所述单个 RTP信道发送所述 RTP包。  D. Send the RTP packet through the single RTP channel.
可选地， 当所述多媒体数据为视频数据时， 所述步骤 C包括： 周期性地从多路所述多媒体数据流中分别同时获取一帧视频数据并依据 各自对应的 SSRC标识进行 RTP打包。  Optionally, when the multimedia data is video data, the step C includes: periodically acquiring one frame of video data from the plurality of the multimedia data streams, and performing RTP packetization according to the corresponding SSRC identifiers.
可选地， 当所述多媒体数据为音频数据时， 在所述步骤 C包括： 周期性地从多路所述多媒体数据流中分别获取相同时长的音频数据并依 据各自对应的 SSRC标识进行 RTP打包。  Optionally, when the multimedia data is audio data, the step C includes: periodically acquiring audio data of the same duration from the multiple multimedia data streams, and performing RTP packaging according to the corresponding SSRC identifiers. .
可选地， 该方法还包括：  Optionally, the method further includes:
在执行所有步骤之前， 获取多个媒体数据釆集设备对应的编码器的所述 多媒体数据。  The multimedia data of the encoder corresponding to the plurality of media data collection devices is obtained before all the steps are performed.
可选地， 所述多帧视频数据具有相同的时间戳。  Optionally, the multi-frame video data has the same time stamp.
可选地， 该方法还包括：  Optionally, the method further includes:
在执行所有步骤之后， 执行以下步骤：  After performing all the steps, perform the following steps:
E、 周期性地接收所述 RTP包；  E. periodically receiving the RTP packet;
F、 依据所述 RTP包的 RTP包头信息中的 SSRC标识信息对接收到的所 述 RTP包进行解包；  F. Unpacking the received RTP packet according to the SSRC identification information in the RTP header information of the RTP packet.
G、 将解包后的媒体包发送至对应的解码器进行解码。  G. Send the unpacked media packet to the corresponding decoder for decoding.
可选地， 在所述步骤 G包括：  Optionally, in the step G, the method includes:
依据所述 RTP头信息中包括的所述 SSRC标识信息与通过带内或带外信 令方式传递过来的位置信息之间的对应关系将解包后的媒体包发送至对应的 解码器进行解码。  The unpacked media packet is sent to the corresponding decoder for decoding according to the correspondence between the SSRC identification information included in the RTP header information and the location information transmitted by the in-band or out-of-band signaling.
本发明实施例还提供了一种多媒体数据的发送装置， 包括数据复合模块 和数据发送模块， 其中： 所述数据复合模块设置成： 从多个编码器获取多媒体数据， 周期性地从 多路所述多媒体数据流中分别获取相同时长的多媒体数据并依据各自对应的The embodiment of the invention further provides a device for transmitting multimedia data, comprising a data composite module and a data sending module, wherein: The data composite module is configured to: acquire multimedia data from a plurality of encoders, and periodically acquire multimedia data of the same duration from the plurality of the multimedia data streams, and according to respective corresponding
SSRC标识进行 RTP打包， 之后将所述 RTP包发送至所述数据发送模块； 所述数据发送模块设置成： 通过一个 RTP信道发送所述 RTP包。 The SSRC identifier performs RTP packetization, and then sends the RTP packet to the data sending module. The data sending module is configured to: send the RTP packet through an RTP channel.
可选地， 当所述多媒体数据为视频数据时， 所述数据复合模块设置成按 照以下方式周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体 数据并依据各自对应的 SSRC标识进行 RTP打包：  Optionally, when the multimedia data is video data, the data composite module is configured to periodically acquire multimedia data of the same duration from the multiple multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers. RTP packaging:
周期性地从多路所述多媒体数据流中分别同时获取一帧视频数据并依据 各自对应的 SSRC标识进行 RTP打包，  Periodically acquiring one frame of video data from the plurality of the multimedia data streams and performing RTP packing according to the corresponding SSRC identifiers.
其中， 所述多帧视频数据具有相同的时间戳。  The multi-frame video data has the same time stamp.
可选地， 当所述多媒体数据为音频数据时， 所述数据复合模块设置成按 照以下方式周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体 数据并依据各自对应的 SSRC标识进行 RTP打包：  Optionally, when the multimedia data is audio data, the data composite module is configured to periodically acquire multimedia data of the same duration from the plurality of the multimedia data streams according to the following manner, and according to respective corresponding SSRC identifiers. RTP packaging:
所述数据复合模块周期性地从多路所述多媒体数据流中分别获取相同时 长的音频数据并依据各自对应的 SSRC标识进行 RTP打包。  The data composite module periodically acquires audio data of the same duration from the plurality of multimedia data streams and performs RTP packing according to the corresponding SSRC identifiers.
本发明实施例还提供了一种多媒体数据的接收装置， 包括数据接收模块 和数据拆分模块， 其中： An embodiment of the present invention further provides a multimedia data receiving apparatus, including a data receiving module and a data splitting module, where:
所述数据接收模块设置成： 周期性地接收 RTP包；  The data receiving module is configured to: periodically receive an RTP packet;
所述数据拆分模块设置成：依据所述 RTP包的 RTP包头信息中的 SSRC 标识信息对所接收到的 RTP包进行解包，并将解包后的媒体包发送至对应的 解码器进行解码。  The data splitting module is configured to: unpack the received RTP packet according to the SSRC identifier information in the RTP header information of the RTP packet, and send the unpacked media packet to a corresponding decoder for decoding. .
可选地， 所述接收装置还包括 Qos处理模块， 其中：  Optionally, the receiving device further includes a Qos processing module, where:
所述 Qos处理模块， 连接于所述数据接收模块与数据拆分模块之间， 设 置成： 对接收到的所述 RTP包作预处理。  The Qos processing module is connected between the data receiving module and the data splitting module, and is configured to: preprocess the received RTP packet.
可选地， 所述预处理包括： 排序、 消除网络的抖动和乱序。 本发明实施例还提供了一种多媒体数据的传输***， 包括如上所述的任 意一种多媒体数据的发送装置以及如上所述的任意一种多媒体数据的接收装 置。 Optionally, the pre-processing includes: sorting, eliminating jitter and disorder of the network. The embodiment of the present invention further provides a multimedia data transmission system, including any one of the multimedia data transmitting apparatuses as described above, and any one of the multimedia data receiving apparatuses as described above.
下面将举一实施例来讲述本发明实施例提供的多媒体数据的传输方法及 ***， 从而更好的让读者理解本发明的精神。 The method and system for transmitting multimedia data provided by the embodiments of the present invention will be described below in order to better understand the spirit of the present invention.
依照本发明一实施例所述的多媒体数据的传输方法，如图 2和图 3所示， 其对应的多媒体数据的传输***至少包括： 发送装置 10和接收装置 20, 其 中：  As shown in FIG. 2 and FIG. 3, the corresponding multimedia data transmission system includes at least: a transmitting device 10 and a receiving device 20, wherein:
发送装置 10设置成：对各个分量的多媒体数据进行复合， 然后对所述多 个多媒体数据进行 RTP封装， 再发送到网络上； 接收装置 20设置成： 接收数据包， 根据 RTP头部的 SSRC信息对复合 的码流进行分离， 把分离后的数据发送给对应的解码器进行解码。  The sending device 10 is configured to: combine the multimedia data of each component, and then perform RTP encapsulation on the plurality of multimedia data, and then send the same to the network; the receiving device 20 is configured to: receive the data packet, according to the SSRC information of the RTP header. The composite code stream is separated, and the separated data is sent to the corresponding decoder for decoding.
下面以三屏远程呈现（左、 中、 右） 为例， 结合图 2和图 3进行详细说 明。 在该实施例中， 所述左、 中、 右三屏的位置信息可以通过带外方式（如 使用信令），也可以用带内方式（如使用 RTP头的 CSRC或者扩展头）传递， 上述的具体实现方式是本技术领域的普通技术人员所熟知的基础知识， 例如 SSRC和位置信息的对应关系等， 在此不再赘述。  The following is a three-screen telepresence (left, center, and right) as an example, and is described in detail in conjunction with FIGS. 2 and 3. In this embodiment, the location information of the left, middle, and right screens may be transmitted in an outband manner (such as using signaling), or in an inband manner (such as a CSRC or an extended header using an RTP header). The specific implementation is well known to those skilled in the art, such as the correspondence between the SSRC and the location information, and details are not described herein.
在本实施例中， 其多媒体数据的传输方法中包括的数据发送步骤包括步 骤 101-步骤 104:  In this embodiment, the data transmission step included in the method for transmitting multimedia data includes the steps 101 to 104:
步骤 101 : 创建媒体传输的 RTP信道， 并为左、 中、 右三屏分配 SSRC 标识。 例如， 左、 中、右三屏对应的 SSRC依次为 SSRC左、 SSRC中、 SSRC 右。  Step 101: Create an RTP channel for media transmission, and assign an SSRC identifier to the left, middle, and right screens. For example, the SSRC corresponding to the left, middle, and right screens is SSRC left, SSRC, and SSRC right.
步骤 102: 数据复合模块 101分别从编码器（左） 、 编码器（中） 、 编 码器 (右 )三屏的编码器获取一帧编码数据。  Step 102: The data composite module 101 acquires one frame of encoded data from an encoder of an encoder (left), an encoder (middle), and an encoder (right).
在该步骤中， 同一时刻釆集的三屏的编码数据具有相同的时间戳， 在逻 辑上可视为来自于同一个编码器的一帧数据， 也可以视为具有相同时间戳的 三帧数据。 为了便于 RTP打包和数据发送模块 102的处理， 在本实施例中， 可将其视为具有相同时间戳的三帧数据。 In this step, the encoded data of the three screens collected at the same time has the same time stamp, which can be logically regarded as one frame of data from the same encoder, and can also be regarded as three frames of data having the same time stamp. . In order to facilitate the processing of the RTP packing and data sending module 102, in this embodiment, Think of it as three frames of data with the same timestamp.
另外， 在该步骤中， 所述数据复合模块 101分别从编码器 （左） 、 编码 器（中）、编码器 (右）三屏的编码器获取一帧编码数据是呈周期性获取的， 即所述数据复合模块 101每隔一个固定或自定义的时间间隔分别从所述编码 器（左） 、 编码器（中） 、 编码器 (右）三屏的编码器获取一帧编码数据。  In addition, in this step, the data multiplexing module 101 obtains one frame of encoded data from the encoders of the encoder (left), the encoder (middle), and the encoder (right), respectively, which are periodically acquired, that is, The data synthesizing module 101 acquires one frame of encoded data from the encoders of the encoder (left), the encoder (middle), and the encoder (right) at every fixed or custom time interval.
步骤 103: 对所述三帧数据进行 RTP打包。  Step 103: Perform RTP packing on the three frames of data.
在本步骤中， 分别使用 SSRC左、 SSRC中、 SSRC右对编码器（左） 、 编码器（中） 、 编码器（右）屏发送的三帧数据进行 RTP打包， 所述三帧数 据具有相同的 RTP时间戳， 而 RTP包序号则按照数据发送模块 102对 RTP 包的发送顺序依次排序。  In this step, the three frames of data sent by the SSRC left, SSRC, SSRC right encoder (left), encoder (middle), and encoder (right) screens are respectively RTP-packed, and the three frames of data have the same The RTP timestamp, and the RTP packet sequence number are sequentially sorted according to the order in which the data transmission module 102 sends the RTP packets.
步骤 104: 发送所述 RTP包。  Step 104: Send the RTP packet.
另外， 多媒体数据的传输方法中包括的数据接收步骤包括步骤 201-步骤 In addition, the data receiving step included in the method for transmitting multimedia data includes step 201 - step
205: 205:
步骤 201： 数据接收模块 201接收网络上的 RTP包；  Step 201: The data receiving module 201 receives an RTP packet on the network.
步骤 202: 数据接收模块 201把接收到的 RTP包送入 Qos处理模块 202 处理 202。  Step 202: The data receiving module 201 sends the received RTP packet to the Qos processing module 202 process 202.
在本实施例中， Qos处理模块 202对 RTP包进行排序、 消除网络的抖动 和乱序， 除此之外， 不难理解， 所述 Qos处理模块 202还可以增设其他对 RTP包处理的方法， 这里对此不做——列举。  In this embodiment, the Qos processing module 202 sorts the RTP packets, eliminates the jitter and disorder of the network, and it is not difficult to understand that the Qos processing module 202 can add other methods for processing the RTP packets. I will not do this here - enumeration.
步骤 203： Qos处理模块 202输出处理后的的 RTP包并将其送入数据拆 分模块 203。  Step 203: The Qos processing module 202 outputs the processed RTP packet and sends it to the data splitting module 203.
步骤 204:数据拆分模块 203根据 RTP头信息中的 SSRC信息对 RTP包 进行解包分离。  Step 204: The data splitting module 203 unpacks and separates the RTP packet according to the SSRC information in the RTP header information.
步骤 205: 数据拆分模块 203将分离后的媒体包根据 SSRC和三屏的位 置信息的对应关系送给对应的解码器进行解码处理， 例如， 如图 3中的对应 的解码器 （左） 、 解码器（中） 、 解码器（右） 。 本发明实施例提供的多媒体数据的传输方法，其各分量的多媒体数据（例 如视频信号 )通过一个 RTP信道被同步地进行传输， 且在数据的恢复过程中 可以不依赖时间戳进行同步恢复， 能够非常容易地将多个多媒体数据关联在 一起， 可以避免带外的信令交互。 在多媒体数据的传输过程中， 对于多媒体 数据的复合过程使用统一的时间戳和包序号， 从而简化了在接收端对数据进 行恢复的过程中的 Qos处理步骤，且不必对每一路多媒体数据流都做 Qos处 理。 除此之外， 本发明实施例提供的多媒体数据的传输方法， 多个媒体数据 流之间的同步无需 RTCP的支持， 因此， 在保证功能的整体性的同时， 本发 明实施例具有可适用性更强的优点。 Step 205: The data splitting module 203 sends the separated media packet to the corresponding decoder according to the corresponding relationship between the SSRC and the position information of the three screens, for example, the corresponding decoder in FIG. 3 (left), Decoder (middle), decoder (right). The multimedia data transmission method provided by the embodiment of the present invention, the multimedia data of each component (for example, a video signal) is synchronously transmitted through an RTP channel, and the data recovery process can be synchronously restored without relying on the timestamp. It is very easy to associate multiple multimedia data together to avoid out-of-band signaling interactions. In the process of transmitting multimedia data, a unified time stamp and a packet sequence number are used for the composite process of multimedia data, thereby simplifying the Qos processing step in the process of recovering data at the receiving end, and does not have to be used for each multimedia data stream. Do Qos processing. In addition, in the method for transmitting multimedia data provided by the embodiment of the present invention, synchronization between multiple media data streams does not need RTCP support, and therefore, the embodiment of the present invention has applicability while ensuring the integrity of the function. Stronger advantage.
以上所述仅为本发明的优选实施例， 并非因此限制本发明的专利范围， 凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换， 或直接 或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。 The above description is only the preferred embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent flow transformation made by the specification and the drawings of the present invention may be directly or indirectly applied to other related The technical field is equally included in the scope of patent protection of the present invention.
工业实用 4生 Industrial and practical
上述技术方案中， 各分量的多媒体数据被同步地传输， 且可以不依赖时 间戳进行同步恢复， 能够非常容易地将多个多媒体数据关联在一起， 可以避 免带外的信令交互。 且在多媒体数据的传输过程中， 使用统一的时间戳和包 序号简化了 Qos处理， 不必对每一路多媒体数据流都做 Qos处理。 因此本发 明具有很强的工业实用性。  In the above technical solution, the multimedia data of each component is synchronously transmitted, and the synchronization recovery can be performed independently of the time stamp, and the plurality of multimedia data can be easily associated together, and the outband signaling interaction can be avoided. Moreover, in the process of transmitting multimedia data, the unified time stamp and the packet sequence number simplify the QoS processing, and it is not necessary to perform QoS processing on each multimedia data stream. Therefore, the present invention has strong industrial applicability.

Claims

1、 一种多媒体数据的传输方法， 包括： 1. A method for transmitting multimedia data, comprising:
A、 创建单个 RTP信道；  A. Create a single RTP channel;
B、 为多路多媒体数据流分别分配 SSRC标识；  B. respectively assigning SSRC identifiers to the multi-channel multimedia data streams;
C、 周期性地从多路所述多媒体数据流中分别获取相同时长的多媒体数 据并依据各自对应的 SSRC标识进行 RTP打包；  C. periodically acquiring multimedia data of the same duration from the plurality of multimedia data streams and performing RTP packetization according to the corresponding SSRC identifiers;
D、 通过所述单个 RTP信道发送所述 RTP包。  D. Send the RTP packet through the single RTP channel.
2、如权利要求 1所述的多媒体数据的传输方法， 其中， 当所述多媒体数 据为视频数据时， 所述步骤 C包括：  The method of transmitting multimedia data according to claim 1, wherein when the multimedia data is video data, the step C includes:
周期性地从多路所述多媒体数据流中分别同时获取一帧视频数据并依据 各自对应的 SSRC标识进行 RTP打包。  Periodically acquiring one frame of video data from the plurality of the multimedia data streams and performing RTP packing according to the corresponding SSRC identifiers.
3、如权利要求 1所述的多媒体数据的传输方法， 其中， 当所述多媒体数 据为音频数据时， 在所述步骤 C包括：  The method of transmitting multimedia data according to claim 1, wherein when the multimedia data is audio data, the step C includes:
周期性地从多路所述多媒体数据流中分别获取相同时长的音频数据并依 据各自对应的 SSRC标识进行 RTP打包。  The audio data of the same duration is separately acquired from the plurality of multimedia data streams and RTP packetized according to the corresponding SSRC identifier.
4、 如权利要求 1所述的多媒体数据的传输方法， 该方法还包括： 在执行所有步骤之前， 获取多个媒体数据釆集设备对应的编码器的所述 多媒体数据。  4. The method of transmitting multimedia data according to claim 1, further comprising: acquiring the multimedia data of an encoder corresponding to the plurality of media data collection devices before performing all the steps.
5、如权利要求 2所述的多媒体数据的传输方法， 其中， 所述多帧视频数 据具有相同的时间戳。  The multimedia data transmission method according to claim 2, wherein the multi-frame video data has the same time stamp.
6、如权利要求 1或 4所述的多媒体数据的传输方法， 其中， 该方法还包 括：  The method for transmitting multimedia data according to claim 1 or 4, wherein the method further comprises:
在执行所有步骤之后， 执行以下步骤：  After performing all the steps, perform the following steps:
E、 周期性地接收所述 RTP包；  E. periodically receiving the RTP packet;
F、 依据所述 RTP包的 RTP包头信息中的 SSRC标识信息对接收到的所 述 RTP包进行解包；  F. Unpacking the received RTP packet according to the SSRC identification information in the RTP header information of the RTP packet.
G、 将解包后的媒体包发送至对应的解码器进行解码。 G. Send the unpacked media packet to the corresponding decoder for decoding.
7、 如权利要求 6所述的多媒体数据的传输方法， 其中， 所述步骤 G包 括： The method for transmitting multimedia data according to claim 6, wherein the step G includes:
依据所述 RTP头信息中包括的所述 SSRC标识信息与通过带内或带外信 令方式传递过来的位置信息之间的对应关系将解包后的媒体包发送至对应的 解码器进行解码。  The unpacked media packet is sent to the corresponding decoder for decoding according to the correspondence between the SSRC identification information included in the RTP header information and the location information transmitted by the in-band or out-of-band signaling.
8、 一种多媒体数据的发送装置， 包括数据复合模块和数据发送模块， 其 中：  8. A device for transmitting multimedia data, comprising a data composite module and a data sending module, wherein:
所述数据复合模块设置成： 从多个编码器获取多媒体数据， 周期性地从 多路所述多媒体数据流中分别获取相同时长的多媒体数据并依据各自对应的 SSRC标识进行 RTP打包， 之后将所述 RTP包发送至所述数据发送模块； 所述数据发送模块设置成： 通过一个 RTP信道发送所述 RTP包。  The data composite module is configured to: acquire multimedia data from a plurality of encoders, periodically acquire multimedia data of the same duration from the plurality of multimedia data streams, and perform RTP packaging according to the corresponding SSRC identifiers, and then The RTP packet is sent to the data sending module; the data sending module is configured to: send the RTP packet through an RTP channel.
9、如权利要求 8所述的发送装置， 其中， 当所述多媒体数据为视频数据 时， 所述数据复合模块设置成按照以下方式周期性地从多路所述多媒体数据 流中分别获取相同时长的多媒体数据并依据各自对应的 SSRC标识进行 RTP 打包：  The transmitting device according to claim 8, wherein, when the multimedia data is video data, the data composite module is configured to periodically acquire the same duration from the plurality of the multimedia data streams in the following manner The multimedia data is RTP packaged according to the corresponding SSRC logo:
周期性地从多路所述多媒体数据流中分别同时获取一帧视频数据并依据 各自对应的 SSRC标识进行 RTP打包，  Periodically acquiring one frame of video data from the plurality of the multimedia data streams and performing RTP packing according to the corresponding SSRC identifiers.
其中， 所述多帧视频数据具有相同的时间戳。  The multi-frame video data has the same time stamp.
10、 如权利要求 8所述的发送装置， 其中， 当所述多媒体数据为音频数 据时， 所述数据复合模块设置成按照以下方式周期性地从多路所述多媒体数 据流中分别获取相同时长的多媒体数据并依据各自对应的 SSRC 标识进行 RTP打包：  The transmitting device according to claim 8, wherein, when the multimedia data is audio data, the data composite module is configured to periodically acquire the same duration from the plurality of the multimedia data streams in the following manner The multimedia data is RTP packaged according to their respective SSRC identifiers:
所述数据复合模块周期性地从多路所述多媒体数据流中分别获取相同时 长的音频数据并依据各自对应的 SSRC标识进行 RTP打包。  The data composite module periodically acquires audio data of the same duration from the plurality of multimedia data streams and performs RTP packing according to the corresponding SSRC identifiers.
11、 一种多媒体数据的接收装置， 包括数据接收模块和数据拆分模块， 其中：  11. A receiving device for multimedia data, comprising a data receiving module and a data splitting module, wherein:
所述数据接收模块设置成： 周期性地接收 RTP包；  The data receiving module is configured to: periodically receive an RTP packet;
所述数据拆分模块设置成：依据所述 RTP包的 RTP包头信息中的 SSRC 标识信息对所接收到的 RTP包进行解包，并将解包后的媒体包发送至对应的 解码器进行解码。 The data splitting module is configured to: according to the SSRC in the RTP header information of the RTP packet The identification information unpacks the received RTP packet, and sends the unpacked media packet to the corresponding decoder for decoding.
12、如权利要求 11所述的多媒体数据的传输***， 其中， 所述接收装置 还包括 Qos处理模块， 其中：  The multimedia data transmission system according to claim 11, wherein the receiving device further comprises a Qos processing module, wherein:
所述 Qos处理模块， 连接于所述数据接收模块与数据拆分模块之间， 设 置成： 对接收到的所述 RTP包作预处理。  The Qos processing module is connected between the data receiving module and the data splitting module, and is configured to: preprocess the received RTP packet.
13、如权利要求 12所述的多媒体数据的传输***， 其中， 所述预处理包 括： 排序、 消除网络的抖动和乱序。  The multimedia data transmission system according to claim 12, wherein the pre-processing comprises: sorting, eliminating jitter and disorder of the network.
14、 一种多媒体数据的传输***， 包括如权利要求 8-10中任一项所述的 多媒体数据的发送装置以及如权利要求 11-13 中任一项所述的多媒体数据的 接收装置。  A system for transmitting multimedia data, comprising the apparatus for transmitting multimedia data according to any one of claims 8 to 10, and the apparatus for receiving multimedia data according to any one of claims 11-13.
PCT/CN2012/077349 2011-07-08 2012-06-21 Multimedia data transmission method and system WO2013007145A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110191453.3 2011-07-08
CN201110191453.3A CN102868937A (en) 2011-07-08 2011-07-08 Method and system for transmitting multimedia data

Publications (1)

Publication Number Publication Date
WO2013007145A1 true WO2013007145A1 (en) 2013-01-17

Family

ID=47447494

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/077349 WO2013007145A1 (en) 2011-07-08 2012-06-21 Multimedia data transmission method and system

Country Status (2)

Country Link
CN (1) CN102868937A (en)
WO (1) WO2013007145A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106559158A (en) * 2015-09-29 2017-04-05 国网智能电网研究院 A kind of mobile device data exchange method based on timestamp

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104079870B (en) * 2013-03-29 2017-07-11 杭州海康威视数字技术股份有限公司 The video frequency monitoring method and system of single channel multi-channel video audio
US10305949B2 (en) 2014-10-10 2019-05-28 Sony Corporation Reception device, reception method, transmission device, and transmission method
CN105872589A (en) * 2016-03-29 2016-08-17 乐视控股（北京）有限公司 Multi-channel video playing method, multi-channel video playing server and multi-channel video playing terminal
CN107306347A (en) * 2016-04-18 2017-10-31 中国科学院宁波材料技术与工程研究所 A kind of real-time video streaming transmission method based on spliced panoramic camera
CN109257561B (en) * 2017-07-14 2021-04-30 成都鼎桥通信技术有限公司 Video decoding method, device and system
CN112073822B (en) * 2019-06-10 2022-10-18 成都鼎桥通信技术有限公司 Media change method and system in broadband trunking communication
CN111447148B (en) * 2020-03-12 2024-04-05 深圳震有科技股份有限公司 RTP data packet ordering method, system and storage medium
CN112584087B (en) * 2021-02-25 2021-05-11 浙江华创视讯科技有限公司 Video conference recording method, electronic device and storage medium
CN113542688B (en) * 2021-07-14 2023-03-28 杭州海康威视数字技术股份有限公司 Audio and video monitoring method, device, equipment, storage medium and system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101267572A (en) * 2008-04-30 2008-09-17 中兴通讯股份有限公司 A program stream conversion method and device
US20090138959A1 (en) * 2007-11-22 2009-05-28 Chae Tae Im DEVICE, SYSTEM AND METHOD FOR DROPPING ATTACK MULTIMEDIA PACKET IN THE VoIP SERVICE
WO2010049312A1 (en) * 2008-10-30 2010-05-06 Thomson Licensing Data container for transferring high resolution audio/video data in a high speed ip network
CN101924742A (en) * 2009-06-16 2010-12-22 华为技术有限公司 Media transmission method and equipment, and media storage method and equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090138959A1 (en) * 2007-11-22 2009-05-28 Chae Tae Im DEVICE, SYSTEM AND METHOD FOR DROPPING ATTACK MULTIMEDIA PACKET IN THE VoIP SERVICE
CN101267572A (en) * 2008-04-30 2008-09-17 中兴通讯股份有限公司 A program stream conversion method and device
WO2010049312A1 (en) * 2008-10-30 2010-05-06 Thomson Licensing Data container for transferring high resolution audio/video data in a high speed ip network
CN101924742A (en) * 2009-06-16 2010-12-22 华为技术有限公司 Media transmission method and equipment, and media storage method and equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106559158A (en) * 2015-09-29 2017-04-05 国网智能电网研究院 A kind of mobile device data exchange method based on timestamp
CN106559158B (en) * 2015-09-29 2018-12-04 国网智能电网研究院 A kind of mobile device data exchange method based on timestamp

Also Published As

Publication number Publication date
CN102868937A (en) 2013-01-09

Similar Documents

Publication Publication Date Title
WO2013007145A1 (en) Multimedia data transmission method and system
US8009742B2 (en) Method and system for retransmitting internet protocol packet for terrestrial digital multimedia broadcasting service
US20200029130A1 (en) Method and apparatus for configuring content in a broadcast system
US9641588B2 (en) Packets recovery system and method
CN100568971C (en) The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream
CN109194982B (en) Method and device for transmitting large file stream
US10477282B2 (en) Method and system for monitoring video with single path of video and multiple paths of audio
WO2011079763A1 (en) Method for processing forward error correction (fec) data, device and system thereof
WO2012034442A1 (en) System and method for realizing synchronous transmission and reception of scalable video coding service
CN111083425B (en) Video stream processing method, device, server, electronic equipment and storage medium
JP2009525657A5 (en)
WO2013098810A1 (en) Adaptive forward error correction (fec) system and method
JP5357839B2 (en) Transmission device and transmission program
WO2012094915A1 (en) Method and system for implementing forward error correction for streaming media
WO2012068940A1 (en) Method for monitoring terminal through ip network and mcu
US8576842B2 (en) Transmission of multi-channel MPEG
KR100631758B1 (en) Network I / F card supporting multi streaming format and method
JP2007509573A5 (en)
US9143808B2 (en) Multi-channel MPEG between headend and fiber node
GB2456709A (en) Providing IPTV multicasts
KR102001014B1 (en) Network apparatus, transmitter and packet transmitting method for next-generation terrestrial broadcasting service
WO2013098809A1 (en) Media stream rate reconstruction system and method
CA2770331A1 (en) System and method of encrypted media encapsulation
JP2015506614A (en) System and method for multiplexed streaming of multimedia content
JP2015506614A5 (en)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12811530

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12811530

Country of ref document: EP

Kind code of ref document: A1