WO2010049312A1 - Data container for transferring high resolution audio/video data in a high speed ip network - Google Patents
Data container for transferring high resolution audio/video data in a high speed ip network Download PDFInfo
- Publication number
- WO2010049312A1 WO2010049312A1 PCT/EP2009/063712 EP2009063712W WO2010049312A1 WO 2010049312 A1 WO2010049312 A1 WO 2010049312A1 EP 2009063712 W EP2009063712 W EP 2009063712W WO 2010049312 A1 WO2010049312 A1 WO 2010049312A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- field
- video
- dpx
- header
- data
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
- G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
- G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
- G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Definitions
- the invention relates to a proposal how to transfer high resolution audio/video data efficiently in an IP network. For this purpose it is defined how to embed the high resolution video/audio data combined with metadata efficiently in RTP packets. New formats for RTP packets are defined. For efficiently transporting the audio/video stream, the Digital Moving-Picture Exchange (DPX) format is utilized.
- DPX Digital Moving-Picture Exchange
- High speed networks are more and more available not only in video production sites, such as film or TV studios, but also in wide area distribution networks.
- Prominent examples are 1OG Ethernet or Infiniband. The requirements for such a network are e.g. but not exhaustive:
- Metadata e.g. Time, Audio, Video, Camera Parameters
- IP protocol stack implemented for networking and these stacks are widely available and can be more easily adapted for the studio needs. Accordingly, there is a high demand from the studios to use IP protocol for video / audio streaming.
- DPX Digital Moving Picture Exchange File Format
- MXF Material Exchange Format
- GXF General Exchange Format
- AAF Advanced Authoring Format
- the invention resides in a method for transferring high resolution audio/video data in a high speed IP network as claimed in claims 1 to 8.
- the invention also concerns an apparatus for performing the method as claimed.
- a corresponding data container format as claimed in claims 9 to 14 is also part of the invention.
- the internal usage of the DPX format simplifies the receiver side of a transmission line. All metadata is included in the DPX frame, including the filename. So the need to transmit additional metadata through an outbound channel is minimized. If the audio option is used, the synchronized playback of video and audio is simplified, too. This is because with the reception of every video frame the associated audio is received at the same time and with the same effort, buffering and sync display efforts are minimal. Because DPX supports a lot of video formats, this file format also supports a range of standard- and high-definition video formats, including common television formats such as ITU BT.601, and standards from the Society of Motion Picture and Television Engineers (SMPTE), such as SMPTE 274M and SMPTE 296M.
- SMPTE Society of Motion Picture and Television Engineers
- RTP is part of the IP protocol stack and is tailor made for transporting multi media data streams (audio, video, text, etc.) . It is a packet-oriented protocol and normally it is operated in conjunction with the User Datagram Protocol (UDP) from the IP stack.
- UDP User Datagram Protocol
- a number of RTP packet formats are already specified for diverse video formats. These include BT.656 video, DV video, SMPTE 292M video, 12-Bit DAT audio, 20- and 24-Bit linear sampled audio, PCM audio.
- the invention makes use of the possibility to add a header extension to the RTP packet header for transporting DPX frames.
- the header extension concerns a payload header, that extends the standard RTP sequence number and the standard RTP time stamp. This has the advantage that the more frames can be sent without sequence number wrap around and thus the problems with misinterpretation of the sequence number due to multiple wrap around in the stream are avoided in particular when operating at high data rates. The correct order of packets can be reconstructed with greater reliability. The accuracy of synchronization is improved by extending the time stamp field.
- time code identifies each video frame from the start of the video stream.
- flags inserted in the extra header which indicate basic characteristics of the frame, such as frame begin, frame end, and time code type.
- a further field is included in the extra header in which an offset value can be placed identifying where the first payload data is found in the RTP packet relative to the first Byte of the current DPX frame. This is an important information in case the DPX frames are transported in fragments for reconstructing the frame at the receiving end.
- the invention further resides in a data transport container for transferring audio/video data as claimed in claims 10 to 14.
- Fig. 1 an example of a professional network in the studio environment
- Fig . 2 an example of an IP protocol stack
- Fig . 4 an RTP packet format for encapsulating DPX frames
- Fig. 5 the format of an extension for field 76 of a DPX frame allowing to transport associated audio data and/or metadata
- Fig. 6 the format of an additional metadata field that is used to transmit a high resolution time stamp value
- Fig. 7 an RTP packet format for encapsulating standalone audio data
- Fig. 8 an example of an AIFF audio payload field for the RTP packet shown in Fig. 6, and
- Fig. 9 an example of a BWF audio payload field for the RTP packet shown in Fig. 6, and
- Fig. 10 the format of a metadata block according to the invention .
- the HD Video format 1920 x 108Oi with a frame rate of 24 frames per second and 10 bit colour resolution for the RGB colours requires a data rate of 1.6 Gbit/s for transferring the uncompressed video stream.
- the network technology should be ready to deal with much higher band width demands. Therefore, in one scenario the studios rely on the already existing lOGbit Ethernet network technology. This network technology is based on two optical fibres one for each direction. The wave length of the light transporting the data is between 1269 and 1356 nm.
- Fig 1 shows an example of a studio network.
- Three RTP Servers A, B, C are depicted which serve for recording audio and video content.
- the network for transporting data streams is based on 10 Gigabit Ethernet technology.
- One video camera is shown that can be connected to an RTP server for copying the data on the recording medium to the server.
- Two video editing places are shown, one inside the studio network and the other remote from the studio and connected via a large distribution network.
- IP stands for the IPv4 or IPv6 Internet Protocol.
- UDP stands for the well known User Datagram Protocol
- RTP stands for the Real-Time Transport Protocol.
- This protocol stack consists of unsecured protocol layers. All the services from the TCP protocol like acknowledging receipt of data packets and repeating of lost data packets is not implemented in the UDP/RTP protocols and in worst case the limited bandwidth would not be sufficient for it.
- the RTP protocol layer provides sequence numbering and time stamping.
- Fig. 2 shows the data flow in the classical RTP/UDP/IP protocol stack of a source device 10 as well as the corresponding IP/UDP/RTP protocol stack of a destination device 20.
- Application software in the source device 10 is denoted with reference number 101. This application delivers video data recorded by a video camera to the transport layer in the device.
- the RTP protocol implementation is denoted.
- the UDP protocol 103 follows directly below the RTP protocol layer.
- Ahead of the IP packet header, an Ethernet MAC header is also added to the IP packet. This is done in the Ethernet MAC layer 105.
- the completed Ethernet packet is transported over the lOGbit Ethernet line by means of the corresponding physical layer which is denoted with reference number 106.
- the Ethernet packet is received by the physical layer 206 in the destination device.
- An Ethernet MAC packet is evaluated in Ethernet MAC layer 205.
- From the IP packet an embedded UDP packet is extracted in the IPv4 layer 204.
- the UDP packet is delivered to the UDP protocol layer 203.
- the payload data of the UDP packet concerns an RTP packet and is forwarded to the RTP protocol layer 202 in the destination device 20.
- the payload data of the RTP packet this is the video data in uncompressed form, is delivered to the application software 201 in the destination device 20.
- the request for command RFC768 wherein the UDP protocol is specified.
- Ethernet network technology the two layers 106 and 105 respectively 206 and 205 need to be implemented in each of the devices.
- OSI/ISO model of data communication those two components relate to the data link layer and physical layer inside this model.
- a number of standards are available for Ethernet bus technology. In case of lOGbit Ethernet, it is referred to the IEEE802.3ae standard.
- Fig. 3 shows the general format of a RTP packet header.
- Three entries are marked with a dedicated reference number.
- One is the sequence number in a corresponding 16 bit field 301 and the other is a time stamp in a 32bit field 302.
- the sequence number increments by 1 for each RTP data packet sent, and may be used by the receiver to detect packet losses and to restore the packet sequence.
- the initial value of the sequence number should be random (unpredictable) to make known plaintext-attacks on encryption more difficult, even if the source itself does not use encryption, because the packets may flow through a translator that does.
- the time stamp reflects the sampling instant of the first Byte in the RTP data packet.
- the sample instant is derived from a clock that increments monotonically and linearly in time to allow synchronization in jitter calculations. If RTP packets are generated periodically, the nominal sampling instant as determined by the sampling clock is to be used, not a reading of the system clock.
- the sequence number provides for recognizing lost packets.
- An optional header extension field is marked with reference number 303. Further information about the RTP header and the RTP protocol are available from Request For Comment RFC3550, in which the RTP protocol has been standardized. The entries in the RTP packet will also be explained in further detail with reference to Fig. 4.
- the DPX file format is ideal to transport video data over a connection in streaming mode.
- the DPX header contains all necessary data to reconstruct the files with their original file names and all important video relevant metadata to process the received video. So it makes sense to transmit the DPX-files which represent a video frame per file as it is.
- Fig. 4 shows a proposal how DPX files can be transported in RTP packet/s.
- the standard RTP header is followed by a 12 -Byte payload header that extends the RTP sequence number with 2 Bytes, and the time stamp with 2 Bytes.
- a further 1 Byte field includes flags followed by a 3 Byte SMPTE time stamp and a 4 Byte offset.
- the DPX payload data follows the header data and shall be 32-bit aligned.
- Payload Type (PT) 7 bits
- This field is a dynamically allocated payload type field that designates the payload as DPX video. Timestamp: 32 bits
- the timestamp in field 402 denotes the sampling instant of the frame to which the RTP packet belongs. Packets must not include data from multiple frames, and all packets belonging to the same frame must have the same timestamp .
- a 90-kHz timestamp should be used. If higher accuracy is needed, the Extended Time Stamp RTP header extension field 404 together with the time code type (TCT) field 407 may/shall be used. A 27- MHz timestamp could be used alternatively. This is an important frequency used for video encoding.
- Marker bit (M) 1 bit
- the marker bit denotes the end of a DPX frame.
- the marker bit must be set to 1 for the last packet of the video frame/field. It must be set to 0 for other packets.
- the low-order bits for RTP sequence number are in field 401.
- the standard 16-bit sequence number is augmented with another 16 bits in field 403 of the header extension in order to avoid problems due to wrap-around when operating at high data rates.
- field 403 the high order bits of the extended 32-bit sequence number, are located in network byte order.
- Extended Time Stamp 16 bits Field 404 carries the high order bits of the extended 32-bit time stamp number, in network byte order.
- the entry in field 405 identifies the beginning of a DPX frame, It is set to 1 if the beginning of a DPX frame follows the header data, and set to 0 otherwise.
- the entry in field 407 identifies the end of a DPX frame. It is set to 1 if the last Bytes of the following payload are the last Bytes of the DPX frame. It is set to 1 if the RTP payload contains the end of a DPX frame and set to 0 otherwise.
- Time Code Type (TCT) : 2 bit
- the entry in this field 407 identifies the type of the used time code. Up to 4 different time codes can be addressed. The possible values are depicted in table 1.
- bits of field 408 are reserved for future use
- SMPTE Time Code 24 bit In field 409 is an SMPTE time code.
- the time code values of RTP packets of one DPX frame are equal. This eases the determination of the presentation time of the encapsulated DPX frame and avoids parsing into the DPX header.
- the offset field 410 identifies the offset of following payload data relative to the first Byte of the current DPX frame.
- DPX frames shall be fragmented so that the resulting RTP packet is smaller than the path MTU.
- MTU stands for maximum transmission unit that can be used on that path without fragmentation .
- Fig. 5 shows an optional extension that describes how associated audio and/or metadata may be transmitted together with video inside DPX frames.
- This specification proposes to use specified field 76 to cover associated audio and additional metadata information. To get fast access to the different components of field 76 an identifier/length header format is introduced.
- a 2 Byte field 501 contains flags that are reserved for future use .
- a 2 Byte field 502 identifies the type of the extended data. Some of the possible entries are defined in table 2 below.
- audio is transmitted with sample rates up to 192 kHz and up to 32 bit words.
- the amount of 1 Megabyte may be divided between audio data and additional metadata.
- Each additional data type shall be aligned to 32-bit boundaries.
- the additional metadata field may also be used to transmit a high resolution time stamp value. It is the same time stamp value which is located in the RTP header. This has the advantage that the information is still available and bound to the DPX frame after the RTP packet has been decoded in the receiver.
- This version of a metadata field is shown in Fig. 6. The different fields in this extension format are defined below:
- 16 bit 2 Bytes field 602 is reserved for an additional data identifier, carrying the entry 0x8020 for indicating a high resolution timer .
- the 4 Byte field 603 indicates the length of the current additional data block in Bytes.
- Field 604 is reserved for future use.
- Time Code Type (TCT) : 2 bit
- Field 605 identifies the type of the used time code. Up to 4 different time codes can be addressed (see Table 1 for definition of types) .
- Field 606 is reserved for future use.
- Field 607 contains a 48 bit high resolution time stamp value.
- audio data shall be transmitted as an own RTP stream.
- the encapsulation of audio data shall be done with the AIFF format.
- Fig. 7 shows the RTP packet format according the invention for transporting audio data in a separate stream.
- the standard RTP header is followed by an 8-Byte payload header that extends the RTP sequence number with 2 Bytes, the time stamp with 2 Bytes and a 1 Byte reserved field for flags followed by a 3 Byte SMPTE time stamp.
- the audio payload data in AIFF format (audio interchange file format) or BWAV format (broadcast wave format) follows the header data and shall be 32-bit aligned.
- Payload Type (PT) 7 bits
- Timestamp 32 bits
- the packets must not include data from multiple AIFF chunks, and all packets belonging to the same frame must have the same timestamp.
- the field is referenced with number 703.
- a 90-kHz timestamp should be used. If higher accuracy is needed, the Extended Time Stamp RTP header extension field 705 together with the time code type (TCT) field 707 may/shall be used. A 27- MHz timestamp could be used alternatively. This is an important frequency used for video encoding.
- the field 702 includes the low-order bits for an RTP sequence number.
- the standard 16-bit sequence number is augmented with another 16 bits in the payload header field 704 in order to avoid problems due to wrap-around when operating at high data rates .
- the payload header is in the header extension of the RTP packet,
- the fields of the header extension have the following meanings:
- This field 704 includes the high order bits of the extended 32- bit sequence number, in network byte order.
- This field 705 includes the high order bits of the extended 32- bit time stamp, in network byte order.
- bits in this field 706 are reserved for future use.
- Time Code Type (TCT) : 2 bit
- This field 707 includes an identifier for the type of the used time code. Up to 4 different time codes can be addressed. See Table 1 for the definition of types.
- Audio Type (AT) 2 bit
- the bits of this field 708 identify the type of the used audio format. Up to 4 different audio formats can be addressed.
- the field 709 is reserved for future use.
- the field 710 includes the SMPTE time code, see above.
- AIFF or BWF data shall be fragmented so that the resulting RTP packet is smaller than the path MTU. Because AIFF and BWF are file formats with header data which appears only once per file the following adoption to the streaming behaviour shall / may be used.
- the audio data associated to one (DPX) video frame shall be encapsulated in a valid AIFF (FORM chunk) or BWF sequence.
- Fig. 8 shows the format of a valid AIFF form chunk.
- the chunk contains AES data.
- the format is not explained in detail. For this purpose it is referred to the AIFF standard described in the document: Audio Interchange File Format "AIFF" 'A Standard for Sampled Sound Files', Version 1.3, Apple Computer, Inc., 1989.
- the extended timestamp and SMPTE time code is repeated in each chunk, see field 801 and field 802.
- Fig. 9 shows the format of a BWF WAVE format chunk.
- the format is not explained in detail. For this purpose it is referred to the document 'A format for audio data files in broadcasting. ' available under the link:
- Fig. 10 now shows a proposal for a specification how to embed the certain kind of metadata according to the SMPTE RP210 standard in field 76 of the DPX frame header.
- the special identifier for this type of data is 0x8030 which has already been listed in table 2.
- the explanation for all the different fields of Fig. 10 is given below:
- table 2 there is also an entry for experimental data. This makes it explicit which range of identifiers is reserved for experimental purpose. This range of values allows divagating definitions of identifiers that may be used in entities. It is tolerated and does not mean that there is a conflict or non- compliance to the specification or standard.
Abstract
High speed networks are available for transferring video content from video servers to workstations for post-processing like video editing, colour management etc. Most networks and a lot of software for postprocessing is available for exchanging data with Internet protocol. With high definition video it is more complicated to use IP protocols for video transport in networks due to the much higher bandwidth needs. The invention enables that high definition videos can be transported in real time transport packets that are commonly used for video streaming. The whole RTP packet format is defined and a corresponding header extension for the RTP packet header is disclosed. Furthermore, the invention concerns the idea of transporting associated metadata inside the video data, which comes in the format of DPX frames. Metadata items are specifically formatted to support an efficient parsing operation.
Description
DATA CONTAINER FOR TRANSFERRING HIGH RESOLUTION AUDIO/VIDEO DATA
IN A HIGH SPEED IP NETWORK
The invention relates to a proposal how to transfer high resolution audio/video data efficiently in an IP network. For this purpose it is defined how to embed the high resolution video/audio data combined with metadata efficiently in RTP packets. New formats for RTP packets are defined. For efficiently transporting the audio/video stream, the Digital Moving-Picture Exchange (DPX) format is utilized.
Background of the Invention
High speed networks are more and more available not only in video production sites, such as film or TV studios, but also in wide area distribution networks. Prominent examples are 1OG Ethernet or Infiniband. The requirements for such a network are e.g. but not exhaustive:
• Packetized Transport
• Low Latency
• Synchronisation Information like Audio - Video Time Stamps included
• Multiplexing of Video and related Audio Content
• Robustness Against Errors - Bit Errors shall not be visible to Upper Layers
• Easy Support by Hardware Building Blocks
• Support of Metadata (e.g. Time, Audio, Video, Camera Parameters)
Software for post processing and video editing usually have already an IP protocol stack implemented for networking and these stacks are widely available and can be more easily adapted
for the studio needs. Accordingly, there is a high demand from the studios to use IP protocol for video / audio streaming.
In studios, professional video networking means that the video content is transferred uncompressed. For HD quality, in 2k (2048 * 1080 pixels) resolution a video stream with a net data rate of 1.91 Gbit/s is resulting. Even higher data rates are resulting for 4k resolution (4096 * 2160 pixels) . For HDTV formats 1080i/720p data rates from 200 to 250 Mbit/s are resulting in studio environment (uncompressed) . This shows, what high speed networking means in this case.
In current and future production environments, metadata creation, transport and storage is a key technology to process video and audio. SMPTE is standardizing a λdata element dictionary' in the recommended practice RP210 that is adapted and embedded by the video and film industry. Today there are several proposals, how to embed mentioned metadata e.g. in HD- SDI standard. By introducing new transportation technologies based on packet oriented methods, e.g. streaming over Ethernet there are new transmission formats proposed like in EP-A-I 936 908 A2. 'Transport of digital moving picture exchange data (DPX) over high speed networks' . Here, a new proposal is necessary to embed structural metadata according the image information .
In a publication from the DVS Digital Video Systems GmbH titled "DVS Clipster Metadata Specification for DPX file" it is proposed to use a format with a magic number indicating the start of the metadata, one or more metadata blocks and 4 zero bytes indicating the end of the metadata section. This approach has a disadvantage in terms of parsing which is more complicated. Also, the metadata block length is restricted to
255 bytes. The descriptor coding is restricted to 255 sub-types of the same metadata group with the same length. Another problem is that the implementation is not conforming to SMPTE RP210.
Invention
It is an object of the invention to embed structural metadata within SMPTE 268M-2003 (DPX) format.
Different audio/video containers are available for professional video production.
One is the Digital Moving Picture Exchange File Format (DPX) . This format is standardized in SMPTE 268M. Characteristics of the format are:
• Frame based
• no explicit Audio Support
• basic Metadata Support per Frame.
Another format is the Material Exchange Format (MXF) , which is standardized in SMPTE 377M. This format has the characteristics:
• Stream based
• can cover multiple Components, e.g. Audio and Video.
More sophisticated formats are the General Exchange Format (GXF) standardized in SMPTE 360M and the Advanced Authoring Format (AAF) .
The invention resides in a method for transferring high resolution audio/video data in a high speed IP network as
claimed in claims 1 to 8. The invention also concerns an apparatus for performing the method as claimed. A corresponding data container format as claimed in claims 9 to 14 is also part of the invention.
It is one idea of the previous application, see EP-A-I 936 908 A2 of the applicant to use the DPX format for networking. In supplement to this prior application it is the idea of the present invention to embed Metadata according to SMPTE RP210 in the optional field of the DPX header. This is done in a flexible way to allow concatenation of several types of metadata items. For this the UL Header and UL Designators follow next after the Identifier/Length header of field 76 in the DPX file. This has the advantage that parsing of the metadata is easily possible, where a corresponding machine can do the job by first looking to the UL header and UL designator to determine if evaluation of this metadata is needed. If not, the parser can perform a jump to the next metadata item by taking into account the information in the length field for this metadata item.
The internal usage of the DPX format simplifies the receiver side of a transmission line. All metadata is included in the DPX frame, including the filename. So the need to transmit additional metadata through an outbound channel is minimized. If the audio option is used, the synchronized playback of video and audio is simplified, too. This is because with the reception of every video frame the associated audio is received at the same time and with the same effort, buffering and sync display efforts are minimal. Because DPX supports a lot of video formats, this file format also supports a range of standard- and high-definition video formats, including common television formats such as ITU BT.601, and standards from the Society of
Motion Picture and Television Engineers (SMPTE), such as SMPTE 274M and SMPTE 296M.
RTP is part of the IP protocol stack and is tailor made for transporting multi media data streams (audio, video, text, etc.) . It is a packet-oriented protocol and normally it is operated in conjunction with the User Datagram Protocol (UDP) from the IP stack. A number of RTP packet formats are already specified for diverse video formats. These include BT.656 video, DV video, SMPTE 292M video, 12-Bit DAT audio, 20- and 24-Bit linear sampled audio, PCM audio.
No explicit RTP packet format is available for the DPX video. In one embodiment the invention makes use of the possibility to add a header extension to the RTP packet header for transporting DPX frames. The header extension concerns a payload header, that extends the standard RTP sequence number and the standard RTP time stamp. This has the advantage that the more frames can be sent without sequence number wrap around and thus the problems with misinterpretation of the sequence number due to multiple wrap around in the stream are avoided in particular when operating at high data rates. The correct order of packets can be reconstructed with greater reliability. The accuracy of synchronization is improved by extending the time stamp field.
In addition, a further time code field is added to the extra header big enough to carry an SMPTE time code. This time code identifies each video frame from the start of the video stream.
There are a number of flags inserted in the extra header, which indicate basic characteristics of the frame, such as frame begin, frame end, and time code type.
A further field is included in the extra header in which an offset value can be placed identifying where the first payload data is found in the RTP packet relative to the first Byte of the current DPX frame. This is an important information in case the DPX frames are transported in fragments for reconstructing the frame at the receiving end.
The invention further resides in a data transport container for transferring audio/video data as claimed in claims 10 to 14.
Drawings
Embodiments of the invention are depicted in the drawings and will be explained hereinafter. The drawings show in:
Fig. 1 an example of a professional network in the studio environment;
Fig . 2 an example of an IP protocol stack;
Fig . 3 the conventional RTP packet format;
Fig . 4 an RTP packet format for encapsulating DPX frames;
Fig . 5 the format of an extension for field 76 of a DPX frame allowing to transport associated audio data and/or metadata; Fig. 6 the format of an additional metadata field that is used to transmit a high resolution time stamp value; Fig. 7 an RTP packet format for encapsulating standalone audio data; Fig. 8 an example of an AIFF audio payload field for the RTP packet shown in Fig. 6, and; Fig. 9 an example of a BWF audio payload field for the RTP packet shown in Fig. 6, and; Fig. 10 the format of a metadata block according to the invention .
Detailed Description of the Invention
Thinking about professional video production in studios, this is a field where non-linear video editing needs to be performed as well as other tasks like colour correction. This is done with workstations based on high-end personal computers and corresponding software, today. As Ethernet technology is the de facto standard in the field of computer networks, it is not surprising that there is a demand from the studios to also build their networks for post production based on Ethernet network technology. If uncompressed video data needs to be transported from a professional video camera to a data recorder, there is a very high band width needed on the network for doing the job. For example, the HD Video format 1920 x 108Oi with a frame rate of 24 frames per second and 10 bit colour resolution for the RGB colours, requires a data rate of 1.6 Gbit/s for transferring the uncompressed video stream. Including audio data and to be conform with even higher video formats like 2K or 4K, the network technology should be ready to deal with much higher band width demands. Therefore, in one scenario the studios rely on the already existing lOGbit Ethernet network technology. This network technology is based on two optical fibres one for each direction. The wave length of the light transporting the data is between 1269 and 1356 nm.
Fig 1 shows an example of a studio network. Three RTP Servers A, B, C are depicted which serve for recording audio and video content. The network for transporting data streams is based on 10 Gigabit Ethernet technology. One video camera is shown that can be connected to an RTP server for copying the data on the recording medium to the server. Two video editing places are shown, one inside the studio network and the other remote from the studio and connected via a large distribution network.
From Internet technology various protocols exist for transporting real-time data streams. In case of transferring
uncompressed data streams for HDTV video production, the reliable TCP protocol cannot be used. Instead of that, it is the IP/UDP/RTP protocol stack, shown in Fig. 2 that is available for this purpose. Hereby, IP stands for the IPv4 or IPv6 Internet Protocol. UDP stands for the well known User Datagram Protocol and RTP stands for the Real-Time Transport Protocol. This protocol stack consists of unsecured protocol layers. All the services from the TCP protocol like acknowledging receipt of data packets and repeating of lost data packets is not implemented in the UDP/RTP protocols and in worst case the limited bandwidth would not be sufficient for it. As the order of transmission of packets can also be affected when transporting the packets over the LAN, the RTP protocol layer provides sequence numbering and time stamping.
Fig. 2 shows the data flow in the classical RTP/UDP/IP protocol stack of a source device 10 as well as the corresponding IP/UDP/RTP protocol stack of a destination device 20. Application software in the source device 10 is denoted with reference number 101. This application delivers video data recorded by a video camera to the transport layer in the device. With reference number 102 the RTP protocol implementation is denoted. The UDP protocol 103 follows directly below the RTP protocol layer. Below the UDP protocol there is the IP protocol IPv4 denoted with reference number 104 depicted. Ahead of the IP packet header, an Ethernet MAC header is also added to the IP packet. This is done in the Ethernet MAC layer 105. The completed Ethernet packet is transported over the lOGbit Ethernet line by means of the corresponding physical layer which is denoted with reference number 106.
In the destination device the data flow is vice versa. The Ethernet packet is received by the physical layer 206 in the destination device. An Ethernet MAC packet is evaluated in Ethernet MAC layer 205. From the IP packet an embedded UDP
packet is extracted in the IPv4 layer 204. The UDP packet is delivered to the UDP protocol layer 203. The payload data of the UDP packet concerns an RTP packet and is forwarded to the RTP protocol layer 202 in the destination device 20. Finally, the payload data of the RTP packet, this is the video data in uncompressed form, is delivered to the application software 201 in the destination device 20. As a further reference for the purpose of the disclosure of the invention it is referred to the request for command RFC768, wherein the UDP protocol is specified.
Furthermore, it is referred to RFC791, in which the IPv4 protocol is specified. For the Ethernet network technology, the two layers 106 and 105 respectively 206 and 205 need to be implemented in each of the devices. With regard to the OSI/ISO model of data communication, those two components relate to the data link layer and physical layer inside this model. A number of standards are available for Ethernet bus technology. In case of lOGbit Ethernet, it is referred to the IEEE802.3ae standard.
Fig. 3 shows the general format of a RTP packet header. Three entries are marked with a dedicated reference number. One is the sequence number in a corresponding 16 bit field 301 and the other is a time stamp in a 32bit field 302. The sequence number increments by 1 for each RTP data packet sent, and may be used by the receiver to detect packet losses and to restore the packet sequence. The initial value of the sequence number should be random (unpredictable) to make known plaintext-attacks on encryption more difficult, even if the source itself does not use encryption, because the packets may flow through a translator that does.
The time stamp reflects the sampling instant of the first Byte in the RTP data packet. The sample instant is derived from a clock that increments monotonically and linearly in time to
allow synchronization in jitter calculations. If RTP packets are generated periodically, the nominal sampling instant as determined by the sampling clock is to be used, not a reading of the system clock. The sequence number provides for recognizing lost packets.
An optional header extension field is marked with reference number 303. Further information about the RTP header and the RTP protocol are available from Request For Comment RFC3550, in which the RTP protocol has been standardized. The entries in the RTP packet will also be explained in further detail with reference to Fig. 4.
The DPX file format is ideal to transport video data over a connection in streaming mode. The DPX header contains all necessary data to reconstruct the files with their original file names and all important video relevant metadata to process the received video. So it makes sense to transmit the DPX-files which represent a video frame per file as it is.
Fig. 4 shows a proposal how DPX files can be transported in RTP packet/s. The standard RTP header is followed by a 12 -Byte payload header that extends the RTP sequence number with 2 Bytes, and the time stamp with 2 Bytes. A further 1 Byte field includes flags followed by a 3 Byte SMPTE time stamp and a 4 Byte offset. The DPX payload data follows the header data and shall be 32-bit aligned.
The fields of the fixed RTP header have their usual meaning, with the following additional notes:
Payload Type (PT) : 7 bits
This field is a dynamically allocated payload type field that designates the payload as DPX video.
Timestamp: 32 bits
For progressive scan video, the timestamp in field 402 denotes the sampling instant of the frame to which the RTP packet belongs. Packets must not include data from multiple frames, and all packets belonging to the same frame must have the same timestamp .
A 90-kHz timestamp should be used. If higher accuracy is needed, the Extended Time Stamp RTP header extension field 404 together with the time code type (TCT) field 407 may/shall be used. A 27- MHz timestamp could be used alternatively. This is an important frequency used for video encoding.
Marker bit (M) : 1 bit
If progressive scan video is being transmitted, the marker bit denotes the end of a DPX frame. The marker bit must be set to 1 for the last packet of the video frame/field. It must be set to 0 for other packets.
Sequence Number: 16 bits
The low-order bits for RTP sequence number are in field 401. The standard 16-bit sequence number is augmented with another 16 bits in field 403 of the header extension in order to avoid problems due to wrap-around when operating at high data rates.
Extended Sequence Number: 16 bits
In field 403 the high order bits of the extended 32-bit sequence number, are located in network byte order.
Extended Time Stamp: 16 bits
Field 404 carries the high order bits of the extended 32-bit time stamp number, in network byte order.
DPX Frame Begin Identification (B) : 1 bit
The entry in field 405 identifies the beginning of a DPX frame, It is set to 1 if the beginning of a DPX frame follows the header data, and set to 0 otherwise.
DPX Frame End Identification (E) : 1 bit
The entry in field 407 identifies the end of a DPX frame. It is set to 1 if the last Bytes of the following payload are the last Bytes of the DPX frame. It is set to 1 if the RTP payload contains the end of a DPX frame and set to 0 otherwise.
Time Code Type (TCT) : 2 bit
The entry in this field 407 identifies the type of the used time code. Up to 4 different time codes can be addressed. The possible values are depicted in table 1.
TCT value Clock
00 9O kHz
01 27 MHz
10 10GbE clock
11 Rsrvd
Table 1: Video RTP Extended Time Code Type Values
Reserved bits (Resrvd) : 4 bit
The bits of field 408 are reserved for future use
SMPTE Time Code 24 bit
In field 409 is an SMPTE time code. The time code values of RTP packets of one DPX frame are equal. This eases the determination of the presentation time of the encapsulated DPX frame and avoids parsing into the DPX header.
Offset: 32 bit
The offset field 410 identifies the offset of following payload data relative to the first Byte of the current DPX frame.
Fragmentation :
DPX frames shall be fragmented so that the resulting RTP packet is smaller than the path MTU. MTU stands for maximum transmission unit that can be used on that path without fragmentation .
Fig. 5 shows an optional extension that describes how associated audio and/or metadata may be transmitted together with video inside DPX frames. This specification proposes to use specified field 76 to cover associated audio and additional metadata information. To get fast access to the different components of field 76 an identifier/length header format is introduced.
Flags: 16 bit
A 2 Byte field 501 contains flags that are reserved for future use .
Identifier: 16 bit
A 2 Byte field 502 identifies the type of the extended data. Some of the possible entries are defined in table 2 below.
Table 2: Extended Data Type Values
It is assumed, that audio is transmitted with sample rates up to 192 kHz and up to 32 bit words. The amount of 1 Megabyte may be divided between audio data and additional metadata. Each additional data type shall be aligned to 32-bit boundaries.
Length: 32 bit
In field 503 the length in Bytes of the current additional data block is identified.
The additional metadata field (DPX field 76) may also be used to transmit a high resolution time stamp value. It is the same time stamp value which is located in the RTP header. This has the advantage that the information is still available and bound to the DPX frame after the RTP packet has been decoded in the receiver. This version of a metadata field is shown in Fig. 6. The different fields in this extension format are defined below:
Flags: 16 bit
2 Bytes field 601 is reserved for flags.
Identifier: 16 bit
2 Bytes field 602 is reserved for an additional data identifier, carrying the entry 0x8020 for indicating a high resolution timer .
Length: 32 bit
The 4 Byte field 603 indicates the length of the current additional data block in Bytes.
Rsv: 2 bits
Field 604 is reserved for future use.
Time Code Type (TCT) : 2 bit
Field 605 identifies the type of the used time code. Up to 4 different time codes can be addressed (see Table 1 for definition of types) .
Reserved bits (Resrvd) : 4 bit
Field 606 is reserved for future use.
Extended Time Stamp: 48 bit
Field 607 contains a 48 bit high resolution time stamp value.
If the optional encapsulation of audio data is not feasible, audio data shall be transmitted as an own RTP stream. The encapsulation of audio data shall be done with the AIFF format.
Fig. 7 shows the RTP packet format according the invention for transporting audio data in a separate stream. The standard RTP header is followed by an 8-Byte payload header that extends the RTP sequence number with 2 Bytes, the time stamp with 2 Bytes
and a 1 Byte reserved field for flags followed by a 3 Byte SMPTE time stamp. The audio payload data, in AIFF format (audio interchange file format) or BWAV format (broadcast wave format) follows the header data and shall be 32-bit aligned.
The fields of the fixed RTP header have their usual meaning, with the following additional notes:
Payload Type (PT) : 7 bits
This is a dynamically allocated payload type field 701 that designates the payload as AIFF audio.
Timestamp: 32 bits
The packets must not include data from multiple AIFF chunks, and all packets belonging to the same frame must have the same timestamp. The field is referenced with number 703.
A 90-kHz timestamp should be used. If higher accuracy is needed, the Extended Time Stamp RTP header extension field 705 together with the time code type (TCT) field 707 may/shall be used. A 27- MHz timestamp could be used alternatively. This is an important frequency used for video encoding.
Sequence Number: 16 bits
The field 702 includes the low-order bits for an RTP sequence number. The standard 16-bit sequence number is augmented with another 16 bits in the payload header field 704 in order to avoid problems due to wrap-around when operating at high data rates .
The payload header is in the header extension of the RTP packet, The fields of the header extension have the following meanings:
Extended Sequence Number: 16 bits
This field 704 includes the high order bits of the extended 32- bit sequence number, in network byte order.
Extended Time Stamp: 16 bits
This field 705 includes the high order bits of the extended 32- bit time stamp, in network byte order.
Reserved bits (Rsv) : 2 bit
The bits in this field 706 are reserved for future use.
Time Code Type (TCT) : 2 bit
This field 707 includes an identifier for the type of the used time code. Up to 4 different time codes can be addressed. See Table 1 for the definition of types.
Audio Type (AT) : 2 bit
The bits of this field 708 identify the type of the used audio format. Up to 4 different audio formats can be addressed.
Table 3 Audio Types
Reserved bits (Resrvd) : 2 bit
The field 709 is reserved for future use.
SMPTE Time Code 24 bit
The field 710 includes the SMPTE time code, see above.
AIFF or BWF data shall be fragmented so that the resulting RTP packet is smaller than the path MTU. Because AIFF and BWF are file formats with header data which appears only once per file the following adoption to the streaming behaviour shall / may be used.
The audio data associated to one (DPX) video frame shall be encapsulated in a valid AIFF (FORM chunk) or BWF sequence.
Fig. 8 shows the format of a valid AIFF form chunk. The chunk contains AES data. The format is not explained in detail. For this purpose it is referred to the AIFF standard described in the document: Audio Interchange File Format "AIFF" 'A Standard for Sampled Sound Files', Version 1.3, Apple Computer, Inc., 1989.
As shown in Fig. 8, the extended timestamp and SMPTE time code is repeated in each chunk, see field 801 and field 802.
Fig. 9 shows the format of a BWF WAVE format chunk. The format is not explained in detail. For this purpose it is referred to the document 'A format for audio data files in broadcasting. ' available under the link:
(http; //www.ebu.ch/CMSimageG /en/tec text n22-1997 temβ-
4645.pdf) .
As shown in Fig. 9, the extended timestamp and SMPTE time code is repeated in each chunk, see field 901 and field 902.
Fig. 10 now shows a proposal for a specification how to embed the certain kind of metadata according to the SMPTE RP210 standard in field 76 of the DPX frame header. The special identifier for this type of data is 0x8030 which has already been listed in table 2. The explanation for all the different fields of Fig. 10 is given below:
Flags: 16 bit
• Reserved flags Identifier: 16 bit
Length: 32 bit
• Length in octets of the current additional data block
Unique 8-byte key SMPTE designators are embedded in the following fields with reference to SMPTE 336M-2007 and SMPTE RP210.
UL Header: 16 bit
UL Designator (first part) : 16 bit
• First part of the SMPTE designator UL Designator (second part) : 32 bit
• Second part of the SMPTE designator Item designator (first part) : 32 bit
• First part of the SMPTE item designator Item designator (second part) : 32 bit
• Second part of the SMPTE item designator Value (s)
• The key according values. For value type please refer to SMPTE RP210.
In table 2 there is also an entry for experimental data. This makes it explicit which range of identifiers is reserved for experimental purpose. This range of values allows divagating definitions of identifiers that may be used in entities. It is tolerated and does not mean that there is a conflict or non- compliance to the specification or standard.
The above specification, examples and drawings provide a complete description of the manufacture and use of the composition of the invention. Since many embodiments of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the claims herein after appended.
Claims
1. Method for transferring high resolution audio/video data in a high speed Internet protocol network, wherein the real time transport protocol RTP is used, wherein a header extension is added to the RTP packet header for audio/video streaming, wherein the video format is based on the digital moving picture exchange file format DPX, and wherein DPX formatted data is encapsulated in an RTP packet for video streaming, wherein associated metadata is also transferred in a DPX frame, wherein a header format with an identifier field (502) and a length field (503) is used for getting faster access to the different metadata items, characterized in that, a metadata item is appended to the header format with identifier and length field in the format with UL header, UL designator, item designator and value.
2. Method according to claim 1, wherein the RTP packet header extension concerns a payload header that extends the standard RTP sequence number in one field (403) and the standard RTP time stamp in another field (404) .
3. Method according to claim 1 or 2, wherein the header extension concerns a real-time time stamp field (409), in which the real-time time stamp can be inserted in particular in the form of an SMPTE time code.
4. Method according to one of claims 1 to 3, wherein the RTP packet header extension includes a control field (405 to 408) with a number of flags, indicating one or more of the following items:
• DPX frame begin identification
• DPX frame end identification
• Time code type.
5. Method according to one of claims 1 to 4, wherein the RTP packet header extension concerns an offset field (410) identifying where the first payload data of the DPX frame is found in the RTP packet.
6. Method according to one of the claims 1 to 5, wherein associated audio data is also transferred in a DPX frame.
7. Method according to one of the claims 1 to 6, wherein the specified field 76 of a DPX frame is used for inserting associated audio and/or metadata into the DPX frame.
8. Apparatus being adapted to perform the method according to one of the claims 1 to 7.
9. Data transport container for transferring audio/video data in a high speed Internet protocol network, wherein the data transport container is in the form of a valid real time transport protocol packet, a header extension is added to the RTP packet header for audio/video streaming, wherein DPX formatted data is encapsulated in an RTP packet for video streaming, wherein the video format is based on the digital moving picture exchange file format DPX, and, wherein associated metadata is also transferred in a DPX frame, wherein a header format with an identifier field (502) and a length field (503) is used for getting faster access to the different metadata items, characterized in that, a metadata item is appended to the header format with identifier and length field in the format with UL header, UL designator, item designator and value.
10. Data transport container according to claim 9, wherein the header extension concerns a payload header that extends the standard RTP sequence number and the standard RTP time stamp in one field (403) and the standard RTP time stamp in another field (404) .
11. Data transport container according to claim 10, wherein the header extension concerns a real-time timestamp (402) in particular in the form of an SMPTE time code.
12. Data transport container according to one of claims 9 to 11, wherein the header extension includes a control field (405 to 408) with a number of flags indicating one or more of the following items:
• DPX frame begin identification
• DPX frame and identification
• Time code type.
13. Data transport container according to one of claims 9 to 12, wherein the header extension also concerns an offset (410) identifying where the first payload data is found in the RTP packet .
14. Data transport container according to one of claims 10 to 16, wherein specified field 76 of a DPX frame is used for inserting associated audio and/or metadata into the DPX frame .
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP08305757.0 | 2008-10-30 | ||
EP08305757 | 2008-10-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010049312A1 true WO2010049312A1 (en) | 2010-05-06 |
Family
ID=41571095
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2009/063712 WO2010049312A1 (en) | 2008-10-30 | 2009-10-20 | Data container for transferring high resolution audio/video data in a high speed ip network |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2010049312A1 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012141648A2 (en) * | 2011-04-12 | 2012-10-18 | Telefonaktiebolaget L M Ericsson (Publ) | A method and system for transmitting data from a radio network controller to a user equipment |
CN102752669A (en) * | 2011-04-19 | 2012-10-24 | 中国电信股份有限公司 | Transfer processing method and system for multi-channel real-time streaming media file and receiving device |
WO2013007145A1 (en) * | 2011-07-08 | 2013-01-17 | 中兴通讯股份有限公司 | Multimedia data transmission method and system |
WO2014018917A1 (en) * | 2012-07-27 | 2014-01-30 | Qualcomm Incorporated | Delivering time synchronized arbitrary data in an rtp session |
CN107925620A (en) * | 2015-07-31 | 2018-04-17 | 康维达无线有限责任公司 | (S)MTC services selections in GI LAN |
JP2019033524A (en) * | 2012-04-25 | 2019-02-28 | サムスン エレクトロニクス カンパニー リミテッド | Data transmission method in multimedia system |
CN110169047A (en) * | 2017-01-11 | 2019-08-23 | 雷索恩公司 | The method that original UHD video is encoded and handled via existing HD video architecture |
CN110933513A (en) * | 2019-11-18 | 2020-03-27 | 维沃移动通信有限公司 | Audio and video data transmission method and device |
CN116980657A (en) * | 2023-09-25 | 2023-10-31 | 北京数盾信息科技有限公司 | Video data transmission processing method, device and equipment |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002051096A1 (en) * | 2000-12-18 | 2002-06-27 | Koninklijke Philips Electronics N.V. | Pointers to encrypted data in rtp header |
DE102004024946A1 (en) * | 2004-05-21 | 2005-12-15 | Heitmann, Jürgen, Dr. | Metadata recording method for digital video tape recorder involves recording the metadata in the edit gaps between sectors |
EP1936908A1 (en) * | 2006-12-19 | 2008-06-25 | Deutsche Thomson OHG | Method, apparatus and data container for transferring high resolution audio/video data in a high speed IP network |
-
2009
- 2009-10-20 WO PCT/EP2009/063712 patent/WO2010049312A1/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002051096A1 (en) * | 2000-12-18 | 2002-06-27 | Koninklijke Philips Electronics N.V. | Pointers to encrypted data in rtp header |
DE102004024946A1 (en) * | 2004-05-21 | 2005-12-15 | Heitmann, Jürgen, Dr. | Metadata recording method for digital video tape recorder involves recording the metadata in the edit gaps between sectors |
EP1936908A1 (en) * | 2006-12-19 | 2008-06-25 | Deutsche Thomson OHG | Method, apparatus and data container for transferring high resolution audio/video data in a high speed IP network |
Non-Patent Citations (2)
Title |
---|
J SCHWENK: "XML- und Webservice-Sicherheit", 28 October 2009 (2009-10-28), Germany, pages 1 - 40, XP002566072, Retrieved from the Internet <URL:http://www.nds.rub.de/media/nds/downloads/ws0910/1_2_WWW_HTML_XML_v09.pdf> [retrieved on 20100129] * |
U KEHL: "Barrierefreies Internet: 4.HTML Techniken", 18 October 2002 (2002-10-18), Halle, Germany, XP002566071, Retrieved from the Internet <URL:http://pool.urz.uni-halle.de/kurse/barrierefrei/wai-html.html> * |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012141648A2 (en) * | 2011-04-12 | 2012-10-18 | Telefonaktiebolaget L M Ericsson (Publ) | A method and system for transmitting data from a radio network controller to a user equipment |
WO2012141648A3 (en) * | 2011-04-12 | 2012-12-27 | Telefonaktiebolaget L M Ericsson (Publ) | A packet data unit, a user equipment, a radio network controller and methods therein for transmitting data from the radio network controller to the user equipment |
US9628588B2 (en) | 2011-04-12 | 2017-04-18 | Telefonaktiebolaget Lm Ericsson (Publ) | Packet data unit, a receiving communication device, a radio network controller and methods therein for transmitting data from the radio network controller to the user equipment |
CN102752669A (en) * | 2011-04-19 | 2012-10-24 | 中国电信股份有限公司 | Transfer processing method and system for multi-channel real-time streaming media file and receiving device |
CN102752669B (en) * | 2011-04-19 | 2015-09-16 | 中国电信股份有限公司 | The transfer processing method of multichannel real time flow medium file and system, receiving system |
WO2013007145A1 (en) * | 2011-07-08 | 2013-01-17 | 中兴通讯股份有限公司 | Multimedia data transmission method and system |
US10715844B2 (en) | 2012-04-25 | 2020-07-14 | Samsung Electronics Co., Ltd. | Method and apparatus for transceiving data for multimedia transmission system |
JP2019033524A (en) * | 2012-04-25 | 2019-02-28 | サムスン エレクトロニクス カンパニー リミテッド | Data transmission method in multimedia system |
US9883361B2 (en) | 2012-07-27 | 2018-01-30 | Qualcomm Incorporated | Delivering time synchronized arbitrary data in an RTP session |
CN104737515B (en) * | 2012-07-27 | 2018-06-05 | 高通股份有限公司 | The arbitrary data of Delivery time synchronization in RTP sessions |
CN104737515A (en) * | 2012-07-27 | 2015-06-24 | 高通股份有限公司 | Delivering time synchronized arbitrary data in an rtp session |
WO2014018917A1 (en) * | 2012-07-27 | 2014-01-30 | Qualcomm Incorporated | Delivering time synchronized arbitrary data in an rtp session |
CN107925620A (en) * | 2015-07-31 | 2018-04-17 | 康维达无线有限责任公司 | (S)MTC services selections in GI LAN |
CN107925620B (en) * | 2015-07-31 | 2022-01-18 | 康维达无线有限责任公司 | MTC service selection method in (S) GI-LAN |
CN110169047A (en) * | 2017-01-11 | 2019-08-23 | 雷索恩公司 | The method that original UHD video is encoded and handled via existing HD video architecture |
CN110933513A (en) * | 2019-11-18 | 2020-03-27 | 维沃移动通信有限公司 | Audio and video data transmission method and device |
CN116980657A (en) * | 2023-09-25 | 2023-10-31 | 北京数盾信息科技有限公司 | Video data transmission processing method, device and equipment |
CN116980657B (en) * | 2023-09-25 | 2023-12-26 | 北京数盾信息科技有限公司 | Video data transmission processing method, device and equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1936908A1 (en) | Method, apparatus and data container for transferring high resolution audio/video data in a high speed IP network | |
US20210351883A1 (en) | Transmission apparatus, transmission method, reception apparatus, and reception method | |
WO2010049312A1 (en) | Data container for transferring high resolution audio/video data in a high speed ip network | |
US11381625B2 (en) | Apparatus and method for transmitting multimedia data in hybrid network | |
US8750315B2 (en) | Efficiently storing transport streams | |
US20200029130A1 (en) | Method and apparatus for configuring content in a broadcast system | |
JP6330804B2 (en) | Transmission device, transmission stream transmission method and processing device | |
CN100568971C (en) | The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream | |
KR20190029551A (en) | Media data transmission apparatus and method, and media data reception apparatus and method in mmt system | |
JP2015015759A (en) | Transmission device, transmission method, reception device, and reception method | |
US8416786B2 (en) | Data transport container for transferring data in a high speed internet protocol network | |
EP1090491B1 (en) | Preprocessing method for adapting mpeg-4 data streams to the internet network | |
EP2188973B1 (en) | Method, server and client apparatuses for transferring high resolution multimedia data in a high speed network | |
EP1868342A1 (en) | Method, transmitting station and receiving station for transferring a real-time stream in a network of subscriber stations | |
US20220131921A1 (en) | Multicast to unicast conversion | |
US20220131920A1 (en) | Multicast to unicast conversion | |
EP2076041A1 (en) | Method for transferring a real-time uncompressed video stream in a network of subscriber stations | |
Kobayashi et al. | RFC3189: RTP Payload Format for DV (IEC 61834) Video |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09736967 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09736967 Country of ref document: EP Kind code of ref document: A1 |