CA2343166C - A method for integrating audiovisual coded information into one predefined, frame-structured transmission standard, as well as terminals for this purpose - Google Patents
A method for integrating audiovisual coded information into one predefined, frame-structured transmission standard, as well as terminals for this purpose Download PDFInfo
- Publication number
- CA2343166C CA2343166C CA002343166A CA2343166A CA2343166C CA 2343166 C CA2343166 C CA 2343166C CA 002343166 A CA002343166 A CA 002343166A CA 2343166 A CA2343166 A CA 2343166A CA 2343166 C CA2343166 C CA 2343166C
- Authority
- CA
- Canada
- Prior art keywords
- data
- standard
- data streams
- mpeg
- audiovisual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims description 40
- 230000011664 signaling Effects 0.000 claims description 12
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000011156 evaluation Methods 0.000 claims description 3
- 230000006854 communication Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 11
- 230000008901 benefit Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 239000003550 marker Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000007175 bidirectional communication Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000000266 injurious effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Time-Division Multiplex Systems (AREA)
- Television Systems (AREA)
- Communication Control (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
To integrate audiovisual, encoded information into one predefined, frame-structured transmission standard, individual data streams are multiplexed into one or a plurality of data channels of the frame-structured transmission standard. In addition, the capabilities of the communicating terminals are exchanged.
Description
A METHOD FOR INTEGRATING AUDIOVISUAL CODED INFORMATION INTO ONE
PREDEFINED, FRAME-STRUCTURED TRANSMISSION STANDARD, AS WELL AS
TERMINALS FOR THIS PURPOSE
Field of the Invention For the transmission of image and sound data at low bitrates for multimedia communications, on the basis of the ITU-H.324 specification, "Terminals for Low-Bitrate Multimedia Communications," a system is specified which is suited for video telephony applications.
Figure 1 depicts a block diagram of a multimedia system of this type according to the H.324 standard. In the block designated by reference numeral 1 are accommodated the modules l0 which are defined in greater detail in H.324. Video codec 2 is configured in accordance with the method in ITU-H.263/H.261. In order to smooth out any time differences between the image coding and the sound coding, a delay device 4 is connected downstream of audio codec 3 in accordance with ITU 6.723. Device 5 functions to process data protocols, e.g.
V.14 LAPM, etc., and device 6 processes control protocols in accordance with ITU H.245.
The audiovisual data is supplied to codecs 2 and 3 by appropriate I/O (Input/output) devices 7 and 8. The devices for processing protocols 5 and 6 receive their input data via devices 9 (User Data Applications) and 10 (System Control). The data streams of codecs 2, 3 and of protocol processing devices 5 and 6 are joined via multiplex/demultiplex device 11 in accordance with the H.223 standard. Modem 12, connected downstream, supplies V.34 conformal data for the 2 o combined data streams and V.25 conformal data for the system control data.
Transmission network 13 is connected to block 1, along with an appropriate network control system 14.
Summary of the Invention The method in accordance with the present invention is suitable for integrating information that is encoded in an object-based manner, in particular according to the MPEG-4 transmission standard, into one predefined, frame-structured transmission standard, in particular into an ITU
standard, and it thus makes possible the transfer of the encoded MPEG-4 data.
Accordingly, one aspect of the present invention provides a method for integrating audiovisual encoded information into a predefined frame-structured transmission standard, comprising the steps of preprocessing the audiovisual encoded information into separate data streams;
respectively supplying the audiovisual encoded information as the separate data streams;
1 o multiplexing the separate data streams into at least one data channel in the predefined frame-structured transmission standard; exchanging capabilities of terminals that communicate with one another as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and signaling, in accordance with data structures of an encoding standard, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
Another aspect of the present invention provides a terminal for a transmitter-side integrating of audiovisual encoded information into a predefined frame-structured transmission standard, comprising: an arrangement for preprocessing the audiovisual encoded information into separate data streams for the terminal; an arrangement for delivering the audiovisual encoded 2 o information as the separate data streams; an arrangement for multiplexing the separate data streams into at least one data channel of the predefined frame-structured transmission standard; an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data structures, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
A further aspect of the present invention provides a terminal for a receiver-side evaluation of audiovisual encoded information in a predefined frame-structured transmission standard, comprising: an arrangement for decomposing up at least one multiplexed frame-structured data channel of a transmission standard into individual audiovisual data streams;
an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data 1 o structures, specifications on the data type used, a decoding tool to be used, and a data capacity.
In contrast to conventional video coding methods, such as the video method discussed above in accordance with ITU-H.263/H.261 and the audio codec according to 6.723.1; the following specific advantages result:
- object-based coding of synthetic and natural visual objects as well as audio objects, - improved coding efficiency, - improved visual error-resistance of the video coding, - individualized format for describing the arrangement of audiovisual objects, - synchronization of different audiovisual objects, 2 0 - interaction with audiovisual objects.
PCT Publication No. WO 98/21846A describes multiplexing a multiplicity of substantially identical audiovisual data streams into one common intermediate data stream.
For the intermediate data streams, measures are devised for detecting errors via an appropriate signaling in an initialization phase. The intermediate data streams are grouped into one overall 2 5 data stream.
2a The publication by Lindbergh, D., entitled "The H.324 Multimedia Communication Standard,"
IEE Communications Magazine, U.S., ISS Service Center, Piscataway, NJ, Vol.
34, No. 12, December 1, 1996 (12/1/1996), pages 46-51, describes joining data streams. By exploiting data packets of a constant length in the frame structure, the error-resistance is increased.
Synchronization to the data stream after an error is possible in a simple manner. An encapsulation or even the joining of different systems can be carried out in a simple manner.
The publication Information Technology - Generic Coding of Audiovisual Objects Part 1:
System (Passage) ISO/IEC 14496-1, Final Committee Draft of International Standard, May 18, 1998, describes a similar signal joining is known.
1 o The method according to the present invention is based on two different concepts - designated below as Concept A and B. In general, each of the concepts is suitable by itself alone to secure the desired functionality - transmission of object-based coded audiovisual information -, but Concept A can be advantageous with regard to larger numbers of objects (i.e., a large number of MPEG-4 data streams). A combination of the two concepts is also possible.
Therefore, the method according to the present invention has the great advantage that -- all MPEG-4 data streams -- for example, when a large number of objects are used -can be packetized using the MPEG-4 FIexMux specification, into one data stream, which contains all of the information for decoding (Concept A), and /or - a bi-directional communication can be carried out based on the total of MPEG-4 functionalities, without requiring expensive additional 2 o adjustments of the MPEG-4 data to the formats of the communications standard. This is made possible through the consistent exploitation of the mechanisms made available by the multimedia communications H.324 standard (Concept B).
Furthermore, in the exchange of capabilities and in the opening of a transmission channel, the same data structures are used which designate the type of data stream to be transmitted, the 2b coding tools used, and their parameters, such as the data capacity.
Through the application of data packets of a constant length (in Concept A) or through the exploitation of the frame structure of the multiplex H.223 standard embedded in H.324 (in Concept B), error-resistance is increased. Synchronization to the data stream after an error is possible in a simple manner. An encapsulation or even the joining of different systems, e.g., a 2c combination of an H.324 platform and an MPEG-4 platform, can be carried out in a simple manner.
Brief Description of the Drawings Figure 1 depicts a block diagram of a multimedia system according to the H.324 standard.
Figure 2a depicts a first block diagram of MPEG-4 multimedia systems based on an H.324 terminal.
Figure 2b depicts a second block diagram of MPEG-4 multimedia systems based on an H.324 terminal.
Figure 3 depicts the setup of a FIexMux protocol in simple mode having a constant length.
l0 Figure 4 depicts the setup of a FIexMux protocol in Mux mode having a constant length.
Figure 5 depicts an Adaption Layer Frame in accordance with ITU H.223.
Figure 6 depicts the nesting of the data of the logical ITU channels.
Figure 7 depicts the header format.
Figure 8 depicts an example for a Multiplex Entry Descriptor.
Figure 9 depicts the integrating of packets of a constant length into the ITU
Adaption Layer of variable length.
Detailed Description Before the method according to the present invention is described in detail, for the sake of greater intelligibility, the standards used will be briefly specified:
2 o The ITU-H.324 standard specifies a terminal which is composed of a video codec in accordance with H.261/H.263, an audio codec in accordance with 6.723, a multiplexer in accordance with H.223, and a control protocol in accordance with H.245. The setup and the assembly of the individual components is described in this standard.
PREDEFINED, FRAME-STRUCTURED TRANSMISSION STANDARD, AS WELL AS
TERMINALS FOR THIS PURPOSE
Field of the Invention For the transmission of image and sound data at low bitrates for multimedia communications, on the basis of the ITU-H.324 specification, "Terminals for Low-Bitrate Multimedia Communications," a system is specified which is suited for video telephony applications.
Figure 1 depicts a block diagram of a multimedia system of this type according to the H.324 standard. In the block designated by reference numeral 1 are accommodated the modules l0 which are defined in greater detail in H.324. Video codec 2 is configured in accordance with the method in ITU-H.263/H.261. In order to smooth out any time differences between the image coding and the sound coding, a delay device 4 is connected downstream of audio codec 3 in accordance with ITU 6.723. Device 5 functions to process data protocols, e.g.
V.14 LAPM, etc., and device 6 processes control protocols in accordance with ITU H.245.
The audiovisual data is supplied to codecs 2 and 3 by appropriate I/O (Input/output) devices 7 and 8. The devices for processing protocols 5 and 6 receive their input data via devices 9 (User Data Applications) and 10 (System Control). The data streams of codecs 2, 3 and of protocol processing devices 5 and 6 are joined via multiplex/demultiplex device 11 in accordance with the H.223 standard. Modem 12, connected downstream, supplies V.34 conformal data for the 2 o combined data streams and V.25 conformal data for the system control data.
Transmission network 13 is connected to block 1, along with an appropriate network control system 14.
Summary of the Invention The method in accordance with the present invention is suitable for integrating information that is encoded in an object-based manner, in particular according to the MPEG-4 transmission standard, into one predefined, frame-structured transmission standard, in particular into an ITU
standard, and it thus makes possible the transfer of the encoded MPEG-4 data.
Accordingly, one aspect of the present invention provides a method for integrating audiovisual encoded information into a predefined frame-structured transmission standard, comprising the steps of preprocessing the audiovisual encoded information into separate data streams;
respectively supplying the audiovisual encoded information as the separate data streams;
1 o multiplexing the separate data streams into at least one data channel in the predefined frame-structured transmission standard; exchanging capabilities of terminals that communicate with one another as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and signaling, in accordance with data structures of an encoding standard, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
Another aspect of the present invention provides a terminal for a transmitter-side integrating of audiovisual encoded information into a predefined frame-structured transmission standard, comprising: an arrangement for preprocessing the audiovisual encoded information into separate data streams for the terminal; an arrangement for delivering the audiovisual encoded 2 o information as the separate data streams; an arrangement for multiplexing the separate data streams into at least one data channel of the predefined frame-structured transmission standard; an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data structures, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
A further aspect of the present invention provides a terminal for a receiver-side evaluation of audiovisual encoded information in a predefined frame-structured transmission standard, comprising: an arrangement for decomposing up at least one multiplexed frame-structured data channel of a transmission standard into individual audiovisual data streams;
an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data 1 o structures, specifications on the data type used, a decoding tool to be used, and a data capacity.
In contrast to conventional video coding methods, such as the video method discussed above in accordance with ITU-H.263/H.261 and the audio codec according to 6.723.1; the following specific advantages result:
- object-based coding of synthetic and natural visual objects as well as audio objects, - improved coding efficiency, - improved visual error-resistance of the video coding, - individualized format for describing the arrangement of audiovisual objects, - synchronization of different audiovisual objects, 2 0 - interaction with audiovisual objects.
PCT Publication No. WO 98/21846A describes multiplexing a multiplicity of substantially identical audiovisual data streams into one common intermediate data stream.
For the intermediate data streams, measures are devised for detecting errors via an appropriate signaling in an initialization phase. The intermediate data streams are grouped into one overall 2 5 data stream.
2a The publication by Lindbergh, D., entitled "The H.324 Multimedia Communication Standard,"
IEE Communications Magazine, U.S., ISS Service Center, Piscataway, NJ, Vol.
34, No. 12, December 1, 1996 (12/1/1996), pages 46-51, describes joining data streams. By exploiting data packets of a constant length in the frame structure, the error-resistance is increased.
Synchronization to the data stream after an error is possible in a simple manner. An encapsulation or even the joining of different systems can be carried out in a simple manner.
The publication Information Technology - Generic Coding of Audiovisual Objects Part 1:
System (Passage) ISO/IEC 14496-1, Final Committee Draft of International Standard, May 18, 1998, describes a similar signal joining is known.
1 o The method according to the present invention is based on two different concepts - designated below as Concept A and B. In general, each of the concepts is suitable by itself alone to secure the desired functionality - transmission of object-based coded audiovisual information -, but Concept A can be advantageous with regard to larger numbers of objects (i.e., a large number of MPEG-4 data streams). A combination of the two concepts is also possible.
Therefore, the method according to the present invention has the great advantage that -- all MPEG-4 data streams -- for example, when a large number of objects are used -can be packetized using the MPEG-4 FIexMux specification, into one data stream, which contains all of the information for decoding (Concept A), and /or - a bi-directional communication can be carried out based on the total of MPEG-4 functionalities, without requiring expensive additional 2 o adjustments of the MPEG-4 data to the formats of the communications standard. This is made possible through the consistent exploitation of the mechanisms made available by the multimedia communications H.324 standard (Concept B).
Furthermore, in the exchange of capabilities and in the opening of a transmission channel, the same data structures are used which designate the type of data stream to be transmitted, the 2b coding tools used, and their parameters, such as the data capacity.
Through the application of data packets of a constant length (in Concept A) or through the exploitation of the frame structure of the multiplex H.223 standard embedded in H.324 (in Concept B), error-resistance is increased. Synchronization to the data stream after an error is possible in a simple manner. An encapsulation or even the joining of different systems, e.g., a 2c combination of an H.324 platform and an MPEG-4 platform, can be carried out in a simple manner.
Brief Description of the Drawings Figure 1 depicts a block diagram of a multimedia system according to the H.324 standard.
Figure 2a depicts a first block diagram of MPEG-4 multimedia systems based on an H.324 terminal.
Figure 2b depicts a second block diagram of MPEG-4 multimedia systems based on an H.324 terminal.
Figure 3 depicts the setup of a FIexMux protocol in simple mode having a constant length.
l0 Figure 4 depicts the setup of a FIexMux protocol in Mux mode having a constant length.
Figure 5 depicts an Adaption Layer Frame in accordance with ITU H.223.
Figure 6 depicts the nesting of the data of the logical ITU channels.
Figure 7 depicts the header format.
Figure 8 depicts an example for a Multiplex Entry Descriptor.
Figure 9 depicts the integrating of packets of a constant length into the ITU
Adaption Layer of variable length.
Detailed Description Before the method according to the present invention is described in detail, for the sake of greater intelligibility, the standards used will be briefly specified:
2 o The ITU-H.324 standard specifies a terminal which is composed of a video codec in accordance with H.261/H.263, an audio codec in accordance with 6.723, a multiplexer in accordance with H.223, and a control protocol in accordance with H.245. The setup and the assembly of the individual components is described in this standard.
The ITU-H.223 standard specifies a packet-oriented multiplex protocol for multimedia communications at low bitrates. It is used for the transmission of low bitrates between two multimedia terminals or between one terminal and a multipoint unit. The protocol makes possible the transmission of any combination of audio, video, and data information via one individual communications channel. The protocol is characterized by "low-delay" and low overhead. The protocol procedures for implementing the multiplex protocol are 3a specified in the H.245 standard.
The ITU-H. 245 standard, "Control Protocol for Multimedia Communication,"
specifies the syntax and the semantics of terminal information and messages as well as the procedures for 6 the communications setup. The messages make possible the exchange of terminal capacities/capabilities, e.g., terminal A signals to terminal B that it can decode video data and which methods it supports.
Furthermore, a protocol is specified, permitting the reliable transmission of audiovisual data via an Acknowledge Message (terminal A signals to terminal B the correct reception of the data packet).
The ITU-H.263/H.261 specifies the coding of compressed video data for channels at low bitrates.
The 6.723.1 standard specifies the decoding of compressed audio data for channels of low bitrates.
For the transmission of MPEG-4 data using the H.245 standard, the following steps are required:
1. First, a capability exchange of the communicating terminals takes place in order to make possible reciprocal communication. The data transmission takes place in logical channel 0, corresponding to H.245, provided for this purpose.
2. Next, the MPEG-4 decoders are configured. The specific MPEG-4 information required for this purpose, such as the Initial Object Descriptor, is transmitted either via H.24~, in particular logical channel 0, or via a separate logical ITU channel, in particular a logic channel not equal to 0, in accordance with the ITU-H.223 standard.
3. Then, using the H.245 standard, the individual logical channels are opened for transmitting the audiovisual data streams.
Regarding 1: Capability Exchange NY01 355243 v 1 For the capability exchange, it is sufficient to define an MPEG-4 capability within H.245, which can look as follows:
Is14496Capability {
streamType INTEGER (0..255) ProfileIndication INTEGER (0..255) LevelIndication INTEGER (0..255) }
or Is 14496Capability streamType INTEGER (0..255) DecoderSpecificInfo OCTET STRING OPTIONAL
or Is 14496Capability {
decConfDescr DecoderConfigDescriptor The individual fields of the above data structures are discussed in greater detail in the MPEG-4 documents (ISO/IEC 14496). The advantage of this Capability Definition is based on the low data overhead and a reference to the specification within the MPEG-4 standard, therefore avoiding an overhead in additional definitions in the H.245 standard. The streamType defines the type (i.e., the content) of the data stream, the Profile Indicator defines the decoder tools, and the level defines the parameters of these decoder tools. Among other things, these parameters are contained within MPEG-4, with the exception of the Level Indication, which has yet to be specified by MPEG.
In Concept B, using the "data type" field when a logical channel is opened using the H.245 function, OpenLogicalChannel, the is14496Capability also functions to indicate the MPEG-4 NY01 355243 v 1 5 data type transmitted in this channel.
Regarding 2: Configuration of the Decoders After the terminal capabilities have been defined using the Capability Exchange, the configuration of the decoders is carned out through the transmission of the Initial Object Descriptors or of the Object Descriptors. This takes place either using a request/confirm command in accordance with H.245, within which the Initial Object Descriptors are exchanged, or by opening a new logical ITU channel, which only contains the Initial Object Descriptor or the SL-packetized Object Descriptor stream.
Regarding 3: Opening the Logical Channels and Data Transmission After the configuration, the individual ITU channels are opened. In general, the following applies:
The audiovisual coded information, in particular in accordance with MPEG-4, is processed in separate data streams. An encoder, which generates an MPEG-4 conformal data stream, already delivers at its output a plurality of these separate data streams, in particular SL
(Synchronization Layer)-packetized data streams. In Figure 2a and Figure 2b, the elementary data streams (El. Streams) are depicted at the "Elementary Stream Interface"
of the Sync (synchronization) layer. In this regard, it should be noted that the header of the SL packets can also be configured at "zero" -- i.e.., omitted. Within this "Sync Layer,"
the packetizing of the elementary data streams takes place, which then can be picked off at the "Stream Multiplex Interface" for further processing.
According to Concept B, opening a logical channel takes place using the OpenLogicalChannel Message defined in H.245. In opening the specific logical channel, the "portNumber" field functions for the signaling of the assigned elementary data stream identification (ES ID), using which the data streams are referenced on the MPEG-4 side.
Using the "streamType" field, to which is assigned here the value of an Is14496Capability (thus the same data structures can be used as in the case of the Capability Exchange), in this context, the content of a logical channel (i.e., the MPEG-4 object type) is explicitly indicated NY01 355243 v 1 6 in each case. In the actual -- then subsequent -- data transmission, in Concept B, each individual SL-packetized MPEG-4 data stream is picked off at the "Stream Multiplex Interface" and is transmitted in a lojical ITU channel. For this purpose, the SL-packetized MPEG-4 data streams are further processed by the H.233 AdaptationLayer as AL-SDU
S packets and are multiplexed using the H.223 standard (exemplary embodiment according to Figure 2a). This acceptance of the MPEG-4 framing of the data into a framing in accordance with H.223 (SL-PDU: = AL-SDU) increases the error-resistance and makes possible a simple resynchronization in the event that a packet was transmitted in an erroneous fashion. In addition, as a result, an otherwise additional adaptation of the MPEG-4 data format to the format of the multiplexer is avoided. Concept B makes possible the (later) dynamic adding of further MPEG-4 data streams.
For the conversion of Concept A, individual data streams are multiplexed into a total of only one data stream using the MPEG-4 FlexMux and are transmitted in a total of one logical ITLT
1 ~ channel (exemplary embodiment in accordance with Figure 2b). For this type of transmission of MPEG-4 data streams using the FlexMux, additional Descriptors are defined, which make possible the connection setup. Only using these Descriptors is the recognition of the individual MPEG-4 data streams possible. These MPEG-4-specific data streams are multiplexed using the MPEG-4 FlexMux tools. In this context, the use of packets of a constant length is defined, as a result of which the error-resistance is increased. In this manner, synchronization to the data stream after an error is possible.
Below, Concept A is described in detail.
2~ As Figure 2b shows, the following logical MPEG-4 objects (SL-packetized data streams) can be multiplexed using the MPEG-4 FlexMux tools into one transmission frame and can be transmitted in one logical ITU channel AL1:
S L-audio, SL-video, SL-OCR (Object Clock Reference), SL-OD (Object Descriptor), SL-OCI (Object Content Information).
NY01 355243 v 1 In one easy transformation of Concept A, it is also possible to multiplex data exclusively of the same type (e.g., either only SL-audio or only SL-video) into one logical channel using the FlexMux tools, i.e., to transmit the entirety of the MPEG-4 data streams in a plurality (although less than in Concept B) of logical ITU channels. Under certain circumstances, this would make possible a simpler separation and decoding of the multiplexed data in the receiver. However, the original Concept A, i.e., the multiplexing of all MPEG
data streams into one logical ITU channel using the FlexMux tools is considered below.
Concept A (just as Concept B) makes possible the transmission of a plurality of MPEG-4 data streams of the same type, such as the transmission of a plurality of audio streams for an image-accompanying sound in different languages.
For the method in accordance with Concept A, MUXCODETABLE_Entry is transmitted during the initialization phase in order to configure the MPEG-4 FIexMux.
In the end, the stipulated assignment of the individual ES streams to the data to be multiplexed is communicated to the MPEG-4 decoder. This is achieved using a Channel Map Table (also known as Stream Map Table).
In addition to the Object Descriptors, these two information messages are used for the decoding.
In order to insert the additional information messages MUXCODETABLE Entry and 2~ Channel Map Table into the Initial Object Descriptor, the definition of the new Descriptors is used. The latter are inserted in the form of Extension Descriptors into the Initial Object Descriptor.
Class Channel Map Table Descriptor: bit (8) tag = to be defined bit(16) length:
bit (15) streamCount:
bit (1) MultiplexCodeFlag;
NY01 355243 v 1 For (i=0; i<streamCount; i++{
bit (16) ES ID;
bit (8) FlexMuxChannel;
IFMultiplexCodeFlag {
S
bit (4) MultiplexCode;
bit (4) reserved:;
) The part printed in bold indicates the Descriptor that is newly defined here.
Similarly, the setup of a MuxCodeTableEntryDescriptor can be carned out:
Class MuxCodeTableEntryDescriptor: bit (8) tag = to be defined bit ( 16) length bit (4) number of MuxCodeTableEntries;
bit (1) constantLengthFlag;
bit (3) reserved;
IF constantLengthFlag bit(8) FlexMuxLength;
For (j=0; j<numberOfMuxCodeTableEntries; j++{
bit (8) length;
bit (4) MuxCode;
bit (4) version;
bit (8) substructureCount;
for (I~; i<substructureCount; I++) bit (5) slotCount;
bit (3) repetitionCount;
for (k=0; k<slotCount; k++) NY01 355243 v 1 bit (8) FlexMuxChannel (I) (k);
bit (8) numberOfBytes (I) (k);
The part printed in bold indicates the Descriptor newly defined here. The data field numberOfiYIuxCodeTableEntries makes it possible to transmit the maximum of 16 MuxCodeTableEntries. Using the constantLengthFlag and the field FlexMuxLength, it is signaled to the receiver that the FlexMux packets having a constant length are transmitted in the packet size FlexMuxLength + 2.
The FlexMux packets defined in MPEG-4 are transmitted, on the one hand, in the simple mode in accordance with Figure 3 and, on the other hand, in the MuxCode in accordance with 1 ~ Figure 4.
By using packets of a constant, nonlinear length, here 127 bytes, the upper 7 bits of the Length field can be used for synchronization.
This increases the error-resistance and makes possible a resynchronization in the event that a Length field of one packet is faulty.
These FIexMux packets are now merged into one ITU frame. In Figure 5, an Adaptation Layer (AL) frame in accordance with ITU-H.223 is depicted, having an AL-PDU
(Protocol Data Unit) Payload Field. Due to the variable length of a FlexMux packet, it would no longer be possible to locate a new FlexMux packet after an error in the length field.
This is particularly injurious if a plurality of MPEG-4 elementary streams (e.g., BIFS, OD, and video) are transmitted in one ITU channel.
By using constant lengths within the MPEG-4 FIexMux packets, according to the present invention this is now possible.
By using a constant length within the MPEG-4 FlexMux packet, this is now possible according to the present invention.
The individual AL-PDU packets of variable lengths are now packetized using the NY01 355243 v 1 1 ~
multiplexes.
The setup of the Multiplexed Layer and the basic integrating of the MPEG-4 FlexMux data stream are briefly discussed.
A MUX Protocol Data Unit (MUX-PDU) is composed of a header and an information field, in nesting the data of the individual logical ITU channels. Figure 6 depicts the setup.
The header is composed of individual fields, which are shown in Figure 1.
The 4-bit-large Multiplex Code indicates a MultiplexEntry transmitted over H.245, of which a maximum of 15 different ones can be defined.
The header Error Control Field is a 3-bit-large CRC Field, which permits error detection in the header.
The 1-bit packet Marker Field marks the end of a MUX-SDU of a segmented logical channel.
The information field shown in Figure 6 is configured using the MultiplexTable transmitted in H.245.
The information field can at any time be closed at an Octet Border using a Closing Flag, but a MUX-SDU may not be interrupted by a non-segmentable channel.
The MultiplexEntryDescriptor configures the H.223 Multiplexes and is transmitted in the initialization phase (Figure 8).
In this Figure, LCN denotes: LogicalChannelNumber; RC: RepeatCount; UCF:
UntilClosingFlag.
The advantage is made clear in Figure 9:
if, in an ITU channel, a plurality of MPEG data are transmitted and MPEG-4 packets of variable length are used, then none of the following FlexMuxPackets can any longer be decoded. The skillful use of the Length field as a synchronization marker makes possible the synchronization of the receiver.
NY01 355243 v 1 1 1 The transmitting terminal signals the packet length to the receiving terminal using the MuxCodeTableEntryDescriptor deFned here, which is designated by a flag, which signals the use of FlexMux packets of a constant length and which also contains a field that establishes the length to be used. In this manner, high flexibility, in conjunction with great error-S resistance, is assured.
Of course, the present invention does not have to be used only for MPEG-4 data, but may also be used for other audiovisual coded information which is to be merged into one standardized transmission frame and whose decoding is to take place in a manner that is simple and resistant to errors.
Of course, the method presented can be realized in transmitter-side and receiver-side terminals. For transmitter-side integrating, the appropriate element is provided for preparing, or for delivering, audiovisual coded information, as well as an appropriate element for multiplexing the data streams, exchanging the capabilities, and signaling . For the receiver-side evaluation, what is desirable is a way for decomposing up the multiplexed data channels as well as means for exchanging capabilities and their valuation, as well as for evaluating the signaling. Since usually work is done in the interactive mode, subscriber terminals are furnished both for transmitting as well as for receiving operation.
NY01 355243 v 1 12
The ITU-H. 245 standard, "Control Protocol for Multimedia Communication,"
specifies the syntax and the semantics of terminal information and messages as well as the procedures for 6 the communications setup. The messages make possible the exchange of terminal capacities/capabilities, e.g., terminal A signals to terminal B that it can decode video data and which methods it supports.
Furthermore, a protocol is specified, permitting the reliable transmission of audiovisual data via an Acknowledge Message (terminal A signals to terminal B the correct reception of the data packet).
The ITU-H.263/H.261 specifies the coding of compressed video data for channels at low bitrates.
The 6.723.1 standard specifies the decoding of compressed audio data for channels of low bitrates.
For the transmission of MPEG-4 data using the H.245 standard, the following steps are required:
1. First, a capability exchange of the communicating terminals takes place in order to make possible reciprocal communication. The data transmission takes place in logical channel 0, corresponding to H.245, provided for this purpose.
2. Next, the MPEG-4 decoders are configured. The specific MPEG-4 information required for this purpose, such as the Initial Object Descriptor, is transmitted either via H.24~, in particular logical channel 0, or via a separate logical ITU channel, in particular a logic channel not equal to 0, in accordance with the ITU-H.223 standard.
3. Then, using the H.245 standard, the individual logical channels are opened for transmitting the audiovisual data streams.
Regarding 1: Capability Exchange NY01 355243 v 1 For the capability exchange, it is sufficient to define an MPEG-4 capability within H.245, which can look as follows:
Is14496Capability {
streamType INTEGER (0..255) ProfileIndication INTEGER (0..255) LevelIndication INTEGER (0..255) }
or Is 14496Capability streamType INTEGER (0..255) DecoderSpecificInfo OCTET STRING OPTIONAL
or Is 14496Capability {
decConfDescr DecoderConfigDescriptor The individual fields of the above data structures are discussed in greater detail in the MPEG-4 documents (ISO/IEC 14496). The advantage of this Capability Definition is based on the low data overhead and a reference to the specification within the MPEG-4 standard, therefore avoiding an overhead in additional definitions in the H.245 standard. The streamType defines the type (i.e., the content) of the data stream, the Profile Indicator defines the decoder tools, and the level defines the parameters of these decoder tools. Among other things, these parameters are contained within MPEG-4, with the exception of the Level Indication, which has yet to be specified by MPEG.
In Concept B, using the "data type" field when a logical channel is opened using the H.245 function, OpenLogicalChannel, the is14496Capability also functions to indicate the MPEG-4 NY01 355243 v 1 5 data type transmitted in this channel.
Regarding 2: Configuration of the Decoders After the terminal capabilities have been defined using the Capability Exchange, the configuration of the decoders is carned out through the transmission of the Initial Object Descriptors or of the Object Descriptors. This takes place either using a request/confirm command in accordance with H.245, within which the Initial Object Descriptors are exchanged, or by opening a new logical ITU channel, which only contains the Initial Object Descriptor or the SL-packetized Object Descriptor stream.
Regarding 3: Opening the Logical Channels and Data Transmission After the configuration, the individual ITU channels are opened. In general, the following applies:
The audiovisual coded information, in particular in accordance with MPEG-4, is processed in separate data streams. An encoder, which generates an MPEG-4 conformal data stream, already delivers at its output a plurality of these separate data streams, in particular SL
(Synchronization Layer)-packetized data streams. In Figure 2a and Figure 2b, the elementary data streams (El. Streams) are depicted at the "Elementary Stream Interface"
of the Sync (synchronization) layer. In this regard, it should be noted that the header of the SL packets can also be configured at "zero" -- i.e.., omitted. Within this "Sync Layer,"
the packetizing of the elementary data streams takes place, which then can be picked off at the "Stream Multiplex Interface" for further processing.
According to Concept B, opening a logical channel takes place using the OpenLogicalChannel Message defined in H.245. In opening the specific logical channel, the "portNumber" field functions for the signaling of the assigned elementary data stream identification (ES ID), using which the data streams are referenced on the MPEG-4 side.
Using the "streamType" field, to which is assigned here the value of an Is14496Capability (thus the same data structures can be used as in the case of the Capability Exchange), in this context, the content of a logical channel (i.e., the MPEG-4 object type) is explicitly indicated NY01 355243 v 1 6 in each case. In the actual -- then subsequent -- data transmission, in Concept B, each individual SL-packetized MPEG-4 data stream is picked off at the "Stream Multiplex Interface" and is transmitted in a lojical ITU channel. For this purpose, the SL-packetized MPEG-4 data streams are further processed by the H.233 AdaptationLayer as AL-SDU
S packets and are multiplexed using the H.223 standard (exemplary embodiment according to Figure 2a). This acceptance of the MPEG-4 framing of the data into a framing in accordance with H.223 (SL-PDU: = AL-SDU) increases the error-resistance and makes possible a simple resynchronization in the event that a packet was transmitted in an erroneous fashion. In addition, as a result, an otherwise additional adaptation of the MPEG-4 data format to the format of the multiplexer is avoided. Concept B makes possible the (later) dynamic adding of further MPEG-4 data streams.
For the conversion of Concept A, individual data streams are multiplexed into a total of only one data stream using the MPEG-4 FlexMux and are transmitted in a total of one logical ITLT
1 ~ channel (exemplary embodiment in accordance with Figure 2b). For this type of transmission of MPEG-4 data streams using the FlexMux, additional Descriptors are defined, which make possible the connection setup. Only using these Descriptors is the recognition of the individual MPEG-4 data streams possible. These MPEG-4-specific data streams are multiplexed using the MPEG-4 FlexMux tools. In this context, the use of packets of a constant length is defined, as a result of which the error-resistance is increased. In this manner, synchronization to the data stream after an error is possible.
Below, Concept A is described in detail.
2~ As Figure 2b shows, the following logical MPEG-4 objects (SL-packetized data streams) can be multiplexed using the MPEG-4 FlexMux tools into one transmission frame and can be transmitted in one logical ITU channel AL1:
S L-audio, SL-video, SL-OCR (Object Clock Reference), SL-OD (Object Descriptor), SL-OCI (Object Content Information).
NY01 355243 v 1 In one easy transformation of Concept A, it is also possible to multiplex data exclusively of the same type (e.g., either only SL-audio or only SL-video) into one logical channel using the FlexMux tools, i.e., to transmit the entirety of the MPEG-4 data streams in a plurality (although less than in Concept B) of logical ITU channels. Under certain circumstances, this would make possible a simpler separation and decoding of the multiplexed data in the receiver. However, the original Concept A, i.e., the multiplexing of all MPEG
data streams into one logical ITU channel using the FlexMux tools is considered below.
Concept A (just as Concept B) makes possible the transmission of a plurality of MPEG-4 data streams of the same type, such as the transmission of a plurality of audio streams for an image-accompanying sound in different languages.
For the method in accordance with Concept A, MUXCODETABLE_Entry is transmitted during the initialization phase in order to configure the MPEG-4 FIexMux.
In the end, the stipulated assignment of the individual ES streams to the data to be multiplexed is communicated to the MPEG-4 decoder. This is achieved using a Channel Map Table (also known as Stream Map Table).
In addition to the Object Descriptors, these two information messages are used for the decoding.
In order to insert the additional information messages MUXCODETABLE Entry and 2~ Channel Map Table into the Initial Object Descriptor, the definition of the new Descriptors is used. The latter are inserted in the form of Extension Descriptors into the Initial Object Descriptor.
Class Channel Map Table Descriptor: bit (8) tag = to be defined bit(16) length:
bit (15) streamCount:
bit (1) MultiplexCodeFlag;
NY01 355243 v 1 For (i=0; i<streamCount; i++{
bit (16) ES ID;
bit (8) FlexMuxChannel;
IFMultiplexCodeFlag {
S
bit (4) MultiplexCode;
bit (4) reserved:;
) The part printed in bold indicates the Descriptor that is newly defined here.
Similarly, the setup of a MuxCodeTableEntryDescriptor can be carned out:
Class MuxCodeTableEntryDescriptor: bit (8) tag = to be defined bit ( 16) length bit (4) number of MuxCodeTableEntries;
bit (1) constantLengthFlag;
bit (3) reserved;
IF constantLengthFlag bit(8) FlexMuxLength;
For (j=0; j<numberOfMuxCodeTableEntries; j++{
bit (8) length;
bit (4) MuxCode;
bit (4) version;
bit (8) substructureCount;
for (I~; i<substructureCount; I++) bit (5) slotCount;
bit (3) repetitionCount;
for (k=0; k<slotCount; k++) NY01 355243 v 1 bit (8) FlexMuxChannel (I) (k);
bit (8) numberOfBytes (I) (k);
The part printed in bold indicates the Descriptor newly defined here. The data field numberOfiYIuxCodeTableEntries makes it possible to transmit the maximum of 16 MuxCodeTableEntries. Using the constantLengthFlag and the field FlexMuxLength, it is signaled to the receiver that the FlexMux packets having a constant length are transmitted in the packet size FlexMuxLength + 2.
The FlexMux packets defined in MPEG-4 are transmitted, on the one hand, in the simple mode in accordance with Figure 3 and, on the other hand, in the MuxCode in accordance with 1 ~ Figure 4.
By using packets of a constant, nonlinear length, here 127 bytes, the upper 7 bits of the Length field can be used for synchronization.
This increases the error-resistance and makes possible a resynchronization in the event that a Length field of one packet is faulty.
These FIexMux packets are now merged into one ITU frame. In Figure 5, an Adaptation Layer (AL) frame in accordance with ITU-H.223 is depicted, having an AL-PDU
(Protocol Data Unit) Payload Field. Due to the variable length of a FlexMux packet, it would no longer be possible to locate a new FlexMux packet after an error in the length field.
This is particularly injurious if a plurality of MPEG-4 elementary streams (e.g., BIFS, OD, and video) are transmitted in one ITU channel.
By using constant lengths within the MPEG-4 FIexMux packets, according to the present invention this is now possible.
By using a constant length within the MPEG-4 FlexMux packet, this is now possible according to the present invention.
The individual AL-PDU packets of variable lengths are now packetized using the NY01 355243 v 1 1 ~
multiplexes.
The setup of the Multiplexed Layer and the basic integrating of the MPEG-4 FlexMux data stream are briefly discussed.
A MUX Protocol Data Unit (MUX-PDU) is composed of a header and an information field, in nesting the data of the individual logical ITU channels. Figure 6 depicts the setup.
The header is composed of individual fields, which are shown in Figure 1.
The 4-bit-large Multiplex Code indicates a MultiplexEntry transmitted over H.245, of which a maximum of 15 different ones can be defined.
The header Error Control Field is a 3-bit-large CRC Field, which permits error detection in the header.
The 1-bit packet Marker Field marks the end of a MUX-SDU of a segmented logical channel.
The information field shown in Figure 6 is configured using the MultiplexTable transmitted in H.245.
The information field can at any time be closed at an Octet Border using a Closing Flag, but a MUX-SDU may not be interrupted by a non-segmentable channel.
The MultiplexEntryDescriptor configures the H.223 Multiplexes and is transmitted in the initialization phase (Figure 8).
In this Figure, LCN denotes: LogicalChannelNumber; RC: RepeatCount; UCF:
UntilClosingFlag.
The advantage is made clear in Figure 9:
if, in an ITU channel, a plurality of MPEG data are transmitted and MPEG-4 packets of variable length are used, then none of the following FlexMuxPackets can any longer be decoded. The skillful use of the Length field as a synchronization marker makes possible the synchronization of the receiver.
NY01 355243 v 1 1 1 The transmitting terminal signals the packet length to the receiving terminal using the MuxCodeTableEntryDescriptor deFned here, which is designated by a flag, which signals the use of FlexMux packets of a constant length and which also contains a field that establishes the length to be used. In this manner, high flexibility, in conjunction with great error-S resistance, is assured.
Of course, the present invention does not have to be used only for MPEG-4 data, but may also be used for other audiovisual coded information which is to be merged into one standardized transmission frame and whose decoding is to take place in a manner that is simple and resistant to errors.
Of course, the method presented can be realized in transmitter-side and receiver-side terminals. For transmitter-side integrating, the appropriate element is provided for preparing, or for delivering, audiovisual coded information, as well as an appropriate element for multiplexing the data streams, exchanging the capabilities, and signaling . For the receiver-side evaluation, what is desirable is a way for decomposing up the multiplexed data channels as well as means for exchanging capabilities and their valuation, as well as for evaluating the signaling. Since usually work is done in the interactive mode, subscriber terminals are furnished both for transmitting as well as for receiving operation.
NY01 355243 v 1 12
Claims (24)
1. A method for integrating audiovisual encoded information into a predefined frame-structured transmission standard, comprising the steps of:
preprocessing the audiovisual encoded information into separate data streams;
respectively supplying the audiovisual encoded information as the separate data streams;
multiplexing the separate data streams into at least one data channel in the predefined frame-structured transmission standard;
exchanging capabilities of terminals that communicate with one another as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and signaling, in accordance with data structures of an encoding standard, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
preprocessing the audiovisual encoded information into separate data streams;
respectively supplying the audiovisual encoded information as the separate data streams;
multiplexing the separate data streams into at least one data channel in the predefined frame-structured transmission standard;
exchanging capabilities of terminals that communicate with one another as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and signaling, in accordance with data structures of an encoding standard, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
2. The method according to claim 1, wherein:
the data structures are selected so as to be identical.
the data structures are selected so as to be identical.
3. The method according to claim 1 or 2, further comprising the steps of:
for object-based, audiovisually encoded information having a low number of objects, causing a multiplexer to packetize a set of the separate data streams; and transmitting the packetized set of separate data streams in individual transmission channels in accordance with the H.245 standard.
for object-based, audiovisually encoded information having a low number of objects, causing a multiplexer to packetize a set of the separate data streams; and transmitting the packetized set of separate data streams in individual transmission channels in accordance with the H.245 standard.
4. The method according to claim 3, wherein:
the multiplexer conforms to the H.223 standard, and the individual transmission channels include ITU channels.
the multiplexer conforms to the H.223 standard, and the individual transmission channels include ITU channels.
5. The method according to claim 3, wherein:
a data field assigns individual packets within the individual transmission channels assigned to the individual packets, and a data field in an MPEG-4 transmission contains an identification of individual elementary data streams.
a data field assigns individual packets within the individual transmission channels assigned to the individual packets, and a data field in an MPEG-4 transmission contains an identification of individual elementary data streams.
6. The method according to claim 3, further comprising the step of:
taking over directly from the multiplexing step a data format of MPEG-4 output data streams in order to avoid a further reformatting.
taking over directly from the multiplexing step a data format of MPEG-4 output data streams in order to avoid a further reformatting.
7. The method according to claim 3, further comprising the step of:
accommodating object descriptors for the audiovisual encoded information in a separate channel corresponding to a logical channel not equal to 0 in accordance with the ITU-H.223 standard.
accommodating object descriptors for the audiovisual encoded information in a separate channel corresponding to a logical channel not equal to 0 in accordance with the ITU-H.223 standard.
8. The method according to claim 7, wherein:
the object descriptors each correspond to an Initial Object Descriptor in accordance with MPEG-4.
the object descriptors each correspond to an Initial Object Descriptor in accordance with MPEG-4.
9. The method according to claim 3, further comprising the steps of:
for object-based audiovisual, encoded information having a large number of objects, multiplexing the separate data streams into a common data stream; and transmitting the separate data streams in one of the individual transmission channels.
for object-based audiovisual, encoded information having a large number of objects, multiplexing the separate data streams into a common data stream; and transmitting the separate data streams in one of the individual transmission channels.
10. The method according to claim 9, wherein:
one of the individual transmission channels includes an ITU channel.
one of the individual transmission channels includes an ITU channel.
11. The method according to any one of claims 1,2 or 9, wherein:
the multiplexed separate data streams are in a transmission frame of the predefined frame-structured transmission standard, and the method further comprises the step of:
in addition to the multiplexed separate data streams in the transmission frame of the predefined frame-structured transmission standard, storing a signaling information that signals that multiplexed information packets of a constant length are transmitted, on whose basis a synchronization can be carried out.
the multiplexed separate data streams are in a transmission frame of the predefined frame-structured transmission standard, and the method further comprises the step of:
in addition to the multiplexed separate data streams in the transmission frame of the predefined frame-structured transmission standard, storing a signaling information that signals that multiplexed information packets of a constant length are transmitted, on whose basis a synchronization can be carried out.
12. The method according to claim 11, wherein:
the synchronization is in response to faulty data packets.
the synchronization is in response to faulty data packets.
13. The method according to claim 1, further comprising the step of:
accommodating in an additional channel object descriptors.
accommodating in an additional channel object descriptors.
14. The method according to claim 13, wherein:
the additional channel includes logical channel 0 corresponding to the ITU
H.245 standard.
the additional channel includes logical channel 0 corresponding to the ITU
H.245 standard.
15. The method according to claim 13, wherein:
the object descriptors each correspond to an Initial Object Descriptor in accordance with MPEG-4 for the audiovisual encoded information.
the object descriptors each correspond to an Initial Object Descriptor in accordance with MPEG-4 for the audiovisual encoded information.
16. The method according to claim 13, further comprising the step of:
storing allocation data between the separate data streams in the additional channel.
storing allocation data between the separate data streams in the additional channel.
17. The method according to claim 16, wherein:
the separate data streams include SL-packetized MPEG-4 elementary data streams and multiplexed data.
the separate data streams include SL-packetized MPEG-4 elementary data streams and multiplexed data.
18. The method according to claim 16, wherein:
the additional channel includes logical channel 0 in accordance with the ITU-H.245 standard.
the additional channel includes logical channel 0 in accordance with the ITU-H.245 standard.
19. The method according to claim 1, further comprising the step of:
for a signaling information, providing data fields that identify, on the one hand, a constant length and, on the other hand, a packet size of multiplexed information packets.
for a signaling information, providing data fields that identify, on the one hand, a constant length and, on the other hand, a packet size of multiplexed information packets.
20. The method according to any one of claims 1, 2 or 9, wherein:
MPEG-4 data corresponds to the audiovisual encoded information that are preprocessed into FlexMux packets of a constant length, and the FlexMux packets of the constant length are multiplexed into a transmission frame in order to make possible a transmission in accordance with the ITU standard H.324.
MPEG-4 data corresponds to the audiovisual encoded information that are preprocessed into FlexMux packets of a constant length, and the FlexMux packets of the constant length are multiplexed into a transmission frame in order to make possible a transmission in accordance with the ITU standard H.324.
21. The method according to claim 1, further comprising the steps of:
within an Adaption Layer of a variable length in accordance with the ITU
standard H.324, storing a plurality of MPEG-4 data in data packets of a constant length; and providing a length field in a header portion of each of the data packets, wherein:
the length field corresponds to a synchronization identification.
within an Adaption Layer of a variable length in accordance with the ITU
standard H.324, storing a plurality of MPEG-4 data in data packets of a constant length; and providing a length field in a header portion of each of the data packets, wherein:
the length field corresponds to a synchronization identification.
22. The method according to claim 21, wherein:
the synchronization identification is for synchronizing a receiver.
the synchronization identification is for synchronizing a receiver.
23. A terminal for a transmitter-side integrating of audiovisual encoded information into a predefined frame-structured transmission standard, comprising:
an arrangement for preprocessing the audiovisual encoded information into separate data streams for the terminal;
an arrangement for delivering the audiovisual encoded information as the separate data streams;
an arrangement for multiplexing the separate data streams into at least one data channel of the predefined frame-structured transmission standard;
an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data structures, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
an arrangement for preprocessing the audiovisual encoded information into separate data streams for the terminal;
an arrangement for delivering the audiovisual encoded information as the separate data streams;
an arrangement for multiplexing the separate data streams into at least one data channel of the predefined frame-structured transmission standard;
an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data structures, specifications on the data type used, a decoding tool to be used, and encoding parameters including a data capacity.
24. A terminal for a receiver-side evaluation of audiovisual encoded information in a predefined frame-structured transmission standard, comprising:
an arrangement for decomposing up at least one multiplexed frame-structured data channel of a transmission standard into individual audiovisual data streams;
an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data structures, specifications on the data type used, a decoding tool to be used, and a data capacity.
an arrangement for decomposing up at least one multiplexed frame-structured data channel of a transmission standard into individual audiovisual data streams;
an arrangement for exchanging capabilities with other terminals as to types of data capable of being one of encoded and decoded and as to encoding and decoding operations that are supported, after a connection is established; and an arrangement for signaling, in accordance with data structures, specifications on the data type used, a decoding tool to be used, and a data capacity.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE19840500 | 1998-09-07 | ||
| DE19840500.6 | 1998-09-07 | ||
| DE19845193A DE19845193A1 (en) | 1998-09-07 | 1998-10-01 | Process for the introduction of audiovisual coded information into a predetermined, frame-structured transmission standard as well as terminals for this |
| DE19845193.8 | 1998-10-01 | ||
| PCT/DE1999/002770 WO2000014966A1 (en) | 1998-09-07 | 1999-09-01 | Method and terminal equipment for integrating audiovisual coded information into a frame structured transmission standard |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2343166A1 CA2343166A1 (en) | 2000-03-16 |
| CA2343166C true CA2343166C (en) | 2005-11-08 |
Family
ID=26048639
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002343166A Expired - Fee Related CA2343166C (en) | 1998-09-07 | 1999-09-01 | A method for integrating audiovisual coded information into one predefined, frame-structured transmission standard, as well as terminals for this purpose |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US6907067B1 (en) |
| EP (2) | EP0986267A3 (en) |
| JP (1) | JP4488465B2 (en) |
| AT (1) | ATE222042T1 (en) |
| AU (1) | AU759158B2 (en) |
| CA (1) | CA2343166C (en) |
| ES (1) | ES2182576T3 (en) |
| WO (1) | WO2000014966A1 (en) |
Families Citing this family (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003534741A (en) * | 2000-05-23 | 2003-11-18 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Communication system with MPEG-4 remote access terminal |
| WO2002011350A1 (en) | 2000-07-31 | 2002-02-07 | Siemens Aktiengesellschaft | Method for correcting errors in a packet-oriented data transmission |
| KR100397511B1 (en) * | 2001-11-21 | 2003-09-13 | 한국전자통신연구원 | The processing system and it's method for the stereoscopic/multiview Video |
| US8059673B2 (en) * | 2003-05-01 | 2011-11-15 | Genesis Microchip Inc. | Dynamic resource re-allocation in a packet based video display interface |
| US8204076B2 (en) * | 2003-05-01 | 2012-06-19 | Genesis Microchip Inc. | Compact packet based multimedia interface |
| US20040218624A1 (en) * | 2003-05-01 | 2004-11-04 | Genesis Microchip Inc. | Packet based closed loop video display interface with periodic status checks |
| US7839860B2 (en) * | 2003-05-01 | 2010-11-23 | Genesis Microchip Inc. | Packet based video display interface |
| US7405719B2 (en) * | 2003-05-01 | 2008-07-29 | Genesis Microchip Inc. | Using packet transfer for driving LCD panel driver electronics |
| US7620062B2 (en) * | 2003-05-01 | 2009-11-17 | Genesis Microchips Inc. | Method of real time optimizing multimedia packet transmission rate |
| US8068485B2 (en) * | 2003-05-01 | 2011-11-29 | Genesis Microchip Inc. | Multimedia interface |
| JP2005033664A (en) * | 2003-07-10 | 2005-02-03 | Nec Corp | Communication device and its operation control method |
| US7634090B2 (en) | 2003-09-26 | 2009-12-15 | Genesis Microchip Inc. | Packet based high definition high-bandwidth digital content protection |
| EP1594287B1 (en) * | 2004-04-12 | 2008-06-25 | Industry Academic Cooperation Foundation Kyunghee University | Method, apparatus and medium for providing multimedia service considering terminal capability |
| WO2006019380A1 (en) * | 2004-07-19 | 2006-02-23 | Thomson Licensing S.A. | Non-similar video codecs in video conferencing system |
| KR100677378B1 (en) * | 2004-11-02 | 2007-02-02 | 엘지전자 주식회사 | Method for encoding video call data of wcdma terminal |
| JP2006165935A (en) * | 2004-12-07 | 2006-06-22 | Nec Corp | Device and method for converting control information |
| CN100464581C (en) * | 2005-01-12 | 2009-02-25 | 宁波大学 | Phonetic imaging transmitting method for wireless digital visual walkie-talkie |
| KR20080114496A (en) * | 2007-06-26 | 2008-12-31 | 삼성전자주식회사 | Method and apparatus for composing scene using laser contents |
| US20090219932A1 (en) * | 2008-02-04 | 2009-09-03 | Stmicroelectronics, Inc. | Multi-stream data transport and methods of use |
| US8156238B2 (en) | 2009-05-13 | 2012-04-10 | Stmicroelectronics, Inc. | Wireless multimedia transport method and apparatus |
| US8429440B2 (en) * | 2009-05-13 | 2013-04-23 | Stmicroelectronics, Inc. | Flat panel display driver method and system |
| US8671234B2 (en) | 2010-05-27 | 2014-03-11 | Stmicroelectronics, Inc. | Level shifting cable adaptor and chip system for use with dual-mode multi-media device |
| JP5212437B2 (en) * | 2010-08-30 | 2013-06-19 | 株式会社Ｊｖｃケンウッド | Image data transmitting apparatus, image data receiving apparatus, image data transmission system, image data transmitting method, and image data receiving method |
| US9130769B2 (en) | 2011-09-16 | 2015-09-08 | Cisco Technology, Inc. | Upstream external PHY interface for data and control plane traffic |
| DE102020114742B4 (en) | 2020-06-03 | 2022-06-02 | Dspace Gmbh | Method and computer system for reading message packets |
| EP4274222A4 (en) * | 2021-01-21 | 2024-03-20 | Huawei Tech Co Ltd | Transmission method, apparatus and system |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3197420B2 (en) * | 1994-01-31 | 2001-08-13 | 三菱電機株式会社 | Image coding device |
| US5838664A (en) * | 1997-07-17 | 1998-11-17 | Videoserver, Inc. | Video teleconferencing system with digital transcoding |
| JPH08317382A (en) * | 1995-05-19 | 1996-11-29 | Canon Inc | Image transmitter |
| GB2318030B (en) * | 1996-10-04 | 2001-03-14 | Ibm | Communication system with exchange of capability information |
| JP2001504288A (en) * | 1996-11-08 | 2001-03-27 | シーメンス アクチエンゲゼルシヤフト | Method and apparatus for multiplexing multiple digital data streams into one digital overall data stream, and method and apparatus for demultiplexing one digital overall data stream into multiple digital data streams |
| JPH10210441A (en) * | 1997-01-21 | 1998-08-07 | Matsushita Electric Ind Co Ltd | Data-receiving device, data-transmitting device and data-receiving and transmitting device |
| EP1439704A3 (en) * | 1997-03-17 | 2011-08-10 | Panasonic Corporation | Method and apparatus for processing, transmitting and receiving dynamic image data |
| CA2257577C (en) * | 1997-04-07 | 2002-03-19 | At&T Corp. | System and method for interfacing mpeg-coded audiovisual objects permitting adaptive control |
| CA2257578C (en) * | 1997-04-07 | 2003-01-21 | At&T Corp. | System and method for processing object-based audiovisual information |
| JP3365487B2 (en) * | 1998-09-30 | 2003-01-14 | 日本電気株式会社 | Videophone device and its mode setting method |
| US20020097798A1 (en) * | 2000-11-17 | 2002-07-25 | Yehuda Manor | System and method for coding and decoding |
-
1999
- 1999-06-24 EP EP99112152A patent/EP0986267A3/en not_active Withdrawn
- 1999-09-01 WO PCT/DE1999/002770 patent/WO2000014966A1/en active IP Right Grant
- 1999-09-01 CA CA002343166A patent/CA2343166C/en not_active Expired - Fee Related
- 1999-09-01 ES ES99953683T patent/ES2182576T3/en not_active Expired - Lifetime
- 1999-09-01 JP JP2000569584A patent/JP4488465B2/en not_active Expired - Fee Related
- 1999-09-01 AT AT99953683T patent/ATE222042T1/en not_active IP Right Cessation
- 1999-09-01 AU AU10303/00A patent/AU759158B2/en not_active Ceased
- 1999-09-01 US US09/786,574 patent/US6907067B1/en not_active Expired - Fee Related
- 1999-09-01 EP EP99953683A patent/EP1112660B1/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| US6907067B1 (en) | 2005-06-14 |
| ATE222042T1 (en) | 2002-08-15 |
| EP0986267A3 (en) | 2003-11-19 |
| CA2343166A1 (en) | 2000-03-16 |
| AU759158B2 (en) | 2003-04-10 |
| JP2002524984A (en) | 2002-08-06 |
| ES2182576T3 (en) | 2003-03-01 |
| AU1030300A (en) | 2000-03-27 |
| WO2000014966A1 (en) | 2000-03-16 |
| EP0986267A2 (en) | 2000-03-15 |
| EP1112660A1 (en) | 2001-07-04 |
| EP1112660B1 (en) | 2002-08-07 |
| JP4488465B2 (en) | 2010-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2343166C (en) | A method for integrating audiovisual coded information into one predefined, frame-structured transmission standard, as well as terminals for this purpose | |
| US6522651B2 (en) | Method of encapsulation of data into transport packets of constant size | |
| US6172988B1 (en) | Method for universal messaging and multiplexing of video, audio, and data streams | |
| US8422564B2 (en) | Method and apparatus for transmitting/receiving enhanced media data in digital multimedia broadcasting system | |
| US7372858B2 (en) | Data transmission device and data transmission method | |
| EP2739043A1 (en) | Transmitting apparatus and method and receiving apparatus and method for providing a 3d service through a connection with a reference image transmitted in real time and additional image and content transmitted separately | |
| CN100568971C (en) | The transmission code stream of a kind of MPEG-4 is to the real time conversion method of internet stream media alliance stream | |
| US8432937B2 (en) | System and method for recovering the decoding order of layered media in packet-based communication | |
| EP0969673B1 (en) | Error detection in receiving multiplex signals | |
| CN102171750A (en) | Method and apparatus for delivery of aligned multi-channel audio | |
| US20050152372A1 (en) | System and method for performing transmission and reception operations based on broadcast/communication convergence | |
| CN101479969B (en) | Method and device for data packing | |
| WO2001039505A2 (en) | Method and apparatus of transmitting and receiving variable bit rate streams | |
| CN101193290A (en) | A real time conversion system from MPEG-4 transmission code stream to Internet stream media alliance stream | |
| WO2003010975A1 (en) | System and method for broadcast of independently encoded signals on atsc channels | |
| US20040190629A1 (en) | System and method for broadcast of independently encoded signals on atsc channels | |
| KR100841896B1 (en) | Method and device for encoding £Í£Ð£Å£Ç-4 video data | |
| WO2000064119A1 (en) | Preprocessing method for adapting mpeg-4 data streams to the internet network | |
| US7577170B2 (en) | System for the dynamic multiplexing of digital streams | |
| KR100663556B1 (en) | Broadcasting/communication convergence transmission/reception system and method | |
| KR20080023902A (en) | Internet protocol packet re-transporting apparatus for digital multimedia broadcasting service | |
| Shuaib et al. | Dejittering in the transport of MPEG-2 and MPEG-4 video | |
| Shuaib et al. | De-jittering in the transport of MPEG-4 and MPEG-2 video over ATM | |
| Carvalho | Quality of service controlled multimedia transport protocol |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |
Effective date: 20140903 |
|
| MKLA | Lapsed |
Effective date: 20140903 |