EP3035691A2 - Methods and apparatus for minimizing timing artifacts in remultiplexing - Google Patents
Methods and apparatus for minimizing timing artifacts in remultiplexing Download PDFInfo
- Publication number
- EP3035691A2 EP3035691A2 EP15306973.7A EP15306973A EP3035691A2 EP 3035691 A2 EP3035691 A2 EP 3035691A2 EP 15306973 A EP15306973 A EP 15306973A EP 3035691 A2 EP3035691 A2 EP 3035691A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- transport
- program
- stream
- clock reference
- single program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 239000000872 buffer Substances 0.000 claims abstract description 90
- 238000012546 transfer Methods 0.000 claims description 20
- 230000003139 buffering effect Effects 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 27
- 230000032258 transport Effects 0.000 description 120
- 230000006870 function Effects 0.000 description 21
- 238000013459 approach Methods 0.000 description 10
- 238000003752 polymerase chain reaction Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 241000223602 Alternaria alternata Species 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 238000004455 differential thermal analysis Methods 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000012464 large buffer Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23611—Insertion of stuffing data into a multiplex stream, e.g. to obtain a constant bitrate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4344—Remultiplexing of multiplex streams, e.g. by modifying time stamps or remapping the packet identifiers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/70—Media network packetisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23608—Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2365—Multiplexing of several video streams
- H04N21/23655—Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/21—Flow control; Congestion control using leaky-bucket
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/30—Flow control; Congestion control in combination with information about buffer occupancy at either end or at transit nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/06—Generation of synchronising signals
- H04N5/067—Arrangements or circuits at the transmitter end
- H04N5/073—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations
- H04N5/0736—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations using digital storage buffer techniques
Definitions
- the present principles relate generally to methods and apparatus for minimization of timing artifacts in a remultiplexing process.
- Edge QAMs used in the hospitality industries include a remultimplexer function.
- the remultiplexer takes Transport Stream (TS) packets from several single program transport streams (SPTS) and inserts them into a multiple program transport stream (MPTS) for the respective television channel.
- Most of the Edge QAMs receive the input streams on an Internet Protocol (IP) interface.
- IP Internet Protocol
- the internal remultiplexer restamps the TS packets with a new program clock reference (PCR). This often creates timing artifacts that are noticeable on some digital televisions (DTVs).
- PCR program clock reference
- a plurality of single program transport streams are controlled during remultiplexing to a multi program transport stream.
- At least one SPTS is buffered and calculations are performed to determine a rate of transfer of transport packets to a multiplex buffer.
- the transport packets are transferred to a multiplex buffer at the calculated rate.
- control of the remultiplexing of a plurality of single program transport streams to a multi program transport stream is achieved by limiting a number of consecutive packets being transferred from any particular single program transport stream, and controlling the multiplex frequency from any particular stream.
- control of a plurality of single program transport streams during remultiplexing to a multi-program transport stream is based on using multiple program clock reference values such that packets from each single program transport stream are released only after a previous program clock reference value is greater than the system time.
- implementations may be configured or embodied in various manners.
- an implementation may be performed as a method, or embodied as an apparatus, such as, for example, an apparatus configured to perform a set of operations or an apparatus storing instructions for performing a set of operations, or embodied in a signal.
- an apparatus such as, for example, an apparatus configured to perform a set of operations or an apparatus storing instructions for performing a set of operations, or embodied in a signal.
- the described embodiments are directed to methods and apparatus for transporting digital multimedia signals, such as television programs, to customer equipment, and more particularly to audio-video program distribution systems that convert a plurality of single program transport streams (SPTS) into a multiple program transport stream (MPTS).
- SPTS single program transport streams
- MPTS multiple program transport stream
- IP Edge Modulators such as the cable quadrature amplitude modulation (QAM) modulators used in a hotel entertainment system to re-modulate and distribute TV programming that originates from a different broadcast network, such as a Satellite Video Broadcast System. Timing artifacts can occur when several single program transports streams are remultiplexed into a multi-program transport stream.
- Some hotels use entertainment systems that receive video signals from satellite service providers and then rebroadcast video programs in stacked quadrature amplitude modulation (QAM) RF channels.
- Each QAM channel can carry up to approximately 12 Standard Definition (SD) programs or 3 High Definition (HD) programs.
- the infrastructure between the satellite receivers and the QAM is a jitter-inducing IP network. It is difficult to multiplex unrelated Single Program Transport Streams (SPTS) into a Multi-Program Transport Stream (MPTS) while minimizing introduced timing artifacts.
- SPTS Single Program Transport Streams
- MPTS Multi-Program Transport Stream
- TS-STD Transport Stream-System Target Decoder
- FIG. 1 An example Satellite to Cable Re-broadcast System is shown in Figure 1 .
- FIG. 2 shows a typical IP edge QAM modulator. It includes an IP network interface for receiving the Ethernet frames.
- the Ethernet Frames are stored in a large buffer and then applied to an IP stack that recovers the MPEG2 transport stream (TS) packets.
- TS transport stream
- Those TS packets are analyzed in a manner that identifies their associated program.
- the program identifiers (PIDs) in the Program Association Table (PAT), Program Map Tables (PMTs), and MPEG2-TS packet headers are changed (remapped) to prepare for multiplexing sub-channels that will be broadcast in the same RF channel.
- the MPEG2-TS packets go into multiplexers, one for each RF output channel.
- the purpose of the multiplex operation is to combine multiple variable-rate SPTS's into a constant rate MPTS prior to modulation. The focus will be on the MPTS multiplex process from here forward.
- a first prior art approach focuses on reducing latency in the remultiplexing process.
- IP Edge QAM modulators Another approach used in IP Edge QAM modulators is to use a QAM modulator IC or QAM modulator FPGA core to do the actual packet coding and modulation.
- each core can generate up to 4 QAM channels, each of which may carry multiple sub-channels. The multiplexing of the sub-channels into the channel is done by the processing that loads packets into the front end queue of each channel. Similar to other QAM modulators, this core contains several input modes. One mode that is used in this prior art device is the "PCR Restamping" mode.
- the TS PCR restamping extension core provides a TS interface to allow data to be input at any rate.
- the core will pad the input TS stream with NULL TS packets as required and perform any PCR adjustment.
- an output signal is provided that indicates the necessary 188-byte TS byte_rate to satisfy the on-air requirements.
- the output bitrate of each QAM channel is 38.8Mbps.
- the output stage clocks the data packets out of the multiplex buffer at a constant rate and then modulates the appropriate RF carrier for the designated television channel with that data. Because such television signal generation utilizes quadrature amplitude modulation, this type of IP edge multiplexer is often referred to as an "edge QAM.”
- the multiplexer's function is to create a transport stream containing the TS packets for those multiple programs.
- the multiplexer takes TS packets from several single program transport streams and inserts them into a multiple program transport stream for the respective television channel.
- the internal multiplexer re-stamps the TS packets with a new program clock reference (PCR).
- PCR program clock reference
- the multiplexer also generates a new program map table and a new program association table to ensure proper construction of the MPTS.
- the focus of the described embodiments is the process of converting multiple variable rate transport streams into a constant rate stream in an output RF channel. This includes the process of multiplexing multiple SPTS into a single MPTS. To simplify the explanation and drawings, the focus in the discussion will be on a single RF output channel of the Edge QAM. A single output channel of the example Edge QAM is shown in Figure 3 .
- the conventional input buffer simultaneously stores groups of transport stream packets from a large number of Ethernet frames and a plurality of separate programs.
- the input buffer is implemented by a very large random access memory so that all the incoming TS packets can be stored until one can be processed by the respective modulator circuit.
- a relatively large amount of buffer memory is required to provide time for the IP Edge Multiplexer to construct the program specific information (PSI), specifically the PAT and the PMT, for the audio-video content being transported.
- PSI program specific information
- the size of the input buffer varies dynamically based on the amount of incoming data that has to be stored before the multiplexers can process that data.
- Packets are transferred from the Multiplex Buffer (MB) to the TS FIFO (First In First Out) as long as there is a packet in the Multiplex Buffer and there is room in the TS FIFO. If the TS FIFO empties and there are no MPEG packets in the Multiplex Buffer, then the QAM Modulator Core inserts a NULL packet as previously explained. This is to maintain the necessary constant packet rate needed to produce the television channel output signal.
- MB Multiplex Buffer
- TS FIFO First In First Out
- a MPTS In addition to being syntactically correct, a MPTS must also meet certain timing constraints. This is usually handled by an expensive MPEG Statistical Multiplexer at the Broadcast Service Provider's head-end. Each SPTS must meet the buffer requirements in the MPEG Transport Stream System Target Decoder (TS- STD) without overflowing buffers. See Figure 4 . Additionally, each Elementary Stream (ES) must also not overflow ES buffers.
- TS- STD MPEG Transport Stream System Target Decoder
- ES Elementary Stream
- a timing model of an STD can be found in Annex D of the MPEG2-1 system specification.
- the IP stack in the receivers and the input buffer of the IP edge modulator introduce significant jitter in the transmission of the TS packets for each program. Specifically, the IP stack introduces an indeterminate and varying delay, which can be up to an additional 1 ⁇ 2 second.
- the distortion between the PCR and the PTS manifests itself in several ways. Specifically, the SPTS within a channel from some IP Edge QAMs do not meet the TS-TSD buffer requirements (See Figure 4 ). This can lead to video/audio artifacts in some MPEG decoders (for example, digital televisions, STBs, DTAs, etc.).
- Figure 5 shows the distribution of PCR Interval before processing by an IP Edge Modulator.
- the PCR accuracy of the SPTS on the IP network was measured at about ⁇ 100msec.
- the target interval for PCRs is usually about 40msec. It can be seen that the distribution is still centered on that average value, but there is substantial spread in the PCR interval.
- Figure 6 shows the distribution of PCR Interval after processing by the prior-art IP edge modulator described here.
- the PCR accuracy of this signal measured ⁇ 200usec which is much closer to the MPEG2 compliant value of ⁇ 500nsec
- the PCR Interval is more distorted than the PCR in the IP domain.
- the PCR interval ranged from 0.232 ms to 59.785 msec.
- the jitter introduced on the IP network is mostly due to the bursty nature in which packets are processed and transmitted, especially if a general purpose processor is used to process and route packets.
- the bursty nature of the packet transmission can be seen by looking at UDP (User Datagram Protocol) packets on the IP network. As has been said, most of the UDP packets contain 7 MPEG2-TS packets.
- Figure 7 is a graph of how many packets are received at the IP edge modulator in a 100 msec period. This graph approximately follows the actual bit rate of the SPTS in the original MPTS. However, if one looks at the number of packets sent in 10msec interval, the traffic is much more bursty. See Figure 8 . Note that in one 10 msec interval, 10 UDP packets may be received while in the next 10 msec interval, no packets may be received.
- Table 1 shows a summary of some important parameters of this one minute live video capture. Note that the Transport Buffer Fullness is exceeded in many places and the Elementary Stream Buffer Fullness limit is exceeded for Dolby Audio for two out of the three programs. Table 1 Buffer Statistics for 1 minute channel capture PID Stream Type Transport Drain Rate (kbps) Transport Buffer Fullness (%) ES Buffer Size (bits) ES Buffer Fullness (%) min Max min avg max 0x000 0 MPEG2 PSI PAT 1,000 0.00 0 36.719 0x001 0 MPEG2 PSI PMT 1,000 0.00 0 36.719 0x001 1 MPEG4 Video 24,000 0.00 0 925.00 30,000,0 00 3.730 11.34 4 25.778 0x001 2 Dolby Digital Audio 2,000 0.00 0 116.79 7 45,568 31.46 1 47.18 7 62.921 0x002 0 MPEG2 PSI PMT 1,000 0.00 0 36.719 0x002 1 MPEG4 Video 2
- FIG. 9 A graph showing the Transport Buffer Fullness as a function of time for one of the video streams is shown in Figure 9 . Notice that the Transport Buffer Fullness is almost always above the limit. Transport Buffer Fullness of an audio stream is shown in Figure 10 . Although the Transport Buffer Fullness is mostly within the required limit, it was noted earlier that the ES Buffer Fullness limit is exceeded.
- One method to minimize the TS-STD transport buffer overflows is to rate control the packets from each program entering the MPTS multiplex buffer. This can be done using a series of leaky buckets as shown in Figure 11 .
- the leaky buckets are placed between the previously described IP processing and the multiplex buffer. As packets "leak" from each bucket, they are placed in the multiplex buffer.
- the leaky buckets can be in an FPGA since the multiplex buffer can also be implemented in an FPGA. In this case, the multiplex buffer should be made large to minimize overflow, although flow control can easily be implemented.
- the exit rate of the bucket should be set approximately to the drain rate used by the TS-STD in its transport buffers to determine compliance. Since an individual program's stream rate is dominated by the video, a reasonable approach would be to use the video transport buffer drain rate.
- the video transport drain rate can be derived from the bit_rate_value carried in the Video Sequence Header. If there is not enough processing power to parse the video stream down to the Video Sequence Header, then it is also possible to base the leak rate on the stream_type, which is carried in the Program Map Table (PMT) and/or the stream_id, which is carried in the PES Header.
- PMT Program Map Table
- Another embodiment of a method to minimize the TS-STD transport buffer overflows is to control the number of consecutive packets from each program entering the MPTS multiplex buffer. This can be done by modifying the algorithm that releases packets to the multiplex buffer as shown in Figure 13 .
- the rules for transferring packets from each program into the multiplex buffer are modified to allow only a specific number of consecutive packets to enter.
- the rules would be as follows:
- N and M the transport buffers (TB) in the TS-STD of Figure 4 . Since an individual program's stream rate is dominated by the video, a reasonable approach would be to use the video transport buffer drain rate for all stream components (i.e., including audio).
- the drain rate of video transport buffer (TB) used in the TS-STD is determined by the video bitstream's maximum bitrate and is generally 1.2 times that maximum bitrate. The video transport drain rate can be found in the bit_rate_value carried in the Video Sequence Header.
- the average bitrate of the incoming stream must be less than the average bitrate of the outgoing stream.
- M / N TB outgoing_rate / TB incoming_rate . This sets the ratio of M and N.
- TB 512byte. Assume a drain rate of 24Mbps.
- the TB referred to here is the transport buffer in the TV decoder.
- the incoming transport buffer rate of the TV i.e., QAM channel
- the incoming transport buffer rate of the TV is 38.8Mbps, which is approximately one transport packet every 40 ⁇ sec.
- a method proceeds to limit the number of consecutive packets and frequency of packets from each SPTS with PCR Restamping/NULL padding set to on.
- Another embodiment of a method to minimize the timing artifacts is to use the PCRs to "pace" the data from multiple streams during the remultiplexing process.
- the PCR in the transport stream header and the PTS's in the video stream are directly related as a result of the encoding process.
- all video and audio streams included in a program must get their time stamps from a common System Time Clock (STC) so that synchronization of the video and audio decoders with each other can be accomplished. This is explained in the MPEG2 standards.
- STC System Time Clock
- STC' is the Edge QAM's estimate of the STC associated with a given video / audio program.
- ⁇ ' is the offset estimate between STC' and the Master Clock shown in Figure 18 .
- ⁇ '(n) T(n) - PCR (n) .
- the access units In a streaming application, when the video / audio data is pulled off a storage media or a buffer, the access units must be output at a rate which will not cause overflow or underflow in the decoder buffer at the receiver. This is usually achieved by looking at the PTS/DTS values of the access units.
- the PTS/DTS fields appear in the PES header of the access unit and need parsing of the transport stream beyond transport header ( Figure 14 ).
- the PTS/DTS values are related to the PCR as stated above and the PCR value is easily accessible in the transport header, the goal of managing the data rate of the streaming can be achieved by pacing the data using PCR values and parsing the transport header only Figure 15 ). So, rather than rely on PCR restamping to eliminate PCR jitter, the PCR time stamps can be used to pace the data.
- PCR time stamps are required to occur at maximum 100mS intervals, but often occur at a faster rate, such as every 40 msec, for example.
- the PCR is based on a 27MHz clock. In the original stream, which is assumed to be compliant, after a PCR is recorded, the next PCR will occur within the next 100msec and its value will match the time that the packet arrives. Because of the jitter produced by the IP network, the packet may arrive early or late. To pace the data, the PCRs can be used to release packets to a downstream smoothing buffer after holding that packet and all following packets until the associated STC' matches the PCR.
- Figure 16 includes additions to the single QAM channel remultiplexing process to pace data based on the PCR time stamps.
- the NULL stuffing function is still required to fill out the full transport stream once several SPTS have been remultiplexed to form a new partial MPTS.
- the PCR restamping function is not needed since the PCRs should already be correct for their position in the transport stream, but it doesn't hurt to leave the PCR restamping function on. In most cases, the new PCR should match the old PCR.
- This method can work well, but has the following disadvantage: If STC' is late because the 1 st PCR is late, then there is more delay between the IP receiver and remultiplexer than there needs to be. This wastes QAM buffer space. If the first PCR is early, then packets will be released as soon as they arrive and little improvement would be gained. Therefore, this scheme could benefit from some PCR to master clock adaptation as will be explained later.
- This method can also improve the stream characteristics, but suffers from the following disadvantage.
- the continual reset of the STC' to Master Clock relationship has the problem that the relationship with the master clock causes slips to STC', causing the streaming buffer to grow in size.
- ⁇ "(n) M/N * ⁇ "(n-1) + (N-M)/N * ⁇ '(n).
- This method has infinite memory.
- ⁇ "(n) sum of (1/2 i * ⁇ '(i)) * 2N/(2N-1) where i ranges from n-N to n).
- the remultiplexing process is further illustrated in Figure 18 for the case of a fixed ⁇ ' based on the arrival of the first PCR (i.e., flowchart A in Figure 17 ). Note that once the PCR packets of both streams have passed the "time_to_send", packets can be alternated until packets are not available from either stream. If three or more SPTS's are being remultiplexed, then a round-robin approach can be used to load the multiplex buffer until no packets are available.
- a general aspect of the embodiments described herein is control of a plurality of single program transport streams during a remultiplexing process.
- Figure 19 is a method 1900 for controlling a plurality of single program transport streams during remultiplexing.
- the method commences with start block 1901 and proceeds to block 1910 for buffering a single program transport stream (SPTS). Control then proceeds to block 1920 for calculating a transfer rate to be used in transferring a transport packet from the buffer used in step 1910 to a multiplex buffer. Control then proceeds to block 1930 for transferring a transport packet to a multiplex buffer at the calculated transfer rate.
- SPTS single program transport stream
- the apparatus comprises a buffer 2010 of a single program transport stream which receives transport packets on its input.
- the output of buffer 2010 is in signal communication with a first input of processor 2020 and also with a first input of multiplex buffer 2030.
- Processor 2020 calculates a transfer rate to be used in transferring packets from buffer 2010 to multiplex buffer 2030 and generates an output control signal that is in signal communication with a second input of multiplex buffer 2030.
- Multiplex buffer 2030 stores transport packet data from buffer 2010.
- FIG. 21 Another embodiment of the principles described herein is a method 2100 shown in Figure 21 for controlling a plurality of single program transport streams during remultiplexing.
- the method commences with start block 2101and proceeds to block 2110 for limiting a number of consecutive single program transport streams coming from each of a plurality of streams. Control then proceeds to step 2120 for limiting a frequency of single program transport streams coming from each single program transport stream.
- Still another embodiment of the principles described herein is an apparatus 2200 for controlling a plurality of single program transport streams during remultiplexing, shown in Figure 22 .
- the apparatus comprises a processor 2210 that is configured to limit a number of consecutive packets from each single program transport stream and further configured to limit a frequency of packets from each single program transport stream.
- Processor 2210 receives buffered transport packets on its input and controls the transfer of these packets to another buffer.
- Processor 2210 has an output in signal communication with the receiver buffer to control the transfer process.
- FIG. 23 Another embodiment of the general principles is a method 2300 for controlling a plurality of single program transport streams during remultiplexing, shown in Figure 23 .
- This implementation controls the remultiplexing process using multiple program clock reference values such that packets from each single program transport stream are released only after a previous program clock reference value is greater than the system time.
- the method commences at start block 2301 and proceeds to block 2310 for checking whether a program clock reference value is present within a transport packet header. If the program clock references is absent from the transport packet header, control proceeds from block 2310 to block 2360 for releasing a transport packet to the single program transport stream queue.
- control proceeds from block 2310 to block 2320 to determine whether this transport packet is the first to contain a program clock reference value. If it is, control proceeds from block 2320 to block 2330 for calculating an offset time that is equal to the difference between the current time and the program clock reference value. Control then proceeds from block 2330 to block 2360 for releasing a transport packet to the single program transport stream queue.
- FIG. 24 Another embodiment of the described principles is an apparatus 2400 for controlling a plurality of single program transport streams during remultiplexing, shown in Figure 24 .
- This apparatus controls the remultiplexing process using multiple program clock reference values such that packets from each single program transport stream are released only after a previous program clock reference value is greater than the system time.
- the apparatus comprises a receiver 2410 of transport packets on its input, and whose output is in signal communication with an input of processor 2420 and also in signal communication with an input of control circuit 2440.
- Processor 2420 is configured to determine whether a program clock reference is present in the transport packet and whether the transport packet is the first packet to contain a PCR.
- Processor 2420 calculates at least one offset time to determine a time to transfer the transport packet to a single program transport stream queue.
- Processor 2420 is in signal communication with a port of control circuit 2440 and an output of processor 2420 is in signal communication with a first input of single program transport stream queue 2430.
- Control circuit 2440 has an output that is in signal communication with a second input of single program transport stream queue 2430 that receives the transport packet at the appropriate time.
- Control circuit 2440 retrieves the transport packet from receiver 2410 and transfers it to single program transport stream queue 2430 based on the current time, and at least one calculated offset time, which is calculated based on whether a program clock reference is contained in the transport header and whether it is the first transport packet to contain a PCR value.
- processor or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage.
- DSP digital signal processor
- ROM read-only memory
- RAM random access memory
- any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
- any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function.
- the present principles as defined by such claims reside in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.
- such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C).
- This may be extended, as readily apparent by one of ordinary skill in this and related arts, for as many items listed.
- the teachings of the present principles are implemented as a combination of hardware and software.
- the software may be implemented as an application program tangibly embodied on a program storage unit.
- the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
- the machine is implemented on a computer platform having hardware such as one or more central processing units (“CPU"), a random access memory (“RAM”), and input/output ("I/O") interfaces.
- CPU central processing units
- RAM random access memory
- I/O input/output
- the computer platform may also include an operating system and microinstruction code.
- the various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU.
- various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Time-Division Multiplex Systems (AREA)
Abstract
Description
- The present principles relate generally to methods and apparatus for minimization of timing artifacts in a remultiplexing process.
- The radio frequency (RF) signal for a standard television channel is able to carry multiple digital television programs simultaneously. Consequently, Edge QAMs used in the hospitality industries (e.g., hotels) include a remultimplexer function. The remultiplexer takes Transport Stream (TS) packets from several single program transport streams (SPTS) and inserts them into a multiple program transport stream (MPTS) for the respective television channel. Most of the Edge QAMs receive the input streams on an Internet Protocol (IP) interface. Because of the relatively large and often uncertain dynamically varying delays in the IP stack and input buffer, in some implementations the internal remultiplexer restamps the TS packets with a new program clock reference (PCR). This often creates timing artifacts that are noticeable on some digital televisions (DTVs).
- These and other drawbacks and disadvantages of the prior art are addressed by various described embodiments, which are directed to methods and apparatus for minimization of timing artifacts in remultiplexing, such as used in Edge QAMs.
- According to one general aspect, a plurality of single program transport streams are controlled during remultiplexing to a multi program transport stream. At least one SPTS is buffered and calculations are performed to determine a rate of transfer of transport packets to a multiplex buffer. The transport packets are transferred to a multiplex buffer at the calculated rate.
- According to another general aspect, control of the remultiplexing of a plurality of single program transport streams to a multi program transport stream is achieved by limiting a number of consecutive packets being transferred from any particular single program transport stream, and controlling the multiplex frequency from any particular stream.
- According to yet another general aspect, control of a plurality of single program transport streams during remultiplexing to a multi-program transport stream is based on using multiple program clock reference values such that packets from each single program transport stream are released only after a previous program clock reference value is greater than the system time.
- The details of one or more implementations are set forth in the accompanying drawings and the description below. Even if described in one particular manner, it should be clear that implementations may be configured or embodied in various manners. For example, an implementation may be performed as a method, or embodied as an apparatus, such as, for example, an apparatus configured to perform a set of operations or an apparatus storing instructions for performing a set of operations, or embodied in a signal. Other aspects and features will become apparent from the following detailed description considered in conjunction with the accompanying drawings and the claims.
- The present principles may be better understood in accordance with the following exemplary figures, in which:
-
Figure 1 shows an example hospitality system. -
Figure 2 shows a typical QAM modulator with transport stream remultiplexing. -
Figure 3 shows a single channel of a typical QAM modulator with transport stream remultiplexing. -
Figure 4 shows an MPEG-2 transport stream system target decoder -
Figure 5 shows a distribution of program clock reference interval before processing by an IP edge modulator. -
Figure 6 shows a distribution of program clock reference interval after processing by a prior art IP edge modulator. -
Figure 7 shows UDP packets for received single program transport stream. -
Figure 8 shows UDP packets for single program transport streams from a receiver to an IP edge modulator. -
Figure 9 shows a video transport buffer analysis for one test subchannel. -
Figure 10 shows an audio transport buffer analysis for one test subchannel. -
Figure 11 shows a single channel of a typical QAM modulator with small leaky buckets before transport stream remultiplexing. -
Figure 12 shows parsing of transport stream. -
Figure 13 shows a single channel of QAM Modulator with function to limit number of consecutive packets from each SPTS. -
Figure 14 shows parsing of stream for PTS in video PES layers. -
Figure 15 shows parsing of stream for program clock reference. -
Figure 16 shows single channel of QAM Modulator with function to read and use multiple PCR's during remultiplexing. -
Figure 17 shows flow diagrams of using PCR to hold up data until PCR matches QAM STC', shown for a single program) -
Figure 18 shows example timing diagrams of remultiplexing using PCRs to pace data. -
Figure 19 shows an embodiment of a method using the present principles. -
Figure 20 shows an embodiment of an apparatus using the present principles. -
Figure 21 shows a second embodiment of a method using the present principles. -
Figure 22 shows a second embodiment of an apparatus using the present principles. -
Figure 23 shows a third embodiment of a method using the present principles. -
Figure 24 shows a third embodiment of an apparatus using the present principles. - The described embodiments are directed to methods and apparatus for transporting digital multimedia signals, such as television programs, to customer equipment, and more particularly to audio-video program distribution systems that convert a plurality of single program transport streams (SPTS) into a multiple program transport stream (MPTS).
- In particular, the described embodiments can be used in IP Edge Modulators such as the cable quadrature amplitude modulation (QAM) modulators used in a hotel entertainment system to re-modulate and distribute TV programming that originates from a different broadcast network, such as a Satellite Video Broadcast System. Timing artifacts can occur when several single program transports streams are remultiplexed into a multi-program transport stream. Some hotels use entertainment systems that receive video signals from satellite service providers and then rebroadcast video programs in stacked quadrature amplitude modulation (QAM) RF channels. Each QAM channel can carry up to approximately 12 Standard Definition (SD) programs or 3 High Definition (HD) programs. Quite often, the infrastructure between the satellite receivers and the QAM is a jitter-inducing IP network. It is difficult to multiplex unrelated Single Program Transport Streams (SPTS) into a Multi-Program Transport Stream (MPTS) while minimizing introduced timing artifacts. Several low-cost methods that greatly reduce the possibility and magnitude of Transport Stream-System Target Decoder (TS-STD) buffer overflow violations.
- An example Satellite to Cable Re-broadcast System is shown in
Figure 1 . -
Figure 2 shows a typical IP edge QAM modulator. It includes an IP network interface for receiving the Ethernet frames. The Ethernet Frames are stored in a large buffer and then applied to an IP stack that recovers the MPEG2 transport stream (TS) packets. Those TS packets are analyzed in a manner that identifies their associated program. The program identifiers (PIDs) in the Program Association Table (PAT), Program Map Tables (PMTs), and MPEG2-TS packet headers are changed (remapped) to prepare for multiplexing sub-channels that will be broadcast in the same RF channel. From here, the MPEG2-TS packets go into multiplexers, one for each RF output channel. The purpose of the multiplex operation is to combine multiple variable-rate SPTS's into a constant rate MPTS prior to modulation. The focus will be on the MPTS multiplex process from here forward. - There are several prior methods for remultiplexing.
- A first prior art approach focuses on reducing latency in the remultiplexing process.
- An example of how the SPTS to MPTS multiplex process is implemented is described below. It should be noted that the MPTS remultiplexing processes used in IP Edge Modulators do not produce MPEG2 MPTS's that are fully compliant with regards to timing. This is partially due to cost. A hotel operator cannot support the same level of equipment that can be supported by a national broadcaster. For low-cost IP Edge multiplexors, there is no re-encoding of the elementary stream (ES) and therefore statistical multiplexing cannot be accomplished. In a statistical multiplexing process, the rate of each ES is controlled so that the sum of all of the rates is less than the full transport stream rate. In other words, the rates of all of the streams in the multiplex are related. In the multiplexing process, there is no re-encoding. There may be several packets from different SPTS's that should be sent next, but only one can. So, in most cases, there is a compromise between cost and performance.
- Another approach used in IP Edge QAM modulators is to use a QAM modulator IC or QAM modulator FPGA core to do the actual packet coding and modulation. In a second prior art method, each core can generate up to 4 QAM channels, each of which may carry multiple sub-channels. The multiplexing of the sub-channels into the channel is done by the processing that loads packets into the front end queue of each channel. Similar to other QAM modulators, this core contains several input modes. One mode that is used in this prior art device is the "PCR Restamping" mode.
- TS PCR Restamping is useful in certain applications where some form of rate adaption is required. The TS PCR restamping extension core provides a TS interface to allow data to be input at any rate. The core will pad the input TS stream with NULL TS packets as required and perform any PCR adjustment. When the PCR restamping extension core is used, an output signal is provided that indicates the necessary 188-byte TS byte_rate to satisfy the on-air requirements. In this example, the output bitrate of each QAM channel is 38.8Mbps.
- The output stage clocks the data packets out of the multiplex buffer at a constant rate and then modulates the appropriate RF carrier for the designated television channel with that data. Because such television signal generation utilizes quadrature amplitude modulation, this type of IP edge multiplexer is often referred to as an "edge QAM."
- Because the RF signal for a standard television channel is able to carry multiple digital television programs at the same time, the multiplexer's function is to create a transport stream containing the TS packets for those multiple programs. Thus, the multiplexer takes TS packets from several single program transport streams and inserts them into a multiple program transport stream for the respective television channel. Because of the relatively large and often uncertain dynamically varying delays in the IP stack and the input buffer, the internal multiplexer re-stamps the TS packets with a new program clock reference (PCR). The multiplexer also generates a new program map table and a new program association table to ensure proper construction of the MPTS.
- The focus of the described embodiments is the process of converting multiple variable rate transport streams into a constant rate stream in an output RF channel. This includes the process of multiplexing multiple SPTS into a single MPTS. To simplify the explanation and drawings, the focus in the discussion will be on a single RF output channel of the Edge QAM. A single output channel of the example Edge QAM is shown in
Figure 3 . - As each Ethernet frame is received, its group of transport stream packets is extracted and placed into a large input buffer. The conventional input buffer simultaneously stores groups of transport stream packets from a large number of Ethernet frames and a plurality of separate programs. The input buffer is implemented by a very large random access memory so that all the incoming TS packets can be stored until one can be processed by the respective modulator circuit. A relatively large amount of buffer memory is required to provide time for the IP Edge Multiplexer to construct the program specific information (PSI), specifically the PAT and the PMT, for the audio-video content being transported. The size of the input buffer varies dynamically based on the amount of incoming data that has to be stored before the multiplexers can process that data.
- In this example implementation, when MPEG packets destined for a specific output channel are available and there is room in the associated Multiplex Buffer, packets are transferred to that buffer. Note that if there are 7 MPEG2-TS packets in each IP packet, then the Multiplex buffer can hold about 1½ IP packets. The packets are loaded based on their availability. In many cases, buffers for one program may be emptied before the processor sequentially processes another program. It is possible to have 7 packets from one program loaded into the buffer followed by another 7 from the same program.
- Packets are transferred from the Multiplex Buffer (MB) to the TS FIFO (First In First Out) as long as there is a packet in the Multiplex Buffer and there is room in the TS FIFO. If the TS FIFO empties and there are no MPEG packets in the Multiplex Buffer, then the QAM Modulator Core inserts a NULL packet as previously explained. This is to maintain the necessary constant packet rate needed to produce the television channel output signal.
- In addition to being syntactically correct, a MPTS must also meet certain timing constraints. This is usually handled by an expensive MPEG Statistical Multiplexer at the Broadcast Service Provider's head-end. Each SPTS must meet the buffer requirements in the MPEG Transport Stream System Target Decoder (TS- STD) without overflowing buffers. See
Figure 4 . Additionally, each Elementary Stream (ES) must also not overflow ES buffers. - Some general TS-STD Rules for MPEG2-TS are shown below:
- A Transport Buffer (TB) shall empty at least once/sec.
- Program Clock Reference (PCR) associated with Presentation Units shall occur at least every 100msec. Typical is every 40msec. PCRs are carried in the adaptation field of TS packets and can be used to create a synchronized clock between the transmitter and receiver (assuming a well behaved channel). Data from the TS enters the T-STD at a piecewise constant rate between PCRs (bytes from all programs in the transport stream divided by the difference in PCRs from a specific program).
- The Presentation Time Stamp (PTS) shall be encoded into presentation units at least every 700msec. The Decoding Time Stamps (DTS) are only present if different from PTS. PTS and DTS are contained in the PES (Packetized Elementary Stream) header.
- For many broadcast systems, there is one access unit (AU) per PES packet. This allows a PTS to be sent for every picture.
- Rxvideo = 1.2 X Rmax [profile, level] . Rmax is specified in the Video Sequence Header. Rxvideo is the rate at which data is removed from the Transport Buffer (TB).
- The rate at which video (PES payload data) is removed from the MB, Rbxvideo= 15Mbps for SD using Leak Method. The Leak method is used when vbv_delay is not specified in the bitstream.
- ∘
- ∘ min{1.05 X Res; Rmax} for HD using Leak Method. Res is specified in video elementary stream.
- o For the vbv_delay (Video Buffer Verifier delay) method, the time it takes to transfer a picture from the MB to the EB is vbv_delay. Therefore, the transfer of each picture is a piecewise constant rate derived from vbv_delay. vbv_delay is carried in the Picture Header for MPEG2-TS.
- For some broadcast systems, the coded vbv buffer size is less than or equal to 7,995,392 bits (vbv_buffer_size≤488) and the vbv_delay is less than or equal to 0.5 seconds (vbv_delay≤45000). vbv_buffer_size is an 18-bit integer specifying the size (in units of 2048 bytes) of the VBV and carried in Sequence Header. vbv_delay is an 16-bit integer whose value is the number of periods of a 90KHz clock derived from the 27MHz system clock that the VBV shall wait after receiving the final byte of the picture start code before the decoding the picture. The vbv buffer size and vbv_delay limit the allowed fluctuations in the video portion of the bit stream.
- A timing model of an STD can be found in Annex D of the MPEG2-1 system specification.
- The IP stack in the receivers and the input buffer of the IP edge modulator introduce significant jitter in the transmission of the TS packets for each program. Specifically, the IP stack introduces an indeterminate and varying delay, which can be up to an additional ½ second.
- Although by using the PCR Restamping function shown in
Figure 3 , PCR jitter is reduced to a reasonable value, the relationship between the PCR of a program and the video and audio Presentation Time Stamps (PTS) have been perturbed by the process. When packets with a PCR are restamped, the new value is only based on the packet position within the newly created MPTS. - As an illustration of the impairments, one minute of one program was analyzed in the IP domain and at the QAM output. The distortion between the PCR and the PTS manifests itself in several ways. Specifically, the SPTS within a channel from some IP Edge QAMs do not meet the TS-TSD buffer requirements (See
Figure 4 ). This can lead to video/audio artifacts in some MPEG decoders (for example, digital televisions, STBs, DTAs, etc.). -
Figure 5 shows the distribution of PCR Interval before processing by an IP Edge Modulator. The PCR accuracy of the SPTS on the IP network was measured at about ±100msec. The target interval for PCRs is usually about 40msec. It can be seen that the distribution is still centered on that average value, but there is substantial spread in the PCR interval. -
Figure 6 shows the distribution of PCR Interval after processing by the prior-art IP edge modulator described here. Although the PCR accuracy of this signal measured ±200usec which is much closer to the MPEG2 compliant value of ±500nsec, the PCR Interval is more distorted than the PCR in the IP domain. Here, the PCR interval ranged from 0.232 ms to 59.785 msec. - The jitter introduced on the IP network is mostly due to the bursty nature in which packets are processed and transmitted, especially if a general purpose processor is used to process and route packets. The bursty nature of the packet transmission can be seen by looking at UDP (User Datagram Protocol) packets on the IP network. As has been said, most of the UDP packets contain 7 MPEG2-TS packets.
Figure 7 is a graph of how many packets are received at the IP edge modulator in a 100 msec period. This graph approximately follows the actual bit rate of the SPTS in the original MPTS. However, if one looks at the number of packets sent in 10msec interval, the traffic is much more bursty. SeeFigure 8 . Note that in one 10 msec interval, 10 UDP packets may be received while in the next 10 msec interval, no packets may be received. - Table 1 shows a summary of some important parameters of this one minute live video capture. Note that the Transport Buffer Fullness is exceeded in many places and the Elementary Stream Buffer Fullness limit is exceeded for Dolby Audio for two out of the three programs.
Table 1 Buffer Statistics for 1 minute channel capture PID Stream Type Transport Drain Rate (kbps) Transport Buffer Fullness (%) ES Buffer Size (bits) ES Buffer Fullness (%) min Max min avg max 0x000 0 MPEG2 PSI PAT 1,000 0.00 0 36.719 0x001 0 MPEG2 PSI PMT 1,000 0.00 0 36.719 0x001 1 MPEG4 Video 24,000 0.00 0 925.00 30,000,0 00 3.730 11.34 4 25.778 0x001 2 Dolby Digital Audio 2,000 0.00 0 116.79 7 45,568 31.46 1 47.18 7 62.921 0x002 0 MPEG2 PSI PMT 1,000 0.00 0 36.719 0x002 1 MPEG4 Video 24,000 0.00 0 730.27 3 30,000,0 00 4.311 11.25 3 20.514 0x002 2 Dolby Digital Audio 2,000 0.00 0 89.063 45,568 0.000 62.93 7 137.50 0 0x002 3 CA related 1,000 0.00 0 36.719 0x003 0 MPEG2 PSI PMT 1,000 0.00 0 36.719 0x003 1 MPEG4 Video 24,000 0.00 0 717.18 8 30,000,0 00 6.497 12.00 1 21.236 0x003 2 Dolby Digital Audio 2,000 0.00 0 63.086 45,568 0.000 63.22 1 269.66 3 0x003 3 CA Related 1,000 0.00 0 36.719 - A graph showing the Transport Buffer Fullness as a function of time for one of the video streams is shown in
Figure 9 . Notice that the Transport Buffer Fullness is almost always above the limit. Transport Buffer Fullness of an audio stream is shown inFigure 10 . Although the Transport Buffer Fullness is mostly within the required limit, it was noted earlier that the ES Buffer Fullness limit is exceeded. - It is desirable to maintain low cost transport stream multiplexing while reducing, although perhaps not eliminating, re-multiplexing timing artifacts.
- One method to minimize the TS-STD transport buffer overflows is to rate control the packets from each program entering the MPTS multiplex buffer. This can be done using a series of leaky buckets as shown in
Figure 11 . The leaky buckets are placed between the previously described IP processing and the multiplex buffer. As packets "leak" from each bucket, they are placed in the multiplex buffer. The leaky buckets can be in an FPGA since the multiplex buffer can also be implemented in an FPGA. In this case, the multiplex buffer should be made large to minimize overflow, although flow control can easily be implemented. - In one embodiment, there is a leaky bucket for each program. The exit rate of the bucket should be set approximately to the drain rate used by the TS-STD in its transport buffers to determine compliance. Since an individual program's stream rate is dominated by the video, a reasonable approach would be to use the video transport buffer drain rate. The video transport drain rate can be derived from the bit_rate_value carried in the Video Sequence Header. If there is not enough processing power to parse the video stream down to the Video Sequence Header, then it is also possible to base the leak rate on the stream_type, which is carried in the Program Map Table (PMT) and/or the stream_id, which is carried in the PES Header. An even simpler approach would be to set the leak rate of all of the buckets to a constant that doesn't change. Good values would be 18 Mbps for SD video and 24 Mbps for HD video (see Table 2). In many cases, it is also possible to get information on the maximum bit rate, and therefore the transport buffer (TB) drain rate, through an out-of-band channel such as an Electronic Program Guide (EPG).
- A more refined variation of this method would be to route each elementary stream through its own leaky bucket. This would be more precise and would reduce more artifacts, but it is a complexity/performance tradeoff. This is a straightforward extension of one leaky bucket per program and will not be explained further.
Table 2 Typical Video Transport Buffer Drain Rates Stream Type Typical Max Bit Rate* Associated Transport Buffer Drain Rate (RXvideo) in Mbps MPEG-2 Part 2 Video (Mail Level)15 18 MPEG-2 Part 2 Video (High Level)19.4 23.28 MPEG-4 Part 10 video (< Level 3.0)2 2.4 MPEG-4 Part 10 video (< Level 3.0)10 12 MPEG-4 Part 10 video (< Level 3.0)20 24 * Specified in bit_rate_value field of Video Sequence Header. - One embodiment of a method using the general aspects herein described is as follows:
- 1. Leaky Bucket on each SPTS being multiplexed into the MPTS with PCR Restamping/NULL padding set to on.
- a. Leak Rate set based on bit_rate_value.
- b. Leak rate set based on stream_type and/or stream_id.
- c. Leak Rate set to a constant
- 2. Or Leaky Bucket on each Elementary Stream.
- a. Leak Rate set based on bit_rate_value.
- b. Leak rate set based on stream_type and/or stream_id.
- c. Leak Rate set to a constant
- Another embodiment of a method to minimize the TS-STD transport buffer overflows is to control the number of consecutive packets from each program entering the MPTS multiplex buffer. This can be done by modifying the algorithm that releases packets to the multiplex buffer as shown in
Figure 13 . - In this embodiment, the rules for transferring packets from each program into the multiplex buffer are modified to allow only a specific number of consecutive packets to enter. The rules would be as follows:
- 1. For remultiplexing of two streams:
- a. Alternate packets when both steams have packets available to transfer.
- b. When only one stream has packets available to transfer, transfer no more than M out of every N packets.
- 2. For remultiplexing of three or more streams
- a. Round-robin on packets from all steams that have packets available to transfer.
- b. When only one stream has packets available to transfer, transfer no more than M out of every N packets.
- To determine N and M, we consider the transport buffers (TB) in the TS-STD of
Figure 4 . Since an individual program's stream rate is dominated by the video, a reasonable approach would be to use the video transport buffer drain rate for all stream components (i.e., including audio). The drain rate of video transport buffer (TB) used in the TS-STD is determined by the video bitstream's maximum bitrate and is generally 1.2 times that maximum bitrate. The video transport drain rate can be found in the bit_rate_value carried in the Video Sequence Header. If there is not enough processing power to parse the video stream down to the Video Sequence Header, then it is also possible to base the drain rate on the stream_type, which is carried in the Program Map Table (PMT) and/or the stream_id, which is carried in the PES Header. An even simpler approach would be to use a drain rate that doesn't change. Good values would be 18 Mbps for SD video and 24 Mbps for HD video (see Table 2). In many cases, it is also possible to get information on the maximum bit rate and therefore the transport buffer drain rate through an out-of-band channel such as an Electronic Program Guide (EPG). - For the transport buffer level to at least remain constant and not overflow, the average bitrate of the incoming stream must be less than the average bitrate of the outgoing stream. So,
- In this embodiment, a method proceeds to limit the number of consecutive packets and frequency of packets from each SPTS with PCR Restamping/NULL padding set to on.
- Another embodiment of a method to minimize the timing artifacts is to use the PCRs to "pace" the data from multiple streams during the remultiplexing process.
- The PCR in the transport stream header and the PTS's in the video stream are directly related as a result of the encoding process. In the encoding process, all video and audio streams included in a program must get their time stamps from a common System Time Clock (STC) so that synchronization of the video and audio decoders with each other can be accomplished. This is explained in the MPEG2 standards. The perturbation of this relationship by the IP network is what leads to the buffer overflow violations described earlier.
- In the following, STC' is the Edge QAM's estimate of the STC associated with a given video / audio program. Δ' is the offset estimate between STC' and the Master Clock shown in
Figure 18 . For the purposes of correlating the flowcharts inFigure 17 with the clocks shown inFigure 18 , please note that Δ'(n) = T(n) - PCR (n) . - In a streaming application, when the video / audio data is pulled off a storage media or a buffer, the access units must be output at a rate which will not cause overflow or underflow in the decoder buffer at the receiver. This is usually achieved by looking at the PTS/DTS values of the access units. The PTS/DTS fields appear in the PES header of the access unit and need parsing of the transport stream beyond transport header (
Figure 14 ). - Since the PTS/DTS values are related to the PCR as stated above and the PCR value is easily accessible in the transport header, the goal of managing the data rate of the streaming can be achieved by pacing the data using PCR values and parsing the transport header only
Figure 15 ). So, rather than rely on PCR restamping to eliminate PCR jitter, the PCR time stamps can be used to pace the data. - PCR time stamps are required to occur at maximum 100mS intervals, but often occur at a faster rate, such as every 40 msec, for example. The PCR is based on a 27MHz clock. In the original stream, which is assumed to be compliant, after a PCR is recorded, the next PCR will occur within the next 100msec and its value will match the time that the packet arrives. Because of the jitter produced by the IP network, the packet may arrive early or late. To pace the data, the PCRs can be used to release packets to a downstream smoothing buffer after holding that packet and all following packets until the associated STC' matches the PCR.
-
Figure 16 includes additions to the single QAM channel remultiplexing process to pace data based on the PCR time stamps. The NULL stuffing function is still required to fill out the full transport stream once several SPTS have been remultiplexed to form a new partial MPTS. The PCR restamping function is not needed since the PCRs should already be correct for their position in the transport stream, but it doesn't hurt to leave the PCR restamping function on. In most cases, the new PCR should match the old PCR. - In flowchart A of
Figure 17 , the box that says "time_to_send=PCR-PCR(1)+T(1)" could be written as "time_to_send=PCR- Δ'(1)" Since Δ'(1) does not change, this offset is used for all subsequent packets and the relationship between the master clock and the estimate of the STC clock (STC') is a fixed offset. The first PCR packet sets the relationship between STC' and PCR. This is illustrated inFigure 18 . - This method can work well, but has the following disadvantage: If STC' is late because the 1st PCR is late, then there is more delay between the IP receiver and remultiplexer than there needs to be. This wastes QAM buffer space. If the first PCR is early, then packets will be released as soon as they arrive and little improvement would be gained. Therefore, this scheme could benefit from some PCR to master clock adaptation as will be explained later.
- In flowchart B of
Figure 17 , the box that says "time_to_send=PCR(n)-PCR(n-1))+T(n-1)" could be written equivalently as "time_to_send=PCR(n)-Δ'(n-1)". In this case, Δ'(n) = T (n) - (PCR(n)) and the STC'/Master Clock relationship therefore is only based on the previous PCR sample. - This method can also improve the stream characteristics, but suffers from the following disadvantage. The continual reset of the STC' to Master Clock relationship has the problem that the relationship with the master clock causes slips to STC', causing the streaming buffer to grow in size.
- A better approach to these two would be to have a somewhat stable Δ', but let it find its optimal value over time. For this, a hybrid approach can be used, where the estimate of the offset Δ' adapts and is refined over time. This is shown for a single SPTS in flowchart C of
Figure 17 . Instead of just using the first PCR to estimate a fixed Δ', one can use the current and past PCRs to update the estimate of delta. With Δ'(n) = T(n) - (PCR(n)) for each of the PCRs as in Flowchart B, a current estimate of the adaptive offset Δ" may be generally calculated as Δ"(n) = f({Δ'(i)|i=1 to n}). There are many functions "f" that can be used, but one approach bases Δ"(n) on the weighted sum of the current estimate Δ'(n) and the previous estimate of the adaptive offset Δ"(n-1): Δ"(n) = M/N * Δ"(n-1) + (N-M)/N * Δ'(n). This method has infinite memory. Alternatively, the estimate of Δ"(n) could be determined only by the last N estimates of Δ'(n). (e.g., Δ"(n)= sum of (1/2i * Δ'(i)) * 2N/(2N-1) where i ranges from n-N to n). Other variations are possible. - The remultiplexing process is further illustrated in
Figure 18 for the case of a fixed Δ' based on the arrival of the first PCR (i.e., flowchart A inFigure 17 ). Note that once the PCR packets of both streams have passed the "time_to_send", packets can be alternated until packets are not available from either stream. If three or more SPTS's are being remultiplexed, then a round-robin approach can be used to load the multiplex buffer until no packets are available. - A general aspect of the embodiments described herein is control of a plurality of single program transport streams during a remultiplexing process.
- One embodiment of such a system is shown in
Figure 19 , which is amethod 1900 for controlling a plurality of single program transport streams during remultiplexing. The method commences withstart block 1901 and proceeds to block 1910 for buffering a single program transport stream (SPTS). Control then proceeds to block 1920 for calculating a transfer rate to be used in transferring a transport packet from the buffer used instep 1910 to a multiplex buffer. Control then proceeds to block 1930 for transferring a transport packet to a multiplex buffer at the calculated transfer rate. - Another embodiment of the general aspects described herein is an
apparatus 2000 for controlling a plurality of single program transport streams during remultiplexing. The apparatus comprises abuffer 2010 of a single program transport stream which receives transport packets on its input. The output ofbuffer 2010 is in signal communication with a first input ofprocessor 2020 and also with a first input ofmultiplex buffer 2030.Processor 2020 calculates a transfer rate to be used in transferring packets frombuffer 2010 tomultiplex buffer 2030 and generates an output control signal that is in signal communication with a second input ofmultiplex buffer 2030.Multiplex buffer 2030 stores transport packet data frombuffer 2010. - Another embodiment of the principles described herein is a
method 2100 shown inFigure 21 for controlling a plurality of single program transport streams during remultiplexing. The method commences with start block 2101and proceeds to block 2110 for limiting a number of consecutive single program transport streams coming from each of a plurality of streams. Control then proceeds to step 2120 for limiting a frequency of single program transport streams coming from each single program transport stream. - Still another embodiment of the principles described herein is an
apparatus 2200 for controlling a plurality of single program transport streams during remultiplexing, shown inFigure 22 . The apparatus comprises aprocessor 2210 that is configured to limit a number of consecutive packets from each single program transport stream and further configured to limit a frequency of packets from each single program transport stream.Processor 2210 receives buffered transport packets on its input and controls the transfer of these packets to another buffer.Processor 2210 has an output in signal communication with the receiver buffer to control the transfer process. - Another embodiment of the general principles is a
method 2300 for controlling a plurality of single program transport streams during remultiplexing, shown inFigure 23 . This implementation controls the remultiplexing process using multiple program clock reference values such that packets from each single program transport stream are released only after a previous program clock reference value is greater than the system time. The method commences atstart block 2301 and proceeds to block 2310 for checking whether a program clock reference value is present within a transport packet header. If the program clock references is absent from the transport packet header, control proceeds fromblock 2310 to block 2360 for releasing a transport packet to the single program transport stream queue. - If, however, a program clock reference value is present within the transport packet header being checked in
block 2310, control proceeds fromblock 2310 to block 2320 to determine whether this transport packet is the first to contain a program clock reference value. If it is, control proceeds fromblock 2320 to block 2330 for calculating an offset time that is equal to the difference between the current time and the program clock reference value. Control then proceeds fromblock 2330 to block 2360 for releasing a transport packet to the single program transport stream queue. - If, however, in
block 2320 it is determined that the current transport packet is not the first packet containing a program clock reference value, control then proceeds fromblock 2320 to block 2340 for updating an offset time to be equal to a function of the difference between a current time and the program clock reference value. Control then proceeds fromblock 2340 to block 2350 to determine whether the current time has reached a time to send, based on the updated offset time. If the time to send has not yet been reached, block 2350 will recheck the time until the time to send is reached. When the time has reached the time to send, control proceeds fromblock 2350 to block 2360 for releasing a transport packet to the single program transport stream queue. - Another embodiment of the described principles is an
apparatus 2400 for controlling a plurality of single program transport streams during remultiplexing, shown inFigure 24 . This apparatus controls the remultiplexing process using multiple program clock reference values such that packets from each single program transport stream are released only after a previous program clock reference value is greater than the system time. - The apparatus comprises a
receiver 2410 of transport packets on its input, and whose output is in signal communication with an input ofprocessor 2420 and also in signal communication with an input ofcontrol circuit 2440.Processor 2420 is configured to determine whether a program clock reference is present in the transport packet and whether the transport packet is the first packet to contain a PCR.Processor 2420 calculates at least one offset time to determine a time to transfer the transport packet to a single program transport stream queue.Processor 2420 is in signal communication with a port ofcontrol circuit 2440 and an output ofprocessor 2420 is in signal communication with a first input of single programtransport stream queue 2430.Control circuit 2440 has an output that is in signal communication with a second input of single programtransport stream queue 2430 that receives the transport packet at the appropriate time.Control circuit 2440 retrieves the transport packet fromreceiver 2410 and transfers it to single programtransport stream queue 2430 based on the current time, and at least one calculated offset time, which is calculated based on whether a program clock reference is contained in the transport header and whether it is the first transport packet to contain a PCR value. - The present description illustrates the present principles.
It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the present principles and are thereby included within the present principles. - All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the present principles and the concepts contributed by the inventor(s) to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions.
- Moreover, all statements herein reciting principles, aspects, and embodiments of the present principles, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
- Thus, for example, it will be appreciated by those skilled in the art that the block diagrams presented herein represent conceptual views of illustrative circuitry embodying the present principles. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudocode, and the like represent various processes which may be substantially represented in computer readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
- The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term "processor" or "controller" should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor ("DSP") hardware, read-only memory ("ROM") for storing software, random access memory ("RAM"), and non-volatile storage.
- Other hardware, conventional and/or custom, may also be included. Similarly, any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
- In the claims hereof, any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements that performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function. The present principles as defined by such claims reside in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.
- Reference in the specification to "one embodiment" or "an embodiment" of the present principles, as well as other variations thereof, means that a particular feature, structure, characteristic, and so forth described in connection with the embodiment is included in at least one embodiment of the present principles. Thus, the appearances of the phrase "in one embodiment" or "in an embodiment", as well any other variations, appearing in various places throughout the specification are not necessarily all referring to the same embodiment.
- It is to be appreciated that the use of any of the following "/", "and/or", and "at least one of", for example, in the cases of "A/B", "A and/or B" and "at least one of A and B", is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of both options (A and B). As a further example, in the cases of "A, B, and/or C" and "at least one of A, B, and C", such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C). This may be extended, as readily apparent by one of ordinary skill in this and related arts, for as many items listed.
- These and other features and advantages of the present principles may be readily ascertained by one of ordinary skill in the pertinent art based on the teachings herein. It is to be understood that the teachings of the present principles may be implemented in various forms of hardware, software, firmware, special purpose processors, or combinations thereof.
- Most preferably, the teachings of the present principles are implemented as a combination of hardware and software. Moreover, the software may be implemented as an application program tangibly embodied on a program storage unit. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units ("CPU"), a random access memory ("RAM"), and input/output ("I/O") interfaces. The computer platform may also include an operating system and microinstruction code. The various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU. In addition, various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.
- It is to be further understood that, because some of the constituent system components and methods depicted in the accompanying drawings are preferably implemented in software, the actual connections between the system components or the process function blocks may differ depending upon the manner in which the present principles are programmed. Given the teachings herein, one of ordinary skill in the pertinent art will be able to contemplate these and similar implementations or configurations of the present principles.
Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the present principles are not limited to those precise embodiments, and that various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the scope of the present principles. All such changes and modifications are intended to be included within the scope of the present principles as set forth in the appended claims.
Claims (13)
- A method for controlling a plurality of single program transport streams during remultiplexing, comprising:Buffering (1910) at least one stream of a plurality of single program transport streams;calculating (1920) respective rates for each of the at least one buffered streams at which each of the at least one streams transfers data to a multiplex buffer; andtransferring (1930) the buffered data to a multiplex buffer at said respective calculated rates.
- An apparatus for controlling a plurality of single program transport streams during remultiplexing, comprising:a buffer (2010) of a single program transport stream;a processor (2020) that calculates a transfer rate from said buffer; and,a multiplex buffer (2030) that stores data transferred from said buffer.
- The method of Claim 1 or the apparatus of Claim 2, further comprising buffering each of the plurality of single program transport streams;
restamping a program clock reference value; and, padding the stream with null packets. - The method of Claim 1 or the apparatus of Claim 2, further comprising buffering each elementary stream of the plurality of single program transport streams.
- The method of Claim 1 or the apparatus of Claim 2, further comprising basing the rate on at least one of bit_rate_value, stream_type, stream_id, or a constant value.
- A method for controlling a plurality of single program transport streams during remultiplexing, comprising:limiting (2110) respective numbers of consecutive packets from each of said single program transport streams;limiting (2120) respective frequencies of packets from each of said single program transport streams;when program clock reference and null padding are active.
- An apparatus for controlling a plurality of single program transport streams during remultiplexing, comprising:a processor (2210), configured to limit a number of consecutive packets from each single program transport stream, and further configured to limit a frequency of packets from each single program transport stream;wherein program clock reference and null padding are active.
- The method of Claim 6 or the apparatus of Claim 7, wherein frequency is based on bit_rate_value being carried in Video Sequence Header.
- The method of Claim 6 or the apparatus of Claim 7, wherein frequency is based on stream_type in Program Map Table, and/or based on stream_id from PES Header.
- The method of Claim 6 or the apparatus of Claim 7, wherein frequency is based on a constant.
- The method of Claim 6 or the apparatus of Claim 7, wherein frequency is based on data from an out of band channel.
- A method for controlling a plurality of single program transport streams during remultiplexing, comprising:releasing (2310) a transport packet to a single program transport stream queue if a program clock reference value is not present in the transport packet header;releasing (2320) the transport packet to a single program transport stream queue after storing an offset time that is a difference between a current time and the program clock reference if a program clock reference value is present in the transport packet header and the transport packet is a first packet to contain a program clock reference; and,releasing (2360) the transport packet to a single program transport stream queue when a time is reached that is equal to an updated offset time plus the program clock reference value if a program clock reference value is present in the transport packet header and the transport packet is not a first packet to contain a program clock reference, said updated offset time being a function of a difference between a current time and the program clock reference.
- An apparatus for controlling a plurality of single program transport streams during remultiplexing, comprising:a receiver (2410) of a transport packet;a processor (2420), configured to determine whether a program clock reference is present in the transport packet and whether the transport packet is a first packet to contain a program clock reference, and that calculates at least one offset time to determine a time to transfer said transport packet;a single program transport stream queue (2430) that receives said transport packet; and,control circuitry (2440) that retrieves said transport packet from the receiver and transfers it to the single program transport stream queue based on said offset time and whether a program clock reference is present in the transport packet and whether the transport packet is a first packet to contain a program clock reference.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201462092998P | 2014-12-17 | 2014-12-17 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3035691A2 true EP3035691A2 (en) | 2016-06-22 |
EP3035691A3 EP3035691A3 (en) | 2016-08-24 |
Family
ID=55085498
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP15306973.7A Withdrawn EP3035691A3 (en) | 2014-12-17 | 2015-12-10 | Methods and apparatus for minimizing timing artifacts in remultiplexing |
Country Status (2)
Country | Link |
---|---|
US (1) | US10142675B2 (en) |
EP (1) | EP3035691A3 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10893308B2 (en) * | 2017-12-01 | 2021-01-12 | Harmonic, Inc. | Hybrid statistical multiplexer |
Family Cites Families (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5566174A (en) | 1994-04-08 | 1996-10-15 | Philips Electronics North America Corporation | MPEG information signal conversion system |
US5790543A (en) | 1995-09-25 | 1998-08-04 | Bell Atlantic Network Services, Inc. | Apparatus and method for correcting jitter in data packets |
US5828414A (en) | 1996-02-23 | 1998-10-27 | Divicom, Inc. | Reduction of timing jitter in audio-video transport streams |
US7092395B2 (en) | 1998-03-09 | 2006-08-15 | Lucent Technologies Inc. | Connection admission control and routing by allocating resources in network nodes |
EP1072156A2 (en) * | 1998-04-17 | 2001-01-31 | Tiernan Communications Incorporated | Apparatus and method for dynamic multiplexing |
KR100345353B1 (en) * | 1998-11-08 | 2005-07-29 | 엘지전자 주식회사 | Method and ap-paratus for creating and recording management information for digital data streams |
US6721271B1 (en) * | 1999-02-04 | 2004-04-13 | Nortel Networks Limited | Rate-controlled multi-class high-capacity packet switch |
US6330286B1 (en) * | 1999-06-09 | 2001-12-11 | Sarnoff Corporation | Flow control, latency control, and bitrate conversions in a timing correction and frame synchronization apparatus |
GB9930788D0 (en) * | 1999-12-30 | 2000-02-16 | Koninkl Philips Electronics Nv | Method and apparatus for converting data streams |
US6801536B1 (en) * | 2000-03-23 | 2004-10-05 | International Business Machines Corporation | Remultiplexing audio/video PES streams from an MPEG transport system |
WO2001082608A1 (en) * | 2000-04-21 | 2001-11-01 | Sony Corporation | Information processing apparatus and method, program, and recorded medium |
US6907481B2 (en) * | 2001-03-06 | 2005-06-14 | Ati Technologies, Inc. | System for bit-rate controlled digital stream playback and method thereof |
US7103047B1 (en) | 2001-06-26 | 2006-09-05 | Juniper Networks, Inc. | Method and apparatus for modifying the rate of MPEG transport streams |
US7269836B2 (en) * | 2003-03-24 | 2007-09-11 | International Business Machines Corporation | System and method for providing multiplexing and remultiplexing of MPEG-2 streams |
US7693222B2 (en) * | 2003-08-13 | 2010-04-06 | Ericsson Television Inc. | Method and system for re-multiplexing of content-modified MPEG-2 transport streams using PCR interpolation |
KR100584381B1 (en) * | 2004-02-04 | 2006-05-26 | 삼성전자주식회사 | Method for adjusting transmission rate of mpeg-2 data and apparatus therefor |
US7433946B2 (en) * | 2004-08-12 | 2008-10-07 | Microsoft Corporation | Mechanism for transmitting elementary streams in a broadcast environment |
EP1805990A4 (en) | 2004-10-27 | 2010-10-20 | Eg Technology Inc | Network architecture for real time delivery of video over lossy networks from remote locations |
KR100688089B1 (en) | 2005-09-27 | 2007-03-02 | 한국전자통신연구원 | Apparatus for multiplexing and demultiplexing in cable tv receiver |
JP4746998B2 (en) * | 2006-02-15 | 2011-08-10 | Necディスプレイソリューションズ株式会社 | Transmission rate adjusting device and transmission rate adjusting method |
US7626837B2 (en) | 2006-08-14 | 2009-12-01 | Agere Systems Inc. | Digitally controlled current-mode switched power supply |
JP2008066811A (en) * | 2006-09-05 | 2008-03-21 | Hitachi Ltd | Digital broadcast receiving system |
US7885189B2 (en) * | 2006-09-20 | 2011-02-08 | Rgb Networks, Inc. | Methods and apparatus for rate estimation and predictive rate control |
US7804761B2 (en) | 2007-05-09 | 2010-09-28 | Ceragon Networks Ltd. | Multiplexing separately modulated channels |
US7843969B2 (en) * | 2007-06-15 | 2010-11-30 | Screen Service Broadcasting Technologies S.P.A. | Communications system to feed multiple single frequency networks with multiple content |
US7831729B1 (en) * | 2007-06-15 | 2010-11-09 | Bigband Networks Inc. | Device and method for managing multiple versions of a single program transport stream |
US8468572B2 (en) | 2008-03-26 | 2013-06-18 | Cisco Technology, Inc. | Distributing digital video content to multiple end-user devices |
US20100150182A1 (en) * | 2008-12-12 | 2010-06-17 | Tandberg Television Inc. | Systems and methods for mutiplexing mpeg services for ip networks |
US9060187B2 (en) * | 2008-12-22 | 2015-06-16 | Netflix, Inc. | Bit rate stream switching |
US20100333149A1 (en) * | 2009-06-24 | 2010-12-30 | Rgb Networks, Inc. | Delivery of pre-statistically multiplexed streams in a vod system |
US8514853B2 (en) * | 2010-01-11 | 2013-08-20 | Cisco Technology, Inc. | Remote re-multiplexing of transport streams |
US8514893B2 (en) * | 2011-01-12 | 2013-08-20 | Videopropulsion Interactive, Inc. | Digital video apparatus for multiplexing single program transport streams into a multiple program transport stream |
US9332286B2 (en) * | 2011-10-28 | 2016-05-03 | Irdeto B.V. | Constructing a transport stream |
WO2014168893A1 (en) * | 2013-04-08 | 2014-10-16 | General Instrument Corporation | Signaling for addition or removal of layers in video coding |
-
2015
- 2015-12-10 EP EP15306973.7A patent/EP3035691A3/en not_active Withdrawn
- 2015-12-14 US US14/967,533 patent/US10142675B2/en active Active
Non-Patent Citations (1)
Title |
---|
None |
Also Published As
Publication number | Publication date |
---|---|
US20160182943A1 (en) | 2016-06-23 |
EP3035691A3 (en) | 2016-08-24 |
US10142675B2 (en) | 2018-11-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10015052B2 (en) | Cross layer coordinated channel bonding | |
US10708640B2 (en) | Channel bonding with multiple network types | |
US8046815B2 (en) | Optical network for bi-directional wireless communication | |
US8301982B2 (en) | RTP-based loss recovery and quality monitoring for non-IP and raw-IP MPEG transport flows | |
US9832515B2 (en) | DTS/PTS backward extrapolation for stream transition events | |
CA2625025C (en) | Ip broadcast system, and multiplexer, receiving apparatus and method used in ip broadcast system | |
US8166170B2 (en) | Distributed multiplexing | |
US9369746B2 (en) | Apparatus and method for tuning to a channel of a moving pictures expert group transport stream (MPEG-TS) | |
US20090013369A1 (en) | Device and Method for Initializing Decoder in Digital Broadcasting Receiver | |
JP2012147437A (en) | Digital video apparatus for multiplexing single program transport streams into multiple program transport stream | |
US20090251616A1 (en) | Apparatus and method for processing data in digital broadcasting receiver | |
US10142675B2 (en) | Method and apparatus for minimizing timing artifacts in remultiplexing | |
US10700799B2 (en) | Method and apparatus for broadcast signal transmission | |
Wagner et al. | A scalable fast channel change solution | |
Deen | Distributed encoding architectures | |
EP2093951A1 (en) | Method and device for processing multimedia data and communication system comprising such device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
PUAL | Search report despatched |
Free format text: ORIGINAL CODE: 0009013 |
|
AK | Designated contracting states |
Kind code of ref document: A3 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04N 21/2365 20110101ALI20160718BHEP Ipc: H04N 21/236 20110101AFI20160718BHEP |
|
17P | Request for examination filed |
Effective date: 20170221 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
17Q | First examination report despatched |
Effective date: 20170609 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20190130 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: INTERDIGITAL CE PATENT HOLDINGS |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20190612 |