EP1466476A4 - Kompressionsformatumsetzung mit niedriger bitrate für verbesserte auflösung - Google Patents
Kompressionsformatumsetzung mit niedriger bitrate für verbesserte auflösungInfo
- Publication number
- EP1466476A4 EP1466476A4 EP02803681A EP02803681A EP1466476A4 EP 1466476 A4 EP1466476 A4 EP 1466476A4 EP 02803681 A EP02803681 A EP 02803681A EP 02803681 A EP02803681 A EP 02803681A EP 1466476 A4 EP1466476 A4 EP 1466476A4
- Authority
- EP
- European Patent Office
- Prior art keywords
- resolution
- progressive
- fields
- recited
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000006243 chemical reaction Methods 0.000 title claims abstract description 29
- 230000006835 compression Effects 0.000 title description 8
- 238000007906 compression Methods 0.000 title description 8
- 230000000750 progressive effect Effects 0.000 claims abstract description 65
- 238000000034 method Methods 0.000 claims abstract description 35
- 230000005540 biological transmission Effects 0.000 claims description 9
- 238000005070 sampling Methods 0.000 claims 4
- 238000010586 diagram Methods 0.000 description 9
- 238000012805 post-processing Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/012—Conversion between an interlaced and a progressive signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/12—Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal
Definitions
- the present invention generally relates to low bit rate transmissions and, more particularly, to a method and apparatus for providing format conversion of video to enable low bit rate compression of non-progressive video.
- Video fields are sometimes interlaced to enable serial video bit streams to be sent over networks. Interlacing includes sending alternating fields of video successively over a link. Video streams may be identified as progressive or non- progressive. Progressive video includes pairs of successive fields where there is no
- Non-progressive video can include fields where there is object motion between successive pairs of fields.
- Progressive frames can easily be format converted; however, format converting non-progressive video does not enjoy the same capability. Instead, non-progressive video is much more difficult to format convert without significant loss in vertical resolution.
- One approach to this downconverting is to use intra-field interpolation to convert 240-line incoming fields to 120-line fields.
- the resulting 240 interlaced (240i) video is compressed, transmitted, and decompressed.
- the 240i video is then intra- field converted by vertical interpolation to 240-line fields of a 480i signal and displayed.
- the vertical resolution suffers, especially in comparison to 240
- Diagonal edges of moving objects are jagged, as well.
- a method for format conversion includes providing a first interlaced video signal including non-progressive video of a first resolution, downconverting fields of the first resolution to fields of a second resolution, and combining and interlacing the fields at a third resolution.
- the video signal is transmitted at the third resolution.
- the video signal of the third resolution is deinterlaced to form a progressive format video.
- the progressive format video is converted to the first non-progressive resolution by alternately adjusting position of the progressive format of the third resolution up and down to make upper and lower fields, respectively, of the first resolution for display.
- the step of deinterlacing the non-progressive video signal to a progressive format having the first resolution may be included.
- a jagged diagonal reduction method may be employed to perform deinterlacing.
- a system for format conversion includes a conversion device, which deinterlaces a non-progressive interlaced video signal having a first resolution to a progressive format having the same resolution.
- the conversion device downconverts the progressive format to a second resolution and combines and interlaces fields of the second resolution to provide frames at a third resolution.
- a transmission link is coupled to the conversion device for transmitting the video signal at the third resolution.
- a reconversion device is coupled to the output of the transmission link. The reconversion device deinterlaces the video stream of the third resolution as a progressive format video and converts the progressive format video to alternating upper field lines and lower field lines for display at the first resolution.
- FIG. 1 is block diagram showing an illustrative preprocessing sequence for format conversion in accordance with the present invention
- FIG. 2 is a block diagram showing block 12 in greater detail in accordance with 0 one embodiment of the present invention.
- FIG. 3 is a block diagram showing blocks 16 and 18 in greater detail in accordance with one embodiment of the present invention.
- FIG. 4 is a block diagram showing an illustrative postprocessing sequence for format conversion in accordance with the present invention
- FIG. 5 is a diagram illustratively showing adjustment of line positions in step 34 in accordance with the present invention
- FIG. 6 is a diagram illustratively showing a jagged diagonal reduction method/algorithm employed in accordance with the present invention.
- FIG. 7 is a diagram of an illustrative format conversion system in accordance with the present invention.
- the present invention provides a method and system for format converting a video to permit compression for a low bit rate stream.
- the present invention permits incoming non-progressive video to be deinterlaced and downconverted to fields to provide interlaced video with VT. resolution, for example, the vertical resolution.
- the 1 resolution interlaced video is compressed, transmitted, and decompressed.
- the 1 resolution interlaced video is then deinterlaced to a progressive format, and the progressive format video is converted to alternating upper fields and lower fields for display on conventional TV set or display monitor.
- the present invention is described in terms of a 2:1 resolution reduction, the vertical resolution reduction may be reduced by other ratios, for example, a 4:1 reduction.
- the present invention is described in terms of a conventional 480-line interlaced (480i) video system; however, the present invention is much broader and may include any video formats or sizes, which are capable of delivery over a wired or wireless network.
- 480i 480-line interlaced
- incoming non-progressive 480i video is deinterlaced and downconverted to 120-line fields to make 240i video.
- the 240i video is compressed, transmitted, and decompressed.
- the 240i video is then deinterlaced to 240p.
- the 240p is converted to alternating 240-line upper field and 240-line lower field to make 480i for display on, for example, a conventional TV set.
- the present invention is applicable to any system including video delivery systems over the telephone, set top boxes, computer, satellite links, Internet, etc.
- the present invention is particularly useful in video on-demand applications, which may be implemented on a digital subscriber line (DSL) network or other systems with medium bit rate channels.
- DSL digital subscriber line
- FIGS may be implemented in various forms of hardware, software or combinations thereof. Preferably, these elements are implemented in software on one or more appropriately programmed general-purpose devices, which may include a processor, memory and input/output interfaces.
- an incoming signal may be horizontally cropped to reduce processing.
- a 720 pixel (horizontal) by 480 interlaced (480i) pixel signal may be cropped to 704x480i, if needed.
- a horizontal downsampling is performed to form 352x480i.
- a 2 to 1 downsampling is carried out. Other ratios are also contemplated.
- the downsampling may be performed using conventional interpolation filtering methods.
- a low pass anti-alias filter 13 filters the video data followed by a subsampling step in block 15.
- the output of block 15 is a 1 / horizontally downsampled field.
- the signal is deinterlaced to 352x480p to preferably 60Hz in block 14.
- Deinterlacing may be performed by conventional deinterlacing methods.
- the signal is vertically lowpass filtered as shown in FIG. 3, with a , 2, % filter 21 , and subsequently is subsampled 4 to 1 with a first phasing to make an upper 120-line field, shown as lines numbered i1 , i3, etc.
- Other filters may be employed for filter 21. Also shown in FIG.
- a subsequent deinterlaced 480p frame which is processed through the same filter as frame i, but is 4 to 1 subsampled with a different phase than the first phase to make a subsequent lower 120-line field, is shown as lines numbered i2, i4, etc.
- the 240i sequence of 60 Hz fields is formed. Pairs of successive 240i fields are then formed into 30 Hz frames in block 18.
- Each frame is formed in block 18 shown in FIG. 1.
- 704x480i frames have been downconverted to 352x240i frames suitable for a reduced bit rate compression.
- the video stream is compressed and transferred over a network or transmission link (wired or wireless) to a receiver such as a television or display device.
- the present invention improves the displayed vertical resolution for non-moving images. Non-moving images experience a vertical resolution improvement of 2:1 or greater over conventional systems.
- by employing the method of the present invention including for example, jagged diagonal reduction, as will be described below, improved downconverting of non-progressive video streams is provided.
- Postprocessing includes upconverting each frame in the horizontal direction. This is illustratively shown in block 30 where an interpolation method, such as a bicubical interpolation method, is employed to upconvert 352 samples per line to 704 samples per line.
- the upconverted 240i signal is deinterlaced in block 32.
- One of a plurality of different deinterlacing algorithms may be employed. In one embodiment, a jagged diagonal reduction algorithm is employed for the moving portions of the picture. This will be described later with reference to FIG. 5.
- the deinterlaced 240p/60Hz signal is then converted into 240-line fields by alternating upward shift to make an upper 240-line field from a240p frame and a downward shift to make a lower 240-line field from a succeeding 240p line frame. These shifts are performed in block 34 to adjust position up or down to reconstruct 480i fields.
- FIG. 5 is an illustrative diagram showing the conversion of 240p to 480i. The number associated with each line, e.g., A and %, is a weight. A first picture i is shifted up by a quarter line, and a second picture i+1 is shifted down by a quarter line. These two shifted pictures are interlaced to form a 480 line interlaced picture. Following the adjusting of position, the signal can be outputted as a 60Hz field sequence, which is restored to the 704x480i format.
- an illustrative technique for deinterlacing is shown.
- a jagged diagonal reduction portion of the deinterlacing is performed.
- Other deinterlacing techniques may be employed and are contemplated by the present inventors.
- the previous field lines may be inserted between the present field lines to accomplish deinterlacing. This maintains the full level of vertical detail.
- the previous or following field cannot be used to make an in-between line of pixels. So these pixels must be formed from the lines immediately above and below the pixels to be formed.
- a jagged diagonal reduction method preferably employed with the present invention, the diagonal pixel pairs L1 through L5 are tested to see which has the lowest difference, for example, in intensity.
- the pair with the lowest difference is averaged and used as pixel I. The exception to this occurs if this average is not the median of the average, the above pixel and the below pixel. If not, then the above pixel or the below pixel with the value nearest to this average is used instead.
- jagged edges are reduced significantly, rendering a better image on moving objects when the video is displayed.
- FIG. 7 a system 130 for format conversion is schematically shown in accordance with the present invention.
- System 130 provides a conversion device 132, which deinterlaces a non-progressive interlaced video stream having a first resolution (e.g., 480i) to a progressive format (e.g., 480p) having the same resolution.
- the conversion device 132 downconverts the progressive format to a second resolution (e.g., 120) and combines fields of the second resolution to provide frames at a third resolution (240i).
- the conversion device 132 preferably includes a %, Vz, V ⁇ filter 134 which downconverts the progressive format (480p) of the first resolution.
- the filter 134 samples a first image i with a first phase and samples a second image i+1 using the same , Vz, filter 134 with a second phase.
- the fields are output from the %, Vz, filter with the first phase and the second phase and a combining device combines the fields with the first phase with the fields of the second phase to achieve the third resolution.
- a jagged diagonal reduction algorithm 142 may be employed to provide deinterlacing of video signals.
- Conversion device 132 also preferably compresses the video data prior to transmission. Conversion device 132 is described with reference to blocks 10-18 in FIG. 1.
- a transmission link 136 is coupled to the conversion device for transmitting the compressed video stream at the third resolution (e.g., 240).
- a reconversion device 138 is coupled to the transmission link 136 and receives the transmitted video stream.
- the reconversion device 138 decompresses the video data when received.
- Reconversion device 138 deinterlaces the decompressed video stream of the third resolution to a progressive format video and converts the progressive format video to alternating upper field lines and lower field lines to make successive fields for display.
- Reconversion device 138 is described with reference to blocks 30-34 of FIG. 4.
- System 130 may include a cropping module/device 140 for cropping out a portion of the non-progressive interlaced video stream to reduce an amount of pixels being processed.
- Reconversion device 138 may include a jagged diagonal reduction algorithm or other program/device 142 for deinterlacing the video stream. The video is then able to be displayed on, for example, a display or TV set 144. Compression and decompression may be performed in accordance with known methods.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Television Systems (AREA)
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US33158801P | 2001-11-20 | 2001-11-20 | |
US331588P | 2001-11-20 | ||
US10/127,743 US6573941B1 (en) | 2002-04-22 | 2002-04-22 | Low bit rate compression format conversion for improved resolution |
US127743 | 2002-04-22 | ||
PCT/US2002/037186 WO2003045056A1 (en) | 2001-11-20 | 2002-11-19 | Low bit rate compression format conversion for improved resolution |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1466476A1 EP1466476A1 (de) | 2004-10-13 |
EP1466476A4 true EP1466476A4 (de) | 2009-05-06 |
Family
ID=26825931
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP02803681A Withdrawn EP1466476A4 (de) | 2001-11-20 | 2002-11-19 | Kompressionsformatumsetzung mit niedriger bitrate für verbesserte auflösung |
Country Status (6)
Country | Link |
---|---|
EP (1) | EP1466476A4 (de) |
JP (1) | JP2005510905A (de) |
KR (1) | KR100958708B1 (de) |
CN (1) | CN100336393C (de) |
AU (1) | AU2002366172A1 (de) |
WO (1) | WO2003045056A1 (de) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2886787A1 (fr) * | 2005-06-06 | 2006-12-08 | Thomson Licensing Sa | Procede et dispositif de codage et de decodage d'une sequence d'images |
KR100703165B1 (ko) * | 2005-07-26 | 2007-04-06 | 삼성전자주식회사 | 영상처리장치 및 영상처리방법 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0888018A1 (de) * | 1996-02-28 | 1998-12-30 | Matsushita Electric Industrial Co., Ltd. | Optische platte mit hoher auflösung zur aufzeichnung von stereoskopischen videosignalen, wiedergabeanordnung für optische platten und aufzeichnungsvorrichtung für optische platten |
WO2000060856A1 (en) * | 1999-04-02 | 2000-10-12 | Teralogic, Inc. | Efficient image scaling for scan rate conversion |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5530484A (en) * | 1995-05-19 | 1996-06-25 | Thomson Multimedia S.A | Image scanning format converter suitable for a high definition television system |
US5844617A (en) | 1995-10-05 | 1998-12-01 | Yves C. Faroudja | Method and apparatus for enhancing the vertical resolution of a television signal having degraded vertical chrominance transitions |
US6456329B1 (en) * | 1999-04-19 | 2002-09-24 | Sarnoff Corporation | De-interlacing of video signals |
US6788311B1 (en) * | 1999-04-28 | 2004-09-07 | Intel Corporation | Displaying data on lower resolution displays |
CN1279560A (zh) * | 1999-07-02 | 2001-01-10 | 深圳市赛格集团有限公司 | 等离子体显示器中隔行视频信号的显示方法和装置 |
-
2002
- 2002-11-19 KR KR1020047007043A patent/KR100958708B1/ko not_active IP Right Cessation
- 2002-11-19 AU AU2002366172A patent/AU2002366172A1/en not_active Abandoned
- 2002-11-19 EP EP02803681A patent/EP1466476A4/de not_active Withdrawn
- 2002-11-19 CN CNB028230868A patent/CN100336393C/zh not_active Expired - Fee Related
- 2002-11-19 WO PCT/US2002/037186 patent/WO2003045056A1/en active Application Filing
- 2002-11-19 JP JP2003546568A patent/JP2005510905A/ja active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0888018A1 (de) * | 1996-02-28 | 1998-12-30 | Matsushita Electric Industrial Co., Ltd. | Optische platte mit hoher auflösung zur aufzeichnung von stereoskopischen videosignalen, wiedergabeanordnung für optische platten und aufzeichnungsvorrichtung für optische platten |
WO2000060856A1 (en) * | 1999-04-02 | 2000-10-12 | Teralogic, Inc. | Efficient image scaling for scan rate conversion |
Non-Patent Citations (1)
Title |
---|
See also references of WO03045056A1 * |
Also Published As
Publication number | Publication date |
---|---|
KR100958708B1 (ko) | 2010-05-18 |
KR20040066807A (ko) | 2004-07-27 |
WO2003045056A1 (en) | 2003-05-30 |
JP2005510905A (ja) | 2005-04-21 |
CN100336393C (zh) | 2007-09-05 |
AU2002366172A1 (en) | 2003-06-10 |
CN1589572A (zh) | 2005-03-02 |
EP1466476A1 (de) | 2004-10-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0608092B1 (de) | Vorrichtungungen und Verfahren zur skalierbaren Kodierung und Dekodierung von Videosignalen | |
JPH10126748A (ja) | 画像信号のフォーマット変換信号処理方法及び回路 | |
EP0743791A2 (de) | Einrichtung zum Umwandeln des Abtastformats für ein Fernsehsystem mit hoher Auflösung | |
EP0743788A1 (de) | Automatischer Bildabtastformatumwandler mit nahtloser Umschaltung | |
US6256045B1 (en) | Device and method for processing picture in MPEG decoder | |
WO2004086748A2 (en) | Systems and methods for multi-resolution image processing | |
JPH07162870A (ja) | ビデオ信号符号化装置 | |
JP2001506099A (ja) | Hdtvダウン変換システム | |
US6573941B1 (en) | Low bit rate compression format conversion for improved resolution | |
EP0618729B1 (de) | Verfahren und Vorrichtung zum Übertragen und Empfangen eines Videosignals | |
US8170099B2 (en) | Unified system for progressive and interlaced video transmission | |
CN102685475B (zh) | 视频减帧率的隔行压缩显示方法及其*** | |
US20010016010A1 (en) | Apparatus for receiving digital moving picture | |
US20120236183A1 (en) | Image transfer system, image transfer method, image reception apparatus, image transmission apparatus, and image pickup apparatus | |
KR100958708B1 (ko) | 포맷 변환을 하기 위한 방법 및 시스템 | |
EP1418754B1 (de) | Auf kodierter Datenströmanalyse basierte Progressivumwandlung von einem Zeilensprungvideo | |
JP2005192230A (ja) | 表示装置 | |
KR960002047B1 (ko) | 525라인 순차주사식 모니터 디스플레이 영상포맷을 갖는 에치디티브이(hdtv) 수신장치 및 에치디티브이 영상포맷 변환방법 | |
US5278648A (en) | Mixed field time-multiplexed video transmission system and method | |
Schamel | Adaptive signal processing for digital HDTV 280 Mbit/s transmission | |
KR0157532B1 (ko) | 동화상 크기를 축소/확대를 위한 압축/복원 개선방법 및 시스템 | |
JPH08126006A (ja) | 画像信号復号装置 | |
JPS62260488A (ja) | テレビジヨン信号受信装置 | |
JPH04188983A (ja) | テレビジョン信号処理回路 | |
JPH04238481A (ja) | テレビジョン信号変換器 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20040507 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO SI |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: THOMSON LICENSING |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20090408 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: THOMSON LICENSING |
|
17Q | First examination report despatched |
Effective date: 20100219 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20120601 |