US20030058365A1 - Method and apparatus for interlaced display of progressive video content - Google Patents
Method and apparatus for interlaced display of progressive video content Download PDFInfo
- Publication number
- US20030058365A1 US20030058365A1 US10/247,044 US24704402A US2003058365A1 US 20030058365 A1 US20030058365 A1 US 20030058365A1 US 24704402 A US24704402 A US 24704402A US 2003058365 A1 US2003058365 A1 US 2003058365A1
- Authority
- US
- United States
- Prior art keywords
- video
- progressive
- lines
- field
- display device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/012—Conversion between an interlaced and a progressive signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
Definitions
- Certain embodiments of the present invention relate to the display of video data. More particularly, certain embodiments relate to the vertical/temporal sampling and display of progressively scanned video data on an interlaced display device.
- “Artifacts” refer to visual blemishes in video that are not caused by the inherent sampling format and therefore are considered abnormal byproducts of video processing.
- “Top Field” refers to the field of video that starts at the first line in the displayed frame if each field of video is referenced to the physical start of the display.
- “Bottom Field”, refers to the field of video that starts at the second line in a displayed frame if each field of video is referenced to the physical start of display of the first line of the frame.
- “Even/odd lines” refers to the even lines numbered 0 , 2 , 4 , etc. (i.e. Top field in an interlaced frame) and the odd lines numbered 1 , 3 , 5 , etc. (i.e.
- Fres refers to sets of video lines that constitute a coherent picture.
- “Frame-time” refers to the period of time used to sample or display all the lines in the frame. One frame-time of ⁇ fraction (1/30) ⁇ th of a second, for example, is the time interval between frames (i.e. between the starting times of successive frames).
- Fields refers to sets of video lines that are parts of frames of video wherein each field of a frame has about 1 ⁇ 2 the number of the total lines in the frame. “Field-time” refers to the time interval between two fields (i.e. between the starting times of successive fields).
- An interlaced video comprises two fields that are sampled at two different times; and each field comprises either the even or odd lines of the video data.
- For interlaced video half the lines in the frame are displayed in one field-time and the other half of the lines are displayed in the next field-time.
- Each frame of video is displayed on a presentation device at a specific frame rate.
- fps 30 Frame/sec
- 60 Field/sec rate is used to indicate the display rate for individual fields in an interlaced frame, where the interlaced frame (i.e., two fields) is displayed at 30 Frame/sec.
- a progressive frame is usually sampled line by line after sampling starts at one time.
- a CIF (Common Image Format) frame (240 lines) is such an example. It may be displayed on a 525-line (about 480 active lines) or a 625-line (about 576 active lines) interlaced system, which is alternatively referred to as an “NTSC-display” or “PAL-display” respectively. While a representative frame rate of 30 fps may be utilized as provided above, other frame rates, including 25 fps, 29.97fps, 23.976 fps, etc., are contemplated.
- the task of displaying progressive video content on interlaced presentation devices may involve changing the sampling rate and sampling grid. Not only are the lines in the original progressive frame displayed at field rates, but they are also displayed with a vertical offset between fields that are characteristic of interlaced displays.
- the progressive video data is meant to be displayed on a progressive presentation device.
- the video data is typically, but not always, displayed one line at a time starting from the top of the frame all the way to the bottom of the frame during one display time. If the lines in the progressive frame are numbered 0 , 1 , 2 , 3 , . . . and the data is sampled at a frame rate of 30 frm/sec, then all lines ( 0 , 1 , 2 , 3 , . . . ) may be displayed in succession in ⁇ fraction (1/30) ⁇ second. However, this is not the case for typical CRT (cathode ray tube) designs, for example.
- the interlaced video is meant to be displayed on an interlaced presentation device as separate fields of video. If the lines in the interlaced video frame are numbered 0 , 1 , 2 , 3 , . . . then by convention the even-numbered lines belong to the top field and the odd-numbered lines belong to the bottom field.
- An interlaced frame of video implies that the fields are sampled at different times and are displayed on the presentation device at different times. For example, if an interlaced video frame is displayed in ⁇ fraction (1/30) ⁇ second, the top field (lines 0 , 2 , 4 , . . . ) is displayed in a ⁇ fraction (1/60) ⁇ second time period and the bottom field (lines 1 , 3 , 5 , . . . ) is typically displayed in the next ⁇ fraction (1/60) ⁇ second period.
- Displaying progressive video on a progressive presentation device generally results in no display artifacts. Similarly, there are no unexpected visual problems when interlaced video is displayed on interlaced presentation devices. Artifacts (both spatial and temporal) may be created when displaying progressive video on interlaced devices, or when displaying interlaced video on progressive devices.
- Video lines in a progressive frame containing “n” lines may be denoted as p 0 , p 1 , p 2 , p 3 , . . . p(n ⁇ 1) and video lines in an interlaced frame containing “m” lines are denoted as i 0 , i 1 , i 2 , i 3 , . . . i(m ⁇ 1), where the top field comprises the even numbered lines i 0 , i 2 , i 4 , . . . i(m ⁇ 2) and the bottom field comprises the odd numbered lines i 1 , i 3 , i 5 , . . . i (m ⁇ 1).
- Progressive content may be displayed on interlaced devices using progressive lines p 0 , p 1 , p 2 , p 3 , . . . p(n ⁇ 1) in one field-time interval ( ⁇ fraction (1/60) ⁇ sec), and the same lines p 0 , p 1 , p 2 , p 3 , . . . p(n ⁇ 1) in a second field-time interval ( ⁇ fraction (1/60) ⁇ sec) where “n” is the number of progressive video lines. If “n” is not equal to “m/2” (where m is the number of interlaced video lines), spatial (i.e., vertical) scaling is performed to match the progressive video lines to the interlaced display format.
- the display of the progressive video lines p 0 , p 1 , p 2 , . . . for both fields causes a vertical shift that manifests itself as a display artifact that looks like vertical hopping.
- Vertical scaling may produce additional artifacts depending on the scaling ratios used.
- Progressive content may be displayed on interlaced devices by displaying video lines p 0 , p 1 ′, p 2 , p 3 ′, p 4 , . . . in an even field interval ( ⁇ fraction (1/60) ⁇ sec), and p 0 ′, p 1 , p 2 ′, p 3 , . . . in a next odd field interval ( ⁇ fraction (1/60) ⁇ sec), where p 1 ′, p 3 ′, . . . are spatially interpolated lines from p 0 , p 2 , p 4 , . . . , and p 0 ′, p 2 ′, . . .
- n number of progressive video lines in a progressive frame
- m the number of interlaced video lines in an interlaced frame
- vertical scaling is performed for each independent field using the lines from the even and odd fields as defined above.
- the original lines of the progressive frame are displayed in the correct relative vertical positions with respect to each other.
- the interpolated lines are positioned in between the original lines, using a different set of interpolated lines for each field as described above.
- the interpolation process causes a display artifact of vertical blur that reduces the quality of the original video.
- An embodiment of the present invention provides an approach to display progressive video content on an interlaced display device.
- a display device produces a high quality video display and is less complex than more advanced, previously known display devices.
- a method for displaying progressive video content on an interlaced display device comprises vertically phase shifting video lines of the progressive video content to correctly position the video lines with respect to a video field of the interlaced display device.
- the method further comprises scaling the video lines of progressive video content to match a vertical size of a video field of the interlaced display device.
- Apparatus for displaying progressive video content on an interlaced display device.
- the apparatus comprises a line selection module (LSM) to select a set of video lines from the progressive video content.
- the apparatus further comprises a vertical phase shifter and scaling (VPSS) module responsive to the set of video lines to generate output video lines in a correct position on the interlaced display device.
- the vertical phase shifter function of the VPSS module positions the video lines for correct display in accordance with the line positions of each of the top and bottom fields of the interlaced display and the scaling function of the VPSS module adjusts the number of lines to match the vertical size of the progressive source frames to the vertical size of the interlaced display fields.
- Certain embodiments of the present invention afford an approach to display progressive video content on an interlaced display device in an efficient and effective manner that preserves image quality and prevents image artifacts.
- FIGS. 1A and 1B illustrate video frames in both progressive and interlaced formats viewed from the horizontal axis along each video line.
- FIG. 2 illustrates vertical phase shifting of the progressive video content of FIG. 1 for display on an interlaced display device in accordance with an embodiment of the present invention.
- FIG. 3 illustrates another embodiment of vertical phase shifting of progressive video content for display on an interlaced display device in accordance with an embodiment of the present invention.
- FIG. 4 illustrates a block diagram of the line selection module (LSM) and vertical phase shifter and scaler (VPSS) module in accordance with an embodiment of the present invention.
- LSM line selection module
- VPSS vertical phase shifter and scaler
- FIG. 5 illustrates a polyphase filter structure, that is a part of the VPSS module of FIG. 4, and an exemplary progressive to interlaced video pixel conversion in accordance with an embodiment of the present invention.
- An embodiment of the present invention provides the ability to perform vertical phase shifting of video data separately for top and bottom fields in order to position video data correctly on the top and bottom display fields. Further, an embodiment of the present invention enables video to be optionally scaled in combination with the vertical phase shifting, thereby fitting progressive video frames onto an interlaced display device at whatever size is desired. Also, an embodiment of the present invention combines vertical phase shifting and scaling in one polyphase filter structure.
- FIGS. 1A and 1B illustrate video frames in both progressive 10 and interlaced 20 video formats viewed from the horizontal axis along each line (‘looking into’ the lines from the side).
- FIGS. 1A and 1B also illustrate the relative vertical position of adjacent lines across time.
- the lines of the source progressive frame 10 have a consistent vertical position with respect to the top of the frame across time.
- FIG. 1A all of the progressive video lines for a given frame (e.g. 15 ) are not decomposed into fields and are displayed in a single frame time.
- FIG. 1B the video lines exist in two separate fields.
- Field 25 is an example of one field of a pair of fields in a frame.
- a frame 26 clearly shows two fields that are displayed during two different field times. The vertical positions of the fields are different from each other.
- Standard Image Format (“SIF”) video, which is progressive video.
- the task here is to display 240 lines from one frame produced at 30 frames/sec as an interlaced frame with 480 lines per frame displayed also at 30 frames/sec.
- the entire 240 progressive video lines 32 are displayed on the top interlaced field 33 with an initial vertical phase shift 31 implementing a shift of 1 ⁇ 2 of a frame line with respect to the top of the frame.
- the same 240 progressive lines 32 are displayed with a different starting vertical phase 36 implementing a shift of one frame line with respect to the first field of the frame.
- FIG. 2 illustrates phase shifting in the downward direction for both fields, it should be appreciated that one or both phases may be shifted in the upward direction as long as the relative positions of the two fields are correctly kept.
- FIG. 3 illustrates another embodiment of the present invention used for an alternative display arrangement.
- the original progressive video content 41 is not shifted vertically when it is displayed as the top field 42 .
- Only the second field 44 is shifted by 1 ⁇ 2 frame line 45 with respect to the first field 42 .
- FIG. 4 An apparatus embodiment of the present invention is illustrated in FIG. 4 as conversion apparatus 50 .
- Input video lines of progressive video content e.g. line 1 to line 4
- LSM line selection module
- VPSS vertical phase shifter and scaler
- VPSS module 70 produces one output line at a time using an internal polyphase filter structure 76 .
- VPSS module 70 is externally programmed with an initial phase shift selection for each field type and with the values of the coefficients for each phase.
- vertical frame and field synchronization information may be used by both modules (LSM and VPSS module) to coordinate processing between the two modules.
- the LSM 60 may present a combination of lines to the VPSS module 70 depending on the scaling ratio or display rate desired at the output of the system.
- the LSM 60 includes a line storage memory 65 for storing the selected progressive video lines. For example, if the system is required to generate more lines for display than the input number of lines (i.e., scale up), then the lines stored in the LSM 60 are used multiple times in order to produce a higher number of lines at the output of the VPSS module 70 , which is a normal consequence of scaling.
- the conversion apparatus 50 produces a high quality video display and is less complex than known systems in the prior art.
- the vertical phase shifter function of the VPSS 70 positions the video lines for correct display in accordance with the line positions of each of the top and bottom fields.
- the scaler function of the VPSS 70 adjusts the number of lines to match the vertical size of the progressive source frames to the vertical size of the interlaced display fields. It should be appreciated that scaling is optional.
- the phase shifter and scaler functions are combined in a single polyphase filter structure 76 within the VPSS 70 .
- polyphase filters may be used to perform sample rate conversion in spatial up/down scaling applications.
- the polyphase filter structure 76 may be expressed by a single finite impulse response (FIR) filter with loadable coefficients.
- FIR finite impulse response
- a polyphase filter structure may not be needed unless scaling is being performed. Phase shifting without scaling does not require a polyphase filter. A simple phase shift filter having one phase may suffice.
- the polyphase filter structure comprises a predetermined number of phases. Each phase of the polyphase filter structure is associated with a specific phase shift of the filter. Phase shifting the progressive input image by the correct amount to match the field positions on the interlaced display produces a high quality display.
- a well designed phase shift filter such as one that uses 4 or 6 taps, gives much better results than, for example, a 2 tap filter. The number of taps is independent of the number of phases.
- FIG. 5 illustrates an embodiment of the present invention that includes a vertical polyphase filter structure 76 .
- the 4 coefficients (e.g. 300 ) associated with one phase correspond to 4 taps of a normal FIR processing structure (i.e. the FIR processing structure is at the heart of the polyphase filter structure).
- the FIR processing structure is used to implement the processing at each phase in the polyphase filter structure 76 .
- the initial phase of the polyphase filter for each field type is chosen to provide the correct vertical positioning as required for the particular progressive to interlace conversion, combined with the chosen scaling factor.
- the FIR filter associated with one selected phase of the filter is loaded with four progressive video pixel values (e.g. 401 - 404 ), i.e. two values above (e.g. 401 and 402 ) the output pixel position of interest (e.g. 501 or 601 ) and two below (e.g. 403 and 404 ).
- Each progressive video pixel value in the filter is multiplied by its corresponding filter coefficient. The products are then summed to generate the new interlaced pixel value (e.g. 501 ).
- FIG. 5 illustrates four pixels ( 500 - 503 ) that are generated for the top field and four pixels ( 600 - 603 ) that are generated for the bottom field.
- the top field pixels ( 500 - 503 ) are shifted vertically with respect to the progressive pixels ( 401 - 404 ) and how the bottom field pixels ( 600 - 603 ) are also shifted vertically to a different position which is interlaced between the top field pixels ( 500 - 503 ).
- the final result is a set of interlaced video lines having twice the density of the original progressive video lines.
- the coefficients corresponding to each phase of the polyphase filter structure 76 may be programmed at any time. Further, the coefficients are double buffered so that, once the system is operating in the active portion of the current field, any changes in the coefficients do not take effect until the next field. Furthermore, the initial phase offset may be programmed before the beginning of the next field, but it is fixed for the duration of the active portion of such a field. As a result, the polyphase filter structure 76 may be programmed completely differently for both scaling and initial phase shifting for individual fields.
- the VPSS module 70 includes a coefficient storage memory 75 to store enough coefficients to define two fields of data, obviating the need to program the coefficients every field to obtain a frame of video.
- the polyphase filter structure 76 For any given configuration, two initial phases are contemplated for the polyphase filter structure 76 ; one initial phase for the top display fields; and one initial phase for the bottom display fields. Choosing the vertical starting phases correctly for each field results in a vertical displacement that places the original progressive video material in the correct vertical locations with the correct vertical offset for proper interlaced display, taking into account any scaling to be performed.
- the initial phase may be flexibly selected without directly changing the filter structure or value of the individual coefficients.
- the initial phases are chosen separately and correctly for each of the top and bottom fields.
- the polyphase filter may be designed as a pure phase shift filter in those instances where scaling is not required.
- the progressive video frames are scaled to produce a complete interlaced frame, containing both top and bottom fields.
- the fields are selected for display from the resulting interlaced frame.
- the various elements of the conversion apparatus 50 may be combined or separated according to various embodiments of the present invention.
- the vertical shifting function and scaling function may be implemented as separate filter structures instead of as a single structure.
- certain embodiments of the present invention enable the display of progressive video material on interlaced displays by positioning and phase shifting the progressive input lines on to the interlaced display-sampling grid.
- Combining vertical phase shifting and scaling enables interlaced display and scaling to a desired display size.
- Implementing vertical phase shifting and scaling together reduces complexity when compared with separate scaling and phase shifting functions.
- Certain embodiments of the present invention do not require temporal processing to be performed to obtain good quality conversions. Selecting the proper generation of coefficients, phases and starting offset independently for each field of video generated means that embodiments of the present invention are hardly more complex to implement than a conventional polyphase filter structure.
- certain embodiments of the present invention include programmable loading of the coefficients for the phases, phase offset and selection so that certain embodiments of the present invention are capable of handling a variety of conversion formats.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Systems (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Details Of Television Scanning (AREA)
Abstract
Description
- The applicants claim priority based on provisional application No. 60/324732 filed Sep. 24, 2001, the complete subject matter of which is incorporated herein by reference in its entirety.
- [Not Applicable]
- [Not Applicable]
- Certain embodiments of the present invention relate to the display of video data. More particularly, certain embodiments relate to the vertical/temporal sampling and display of progressively scanned video data on an interlaced display device.
- Vertical/temporal sampling and display of progressively scanned video data is discussed herein. It is contemplated that horizontal/spatial scaling of video data is handled independently of the vertical/temporal processing. scaling of video data is handled independently of the vertical/temporal processing.
- “Artifacts” refer to visual blemishes in video that are not caused by the inherent sampling format and therefore are considered abnormal byproducts of video processing. “Top Field” refers to the field of video that starts at the first line in the displayed frame if each field of video is referenced to the physical start of the display. “Bottom Field”, refers to the field of video that starts at the second line in a displayed frame if each field of video is referenced to the physical start of display of the first line of the frame. “Even/odd lines” refers to the even lines numbered0, 2, 4, etc. (i.e. Top field in an interlaced frame) and the odd lines numbered 1, 3, 5, etc. (i.e. Bottom field in an interlaced frame) when the lines of a frame are numbered starting from ‘0’ and a counter is incremented by one for each line. “Frames” refers to sets of video lines that constitute a coherent picture. “Frame-time” refers to the period of time used to sample or display all the lines in the frame. One frame-time of {fraction (1/30)}th of a second, for example, is the time interval between frames (i.e. between the starting times of successive frames). “Fields” refers to sets of video lines that are parts of frames of video wherein each field of a frame has about ½ the number of the total lines in the frame. “Field-time” refers to the time interval between two fields (i.e. between the starting times of successive fields).
- Two types of video data, “progressive” and “interlaced” video data, are typically generated as frames of video. An interlaced video comprises two fields that are sampled at two different times; and each field comprises either the even or odd lines of the video data. For interlaced video, half the lines in the frame are displayed in one field-time and the other half of the lines are displayed in the next field-time. Each frame of video is displayed on a presentation device at a specific frame rate. For purposes of discussion herein, a 30 Frame/sec (“fps”) rate is used to indicate the display rate for frames while a 60 Field/sec rate is used to indicate the display rate for individual fields in an interlaced frame, where the interlaced frame (i.e., two fields) is displayed at 30 Frame/sec.
- A progressive frame is usually sampled line by line after sampling starts at one time. A CIF (Common Image Format) frame (240 lines) is such an example. It may be displayed on a 525-line (about 480 active lines) or a 625-line (about 576 active lines) interlaced system, which is alternatively referred to as an “NTSC-display” or “PAL-display” respectively. While a representative frame rate of 30 fps may be utilized as provided above, other frame rates, including 25 fps, 29.97fps, 23.976 fps, etc., are contemplated.
- In the interlaced video case, with top and bottom (or even and odd) fields, there is a vertical positional offset between the two fields. In the progressive video case, there are no fields.
- In very general terms, the task of displaying progressive video content on interlaced presentation devices may involve changing the sampling rate and sampling grid. Not only are the lines in the original progressive frame displayed at field rates, but they are also displayed with a vertical offset between fields that are characteristic of interlaced displays.
- Generally the progressive video data is meant to be displayed on a progressive presentation device. The video data is typically, but not always, displayed one line at a time starting from the top of the frame all the way to the bottom of the frame during one display time. If the lines in the progressive frame are numbered0, 1, 2, 3, . . . and the data is sampled at a frame rate of 30 frm/sec, then all lines (0, 1, 2, 3, . . . ) may be displayed in succession in {fraction (1/30)} second. However, this is not the case for typical CRT (cathode ray tube) designs, for example.
- Generally the interlaced video is meant to be displayed on an interlaced presentation device as separate fields of video. If the lines in the interlaced video frame are numbered0, 1, 2, 3, . . . then by convention the even-numbered lines belong to the top field and the odd-numbered lines belong to the bottom field. An interlaced frame of video implies that the fields are sampled at different times and are displayed on the presentation device at different times. For example, if an interlaced video frame is displayed in {fraction (1/30)} second, the top field (
lines lines - Displaying progressive video on a progressive presentation device generally results in no display artifacts. Similarly, there are no unexpected visual problems when interlaced video is displayed on interlaced presentation devices. Artifacts (both spatial and temporal) may be created when displaying progressive video on interlaced devices, or when displaying interlaced video on progressive devices.
- Video lines in a progressive frame containing “n” lines may be denoted as p0, p1, p2, p3, . . . p(n−1) and video lines in an interlaced frame containing “m” lines are denoted as i0, i1, i2, i3, . . . i(m−1), where the top field comprises the even numbered lines i0, i2, i4, . . . i(m−2) and the bottom field comprises the odd numbered lines i1, i3, i5, . . . i (m−1).
- Progressive content may be displayed on interlaced devices using progressive lines p0, p1, p2, p3, . . . p(n−1) in one field-time interval ({fraction (1/60)} sec), and the same lines p0, p1, p2, p3, . . . p(n−1) in a second field-time interval ({fraction (1/60)} sec) where “n” is the number of progressive video lines. If “n” is not equal to “m/2” (where m is the number of interlaced video lines), spatial (i.e., vertical) scaling is performed to match the progressive video lines to the interlaced display format. Since the lines of the interlaced fields have a different vertical position from one field-time interval to the next, the display of the progressive video lines p0, p1, p2, . . . for both fields causes a vertical shift that manifests itself as a display artifact that looks like vertical hopping. Vertical scaling may produce additional artifacts depending on the scaling ratios used.
- Progressive content may be displayed on interlaced devices by displaying video lines p0, p1′, p2, p3′, p4, . . . in an even field interval ({fraction (1/60)} sec), and p0′, p1, p2′, p3, . . . in a next odd field interval ({fraction (1/60)} sec), where p1′, p3′, . . . are spatially interpolated lines from p0, p2, p4, . . . , and p0′, p2′, . . . are spatially interpolated lines from p1, p3, p5, . . . If “n” (number of progressive video lines in a progressive frame) is not equal to “m/2” (where m is the number of interlaced video lines in an interlaced frame), then vertical scaling is performed for each independent field using the lines from the even and odd fields as defined above. The original lines of the progressive frame are displayed in the correct relative vertical positions with respect to each other. The interpolated lines are positioned in between the original lines, using a different set of interpolated lines for each field as described above. However, the interpolation process causes a display artifact of vertical blur that reduces the quality of the original video.
- Further limitations and disadvantages of conventional and traditional approaches will become apparent to one of skill in the art, through comparison of such systems with certain embodiments of the present invention as set forth in the remainder of the present application with reference to the drawings.
- An embodiment of the present invention provides an approach to display progressive video content on an interlaced display device. In an embodiment of the present invention a display device produces a high quality video display and is less complex than more advanced, previously known display devices.
- A method is provided for displaying progressive video content on an interlaced display device. The method comprises vertically phase shifting video lines of the progressive video content to correctly position the video lines with respect to a video field of the interlaced display device. The method further comprises scaling the video lines of progressive video content to match a vertical size of a video field of the interlaced display device.
- Apparatus is provided for displaying progressive video content on an interlaced display device. The apparatus comprises a line selection module (LSM) to select a set of video lines from the progressive video content. The apparatus further comprises a vertical phase shifter and scaling (VPSS) module responsive to the set of video lines to generate output video lines in a correct position on the interlaced display device. The vertical phase shifter function of the VPSS module positions the video lines for correct display in accordance with the line positions of each of the top and bottom fields of the interlaced display and the scaling function of the VPSS module adjusts the number of lines to match the vertical size of the progressive source frames to the vertical size of the interlaced display fields.
- Certain embodiments of the present invention afford an approach to display progressive video content on an interlaced display device in an efficient and effective manner that preserves image quality and prevents image artifacts.
- Other aspects, advantages and novel features of certain embodiments of the present invention, as well as details of an illustrated embodiment thereof, will be more fully understood from the following description and drawing, wherein like numerals refer to like parts.
- FIGS. 1A and 1B illustrate video frames in both progressive and interlaced formats viewed from the horizontal axis along each video line.
- FIG. 2 illustrates vertical phase shifting of the progressive video content of FIG. 1 for display on an interlaced display device in accordance with an embodiment of the present invention.
- FIG. 3 illustrates another embodiment of vertical phase shifting of progressive video content for display on an interlaced display device in accordance with an embodiment of the present invention.
- FIG. 4 illustrates a block diagram of the line selection module (LSM) and vertical phase shifter and scaler (VPSS) module in accordance with an embodiment of the present invention.
- FIG. 5 illustrates a polyphase filter structure, that is a part of the VPSS module of FIG. 4, and an exemplary progressive to interlaced video pixel conversion in accordance with an embodiment of the present invention.
- An embodiment of the present invention provides the ability to perform vertical phase shifting of video data separately for top and bottom fields in order to position video data correctly on the top and bottom display fields. Further, an embodiment of the present invention enables video to be optionally scaled in combination with the vertical phase shifting, thereby fitting progressive video frames onto an interlaced display device at whatever size is desired. Also, an embodiment of the present invention combines vertical phase shifting and scaling in one polyphase filter structure.
- FIGS. 1A and 1B illustrate video frames in both progressive10 and interlaced 20 video formats viewed from the horizontal axis along each line (‘looking into’ the lines from the side). FIGS. 1A and 1B also illustrate the relative vertical position of adjacent lines across time. The lines of the source
progressive frame 10 have a consistent vertical position with respect to the top of the frame across time. - In FIG. 1A, all of the progressive video lines for a given frame (e.g.15) are not decomposed into fields and are displayed in a single frame time. In FIG. 1B, the video lines exist in two separate fields. Field 25 is an example of one field of a pair of fields in a frame. A frame 26 clearly shows two fields that are displayed during two different field times. The vertical positions of the fields are different from each other.
- One example of a commonly needed conversion is the interlaced display of Standard Image Format (“SIF”) video, which is progressive video. The task here is to display 240 lines from one frame produced at 30 frames/sec as an interlaced frame with 480 lines per frame displayed also at 30 frames/sec. Referring to FIG. 2, the entire 240 progressive video lines32 are displayed on the top interlaced field 33 with an initial
vertical phase shift 31 implementing a shift of ½ of a frame line with respect to the top of the frame. For thebottom field 35, the same 240 progressive lines 32 are displayed with a different starting vertical phase 36 implementing a shift of one frame line with respect to the first field of the frame. While FIG. 2 illustrates phase shifting in the downward direction for both fields, it should be appreciated that one or both phases may be shifted in the upward direction as long as the relative positions of the two fields are correctly kept. - FIG. 3 illustrates another embodiment of the present invention used for an alternative display arrangement. In the embodiment, the original progressive video content41 is not shifted vertically when it is displayed as the
top field 42. Only thesecond field 44 is shifted by ½frame line 45 with respect to thefirst field 42. - An apparatus embodiment of the present invention is illustrated in FIG. 4 as conversion apparatus50. Input video lines of progressive video content (e.g.
line 1 to line 4) are selected and presented by a line selection module (LSM) 60 to a vertical phase shifter and scaler (VPSS)module 70.VPSS module 70 produces one output line at a time using an internalpolyphase filter structure 76.VPSS module 70 is externally programmed with an initial phase shift selection for each field type and with the values of the coefficients for each phase. In an embodiment of the present invention, vertical frame and field synchronization information may be used by both modules (LSM and VPSS module) to coordinate processing between the two modules. - The
LSM 60 may present a combination of lines to theVPSS module 70 depending on the scaling ratio or display rate desired at the output of the system. In an embodiment of the present invention, theLSM 60 includes aline storage memory 65 for storing the selected progressive video lines. For example, if the system is required to generate more lines for display than the input number of lines (i.e., scale up), then the lines stored in theLSM 60 are used multiple times in order to produce a higher number of lines at the output of theVPSS module 70, which is a normal consequence of scaling. - The conversion apparatus50 produces a high quality video display and is less complex than known systems in the prior art. The vertical phase shifter function of the
VPSS 70 positions the video lines for correct display in accordance with the line positions of each of the top and bottom fields. The scaler function of theVPSS 70 adjusts the number of lines to match the vertical size of the progressive source frames to the vertical size of the interlaced display fields. It should be appreciated that scaling is optional. In an embodiment of the present invention, the phase shifter and scaler functions are combined in a singlepolyphase filter structure 76 within theVPSS 70. - In general, polyphase filters may be used to perform sample rate conversion in spatial up/down scaling applications. The
polyphase filter structure 76 may be expressed by a single finite impulse response (FIR) filter with loadable coefficients. However, a polyphase filter structure may not be needed unless scaling is being performed. Phase shifting without scaling does not require a polyphase filter. A simple phase shift filter having one phase may suffice. The polyphase filter structure comprises a predetermined number of phases. Each phase of the polyphase filter structure is associated with a specific phase shift of the filter. Phase shifting the progressive input image by the correct amount to match the field positions on the interlaced display produces a high quality display. A well designed phase shift filter, such as one that uses 4 or 6 taps, gives much better results than, for example, a 2 tap filter. The number of taps is independent of the number of phases. - For example, FIG. 5 illustrates an embodiment of the present invention that includes a vertical
polyphase filter structure 76. The 4 coefficients (e.g. 300) associated with one phase correspond to 4 taps of a normal FIR processing structure (i.e. the FIR processing structure is at the heart of the polyphase filter structure). The FIR processing structure is used to implement the processing at each phase in thepolyphase filter structure 76. The initial phase of the polyphase filter for each field type is chosen to provide the correct vertical positioning as required for the particular progressive to interlace conversion, combined with the chosen scaling factor. - In an exemplary embodiment with a 4 tap filter as illustrated in FIG. 5, to generate a given interlaced pixel value in an interlaced video line, the FIR filter associated with one selected phase of the filter is loaded with four progressive video pixel values (e.g.401-404), i.e. two values above (e.g. 401 and 402) the output pixel position of interest (e.g. 501 or 601) and two below (e.g. 403 and 404). Each progressive video pixel value in the filter is multiplied by its corresponding filter coefficient. The products are then summed to generate the new interlaced pixel value (e.g. 501).
- FIG. 5 illustrates four pixels (500-503) that are generated for the top field and four pixels (600-603) that are generated for the bottom field. In the example of FIG. 5, it may be seen how the top field pixels (500-503) are shifted vertically with respect to the progressive pixels (401-404) and how the bottom field pixels (600-603) are also shifted vertically to a different position which is interlaced between the top field pixels (500-503). The final result is a set of interlaced video lines having twice the density of the original progressive video lines.
- In an exemplary embodiment, the coefficients corresponding to each phase of the
polyphase filter structure 76 may be programmed at any time. Further, the coefficients are double buffered so that, once the system is operating in the active portion of the current field, any changes in the coefficients do not take effect until the next field. Furthermore, the initial phase offset may be programmed before the beginning of the next field, but it is fixed for the duration of the active portion of such a field. As a result, thepolyphase filter structure 76 may be programmed completely differently for both scaling and initial phase shifting for individual fields. In an embodiment of the present invention, theVPSS module 70 includes acoefficient storage memory 75 to store enough coefficients to define two fields of data, obviating the need to program the coefficients every field to obtain a frame of video. - For any given configuration, two initial phases are contemplated for the
polyphase filter structure 76; one initial phase for the top display fields; and one initial phase for the bottom display fields. Choosing the vertical starting phases correctly for each field results in a vertical displacement that places the original progressive video material in the correct vertical locations with the correct vertical offset for proper interlaced display, taking into account any scaling to be performed. In an embodiment of the present invention, the initial phase may be flexibly selected without directly changing the filter structure or value of the individual coefficients. The initial phases are chosen separately and correctly for each of the top and bottom fields. The polyphase filter may be designed as a pure phase shift filter in those instances where scaling is not required. - In an alternative embodiment of the present invention, the progressive video frames are scaled to produce a complete interlaced frame, containing both top and bottom fields. The fields are selected for display from the resulting interlaced frame.
- The various elements of the conversion apparatus50 may be combined or separated according to various embodiments of the present invention. For example, the vertical shifting function and scaling function may be implemented as separate filter structures instead of as a single structure.
- In summary, certain embodiments of the present invention enable the display of progressive video material on interlaced displays by positioning and phase shifting the progressive input lines on to the interlaced display-sampling grid. Combining vertical phase shifting and scaling enables interlaced display and scaling to a desired display size. Implementing vertical phase shifting and scaling together reduces complexity when compared with separate scaling and phase shifting functions. Certain embodiments of the present invention do not require temporal processing to be performed to obtain good quality conversions. Selecting the proper generation of coefficients, phases and starting offset independently for each field of video generated means that embodiments of the present invention are hardly more complex to implement than a conventional polyphase filter structure. Furthermore, certain embodiments of the present invention include programmable loading of the coefficients for the phases, phase offset and selection so that certain embodiments of the present invention are capable of handling a variety of conversion formats.
- While the invention has been described with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from its scope. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.
Claims (27)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/247,044 US7440030B2 (en) | 2001-09-24 | 2002-09-19 | Method and apparatus for interlaced display of progressive video content |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US32473201P | 2001-09-24 | 2001-09-24 | |
US10/247,044 US7440030B2 (en) | 2001-09-24 | 2002-09-19 | Method and apparatus for interlaced display of progressive video content |
Publications (2)
Publication Number | Publication Date |
---|---|
US20030058365A1 true US20030058365A1 (en) | 2003-03-27 |
US7440030B2 US7440030B2 (en) | 2008-10-21 |
Family
ID=23264850
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/247,044 Expired - Fee Related US7440030B2 (en) | 2001-09-24 | 2002-09-19 | Method and apparatus for interlaced display of progressive video content |
Country Status (2)
Country | Link |
---|---|
US (1) | US7440030B2 (en) |
EP (1) | EP1298922A3 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060227812A1 (en) * | 2005-03-10 | 2006-10-12 | Bojan Vrcelj | Timing corrections in a multi carrier system and propagation to a channel estimation time filter |
US20070195883A1 (en) * | 2004-03-19 | 2007-08-23 | Koninklijke Philips Electronics, N.V. | Media signal processing method, corresponding system, and application thereof in a resource-scalable motion estimator |
US20080219144A1 (en) * | 2007-03-05 | 2008-09-11 | Qualcomm Incorporated | Timing adjustments for channel estimation in a multi carrier system |
US20080219332A1 (en) * | 2007-03-05 | 2008-09-11 | Qualcomm Incorporated | Apparatus and methods accounting for automatic gain control in a multi carrier system |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5497199A (en) * | 1993-10-20 | 1996-03-05 | Matsushita Electric Industrial Co., Ltd. | Apparatus for processing progressive scanning video signal comprising progressive to interlaced signal converter and interlaced to progressive signal converter |
US5517247A (en) * | 1992-10-05 | 1996-05-14 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for converting a video input signal of progressive scan form to an interlaced video output signal of doubled field rate and employing progressive scan to progressive scan interpolation for reduction of visual artifacts |
US5936675A (en) * | 1998-04-28 | 1999-08-10 | Ai Tech International Corp. | Method and architecture for reducing flickers using one FIFO video line buffer in video signal conversions |
US5963261A (en) * | 1996-04-29 | 1999-10-05 | Philips Electronics North America Corporation | Low cost scan converter for television receiver |
US6069664A (en) * | 1997-06-04 | 2000-05-30 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for converting a digital interlaced video signal from a film scanner to a digital progressive video signal |
US6151363A (en) * | 1991-09-03 | 2000-11-21 | British Broadcasting Corporation | Video image processing |
US6281873B1 (en) * | 1997-10-09 | 2001-08-28 | Fairchild Semiconductor Corporation | Video line rate vertical scaler |
US6327000B1 (en) * | 1999-04-02 | 2001-12-04 | Teralogic, Inc. | Efficient image scaling for scan rate conversion |
US6359654B1 (en) * | 1996-02-14 | 2002-03-19 | Conexant Systems, Inc. | Methods and systems for displaying interlaced video on non-interlaced monitors |
US6690426B1 (en) * | 1999-08-23 | 2004-02-10 | Samsung Electronics Co., Ltd. | Apparatus and method for converting from progressive scanning image to interlace scanning image |
US6727958B1 (en) * | 1999-08-20 | 2004-04-27 | Winbond Electronics Corp. | Method and apparatus for displaying resized pictures on an interlaced target display system |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997014247A1 (en) | 1995-10-13 | 1997-04-17 | Apple Computer, Inc. | Method and apparatus for video scaling and convolution for displaying computer graphics on a conventional television monitor |
-
2002
- 2002-09-19 US US10/247,044 patent/US7440030B2/en not_active Expired - Fee Related
- 2002-09-24 EP EP02256605A patent/EP1298922A3/en not_active Ceased
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6151363A (en) * | 1991-09-03 | 2000-11-21 | British Broadcasting Corporation | Video image processing |
US5517247A (en) * | 1992-10-05 | 1996-05-14 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for converting a video input signal of progressive scan form to an interlaced video output signal of doubled field rate and employing progressive scan to progressive scan interpolation for reduction of visual artifacts |
US5497199A (en) * | 1993-10-20 | 1996-03-05 | Matsushita Electric Industrial Co., Ltd. | Apparatus for processing progressive scanning video signal comprising progressive to interlaced signal converter and interlaced to progressive signal converter |
US6359654B1 (en) * | 1996-02-14 | 2002-03-19 | Conexant Systems, Inc. | Methods and systems for displaying interlaced video on non-interlaced monitors |
US5963261A (en) * | 1996-04-29 | 1999-10-05 | Philips Electronics North America Corporation | Low cost scan converter for television receiver |
US6069664A (en) * | 1997-06-04 | 2000-05-30 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for converting a digital interlaced video signal from a film scanner to a digital progressive video signal |
US6281873B1 (en) * | 1997-10-09 | 2001-08-28 | Fairchild Semiconductor Corporation | Video line rate vertical scaler |
US5936675A (en) * | 1998-04-28 | 1999-08-10 | Ai Tech International Corp. | Method and architecture for reducing flickers using one FIFO video line buffer in video signal conversions |
US6327000B1 (en) * | 1999-04-02 | 2001-12-04 | Teralogic, Inc. | Efficient image scaling for scan rate conversion |
US6727958B1 (en) * | 1999-08-20 | 2004-04-27 | Winbond Electronics Corp. | Method and apparatus for displaying resized pictures on an interlaced target display system |
US6690426B1 (en) * | 1999-08-23 | 2004-02-10 | Samsung Electronics Co., Ltd. | Apparatus and method for converting from progressive scanning image to interlace scanning image |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070195883A1 (en) * | 2004-03-19 | 2007-08-23 | Koninklijke Philips Electronics, N.V. | Media signal processing method, corresponding system, and application thereof in a resource-scalable motion estimator |
US20060227812A1 (en) * | 2005-03-10 | 2006-10-12 | Bojan Vrcelj | Timing corrections in a multi carrier system and propagation to a channel estimation time filter |
US8428001B2 (en) | 2005-03-10 | 2013-04-23 | Qualcomm Incorporated | Timing corrections in a multi carrier system and propagation to a channel estimation time filter |
US20080219144A1 (en) * | 2007-03-05 | 2008-09-11 | Qualcomm Incorporated | Timing adjustments for channel estimation in a multi carrier system |
US20080219332A1 (en) * | 2007-03-05 | 2008-09-11 | Qualcomm Incorporated | Apparatus and methods accounting for automatic gain control in a multi carrier system |
US8098567B2 (en) | 2007-03-05 | 2012-01-17 | Qualcomm Incorporated | Timing adjustments for channel estimation in a multi carrier system |
Also Published As
Publication number | Publication date |
---|---|
US7440030B2 (en) | 2008-10-21 |
EP1298922A3 (en) | 2004-03-24 |
EP1298922A2 (en) | 2003-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5574572A (en) | Video scaling method and device | |
US6281873B1 (en) | Video line rate vertical scaler | |
EP0951777B1 (en) | Method and apparatus for scaling and reducing flicker with dynamic coefficient weighting | |
US7477323B2 (en) | Method and system for digital image magnification and reduction | |
JP2533393B2 (en) | NTSC-HD converter | |
US20060285010A1 (en) | Systems and methods for deinterlacing video signals | |
JPH05508522A (en) | Asymmetric screen compression | |
US7233362B2 (en) | Method for transforming one video output format into another video output format without degrading display quality | |
US6563544B1 (en) | Combined vertical filter for graphic displays | |
TWI260164B (en) | Motion adaptive deinterlacer with integrated dynamic format change filter | |
US6023262A (en) | Method and apparatus in a computer system to generate a downscaled video image for display on a television system | |
US6392706B1 (en) | Apparatus and method of moving picture format conversion | |
US5838385A (en) | Sampling analog video signal for secondary images | |
JPH1031466A (en) | Display method and system for displaying interlace video on non-interlace type monitor | |
EP1036389B1 (en) | System and methods for 2-tap/3-tap flicker filtering | |
US7440030B2 (en) | Method and apparatus for interlaced display of progressive video content | |
EP1560427B1 (en) | Method and system for minimizing both on-chip memory size and peak dram bandwitch requirements for multifield deinterlacers | |
KR100426999B1 (en) | Sampling Analog Video Signal for Secondary Images | |
KR100743520B1 (en) | Video Scaler and method for scaling video signal | |
KR19990080824A (en) | Apparatus and method for converting video format using common format | |
JP2944284B2 (en) | Multi-screen display device | |
US20030103164A1 (en) | Video signal processing apparatus and method | |
US20050046742A1 (en) | Image signal processing circuit | |
JPH04345389A (en) | Wide screen television receiver with wide aspect converting function | |
WO2001028243A1 (en) | Method and system for eliminating edge effects at the end of frame in video signals |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MACINNIS, ALEXANDER G.;ZHONG, SHENG;ALVAREZ, JOSE R.;REEL/FRAME:013424/0672 Effective date: 20021021 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Expired due to failure to pay maintenance fee |
Effective date: 20161021 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 |
|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041712/0001 Effective date: 20170119 |