CN1541482A - 用于数字视频信号的运动自适应降噪预处理 - Google Patents
用于数字视频信号的运动自适应降噪预处理 Download PDFInfo
- Publication number
- CN1541482A CN1541482A CNA02815861XA CN02815861A CN1541482A CN 1541482 A CN1541482 A CN 1541482A CN A02815861X A CNA02815861X A CN A02815861XA CN 02815861 A CN02815861 A CN 02815861A CN 1541482 A CN1541482 A CN 1541482A
- Authority
- CN
- China
- Prior art keywords
- pixel
- frame
- value
- motion vector
- anchor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 17
- 230000009467 reduction Effects 0.000 title description 13
- 238000001914 filtration Methods 0.000 claims abstract description 47
- 239000013598 vector Substances 0.000 claims abstract description 45
- 238000000034 method Methods 0.000 claims abstract description 23
- 230000002123 temporal effect Effects 0.000 claims abstract description 18
- 230000008859 change Effects 0.000 claims abstract description 12
- 230000006835 compression Effects 0.000 claims description 15
- 238000007906 compression Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 230000008030 elimination Effects 0.000 claims 2
- 238000003379 elimination reaction Methods 0.000 claims 2
- 238000001514 detection method Methods 0.000 claims 1
- 230000004044 response Effects 0.000 abstract description 4
- 238000007781 pre-processing Methods 0.000 abstract 1
- 241001125929 Trisopterus luscus Species 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 4
- 230000006978 adaptation Effects 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 101000969688 Homo sapiens Macrophage-expressed gene 1 protein Proteins 0.000 description 1
- 102100021285 Macrophage-expressed gene 1 protein Human genes 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
- H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/142—Detection of scene cut or scene change
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/192—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
- H04N19/194—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive involving only two passes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
- H04N19/615—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding using motion compensated temporal filtering [MCTF]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20182—Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20192—Edge enhancement; Edge preservation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Picture Signal Circuits (AREA)
Abstract
通过应用利用预生成运动矢量的运动补偿时域滤波,以及在场景变换帧应用自适应空域滤波,从而在视频***中降低噪声。除了对FIR空域滤波的改进,本发明还通过使用无限冲激响应(IIR)时域滤波来降低噪声,同时保持边沿的清晰度,从而改进了以前的滤波技术。它还使用已作为第一次扫描图像编码的一部分被计算出来的运动矢量,或者作为另一种选择方案,使用代码转换,以降低P帧和B帧图像预处理的计算复杂度。介绍了单阶段P帧时域噪声滤波与双阶段B帧时域噪声滤波。
Description
技术领域
本发明涉及一种设备与方法,其通过利用预生成运动矢量来应用运动补偿时域滤波,并在场景变换帧应用自适应空域滤波,从而在视频***中降低噪声。
背景技术
数字电视向观众提供了高质量视频娱乐,其特色诸如按次计费、电子节目指南、视频点播、天气与股票信息、以及因特网接入。视频图像被包装在信息流中,通过基于卫星、电缆或陆基传输媒介的宽带通信网络传输给用户。由于带宽与功率限制,电影与视频的有效传输要求广泛使用压缩与格式技术。诸如MPEG1与MPEG2之类的协议通过向空域压缩算法添加时域组件来最大化电影与视频信息传输的带宽利用率。
电影或视频的一个图像序列中的每一幅单独的图像被称为一帧。每一帧由大量的图像元素(像素)组成,这些像素定义了该图像。在每一帧内,冗余像素描述了场景中的相似部分,例如蓝天。多种类型的压缩算法已被用于去除冗余空间元素,从而降低图像传输的带宽要求。电影或视频的帧序列常包含非常类似或雷同的像素。为了最大化带宽利用率,通常使用压缩与运动补偿协议,例如MPEG,来最小化相邻帧之间的冗余像素。被编码器参考,以预测相邻帧中图像的运动的帧被称为锚帧(anchor frame)。这些锚帧可以是帧内帧(I帧)或预测帧(P帧)类型。不参考其它帧的像素组(宏块)组成I帧,P帧则包含对帧序列内的已编码帧的参考。第三种帧类型被称为双向帧(B帧),其既包含参考已遇到的锚帧的宏块,也包含参考当前被分析帧之后的锚帧的宏块。B帧和P帧编码都通过计算与被参考帧内的宏块相关联的运动矢量减少了像素的重复,使得带宽需求降低。一个特定帧的编码类型的选择取决于该图像的复杂度。
对于摇摄图像而言(for images that pan),描述运动物体的像素大体上是相同的,这是因为它们只是在空间上被移动了。参考前面(或后面)的帧中的像素组(即宏块),而不是在连续的若干帧中反复指定这些像素,这常常是有利的。运动矢量指示视频处理器到何处去获取被参考帧中的宏块。为此目的使用运动矢量被称为运动补偿。运动补偿也可用于帮助减小编码视频图像中的噪声影响。
多种类型的噪声可于压缩与传输之前被引入到视频中。来自成像与录像设备、来自陆基或轨道传输设备、来自通信信道、以及来自编码与解码设备的赝像(artifact)为人们所熟知。在图像压缩之前引入的噪声会带来问题,因为它垄断数据带宽,同时降低图像质量,从而干扰了后继的压缩***的性能。另外,离散余弦变换(DCT)域中的量化倾向于放大噪声的影响,导致信号退化加剧。
滤波降低了视频图像中的噪声,同时也可能随之降低图像的分辨率(例如锐利度),导致不精确的边沿过渡,从而降低了表观聚焦(apparent focus)。边沿被定义为像素幅度的陡峭变化(例如像素集之间的色彩差异和/或亮度幅度变化)。这些陡峭变化通常定向于竖直或水平方向,例如介于蓝天与黑色建筑之间的边沿。
因此,存在对被改进的噪声滤波***的需求,该***可以减小存在于目前的数字图像滤波器中的许多不利影响。本发明提供了一种解决方案,用以解决这些问题,同时提供增强的电影或视频帧的编码吞吐量。
发明内容
本发明涉及一种设备与方法,其通过利用预生成运动矢量来应用运动补偿时域滤波算法,并在在场景变换帧应用自适应空域滤波,从而在视频***中降低噪声。
在双编码(two-pass)的视频压缩与编码***中,描述了用于预压缩视频图像数据的运动补偿时域与自适应空域滤波子***。输入视频帧的降噪方案可通过使用存储组件实现,该存储组件提供帧缓冲,以存储至少三个连续的视频帧。被缓冲的帧包括当前帧,当前被编码帧之前的第一锚帧,以及当前帧之后的第二锚帧。这些帧中的每一帧上的图像用多个像素表示,其中每个像素展现一个信号幅度。当前帧上的许多图像在图像组(GOP)中的第一(前)和第二(后)帧上被重复。如果当前帧未被判定为场景变换帧,则使用P帧或B帧编码来处理该帧。对于P帧编码,实现了前向预测阶段,由此确定当前帧的一个像素的幅度与第一帧的一个像素的幅度之间的差异的绝对值。该值被用于利用查表实现对无限冲激响应(IIR)滤波器的非线性滤波器系数β(前向)进行求值。作为图像内物体摇摄移动的结果,第一帧的像素位置相对当前帧的像素位置存在偏移,如预计算的运动矢量所描述的那样。使用这些运动矢量,确定先前锚帧像素幅度部分(proportional value),并乘以滤波器系数β(前向)。当前帧内所选像素幅度部分乘以(1-β(前向)),再加上前述结果。对它们各自的幅度值连同β(前向)、(1-β(前向))以及与先前锚帧相关的运动矢量的数值进行算术处理,即可计算出当前帧像素幅度。
对于B帧编码,时域滤波被划分为两个阶段。第一阶段,前向预测,与上面描述的P帧编码方案相同。在由第一阶段的前向预测过程进行滤波之后,当前帧的像素数据被送到第二阶段,在这里,后向预测过程再次对该帧进行滤波。计算出当前帧内的一个像素的幅度与第二(后)帧内的一个像素的幅度之间的绝对值差异。第二帧像素位置从当前帧像素位置偏移一个预计算的运动矢量。非线性IIR滤波器系数β(后向)被从查找表中确定,取值在0到1之间,对应于所算出的绝对值差异。第二帧内的像素位置由当前帧内的位置决定,但偏移一个由预计算的运动矢量描述的量。β(后向)与运动补偿的第二帧像素值的乘积为当前帧像素值中所表示的第二锚帧像素值的部分。(1-β(后向))与当前帧像素值的乘积为最后得到的当前帧像素值中由当前锚帧像素值贡献的部分。这两部分帧像素值的和代表当前帧像素值。
这些经时域滤波的像素幅度值结果被空域滤波与流水线架构中的其它***组件进一步处理。延迟器组件也被引入,以提供一定程度的预测(look-ahead),用以提供统计的复用速率控制。这里描述的运动矢量可由第一次扫描编码器计算,作为另一种选择方案,也可使用代码转换计算。这有效消除了在其后的滤波步骤中重新生成运动矢量的需求。
当检测到场景变换帧时,选择来自非线性自适应空域滤波器的输出,以替代运动补偿时域滤波的输出。对于自适应空域滤波,每个输出的帧像素值等于一个加权平均值,该值为邻域像素幅度值的合成。一个邻域像素的权重由预确定的参考表确定,且与每个像素到目标像素(subject pixel)的距离成反比。每个非线性滤波器与一个滤波器系数相联系,该系数适合于输入像素幅度与领域像素幅度加权和之间的绝对值差异。
附图说明
图1描绘了一个依照本发明的示例***处理架构的框图。
图2描绘了与降噪处理器和第一次扫描编码器相联系的处理流水线。
图3描绘了指示多个滤波器强度的滤波器系数自适应过程。
图4描绘了用于B帧像素的两阶段自适应滤波流水线。
具体实施方式
本发明涉及一种设备与方法,其通过利用预生成运动矢量来应用运动补偿时域滤波,并应用自适应空域滤波,从而在视频***中降低噪声。
图1描绘了一个依照本发明的视频帧编码子***的示例处理架构的框图。该子***是更大规模的数字视频编码***的一部分。
该子***由以下组件组成:
第一次扫描编码器100;
降噪预处理器102;
第二次扫描编码器104;
主压缩控制器(MCC)106;
分组处理器108;和
视频FIFO队列与分组创建器110。
***总览
第一次扫描编码器100、降噪预处理器102与第二次扫描编码器104联合操作,以估计输入的视频帧的复杂度,对输入的视频进行噪声滤波,以及负责压缩输入的视频图像。第二次扫描编码器准备所需的参数,并提供该信息给速率控制处理器(未显示),该处理器提供相应的编码比特率分配值给第二次扫描编码器。第一次与第二次扫描编码器的层叠有效地对输入数据的单一信道进行编码,并进行数据压缩,包括运动补偿(对P帧与B帧)、离散余弦变换(DCT)与量化。编码器可针对实际编码比特率给速率控制处理器提供反馈信息。主压缩控制器(MCC)106通过***设备互联(PCI)总线为编码器控制数据的压缩。编码数据被提供给分组创建器110,其与分组处理器108联合工作,以提供视频数据的复用比特流。视频先入先出(FIFO)缓冲器110暂时存储压缩数据,分组处理器108将压缩数据与合适的头信息(比如,依照MPEG-2或其它视频标准)组成分组。之后,数据被送到发送器,以在信道上发送输出流。
在解码端,提供接收器、缓冲器与解复用器,以输出解码视频信号,例如用于显示在电视上。
降噪预处理器102对输入的视频帧实行空域与时域滤波,以减小视频噪声的影响。时域滤波器使用第一次扫描编码器提供的运动矢量,在连续视频帧内对运动物体精确地实行噪声滤波,同时降低***资源使用率。作为另一种选择方案,可使用代码转换来获得所需的运动矢量。代码转换允许预计算运动矢量在沿信道发送的比特流之内发送到时域滤波器。图2显示了通用降噪预处理流水线的数据流图。如图所示,在降噪预处理之前,第一次扫描编码器100对视频帧进行视频捕捉、水平抽取(decimation)与电影模式效果使用(detelecine)。这些帧被送到降噪预处理器的视频捕捉模块112,并被传统延迟组件114延迟。第一次扫描编码器还进行类型编码与运动矢量合成,它们被送到循环缓冲器116,之后被送往降噪预处理器内的时域与空域118滤波器模块。降噪预处理器,特别是时域滤波器,使用该信息来对连续接收的帧进行自适应无限冲激响应(IIR)滤波。其后,滤波后的视频帧被送到一系列延迟组件120,并最终被送到视频输出驱动器122,以发送到第二次扫描编码器104,进行进一步的处理。
降噪
在压缩之前,降噪预处理器进行自适应空域滤波与运动补偿时域滤波,以减小视频源噪声的影响。它还对视频进行延迟,以提供预测,用于统计复用的速率控制与特殊事件处理。
自适应时域滤波
运动补偿时域滤波器是一个IIR滤波器。第一次扫描编码生成的运动矢量被用于跟踪帧内物体的运动。
对于P帧,滤波器为每一个坐标(x,y)上的像素pOut生成如下输出:
pOut[x,y]=(1-βfwd)*pIn[x,y]+βfwd*prevPOut[x-MVx,y-MVy]
其中:
pIn[x,y]是当前P帧的地址[x,y]上的输入像素。
prevPOut[x,y]是前一个输出P帧的地址[x,y]上的像素值;
[MVx,MVy]是半像素(halfpel)截断的(truncated)场运动矢量。MVy被依照运动矢量中的场选择比特缩放到帧坐标。
βfwd是pIn[x,y]与prevPOut[x,y]之间的绝对差的非线性函数,通过查找表实现。(即βfwd=Look-up-table(|pIn[x,y]-prevPOut[x-MVx,y-MVy]|))。
图3显示了时域滤波器系数的自适应特性的一个示例。多个查找表被用于描述该自适应特性。对于边沿上的像素,滤波器系数β趋近于零,这意味着没有应用滤波。
对于B帧,运动补偿时域滤波器被实现为两个阶段,如图4所示。第一阶段,如轮廓框126所示,其通过利用之前的P帧执行时域滤波器来进行前向预测,以利用前向运动矢量[MVxfwd,MVyfwd]为每一个坐标[x,y]上的像素bOut1生成中间结果:
bOut1[x,y]=(1-βfwd)*bIn[x,y]+βfwd*pOutfwd[x-MVxfwd,y-MVyfwd]
其中:
bIn[x,y]是当前B帧的地址[x,y]上的输入像素;
pOutfwd[x,y]是用于前向预测的P帧的地址[x,y]上的像素值。该帧被存储于图4所示的多帧延迟器130,并在需要时被提供给运动补偿器128。
[MVxfwd,MVyfwd]是前向场运动矢量,其被舍入(round)到整数值,并被依照前向运动矢量中的场选择比特缩放到帧坐标。
pOutfwd[x-MVxfwd,y-MVyfwd]在运动补偿器部件128中通过结合前向运动矢量与像素信息pOutfwd[x,y]得到,该像素信息由多帧延迟器130提供。
βfwd是bIn[x,y]与pOutfwd[x-MVxfwd,y-MVyfwd]之间的绝对差的非线性函数。该操作由图4所示的绝对差计算器132执行,其后从查找表134中搜索滤波器函数βfwd。图3显示了所得到的滤波器函数的一个示例。
即βfwd=Look-up-table(|bIn[x,y]-[x-MVxfwd,y-MVyfwd]|)
滤波器函数βfwd与用于前向预测的P帧的地址[x,y]上的运动补偿的像素值pOutfwd[x-MVxfwd,y-MVyfwd]的乘积,加上输入像素bIn[x,y]与(1-βfwd)的乘积,得到像素值的中间值bOut1[x,y],该值被送到选择器138,以进行进一步的估计。
选择器138对场景变换检测器140的结果进行检查。如果选择器138收到一个场景变换通知,则该选择器选择自适应空域滤波器152的结果,送到延时存储器130,输出到第二次扫描编码器。
如果被分析的帧不是图像组(GOP)中的场景变换之后的第一个P帧,则中间结果bOut1[x,y]被送到延时存储器130,之后被送到时域滤波器142的第二阶段。其后的P帧也被选择器138选择送到第二阶段滤波器,在那里,利用后向运动矢量[MVxbwd,MVybwd]生成坐标[x,y]上的最后滤波输出bOut:
bOut[x,y]=(1-βbwd)*bOut1[x,y]+βbwd*pOutbwd[x-MVxbwd,y-MVybwd]
其中
pOutbwd[x,y]是用于后向预测的P帧的地址[x,y]上的像素值。该帧通过多帧延迟器130输入到第二阶段滤波器。
[MVxbwd,MVybwd]是后向场运动矢量,其被舍入到整数值,并被依照运动矢量中的场选择比特缩放到帧坐标。
运动补偿器144利用后向运动矢量确定pOutbwd[x-MVxbwd,y-MVybwd]。结果传给绝对差计算器146以确定βbwd。
βbwd是bOut1[x,y]与pOutbwd[x,y]之间的绝对差的非线性函数,其偏移相应的运动矢量,通过组合绝对差计算器146与查找表148实现。图3显示了该非线性函数的特性曲线。
即βbwd=Look-up-table(|bOut1[x,y]-Poutbwd[x-MVxbwd,y-MVybwd]|)
滤波器函数βbwd与用于后向预测的P帧的地址[x,y]上的运动补偿的像素值pOutbwd[x-MVxbwd,y-MVybwd]的乘积,加上中间像素值bOut1[x,y]与1减去前向滤波器系数(1-βfwd)150的乘积,得到像素值的输出结果bOut[x,y]。
如果βfwd是0,只有后向运动会被用于生成结果。类似地,如果βbwd是0,只有前向运动会被用到。进一步地,建立不同的查找表,以允许用户选择滤波器的强度。β越快从系数自适应曲线衰落(rolloff),滤波器越弱。滤波器系数取值从0到1。对于强度接近于平均值的像素,滤波器系数β趋近于1,滤波器变为平均滤波器,这意味着强滤波。
自适应空域滤波
自适应空域滤波器被定义为
g[x,y]=(1-α)*f[x,y]+α*μ
其中f[x,y]与g[x,y]分别是位置[x,y]上的输入像素值与输出像素值。
μ是像素f[x,y]周围5×5邻域的局域加权平均值,被定义为:
μ=(像素f[x,y]周围5×5邻域除f[x,y]之外的所有像素的加权和)/(52-1)
下面的权重表被用于计算加权平均:
0.0125 0.025 0.05 0.025 0.0125
0.025 0.05 0.1 0.05 0.025
0.025 0.05 0.1 0.05 0.025
0.025 0.05 0.1 0.05 0.025
0.0125 0.025 0.05 0.025 0.0125
设计该权重表,使得像素越靠近5×5窗口的中心,其权重也越高。这样的权重有助于保存图像的纹理。滤波器系数α适应于f[x,y]与μ之间的绝对值差异。查找表被用于选择系数值。建立查找表的分类,以允许用户从滤波器的多种强度级别中进行选择。与时域滤波的情形相似,α越快从系数自适应曲线衰落(roll off),滤波器越弱。滤波器系数取值从0到1。对于强度接近于平均值的像素,滤波器系数α趋近于1,滤波器变为平均滤波器,这意味着强滤波。对于边沿上的像素,滤波器系数α趋近于零,这意味着没有应用滤波。
因此,可以看到本发明提供了一种改进的设备与方法,其通过利用被第一次扫描编码器预生成运动矢量来应用运动补偿时域滤波,从而在视频***中降低噪声。在场景变换帧,自适应空域滤波与权重表相结合,基于像素相对于其它像素及边沿的位置,提供程度可变的滤波。该操作保存了图像内的纹理。改进了时域滤波响应,并降低了计算复杂度;从而使精确度与处理吞吐量得到增强。
尽管本发明是结合所述优选实施例进行描述的,应该认识到,在不背离如权利要求书所阐述的本发明的范围的前提下,还可另外作出多种修改和变动。
Claims (12)
1.一种用于在视频分配***上降低噪声的方法,其包括:
利用对图像数据进行压缩期间预生成的运动矢量来对压缩图像数据应用运动补偿时域滤波,其中:
所述滤波操作适于降低所述压缩图像数据中的噪声,
消除在所述滤波步骤期间重新生成所述运动矢量的需求,和
对压缩图像数据应用自适应空域滤波。
2.一种运动补偿时域滤波方法,其用于包括至少三个连续视频帧的预压缩的视频图像数据,以降低所述数据中的噪声,所述视频图像数据包括当前帧、所述当前帧之前的第一锚帧、所述当前帧之后的第二锚帧,其中所述各帧中的每一个具有多个像素,每个所述像素具有关联的幅度,所述当前帧的当前像素是中间像素且匹配于所述第一锚帧内的第一像素与所述第二锚帧内的第二像素,所述方法包括如下步骤:
对于P帧与B帧编码,
前向预测阶段,其包括:
确定所述当前帧内的像素的幅度与位于所述第一帧内的像素的幅度之间的绝对值差异,其中第一帧像素位置从当前帧像素位置偏移出预计算的运动矢量;
从所述绝对值差异确定滤波器系数β(前向),
通过对前锚帧像素与当前帧像素各自的幅度值连同β(前向)、(1-β(前向))的数值,以及与之关联的运动矢量进行算术处理,为前锚帧像素与当前帧像素计算部分值,从而赋值给计算的当前帧像素值,
对各个锚帧像素的部分值结果与当前帧像素的部分值进行相加,以获得单个计算出的像素幅度值;
另外,对于B帧编码:
后向预测阶段,其包括:
从第一前向预测阶段接收经时域滤波的当前帧像素幅度值,
确定位于所述当前帧内的像素的幅度与位于所述第二帧内的像素的幅度之间的绝对值差异,其中第二帧像素位置从所述当前帧像素位置偏移出预计算的运动矢量,
确定滤波器系数β(后向),其对应于所述绝对值差异,
通过对后锚帧像素与当前帧像素各自的幅度值连同β(后向)、(1-β(后向)),以及位于偏移出代表性的运动矢量的所述第二帧之内的所述像素的幅度进行算术处理,为后锚帧像素值与当前帧像素值计算部分值,以赋值给计算的当前帧像素值,和
对各个锚帧像素的部分值结果与当前帧像素的部分值进行相加,以获得单个计算出的像素幅度值。
3.如权利要求1所述的方法,其进一步包括查找表,其用于基于像素幅度差异来确定β(后向)和β(前向)的值,其对应于介子0到1之间的值。
4.如权利要求1所述的方法,其进一步包括流水线架构,由此将运动补偿时域滤波与空域滤波和延迟组件相结合,以提供预测方案,该方案用于统计的复用器速率控制***。
5.如权利要求1所述的方法,其进一步包括选择代码转换或第一次扫描编码之一,用于计算所述运动矢量。
6.一种自适应空域滤波方法,其包括对当前帧内的输入与输出像素值、所述帧上的一组像素的加权平均值以及滤波器系数α进行算术处理。
7.如权利要求6所述的方法,其中所述加权平均值是从包含预确定区域内的多个指定像素的像素幅度值的表中确定的。
8.如权利要求7所述的方法,其中包含所述预确定区域的所述像素幅度值与像素到所述区域内的中心像素的距离成反比。
9.如权利要求1所述的方法,其进一步包括场景变换检测流程,其用于确定所述当前帧是否被承认为场景变换帧。
10.如权利要求9所述的方法,其中所述流程选择所述第一阶段时域滤波器输出或所述自适应空域滤波器输出之一。
11.一种用于在视频分配***上降低噪声的设备,其包括:
运动补偿时域滤波器,其适于利用在对图像数据进行压缩期间预生成的运动矢量,对所述压缩图像数据进行滤波,其中:
所述滤波操作适于降低所述压缩图像数据中的噪声,
消除在所述滤波步骤期间重新生成所述运动矢量的需求,和
对压缩图像数据应用自适应空域滤波。
12.一种运动补偿时域滤波设备,其用于包括至少三个连续视频帧的预压缩的视频图像数据,以降低所述数据中的噪声,所述视频图像数据包括当前帧、所述当前帧之前的第一锚帧、所述当前帧之后的第二锚帧,其中所述各帧中的每一个具有多个像素,每个所述像素具有关联的幅度,所述当前帧的当前像素是中间像素且匹配于所述第一锚帧内的第一像素与所述第二锚帧内的第二像素,所述方法包括:
对于P帧与B帧编码:
第一阶段,其包括:
减法器,其用于确定位于所述当前帧内的像素的幅度与位于所述第一帧内的像素的幅度之间的绝对值差异,其中第一帧像素位置从当前帧像素位置偏移出预计算的运动矢量;
比较器,其用于对绝对值像素差与存储为表的形式的β(前向)值表进行比较,
计算器,其通过对前锚帧像素与当前帧像素各自的幅度值连同β(前向)、(1-β(前向))的数值,以及与前锚帧关联的运动矢量进行算术处理,为前锚帧像素与当前帧像素确定部分值,从而赋值给计算的当前帧像素值,
计算器,用于对适用的锚帧像素的部分值结果与当前帧像素的部分值进行相加,以获得单个计算出的像素幅度值;和
存储组件,其用于存储编码帧,由此可以比较各帧之间的像素;和
另外,对于B帧编码:
第二阶段,其包括:
减法器,其用于确定所述当前像素的幅度与所述第二像素的幅度之间的绝对值差异,其中所述第二像素位置是通过一个位置和一个由预计算的运动矢量所描述的偏移而确定的;
滤波器系数值β(后向)的表,其关联于所述绝对值差异,
计算器,其通过对第二锚帧像素和当前帧像素各自的幅度值连同β(后向)、(1-β(后向))的数值,以及与第二锚帧关联的运动矢量进行算术处理,为第二锚帧像素值确定部分值,从而赋值给计算的当前帧像素值;
计算器,用于对适用的锚帧像素的部分值结果与当前帧像素的部分值进行相加,以获得单个计算出的像素幅度值;和
存储组件,其用于存储编码帧,由此可以比较各帧之间的像素。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/929,553 US7110455B2 (en) | 2001-08-14 | 2001-08-14 | Noise reduction pre-processor for digital video using previously generated motion vectors and adaptive spatial filtering |
US09/929,553 | 2001-08-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN1541482A true CN1541482A (zh) | 2004-10-27 |
Family
ID=25458046
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNA02815861XA Pending CN1541482A (zh) | 2001-08-14 | 2002-08-07 | 用于数字视频信号的运动自适应降噪预处理 |
Country Status (8)
Country | Link |
---|---|
US (1) | US7110455B2 (zh) |
EP (2) | EP1711019B1 (zh) |
KR (1) | KR100960742B1 (zh) |
CN (1) | CN1541482A (zh) |
AU (1) | AU2002356069A1 (zh) |
CA (1) | CA2456252C (zh) |
MX (1) | MXPA04001375A (zh) |
WO (1) | WO2003017676A2 (zh) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102460505A (zh) * | 2009-04-17 | 2012-05-16 | 通用仪表公司 | 用于在视频处理中减少噪声的*** |
CN102640184A (zh) * | 2009-10-20 | 2012-08-15 | 苹果公司 | 用于图像信号处理的时域滤波技术 |
CN104350752A (zh) * | 2012-01-17 | 2015-02-11 | 华为技术有限公司 | 用于高性能视频编码中的无损编码模式的环内滤波 |
CN102957844B (zh) * | 2011-08-12 | 2017-03-01 | 索尼公司 | 图像处理设备和图像处理方法 |
CN110933334A (zh) * | 2019-12-12 | 2020-03-27 | 腾讯科技(深圳)有限公司 | 视频降噪方法、装置、终端及存储介质 |
CN111009219A (zh) * | 2018-10-08 | 2020-04-14 | 奇景光电股份有限公司 | 适用于显示器背光的区域调光*** |
CN113259662A (zh) * | 2021-04-16 | 2021-08-13 | 西安邮电大学 | 基于三维小波视频编码的码率控制方法 |
CN113438488A (zh) * | 2021-06-18 | 2021-09-24 | 北京锐马视讯科技有限公司 | 低码率视频优化编码方法和装置、设备及存储介质 |
CN113726311A (zh) * | 2021-08-23 | 2021-11-30 | 北京智源人工智能研究院 | 脉冲信号滤波电路及电子设备 |
CN115604463A (zh) * | 2022-09-07 | 2023-01-13 | 天津市国瑞数码安全***股份有限公司(Cn) | 一种自适应感知采样的视频压缩方法和*** |
Families Citing this family (96)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2851111B1 (fr) * | 2003-02-10 | 2005-07-22 | Nextream France | Dispositif de codage d'un flux de donnees video |
US7215380B2 (en) | 2003-04-15 | 2007-05-08 | Silicon Integrated Systems Corp. | Method for detecting video frame types with median filtering |
CN100334874C (zh) * | 2003-07-02 | 2007-08-29 | 矽统科技股份有限公司 | 具滤噪声步骤的图框种类侦测方法 |
US10554985B2 (en) | 2003-07-18 | 2020-02-04 | Microsoft Technology Licensing, Llc | DC coefficient signaling at small quantization step sizes |
US7738554B2 (en) | 2003-07-18 | 2010-06-15 | Microsoft Corporation | DC coefficient signaling at small quantization step sizes |
US8218624B2 (en) | 2003-07-18 | 2012-07-10 | Microsoft Corporation | Fractional quantization step sizes for high bit rates |
US7606391B2 (en) * | 2003-07-25 | 2009-10-20 | Sony Corporation | Video content scene change determination |
US8243093B2 (en) * | 2003-08-22 | 2012-08-14 | Sharp Laboratories Of America, Inc. | Systems and methods for dither structure creation and application for reducing the visibility of contouring artifacts in still and video images |
US7359565B2 (en) * | 2004-05-03 | 2008-04-15 | International Business Machines Corporation | Method of filtering pixels in a video encoding process |
KR100624421B1 (ko) | 2004-05-04 | 2006-09-19 | 삼성전자주식회사 | 디지탈 영상 신호 필터링 장치 및 방법 |
US7801383B2 (en) | 2004-05-15 | 2010-09-21 | Microsoft Corporation | Embedded scalar quantizers with arbitrary dead-zone ratios |
KR20050119422A (ko) * | 2004-06-16 | 2005-12-21 | 삼성전자주식회사 | 움직임 보상에 기반한 입력 영상의 노이즈 예측 및 그장치와, 이를 사용한 노이즈 제거 및 동영상 부호화 방법,이를 수행하기 위한 프로그램이 기록된 기록 매체 |
US7199838B2 (en) * | 2004-06-17 | 2007-04-03 | Samsung Electronics Co., Ltd. | Motion adaptive noise reduction apparatus and method for video signals |
US20100272182A1 (en) * | 2004-06-23 | 2010-10-28 | Quanta International Limited | Image flow knowledge assisted latency-free in-loop temporal filter |
US20050286638A1 (en) * | 2004-06-23 | 2005-12-29 | Qpixel Technology International, Inc. | Image flow knowledge assisted latency-free in-loop temporal filter |
US7512182B2 (en) * | 2004-08-30 | 2009-03-31 | General Instrument Corporation | Method and apparatus for performing motion compensated temporal filtering in video encoding |
KR20060043051A (ko) * | 2004-09-23 | 2006-05-15 | 엘지전자 주식회사 | 영상 신호의 인코딩 및 디코딩 방법 |
KR100677748B1 (ko) * | 2004-12-23 | 2007-02-02 | 삼성전자주식회사 | 노이즈 감쇄장치 및 그 방법 |
US7535517B2 (en) * | 2005-04-14 | 2009-05-19 | Samsung Electronics Co., Ltd. | Method of motion compensated temporal noise reduction |
US7554611B2 (en) * | 2005-04-19 | 2009-06-30 | Samsung Electronics Co., Ltd. | Method and apparatus of bidirectional temporal noise reduction |
US7787754B2 (en) | 2005-05-17 | 2010-08-31 | Université de Montréal | Continuous extension of discrete transform for data processing |
US8422546B2 (en) | 2005-05-25 | 2013-04-16 | Microsoft Corporation | Adaptive video encoding using a perceptual model |
CN101213574A (zh) * | 2005-06-07 | 2008-07-02 | 汤姆逊许可公司 | 静态图像、视频以及影片基于内容的高斯降噪 |
US8005308B2 (en) * | 2005-09-16 | 2011-08-23 | Sony Corporation | Adaptive motion estimation for temporal prediction filter over irregular motion vector samples |
US7894527B2 (en) * | 2005-09-16 | 2011-02-22 | Sony Corporation | Multi-stage linked process for adaptive motion vector sampling in video compression |
US8107748B2 (en) * | 2005-09-16 | 2012-01-31 | Sony Corporation | Adaptive motion search range |
KR100772405B1 (ko) * | 2005-09-27 | 2007-11-01 | 삼성전자주식회사 | 전역 움직임 추정에 근거한 적응성 잡음 감쇄 방법 및 영상처리 시스템 |
US7640000B2 (en) * | 2005-12-10 | 2009-12-29 | Electronics And Telecommunications Research Institute | Apparatus and method for cancellation of partially overlapped crosstalk signals |
KR100823569B1 (ko) * | 2005-12-10 | 2008-04-21 | 한국전자통신연구원 | 주파수 대역의 부분적인 중첩에 따른 간섭 신호를 제거하는장치 및 그 방법 |
US8514332B2 (en) * | 2005-12-20 | 2013-08-20 | Broadcom Corporation | Method and system for non-linear blending in motion-based video processing |
US7639309B2 (en) * | 2005-12-20 | 2009-12-29 | Broadcom Corporation | Method and system for analog video noise reduction by blending FIR and IIR filtering |
US8040437B2 (en) * | 2005-12-20 | 2011-10-18 | Broadcom Corporation | Method and system for analog video noise detection |
US8503536B2 (en) | 2006-04-07 | 2013-08-06 | Microsoft Corporation | Quantization adjustments for DC shift artifacts |
US7974340B2 (en) | 2006-04-07 | 2011-07-05 | Microsoft Corporation | Adaptive B-picture quantization control |
US7995649B2 (en) | 2006-04-07 | 2011-08-09 | Microsoft Corporation | Quantization adjustment based on texture level |
US8059721B2 (en) | 2006-04-07 | 2011-11-15 | Microsoft Corporation | Estimating sample-domain distortion in the transform domain with rounding compensation |
US8130828B2 (en) | 2006-04-07 | 2012-03-06 | Microsoft Corporation | Adjusting quantization to preserve non-zero AC coefficients |
US8711925B2 (en) | 2006-05-05 | 2014-04-29 | Microsoft Corporation | Flexible quantization |
US8369417B2 (en) * | 2006-05-19 | 2013-02-05 | The Hong Kong University Of Science And Technology | Optimal denoising for video coding |
US8831111B2 (en) * | 2006-05-19 | 2014-09-09 | The Hong Kong University Of Science And Technology | Decoding with embedded denoising |
WO2008048489A2 (en) * | 2006-10-18 | 2008-04-24 | Thomson Licensing | Method and apparatus for video coding using prediction data refinement |
US20080101469A1 (en) * | 2006-10-31 | 2008-05-01 | Motorola, Inc. | Method and apparatus for adaptive noise filtering of pixel data |
US8582666B2 (en) * | 2006-12-18 | 2013-11-12 | Koninklijke Philips N.V. | Image compression and decompression |
JP4850689B2 (ja) * | 2006-12-22 | 2012-01-11 | キヤノン株式会社 | 画像処理装置、画像処理方法、画像処理プログラム並びに記憶媒体 |
US7952646B2 (en) | 2006-12-27 | 2011-05-31 | Intel Corporation | Method and apparatus for content adaptive spatial-temporal motion adaptive noise reduction |
US8238424B2 (en) | 2007-02-09 | 2012-08-07 | Microsoft Corporation | Complexity-based adaptive preprocessing for multiple-pass video compression |
US8498335B2 (en) | 2007-03-26 | 2013-07-30 | Microsoft Corporation | Adaptive deadzone size adjustment in quantization |
US8243797B2 (en) | 2007-03-30 | 2012-08-14 | Microsoft Corporation | Regions of interest for quality adjustments |
US8442337B2 (en) | 2007-04-18 | 2013-05-14 | Microsoft Corporation | Encoding adjustments for animation content |
JP5050637B2 (ja) * | 2007-05-11 | 2012-10-17 | ソニー株式会社 | 映像信号処理装置、映像信号処理方法、映像信号処理方法のプログラム及び映像信号処理方法のプログラムを記録した記録媒体 |
US8331438B2 (en) | 2007-06-05 | 2012-12-11 | Microsoft Corporation | Adaptive selection of picture-level quantization parameters for predicted video pictures |
US8837849B2 (en) * | 2007-06-26 | 2014-09-16 | Google Inc. | Method for noise-robust color changes in digital images |
US20090010339A1 (en) * | 2007-07-05 | 2009-01-08 | Faraday Technology Corp. | Image compensation circuit, method thereof, and lcd device using the same |
US8145970B2 (en) * | 2007-09-06 | 2012-03-27 | Broadcom Corporation | Data puncturing ensuring orthogonality within communication systems |
KR20090095316A (ko) * | 2008-03-05 | 2009-09-09 | 삼성전자주식회사 | 영상 인트라 예측 방법 및 장치 |
US8189933B2 (en) | 2008-03-31 | 2012-05-29 | Microsoft Corporation | Classifying and controlling encoding quality for textured, dark smooth and smooth video content |
US8897359B2 (en) | 2008-06-03 | 2014-11-25 | Microsoft Corporation | Adaptive quantization for enhancement layer video coding |
US8891619B2 (en) * | 2008-06-16 | 2014-11-18 | Dolby Laboratories Licensing Corporation | Rate control model adaptation based on slice dependencies for video coding |
US8326075B2 (en) | 2008-09-11 | 2012-12-04 | Google Inc. | System and method for video encoding using adaptive loop filter |
US8792564B2 (en) * | 2008-10-28 | 2014-07-29 | Sony Corporation | Adaptive preprocessing method using feature-extracted video maps |
KR101573400B1 (ko) | 2009-02-18 | 2015-12-02 | 삼성디스플레이 주식회사 | 액정 표시 장치 및 그 구동 방법 |
TWI398825B (zh) * | 2009-10-07 | 2013-06-11 | Altek Corp | Method of suppressing noise by using multiple digital images |
KR101379189B1 (ko) * | 2009-10-19 | 2014-04-10 | 에스케이 텔레콤주식회사 | 움직임 보상 프레임의 필터링을 이용한 영상 부호화/복호화 방법 및 장치 |
SG10201406803YA (en) | 2009-10-30 | 2014-11-27 | Agency Science Tech & Res | Methods, Devices, And Computer Readable Mediums For Processing A Digital Picture |
US8503528B2 (en) | 2010-09-15 | 2013-08-06 | Google Inc. | System and method for encoding video using temporal filter |
US9036695B2 (en) | 2010-11-02 | 2015-05-19 | Sharp Laboratories Of America, Inc. | Motion-compensated temporal filtering based on variable filter parameters |
US8755438B2 (en) * | 2010-11-29 | 2014-06-17 | Ecole De Technologie Superieure | Method and system for selectively performing multiple video transcoding operations |
US9462280B2 (en) * | 2010-12-21 | 2016-10-04 | Intel Corporation | Content adaptive quality restoration filtering for high efficiency video coding |
US9807424B2 (en) * | 2011-01-10 | 2017-10-31 | Qualcomm Incorporated | Adaptive selection of region size for identification of samples in a transition zone for overlapped block motion compensation |
US8780996B2 (en) | 2011-04-07 | 2014-07-15 | Google, Inc. | System and method for encoding and decoding video data |
US8781004B1 (en) | 2011-04-07 | 2014-07-15 | Google Inc. | System and method for encoding video using variable loop filter |
US8780971B1 (en) | 2011-04-07 | 2014-07-15 | Google, Inc. | System and method of encoding using selectable loop filters |
US8885706B2 (en) | 2011-09-16 | 2014-11-11 | Google Inc. | Apparatus and methodology for a video codec system with noise reduction capability |
WO2013049412A2 (en) | 2011-09-29 | 2013-04-04 | Dolby Laboratories Licensing Corporation | Reduced complexity motion compensated temporal processing |
US8818125B2 (en) * | 2011-10-07 | 2014-08-26 | Texas Instruments Incorporated | Scene adaptive filter design for improved stereo matching |
US9906815B2 (en) * | 2011-11-08 | 2018-02-27 | Texas Instruments Incorporated | Delayed duplicate I-picture for video coding |
TWI510076B (zh) * | 2011-12-05 | 2015-11-21 | Realtek Semiconductor Corp | 影像處理方法及相關的影像處理裝置 |
US9131073B1 (en) * | 2012-03-02 | 2015-09-08 | Google Inc. | Motion estimation aided noise reduction |
US9326008B2 (en) | 2012-04-10 | 2016-04-26 | Google Inc. | Noise reduction for image sequences |
US9344729B1 (en) | 2012-07-11 | 2016-05-17 | Google Inc. | Selective prediction signal filtering |
US9041834B2 (en) * | 2012-09-19 | 2015-05-26 | Ziilabs Inc., Ltd. | Systems and methods for reducing noise in video streams |
CN102968763A (zh) * | 2012-10-20 | 2013-03-13 | 江南大学 | 一种基于自适应神经模糊推理***的图像滤波方法 |
WO2015031891A2 (en) * | 2013-08-30 | 2015-03-05 | ARRIS Enterprises, Inc | Multipass encoder with heterogeneous codecs |
US9294766B2 (en) | 2013-09-09 | 2016-03-22 | Apple Inc. | Chroma quantization in video coding |
JP2015149554A (ja) * | 2014-02-05 | 2015-08-20 | キヤノン株式会社 | 画像処理装置、画像処理方法及び撮像装置 |
CA2952823A1 (en) * | 2014-06-25 | 2015-12-30 | Arris Enterprises Llc | A method for using a decoder or look-ahead encoder to control an adaptive pre-filter |
US10102613B2 (en) | 2014-09-25 | 2018-10-16 | Google Llc | Frequency-domain denoising |
US10021396B1 (en) | 2014-12-30 | 2018-07-10 | Ambarella, Inc. | Motion detection based on observing several pictures |
US10049436B1 (en) | 2015-09-30 | 2018-08-14 | Google Llc | Adaptive denoising for real-time video on mobile devices |
KR101780444B1 (ko) | 2015-10-29 | 2017-09-21 | 삼성에스디에스 주식회사 | 영상 신호의 노이즈 제거 방법 |
CN105898319A (zh) * | 2015-12-22 | 2016-08-24 | 乐视云计算有限公司 | 视频转码方法和装置 |
WO2017132600A1 (en) * | 2016-01-29 | 2017-08-03 | Intuitive Surgical Operations, Inc. | Light level adaptive filter and method |
US10911698B2 (en) * | 2016-09-30 | 2021-02-02 | Huddly As | ISP bias-compensating noise reduction systems and methods |
US10453187B2 (en) * | 2017-07-21 | 2019-10-22 | The Boeing Company | Suppression of background clutter in video imagery |
US11252440B2 (en) * | 2019-11-07 | 2022-02-15 | Comcast Cable Communications, Llc | Pixel filtering for content |
CN113055669B (zh) * | 2021-01-15 | 2023-01-17 | 北京博雅慧视智能技术研究院有限公司 | 一种编码前的图像滤波方法及装置 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3679553D1 (de) * | 1985-12-24 | 1991-07-04 | British Broadcasting Corp | Bandbreitenreduktion fuer fernsehsignale. |
US5367629A (en) * | 1992-12-18 | 1994-11-22 | Sharevision Technology, Inc. | Digital video compression system utilizing vector adaptive transform |
KR960012932B1 (ko) * | 1993-09-17 | 1996-09-25 | 대우전자 주식회사 | 이차원 공간 필터링을 이용한 시간축 대역 제한 방법 |
JPH07177464A (ja) * | 1993-12-16 | 1995-07-14 | Pioneer Video Corp | リアルタイム画像圧縮処理装置 |
EP0772365A3 (en) * | 1995-11-02 | 1999-05-12 | Matsushita Electric Industrial Co., Ltd. | Method and device for filtering a picture signal, and encoding/decoding using the same |
US5686963A (en) * | 1995-12-26 | 1997-11-11 | C-Cube Microsystems | Method for performing rate control in a video encoder which provides a bit budget for each frame while employing virtual buffers and virtual buffer verifiers |
JPH11504490A (ja) * | 1996-02-19 | 1999-04-20 | フィリップス エレクトロニクス ネムローゼ フェンノートシャップ | ビデオ信号符号化方法及び装置 |
US6100931A (en) * | 1996-03-19 | 2000-08-08 | Sony Corporation | Method and apparatus for controlling a target amount of code and for compressing video data |
US6005626A (en) * | 1997-01-09 | 1999-12-21 | Sun Microsystems, Inc. | Digital video signal encoder and encoding method |
US6178205B1 (en) * | 1997-12-12 | 2001-01-23 | Vtel Corporation | Video postfiltering with motion-compensated temporal filtering and/or spatial-adaptive filtering |
US6385489B1 (en) | 1998-09-25 | 2002-05-07 | Ep Medsystems, Inc. | Triple array defibrillation catheter and method of using the same |
US6310915B1 (en) * | 1998-11-20 | 2001-10-30 | Harmonic Inc. | Video transcoder with bitstream look ahead for rate control and statistical multiplexing |
US7145607B1 (en) * | 1999-11-11 | 2006-12-05 | Stmicroelectronics Asia Pacific Pte. Ltd. | Spatio-temporal video noise reduction system |
EP1100260A1 (en) * | 1999-11-12 | 2001-05-16 | STMicroelectronics S.r.l. | Spatio-temporal filtering method for noise reduction during pre-processing of picture sequences in video encoders |
-
2001
- 2001-08-14 US US09/929,553 patent/US7110455B2/en not_active Expired - Lifetime
-
2002
- 2002-08-07 KR KR1020047002223A patent/KR100960742B1/ko active IP Right Grant
- 2002-08-07 CN CNA02815861XA patent/CN1541482A/zh active Pending
- 2002-08-07 MX MXPA04001375A patent/MXPA04001375A/es active IP Right Grant
- 2002-08-07 CA CA2456252A patent/CA2456252C/en not_active Expired - Fee Related
- 2002-08-07 AU AU2002356069A patent/AU2002356069A1/en not_active Abandoned
- 2002-08-07 EP EP06076414.9A patent/EP1711019B1/en not_active Expired - Lifetime
- 2002-08-07 WO PCT/US2002/024867 patent/WO2003017676A2/en not_active Application Discontinuation
- 2002-08-07 EP EP02794854.6A patent/EP1438862B1/en not_active Expired - Lifetime
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102460505A (zh) * | 2009-04-17 | 2012-05-16 | 通用仪表公司 | 用于在视频处理中减少噪声的*** |
CN102640184A (zh) * | 2009-10-20 | 2012-08-15 | 苹果公司 | 用于图像信号处理的时域滤波技术 |
CN102640184B (zh) * | 2009-10-20 | 2015-04-08 | 苹果公司 | 用于图像信号处理的时域滤波技术 |
CN102957844B (zh) * | 2011-08-12 | 2017-03-01 | 索尼公司 | 图像处理设备和图像处理方法 |
CN104350752A (zh) * | 2012-01-17 | 2015-02-11 | 华为技术有限公司 | 用于高性能视频编码中的无损编码模式的环内滤波 |
CN104350752B (zh) * | 2012-01-17 | 2019-07-12 | 华为技术有限公司 | 用于高性能视频编码中的无损编码模式的环内滤波的装置 |
CN111009219B (zh) * | 2018-10-08 | 2021-09-21 | 奇景光电股份有限公司 | 适用于显示器背光的区域调光*** |
CN111009219A (zh) * | 2018-10-08 | 2020-04-14 | 奇景光电股份有限公司 | 适用于显示器背光的区域调光*** |
CN110933334A (zh) * | 2019-12-12 | 2020-03-27 | 腾讯科技(深圳)有限公司 | 视频降噪方法、装置、终端及存储介质 |
CN113259662A (zh) * | 2021-04-16 | 2021-08-13 | 西安邮电大学 | 基于三维小波视频编码的码率控制方法 |
CN113438488A (zh) * | 2021-06-18 | 2021-09-24 | 北京锐马视讯科技有限公司 | 低码率视频优化编码方法和装置、设备及存储介质 |
CN113726311A (zh) * | 2021-08-23 | 2021-11-30 | 北京智源人工智能研究院 | 脉冲信号滤波电路及电子设备 |
CN113726311B (zh) * | 2021-08-23 | 2022-05-06 | 北京智源人工智能研究院 | 脉冲信号滤波电路及电子设备 |
CN115604463A (zh) * | 2022-09-07 | 2023-01-13 | 天津市国瑞数码安全***股份有限公司(Cn) | 一种自适应感知采样的视频压缩方法和*** |
Also Published As
Publication number | Publication date |
---|---|
US7110455B2 (en) | 2006-09-19 |
EP1438862A2 (en) | 2004-07-21 |
US20030039310A1 (en) | 2003-02-27 |
EP1438862B1 (en) | 2019-03-27 |
WO2003017676A3 (en) | 2003-12-11 |
CA2456252C (en) | 2012-11-27 |
AU2002356069A1 (en) | 2003-03-03 |
EP1711019A3 (en) | 2011-11-30 |
EP1711019A2 (en) | 2006-10-11 |
MXPA04001375A (es) | 2004-06-03 |
KR20040030096A (ko) | 2004-04-08 |
KR100960742B1 (ko) | 2010-06-01 |
WO2003017676A2 (en) | 2003-02-27 |
EP1711019B1 (en) | 2018-10-03 |
CA2456252A1 (en) | 2003-02-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN1541482A (zh) | 用于数字视频信号的运动自适应降噪预处理 | |
CN1098597C (zh) | 视频信号处理的噪声估计与降低装置 | |
CN1264355C (zh) | 视频编码方法 | |
EP1653744A1 (en) | Non-integer pixel sharing for video encoding | |
JP2000013799A (ja) | 動き補償符号化復号化装置及びその方法 | |
JPWO2003003749A1 (ja) | 画像符号化装置、画像復号装置、画像符号化方法及び画像復号方法 | |
US9014268B2 (en) | Video encoder and its decoder | |
WO2006094033A1 (en) | Adaptive frame skipping techniques for rate controlled video encoding | |
US20050036549A1 (en) | Method and apparatus for selection of scanning mode in dual pass encoding | |
CN1306725A (zh) | 视频编码方法以及对应的视频编码器 | |
CN1232125C (zh) | 通过参考离散余弦变换系数来估计运动的方法及其装置 | |
WO2006074043A2 (en) | Method and apparatus for providing motion estimation with weight prediction | |
KR100229796B1 (ko) | 열화영상에 대한 보상기능을 갖는 영상 복호화 시스템 | |
CN1878304A (zh) | 编码和解码图像序列的方法和设备 | |
Ye et al. | Improved side information generation with iterative decoding and frame interpolation for distributed video coding | |
CN101540900A (zh) | 降低视频流中的区块效应的方法 | |
JPH07107462A (ja) | 動画像符号化方法 | |
KR20070011351A (ko) | 압축된 비트스트림으로부터 코딩 정보를 사용하는 비디오품질 강화 및/또는 아티팩트 저감 | |
KR20130032807A (ko) | 동영상 부호화 장치 및 방법 | |
KR20010104058A (ko) | 동영상 부호화기의 부호화 모드에 따른 적응적 양자화기 | |
JP2007516639A (ja) | 符号化方法及び符号化装置 | |
GB2393060A (en) | Manipulation of video compression | |
JPH05227513A (ja) | 映像信号伝送装置 | |
JPH07298270A (ja) | 動き補償フレーム間予測符号化装置 | |
JP4734301B2 (ja) | 量子化誤差低減装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |