TWI477152B - Method for determining size of adaptive window applied in motion estimation and application thereof - Google Patents

Method for determining size of adaptive window applied in motion estimation and application thereof Download PDF

Info

Publication number
TWI477152B
TWI477152B TW097120985A TW97120985A TWI477152B TW I477152 B TWI477152 B TW I477152B TW 097120985 A TW097120985 A TW 097120985A TW 97120985 A TW97120985 A TW 97120985A TW I477152 B TWI477152 B TW I477152B
Authority
TW
Taiwan
Prior art keywords
threshold
sum
size
block
search box
Prior art date
Application number
TW097120985A
Other languages
Chinese (zh)
Other versions
TW200952492A (en
Inventor
Jhingfa Wang
Paul Anand
Jiaching Wang
Original Assignee
Univ Nat Cheng Kung
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Nat Cheng Kung filed Critical Univ Nat Cheng Kung
Priority to TW097120985A priority Critical patent/TWI477152B/en
Publication of TW200952492A publication Critical patent/TW200952492A/en
Application granted granted Critical
Publication of TWI477152B publication Critical patent/TWI477152B/en

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Description

一種應用於移動估測之適應性搜尋框的大小決定方法與其應用A Method for Determining the Size of Adaptive Search Box for Mobile Estimation and Its Application

本發明是有關於一種應用於移動估測之適應性搜尋框的大小決定方法與其應用。The present invention relates to a method for determining the size of an adaptive search box for mobile estimation and its application.

H.264/AVC是國際電信聯盟遠程通信標準化組(ITU-T)內的視訊編碼專家組(Video Coding Experts Group; VCEG)與國際標準組織(ISO)/國際電工協會(IEC)下的動態圖像專家組(Moving Picture Experts Group; MPEG)共同組成的聯合視訊組(Joint Video Team; JVT)所制訂的視訊壓縮標準。其中H.264係依據ITU-T以H.26x系列為標準之命名,而AVC則為ISO/IEC MPEG的稱呼。此標準的第一版最終草案(Final Draft)已於2003年5月完成。H.264/AVC is a dynamic diagram of the Video Coding Experts Group (VCEG) and the International Standards Organization (ISO)/International Electrotechnical Commission (IEC) within the International Telecommunication Union Telecommunication Standardization Group (ITU-T). A video compression standard developed by the Joint Video Team (JVT), which is composed of the Moving Picture Experts Group (MPEG). Among them, H.264 is based on the ITU-T standard named H.26x series, while AVC is the name of ISO/IEC MPEG. The first draft of this standard, the Final Draft, was completed in May 2003.

H.264/AVC的主要目標是希望在近似的視訊品質下,能較先前的相關技術(比如MPEG-2或者H.263),提供更高的壓縮率;同時,不需增加很多複雜的編解碼工具,使得硬體難以實現。另一個目標是可適應性,即該視訊壓縮標準可在很廣泛的範圍內使用(包含高位元率與低位元率的視訊,以及不同的視訊解析度),並且能在各種網路和系統上(如多媒體行動電話系統或高畫質電視)工作。The main goal of H.264/AVC is to provide higher compression ratios than previous related technologies (such as MPEG-2 or H.263) under the approximate video quality. At the same time, there is no need to add a lot of complicated editing. The decoding tool makes the hardware difficult to implement. Another goal is adaptability, that is, the video compression standard can be used in a wide range (including high bit rate and low bit rate video, and different video resolution), and can be used on various networks and systems. Work (such as multimedia mobile phone systems or high definition TV).

移動估測(motion estimation, ME)在H.264中是很重要的部份。移動估測主要目的是消除影像在時間域上的冗餘,使其在編解碼過程時只需記錄第一張畫面的資訊,而其它畫面皆可以由移動過程中所紀錄的等資訊來重建,如 此一來可以不用儲存所有畫面的資訊,即可使得資訊量大幅減少而達到影像壓縮的效果。一般的移動估測方法係以每個畫面框中的一個區塊(macro block)做為最小估測單位,每個區塊之大小可例如為16X16個像素。Motion estimation (ME) is a very important part of H.264. The main purpose of the motion estimation is to eliminate the redundancy of the image in the time domain, so that only the information of the first picture is recorded during the encoding and decoding process, and other pictures can be reconstructed by information recorded during the movement process. Such as In this way, the information can be greatly reduced and the image compression effect can be achieved without storing the information of all the pictures. A general motion estimation method uses a macro block in each picture frame as a minimum estimation unit, and each block may have a size of, for example, 16×16 pixels.

目前已有相當多的移動估測方法被提出,例如T.Koga等人所提出之三步搜尋(Three-Step Search, TSS)演算法,又例如Lai-Man Po等人所提出之四步搜尋(Four-Step Search, FSS)演算法。然而,在習知技術中,使用固定大小的搜尋框來搜尋較為匹配(matching)且相似度較高之區塊,此舉不但容易浪費系統的運算資源,也可能導致影像的峰值信噪比(Peak Signal to Noise Ratio; PSNR)值下降。At present, quite a number of mobile estimation methods have been proposed, such as the Three-Step Search (TSS) algorithm proposed by T. Koga et al., and the four-step search proposed by Lai-Man Po et al. (Four-Step Search, FSS) algorithm. However, in the prior art, a fixed-size search box is used to search for blocks that are more matching and have higher similarity, which is not only easy to waste the computing resources of the system, but also may cause the peak signal-to-noise ratio of the image ( Peak Signal to Noise Ratio; PSNR) value decreases.

因此,需要一種適應性搜尋框(adaptive searching window)與應用此適應性搜尋框之移動估測方法。Therefore, there is a need for an adaptive searching window and a mobile estimation method that applies this adaptive search box.

因此,本發明之一方面係提供一種適應性搜尋框與決定其大小之方法。Accordingly, one aspect of the present invention provides an adaptive search box and method of determining its size.

本發明之另一方面係提供一種應用適應性搜尋框之移動估測方法。Another aspect of the present invention provides a mobile estimation method using an adaptive search box.

根據本發明之一實施例,在此適應性搜尋框(adaptive searchiug window)之大小的決定方法中,首先,提供一目標圖框,此目標圖框包含至少一已編碼區塊和一目標區塊。接著,提供一參考圖框(reference frame),此參考圖框包含複數個參考區塊。然後,進行一閥值決定步驟,以計算至少一已編碼區塊之一第一平均絕對差值總和(Average of Sum of Absolute Difference),並利用此第一平均絕對差值總和來決定第一閥值和第二閥值,其中第二閥值係大於第一閥值。接著,進行目標值計算步驟,以計算已編碼區塊和目標區塊之一第二平均絕對差值總和。然後,進行一搜尋框大小決定步驟,以比較第二平均絕對差值總和、第一閥值和第二閥值之大小來獲得一比較結果,並根據此比較結果來決定對應至目標區塊之搜尋框的大小。According to an embodiment of the present invention, in the method for determining the size of the adaptive search iug window, first, a target frame is provided, the target frame including at least one coded block and a target block. . Next, a reference frame is provided, the reference frame including a plurality of reference blocks. Then, a threshold decision step is performed to calculate a sum of the first average absolute differences of one of the at least one coded block (Average of Sum of Absolute Difference), and using the sum of the first average absolute differences to determine a first threshold and a second threshold, wherein the second threshold is greater than the first threshold. Next, a target value calculation step is performed to calculate a sum of the second average absolute differences of one of the encoded block and the target block. Then, a search box size determining step is performed to compare the sum of the second average absolute difference, the first threshold and the second threshold to obtain a comparison result, and according to the comparison result, the corresponding to the target block is determined. The size of the search box.

根據本發明之另一實施例,此適應性搜尋框(adaptive searching window)之大小的決定方法中,首先,提供一目標圖框,此目標圖框包含一目標區塊。接著,提供一參考圖框(reference frame),此參考圖框包含複數個參考區塊。然後,進行一閥值決定步驟,以計算這些參考區塊之一第一平均絕對差值總和(Average of Sum of Absolute Difference),並利用此第一平均絕對差值總和來決定第一閥值和第二閥值,其中第二閥值係大於第一閥值。接著,進行目標值計算步驟,以計算這些參考區塊和目標區塊之一第二平均絕對差值總和。然後,進行一搜尋框大小決定步驟,以比較第二平均絕對差值總和、第一閥值和第二閥值之大小來獲得一比較結果,並根據此比較結果來決定對應至目標區塊之搜尋框的大小。According to another embodiment of the present invention, in the method for determining the size of the adaptive searching window, first, a target frame is provided, and the target frame includes a target block. Next, a reference frame is provided, the reference frame including a plurality of reference blocks. Then, a threshold determining step is performed to calculate an Average of Sum of Absolute Difference, and the first average absolute difference sum is used to determine the first threshold and a second threshold, wherein the second threshold is greater than the first threshold. Next, a target value calculation step is performed to calculate a sum of the second average absolute differences of one of the reference block and the target block. Then, a search box size determining step is performed to compare the sum of the second average absolute difference, the first threshold and the second threshold to obtain a comparison result, and according to the comparison result, the corresponding to the target block is determined. The size of the search box.

根據本發明之又一實施例,在此應用適應性搜尋框之移動估測方法中,首先進行一閥值決定步驟,以計已編碼區塊之一第一平均絕對差值總和,並利用第一平均絕對差值總和來決定一第一閥值和一第二閥值,其中第二閥值係大於第一閥值。然後,進行目標值計算步驟,以計算已編 碼區塊和目標區塊之一第二平均絕對差值總和。接著,進行搜尋框大小決定步驟,以比較第二平均絕對差值總和、第一閥值和第二閥值之大小來獲得一比較結果,並根據比較結果來決定對應至目標區塊之第一搜尋框之大小。然後,進行相似度比較步驟,以利用第一搜尋框來於參考圖框中選定匹配區塊。接著,進行移動向量計算步驟,以根據目標區塊和匹配區塊來計算目標區塊之移動向量。According to still another embodiment of the present invention, in the mobile estimation method for applying the adaptive search box, a threshold value determining step is first performed to calculate the sum of the first average absolute differences of one of the coded blocks, and utilize the A sum of average absolute differences determines a first threshold and a second threshold, wherein the second threshold is greater than the first threshold. Then, perform the target value calculation step to calculate the edited The sum of the second average absolute differences of one of the code block and the target block. Then, a search box size determining step is performed to compare the second average absolute difference sum, the first threshold and the second threshold to obtain a comparison result, and determine the first corresponding to the target block according to the comparison result. The size of the search box. Then, a similarity comparison step is performed to select the matching block in the reference frame using the first search box. Next, a motion vector calculation step is performed to calculate a motion vector of the target block from the target block and the matching block.

在移動估測技術中,若要使用適應性搜尋框(adaptive searching window)來搜尋較為匹配(matching)之區塊,適應性搜尋框(adaptive searchiug window)大小的決定方法是不可或缺的。在以下的說明中,將以多個實施例來說明本發明之適應性搜尋框大小的決定方法,與應用此適應性搜尋框之移動估測方法。In the mobile estimation technique, if an adaptive searching window is used to search for a matching block, the method of determining the size of the adaptive search iug window is indispensable. In the following description, a method for determining the size of an adaptive search box of the present invention and a method for estimating the motion of the adaptive search box will be described in various embodiments.

請同時參照第1圖和第2圖,第1圖係繪示根據本發明第一實施例之目標圖框100和參考圖框150之結構示意圖,其中相同之剖面線係代表相同之區塊(102、104和106)。第2圖係繪示根據本發明第一實施例之適應性搜尋框(adaptive searching window)大小的決定方法200的流程示意圖。目標圖框100包含已編碼區塊102、未編碼區塊104和處理中之目標區塊106。參考圖框150和目標圖框100為連續之圖框,其中參考圖框150包含有參考區塊152。Referring to FIG. 1 and FIG. 2 together, FIG. 1 is a schematic structural view of a target frame 100 and a reference frame 150 according to the first embodiment of the present invention, wherein the same hatching represents the same block ( 102, 104 and 106). 2 is a flow chart showing a method 200 for determining the size of an adaptive searching window according to the first embodiment of the present invention. The target frame 100 includes an encoded block 102, an uncoded block 104, and a target block 106 in process. Reference frame 150 and target frame 100 are continuous frames, wherein reference frame 150 includes reference block 152.

為決定目標區塊106於參考圖框150之搜尋範圍,進行適應性搜尋框大小的決定方法200來決定目標區塊106 所對應之適應性搜尋框的大小。在決定方法200中,首先進行閥值決定步驟210。在閥值決定步驟210中,計算已編碼區塊之平均絕對差值總和(Average of Sum of Absolute Difference),並利用已編碼區塊之平均絕對差值總和來決定第一閥值和第二閥值。在本實施例中,第一閥值等於已編碼區塊之平均絕對差值總和,而第二閥值等於第一閥值之1.2倍,在本發明之其他實施例中,已編碼區塊之平均絕對差值總和與第一閥值和第二閥值之關係可設定為其他比例。接著,進行目標值計算步驟220。在目標值計算步驟220中,計算已編碼區塊和目標區塊之平均絕對差值總和。然後,進行搜尋框大小決定步驟230。在搜尋框大小決定步驟230中,比較已編碼區塊和目標區塊之平均絕對差值總和和、第一閥值和第二閥值之大小來獲得比較結果,並根據比較結果來決定對應至目標區塊106之搜尋框的大小。在搜尋框大小決定步驟230中,當已編碼區塊和目標區塊之平均絕對差值總和總和小於或等於第一閥值時,決定搜尋框之大小為8乘8個參考區塊。當已編碼區塊和目標區塊之平均絕對差值總和總和大於第一閥值,且小於第二閥值時,決定搜尋框之大小為16乘16個參考區塊。當已編碼區塊和目標區塊之平均絕對差值總和總和大於或等於第二閥值時,決定搜尋框之大小為32乘32個參考區塊。To determine the search range of the target block 106 in the reference frame 150, an adaptive search box size determination method 200 is performed to determine the target block 106. The size of the adaptive search box. In the decision method 200, a threshold determination step 210 is first performed. In the threshold decision step 210, the Average of Sum of Absolute Difference is calculated, and the sum of the average absolute differences of the coded blocks is used to determine the first threshold and the second valve. value. In this embodiment, the first threshold is equal to the sum of the average absolute differences of the coded blocks, and the second threshold is equal to 1.2 times the first threshold. In other embodiments of the invention, the coded blocks are The relationship between the sum of the average absolute differences and the first threshold and the second threshold can be set to other ratios. Next, the target value calculation step 220 is performed. In the target value calculation step 220, the sum of the average absolute differences of the coded block and the target block is calculated. Then, a search box size decision step 230 is performed. In the search box size determining step 230, comparing the sum of the average absolute difference sum of the coded block and the target block, the first threshold and the second threshold to obtain a comparison result, and determining the corresponding to the comparison result. The size of the search box of the target block 106. In the search box size decision step 230, when the sum of the average absolute differences of the coded block and the target block is less than or equal to the first threshold, the size of the search box is determined to be 8 by 8 reference blocks. When the sum of the average absolute differences of the coded block and the target block is greater than the first threshold and less than the second threshold, the size of the search box is determined to be 16 by 16 reference blocks. When the sum of the average absolute differences of the coded block and the target block is greater than or equal to the second threshold, the size of the search box is determined to be 32 by 32 reference blocks.

由以上說明可知,本發明之第一實施例係利用已編碼區塊和目標區塊之平均絕對差值總和總和、第一閥值和第二閥值來預測目標區塊106之匹配區塊(matching block)可能出現的範圍,並且可動態地調整搜尋框之大小,以在較 小的計算複雜度下,達到較佳的影像品質。As can be seen from the above description, the first embodiment of the present invention predicts the matching block of the target block 106 by using the sum of the average absolute differences of the coded block and the target block, the first threshold, and the second threshold ( Matching block) The range that may appear, and the size of the search box can be dynamically adjusted to Achieve better image quality with small computational complexity.

請參照第3圖,其係繪示根據本發明第二實施例之移動估測方法300的流程示意圖。移動估測方法300係應用適應性搜尋框大小的決定方法200,來計算目標區塊106之移動向量。在移動估測方法300中,首先進行適應性搜尋框大小的決定方法200,以決定目標區塊106所對應之一第一搜尋框之大小。接著,進行相似度比較步驟310。在相似度比較步驟310中,利用第一搜尋框來於參考圖框150中選定一匹配區塊,此匹配區塊為第一搜尋框中,與目標區塊106相似度最高之區塊。然後,進行移動向量計算步驟320。在移動向量計算步驟320中,根據目標區塊和匹配區塊來計算目標區塊之移動向量。Please refer to FIG. 3, which is a flow chart showing a mobile estimation method 300 according to a second embodiment of the present invention. The motion estimation method 300 applies a method 200 of determining the size of the adaptive search box to calculate the motion vector of the target block 106. In the mobile estimation method 300, the adaptive search box size determination method 200 is first performed to determine the size of one of the first search frames corresponding to the target block 106. Next, a similarity comparison step 310 is performed. In the similarity comparison step 310, a matching block is selected in the reference frame 150 by using the first search box, and the matching block is the block with the highest similarity to the target block 106 in the first search box. Then, a motion vector calculation step 320 is performed. In the motion vector calculation step 320, the motion vector of the target block is calculated from the target block and the matching block.

經由複雜的實驗證明,在相同影像品質的條件下,本發明之實施例的移動估測方法可較習知技術降低約60%的計算複雜度,因此本發明之實施例的移動估測方法可節省相當多的計算資源。It has been proved by complicated experiments that the motion estimation method of the embodiment of the present invention can reduce the computational complexity by about 60% compared with the prior art under the condition of the same image quality. Therefore, the motion estimation method of the embodiment of the present invention can be Save a lot of computing resources.

請參照第4圖,其係繪示根據本發明第三實施例之相似度比較步驟310的流程示意圖。在相似度比較步驟310中,首先,進行搜尋框比較步驟310a。在搜尋框比較步驟310a中,判斷目標區塊106所對應之第一搜尋框是否大於已編碼區塊102之最後一者所對應之一第二搜尋框,並提供一判斷結果。上述之已編碼區塊102之最後一者係指目標區塊106之前一區塊。例如若目標圖框100之處理順序為由左而右逐列處理,則目標區塊106之前一區塊為目標區塊106左方之區塊,又例如:若目標圖框100之處理順 序為由上而下逐行處理,則目標區塊106之前一區塊為目標區塊106上方之區塊。Please refer to FIG. 4, which is a flow chart showing the similarity comparison step 310 according to the third embodiment of the present invention. In the similarity comparison step 310, first, a search box comparison step 310a is performed. In the search box comparison step 310a, it is determined whether the first search box corresponding to the target block 106 is greater than a second search box corresponding to the last one of the encoded blocks 102, and provides a determination result. The last one of the above-described encoded blocks 102 refers to a block before the target block 106. For example, if the processing sequence of the target frame 100 is processed from left to right column by column, the block before the target block 106 is the block to the left of the target block 106, for example, if the processing of the target frame 100 is smooth The sequence is processed from top to bottom, and the previous block of the target block 106 is the block above the target block 106.

當判斷結果為是時,則進行搜尋步驟310b,以利用第一搜尋框和第二搜尋框之間的區域,來於參考圖框150中搜尋目標區塊106之匹配區塊。當判斷結果為否時,則進行搜尋步驟310c,以利用第一搜尋框來於參考圖框150中搜尋目標區塊106之匹配區塊。When the determination result is YES, a searching step 310b is performed to search for the matching block of the target block 106 in the reference frame 150 by using the area between the first search box and the second search box. When the determination result is no, a searching step 310c is performed to search for the matching block of the target block 106 in the reference frame 150 by using the first search box.

在本發明第三實施例中,當判斷結果為是時,表示目標區塊106與目標區塊106之前一區塊有相當的差異性,目標區塊106之匹配區塊應會落在第一搜尋框和第二搜尋框之間的區域,因此直接於第一搜尋框和第二搜尋框之間的區域中搜尋目標區塊106之匹配區塊,以節省計算複雜度。In the third embodiment of the present invention, when the determination result is YES, it indicates that the target block 106 is quite different from the previous block of the target block 106, and the matching block of the target block 106 should fall on the first block. The area between the search box and the second search box is searched for the matching block of the target block 106 directly in the area between the first search box and the second search box to save computational complexity.

請同時參照第5圖和第6圖,第5圖係繪示根據本發明第四實施例之目標圖框500和參考圖框550的結構示意圖,第6圖係繪示根據本發明第四實施例之適應性搜尋框大小的決定方法600的流程示意圖。目標圖框500包含未編碼區塊504和處理中之目標區塊506。在目標圖框500中,目標區塊506為第一個接受移動估測處理之區塊。參考圖框550和目標圖框500為連續之圖框,其中參考圖框550包含有參考區塊552。在決定方法600中,首先,進行閥值決定步驟610。在閥值決定步驟610中,計算參考區塊552之平均絕對差值總和,並利用此參考區塊之平均絕對差值總和來決定一第一閥值和一第二閥值。在本實施例中,第一閥值等於參考區塊之平均絕對差值總和,而第二閥值 等於第一閥值之1.2倍。接著,進行目標值計算步驟620。在目標值計算步驟620中,計算參考區塊552和目標區塊506之平均絕對差值總和。然後,進行搜尋框大小決定步驟630。在搜尋框大小決定步驟630中,比較參考區塊和目標區塊之平均絕對差值總和、第一閥值和該第二閥值之大小來獲得比較結果,並根據比較結果來決定對應至目標區塊506之搜尋框的大小。在搜尋框大小決定步驟630中,當參考區塊和目標區塊之平均絕對差值總和小於或等於第一閥值時,決定搜尋框之大小為8乘8個參考區塊。當參考區塊和目標區塊之平均絕對差值總和大於第一閥值,且小於第二閥值時,決定搜尋框之大小為16乘16個參考區塊。當參考區塊和目標區塊之平均絕對差值總和大於或等於第二閥值時,決定搜尋框之大小為32乘32個參考區塊。Please refer to FIG. 5 and FIG. 6 simultaneously. FIG. 5 is a schematic structural diagram of a target frame 500 and a reference frame 550 according to a fourth embodiment of the present invention, and FIG. 6 is a fourth embodiment of the present invention. A flow chart of the method 600 for determining the size of the adaptive search box. The target frame 500 includes an uncoded block 504 and a target block 506 in progress. In target frame 500, target block 506 is the first block to accept the motion estimation process. Reference frame 550 and target frame 500 are continuous frames, with reference frame 550 including reference block 552. In the decision method 600, first, a threshold determination step 610 is performed. In the threshold decision step 610, the sum of the average absolute differences of the reference blocks 552 is calculated, and a first threshold and a second threshold are determined using the sum of the average absolute differences of the reference blocks. In this embodiment, the first threshold is equal to the sum of the average absolute differences of the reference blocks, and the second threshold Equal to 1.2 times the first threshold. Next, a target value calculation step 620 is performed. In the target value calculation step 620, the sum of the average absolute differences of the reference block 552 and the target block 506 is calculated. Then, a search box size decision step 630 is performed. In the search box size determining step 630, comparing the sum of the average absolute difference of the reference block and the target block, the first threshold and the second threshold to obtain a comparison result, and determining the corresponding target according to the comparison result. The size of the search box of block 506. In the search box size decision step 630, when the sum of the average absolute differences of the reference block and the target block is less than or equal to the first threshold, the size of the search box is determined to be 8 by 8 reference blocks. When the sum of the average absolute differences of the reference block and the target block is greater than the first threshold and less than the second threshold, the size of the search box is determined to be 16 by 16 reference blocks. When the sum of the average absolute differences of the reference block and the target block is greater than or equal to the second threshold, the size of the search box is determined to be 32 by 32 reference blocks.

在本發明第四實施例中,目標區塊506為目標圖框500中,第一個被處理之區塊,因此對於目標區塊506而言,目標圖框500中不存在有已編碼區塊。因此,本發明第四實施例係利用參考圖框550的所有參考區塊,來決定第一閥值和第二閥值。In the fourth embodiment of the present invention, the target block 506 is the first processed block in the target frame 500, so for the target block 506, there is no coded block in the target frame 500. . Accordingly, the fourth embodiment of the present invention utilizes all of the reference blocks of reference frame 550 to determine the first threshold and the second threshold.

雖然本發明已以實施例揭露如上,然其並非用以限定本發明,任何熟習此技藝者,在不脫離本發明之精神和範圍內,當可作各種之更動與潤飾,因此本發明之保護範圍當視後附之申請專利範圍所界定者為準。Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and the present invention can be modified and retouched without departing from the spirit and scope of the present invention. The scope is subject to the definition of the scope of the patent application attached.

100‧‧‧目標圖框100‧‧‧Target frame

102‧‧‧已編碼區塊102‧‧‧ Coded block

104‧‧‧未編碼區塊104‧‧‧Uncoded blocks

106‧‧‧目標區塊106‧‧‧ Target block

150‧‧‧參考圖框150‧‧‧Refer to the frame

152‧‧‧參考區塊152‧‧‧Reference block

200‧‧‧大小決定方法200‧‧‧Size determination method

210‧‧‧閥值決定步驟210‧‧‧ threshold decision steps

220‧‧‧目標值計算步驟220‧‧‧ Target value calculation steps

230‧‧‧搜尋框大小決定步驟230‧‧‧Search box size decision step

300‧‧‧移動估測方法300‧‧‧Mobile estimation method

310‧‧‧相似度比較步驟310‧‧‧similarity comparison steps

320‧‧‧移動向量計算步驟320‧‧‧Mobile vector calculation steps

310a‧‧‧搜尋框比較步驟310a‧‧‧Search Box Comparison Steps

310b‧‧‧搜尋步驟310b‧‧‧ Search steps

310c‧‧‧搜尋步驟310c‧‧‧ Search steps

500‧‧‧目標圖框500‧‧‧Target frame

504‧‧‧未編碼區塊504‧‧‧Uncoded blocks

506‧‧‧目標區塊506‧‧‧ Target block

550‧‧‧參考圖框550‧‧‧ reference frame

552‧‧‧參考區塊552‧‧‧Reference block

600‧‧‧大小決定方法600‧‧‧Size determination method

610‧‧‧閥值決定步驟610‧‧‧ threshold decision steps

620‧‧‧目標值計算步驟620‧‧‧ Target value calculation steps

630‧‧‧搜尋框大小決定步驟630‧‧‧Search box size decision step

為讓本發明之上述和其他目的、特徵、和優點能更明 顯易懂,上文特舉一較佳實施例,並配合所附圖式,作詳細說明如下:The above and other objects, features and advantages of the present invention will become more apparent. It is obvious that the above description is a preferred embodiment and is described in detail with reference to the following drawings:

第1圖係繪示根據本發明第一實施例之目標圖框和參考圖框之結構示意圖。1 is a schematic structural view of a target frame and a reference frame according to a first embodiment of the present invention.

第2圖係繪示根據本發明第一實施例之適應性搜尋框(adaptive searching window)大小的決定方法的流程示意圖。2 is a flow chart showing a method of determining the size of an adaptive searching window according to the first embodiment of the present invention.

第3圖係繪示根據本發明第二實施例之移動估測方法的流程示意圖。3 is a flow chart showing a method of estimating a movement according to a second embodiment of the present invention.

第4圖係繪示根據本發明第三實施例之相似度比較步驟的流程示意圖。Figure 4 is a flow chart showing the similarity comparison step according to the third embodiment of the present invention.

第5圖係繪示根據本發明第四實施例之目標圖框和參考圖框的結構示意圖。Figure 5 is a block diagram showing the structure of a target frame and a reference frame according to a fourth embodiment of the present invention.

第6圖係繪示根據本發明第四實施例之適應性搜尋框大小的決定方法的流程示意圖。FIG. 6 is a flow chart showing a method for determining the size of an adaptive search box according to a fourth embodiment of the present invention.

200‧‧‧大小決定方法200‧‧‧Size determination method

210‧‧‧閥值決定步驟210‧‧‧ threshold decision steps

220‧‧‧目標值計算步驟220‧‧‧ Target value calculation steps

230‧‧‧搜尋框大小決定步驟230‧‧‧Search box size decision step

Claims (12)

一種應用於移動估測之適應性搜尋框(adaptive searching window)大小的決定方法,用以於一參考圖框(reference frame)中決定一目標區塊之匹配區塊(matching block)的搜尋範圍,其中該適應性搜尋框大小的決定方法至少包含:提供一目標圖框,其中該目標圖框包含至少一已編碼區塊和該目標區塊;提供該參考圖框(reference frame),其中該參考圖框包含複數個參考區塊;進行一閥值決定步驟,以計算該至少一已編碼區塊之平均絕對差值總和(Average of Sum of Absolute Difference),而獲得一第一平均絕對差值總和,並利用該第一平均絕對差值總和來決定一第一閥值和一第二閥值,其中該第二閥值係大於該第一閥值;進行一目標值計算步驟,以計算該至少一已編碼區塊和該目標區塊之平均絕對差值總和,而獲得一第二平均絕對差值總和;以及進行一搜尋框大小決定步驟,以比較該第二平均絕對差值總和、該第一閥值和該第二閥值之大小來獲得一比較結果,並根據該比較結果來決定對應至該目標區塊之一搜尋框的大小。 A method for determining the size of an adaptive searching window for a mobile estimation is used to determine a search range of a matching block of a target block in a reference frame. The method for determining the size of the adaptive search box includes at least: providing a target frame, wherein the target frame includes at least one coded block and the target block; providing the reference frame, wherein the reference frame The frame includes a plurality of reference blocks; performing a threshold determining step to calculate an Average of Sum of Absolute Difference, and obtaining a sum of first average absolute differences And using the sum of the first average absolute differences to determine a first threshold and a second threshold, wherein the second threshold is greater than the first threshold; performing a target value calculation step to calculate the at least a sum of average absolute differences between the coded block and the target block to obtain a sum of a second average absolute difference; and performing a search box size determining step to compare the Two average absolute difference sum, the magnitude of the first threshold and the second threshold value to obtain a comparison result, and determines the size of one block corresponds to the search target block based on the comparison result. 如申請專利範圍第1項所述之適應性搜尋框大小決 定方法,其中當該比較結果為該第二平均絕對差值總和小於或等於該第一閥值時,決定該搜尋框之大小為8乘8個參考區塊。 The size of the adaptive search box as described in item 1 of the patent application scope And a method, wherein when the comparison result is that the sum of the second average absolute differences is less than or equal to the first threshold, determining that the size of the search box is 8 by 8 reference blocks. 如申請專利範圍第1項所述之適應性搜尋框大小決定方法,其中當該比較結果為該第二平均絕對差值總和大於該第一閥值,且小於該第二閥值時,決定該搜尋框之大小為16乘16個參考區塊。 The method for determining an adaptive search box size according to claim 1, wherein the comparison result is that the sum of the second average absolute differences is greater than the first threshold and less than the second threshold. The size of the search box is 16 by 16 reference blocks. 如申請專利範圍第1項所述之適應性搜尋框大小決定方法,其中當該比較結果為該第二平均絕對差值總和大於或等於該第二閥值時,決定該搜尋框之大小為32乘32個參考區塊。 The adaptive search box size determining method according to claim 1, wherein when the comparison result is that the sum of the second average absolute differences is greater than or equal to the second threshold, determining the size of the search box is 32. Multiply by 32 reference blocks. 如申請專利範圍第1項所述之適應性搜尋框大小決定方法,其中該第二閥值為該第一閥值之1.2倍。 The adaptive search box size determining method according to claim 1, wherein the second threshold is 1.2 times the first threshold. 如申請專利範圍第1項所述之適應性搜尋框大小決定方法,其中該目標圖框和該參考圖框為連續圖框。 The adaptive search box size determining method according to claim 1, wherein the target frame and the reference frame are continuous frames. 一種應用適應性搜尋框之移動估測方法,以決定一目標區塊之移動向量,其中該目標區塊至少包含:提供一目標圖框,其中該目標圖框包含至少一已編碼區塊和該目標區塊;提供該參考圖框(reference frame),其中該參考圖框包 含複數個參考區塊;進行一閥值決定步驟,以計算該至少一已編碼區塊之平均絕對差值總和(Average of Sum of Absolute Difference),而獲得一第一平均絕對差值總和,並利用該第一平均絕對差值總和來決定一第一閥值和一第二閥值,其中該第二閥值係大於該第一閥值;進行一目標值計算步驟,以計算該至少一已編碼區塊和該目標區塊之平均絕對差值總和,而獲得一第二平均絕對差值總和;進行一搜尋框大小決定步驟,以比較該第二平均絕對差值總和、該第一閥值和該第二閥值之大小來獲得一比較結果,並根據該比較結果來決定對應至該目標區塊之一第一搜尋框之大小;進行一相似度比較步驟,以利用該第一搜尋框來於該參考圖框中選定一匹配區塊;以及,進行一移動向量計算步驟,以根據該目標區塊和該匹配區塊來計算該目標區塊之移動向量。 A motion estimation method for applying an adaptive search box to determine a motion vector of a target block, wherein the target block includes at least: providing a target frame, wherein the target frame includes at least one coded block and the target block a target block; the reference frame is provided, wherein the reference frame is Having a plurality of reference blocks; performing a threshold determining step to calculate an Average of Sum of Absolute Difference, and obtaining a first average absolute difference sum, and Using the sum of the first average absolute differences to determine a first threshold and a second threshold, wherein the second threshold is greater than the first threshold; performing a target value calculation step to calculate the at least one And a sum of the average absolute differences of the coded block and the target block, and obtaining a sum of the second average absolute differences; performing a search box size determining step to compare the second average absolute difference sum, the first threshold And comparing the size of the second threshold to obtain a comparison result, and determining, according to the comparison result, a size corresponding to the first search frame of one of the target blocks; performing a similarity comparison step to utilize the first search box Selecting a matching block from the reference frame; and performing a motion vector calculation step to calculate a motion vector of the target block according to the target block and the matching block. 如申請專利範圍第7項所述之移動估測方法,其中該相似度比較步驟包含:判斷該第一搜尋框是否大於一第二搜尋框,以提供一判斷結果,其中該第二搜尋框係對應至該少一已編碼區塊之最後一者,而該至少一已編碼區塊之最後一者係鄰接於該目標區塊;以及當該判斷結果為是時,根據該第一搜尋框和該第二搜 尋框之間的區域,來於該參考圖框中選定一匹配區塊。 The mobile estimation method of claim 7, wherein the similarity comparison step comprises: determining whether the first search box is greater than a second search box to provide a determination result, wherein the second search frame is Corresponding to the last one of the less coded blocks, and the last one of the at least one coded block is adjacent to the target block; and when the determination result is yes, according to the first search box and The second search The area between the frames is selected to select a matching block in the reference frame. 如申請專利範圍第7項所述之移動估測方法,其中當該比較結果為該第二平均絕對差值總和小於或等於該第一閥值時,決定該第一搜尋框之大小為8乘8個參考區塊。 The mobile estimation method according to claim 7, wherein when the comparison result is that the sum of the second average absolute differences is less than or equal to the first threshold, determining that the size of the first search box is 8 times 8 reference blocks. 如申請專利範圍第7項所述之移動估測方法,其中當該比較結果為該第二平均絕對差值總和大於該第一閥值,且小於該第二閥值時,決定該第一搜尋框之大小為16乘16個參考區塊。 The mobile estimation method according to claim 7, wherein the first search is determined when the comparison result is that the sum of the second average absolute differences is greater than the first threshold and less than the second threshold. The size of the box is 16 by 16 reference blocks. 如申請專利範圍第7項所述之移動估測方法,當該比較結果為該第二平均絕對差值總和大於或等於該第二閥值時,決定該第一搜尋框之大小為32乘32個參考區塊。 The mobile estimation method according to claim 7, wherein when the comparison result is that the sum of the second average absolute differences is greater than or equal to the second threshold, determining that the size of the first search box is 32 by 32 Reference block. 如申請專利範圍第7項所述之移動估測方法,其中該第二閥值為該第一閥值之1.2倍。The mobile estimation method according to claim 7, wherein the second threshold is 1.2 times the first threshold.
TW097120985A 2008-06-05 2008-06-05 Method for determining size of adaptive window applied in motion estimation and application thereof TWI477152B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW097120985A TWI477152B (en) 2008-06-05 2008-06-05 Method for determining size of adaptive window applied in motion estimation and application thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW097120985A TWI477152B (en) 2008-06-05 2008-06-05 Method for determining size of adaptive window applied in motion estimation and application thereof

Publications (2)

Publication Number Publication Date
TW200952492A TW200952492A (en) 2009-12-16
TWI477152B true TWI477152B (en) 2015-03-11

Family

ID=44872077

Family Applications (1)

Application Number Title Priority Date Filing Date
TW097120985A TWI477152B (en) 2008-06-05 2008-06-05 Method for determining size of adaptive window applied in motion estimation and application thereof

Country Status (1)

Country Link
TW (1) TWI477152B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102663682B (en) * 2012-03-13 2015-06-03 华中科技大学 Adaptive image enhancement method based on interesting area

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6014181A (en) * 1997-10-13 2000-01-11 Sharp Laboratories Of America, Inc. Adaptive step-size motion estimation based on statistical sum of absolute differences

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6014181A (en) * 1997-10-13 2000-01-11 Sharp Laboratories Of America, Inc. Adaptive step-size motion estimation based on statistical sum of absolute differences

Also Published As

Publication number Publication date
TW200952492A (en) 2009-12-16

Similar Documents

Publication Publication Date Title
US7747094B2 (en) Image encoder, image decoder, image encoding method, and image decoding method
JP5422168B2 (en) Video encoding method and video decoding method
US8023562B2 (en) Real-time video coding/decoding
US9088797B2 (en) Video processing method and apparatus with residue prediction
KR100994768B1 (en) Motion estimation method for encoding motion image, and recording medium storing a program to implement thereof
CN1695381A (en) Sharpness enhancement in post-processing of digital video signals using coding information and local spatial features
US6317460B1 (en) Motion vector generation by temporal interpolation
TW202029769A (en) Image predictive decoding method
Hussain et al. A survey on video compression fast block matching algorithms
Young et al. Automatic layout generation for CMOS operational amplifiers
JP3982615B2 (en) System for converting encoded video data
CA2480444A1 (en) Methods and apparatus for efficient global motion compensation encoding and associated decoding
TWI477152B (en) Method for determining size of adaptive window applied in motion estimation and application thereof
JP2002094987A (en) Video signal encoder
KR100987581B1 (en) Method of Partial Block Matching for Fast Motion Estimation
US7706440B2 (en) Method for reducing bit rate requirements for encoding multimedia data
KR20050026661A (en) Motion vector selection method for resolution down-sampling of motion video
KR100628333B1 (en) Method and device for providing selective motion estimation for fast video encoding
JP5788952B2 (en) Video decoding method
JP2001320712A (en) Repeat video signal encoding method and recording medium with recorded program of the method
JP5890933B1 (en) Video decoding method
JP5864022B2 (en) Video decoding method
JP5864023B2 (en) Calculation method of prediction vector
KR101021538B1 (en) Fast Intra Mode Decision Method in H.264 Encoding
Chen et al. New sorting technique on partial distortion search using two bit-transform for fast optimal motion estimation

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees