TWI837469B - Method and device for removeing the background - Google Patents
Method and device for removeing the background Download PDFInfo
- Publication number
- TWI837469B TWI837469B TW110113187A TW110113187A TWI837469B TW I837469 B TWI837469 B TW I837469B TW 110113187 A TW110113187 A TW 110113187A TW 110113187 A TW110113187 A TW 110113187A TW I837469 B TWI837469 B TW I837469B
- Authority
- TW
- Taiwan
- Prior art keywords
- initial image
- image
- color
- background
- background removal
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000012545 processing Methods 0.000 claims abstract description 72
- 238000010191 image analysis Methods 0.000 claims description 18
- 238000006243 chemical reaction Methods 0.000 claims description 16
- 230000000694 effects Effects 0.000 description 11
- 239000003086 colorant Substances 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 3
- 238000012805 post-processing Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010187 selection method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
- Facsimile Image Signal Circuits (AREA)
Abstract
Description
本發明為一種影像處理技術,特別是指一種去除影像背景的去背方法與去背裝置。The present invention relates to an image processing technology, and more particularly to a background removal method and a background removal device for removing image background.
由於網路的發達,以及影音設備的進步,帶動了很多產業的發展。其中,在影音多媒體的產業中,影音播放平台提供了素人以特有的影音內容來取得觀賞者的喜愛與追蹤,因此造就了以網紅或Youtuber為主的新世代的影音產業模式。在這種新型態的網路影音產業中,為了吸引訂閱者,網紅或Youtuber除了在內容企劃上需要投入設計之外,影音剪輯處理,例如:從靜態的圖片到動態影像的編輯、或影像特殊效果的增加等,也是輔助增加訂閱率重要的一環。The development of the Internet and the advancement of audio-visual equipment have driven the development of many industries. In the audio-visual multimedia industry, audio-visual playback platforms provide amateurs with unique audio-visual content to gain the love and attention of viewers, thus creating a new generation of audio-visual industry model dominated by Internet celebrities or YouTubers. In this new type of online audio-visual industry, in order to attract subscribers, Internet celebrities or YouTubers need to invest in content planning and design. Audio-visual editing and processing, such as editing from static images to dynamic images, or adding special effects to images, are also important links to help increase subscription rates.
在影音剪輯處理中,去除背景(以下簡稱去背)是不可或缺的技巧。所謂去除背景,係指將影像或圖片中部分影像主體的部分保留,其餘部分則去除。去背的手法可以讓影像主體任意改變背景的環境,增加影像或圖片的多樣性。Background removal is an indispensable technique in video editing. Background removal means that part of the image subject is retained and the rest is removed. Background removal allows the image subject to change the background environment at will, increasing the diversity of the image or picture.
習用技術中,當使用者有置換背景環境的需求時,一般使用者必須準備一單色幕(例如綠布或藍布)作為背景布幕,再來進行拍攝得到影像。接著,將此影像輸入影像處理軟體中,選取欲保留之前景部分,然後將未選取的背景部分刪除並填上透明背景後存檔,最後,將去背的檔案與欲置換之背景進行疊加即可得到新影像,達到去背與置換背景的影像效果。In practice, when users need to replace the background environment, they generally need to prepare a monochrome screen (such as green or blue cloth) as the background screen, and then shoot to obtain an image. Then, input the image into the image processing software, select the foreground part to be retained, and then delete the unselected background part and fill it with a transparent background before saving. Finally, the background-removed file is superimposed with the background to be replaced to obtain a new image, achieving the image effect of removing the background and replacing the background.
由於在習用技術中,使用者必須自備藍色或綠色布幕,且拍攝完畢之後,還必須以另外的程序上傳到可以進行影像處理的設備,才能進行後製處理,如此對使用者相當的不方便。此外,因為布幕會有隨著燈光的影響,使得在影像或圖像中呈現出來的顏色並不均一,因此使用者很難精準選擇所要去除的顏色,而需要反覆調整,影響去除背景的工作效率。In the application of this technology, users must prepare their own blue or green curtains, and after shooting, they must upload the images to image processing equipment using another program before post-processing, which is quite inconvenient for users. In addition, because the curtains are affected by the light, the colors presented in the images or pictures are not uniform, so it is difficult for users to accurately select the color to be removed, and they need to adjust repeatedly, affecting the efficiency of background removal.
爰是之故,有鑑於習知技術之不足,提出一種去背方法與去背裝置,用以改善上述習用手段之缺失。Therefore, in view of the shortcomings of the prior art, a background removal method and a background removal device are proposed to improve the shortcomings of the above-mentioned conventional means.
本發明提供一種去背方法與裝置,使用者利用手持裝置擷取影像之後,透過操作介面讓使用者選取的任意多組區域,然後自動偵測選取區域的顏色特徵,再根據顏色的特徵即時(real time)進行去背,達到對應現場光源之有效去背的操作效果。The present invention provides a background removal method and device. After a user captures an image with a handheld device, the user is allowed to select any multiple groups of areas through an operation interface. The color characteristics of the selected areas are then automatically detected, and the background removal is performed in real time according to the color characteristics, thereby achieving an effective background removal operation effect corresponding to the on-site light source.
本發明的去背方法與裝置,可以在擷取影像或圖像之後,立即根據使用者選擇區域的顏色特徵找到相應的區域進行去背,透過選取區域顏色特徵的演算,可以解決因為擷取影像的角度產生反光所產生的顏色差異而影響去背效果的問題。此外,使用者直接選取區域的方式更可以提升去背影像處理效率,可以應用在直播、會議或演講等應用。The background removal method and device of the present invention can find the corresponding area for background removal according to the color characteristics of the area selected by the user immediately after capturing an image or picture. By calculating the color characteristics of the selected area, the problem of color difference caused by reflection caused by the angle of the captured image affecting the background removal effect can be solved. In addition, the method of directly selecting the area by the user can further improve the background removal image processing efficiency, which can be applied to live broadcasts, meetings or speeches.
本發明提供一種去背方法,其係藉由影像擷取裝置擷取初始影像,然後於影像擷取裝置中提供操作介面顯示出初始影像,之後,藉由操作介面於初始影像選取複數個欲去背目標,並產生該些欲去背目標的複數個位置資訊,接著,透過處理單元從初始影像當中決定出對應於該些位置資訊的複數個顏色特徵,最後,處理單元根據所得的顏色特徵,對初始影像進行去背。The present invention provides a background removal method, which uses an image capture device to capture an initial image, and then provides an operation interface in the image capture device to display the initial image. Thereafter, multiple targets to be background removed are selected in the initial image through the operation interface, and multiple position information of the targets to be background removed is generated. Then, a processing unit determines multiple color features corresponding to the position information from the initial image. Finally, the processing unit removes the background of the initial image based on the obtained color features.
在一實施例中,本發明提供一種去背裝置,包括操作介面、影像接收埠以及處理單元,其中,影像接收埠接收初始影像,藉由操作介面以於初始影像選取複數個欲去背目標,並產生些欲去背目標的複數個位置資訊。另外,處理單元與影像接收埠電性連接,處理單元從初始影像當中決定出對應於該些位置資訊的複數個顏色特徵,並根據該些顏色特徵對初始影像進行去背。In one embodiment, the present invention provides a background removal device, including an operation interface, an image receiving port, and a processing unit, wherein the image receiving port receives an initial image, and a plurality of background removal targets are selected from the initial image through the operation interface, and a plurality of position information of the background removal targets is generated. In addition, the processing unit is electrically connected to the image receiving port, and the processing unit determines a plurality of color features corresponding to the position information from the initial image, and removes the background of the initial image according to the color features.
在下文將參考隨附圖式,可更充分地描述各種例示性實施例,在隨附圖式中展示一些例示性實施例。然而,本發明概念可能以許多不同形式來體現,且不應解釋為限於本文中所闡述之例示性實施例。確切而言,提供此等例示性實施例使得本發明將為詳盡且完整,且將向熟習此項技術者充分傳達本發明概念的範疇。類似數字始終指示類似元件。以下將以多種實施例配合圖式來說明所述去背方法與去背裝置,然而,下述實施例並非用以限制本發明。Various exemplary embodiments will be more fully described below with reference to the accompanying drawings, some of which are shown in the accompanying drawings. However, the concepts of the present invention may be embodied in many different forms and should not be construed as limited to the exemplary embodiments described herein. Rather, these exemplary embodiments are provided so that the present invention will be detailed and complete, and will fully convey the scope of the concepts of the present invention to those skilled in the art. Similar numbers always indicate similar elements. The background removal method and background removal device will be described below with a variety of embodiments in conjunction with drawings, however, the following embodiments are not intended to limit the present invention.
請參閱圖1A所示,其為本發明之去背裝置之一實施例示意圖。去背裝置3包括操作介面300以及處理單元32。在本實施例中,操作介面300係提供於影像擷取裝置30。在本實施例中,影像擷取裝置30為可攜式裝置,例如:智慧型手機、相機、或平板電腦等,但不以此為限制。影像擷取裝置30同時也具有運算處理能力,可以藉由執行應用程式或APP產生使用者操作介面300。要說明的是,操作介面300可以提供使用者對於影像或圖像進行特定功能的操作,例如:選取圖像或影像上特定位置或區域讓應用程式或APP藉由演算取得關於被選取的特定位置或區域所具有的影像特徵,例如:亮度、對比度或顏色等資訊。本實施例中,影像擷取裝置30藉由內建的鏡頭30a擷取被攝主體4以及其所在背景環境40的影像,以產生初始影像P0。Please refer to FIG. 1A, which is a schematic diagram of an embodiment of the background removal device of the present invention. The
處理單元32在本實施例中,設置於去背裝置3內。去背裝置3在本實施例中,為具有網路通訊功能的直播設備,其係具有第一連接介面330與影像擷取裝置30電性連接。本實施例中的第一連接介面330為影像接收埠,可以為無線通訊介面,例如:Wi-Fi 無線通訊或者是藍牙無線通訊等介面,或者是可以為有線介面,例如:USB各種形式的連接介面、HDMI、DVI等,但不以此為限置。影像擷取裝置30可以將擷取到的初始影像P0藉由該第一連接介面330傳給去背裝置3。此外,第一連接介面330亦可以將操作介面300操作之後所得到的關於去背的資訊(例如:欲去背目標的位置資訊)傳輸給去背裝置3,再傳給處理單元32對初始影像P0進行去背。In the present embodiment, the
在本實施例中,處理單元32更進一步包括有像素轉換模組320、影像分析模組321、背景處理模組322。其中,像素轉換模組320根據使用者在操作介面300上對初始影像P0選取欲去背目標的位置於初始影像P0上決定相應的複數個顏色特徵。欲去背的目標可以是單一點或者是特定大小的範圍。影像分析模組321將些顏色特徵聯集成顏色範圍。背景處理模組322,根據顏色範圍將初始影像中具有該些顏色特徵的顏色去除。In this embodiment, the
以下用圖1A與圖3A與圖3B所示的實施例來說明從初始影像選擇位置的方式,影像擷取裝置30的操作介面300上顯示有初始影像P0,使用者在初始影像P0上選取了欲去背目標90a~90e。要說明的是,選取的方式為觸控方式在影像擷取裝置30的顯示屏幕上選擇。每一個欲去背目標90a~90e可以為單一像素或多個像素的集合。影像擷取裝置30將所選取的目標90a~90e的位置資訊以及初始影像P0傳給了去背裝置3。The following uses the embodiments shown in FIG. 1A and FIG. 3A and FIG. 3B to illustrate the method of selecting a position from an initial image. An initial image P0 is displayed on the
去背裝置3接收到了位置資訊,傳給像素轉換模組320。像素轉換模組320根據所收到的位置資訊,在初始影像P0上取得相應於選取的目標90a~90e的顏色特徵。本實施例中,顏色特徵為YUV資訊,但不以此為限,例如:RGB資訊或者是CMYK資訊亦可。以下以YUV資訊來說明,在位置90a的YUV為(149,53,19),90b的YUV為(122,41,21),90c的YUV為(110,43,30),90d的YUV為(166,69,42) ,90e的YUV為(160,60,30)等。然後影像分析模組321再將對應選取的目標90a~90e的這些顏色特徵聯集成顏色範圍R1(Max:YUV(166, 69, 42), MinYUV(110, 41, 21),也就是Y介於166~110,U介於69~41,V介於42~21之間。之後,顏色範圍R1傳給了背景處理模組322,背景處理模組322再根據顏色範圍R1對初始影像P0中符合前述顏色範圍R1的顏色進行去除。The
除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色範圍。背景處理模組322,根據顏色範圍將初始影像P0中具有該些顏色特徵的顏色去除。在本實施例中,如圖1A、圖3C與圖3D所示,影像擷取裝置30的操作介面300上顯示有初始影像P0,使用者在初始影像上選取了欲去背的目標90f~90h。本實施例中,每一個目標90f~90h是由使用者利用觸控方式在初始影像P0上畫出的範圍。影像擷取裝置30將所選取的目標90f~90h的位置資訊(例如:範圍邊界)傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在初始影像P0上取得相應於選取的目標90f~90h範圍邊界的顏色特徵,然後影像分析模組321再將對應選取的目標90f~90h範圍邊界的顏色特徵決定出對應的顏色範圍R2~R4,例如:R2的YUVmax(149,53,19),YUVmin(138,51,17);R3的YUVmax(122,41,21),YUVmin(115,25,18),R4的YUVmax(110,43,30),YUVmin(108,32,25)。要說明的是產生顏色範圍R2~R4的方式係如前圖3A與3B所述,在此不作贅述。之後,顏色範圍R2~R4傳給了背景處理模組322,背景處理模組322再根據顏色範圍R2~R4對初始影像P0中符合前述顏色範圍R2~R4的顏色進行去除。In addition to the aforementioned method, in another embodiment, the
除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色值。背景處理模組322,根據顏色範圍將第二初始影像中具有該些顏色特徵的像素去除。在一實施例中,如圖3E與圖3F所示,影像擷取裝置30的操作介面300上顯示有初始影像P0,使用者在初始影像P0上選取了欲去背的目標90i~90l。本實施例中,每一個目標90i~90l是由使用者利用觸控方式在初始影像P0點選的位置。影像擷取裝置30將所選取的目標90i~90l的位置資訊傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在初始影像P0上取得相應於選取的目標(像素)90i~90l的顏色特徵,然後影像分析模組321再將對應選取的目標90i~90l的顏色特徵決定出對應的顏色值Ca~Cd,例如:位置90i的YUV值Ca為(149,53,19),90j的YUV值Cb為(122,41,21),90k的YUV值Cc為(110,43,30),90l的YUV值Cd為(166,69,42)。之後,顏色值Ca~Cd傳給了背景處理模組322,背景處理模組322再根據顏色值Ca~Cd對初始影像P0中符合前述顏色值Ca~Cd的顏色進行去除。In addition to the aforementioned method, in another embodiment, the
再回到圖1A所示,處理單元32更具有影像疊加模組323,其係將背景處理模組322去背之後的去背影像與至少一背景影像相互疊加,以形成疊加影像。其中,背景影像可以為圖像或者是動態的影像。背景影像可以事先儲存在去背裝置3內,或者是透過網路連接雲端儲存設備7取得。此外,去背裝置3更具有第三連接介面332、影像輸出模組34以及第四連接介面333,其中第三連接介面332作為影音訊號輸出的介面,與電子裝置5電性連接,將處理後所得到的多媒體資訊,例如:影音資訊、影像資訊或圖像資訊,傳給電子裝置5。電子裝置5可以為智慧型手機、筆記型電腦或者是桌上型電腦等。第三連接介面332可以為USB各種形式的介面、HDMI或DVI等影音介面或者是無線或有線網路介面,但不以此為限置。在一實施例中,電子裝置5內具有應用程式可以將影音處理裝置5所輸出的多媒體資訊上傳到遠端的網路的影音串流平台或者是雲端儲存裝置。Returning to FIG. 1A , the
影像輸出模組34與影像疊加模組323以及第四連接介面333電性連接,第四連接介面333與顯示裝置6電性連接,第四連接介面333可以為USB各種形式的介面、HDMI或DVI等影音介面。透過影像輸出模組34以及第四連接介面333,使用者可以直接透過顯示器6看到後處理之後的影像效果。在另一實施例中,去背裝置3更可以包括有音訊連接介面334用以和音訊輸入裝置電性連接。音訊輸入裝置可以為麥克風或者是其他播音設備。要說明的是,雖然本實施例中去背裝置3與影像擷取裝置30為分離的兩個裝置,在另一實施例中去背裝置3與影像擷取裝置30可以相互整合在一起。例如,影像擷取裝置30可以是智慧型手機,其中去背裝置3整合在影像擷取裝置30內。The
請參閱圖1B所示,其為本發明之去背裝置之另一實施例示意圖。去背裝置3包括有第一影像擷取裝置30’、第二影像擷取裝置31以及處理單元32。第一影像擷取裝置30’在本實施例中為可攜式的影像擷取裝置,例如:智慧型手機、相機、或平板電腦等,但不以此為限制。第一影像擷取裝置30’同時也具有運算處理能力,可以藉由執行應用程式或APP產生使用者操作介面300。要說明的是,操作介面300可以提供使用者對於影像或圖像進行特定功能的操作,例如:選取圖像或影像上特定位置或區域讓應用程式或APP藉由演算取得關於被選取的特定位置或區域所具有的影像特徵,例如:亮度、對比度或顏色等資訊。本實施例中,第一影像擷取裝置30’藉由內建的鏡頭30a擷取被攝主體4以及其所在背景環境40的影像,以產生第一初始影像P1。Please refer to FIG. 1B , which is a schematic diagram of another embodiment of the background removal device of the present invention. The
第二影像擷取裝置31在本實施例中,為外接的攝影裝置,例如:相機或錄影機等,但不以此為限,例如,也可以為智慧型手機、相機、或平板電腦等。在另一實施例中,如圖1C所示,第二影像擷取裝置31可以整合在去背裝置3內。再回到圖1B所示,第二影像擷取裝置31藉由鏡頭31a擷取被攝主體4以及其所在背景環境40的影像,以產生第二初始影像。In this embodiment, the second
處理單元32在本實施例中,設置於去背裝置3內。去背裝置3在本實施例中,為具有網路通訊功能的直播設備,其係具有第一連接介面330以及第二連接介面331分別與第一影像擷取裝置30’以及第二影像擷取裝置31電性連接。第一連接介面330與第二連接介面331可以為無線通訊介面,例如:Wi-Fi 無線通訊或者是藍牙無線通訊等介面,或者是可以為有線介面,例如:USB各種形式的連接介面、HDMI、DVI等,但不以此為限置。In this embodiment, the
第一影像擷取裝置30’可以將操作介面300操作之後所得到的關於去背的資訊(例如:欲去背目標的位置資訊)藉由第一連接介面330傳輸給去背裝置3,再傳給處理單元32進行影像處理。同樣地,第二影像擷取裝置31將所擷取到的第二初始影像經由第二連接介面331傳輸給去背裝置3再傳給處理單元32。處理單元32則根據使用者決定的去背資訊,對第二初始影像進行去背。The first image capture device 30' can transmit the background removal information (e.g., the location information of the background removal target) obtained after the operation of the
在本實施例中,處理單元32更進一步包括有像素轉換模組320、影像分析模組321、背景處理模組322。其中,像素轉換模組320根據使用者在操作介面300上對第一初始影像選取欲去背目標的位置於第二初始影像上決定相應的複數個顏色特徵。欲去背的目標可以是單一點或者是特定大小的範圍。影像分析模組321將些顏色特徵聯集成顏色範圍。背景處理模組322,根據顏色範圍將第二初始影像中具有該些顏色特徵的像素去除。In this embodiment, the
以下用圖1B與圖3G與圖3H所示的實施例來說明,第一影像擷取裝置30’的操作介面300上顯示有第一初始影像P1,使用者在第一初始影像P1上選取了欲去背目標90a~90e。要說明的是,選取的方式為觸控方式在第一影像擷取裝置30’的顯示屏幕上選擇。每一個欲去背目標90a~90e可以為單一像素或多個像素的集合。第一影像擷取裝置30’將所選取的目標90a~90e的位置資訊傳給了去背裝置3。The following is an example shown in FIG. 1B , FIG. 3G and FIG. 3H . A first initial image P1 is displayed on the
去背裝置3接收到了位置資訊,傳給像素轉換模組320。像素轉換模組320根據所收到的位置資訊,在第二初始影像P2上取得相應於選取的目標90a~90e的顏色特徵。本實施例中,顏色特徵為YUV資訊,但不以此為限,例如:RGB資訊或者是CMYK資訊亦可。以下以YUV資訊來說明,在位置90a的YUV為(149,53,19),90b的YUV為(122,41,21),90c的YUV為(110,43,30),90d的YUV為(166,69,42) ,90e的YUV為(160,60,30)等。然後影像分析模組321再將對應選取的目標90a~90e的這些顏色特徵聯集成顏色範圍R1(Max:YUV(166, 69, 42), MinYUV(110, 41, 21),也就是Y介於166~110,U介於69~41,V介於42~21之間。之後,顏色範圍R1傳給了背景處理模組322,背景處理模組322再根據顏色範圍R1對第二初始影像P2中符合前述顏色範圍R1的顏色進行去除。The
除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色範圍。背景處理模組322,根據顏色範圍將第二初始影像P1中具有該些顏色特徵的像素去除。在本實施例中,如圖1B、圖3I與圖3J所示,第一影像擷取裝置30’的操作介面300上顯示有第一初始影像P1,使用者在初始影像上選取了欲去背的目標90f~90h。本實施例中,每一個目標90f~90h是由使用者利用觸控方式在第一初始影像P1上畫出的範圍。第一影像擷取裝置30’將所選取的目標90f~90h的位置資訊(範圍邊界)傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在第二初始影像P2上取得相應於選取的目標90f~90h範圍邊界的顏色特徵,然後影像分析模組321再將對應選取的目標90f~90h範圍邊界的顏色特徵決定出對應的顏色範圍R2~R4,例如:R2的YUVmax(149,53,19),YUVmin(138,51,17);R3的YUVmax(122,41,21),YUVmin(115,25,18),R4的YUVmax(110,43,30),YUVmin(108,32,25)。要說明的是產生顏色範圍R2~R4的方式係如前圖3G與3H所述,在此不作贅述。之後,顏色範圍R2~R4傳給了背景處理模組322,背景處理模組322再根據顏色範圍R2~R4對第二初始影像P2中符合前述顏色範圍R2~R4的顏色進行去除。In addition to the aforementioned method, in another embodiment, the
除了前述之方式外,另一實施例中,影像分析模組321將每一顏色特徵定義出複數個顏色值。背景處理模組322,根據顏色範圍將第二初始影像中具有該些顏色特徵的像素去除。在一實施例中,如圖3K與圖3L所示,第一影像擷取裝置30’的操作介面300上顯示有第一初始影像P1,使用者在初始影像上選取了欲去背的目標90i~90l。本實施例中,每一個目標90i~90l是由使用者利用觸控方式在第一初始影像P1點選的位置。第一影像擷取裝置30’將所選取的目標90i~90l的位置資訊傳給了去背裝置3,然後經由像素轉換模組320根據所收到的位置資訊,在第二初始影像P2上取得相應於選取的目標(像素)90i~90l的顏色特徵,然後影像分析模組321再將對應選取的目標90i~90l的顏色特徵決定出對應的顏色值Ca~Cd,例如:位置90i的YUV值Ca為(149,53,19),90j的YUV值Cb為(122,41,21),90k的YUV值Cc為(110,43,30),90l的YUV值Cd為(166,69,42)。之後,顏色值Ca~Cd傳給了背景處理模組322,背景處理模組322再根據顏色值Ca~Cd對第二初始影像P2中符合前述顏色值Ca~Cd的顏色進行去除。In addition to the aforementioned method, in another embodiment, the
再回到圖1B所示,處理單元32更具有影像疊加模組323,其係將背景處理模組322去背之後的去背影像與至少一背景影像相互疊加,以形成疊加影像。其中,背景影像可以為圖像或者是動態的影像。背景影像可以事先儲存在去背裝置3內,或者是透過網路連接雲端儲存設備7取得。此外,去背裝置3更具有第三連接介面332、影像輸出模組34以及第四連接介面333,其中第三連接介面332作為影音訊號輸出的介面,與電子裝置5電性連接,將處理後所得到的多媒體資訊,例如:影音資訊、影像資訊或圖像資訊,傳給電子裝置5。電子裝置5可以為智慧型手機、筆記型電腦或者是桌上型電腦等。第三連接介面332可以為USB各種形式的介面、HDMI或DVI等影音介面或者是無線或有線網路介面,但不以此為限置。在一實施例中,電子裝置5內具有應用程式可以將影音處理裝置5所輸出的多媒體資訊上傳到遠端的網路的影音串流平台或者是雲端儲存裝置。Returning to FIG. 1B , the
影像輸出模組34與影像疊加模組323以及第四連接介面333電性連接,第四連接介面333與顯示裝置6電性連接,第四連接介面333可以為USB各種形式的介面、HDMI或DVI等影音介面。透過影像輸出模組34以及第四連接介面333,使用者可以直接透過顯示器6看到後處理之後的影像效果。在另一實施例中,去背裝置3更可以包括有音訊連接介面334用以和音訊輸入裝置電性連接。音訊輸入裝置可以為麥克風或者是其他播音設備。The
在一實施例中,透過圖1A的去背裝置3,進行圖2A的去背方法2,首先利用步驟20藉由影像擷取裝置30擷取初始影像P0。接著進行步驟21,於影像擷取裝置30中提供操作介面顯示出初始影像P0。然後以步驟22藉由操作介面300於初始影像P0選取一個或複數個欲去背目標,並產生相應於選取的欲去背目標的複數個位置資訊。在步驟22中,可以利用前述如圖3A、圖3C或圖3E所示的三種方式任一種來達成選取目標位置的效果。之後,進行步驟23利用處理單元32從初始影像P0當中決定出對應於該些位置資訊的複數個顏色特徵。在步驟23中,可以利用前述如圖3B、圖3D或圖3F所示的三種方式任何一種來達成取得顏色特徵的效果。最後進行步驟24,處理單元32根據該些顏色特徵,對初始影像P0進行去背。在去背過程中,處理單元32將初始影像P0中符合顏色特徵的各個像素所具有的顏色去除,將去除顏色的區域透明化,形成去背影像。步驟24所得到的去背影像,可以進一步透過影像疊加模組323與另一目標影像或圖像相互疊加,形成疊加影像。In one embodiment, the
在另一實施例中,透過圖1B或圖1C的去背裝置3,進行圖2B的去背方法2a,首先利用步驟20a藉由第一影像擷取裝置30’擷取第一初始影像以及第二影像擷取裝置31擷取第二初始影像。接著進行步驟21a,於第一影像擷取裝置30’中提供操作介面顯示出第一初始影像P1。然後以步驟22a藉由操作介面300於第一初始影像P1選取一個或複數個欲去背目標,並產生相應於選取的欲去背目標的複數個位置資訊。在步驟22a中,可以利用前述如圖3G、圖3I或圖3K所示的三種方式任一種來達成選取目標位置的效果。之後,進行步驟23a利用處理單元32從第二初始影像當中決定出對應於該些位置資訊的複數個顏色特徵。在步驟23a中,可以利用前述如圖3H、圖3J或圖3L所示的三種方式任何一種來達成取得顏色特徵的效果。最後進行步驟24a,處理單元32根據該些顏色特徵,對第二初始影像進行去背。在去背過程中,處理單元32將第二初始影像中符合顏色特徵的各個像素所具有的顏色去除,將去除顏色的區域透明化,形成去背影像。步驟24a所得到的去背影像,可以進一步透過影像疊加模組323與另一目標影像或圖像相互疊加,形成疊加影像。In another embodiment, the
綜合上述,本發明的去背方法與去背裝置,可以在擷取影像或圖像之後,立即的根據使用者選擇多個區域的找到相應的多個顏色特徵進行去背,透過選取多個區域顏色特徵的演算,可以解決因為擷取影像的角度產生反光所產生的顏色差異而影響去背效果的問題。此外,使用者直接選取區域的方式更可以提升去背影像處理效率。In summary, the background removal method and background removal device of the present invention can find multiple corresponding color features according to multiple regions selected by the user immediately after capturing an image or picture to remove the background. By selecting the calculation of the color features of multiple regions, the problem of color difference caused by reflection caused by the angle of capturing the image and affecting the background removal effect can be solved. In addition, the method of directly selecting the region by the user can further improve the background removal image processing efficiency.
以上所述,乃僅記載本發明為呈現解決問題所採用的技術手段之較佳實施方式或實施例而已,並非用來限定本發明專利實施之範圍。即凡與本發明專利申請範圍文義相符,或依本發明專利範圍所做的均等變化與修飾,皆為本發明專利範圍所涵蓋。The above only records the preferred implementation methods or examples of the technical means adopted by the present invention to solve the problem, and is not used to limit the scope of implementation of the present invention. That is, all equivalent changes and modifications that are consistent with the scope of the patent application of the present invention or made according to the scope of the patent of the present invention are covered by the scope of the patent of the present invention.
2:去背方法
20~24:步驟
3:去背裝置
30:影像擷取裝置
30’:第一影像擷取裝置
30a:鏡頭
300:操作介面
31:第二影像擷取裝置
31a:鏡頭
32:處理單元
320:像素轉換模組
321:影像分析模組
322:背景處理模組
323:影像疊加模組
330:第一連接介面
331:第二連接介面
332:第三連接介面
333:第四連接介面
334:音訊連接介面
34:影像輸出模組
4:被攝主體
40:背景環境
5:電子裝置
6:顯示裝置
7:雲端儲存設備
P0:初始影像
P1:第一初始影像
P2:第二初始影像
90a~90l:目標
R1~R4:範圍
Ca~Cd:顏色值
2:
圖1A為本發明之去背裝置之一實施例示意圖。 圖1B與圖1C為本發明之去背裝置之其他實施例示意圖。 圖2A為本發明之去背方法之一實施例流程示意圖。 圖2B為本發明之去背方法之一實施例流程示意圖。 圖3A至3L為本發明之選取顏色特徵之不同實施例示意圖。 FIG. 1A is a schematic diagram of an embodiment of the background removal device of the present invention. FIG. 1B and FIG. 1C are schematic diagrams of other embodiments of the background removal device of the present invention. FIG. 2A is a schematic diagram of a flow chart of an embodiment of the background removal method of the present invention. FIG. 2B is a schematic diagram of a flow chart of an embodiment of the background removal method of the present invention. FIG. 3A to FIG. 3L are schematic diagrams of different embodiments of selecting color features of the present invention.
2:去背方法 2: Background removal method
20~24:步驟 20~24: Steps
Claims (10)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110113187A TWI837469B (en) | 2021-04-13 | 2021-04-13 | Method and device for removeing the background |
CN202210356625.6A CN115272360A (en) | 2021-04-13 | 2022-04-06 | Back removing method and back removing device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110113187A TWI837469B (en) | 2021-04-13 | 2021-04-13 | Method and device for removeing the background |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202240548A TW202240548A (en) | 2022-10-16 |
TWI837469B true TWI837469B (en) | 2024-04-01 |
Family
ID=83758174
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW110113187A TWI837469B (en) | 2021-04-13 | 2021-04-13 | Method and device for removeing the background |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN115272360A (en) |
TW (1) | TWI837469B (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110263667A (en) * | 2019-05-29 | 2019-09-20 | Oppo广东移动通信有限公司 | Image processing method, device and electronic equipment |
CN110852228A (en) * | 2019-11-04 | 2020-02-28 | 河海大学常州校区 | Method and system for extracting dynamic background and detecting foreground object in monitoring video |
CN110991454A (en) * | 2019-12-23 | 2020-04-10 | 云南大学 | Blade image recognition method and device, electronic equipment and storage medium |
TW202029777A (en) * | 2019-01-18 | 2020-08-01 | 荔枝位元有限公司 | Method for processing augmented reality image |
TW202036369A (en) * | 2019-03-15 | 2020-10-01 | 宏碁股份有限公司 | Image processing apparatus and method thereof |
-
2021
- 2021-04-13 TW TW110113187A patent/TWI837469B/en active
-
2022
- 2022-04-06 CN CN202210356625.6A patent/CN115272360A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW202029777A (en) * | 2019-01-18 | 2020-08-01 | 荔枝位元有限公司 | Method for processing augmented reality image |
TW202036369A (en) * | 2019-03-15 | 2020-10-01 | 宏碁股份有限公司 | Image processing apparatus and method thereof |
CN110263667A (en) * | 2019-05-29 | 2019-09-20 | Oppo广东移动通信有限公司 | Image processing method, device and electronic equipment |
CN110852228A (en) * | 2019-11-04 | 2020-02-28 | 河海大学常州校区 | Method and system for extracting dynamic background and detecting foreground object in monitoring video |
CN110991454A (en) * | 2019-12-23 | 2020-04-10 | 云南大学 | Blade image recognition method and device, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN115272360A (en) | 2022-11-01 |
TW202240548A (en) | 2022-10-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019105467A1 (en) | Method and device for sharing information, storage medium, and electronic device | |
US10242710B2 (en) | Automatic cinemagraph | |
CN107948733B (en) | Video image processing method and device and electronic equipment | |
WO2016011877A1 (en) | Method for filming light painting video, mobile terminal, and storage medium | |
CN103916597A (en) | Shooting method based on simulated scenario | |
US20140313366A1 (en) | Method of processing image and electronic device and system supporting the same | |
TWI717317B (en) | Method and device for taking screenshot of display image of display device | |
WO2023193521A1 (en) | Video inpainting method, related apparatus, device and storage medium | |
JP2017511627A (en) | Raw scene recognition that allows scene-dependent image modification before image recording or display | |
KR102641738B1 (en) | Image processing method and electronic device supporting the same | |
US10205940B1 (en) | Determining calibration settings for displaying content on a monitor | |
TWI837469B (en) | Method and device for removeing the background | |
CN115002358B (en) | Control method and system in digital background shooting | |
US12010433B2 (en) | Image processing apparatus, image processing method, and storage medium | |
WO2021169810A1 (en) | Video processing method, and server | |
US9036070B2 (en) | Displaying of images with lighting on the basis of captured auxiliary images | |
US11562712B2 (en) | Video reproduction system, video reproduction device, and calibration method for video reproduction system | |
US10440266B2 (en) | Display apparatus and method for generating capture image | |
Le et al. | Visual quality assessment for projected content | |
JP5742305B2 (en) | Drawing image processing device | |
EP1542471A4 (en) | Image processing device, method, information processing device, method, recording medium, and program | |
WO2024082863A1 (en) | Image processing method and electronic device | |
WO2024113162A1 (en) | Luminance compensation method and apparatus, device, and storage medium | |
WO2023100664A1 (en) | Image processing device, image processing method, and program | |
CN111083312B (en) | Studio system and program video production method and device |