TWM499621U - Image acquisition device - Google Patents

Image acquisition device Download PDF

Info

Publication number
TWM499621U
TWM499621U TW103218965U TW103218965U TWM499621U TW M499621 U TWM499621 U TW M499621U TW 103218965 U TW103218965 U TW 103218965U TW 103218965 U TW103218965 U TW 103218965U TW M499621 U TWM499621 U TW M499621U
Authority
TW
Taiwan
Prior art keywords
image
green
red
infrared
image capturing
Prior art date
Application number
TW103218965U
Other languages
Chinese (zh)
Inventor
Ching-Lung Tsai
Shuei-Lin Chen
Yung-Neng Yu
Hung-Yu Yeh
I-Hsien Lee
Original Assignee
Altek Semiconductor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Altek Semiconductor Corp filed Critical Altek Semiconductor Corp
Priority to TW103218965U priority Critical patent/TWM499621U/en
Publication of TWM499621U publication Critical patent/TWM499621U/en

Links

Landscapes

  • Image Processing (AREA)
  • Image Analysis (AREA)

Description

影像擷取裝置Image capture device 【0001】【0001】

本創作是有關於一種影像擷取裝置,特別是一種透過偵測擷取影像場景的結果來判斷產生深度影像的方式,以建立一種混合式產生深度影像之影像擷取裝置。The present invention relates to an image capturing device, and in particular to a method for determining a depth image by detecting a result of capturing an image scene to create a hybrid image capturing device for generating a depth image.

【0002】【0002】

目前行動裝置上所搭配之雙鏡頭可達到許多不同的效果,如分別利用一廣角鏡頭或一變焦鏡頭拍下兩照片來作組合,以達到無損變焦的結果,或是利用雙鏡頭所拍下的兩張照片來分析被擷取影像之景深。然而無論是何種應用,都必須在擷取影像的當下即擷取到最好的影像,才可對後續之應用產生最大的效益。At present, the dual lens matched with the mobile device can achieve many different effects, such as using a wide-angle lens or a zoom lens to take two photos to combine to achieve the result of lossless zoom, or using the two shots of the two lenses. A photo is taken to analyze the depth of field of the captured image. However, no matter what kind of application, you must capture the best image while capturing the image, in order to maximize the benefits of subsequent applications.

【0003】[0003]

以智慧型手機為例,目前的深度影像產生方式可估略分為兩種,第一種方式是利用智慧型手機上的一主影像擷取鏡頭及一輔助影像擷取鏡頭,並使用這兩個鏡頭所擷取的彩色影像透過一立體配對(Stereomatching)處理以產生一深度影像。另一種方式利用在智慧型手機上的一紅外線影像擷取鏡頭及一紅外線LED模組,將擷取到的紅外線影像及此紅外線LED模組透過結構光(Structure-light)處理以產生另一深度影像。Taking smart phones as an example, the current depth image generation method can be estimated to be divided into two types. The first method is to use a main image capturing lens and an auxiliary image capturing lens on the smart phone, and use the two. The color images captured by the lenses are processed by a stereo pairing to generate a depth image. Another method utilizes an infrared image capturing lens and an infrared LED module on the smart phone to process the captured infrared image and the infrared LED module through a structure-light process to generate another depth. image.

【0004】[0004]

利用結構光處理所產生的深度影像具有較佳的準確度,然而由於其利用紅外線光源的緣故,若是在戶外容易受到陽光的光源干擾或是被其他的光源所干擾。另一方面,利用立體配對處理所產生的深度影像雖然有不受戶外陽光干擾、適用範圍較廣的優點,然而其深度影像之準確度卻不如使用結構光處理所產生的深度影像之準確度。The depth image generated by the structured light processing has better accuracy. However, due to the use of the infrared light source, it is easily interfered by the light source of the sunlight outdoors or interfered by other light sources. On the other hand, although the depth image generated by the stereo pairing process has the advantage of being free from outdoor sunlight and having a wide application range, the accuracy of the depth image is not as accurate as that of the depth image generated by the structured light processing.

【0005】[0005]

綜觀前所述,是故,本創作之創作人經多年苦心潛心研究、思索並設計一種混合式產生深度之影像擷取裝置,以針對現有技術之缺失加以改善,進而增進產業上之實施利用。As mentioned above, the author of this creation has worked hard for many years to study, think about and design a hybrid image capturing device to improve the lack of existing technology, thereby enhancing the implementation and utilization of the industry.

【0006】[0006]

有鑑於上述習知技藝之問題,本創作之目的就是產生一種結合立體配對處理及結構光處理的影像擷取裝置,以確保影像擷取裝置可針對不同的外部環境以進行不同的影像處理方式。In view of the above-mentioned problems of the prior art, the purpose of the present invention is to create an image capturing device that combines stereo pairing processing and structured light processing to ensure that the image capturing device can perform different image processing methods for different external environments.

【0007】【0007】

基於上述目的,本創作係提供一種影像擷取裝置,其適用於一電子產品上,影像擷取裝置包含一紅綠藍及紅外線(RGB/IR)影像擷取單元、一紅綠藍影像擷取單元、一紅外線發光單元以及一處理單元。紅綠藍及紅外線影像擷取單元可擷取外部環境之第一影像,而第一影像為包含紅綠藍影像資訊及紅外線影像資訊的複合影像。紅綠藍影像擷取單元可擷取外部環境之第二影像。紅外線發光單元係發出紅外線光源。處理單元可電性連接紅綠藍及紅外線影像擷取單元、紅綠藍影像擷取單元及紅外線發光單元。處理單元選擇性地由第一影像取得一第一影像深度資訊,或由第一影像及第二影像取得一第二影像深度資訊。Based on the above purposes, the present invention provides an image capturing device suitable for use in an electronic product. The image capturing device comprises a red, green, blue and infrared (RGB/IR) image capturing unit, and a red, green and blue image capturing device. A unit, an infrared illuminating unit, and a processing unit. The red, green and infrared image capturing unit can capture the first image of the external environment, and the first image is a composite image containing red, green and blue image information and infrared image information. The red, green and blue image capturing unit can capture the second image of the external environment. The infrared light emitting unit emits an infrared light source. The processing unit can be electrically connected to the red, green and blue image capturing unit, the red, green and blue image capturing unit and the infrared light emitting unit. The processing unit selectively obtains a first image depth information from the first image or a second image depth information from the first image and the second image.

【0008】[0008]

較佳地,處理單元由第一影像取出紅外線影像資訊,並對紅外線影像資訊進行一第一影像處理以取得第一影像深度資訊;當處理單元判斷第一影像深度資訊符合一切換條件時,處理單元利用紅綠藍及紅外線影像擷取單元及紅綠藍影像擷取單元擷取第一影像及第二影像,並由第一影像取出紅綠藍影像資訊,且對紅綠藍影像資訊及第二影像進行一第二影像處理,以取得第二影像深度資訊。Preferably, the processing unit extracts the infrared image information from the first image, and performs a first image processing on the infrared image information to obtain the first image depth information; and when the processing unit determines that the first image depth information meets a switching condition, the processing unit processes The unit uses the red, green and blue image capturing unit and the red, green and blue image capturing unit to capture the first image and the second image, and the red, green and blue image information is extracted from the first image, and the red, green and blue image information and the The second image performs a second image processing to obtain the second image depth information.

【0009】【0009】

較佳地,第一影像深度資訊包含複數個畫素,且每一畫素可具有信心指數。Preferably, the first image depth information includes a plurality of pixels, and each pixel may have a confidence index.

【0010】[0010]

較佳地,當複數個畫素之畫素之信心指數大於等於一信心指數門檻值時,畫素為一有效畫素,當畫素之信心指數小於信心指數門檻值時,畫素為一無效畫素。Preferably, when the confidence index of the pixels of the plurality of pixels is greater than or equal to a confidence index threshold, the pixel is a valid pixel, and when the confidence index of the pixel is less than the threshold of the confidence index, the pixel is invalid. Picture.

【0011】[0011]

較佳地,當複數個畫素中具有有效畫素佔該複數個畫素之比例小於一有效畫素比例門檻值時,處理單元判斷第一影像深度係符合切換條件。Preferably, when the ratio of the effective pixels to the plurality of pixels in the plurality of pixels is less than a threshold value of the effective pixel ratio, the processing unit determines that the first image depth conforms to the switching condition.

【0012】[0012]

較佳地,當處理單元判斷第一影像深度資訊不符合切換條件時,處理單元係對持續所擷取到之第一影像取出紅外線影像資訊,並對紅外線影像資訊進行第一影像處理以取得第一影像深度資訊。Preferably, when the processing unit determines that the first image depth information does not meet the switching condition, the processing unit extracts the infrared image information for the first image captured and performs the first image processing on the infrared image information to obtain the first image. An image depth information.

【0013】[0013]

較佳地,紅綠藍及紅外線影像擷取單元與紅綠藍影像擷取單元之間之距離係小於3公分,紅外線發光單元與紅綠藍及紅外線影像擷取單元之間之距離係大於7公分。Preferably, the distance between the red, green and blue image capturing unit and the red, green and blue image capturing unit is less than 3 cm, and the distance between the infrared light emitting unit and the red, green and blue image capturing unit is greater than 7 Centimeters.

【0029】[0029]

100、150‧‧‧影像擷取裝置100, 150‧‧‧ image capture device

10、151、221‧‧‧紅綠藍及紅外線影像擷取單元10,151,221‧‧‧Red, green and infrared image capture unit

11‧‧‧第一影像11‧‧‧ first image

20、152、222‧‧‧紅綠藍影像擷取單元20,152, 222‧‧‧Red, Green and Blue Image Capture Unit

21‧‧‧第二影像21‧‧‧Second image

30、153、223‧‧‧紅外線發光單元30, 153, 223‧‧ Infrared illumination unit

31‧‧‧紅外線光源31‧‧‧Infrared source

40、240‧‧‧處理單元40, 240‧‧‧ processing unit

41‧‧‧切換條件41‧‧‧Switching conditions

42‧‧‧第一影像處理42‧‧‧First image processing

43‧‧‧第二影像處理43‧‧‧Second image processing

44‧‧‧第一影像深度資訊44‧‧‧First image depth information

45‧‧‧第二影像深度資訊45‧‧‧Second image depth information

46‧‧‧紅外線影像資訊46‧‧‧Infrared image information

47‧‧‧紅綠藍影像資訊47‧‧‧Red, Green and Blue Image Information

48‧‧‧畫素48‧‧‧ pixels

d1‧‧‧第一距離D1‧‧‧first distance

d2‧‧‧第二距離D2‧‧‧Second distance

200‧‧‧智慧型手機200‧‧‧Smart mobile phone

211‧‧‧觸控螢幕211‧‧‧ touch screen

【0014】[0014]

第1圖係為本創作之影像擷取裝置之方塊圖。Figure 1 is a block diagram of the image capture device of the present invention.

第2圖係為本創作之第一實施例之影像擷取裝置之示意圖。Figure 2 is a schematic diagram of the image capturing device of the first embodiment of the present invention.

第3A圖係為本創作之第二實施例之影像擷取裝置之第一示意圖。Figure 3A is a first schematic view of the image capturing device of the second embodiment of the present invention.

第3B圖係為本創作之第二實施例之影像擷取裝置之第二示意圖。FIG. 3B is a second schematic diagram of the image capturing device of the second embodiment of the present invention.

【0015】[0015]

為利貴審查員瞭解本創作之技術特徵、內容與優點及其所能達成之功效,茲將本創作配合附圖,並以實施例之表達形式詳細說明如下,而其中所使用之圖式,其主旨僅為示意及輔助說明書之用,未必為本創作實施後之真實比例與精準配置,故不應就所附之圖式的比例與配置關係侷限本創作於實際實施上的專利範圍,合先敘明。In order to understand the technical characteristics, content and advantages of the creation and the effects that can be achieved by the examiner, the author will use the drawings in detail and explain the following in the form of the examples, and the drawings used therein The subject matter is only for the purpose of illustration and supplementary manual. It is not necessarily the true proportion and precise configuration after the implementation of the original creation. Therefore, the proportion and configuration relationship of the attached drawings should not be limited to the scope of patents created in actual implementation. Narration.

【0016】[0016]

請參閱第1圖,其係為本創作之影像擷取裝置之示意圖。如第1圖所示,一種影像擷取裝置100,適用於一電子產品上,此影像擷取裝置100包含一紅綠藍及紅外線(RGB/IR)影像擷取單元10、紅綠藍影像擷取單元20,紅外線發光單元30以及一處理單元40。其中處理單元40係電性連接紅綠藍及紅外線影像擷取單元10、紅綠藍影像擷取單元20及紅外線發光單元30。此電子裝置可包含一智慧型手機、一平板電腦或一筆記型電腦,此紅綠藍及紅外線影像擷取單元10可為一鏡頭模組,其內可包含一感測紅光、綠光、藍光及紅外線(RGB/IR)的影像感測器,而紅綠藍影像擷取單元20可為另一鏡頭模組,其內可包含一感測紅光、綠光、藍光(RGB)的影像感測器。Please refer to FIG. 1 , which is a schematic diagram of the image capturing device of the present invention. As shown in FIG. 1 , an image capturing device 100 is applied to an electronic product. The image capturing device 100 includes a red, green, blue and infrared (RGB/IR) image capturing unit 10, and a red, green and blue image. The unit 20, the infrared illuminating unit 30 and a processing unit 40 are taken. The processing unit 40 is electrically connected to the red, green and blue image capturing unit 10, the red, green and blue image capturing unit 20, and the infrared light emitting unit 30. The electronic device can include a smart phone, a tablet computer or a notebook computer. The red, green and infrared image capturing unit 10 can be a lens module, which can include a sensing red light and green light. The blue and blue (RGB/IR) image sensor, and the red, green and blue image capturing unit 20 can be another lens module, which can include an image that senses red, green, and blue light (RGB). Sensor.

【0017】[0017]

進一步地說明,紅綠藍及紅外線影像擷取單元10可擷取外部環境的一第一影像11,而紅綠藍影像擷取單元20可擷取外部環境的一第二影像21。其中,此第一影像11為一複合影像,其包含紅外線(IR)影像資訊46及紅綠藍(RGB)影像資訊47。擷取第一影像11時,處理單元40可以先使紅外線發光單元30發出一紅外線光源31,再利用紅綠藍及紅外線影像擷取單元10以擷取第一影像11。接著,處理單元40自第一影像11取出紅外線影像資訊46,並對紅外線影像資訊46進行第一影像處理42以產生一第一影像深度資訊44。當處理單元40判斷第一影像深度資訊44滿足一切換條件41時,處理單元40即利用紅綠藍及紅外線影像擷取單元10及紅綠藍影像擷取單元20分別擷取第一影像11及第二影像21,並由第一影像11中取出紅綠藍影像資訊47。最後,利用此第一影像11之紅綠藍影像資訊47及第二影像21進行第二影像處理43,以產生一第二影像深度資訊45。It is further explained that the red, green and blue image capturing unit 10 can capture a first image 11 of the external environment, and the red, green and blue image capturing unit 20 can capture a second image 21 of the external environment. The first image 11 is a composite image, which includes infrared (IR) image information 46 and red, green and blue (RGB) image information 47. When the first image 11 is captured, the processing unit 40 may first cause the infrared light emitting unit 30 to emit an infrared light source 31, and then use the red, green, and infrared image capturing unit 10 to capture the first image 11. Then, the processing unit 40 takes out the infrared image information 46 from the first image 11 and performs a first image processing 42 on the infrared image information 46 to generate a first image depth information 44. When the processing unit 40 determines that the first image depth information 44 satisfies a switching condition 41, the processing unit 40 uses the red, green, and infrared image capturing unit 10 and the red, green, and blue image capturing unit 20 to capture the first image 11 and The second image 21 is taken out of the first image 11 and the red, green and blue image information 47 is taken out. Finally, the second image processing 43 is performed by using the red, green and blue image information 47 and the second image 21 of the first image 11 to generate a second image depth information 45.

【0018】[0018]

其中此第一影像處理42可包含一結構光影像處理,進而產生一結構光深度影像,而此結構光深度影像之特性為具有一較佳準確度的一深度圖影像;此第二影像處理43可包含一立體配對影像處理,以產生具有高解析度之一深度圖影像。The first image processing 42 can include a structured light image processing to generate a structured light depth image, and the structured light depth image is characterized by a depth image having a better accuracy; the second image processing 43 A stereo paired image processing can be included to produce a depth map image having a high resolution.

【0019】[0019]

進一步地說明,處理單元40利用一信心指數門檻值及一有效畫素比例門檻值來判斷第一影像深度資訊44是否符合切換條件41。在第一影像深度資訊44中可包含複數個畫素48,且複數個畫素48的每一個畫素48係具有對應於其深度值的一信心指數(confidence level)。首先,進行複數個畫素48是否為有效畫素之判斷。例如,若畫素48之信心指數大於等於信心指數門檻值時,則處理單元40設定此畫素48為一有效畫素,亦即其具備一有效之深度值;反之,則設定此畫素48為一無效畫素。在完成判斷此複數個畫素48是否為有效後,續而進行第一影像深度資訊44品質優劣的判斷。例如,處理單元40統計有效畫素佔所有畫素之比例,而算出一有效畫素比例,並以此有效畫素比例定義影像深度資訊品質。當此複數個畫素48之有效畫素比例小於一有效畫素比例門檻值時,代表該影像深度資訊品質不佳,處理單元40判斷第一影像深度資訊44之品質係符合切換條件41。Further, the processing unit 40 determines whether the first image depth information 44 meets the switching condition 41 by using a confidence index threshold and a valid pixel ratio threshold. A plurality of pixels 48 may be included in the first image depth information 44, and each pixel 48 of the plurality of pixels 48 has a confidence level corresponding to its depth value. First, a determination is made as to whether or not a plurality of pixels 48 are valid pixels. For example, if the confidence index of the pixel 48 is greater than or equal to the confidence index threshold, the processing unit 40 sets the pixel 48 as a valid pixel, that is, it has a valid depth value; otherwise, the pixel 48 is set. For an invalid pixel. After determining whether the plurality of pixels 48 are valid, the quality of the first image depth information 44 is judged continuously. For example, the processing unit 40 counts the ratio of the effective pixels to all the pixels, calculates a effective pixel ratio, and defines the image depth information quality with the effective pixel ratio. When the effective pixel ratio of the plurality of pixels 48 is less than a valid pixel ratio threshold, it indicates that the image depth information quality is not good, and the processing unit 40 determines that the quality of the first image depth information 44 conforms to the switching condition 41.

【0020】[0020]

綜合以上可得知,透過本創作之影像擷取裝置100可以確保在不同的外部環境下進行不同的影像處理方式,以解決習知技術中深度影像之準確度不佳或是容易遭受到干擾的問題。In summary, the image capturing device 100 of the present invention can ensure different image processing modes in different external environments to solve the problem that the depth image of the prior art is not accurate or susceptible to interference. problem.

【0021】[0021]

請參閱第2圖,其係為本創作之第一實施例之影像擷取裝置之示意圖。在此實施例之影像擷取裝置150中,紅綠藍及紅外線影像擷取單元151與紅綠藍影像擷取單元152之間之第一距離d1可小於3公分,而紅外線發光單元153與紅綠藍及紅外線影像擷取單元151之間之第二距離d2則可大於7公分。Please refer to FIG. 2, which is a schematic diagram of an image capturing device according to a first embodiment of the present invention. In the image capturing device 150 of this embodiment, the first distance d1 between the red, green, and infrared image capturing unit 151 and the red, green, and blue image capturing unit 152 may be less than 3 cm, and the infrared light emitting unit 153 and the red light The second distance d2 between the green-blue and infrared image capturing unit 151 may be greater than 7 cm.

【0022】[0022]

請參閱第3A圖及第3B圖,其係為本創作之第二實施例之影像擷取裝置之第一示意圖及第二示意圖。在此實施例中,電子裝置係以智慧型手機200來舉例實施,但不以此為限。在第3A圖中分別顯示智慧型手機200之一正面及一背面。正面係包含一觸控螢幕211供使用者進行輸入,背面係設置有一紅綠藍及紅外線影像擷取單元221、一紅綠藍影像擷取單元222以及一紅外線發光單元223。在此實施例中係根據智慧型手機200的第一影像深度資訊44之品質來作為一切換條件。亦即使用者可以先使用智慧型手機200上之紅綠藍及紅外線影像擷取單元221及紅外線發光單元223進行影像擷取,並經由第一影像處理後,得到第一影像深度資訊。此時,可以透過系統預設的信心指數門檻值及有效畫素比例門檻值來判斷所產生之第一影像深度資訊是否滿足切換條件。其詳細判斷方式類似於前述,在此不予贅述。Please refer to FIG. 3A and FIG. 3B , which are a first schematic diagram and a second schematic diagram of an image capturing device according to a second embodiment of the present invention. In this embodiment, the electronic device is implemented by using the smart phone 200 as an example, but is not limited thereto. A front side and a back side of the smart phone 200 are respectively shown in Fig. 3A. The front side includes a touch screen 211 for input by the user, and the back side is provided with a red, green and blue image capturing unit 221, a red, green and blue image capturing unit 222, and an infrared light emitting unit 223. In this embodiment, the quality of the first image depth information 44 of the smart phone 200 is used as a switching condition. That is, the user can first use the red, green, and infrared image capturing unit 221 and the infrared light emitting unit 223 on the smart phone 200 to perform image capturing, and obtain the first image depth information through the first image processing. At this time, whether the generated first image depth information satisfies the switching condition can be determined by the system preset confidence index threshold value and the effective pixel ratio threshold value. The detailed judgment manner is similar to the foregoing, and will not be described herein.

【0023】[0023]

智慧型手機200可利用一手機應用程式,以手動或自動方式顯示此切換條件之顯示訊息於觸控螢幕211上。當滿足切換條件時,使用者可以透過智慧型手機200的觸控螢幕211以選擇”是”之一輸入指令,此時智慧型手機200內的處理單元240便會依據此輸入指令而控制紅綠藍及紅外線影像擷取單元221及紅綠藍影像擷取單元222,使此紅綠藍及紅外線影像擷取單元221及紅綠藍影像擷取單元222分別擷取外部環境之影像而產生第一影像和第二影像。接著處理單元240由此第一影像中取出紅綠藍影像資訊,將其與第二影像進行一立體配對影像處理(第二影像處理43),以產生具有高解析度之一深度圖影像。The smart phone 200 can display the display message of the switching condition on the touch screen 211 manually or automatically by using a mobile phone application. When the switching condition is met, the user can input an instruction by selecting one of “Yes” through the touch screen 211 of the smart phone 200, and the processing unit 240 in the smart phone 200 controls the red and green according to the input instruction. The blue and infrared image capturing unit 221 and the red, green and blue image capturing unit 222 respectively cause the red, green and blue image capturing unit 221 and the red, green and blue image capturing unit 222 to capture the image of the external environment to generate the first Image and second image. Then, the processing unit 240 extracts the red, green and blue image information from the first image, and performs a stereo paired image processing (second image processing 43) with the second image to generate a depth map image with high resolution.

【0024】[0024]

相反地,當不滿足切換條件時,如第3B圖所示,此時智慧型手機200內的處理單元240便會依據此輸入指令,先控制紅外線發光單元223進行照射紅外線,再控制紅綠藍及紅外線影像擷取單元221進行影像擷取。由於紅綠藍及紅外線影像擷取單元221所擷取的第一影像含有紅外線資訊,處理單元240便可對第一影像取出紅外線影像資訊,並對其進行一結構光影像處理(第一影像處理42),進而產生一結構光深度影像。而此結構光深度影像之特性為具有一較佳準確度的一深度影像。On the contrary, when the switching condition is not satisfied, as shown in FIG. 3B, the processing unit 240 in the smart phone 200 first controls the infrared light emitting unit 223 to irradiate the infrared light according to the input command, and then controls the red, green and blue. And the infrared image capturing unit 221 performs image capturing. Since the first image captured by the red, green, and infrared image capturing unit 221 contains infrared information, the processing unit 240 can extract the infrared image information from the first image and perform a structured image processing (first image processing) 42), which in turn produces a structured light depth image. The characteristic of the structured light depth image is a depth image with a better accuracy.

【0025】[0025]

值得一提的是,在此實施例亦可由紅綠藍影像擷取單元222產生第二影像,然而在此第二影像將不會被處理單元240所參考而產生所述結構光深度影像。It is worth mentioning that in this embodiment, the second image can also be generated by the red, green and blue image capturing unit 222. However, the second image will not be referenced by the processing unit 240 to generate the structured light depth image.

【0026】[0026]

本實施例係以處理單元240顯示一介面以供使用者進行選擇,其亦可以讓處理單元240在智慧型手機200內的背景程式自動執行以上程序,而上述在觸控螢幕211上所顯示之介面與處理單元240間之驅動關係可由一般的手機應用程式所達到,故在此不進行詳細的描述。In this embodiment, the processing unit 240 displays an interface for the user to select. The processing unit 240 can also automatically execute the above program in the background program in the smart phone 200, and the above display is displayed on the touch screen 211. The driving relationship between the interface and the processing unit 240 can be achieved by a general mobile phone application, and thus will not be described in detail herein.

【0027】[0027]

由以上可知,本創作之影像擷取裝置可以結合立體配對影像處理及結構光影像處理,使影像擷取裝置可針對不同的外部環境進行影像擷取以及其較佳的影像處理方式,換言之,可有效降低外部環境的干擾因素,使此影像擷取裝置拍攝出最符合外部環境的相關影像。It can be seen from the above that the image capturing device of the present invention can be combined with stereo paired image processing and structured light image processing, so that the image capturing device can perform image capturing and better image processing methods for different external environments, in other words, Effectively reduce the interference of the external environment, so that the image capture device captures the relevant image that best matches the external environment.

【0028】[0028]

在較佳實施例之詳細說明中所提出之具體實施例僅用以方便說明本創作之技術內容,而非將本創作狹義地限制於上述實施例,在不超出本創作之精神及以下申請專利範圍之情況,所做之種種變化實施,皆屬於本創作之範圍。The specific embodiments set forth in the detailed description of the preferred embodiments are merely used to facilitate the description of the technical contents of the present invention, and the present invention is not limited to the above embodiments, and does not exceed the spirit of the present invention and the following patents. The scope of the scope, the implementation of all kinds of changes, are within the scope of this creation.

100‧‧‧影像擷取裝置 100‧‧‧Image capture device

10‧‧‧紅綠藍及紅外線影像擷取單元 10‧‧‧Red, green and infrared image capture unit

11‧‧‧第一影像 11‧‧‧ first image

20‧‧‧紅綠藍影像擷取單元 20‧‧‧Red, Green and Blue Image Capture Unit

21‧‧‧第二影像 21‧‧‧Second image

30‧‧‧紅外線發光單元 30‧‧‧Infrared illumination unit

31‧‧‧紅外線光源 31‧‧‧Infrared source

40‧‧‧處理單元 40‧‧‧Processing unit

41‧‧‧切換條件 41‧‧‧Switching conditions

42‧‧‧第一影像處理 42‧‧‧First image processing

43‧‧‧第二影像處理 43‧‧‧Second image processing

44‧‧‧第一影像深度資訊 44‧‧‧First image depth information

45‧‧‧第二影像深度資訊 45‧‧‧Second image depth information

46‧‧‧紅外線影像資訊 46‧‧‧Infrared image information

47‧‧‧紅綠藍影像資訊 47‧‧‧Red, Green and Blue Image Information

48‧‧‧畫素 48‧‧‧ pixels

Claims (8)

【第1項】[Item 1] 一種影像擷取裝置,適用於一電子產品上,該影像擷取裝置包含:
一紅綠藍及紅外線影像擷取單元,係擷取外部環境之一第一影像,其中該第一影像為包含一紅綠藍(RGB)影像資訊及一紅外線(IR)影像資訊之複合影像;
一紅綠藍影像擷取單元,係擷取外部環境之一第二影像;
一紅外線發光單元,係發出一紅外線光源;以及
An image capturing device suitable for use in an electronic product, the image capturing device comprising:
A red, green, blue and infrared image capturing unit captures a first image of an external environment, wherein the first image is a composite image comprising a red, green and blue (RGB) image information and an infrared (IR) image information;
a red, green and blue image capturing unit that captures a second image of the external environment;
An infrared light emitting unit emits an infrared light source;
一處理單元,係電性連接該紅綠藍及紅外線影像擷取單元、該紅綠藍影像擷取單元及該紅外線發光單元,並用以選擇性地由該第一影像取得一第一影像深度資訊,或由該第一影像及該第二影像取得一第二影像深度資訊。a processing unit electrically connecting the red, green and blue image capturing unit, the red, green and blue image capturing unit and the infrared light emitting unit, and configured to selectively obtain a first image depth information from the first image Or obtaining a second image depth information from the first image and the second image. 【第2項】[Item 2] 如申請專利範圍第1項所述之影像擷取裝置,其中該處理單元由該第一影像取出該紅外線影像資訊,並對該紅外線影像資訊進行一第一影像處理以取得該第一影像深度資訊,當該處理單元判斷該第一影像深度資訊符合一切換條件時,該處理單元利用該紅綠藍及紅外線影像擷取單元及該紅綠藍影像擷取單元擷取該第一影像及該第二影像,該處理單元由該第一影像取出該紅綠藍影像資訊,並對該紅綠藍影像資訊及該第二影像進行一第二影像處理,以取得該第二影像深度資訊。The image capturing device of claim 1, wherein the processing unit extracts the infrared image information from the first image, and performs a first image processing on the infrared image information to obtain the first image depth information. When the processing unit determines that the first image depth information meets a switching condition, the processing unit uses the red, green, blue, and infrared image capturing unit and the red, green, and blue image capturing unit to capture the first image and the first image. And the processing unit extracts the red, green and blue image information from the first image, and performs a second image processing on the red, green and blue image information and the second image to obtain the second image depth information. 【第3項】[Item 3] 如申請專利範圍第2項所述之影像擷取裝置,其中該第一影像深度資訊包含複數個畫素,且每一該複數個畫素係具有一信心指數。The image capturing device of claim 2, wherein the first image depth information comprises a plurality of pixels, and each of the plurality of pixels has a confidence index. 【第4項】[Item 4] 如申請專利範圍第3項所述之影像擷取裝置,其中當該複數個畫素之一畫素之該信心指數大於等於一信心指數門檻值時,該畫素為一有效畫素,當該畫素之該信心指數小於該信心指數門檻值時,該畫素為一無效畫素。The image capturing device of claim 3, wherein when the confidence index of one of the plurality of pixels is greater than or equal to a confidence index threshold, the pixel is a valid pixel. When the confidence index of the pixel is less than the threshold of the confidence index, the pixel is an invalid pixel. 【第5項】[Item 5] 如申請專利範圍第4項所述之影像擷取裝置,其中當該複數個畫素中具有該有效畫素佔該複數個畫素之比例小於一有效畫素比例門檻值時,該處理單元判斷該第一影像深度係符合該切換條件。The image capturing device of claim 4, wherein the processing unit determines when the ratio of the effective pixels to the plurality of pixels is less than a threshold of the effective pixel ratio. The first image depth conforms to the switching condition. 【第6項】[Item 6] 如申請專利範圍第2項所述之影像擷取裝置,其中當該處理單元判斷該第一影像深度資訊不符合該切換條件時,該處理單元係對持續所擷取到之該第一影像取出該紅外線影像資訊,並對該紅外線影像資訊進行該第一影像處理以取得該第一影像深度資訊。The image capturing device of claim 2, wherein when the processing unit determines that the first image depth information does not meet the switching condition, the processing unit extracts the first image captured continuously The infrared image information is subjected to the first image processing on the infrared image information to obtain the first image depth information. 【第7項】[Item 7] 如申請專利範圍第1項所述之影像擷取裝置,其中該紅綠藍及紅外線影像擷取單元與該紅綠藍影像擷取單元之間之距離係小於3公分,該紅外線發光單元與該紅綠藍及紅外線影像擷取單元之間之距離係大於7公分。The image capturing device of claim 1, wherein the distance between the red, green, and infrared image capturing unit and the red, green, and blue image capturing unit is less than 3 cm, and the infrared light emitting unit and the infrared light emitting unit The distance between the red, green and infrared image capturing units is greater than 7 cm.
TW103218965U 2014-10-27 2014-10-27 Image acquisition device TWM499621U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW103218965U TWM499621U (en) 2014-10-27 2014-10-27 Image acquisition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW103218965U TWM499621U (en) 2014-10-27 2014-10-27 Image acquisition device

Publications (1)

Publication Number Publication Date
TWM499621U true TWM499621U (en) 2015-04-21

Family

ID=53441374

Family Applications (1)

Application Number Title Priority Date Filing Date
TW103218965U TWM499621U (en) 2014-10-27 2014-10-27 Image acquisition device

Country Status (1)

Country Link
TW (1) TWM499621U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI651578B (en) * 2016-11-08 2019-02-21 聚晶半導體股份有限公司 Image capturing device
CN111381599A (en) * 2018-12-28 2020-07-07 中强光电股份有限公司 Unmanned aerial vehicle obstacle avoidance system and control method thereof

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI651578B (en) * 2016-11-08 2019-02-21 聚晶半導體股份有限公司 Image capturing device
CN111381599A (en) * 2018-12-28 2020-07-07 中强光电股份有限公司 Unmanned aerial vehicle obstacle avoidance system and control method thereof

Similar Documents

Publication Publication Date Title
CN107534751B (en) Display apparatus and image display method thereof
US9036943B1 (en) Cloud-based image improvement
JP6219017B2 (en) OLED display device with light detection function
US8937646B1 (en) Stereo imaging using disparate imaging devices
TWI661725B (en) Camera temperature compensating system and smart terminal employing same
CN109804622B (en) Recoloring of infrared image streams
CN107113415A (en) The method and apparatus for obtaining and merging for many technology depth maps
KR20090063679A (en) Image display apparatus having pointing function and method thereof
CN102063231A (en) Non-contact electronic whiteboard system and detection method based on image detection
US20120038592A1 (en) Input/output device and human-machine interaction system and method thereof
TWI637288B (en) Image processing method and system for eye-gaze correction
CN103501413A (en) Method and system for controlling post camera to focus and take pictures with front camera
TW201351210A (en) Operating area determination method and system
US10447998B2 (en) Power efficient long range depth sensing
US11641528B2 (en) Method and apparatus for partial correction of images
CN106840034A (en) 3 D scanning system and its application with the speckle projector
KR101772820B1 (en) Method for generating a thermal image and electronic device performing the same
TWM499621U (en) Image acquisition device
US9838615B2 (en) Image editing method and electronic device using the same
US20140098184A1 (en) Imaging device and method
TWI330099B (en)
CN105635718A (en) Image capture device
CN111182208A (en) Photographing method and device, storage medium and electronic equipment
CN106846242A (en) The less efficient image method for registering in overlapping region is directed in a kind of video-splicing
CN103888674A (en) Image acquisition device and method

Legal Events

Date Code Title Description
MM4K Annulment or lapse of a utility model due to non-payment of fees