TWI821348B - Automatic optical detection system for measuring a hole-like structure - Google Patents

Automatic optical detection system for measuring a hole-like structure Download PDF

Info

Publication number
TWI821348B
TWI821348B TW108127400A TW108127400A TWI821348B TW I821348 B TWI821348 B TW I821348B TW 108127400 A TW108127400 A TW 108127400A TW 108127400 A TW108127400 A TW 108127400A TW I821348 B TWI821348 B TW I821348B
Authority
TW
Taiwan
Prior art keywords
hole
light source
image
area
automatic optical
Prior art date
Application number
TW108127400A
Other languages
Chinese (zh)
Other versions
TW202107038A (en
Inventor
鄒嘉駿
林伯聰
黃冠勳
張勛豪
Original Assignee
由田新技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 由田新技股份有限公司 filed Critical 由田新技股份有限公司
Priority to TW108127400A priority Critical patent/TWI821348B/en
Priority to CN202010042222.5A priority patent/CN111521614B/en
Publication of TW202107038A publication Critical patent/TW202107038A/en
Application granted granted Critical
Publication of TWI821348B publication Critical patent/TWI821348B/en

Links

Images

Landscapes

  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Cylinder Crankcases Of Internal Combustion Engines (AREA)
  • Testing Of Optical Devices Or Fibers (AREA)

Abstract

The present invention provides an automatic optical detection system for measuring a hole-like structure, comprising a light source device, a telecentric lens camera, and an image processing device. The light source device provides a hole-like structure to an object, wherein the hole structure includes a wall characteristic region and a flat characteristic region. The telecentric lens camera faces the hole-like structure for obtaining an undistorted image of the hole-like structure. The image processing device detects the wall characteristic region and the flat characteristic region on the hole-like structure image according to the difference in image characteristics of the undistorted image.

Description

量測孔狀結構的自動光學檢測系統Automatic optical inspection system for measuring hole-like structures

本發明係有關於一種自動光學檢測系統,特別是指一種量測孔狀結構的自動光學檢測系統。The present invention relates to an automatic optical detection system, in particular to an automatic optical detection system for measuring hole-like structures.

自動光學檢查(Automated Optical Inspection, AOI),係運用機器視覺做為檢測標準技術,透過機器視覺取代傳統人眼辨識以達到高精密度及高效率的檢測,作為改良傳統上以人力使用光學儀器進行檢測的缺點,應用層面包括從高科技產業之研發、製造品管、國防、民生、醫療、環保、電力等領域。Automated Optical Inspection (AOI) uses machine vision as the standard inspection technology. It uses machine vision to replace traditional human eye recognition to achieve high-precision and efficient inspection. As an improvement, it is traditionally performed manually using optical instruments. The application level of detecting shortcomings includes research and development, manufacturing quality control, national defense, people's livelihood, medical care, environmental protection, electric power and other fields in high-tech industries.

在光學檢測領域中,複雜表面的檢測相對平滑表面較為困難,針對平面不可視的缺陷(例如盲孔、穿孔的內側壁面缺陷),難以由傳統的光學方式(例如平面拍攝)進行檢測,這類的缺陷通常需要針對影像擷取裝置的相對位置及拍攝角度進行調整,且必須針對每一個目標區域逐一進行拍攝,以致於在進行這類的檢測時非常的耗時耗功,難以達到相應的效率。In the field of optical inspection, it is more difficult to detect complex surfaces than smooth surfaces. It is difficult to detect defects that are not visible on the plane (such as blind holes and inner wall defects of perforations) using traditional optical methods (such as plane shooting). Defects usually require adjustments to the relative position and shooting angle of the image capture device, and each target area must be photographed one by one, making this type of inspection very time-consuming and power-consuming, making it difficult to achieve corresponding efficiency.

本發明的主要目的,在於提供一種透過雙色效應量測孔狀結構的自動光學檢測系統,包括一光源裝置、一遠心鏡頭攝影機、以及一影像處理裝置。該光源裝置提供至一待測物的一孔狀結構,其中該孔狀結構包括一壁特性區域與一面特性區域。該遠心鏡頭攝影機朝向該孔狀結構,用以獲得孔狀結構的影像,其中該遠心鏡頭攝影機具有一收光錐角。該影像處理裝置根據該孔狀結構的影像的影像特徵差異,判斷該孔狀結構影像上的該壁特性區域與該面特性區域。The main purpose of the present invention is to provide an automatic optical inspection system for measuring hole-like structures through a two-color effect, which includes a light source device, a telecentric lens camera, and an image processing device. The light source device provides a hole-like structure to an object to be measured, wherein the hole-like structure includes a wall characteristic area and a surface characteristic area. The telecentric lens camera faces the hole-like structure to obtain an image of the hole-like structure, wherein the telecentric lens camera has a light collection cone angle. The image processing device determines the wall characteristic area and the surface characteristic area on the hole structure image based on the difference in image characteristics of the hole structure image.

本發明可以利用孔狀結構的面特性區域或壁特性區域的差異,透過調整鏡頭的數值孔徑,在影像上會產生不同的亮度差異,因此可以觀察出側壁與孔底/新生截面。This invention can make use of the difference in the surface characteristic area or wall characteristic area of the hole structure. By adjusting the numerical aperture of the lens, different brightness differences will be produced in the image, so the side wall and hole bottom/new cross-section can be observed.

本發明透過遠心鏡頭攝影機拍攝待測物孔狀結構的影像,用以獲得等倍率的孔狀結構的影像,避免拍攝孔狀結構時因距離不同產生的影像畸變的問題,降低演算的難度。This invention uses a telecentric lens camera to capture images of the hole-like structure of the object to be measured, so as to obtain images of the hole-like structure at equal magnifications, avoid image distortion problems caused by different distances when photographing the hole-like structure, and reduce the difficulty of calculations.

本發明透過遠心鏡頭攝影機拍攝待測物孔狀結構的影像時,可以解決待測物影像因視角因素導致的不對稱、以及待測物遠近造成放大倍率不一致的問題,藉此攝影機不管在左右上下拍攝都可以獲得一致的影像。When the present invention uses a telecentric lens camera to capture an image of the hole-like structure of the object to be measured, it can solve the problem of asymmetry in the image of the object to be measured due to viewing angle factors, as well as the inconsistency in magnification caused by the distance of the object to be measured. By doing this, the camera can be used regardless of whether it is left, right, up or down. You can get consistent images every time you shoot.

有關本發明之詳細說明及技術內容,現就配合圖式說明如下。再者,本發明中之圖式,為說明方便,其比例未必照實際比例繪製,該等圖式及其比例並非用以限制本發明之範圍,在此先行敘明。The detailed description and technical content of the present invention are described below with reference to the drawings. Furthermore, for the convenience of explanation, the proportions of the drawings in the present invention may not be drawn according to the actual proportions. The drawings and their proportions are not intended to limit the scope of the present invention and are explained here.

以下係舉一具體實施例就本發明的技術內容提出詳細的說明,請參閱「圖1」,為本發明中自動光學檢測系統的方塊示意圖。 The following is a detailed description of the technical content of the present invention using a specific embodiment. Please refer to "Figure 1", which is a block diagram of the automatic optical detection system in the present invention.

本實施例係提供一種自動光學檢測系統100,該自動光學檢測系統主要包括光源裝置10、遠心鏡頭攝影機20、以及影像處理裝置30。 This embodiment provides an automatic optical detection system 100 , which mainly includes a light source device 10 , a telecentric lens camera 20 , and an image processing device 30 .

所述的光源裝置10用以產生一光源,以提供至待測物P的孔狀結構H,其中該孔狀結構H包括至少一壁特性區域H1與至少一面特性區域H2(如圖4所示)。根據光源裝置10以及遠心鏡頭攝影機20的收光錐角/數值孔徑的配合,可以凸顯影像中壁特性區域H1與面特性區域H2之間的影像特徵差異。該面特性區域H2例如包含該孔狀結構H的一孔底區域及/或一新生截面區域。孔底區域為孔狀結構H中的底側平面,新生截面區域則為壁特性區域H1或面特性區域H2上各類瑕疵所造成與側壁結構不同的區域(例如不規則、或傾斜角度不同)。於一實施例中,該光源裝置10包含一提供至該孔狀結構H的具準直特性光源11及/或一具漫射特性光源22(如圖2~3所述),於本發明中不予以限制。於一可行的實施態樣中,該孔狀結構可以為盲孔或通孔,於本發明中不予以限制。 The light source device 10 is used to generate a light source to provide the hole-like structure H of the object to be measured P, wherein the hole-like structure H includes at least one wall characteristic area H1 and at least one surface characteristic area H2 (as shown in FIG. 4 ). According to the cooperation of the light collection cone angle/numerical aperture of the light source device 10 and the telecentric lens camera 20 , the difference in image characteristics between the wall characteristic area H1 and the surface characteristic area H2 in the image can be highlighted. The surface characteristic region H2 includes, for example, a hole bottom region and/or a new cross-section region of the hole-like structure H. The hole bottom area is the bottom plane in the hole structure H, and the new cross-section area is the area that is different from the side wall structure (such as irregularity or different inclination angles) caused by various defects in the wall characteristic area H1 or surface characteristic area H2. . In one embodiment, the light source device 10 includes a light source 11 with collimating characteristics and/or a light source 22 with diffusing characteristics provided to the hole structure H (as shown in Figures 2 to 3). In the present invention Not restricted. In a feasible implementation, the hole-like structure can be a blind hole or a through hole, which is not limited in the present invention.

所述的遠心鏡頭攝影機20朝向該孔狀結構H用以獲得孔狀結構H的影像。於一具體實施例中,該遠心鏡頭攝影機20係包括有一遠心鏡頭21(Telecentric lens)、以及一與該遠心鏡頭21連接之感光元件22。其中該遠心鏡頭21係影像擷取物件,並於於感光元件22上成像。於較佳實施例,包含但不限於,感光元件22為光電耦合元件(CCD)或互補金屬氧化物半導體(CMOS)等裝置。於一較佳實施態樣中,該待測物P包括印刷電路板,其中該遠心鏡頭攝影機20的收光錐角/數值孔徑係可由人員或系統調整。透過遠心鏡頭攝影機20解決待測物影像因視角因素導致的不對稱、以及待測物P遠近造成放大倍率不一致的問題,藉此讓攝影機不管在左右上下任何位置拍攝都可以獲得一致的影像,使實際圖像與預期圖像變化率縮減至最低,讓所拍攝到的圖像容易正規化。 The telecentric lens camera 20 is directed toward the hole structure H to obtain an image of the hole structure H. In a specific embodiment, the telecentric lens camera 20 includes a telecentric lens 21 and a photosensitive element 22 connected to the telecentric lens 21 . The telecentric lens 21 is an image capturing object and forms an image on the photosensitive element 22 . In preferred embodiments, including but not limited to, the photosensitive element 22 is a photocoupling device (CCD) or a complementary metal oxide semiconductor (CMOS) device. In a preferred embodiment, the object P includes a printed circuit board, in which the light-collecting cone angle/numerical aperture of the telecentric lens camera 20 can be adjusted by personnel or the system. The telecentric lens camera 20 solves the problem of asymmetry in the image of the object to be measured due to angle of view factors, as well as the inconsistency in magnification caused by the distance of the object to be measured P. This allows the camera to obtain consistent images regardless of whether it is shooting at any position, left, right, up or down. The change rate between the actual image and the expected image is reduced to a minimum, making it easy to normalize the captured image.

該待測物P,包含但不限於可為具有一個或多個孔狀結構H的工件,例如可為具有多個盲孔或通孔的平面工件,於本發明中不予以限制。 The object P to be tested includes, but is not limited to, a workpiece having one or more hole-like structures H, such as a planar workpiece having multiple blind holes or through holes, which is not limited in the present invention.

所述的影像處理裝置30連接至該遠心鏡頭攝影機20,根據該孔狀結構H的影像的影像特徵差異,判斷該孔狀結構H影像上的該壁特性區域H1與該面特性區域H2。於一較佳實施例中,包含但不限於,該影像處理裝置30根據該影像特徵差異,判斷該孔狀結構H的影像上的該壁特性區域H1的面積與位置,以及該面特性區域H2的面積與位置,並依此產生一影像檢測結果。具體而言,該影像處理裝置30係可以載入儲存單元(圖未式)存取程式,並依據該程式執行影像分析的過程。具體而言,影像分析程式例如可以為影像前處理程式、影像分割與定位、缺陷偵測(梯度化、區域成長、成長補償等)、機器學習系統(Machine Learning)、深度學習系統(Deep Learning)等,於本發明中不予以限制。 The image processing device 30 is connected to the telecentric lens camera 20 and determines the wall characteristic area H1 and the surface characteristic area H2 on the image of the hole structure H based on the difference in image characteristics of the image of the hole structure H. In a preferred embodiment, including but not limited to, the image processing device 30 determines the area and position of the wall characteristic region H1 and the surface characteristic region H2 on the image of the hole-like structure H based on the image characteristic difference. area and position, and generate an image detection result accordingly. Specifically, the image processing device 30 can load the storage unit (not shown) access program and perform the image analysis process according to the program. Specifically, the image analysis program can be, for example, an image pre-processing program, image segmentation and positioning, defect detection (gradientization, region growth, growth compensation, etc.), machine learning system (Machine Learning), deep learning system (Deep Learning) etc., are not limited in the present invention.

於一較佳實施例中,包含但不限於,所述的影像特徵差異例如包括亮度特徵差異或/及色度特徵差異,該光源裝置10包含一具準直特性光源11及/或一具漫射特性光源12,透過提供不同特性的光源,於影像中可進一步產生亮度特徵差異,以區隔壁特性區域H1與面特性區域H2。於本案說明書中所謂的「具準直特性光源11」、「具漫射特性光源12」所指的是其光源的成分絕大部分具有準值性質或漫射性質的光源。於另一較佳實施例中,包含但不限於,該光源裝置10包含兩種或兩種以上具有不同光波長的光源(例如第一光源、一第二光源)。於影像中可進一步產生亮度特徵差異及色度特徵差異區隔壁特性區域H1與面特性區域H2。除上述的方式外,亦可以同時混合搭配不同特性及不同光波長的光源,進一步提升孔狀結構H的壁特性區域H1與面特性區域H2的影像特徵差異,於本發明中不予以限制。 In a preferred embodiment, including but not limited to, the image characteristic differences include, for example, brightness characteristic differences and/or chromaticity characteristic differences. The light source device 10 includes a light source 11 with collimation characteristics and/or a diffuse light source. The radiation characteristic light source 12 can further generate brightness characteristic differences in the image by providing light sources with different characteristics to distinguish the wall characteristic area H1 and the surface characteristic area H2. In the description of this case, the so-called "light source 11 with collimated characteristics" and "light source 12 with diffuse characteristics" refers to a light source in which most of the components of the light source have quasi-valued properties or diffuse properties. In another preferred embodiment, including but not limited to, the light source device 10 includes two or more light sources with different light wavelengths (such as a first light source and a second light source). In the image, the difference in brightness characteristics and the difference in chrominance characteristics can be further generated as partitions of the wall characteristic area H1 and the surface characteristic area H2. In addition to the above methods, light sources with different characteristics and different light wavelengths can also be mixed and matched at the same time to further enhance the difference in image characteristics between the wall characteristic area H1 and the surface characteristic area H2 of the hole-shaped structure H, which is not limited in the present invention.

所測量到的影像檢測結果包括孔口形狀檢測、孔底品質檢測、孔壁品質檢測、或孔底與孔壁連接處品質檢測,判斷該孔狀結構H是否出現該新 生截面區域、或判斷該新生截面區域的高度等。 The measured image inspection results include orifice shape inspection, hole bottom quality inspection, hole wall quality inspection, or hole bottom and hole wall connection quality inspection, to determine whether the new hole structure H appears. Create a new cross-section area, or determine the height of the new cross-section area, etc.

於一實施例中,請參閱「圖2」,係本發明第一實施例的外觀示意圖,如圖所示:該具準直特性光源11包括一發光單元111以及一分光鏡112,該發光單元111輸出準直光,該分光鏡112係設置於遠心鏡頭攝影機20的取像方向上,並具有一傾斜角(通常為45度角),以令該發光單元111送出的平行光轉折90度而與遠心鏡頭攝影機20同軸,該分光鏡112供部分光束穿過以令該遠心鏡頭攝影機20獲得孔狀結構H的影像。 In one embodiment, please refer to "Figure 2", which is a schematic diagram of the appearance of the first embodiment of the present invention. As shown in the figure: the light source 11 with collimation characteristics includes a light-emitting unit 111 and a beam splitter 112. The light-emitting unit 111 outputs collimated light. The beam splitter 112 is arranged in the imaging direction of the telecentric lens camera 20 and has an inclination angle (usually an angle of 45 degrees), so that the parallel light sent by the light-emitting unit 111 is turned 90 degrees. Coaxial with the telecentric lens camera 20 , the beam splitter 112 allows part of the light beam to pass through so that the telecentric lens camera 20 can obtain an image of the hole-shaped structure H.

具體而言,該具漫射特性光源12包括一個或多個發光單元121以及一燈罩122。該燈罩122設置於該發光單元121外側,其中為了輸出均光源至該孔狀結構H,該燈罩122的反射面具有漫反射結構或漫反射材料,用以提供該漫射光線至該孔狀結構H。於一較佳實施例中,包含但不限於,該燈罩122係為穹形燈罩,該穹形燈罩的反射面係具有漫反射結構或為漫反射材料,該發光單元121的光入射至該穹形燈罩後,經由該穹形燈罩反射至該孔狀結構H上。該漫反射結構例如可以為不均勻微結構,該漫反射材料例如可以為光擴散粉、擴散塑膠粒等等,於本發明中不予以限制。為了避免發光單元121直接照射至待測物P,該發光單元121係環設至該穹形燈罩外周緣朝向內側(反射面)的位置上。 Specifically, the light source 12 with diffusion characteristics includes one or more light-emitting units 121 and a lampshade 122 . The lampshade 122 is disposed outside the light-emitting unit 121. In order to output a uniform light source to the hole structure H, the reflective surface of the lampshade 122 has a diffuse reflection structure or diffuse reflection material to provide the diffuse light to the hole structure. H. In a preferred embodiment, including but not limited to, the lampshade 122 is a dome-shaped lampshade, the reflective surface of the dome-shaped lampshade has a diffuse reflection structure or is a diffuse reflection material, and the light of the light-emitting unit 121 is incident on the dome. After passing through the dome-shaped lampshade, it is reflected onto the hole-shaped structure H through the dome-shaped lampshade. The diffuse reflection structure can be, for example, a non-uniform microstructure, and the diffuse reflection material can be, for example, light diffusion powder, diffusion plastic particles, etc., which are not limited in the present invention. In order to prevent the light-emitting unit 121 from directly irradiating the object P, the light-emitting unit 121 is set at a position where the outer periphery of the dome-shaped lampshade faces inward (reflective surface).

於另一實施例中,請一併參閱「圖3」,係本發明第二實施例的外觀示意圖,如圖所示:該燈罩122除了可以為穹形燈罩外,亦可以經由其他的均等裝置取代。例如於一較佳實施例中,包含但不限於,該燈罩122亦可以為設置於該發光單元124外側的傾斜均光罩123,該傾斜均光罩123於發光單元124的出光面上係設置有均光板,並於該均光板上具有傾斜面,同樣亦可達到相同的均光效果。 In another embodiment, please also refer to "Fig. 3", which is a schematic diagram of the appearance of the second embodiment of the present invention. As shown in the figure: in addition to the dome-shaped lampshade, the lampshade 122 can also be provided by other equal devices. replace. For example, in a preferred embodiment, including but not limited to, the lampshade 122 can also be an inclined uniform light cover 123 provided outside the light-emitting unit 124, and the inclined uniform light cover 123 is provided on the light exit surface of the light-emitting unit 124. Having a homogenizing plate with an inclined surface on the homogenizing plate can also achieve the same homogenizing effect.

為了在影像處理中,凸顯孔狀結構H中壁特性區域H1與面特性區域H2之間的影像特徵差異,藉以進一步分離影像並凸顯缺陷,該準直光線與 該漫射光線的光波長不同。於一較佳實施例中,包含但不限於,例如底面及側壁的材料均為銅,此時該準直光線較佳可以為藍色光,該漫射光線較佳係可以為紅色光。在兩種光源的混光下,孔狀結構H的壁特性區域H1、面特性區域H2將分別由不同波長的光所凸顯而產生明顯的邊界(如圖3所示),影像處理裝置30可較容易擷取出影像中的缺陷。於一較佳實施例中,包含但不限於,該準直光線及漫射光線於波長上差距,包含但不限於,超過100nm以上,但實際上該波長的差距應視材料與實際應用而定。 In order to highlight the difference in image characteristics between the wall characteristic area H1 and the surface characteristic area H2 in the hole-like structure H during image processing, so as to further separate the image and highlight defects, the collimated light and The diffuse light has different light wavelengths. In a preferred embodiment, including but not limited to, for example, the materials of the bottom surface and side walls are copper. In this case, the collimated light is preferably blue light, and the diffuse light is preferably red light. Under the mixed light of the two light sources, the wall characteristic area H1 and the surface characteristic area H2 of the hole-shaped structure H will be highlighted by light of different wavelengths to produce obvious boundaries (as shown in Figure 3). The image processing device 30 can Easier to pick out defects in images. In a preferred embodiment, the difference in wavelength between the collimated light and the diffuse light includes, but is not limited to, more than 100 nm. However, in fact, the difference in wavelength should depend on the material and actual application. .

於一較佳實施例中,包含但不限於,透過以下的光源進行搭配,均可以有效的加強影像差異特徵,進一步於影像中區隔孔狀結構H的壁特性區域H1與面特性區域H2,以下表列示之:

Figure 108127400-A0305-02-0008-1
In a preferred embodiment, including but not limited to, the combination of the following light sources can effectively enhance the image difference characteristics, and further separate the wall characteristic area H1 and the surface characteristic area H2 of the hole-like structure H in the image, The following table lists them:
Figure 108127400-A0305-02-0008-1

請先一併參閱「圖4」至「圖7」,係為於一實施例,待測物孔狀結構的影像示意圖(一)、影像示意圖(二)、影像示意圖(三)、以及影像示意圖(四),如圖所示: Please refer to "Figure 4" to "Figure 7" together, which are schematic images (1), schematic images (2), schematic images (3), and schematic images of the pore structure of the object to be tested in one embodiment. (4), as shown in the figure:

如圖4所示,待測物為一電路板上的孔狀結構H,其可能因為電鍍不均而產生新生截面區域,造成孔洞的內側斷路。如圖4所示,可以看出當面特性區域H2(孔底區域)的範圍到達預設面積時,新生截面區域H3儼然已造成斷路,確認是否產生新生截面區域H3,可以透過測量孔底區域的面特性區域H2直徑,或是以疊圖影像處理將拍到的影像與良品的影像重疊後取得新生截面區域H3。As shown in Figure 4, the object to be tested is a hole-shaped structure H on a circuit board, which may produce a new cross-sectional area due to uneven plating, causing an open circuit inside the hole. As shown in Figure 4, it can be seen that when the range of the surface characteristic area H2 (the hole bottom area) reaches the preset area, the new cross-section area H3 seems to have caused an open circuit. To confirm whether the new cross-section area H3 is generated, you can measure the area at the bottom of the hole. The diameter of the surface characteristic area H2, or the new cross-sectional area H3 is obtained by overlapping the captured image with the image of the good product through overlay image processing.

另一種情況如圖5所示,孔狀結構H除了於孔底區域形成新生截面區域H3之外,缺陷亦可能形成於壁特性區域H1上而產生新生截面區域H4。新生截面區域H4由於與壁特性區域H1的角度不同,於影像中兩者具有差異特徵影像。In another situation, as shown in Figure 5, in addition to forming a new cross-sectional area H3 in the hole bottom area, defects may also be formed in the wall characteristic area H1 to generate a new cross-sectional area H4 in the hole-like structure H. Due to the different angles between the new cross-section area H4 and the wall characteristic area H1, the two have different characteristic images in the image.

又一種情況如圖6所示,如果新生截面區域H5僅形成於面特性區域H2的一側,而使得面特性區域H2為單側橢圓時,可判斷缺陷僅存在於一側的孔壁。是否構成斷路與新生截面區域的高度之間有正相關性,意即少鍍了多少銅的厚度,因此經由缺陷的高度,可預先確認斷路的可能性。In another situation, as shown in Figure 6, if the new cross-sectional area H5 is formed only on one side of the surface characteristic area H2, and the surface characteristic area H2 is a one-sided ellipse, it can be judged that the defect only exists on one side of the hole wall. There is a positive correlation between whether a break is formed and the height of the new cross-section area, which means how much copper thickness is missing. Therefore, the possibility of a break can be confirmed in advance through the height of the defect.

又一種情況如圖7所示,於孔狀結構H為通孔的情況下,可以看出於通孔底側的周圍將長出新生截面區域H6,可以透過與壁特性區域H1的影像差異特徵(例如預設面積或直徑等)確認斷路的可能性。Another situation is shown in Figure 7. When the hole structure H is a through hole, it can be seen that a new cross-sectional area H6 will grow around the bottom side of the through hole, and the image difference characteristics with the wall characteristic area H1 can be seen through (such as preset area or diameter, etc.) to confirm the possibility of circuit breakage.

有關於缺陷高度的取得方式,請一併參閱「圖8」,係為孔狀結構的局部放大示意圖。Regarding how to obtain the defect height, please also refer to "Figure 8", which is a partially enlarged schematic diagram of the hole-like structure.

為了計算取得缺陷於實際空間中的高度,取像視角及影像中孔壁的傾斜度必須一併考量修正,始能透過影像中缺陷的長度經由計算後獲得正確的高度。In order to calculate the height of the defect in the actual space, the imaging angle and the inclination of the hole wall in the image must be considered and corrected together, so that the correct height can be obtained through calculation of the length of the defect in the image.

就已知的條件中,孔內側壁的傾斜角度是固定的(預期是固定的),在拍攝影像後經由計算可獲得影像中新生截面區域的長度。由於遠心鏡頭所拍攝到的影像可以省略經由攝影機視角所產生的視角因素。因此於運算起始,吾人可以預期先得到二組參數:孔壁傾斜角度、以及孔壁與孔底之間的新生截面區域長度Under the known conditions, the inclination angle of the inner wall of the hole is fixed (expected to be fixed), and the length of the new cross-sectional area in the image can be obtained by calculation after taking the image. Because the image captured by the telecentric lens can omit the perspective factor caused by the camera's perspective. Therefore, at the beginning of the operation, we can expect to obtain two sets of parameters: the hole wall inclination angle , and the length of the new cross-sectional area between the hole wall and the hole bottom .

由於在計算初始時,孔壁傾斜角度是確定的,經由三角函數轉換的關係,可以確定新生截面區域長度將與新生截面區域高度呈現固定的三角比例關係,符合下列的簡式:Since in the initial calculation, the hole wall inclination angle is determined. Through the relationship of trigonometric function conversion, the length of the new cross-section area can be determined. will be the same as the height of the new section area It presents a fixed triangular proportion relationship and conforms to the following simplified formula: ;

新生截面區域高度,經由孔壁傾斜角度、以及新生截面區域長度兩組參數便可以簡單獲得,簡式轉換如下:New section area height , via the inclination angle of the hole wall , and the length of the new cross-section area Two sets of parameters can be easily obtained, and the simplified conversion is as follows: ;

在上述方程式中,將可以獲得新生截面區域高度GPH,經由新生截面區域高度GPH可以預先確認斷路的可能性。In the above equation, the new cross-sectional area height GPH will be obtained, and the possibility of circuit breakage can be confirmed in advance through the new cross-sectional area height GPH.

除了獲得新生截面區域高度GPH外,於另一實施例中,經由影像分析的結果,該影像檢測結果可以更進一步包括孔壁缺陷寬度、以及鍍金不連續尺寸等。In addition to obtaining the height GPH of the new cross-sectional area, in another embodiment, through the results of image analysis, the image detection results can further include the width of hole wall defects, the size of gold plating discontinuities, etc.

該影像處理裝置30除了可以依據上述的方式獲得該新生截面區域高度GPH外,如圖4-7所示,尚可以獲得例如包括新生截面區域總體寬度GPW或新生截面區域總體長度GPL、該壁特性區域的面積H1A與位置,以及該面特性區域的面積H2A與位置等。In addition to obtaining the new cross-sectional area height GPH according to the above method, as shown in Figures 4-7, the image processing device 30 can also obtain, for example, the overall width of the new cross-section area GPW or the overall length of the new cross-section area GPL, and the wall characteristics. The area H1A and position of the region, and the area H2A and position of the surface characteristic region, etc.

綜上所述,本發明利用孔狀結構的面特性區域或壁特性區域的差異,根據攝影機鏡頭的收光錐角/數值孔徑的調整,在影像上會產生不同的亮度差異,因此可以觀察出側壁與孔底/新生截面。To sum up, the present invention uses the difference in the surface characteristic area or wall characteristic area of the hole structure to produce different brightness differences in the image according to the adjustment of the light collection cone angle/numerical aperture of the camera lens, so it can be observed Side wall and hole bottom/new section.

以上已將本發明做一詳細說明,惟以上所述者,僅為本發明之一實施例而已,當不能以此限定本發明實施之範圍,即凡依本發明申請專利範圍所作之均等變化與修飾,皆應仍屬本發明之專利涵蓋範圍內。The present invention has been described in detail above. However, the above description is only an embodiment of the present invention. It should not be used to limit the scope of the present invention. That is, any equal changes made according to the scope of the patent application of the present invention and Modifications should still fall within the scope of the patent of the present invention.

100:自動光學檢測系統 10:光源裝置 11:具準直特性光源 111:發光單元 112:分光鏡 12:具漫射特性光源 121:發光單元 122:燈罩 123:傾斜均光罩 124:發光單元 20:遠心鏡頭攝影機 21:遠心鏡頭 22:感光元件 30:影像處理裝置 P:待測物 H:孔狀結構 H1:壁特性區域 H1A:壁特性區域的面積 H2:面特性區域 H2A:面特性區域的面積 H3:新生截面區域 H4:新生截面區域 H5:新生截面區域 H6:新生截面區域:孔壁傾斜角度:新生截面區域長度:新生截面區域高度 GPW:新生截面區域總體寬度 GPL:新生截面區域總體長度100: Automatic optical detection system 10: Light source device 11: Light source with collimation characteristics 111: Light-emitting unit 112: Beam splitter 12: Light source with diffusion characteristics 121: Light-emitting unit 122: Lampshade 123: Inclined uniform light cover 124: Light-emitting unit 20 : Telecentric lens camera 21: Telecentric lens 22: Photosensitive element 30: Image processing device P: Object to be measured H: Hole structure H1: Wall characteristic area H1A: Area of wall characteristic area H2: Surface characteristic area H2A: Surface characteristic area Area H3: New cross-section area H4: New cross-section area H5: New cross-section area H6: New cross-section area :hole wall inclination angle :Length of new section area :height of new cross-section area GPW:overall width of new cross-section areaGPL:overall length of new cross-section area

圖1,為本發明中自動光學檢測系統的方塊示意圖。Figure 1 is a block diagram of the automatic optical detection system in the present invention.

圖2,為本發明中第一實施例的外觀示意圖。Figure 2 is a schematic diagram of the appearance of the first embodiment of the present invention.

圖3,為本發明中第二實施例的外觀示意圖。Figure 3 is a schematic diagram of the appearance of the second embodiment of the present invention.

圖4,為待測物孔狀結構的影像示意圖(一)。Figure 4 is a schematic image of the pore structure of the object to be tested (1).

圖5,為待測物孔狀結構的影像示意圖(二)。Figure 5 is a schematic image (2) of the pore structure of the object to be tested.

圖6,為待測物孔狀結構的影像示意圖(三)。Figure 6 is a schematic image (3) of the pore structure of the object to be tested.

圖7,為待測物孔狀結構的影像示意圖(四)。Figure 7 is a schematic image (4) of the pore structure of the object to be tested.

圖8,為孔狀結構的局部放大示意圖。Figure 8 is a partial enlarged schematic diagram of the hole-like structure.

100:自動光學檢測系統 100:Automatic optical inspection system

10:光源裝置 10:Light source device

20:遠心鏡頭攝影機 20:Telecentric lens camera

21:遠心鏡頭 21: Telecentric lens

22:感光元件 22: Photosensitive element

30:影像處理裝置 30:Image processing device

P:待測物 P: Test object

H:孔狀結構 H: Porous structure

Claims (16)

一種量測孔狀結構的自動光學檢測系統,包括:一光源裝置,提供至一待測物的一孔狀結構,其中該孔狀結構包括一壁特性區域與一面特性區域,該光源裝置包含一第一光源與一第二光源,其中該第一光源與該第二光源具有不同的光波長;其中該第一光源,用以提供至該孔狀結構,使該面特性區域呈現該影像特徵差異;其中該第二光源,用以提供至該孔狀結構,使該壁特性區域呈現該影像特徵差異;一遠心鏡頭攝影機,朝向該孔狀結構,用以獲得該孔狀結構的影像,其中該遠心鏡頭攝影機具有一收光錐角;以及一影像處理裝置,根據該孔狀結構的影像的一影像特徵差異,判斷該孔狀結構影像上的該壁特性區域與該面特性區域。 An automatic optical inspection system for measuring hole-like structures, including: a light source device, which is provided to a hole-like structure of an object to be measured, wherein the hole-like structure includes a wall characteristic area and a surface characteristic area, and the light source device includes a A first light source and a second light source, wherein the first light source and the second light source have different light wavelengths; wherein the first light source is used to provide to the hole-like structure so that the surface characteristic area exhibits the image characteristic difference. ; wherein the second light source is used to provide to the hole-like structure, so that the wall characteristic area presents the image characteristic difference; a telecentric lens camera is directed toward the hole-like structure, used to obtain an image of the hole-like structure, wherein the The telecentric lens camera has a light collection cone angle; and an image processing device that determines the wall characteristic area and the surface characteristic area on the hole structure image based on an image characteristic difference of the hole structure image. 如申請專利範圍第1項所述的自動光學檢測系統,其中該影像特徵差異包括一亮度特徵差異。 For the automatic optical detection system described in item 1 of the patent application, the image feature difference includes a brightness feature difference. 如申請專利範圍第1項所述的自動光學檢測系統,其中該光源裝置包含一具準直特性光源及/或一具漫射特性光源,提供至該孔狀結構。 For the automatic optical inspection system described in item 1 of the patent application, the light source device includes a light source with collimating characteristics and/or a light source with diffusing characteristics, which is provided to the hole-like structure. 如申請專利範圍第3項所述的自動光學檢測系統,其中該具準直 特性光源或該具漫射特性光源包含白色光源、藍色光源、紅色光源。 The automatic optical detection system as described in item 3 of the patent application scope, wherein the collimator The characteristic light source or the diffuse characteristic light source includes a white light source, a blue light source, and a red light source. 如申請專利範圍第3項所述的自動光學檢測系統,其中該具準直特性光源用以提供具準直特性光至該孔狀結構,使該面特性區域呈現該影像特徵差異。 For the automatic optical detection system described in item 3 of the patent application, the light source with collimating characteristics is used to provide light with collimating characteristics to the hole-like structure, so that the surface characteristic area presents the image characteristic difference. 如申請專利範圍第3項所述的自動光學檢測系統,其中該具漫射特性光源用以提供具漫射特性光至該孔狀結構,使該壁特性區域呈現該影像特徵差異。 For the automatic optical detection system described in item 3 of the patent application, the light source with diffuse characteristics is used to provide light with diffuse characteristics to the hole structure, so that the wall characteristic area presents the image characteristic difference. 如申請專利範圍第3項所述的自動光學檢測系統,其中該具漫射特性光源包括:一個或多個發光單元;以及一燈罩,設置於該發光單元外側,其中該燈罩的反射面具有漫反射結構或漫反射材料。 The automatic optical detection system as described in item 3 of the patent application, wherein the light source with diffuse characteristics includes: one or more light-emitting units; and a lampshade, which is arranged outside the light-emitting unit, wherein the reflective surface of the lampshade has diffuse Reflective structures or diffuse reflective materials. 如申請專利範圍第1項所述的自動光學檢測系統,其中該第一光源或該第二光源包含白色光源、藍色光源、紅色光源。 The automatic optical detection system as described in item 1 of the patent application, wherein the first light source or the second light source includes a white light source, a blue light source, and a red light source. 如申請專利範圍第8項所述的自動光學檢測系統,其中該影像特徵差異包括亮度特徵差異及色度特徵差異。 For the automatic optical detection system described in item 8 of the patent application, the difference in image characteristics includes differences in brightness characteristics and differences in chromaticity characteristics. 如申請專利範圍第1項所述的自動光學檢測系統,其中該影像處理裝置根據該影像特徵差異,判斷該孔狀結構影像上的該壁特性區域的面積與位置、以及該面特性區域的面積與位置。 The automatic optical inspection system as described in item 1 of the patent application, wherein the image processing device determines the area and position of the wall characteristic area on the hole-like structure image and the area of the surface characteristic area based on the difference in image characteristics. and location. 如申請專利範圍第1項所述的自動光學檢測系統,其中該影像處理裝置根據該面特性區域的面積與位置以及該壁特性區域的面積與位置進行影像檢測,進一步產生一影像檢測結果。 As for the automatic optical detection system described in item 1 of the patent application, the image processing device performs image detection based on the area and position of the surface characteristic area and the area and position of the wall characteristic area, and further generates an image detection result. 如申請專利範圍第11項所述的自動光學檢測系統,其中該影像檢測結果包括孔口形狀檢測、孔底品質檢測、孔壁品質檢測、或孔底與孔壁連接處品質檢測。 For example, in the automatic optical inspection system described in item 11 of the patent application, the image inspection results include orifice shape inspection, hole bottom quality inspection, hole wall quality inspection, or hole bottom and hole wall connection quality inspection. 如申請專利範圍第11項所述的自動光學檢測系統,其中該面特性區域包含該孔狀結構的一孔底區域及/或一新生截面區域。 As for the automatic optical inspection system described in item 11 of the patent application, the surface characteristic area includes a hole bottom area and/or a new cross-section area of the hole-like structure. 如申請專利範圍第13項所述的自動光學檢測系統,其中該影像檢測結果包含判斷該孔狀結構是否出現該新生截面區域。 For the automatic optical inspection system described in Item 13 of the patent application, the image inspection result includes determining whether the new cross-sectional area appears in the hole-like structure. 如申請專利範圍第13項所述的自動光學檢測系統,其中該影像檢測結果包含判斷該新生截面區域的高度。 For the automatic optical detection system described in Item 13 of the patent application, the image detection result includes determining the height of the new cross-sectional area. 如申請專利範圍第13項所述的自動光學檢測系統,其中該待測物係為印刷電路板。 For the automatic optical inspection system described in item 13 of the patent application, the object to be tested is a printed circuit board.
TW108127400A 2019-02-01 2019-08-01 Automatic optical detection system for measuring a hole-like structure TWI821348B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW108127400A TWI821348B (en) 2019-08-01 2019-08-01 Automatic optical detection system for measuring a hole-like structure
CN202010042222.5A CN111521614B (en) 2019-02-01 2020-01-15 Automatic optical detection system for measuring hole-shaped structure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW108127400A TWI821348B (en) 2019-08-01 2019-08-01 Automatic optical detection system for measuring a hole-like structure

Publications (2)

Publication Number Publication Date
TW202107038A TW202107038A (en) 2021-02-16
TWI821348B true TWI821348B (en) 2023-11-11

Family

ID=75745443

Family Applications (1)

Application Number Title Priority Date Filing Date
TW108127400A TWI821348B (en) 2019-02-01 2019-08-01 Automatic optical detection system for measuring a hole-like structure

Country Status (1)

Country Link
TW (1) TWI821348B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0459489A2 (en) * 1990-05-30 1991-12-04 Dainippon Screen Mfg. Co., Ltd. Method of reading optical image of inspected surface and image reading system employable therein
US6486965B1 (en) * 1999-05-25 2002-11-26 Hyundai Electronics Industries Co., Ltd. Apparatus for measuring depth and gradient of trench in semiconductor device and method thereof
US6697154B2 (en) * 1999-05-14 2004-02-24 Mv Research Limited Microvia inspection system
JP2007127486A (en) * 2005-11-02 2007-05-24 Cabin Industrial Co Ltd Through hole wall surface defect inspection device of printed board
US8699037B2 (en) * 2010-10-15 2014-04-15 Rolls-Royce Plc Hole inspection
CN102892223B (en) * 2011-07-21 2016-08-17 罗姆股份有限公司 Illuminator

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0459489A2 (en) * 1990-05-30 1991-12-04 Dainippon Screen Mfg. Co., Ltd. Method of reading optical image of inspected surface and image reading system employable therein
US6697154B2 (en) * 1999-05-14 2004-02-24 Mv Research Limited Microvia inspection system
US6486965B1 (en) * 1999-05-25 2002-11-26 Hyundai Electronics Industries Co., Ltd. Apparatus for measuring depth and gradient of trench in semiconductor device and method thereof
JP2007127486A (en) * 2005-11-02 2007-05-24 Cabin Industrial Co Ltd Through hole wall surface defect inspection device of printed board
US8699037B2 (en) * 2010-10-15 2014-04-15 Rolls-Royce Plc Hole inspection
CN102892223B (en) * 2011-07-21 2016-08-17 罗姆股份有限公司 Illuminator

Also Published As

Publication number Publication date
TW202107038A (en) 2021-02-16

Similar Documents

Publication Publication Date Title
US20150253129A1 (en) Inspection apparatus
JP5895305B2 (en) Inspection illumination device and inspection illumination method
JP5862522B2 (en) Inspection device
JP2007171149A (en) Surface defect inspection device
US10012596B2 (en) Appearance inspection apparatus and appearance inspection method
JP6487617B2 (en) Defect inspection method and defect inspection apparatus for microlens array
JP2015155895A (en) Device and method for inspecting material having coated surface
CN106415247A (en) Illuminating device for inspection, and inspection system
TWI724370B (en) An automatic optical inspection system, and method for measuring a hole structure
KR101211438B1 (en) Apparatus for inspecting defects
JP5580121B2 (en) Board inspection equipment
TWI821348B (en) Automatic optical detection system for measuring a hole-like structure
JP6546079B2 (en) Appearance inspection apparatus and appearance inspection method
JP6829828B2 (en) Lens appearance inspection device
TWI711816B (en) System and method for inspecting object
JP7175214B2 (en) inspection equipment
CN111521614B (en) Automatic optical detection system for measuring hole-shaped structure
JP2018040761A (en) Device for inspecting appearance of inspection target object
WO2019117802A1 (en) A system for obtaining 3d images of objects and a process thereof
TWI721720B (en) Light source device and optical inspection system
TWI289662B (en) The defect testing apparatus for testing the backside of glass substrate
JP7251559B2 (en) Information processing equipment
JP2004125644A (en) Dome shape indirect illumination apparatus and pattern image pickup method
JP2016118518A (en) Appearance inspection device
TWI694251B (en) Method for detecting a stitching aluminum foil of aluminum electrolytic capacitors