TWI499999B - The 3D ring car image system based on probability calculation and its obtaining method - Google Patents

The 3D ring car image system based on probability calculation and its obtaining method Download PDF

Info

Publication number
TWI499999B
TWI499999B TW103111349A TW103111349A TWI499999B TW I499999 B TWI499999 B TW I499999B TW 103111349 A TW103111349 A TW 103111349A TW 103111349 A TW103111349 A TW 103111349A TW I499999 B TWI499999 B TW I499999B
Authority
TW
Taiwan
Prior art keywords
bird
image
eye view
vehicle
loop
Prior art date
Application number
TW103111349A
Other languages
Chinese (zh)
Other versions
TW201537510A (en
Inventor
Chih Yung Chen
Hsin Han Tsai
Ching Ju Chien
Jen Kai Liu
Original Assignee
Univ Shu Te
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Shu Te filed Critical Univ Shu Te
Priority to TW103111349A priority Critical patent/TWI499999B/en
Application granted granted Critical
Publication of TWI499999B publication Critical patent/TWI499999B/en
Publication of TW201537510A publication Critical patent/TW201537510A/en

Links

Landscapes

  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Description

以機率方式計算為基礎之3D環車影像系統及其獲得方法 3D ring car image system based on probability calculation and its obtaining method

本發明係一種3D環車影像,特別係有關於利用改良式機率神經網路架構進行演算以得到3D環車影像。 The invention relates to a 3D loop car image, in particular to a calculation using a modified probability neural network architecture to obtain a 3D loop image.

先進駕駛輔助系統已成為世界各國重要且急迫的研究課題之一。根據調查2014年全球汽車出貨量上看8500萬輛,車用視訊安全輔助產品安裝率將上看6,300萬套。在車輛安全領域中,運用機器視覺取得環境影像資訊,在行徑間或倒車時分析路面狀況及車輛四周環境,以做到各種最佳化的動態反應效果,這也是視覺式智慧型運輸系統(Vision-based intelligent transportation system)的發展目標。 Advanced driver assistance systems have become one of the most important and urgent research topics in the world. According to the survey, the global car shipments in 2014 will be 85 million, and the installation rate of video security products will be 63 million. In the field of vehicle safety, machine vision is used to obtain environmental image information, and the road condition and the surrounding environment of the vehicle are analyzed during the path or between the vehicles to achieve various optimal dynamic response effects. This is also a visual intelligent transportation system (Vision). -based intelligent transportation system) development goals.

早期停車輔助系統常採用超音波或攝影鏡頭,採用聲音報警或顯示車輛後方攝像頭視訊的方式,幫助駕駛人判斷盲角處車輛與障礙物距離。採用超音波警報方式,距離的提示並不直觀,無法準確判定實際障礙物距離。採用後置攝影機的方式,傳統的車用影像監控系統受到攝影機取像範圍的限制,車用顯示器所呈現之畫面往往無法有效涵蓋車輛四周監控範圍,因此只能針對車輛後方或車輛兩側發展不同的盲點監控顯示。 Early parking assistance systems often use ultrasonic or photographic lenses, using audible alarms or displaying camera images behind the vehicle to help the driver determine the distance between the vehicle and the obstacle at the blind corner. With the ultrasonic alarm method, the distance indication is not intuitive and the actual obstacle distance cannot be accurately determined. With the rear camera, the traditional vehicle image monitoring system is limited by the camera's image capturing range. The image displayed by the car display often cannot effectively cover the surrounding range of the vehicle, so it can only be developed for the rear of the vehicle or the sides of the vehicle. The blind spot monitoring display.

有鑑於上述習知技藝之問題,本發明之目的就是在提供一種以機率方式計算為基礎之3D環車影像系統及其獲得方法,以解決目前車輛內的車用顯示器無法有效地監控車輛四周之問題。 In view of the above problems of the prior art, the object of the present invention is to provide a 3D loop image system based on probability calculation and a method for obtaining the same, so as to solve the problem that the vehicle display in the vehicle cannot effectively monitor the surroundings of the vehicle. problem.

本發明係一種以機率方式計算為基礎之3D環車影像系統,適用於車輛上,包含擷取單元及處理單元。其中,擷取單元用以擷取車輛周邊之多方位之複數個鳥瞰影像,並傳送鳥瞰影像,處理單元具有校正模組、拼接模組及運算模組,處理單元係用以接收鳥瞰影像,藉由校正模組將鳥瞰影像之座標校正為同一座標系統,並利用拼接模組將鳥瞰影像轉換為虛擬平面影像以拼接成鳥瞰環景影像,再將拼接後之鳥瞰環景影像藉由運算模組利用演算法以得到3D環車影像。 The invention is a 3D ring car image system based on the calculation of a probability method, which is suitable for use on a vehicle, and comprises a capturing unit and a processing unit. The capturing unit is configured to capture a plurality of bird's-eye images in a plurality of directions around the vehicle and transmit the bird's-eye view image. The processing unit has a correction module, a splicing module and a computing module, and the processing unit is configured to receive the bird's-eye image. The calibration module corrects the coordinates of the bird's-eye view image to the same coordinate system, and uses the splicing module to convert the bird's-eye view image into a virtual plane image to be spliced into a bird's-eye view image, and then the spliced bird's-eye view image is used by the operation module. Use algorithms to get 3D loop images.

較佳者,本發明之以機率方式計算為基礎之3D環車影像系統之擷取單元可例如為廣角攝影機。 Preferably, the capture unit of the 3D loop image system based on the probabilistic calculation of the present invention may be, for example, a wide-angle camera.

較佳者,本發明之以機率方式計算為基礎之3D環車影像系統之擷取單元可例如設置於車輛上之前方車體、後方車體及二倒車鏡上。 Preferably, the capture unit of the 3D loop image system based on the probability calculation of the present invention can be disposed, for example, on the front side body, the rear body and the second mirror on the vehicle.

較佳者,本發明之以機率方式計算為基礎之3D環車影像系統之演算法可例如為改良式機率神經網路架構(Modified Probabilistic Neural Network,MPNN)。 Preferably, the algorithm of the 3D loop image system based on the probabilistic calculation of the present invention may be, for example, a Modified Probabilistic Neural Network (MPNN).

較佳者,本發明之以機率方式計算為基礎之3D環車影像系統之改良式機率神經網路架構可例如分別具有輸入層、類別層、總和層及輸出層,其中c={c 1,c 2,...,c m },m為類別c的數量,對於輸入x而言,其最接近類別c i 的有一個對應的輸出向量y i ,其可表示為y={y 1,y 2,...,y m },其中m為類別y的數量,該改良式機率神經網路架構所使用的機率密度函數為,其中σ為高斯函數之平滑係數,絕對輸出,其中z i 為類別向量c i 內樣本數的數量、網路輸出之向 量分別代表點之X軸與Y軸座標。 Preferably, the improved probability neural network architecture of the 3D loop image system based on the probabilistic calculation of the present invention may have, for example, an input layer, a class layer, a sum layer and an output layer, respectively, where c = { c 1 , c 2, ..., c m} , m is the number of class c, the input x, its closest I class c has a corresponding output vector y i, which may be expressed as y = {y 1, y 2 ,..., y m }, where m is the number of categories y , and the probability density function used by the improved probability neural network architecture is Where σ is the smoothing coefficient of the Gaussian function, absolute output for , where z i is the number of samples in the class vector c i , the vector of the network output , versus Represents the X-axis and Y-axis coordinates of the point, respectively.

本發明係一種以機率方式計算為基礎之3D環車影像之獲得方法,包含下列步驟:藉由擷取單元擷取車輛周邊之多方位之複數個鳥瞰影像,並傳送鳥瞰影像;將所接收到之鳥瞰影像之座標校正為同一座標系統;將鳥瞰影像轉換為虛擬平面影像以拼接成鳥瞰環景影像;以及將拼接後之鳥瞰環景影像藉由演算法運算以得到3D環車影像。 The present invention is a method for obtaining a 3D loop image based on a probabilistic calculation, comprising the steps of: capturing a plurality of bird's-eye view images of a plurality of directions around the vehicle by the capture unit, and transmitting the bird's-eye view image; The coordinates of the bird's-eye view image are corrected to the same coordinate system; the bird's-eye view image is converted into a virtual plane image to be stitched into a bird's-eye view image; and the stitched bird's-eye view image is calculated by an algorithm to obtain a 3D car image.

較佳者,本發明之以機率方式計算為基礎之3D環車影像之獲得方法之擷取單元可例如為廣角攝影機。 Preferably, the capturing unit of the method for obtaining a 3D loop image based on the probability calculation of the present invention may be, for example, a wide-angle camera.

較佳者,本發明之以機率方式計算為基礎之3D環車影像之獲得方法之擷取單元可例如設置於車輛上之前方車體、後方車體及二倒車鏡上。 Preferably, the capturing unit of the method for obtaining a 3D car image based on the probability method of the present invention can be disposed, for example, on the front side body, the rear body and the second mirror on the vehicle.

較佳者,本發明之以機率方式計算為基礎之3D環車影像之獲得方法之演算法可例如為改良式機率神經網路架構。 Preferably, the algorithm for obtaining the 3D loop image based on the probabilistic method of the present invention may be, for example, an improved probability neural network architecture.

較佳者,本發明之以機率方式計算為基礎之3D環車影像之獲得方法之改良式機率神經網路架構可例如分別具有輸入層、類別層、總和層及輸出層,其中c={c 1,c 2,...,c m },m為類別c的數量,對於輸入x而言,其最接近類別c i 的有一個對應的輸出向量y i ,其可表示為y={y 1,y 2,...,y m },其中m為類別y的數量,該改良式機率神經網路架構所使用的機率密度函數為,其中σ為高斯函數之平滑係數,絕對輸出,其中z i 為類別向量c i 內樣本數的數量、網路輸出之向 量分別代表點之X軸與Y軸座標。 Preferably, the improved probability neural network architecture of the method for obtaining a 3D loop image based on the probabilistic method of the present invention may have, for example, an input layer, a class layer, a sum layer, and an output layer, respectively, where c = { c 1 , c 2 ,..., c m }, m is the number of categories c , for the input x , the closest to the category c i has a corresponding output vector y i , which can be expressed as y = { y 1 , y 2 ,..., y m }, where m is the number of categories y , and the probability density function used by the modified probability neural network architecture is Where σ is the smoothing coefficient of the Gaussian function, absolute output for , where z i is the number of samples in the class vector c i , the vector of the network output , versus Represents the X-axis and Y-axis coordinates of the point, respectively.

綜上所述,本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法具有下列優點: In summary, the 3D loop image system based on the probabilistic calculation of the present invention and the obtaining method thereof have the following advantages:

(1)本發明之處理單元之校正模組可將相機所擷取之鳥瞰影像校正為同一座標系統,使得擷取之鳥瞰影像進行校正後可以達到完整還原之效果。 (1) The correction module of the processing unit of the present invention can correct the bird's-eye view image captured by the camera to the same coordinate system, so that the captured bird's-eye view image can be corrected to achieve the complete restoration effect.

(2)本發明之處理單元之拼接模組係將鳥瞰影像係先將鳥瞰影像轉換投影至虛擬影像平面後再進行拼接之動作,以確保校正後之鳥瞰影像可以精確地拼接縫合。 (2) The splicing module of the processing unit of the present invention converts the bird's-eye view image into a virtual image plane and then splicing the bird's-eye view image to ensure that the corrected bird's-eye view image can be accurately stitched and stitched.

(3)本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法主要係藉由改良目前鳥瞰影像之缺點,以立體3D環車方式呈現障礙物與車輛的相對位置,提供使用者車輛實際的立體動態,不會因障礙物的方位及高度而造成鳥瞰車體之角度失準。 (3) The 3D loop image system based on the probability calculation of the present invention and the obtaining method thereof mainly provide the use of the stereoscopic 3D loop to present the relative position of the obstacle and the vehicle by improving the shortcomings of the current bird's-eye view image. The actual three-dimensional dynamics of the vehicle will not cause the angle of the vehicle body to be out of alignment due to the orientation and height of the obstacle.

9‧‧‧車輛 9‧‧‧ Vehicles

10‧‧‧擷取單元 10‧‧‧Capture unit

20‧‧‧處理單元 20‧‧‧Processing unit

21‧‧‧校正模組 21‧‧‧ Calibration Module

22‧‧‧拼接模組 22‧‧‧Splicing module

23‧‧‧運算模組 23‧‧‧ Computing Module

101‧‧‧前方車體之鳥瞰影像 101‧‧‧A bird's eye view of the front body

102‧‧‧後方車體之鳥瞰影像 102‧‧‧A bird's eye view of the rear body

103‧‧‧倒車鏡之鳥瞰影像 103‧‧‧ Bird's eye view of the mirror

104‧‧‧倒車鏡之鳥瞰影像 Aerial view of the 104‧‧ ‧ reversing mirror

S10~S40‧‧‧步驟 S10~S40‧‧‧Steps

第1圖係為本發明之以機率方式計算為基礎之3D環車影像系統之系統方塊圖。 Figure 1 is a block diagram of the system of the 3D loop image system based on the probability calculation of the present invention.

第2圖係為本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法之第一示意圖。 2 is a first schematic diagram of a 3D loop image system based on the probability calculation of the present invention and a method for obtaining the same.

第3圖係為本發明之以機率方式計算為基礎之3D環車影像 系統及其獲得方法之第二示意圖。 Figure 3 is a 3D loop image based on the probability calculation of the present invention. A second schematic diagram of the system and its method of acquisition.

第4圖係為本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法之第三示意圖。 Figure 4 is a third schematic diagram of the 3D loop image system based on the probability calculation of the present invention and a method for obtaining the same.

第5圖係為本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法之座標校正之示意圖。 Figure 5 is a schematic diagram of the coordinate correction of the 3D loop image system based on the probabilistic calculation of the present invention and the method of obtaining the same.

第6圖係為本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法之步驟流程圖。 Figure 6 is a flow chart showing the steps of the 3D loop image system based on the probability calculation of the present invention and the obtaining method thereof.

請參閱第1圖,並進一步參閱第2圖至第5圖。本發明之以機率方式計算為基礎之3D環車影像系統,適用於車輛上,包含複數個擷取單元10及處理單元20。其中,擷取單元10用以擷取車輛9周邊之多方位之複數個鳥瞰影像(如第2圖所示),並傳送鳥瞰影像,此擷取單元10可例如為廣角攝影機,於此並不設限只要係可擷取到車輛9周邊之影像皆適合本發明,且擷取單元可例如設置於車輛9上之前方車體、後方車體及二倒車鏡上,用以擷取車輛9之前方車體之鳥瞰影像101、後方車體之鳥瞰影像102及二倒車鏡之鳥瞰影像103、104。 Please refer to Figure 1 and further refer to Figures 2 through 5. The 3D loop image system based on the probability calculation of the present invention is applicable to a vehicle and includes a plurality of capture units 10 and a processing unit 20. The capturing unit 10 is configured to capture a plurality of bird's-eye images (as shown in FIG. 2) in a plurality of directions around the vehicle 9 and transmit a bird's-eye view image. The capturing unit 10 can be, for example, a wide-angle camera. The limitation is as long as the image that can be captured to the periphery of the vehicle 9 is suitable for the present invention, and the capturing unit can be disposed, for example, on the front side of the vehicle 9 , the rear body and the second mirror for capturing the vehicle 9 The bird's-eye view image 101 of the square body, the bird's-eye view image 102 of the rear body, and the bird's-eye view images 103, 104 of the two mirrors.

承上述,本發明之處理單元20具有校正模組21、拼接模組22及運算模組23,處理單元20係用以接收鳥瞰影像,藉由校正模組21將鳥瞰影像之座標校正為同一座標系統,並利用拼接模組22將鳥瞰影像轉換為虛擬平面影像(如第5圖所示)以拼接縫合(Image Stitching)成鳥瞰環景影像(如第3圖所示),再將拼接後之鳥瞰環景影像藉由運算模組利用演算法以得到3D環車影像(如第4圖所示)。上述之座標校正方式係將圖像平面座標轉換為世界座標平面後,再此世界座標平面轉換成虛擬平面座 標。 In the above, the processing unit 20 of the present invention has a calibration module 21, a splicing module 22, and a computing module 23. The processing unit 20 is configured to receive a bird's-eye image, and the calibration module 21 corrects the coordinates of the bird's-eye image to the same coordinate. The system uses the splicing module 22 to convert the bird's-eye view image into a virtual plane image (as shown in FIG. 5) to form a bird's-eye view image (as shown in FIG. 3) by stitching (Image Stitching), and then stitching the image. The aerial view image is obtained by the computing module using an algorithm to obtain a 3D loop image (as shown in Fig. 4). The above coordinate correction method converts the image plane coordinates into a world coordinate plane, and then converts the world coordinate plane into a virtual plane seat. Standard.

上述之演算法可例如為改良式機率神經網路架構,其中,改良式機率神經網路架構分別具有輸入層、類別層、總和層及輸出層,其中c={c 1,c 2,...,c m },m為類別c的數量,對於輸入x而言,其最接近類別c i 的有一個對應的輸出向量y i ,其可表示為y={y 1,y 2,...,y m },其中m為類別y的數量,該改良式機率神經網路架構所使用的機率密度函數為,其中σ為高斯函數之平滑係數,絕對輸出,其中z i 為類別向量c i 內樣本數的數量、網路輸出之向量分別代表點之X軸與Y軸座標。 The above algorithm may be, for example, an improved probabilistic neural network architecture, wherein the improved probabilistic neural network architecture has an input layer, a class layer, a sum layer, and an output layer, respectively, where c = { c 1 , c 2 , .. , c m }, m is the number of categories c , for the input x , the closest to the category c i has a corresponding output vector y i , which can be expressed as y = { y 1 , y 2 , .. y m }, where m is the number of categories y , and the probability density function used by the improved probability neural network architecture is Where σ is the smoothing coefficient of the Gaussian function, absolute output for , where z i is the number of samples in the class vector c i , the vector of the network output , versus Represents the X-axis and Y-axis coordinates of the point, respectively.

請參閱第6圖,其係為本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法之步驟流程圖。本發明包含下列步驟:首先,進行(S10)擷取車輛周邊之多方位之複數個鳥瞰影像,並傳送鳥瞰影像,且此擷取單元可例如為廣角攝影機,而擷取單元可例如設置於車輛上之前方車體、後方車體及二倒車鏡上。接著進行(S20)將所接收到之鳥瞰影像之座標校正為同一座標系統,此座標校正方式係將圖像平面座標轉換為世界座標平面後,再此世界座標平面轉換成虛擬平面座標(如第5圖所示)。 Please refer to FIG. 6 , which is a flow chart of the steps of the 3D loop image system based on the probabilistic calculation of the present invention and the obtaining method thereof. The present invention includes the following steps: First, (S10) capturing a plurality of bird's-eye view images of a plurality of directions around the vehicle, and transmitting a bird's-eye view image, and the capturing unit may be, for example, a wide-angle camera, and the capturing unit may be disposed, for example, in the vehicle. On the front side of the car body, the rear car body and the second mirror. Then (S20) correcting the coordinates of the received bird's-eye image to the same coordinate system, the coordinate correction method is to convert the image plane coordinate into a world coordinate plane, and then convert the world coordinate plane into a virtual plane coordinate (such as Figure 5).

再進行(S30)將鳥瞰影像轉換為虛擬平面影像以拼接成鳥瞰環景影像,舉例來說,可例如利用將複數個分開擷取之影像中找尋相似的特徵點,當特徵點匹配的數量及座標位置符合門檻值時,就會以對應之 角度及距離進行影像拼接縫合,且可例如藉由Open CV影像處理函式庫進行影像拼接縫合。最後進行(S40)將拼接後之鳥瞰環景影像藉由演算法運算以得到3D環車影像。S40中之演算法可例如為改良式機率神經網路架構。 Then, (S30) converting the bird's-eye view image into a virtual plane image to be spliced into a bird's-eye view image. For example, it is possible to find a similar feature point by using a plurality of separately captured images, when the number of feature points is matched and When the coordinate position meets the threshold value, it will correspond The image stitching and stitching are performed at an angle and a distance, and the image stitching and stitching can be performed, for example, by the Open CV image processing library. Finally, (S40), the stitched bird's-eye view image is calculated by an algorithm to obtain a 3D loop image. The algorithm in S40 can be, for example, an improved probability neural network architecture.

總言之,透過本發明之以機率方式計算為基礎之3D環車影像系統及其獲得方法於設計上之巧思,藉由校正模組、拼接模組及運算模組對鳥瞰影像分別依序進行影像校正、拼接縫合以及利用改良式機率神經網路架構進行運算以得到3D環車影像,此3D環車影像可供車輛上之使用者更真實地了解車輛之車體與障礙物之相對距離。 In summary, the 3D ring car image system based on the probability calculation method of the present invention and the obtaining method thereof are designed and ingenious, and the bird's-eye view images are sequentially ordered by the correction module, the splicing module and the computing module. Perform image correction, stitching and stitching, and use the improved probabilistic neural network architecture to calculate 3D loop images. This 3D loop image allows the user on the vehicle to more accurately understand the relative distance between the vehicle body and the obstacle. .

以上所述僅為舉例性,而非為限制性者。任何未脫離本發明之精神與範疇,而對其進行之等效修改或變更,均應包含於後附之申請專利範圍中。 The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

10‧‧‧擷取單元 10‧‧‧Capture unit

20‧‧‧處理單元 20‧‧‧Processing unit

21‧‧‧校正模組 21‧‧‧ Calibration Module

22‧‧‧拼接模組 22‧‧‧Splicing module

23‧‧‧運算模組 23‧‧‧ Computing Module

Claims (5)

一種以機率方式計算為基礎之3D環車影像系統,適用一車輛上,該3D環車影像系統包含:複數個擷取單元,用以擷取該車輛周邊之多方位之複數個鳥瞰影像,並傳送該些鳥瞰影像,其中該些擷取單元為廣角攝影機;以及一處理單元,該處理單元具有一校正模組、一拼接模組及一運算模組,該處理單元係用以接收該些鳥瞰影像,藉由該校正模組將該些鳥瞰影像之座標校正為同一座標系統,並利用該拼接模組將該些鳥瞰影像轉換為虛擬平面影像以拼接成一鳥瞰環景影像,再將拼接後之該鳥瞰環景影像藉由該運算模組利用一演算法以得到一3D環車影像,其中該演算法為改良式機率神經網路架構(Modified Probabilistic Neural Network,MPNN),其中該改良式機率神經網路架構分別具有輸入層(Input)、類別層(Pattern layer)、總和層(Summing layer)及輸出層(Output layer),其中c={c 1,c 2,...,c m },m為類別c的數量,對於輸入x而言,其最接近類別c i 的有一個對應的輸出向量y i ,其可表示為y={y 1,y 2,...,y m },其中m為類別y的數量,該改良式機率神經網路架構所使用的機率密度函數為 ,其中σ為高斯函數之平滑係數,絕對輸出 , ,其中z i 為類別向量c i 內樣本數的數量、網路輸出之向量分別代表點之X軸與Y軸座標。 A 3D loop image system based on a probabilistic calculation is applied to a vehicle. The 3D loop image system includes: a plurality of capture units for capturing a plurality of bird's-eye views of the plurality of directions around the vehicle, and Transmitting the bird's-eye view images, wherein the capture unit is a wide-angle camera; and a processing unit having a correction module, a splicing module and a computing module, the processing unit is configured to receive the bird's eye view The image is corrected by the correction module to coordinate the coordinates of the bird's-eye view image into the same coordinate system, and the splicing module converts the bird's-eye view images into virtual plane images to be spliced into a bird's-eye view image, and then spliced The aerial view image uses the algorithm to obtain a 3D loop image by using the algorithm, wherein the algorithm is a modified Probabilistic Neural Network (MPNN), wherein the improved probability neural network The network architecture has an input layer, a pattern layer, a summing layer, and an output layer, where c = { c 1 , c 2 , ..., c m}, m is the number of class c, the input x, its closest I class c has a corresponding output vector y i, which may be expressed as y = {y 1, y 2 ,..., y m }, where m is the number of categories y , and the probability density function used by the modified probabilistic neural network architecture is Where σ is the smoothing coefficient of the Gaussian function, absolute output for , , where z i is the number of samples in the class vector c i , the vector of the network output , versus Represents the X-axis and Y-axis coordinates of the point, respectively. 如申請專利範圍第1項所述之以機率方式計算為基礎之3D環車影像系統,其中該些擷取單元設置於該車輛上之前方車體、後方車體及二倒車鏡上。 The 3D loop image system based on the probabilistic calculation described in claim 1 is wherein the picking units are disposed on the front side body, the rear body and the second mirror on the vehicle. 一種以機率方式計算為基礎之3D環車影像之獲得方法,包含下列步驟:藉由一擷取單元擷取一車輛周邊之多方位之複數個鳥瞰影像,並傳送該些鳥瞰影像;將所接收到之該些鳥瞰影像之座標校正為同一座標系統;將該些鳥瞰影像轉換為虛擬平面影像以拼接成一鳥瞰環景影像;以及將拼接後之該鳥瞰環景影像藉由一演算法運算以得到一3D環車影像,其中該演算法為改良式機率神經網路架構,其中該改良式機率神經網路架構分別具有輸入層、類別層、總和層及輸出層,其中c={c 1,c 2,...,c m },m為類別c的數量,對於輸入x而言,其最接近類別c i 的有一個對應的輸出向量y i ,其可表示為y={y 1,y 2,...,y m },其中m為類別y的數量,該改良式機率神經網路架構所使用的機率密度函數為 ,其中σ為高斯函數之平滑係數,絕對輸出 ,其中z i 為類別向量c i 內樣本數的數量、網路輸出之向量分別代表點之X軸與Y軸座標。 A method for obtaining a 3D loop image based on a probabilistic calculation includes the following steps: capturing a plurality of bird's-eye view images of a plurality of directions around a vehicle by using a capture unit, and transmitting the bird's-eye images; The coordinates of the bird's-eye view images are corrected to the same coordinate system; the bird's-eye view images are converted into virtual plane images to be stitched into a bird's-eye view image; and the stitched aerial bird's-eye view image is calculated by an algorithm A 3D loop image, wherein the algorithm is an improved probability neural network architecture, wherein the improved probability neural network architecture has an input layer, a class layer, a sum layer, and an output layer, respectively, where c = { c 1 , c 2 ,..., c m }, m is the number of categories c , for the input x , the closest to the category c i has a corresponding output vector y i , which can be expressed as y = { y 1 , y 2 ,..., y m }, where m is the number of categories y , and the probability density function used by the improved probability neural network architecture is Where σ is the smoothing coefficient of the Gaussian function, absolute output for , where z i is the number of samples in the class vector c i , the vector of the network output , versus Represents the X-axis and Y-axis coordinates of the point, respectively. 如申請專利範圍第3項所述之以機率方式計算為基礎之3D環車影像之獲得方法,其中該些擷取單元為廣角攝影機。 The method for obtaining a 3D loop image based on the probability calculation described in claim 3, wherein the capture units are wide-angle cameras. 如申請專利範圍第3項所述之以機率方式計算為基礎之3D環車影像之獲得方法,其中該些擷取單元設置於該車輛上之前方車體、後方車體及二倒車鏡上。 The method for obtaining a 3D loop image based on the probability calculation described in claim 3, wherein the picking units are disposed on the front side body body, the rear side body body and the second rear view mirror of the vehicle.
TW103111349A 2014-03-27 2014-03-27 The 3D ring car image system based on probability calculation and its obtaining method TWI499999B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW103111349A TWI499999B (en) 2014-03-27 2014-03-27 The 3D ring car image system based on probability calculation and its obtaining method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW103111349A TWI499999B (en) 2014-03-27 2014-03-27 The 3D ring car image system based on probability calculation and its obtaining method

Publications (2)

Publication Number Publication Date
TWI499999B true TWI499999B (en) 2015-09-11
TW201537510A TW201537510A (en) 2015-10-01

Family

ID=54608123

Family Applications (1)

Application Number Title Priority Date Filing Date
TW103111349A TWI499999B (en) 2014-03-27 2014-03-27 The 3D ring car image system based on probability calculation and its obtaining method

Country Status (1)

Country Link
TW (1) TWI499999B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI602154B (en) * 2017-04-26 2017-10-11 偉詮電子股份有限公司 Panoramic image stitching method and system thereof
TWI627603B (en) * 2017-05-08 2018-06-21 偉詮電子股份有限公司 Image Perspective Conversion Method and System Thereof
CN109427040B (en) 2017-08-22 2023-10-10 富联国基(上海)电子有限公司 Image processing apparatus and method
TWI658434B (en) * 2017-08-22 2019-05-01 鴻海精密工業股份有限公司 Apparatus and methods for image processing

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070076016A1 (en) * 2005-10-04 2007-04-05 Microsoft Corporation Photographing big things
CN102045546A (en) * 2010-12-15 2011-05-04 广州致远电子有限公司 Panoramic parking assist system
TWM486116U (en) * 2014-03-27 2014-09-11 Univ Shu Te 3D vehicle surrounding image system based on probability calculation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070076016A1 (en) * 2005-10-04 2007-04-05 Microsoft Corporation Photographing big things
CN102045546A (en) * 2010-12-15 2011-05-04 广州致远电子有限公司 Panoramic parking assist system
TWM486116U (en) * 2014-03-27 2014-09-11 Univ Shu Te 3D vehicle surrounding image system based on probability calculation

Also Published As

Publication number Publication date
TW201537510A (en) 2015-10-01

Similar Documents

Publication Publication Date Title
KR102566724B1 (en) Harbor monitoring device and harbor monitoring method
CN106960454B (en) Depth of field obstacle avoidance method and equipment and unmanned aerial vehicle
JP6767998B2 (en) Estimating external parameters of the camera from the lines of the image
WO2020206708A1 (en) Obstacle recognition method and apparatus, computer device, and storage medium
US10268904B2 (en) Vehicle vision system with object and lane fusion
Debattisti et al. Automated extrinsic laser and camera inter-calibration using triangular targets
US20110063436A1 (en) Distance estimating apparatus
JP2008186246A (en) Moving object recognizing device
TWI499999B (en) The 3D ring car image system based on probability calculation and its obtaining method
CN107122770A (en) Many mesh camera systems, intelligent driving system, automobile, method and storage medium
CN111160220B (en) Deep learning-based parcel detection method and device and storage medium
US11282180B1 (en) Object detection with position, pose, and shape estimation
JP2021531601A (en) Neural network training, line-of-sight detection methods and devices, and electronic devices
JP2010191793A (en) Alarm display and alarm display method
WO2020024182A1 (en) Parameter processing method and apparatus, camera device and aircraft
TW201601952A (en) 3D panoramic image system using distance parameter to calibrate correctness of image
KR101612822B1 (en) Apparatus for detecting lane and method thereof
Mariotti et al. Spherical formulation of geometric motion segmentation constraints in fisheye cameras
EP3629292A1 (en) Reference point selection for extrinsic parameter calibration
Dev et al. Steering angle estimation for autonomous vehicle
TWM486116U (en) 3D vehicle surrounding image system based on probability calculation
TWI796952B (en) Object detection device and object detection method
Megalingam et al. Adding intelligence to the robotic coconut tree climber
CN114648639A (en) Target vehicle detection method, system and device
Ahmed et al. Distance alert system using Stereo vision and feature extraction