TWI591593B - Traffic signs, traffic lights and timers for video detection and identification of voice announcers - Google Patents
Traffic signs, traffic lights and timers for video detection and identification of voice announcers Download PDFInfo
- Publication number
- TWI591593B TWI591593B TW102129234A TW102129234A TWI591593B TW I591593 B TWI591593 B TW I591593B TW 102129234 A TW102129234 A TW 102129234A TW 102129234 A TW102129234 A TW 102129234A TW I591593 B TWI591593 B TW I591593B
- Authority
- TW
- Taiwan
- Prior art keywords
- voice
- image
- software module
- countdown
- traffic
- Prior art date
Links
- 238000001514 detection method Methods 0.000 title claims description 65
- 230000006870 function Effects 0.000 claims description 35
- 238000012545 processing Methods 0.000 claims description 23
- 238000000034 method Methods 0.000 claims description 22
- 238000004891 communication Methods 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 6
- 230000001133 acceleration Effects 0.000 claims description 5
- 230000005484 gravity Effects 0.000 claims description 5
- 239000003086 colorant Substances 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 description 15
- 230000000007 visual effect Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 238000005259 measurement Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 229910003460 diamond Inorganic materials 0.000 description 1
- 239000010432 diamond Substances 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Landscapes
- Traffic Control Systems (AREA)
Description
本發明係有關於一種交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器，特別是指使用電子影像辨識技術協助辨識前方交通標誌、燈號或讀秒器數字，並以語音播報方式告知駕駛人員之電子裝置，讓駕駛人員行車時不需為道路上的交通號誌判讀分散目光注意力，提升行車安全。 The invention relates to a voice broadcaster for traffic sign, traffic light number and image recognition and identification of a countdown device, in particular to use an electronic image recognition technology to assist in identifying a traffic sign, a light number or a countdown number in front, and broadcast it by voice. The method informs the driver of the electronic device, so that the driver does not need to distract the traffic signs on the road to diversify his attention and improve driving safety.
隨著現今電腦科技的進步，使得人類的生活從以前的人工作業時代，逐漸轉變為自動化的電腦時代。而現代化運輸工具的發展中，交通路況路線愈顯複雜，利用感測式系統提供周遭環境狀況及相關資訊給駕駛者，以增加駕駛的安全方便性及有效性已成重要課題。遂有“道路標誌資料提示裝置”(中華民國發明專利第M250157號)、“無線交通號誌警示系統”(中華民國發明專利第I312492號)及“道路影像辨識導航裝置與導航方法”(中華民國發明專利第I359259號)等技術相繼被發展出來。另外，為加速「車的智慧化」之目標早日達成，目前有許多研究人員所研究的自動駕駛車，也需要利用相關的技術，讓它們能安全的行駛於公路上。然而交通標誌仍是目前道路駕駛人重要的行路依據，因交通標誌的大小、外型、 顏色和內容都有一定的法規規定，譬如說一般警告標誌必須採用正三角形標誌，白色用於標誌之底色、圖案或文字，紅色則用於警告或禁制標誌等等，加上交通標誌的種類非常繁多，如三角形標誌、圓形標誌、矩形標誌、菱形標誌等，裡面的圖像也是千奇百怪，另外還有紅色、橘色、藍色、黃色等各式各樣的顏色，又自然環境之中會產生很多不利偵測與辨識交通標誌的因素，譬如天氣(晴天、陰天、雨天)、時間(清晨、黃昏、晚上)、交通標誌遭到樹影或汽車的遮蔽、交通標誌變形、在交通標誌附近有相同顏色的物體干擾偵測，又考量行車速度，快速辨識反應的有效性需求等，顯示其辨識技術有其獨特性，相關辨識技術已在目前各公私研究機構廣泛的開發中。但尚未有如本發明，著重在應用相關交通標誌辨識技術及操控技術，並以語音播報方式，來避免道路駕駛人因交通號誌判讀及其操控而分散目光注意力，讓道路駕駛人更輕鬆安全的行在路上。 With the advancement of today's computer technology, human life has gradually changed from the era of manual work to the era of automated computer. In the development of modern transportation vehicles, the traffic conditions are becoming more and more complicated. It is an important issue to use the sensing system to provide the surrounding environment and related information to the driver to increase the safety and effectiveness of driving.遂 “Road Marking Information Prompt Device” (Republic of China Invention Patent No. M250157), “Wireless Traffic Sign Warning System” (Republic of China Invention Patent No. I312492) and “Road Image Identification Navigation Device and Navigation Method” (Republic of China Techniques such as invention patent No. I359259 have been developed. In addition, in order to accelerate the goal of "smart car", many autopilots studied by researchers now need to use related technologies to enable them to safely drive on the road. However, traffic signs are still an important way for current road drivers, due to the size and appearance of traffic signs. Color and content have certain regulations. For example, the general warning sign must use the regular triangle mark, white is used for the background color, pattern or text of the mark, red is used for warning or prohibition sign, etc., plus the type of traffic sign. Very numerous, such as triangular signs, round signs, rectangular signs, diamond signs, etc., the images inside are also very strange, in addition to red, orange, blue, yellow and other various colors, and in the natural environment There will be many factors that adversely detect and identify traffic signs, such as weather (clear, cloudy, rainy), time (early morning, dusk, evening), traffic signs being shaded by trees or cars, traffic signs being deformed, traffic signs There are objects of the same color in the vicinity to detect the interference, consider the driving speed, and quickly identify the validity of the response. It shows that the identification technology has its uniqueness. The relevant identification technology has been widely developed in the current public and private research institutions. However, there is no such thing as the present invention, focusing on the application of relevant traffic sign recognition technology and control technology, and using voice broadcast to avoid road drivers distracting attention from traffic signal interpretation and manipulation, making road drivers easier and safer. The line is on the road.
另根據內政部警政署的統計，歷年來台灣地區每年因交通事故而死亡的人數皆維持在三千人左右，分析其肇事原因，百分之九十六是駕駛不當所致，駕駛不當的原因相當多，譬如說酒後駕車、駕駛員不專心、駕駛員身體不適等，而忽視或是沒有注意到來自交通標誌的警告也是造成駕駛不當的原因之一。駕駛者會因為各種原因沒有注意到來自交通標誌的警告，如此可能會導致車禍的發生或是違反交通標誌而被開罰單，另有研究發現在路***通標誌過多的地方，亦會因交通標誌過多導到駕駛分心而導致車禍的發生，因此如何利用機器視覺的技術去偵測、辨識及回報這些交通標誌，以最少視覺負擔的方式的讓道路駕駛察覺，以期能夠提高交通安全的目的已是一項新的重要課題，正是本發明將要解決的問題。 According to the statistics of the Police Department of the Ministry of the Interior, the number of people who died in traffic accidents in Taiwan every year has remained at around 3,000. The cause of the accident was analyzed. Ninety-six percent were caused by improper driving and improper driving. There are quite a few reasons, such as drunk driving, driver distraction, driver discomfort, etc. Neglect or failure to notice warnings from traffic signs is one of the reasons for improper driving. The driver will not notice the warning from the traffic sign for various reasons. This may result in a car accident or a violation of the traffic sign. A study has found that there are too many traffic signs in places where there are too many traffic signs at the intersection. Leading to driver distraction and causing a car accident, so how to use machine vision technology to detect, identify and reward these traffic signs, to make road driving aware with the least visual burden, in order to improve traffic safety is A new and important topic is the problem that the invention will solve.
本發明之目的是利用最新的電子影像及語音的辨識技術去偵測、辨識及選用回報交通號誌，以避免道路駕駛人因交通號誌的判讀而分散目光注意力，增進行車安全。亦即應用最新交通標誌影像辨識技術及語音或手勢的辨識操控技術，讓道路駕駛人以最少視覺負擔的方式來察覺及選擇所需的路上的行車指示，而能更輕鬆安全的行在路上。 The purpose of the present invention is to utilize the latest electronic image and voice recognition technology to detect, identify and select the return traffic number to prevent the road driver from distracting the attention of the traffic sign and increase the safety of the car. That is to say, using the latest traffic sign image recognition technology and the voice or gesture recognition control technology, the road driver can detect and select the driving directions on the road with the least visual burden, and can travel on the road more easily and safely.
可達成上述發明目的之行動式影像辨識交通號誌播報器，主要係由：攝影鏡頭、行動運算處理裝置、麥克風、具3D影像感測晶片之後背鏡頭、語音輸出介面、手勢偵測控制軟體模組、語音辨識之聲控軟體模組、交通標誌偵測分類及辨識軟體模組、交通燈號與讀秒器偵測及辨識軟體模組、語音播放軟體模組及功能選用輸出輸入軟體介面等組成。使用最新影像交通標誌辨識技術及語音或手勢操控技術，來避免道路駕駛人因交通號誌的判讀而分散目光注意力，以最少視覺負擔的方式讓道路駕駛人察覺及選擇所需路上的行車指示，使道路駕駛人能更輕鬆安全的行在路上。 The mobile image recognition traffic signal broadcaster capable of achieving the above object is mainly composed of: a photographic lens, a motion processing device, a microphone, a back lens with a 3D image sensing chip, a voice output interface, and a gesture detection control software model. The group, voice recognition voice control software module, traffic sign detection classification and identification software module, traffic light number and countdown detection and identification software module, voice playback software module and function selection output input software interface. Use the latest image traffic sign recognition technology and voice or gesture control technology to prevent road drivers from distracting attention due to the interpretation of traffic signs, allowing road drivers to detect and select driving directions on the road with minimal visual burden To make it easier and safe for road drivers to walk on the road.
本發明提供一種交通標誌影像偵測及辨識的語音播報器，其包含：一攝影鏡頭，擷取行車時前方的影像；一交通標誌影像偵測分類及辨識軟體模組，係接收該攝影鏡頭擷取之影像，做交通標誌影像的分類及辨識；一行動運算處理裝置，係處理運算經由該交通標誌影像偵測分類及辨識軟體模組所分類及辨識之影像；以及一語音播放軟體模組與一語音輸出介面，接收該行動運算處理裝置之處理運算結果，選取相對應的語音檔播出。 The invention provides a voice broadcaster for detecting and recognizing a traffic sign image, comprising: a photographing lens for capturing an image in front of driving; and a traffic sign image detecting and identifying software module for receiving the photographing lens. The image is taken as a classification and identification of the traffic sign image; a mobile computing processing device is used to process and classify the image classified and identified by the traffic sign image detection classification and recognition software module; and a voice playback software module and A voice output interface receives the processing result of the action processing device and selects a corresponding voice file to play.
其中該行動運算處理裝置，包含一高速高效能多核心處理器結合協同運算處理器、一控制器及記憶體等所構成，一輸出入介面可與攝影鏡頭、麥克風連結。其中更包含：WiFi通訊埠、Bluetooth通訊埠、3G通訊埠、4G通訊埠、以及GPS接收器及三維空間重力加速偵測器。其中更包含一麥克風及一語音辨識之聲控軟體模組。其中更包含一具3D影像感測晶片之後背鏡頭及手勢偵測控制軟體模組，提供非觸控手勢控制功能，直接以手勢指令啟動、選用或關閉相關偵測辨識功能。其中該交通標誌影像偵測分類及辨識軟體模組係依據政府公布的“道路交通標誌標線號誌設置規則”內所訂定標誌的顏色和形狀做交通標誌偵測。而在不同的光線強度下，顏色的呈現會有些微差異，為使特定的顏色能夠容易且正確地被萃取，顏色篩選的方式可利用RGB顏色系統，設定RGB數值與比例範圍來萃取目標物，或則是利用HSI顏色系統下色相(hue)的範圍來萃取目標物。其中該交通標誌影像偵測分類及辨識軟體模組，係依據政府公布的道路交通標誌標線號誌設置規則內所訂定的標誌設置規範來給予適當的模板，利用樣板比對法或Zernike moments距離比對法或採用鄰近的八個點方向尋找輪廓，以內輪廓和基本圓形、三角形、半圓形及長方形的數學法則或SVM方法做交通標誌分類。其中該交通標誌影像偵測分類及辨識軟體模組，可依設定來對警告、禁制及指示等標誌內圖式、數字及文字等做全數或選擇性辨識。其中該語音播放軟體模組與該語音輸出介面中的語音輸出介面可為一般有線音訊接孔輸出及無線Bluetooth音訊輸出。 The mobile computing processing device comprises a high-speed and high-performance multi-core processor combined with a cooperative computing processor, a controller and a memory, and an input/output interface can be connected with the photographic lens and the microphone. It also includes: WiFi communication, Bluetooth communication, 3G communication, 4G communication, GPS receiver and 3D space gravity acceleration detector. The utility model further comprises a microphone and a voice recognition software module for voice recognition. The utility model further comprises a 3D image sensing chip rear lens and a gesture detection control software module, which provides a non-touch gesture control function, and directly activates, selects or turns off the relevant detection and recognition function by using a gesture command. The traffic sign image detection classification and identification software module is used for traffic sign detection according to the color and shape of the flag set in the "Road Traffic Sign Marking Code Setting Rules" published by the government. At different light intensities, the color will be slightly different. In order to make the specific color easy and correct to be extracted, the color filtering method can use the RGB color system to set the RGB value and the scale range to extract the target. Or the range of the hue under the HSI color system is used to extract the target. The traffic sign image detection classification and identification software module is based on the flag setting specification set by the government's published road traffic sign marking code setting rule to give an appropriate template, using the template comparison method or Zernike moments. The distance alignment method or the use of adjacent eight-point directions to find the contour, and the inner contour and the basic circular, triangular, semi-circular and rectangular mathematical rules or SVM method for traffic sign classification. The traffic sign image detection classification and identification software module can perform full or selective identification of the symbols, numbers and texts such as warnings, prohibitions and indications according to the settings. The voice playback software module and the voice output interface in the voice output interface can be a general wired audio jack output and a wireless Bluetooth audio output.
本發明提供一種交通燈號及讀秒器影像偵測及辨識的語音播報器，其包含：一攝影鏡頭，擷取行車時前方的影像；一交通燈號與讀 秒器偵測及辨識軟體模組，係接收該攝影鏡頭擷取之影像，將交通燈號與讀秒器影像分類及辨識；一行動運算處理裝置，係處理運算經由該交通燈號與讀秒器偵測及辨識軟體模組所分類及辨識之影像；以及一語音播放軟體模組與一語音輸出介面，接收該行動運算處理裝置之處理運算結果，選取相對應的語音檔播出。 The invention provides a voice broadcaster for traffic signal number and countdown image detection and identification, which comprises: a photographing lens for capturing images in front of driving; a traffic light and reading The second device detects and recognizes the software module, receives the image captured by the photographic lens, classifies and recognizes the traffic signal and the image of the chronograph; and an action processing device that processes the operation via the traffic signal and the chronograph Detecting and recognizing the image classified and recognized by the software module; and a voice playing software module and a voice output interface, receiving the processing result of the motion computing processing device, and selecting the corresponding voice file to broadcast.
其中該行動運算處理裝置，包含一高速高效能多核心處理器結合協同運算處理器、一控制器及記憶體等所構成，一輸出入介面可與攝影鏡頭、麥克風連結。其中更包含：WiFi通訊埠、Bluetooth通訊埠、3G通訊埠、4G通訊埠、以及GPS接收器及三維空間重力加速偵測器。其中更包含一麥克風及一語音辨識之聲控軟體模組。其中更包含一具3D影像感測器片之後背鏡頭及手勢偵測控制軟體模組，提供非觸控手勢控制功能，直接以手勢指令啟動、選用或關閉相關偵測辨識功能。其中該交通燈號與讀秒器偵測及辨識軟體模組，係依據政府公布的道路交通標誌標線號誌設置規則內所訂定的燈號及其倒數計時顯示器的樣式及燈色來做偵測辨識。其中該交通燈號與讀秒器偵測及辨識軟體模組，在偵測到有倒數計時顯示器時，提供讀秒辨識同步播報功能，使倒數計時顯示器的秒數與語音播報之秒數同步。其中該交通燈號與讀秒器偵測及辨識軟體模組可設定開始倒數播報之秒數，適時以語音同步提醒駕駛。其中該語音播放軟體模組與該語音輸出介面中的語音輸出介面可為一般有線音訊接孔輸出及無線Bluetooth音訊輸出。 The mobile computing processing device comprises a high-speed and high-performance multi-core processor combined with a cooperative computing processor, a controller and a memory, and an input/output interface can be connected with the photographic lens and the microphone. It also includes: WiFi communication, Bluetooth communication, 3G communication, 4G communication, GPS receiver and 3D space gravity acceleration detector. The utility model further comprises a microphone and a voice recognition software module for voice recognition. The utility model further comprises a 3D image sensor film back lens and a gesture detection control software module, which provides a non-touch gesture control function, and directly activates, selects or turns off the relevant detection and recognition function by using a gesture command. The traffic light and the countdown detector detection and identification software module are based on the light number set by the government's published road traffic sign markings and the color and color of the countdown display. Measurement identification. The traffic light and the countdown detection and recognition software module provide a countdown recognition synchronization broadcast function when the countdown display is detected, so that the number of seconds of the countdown display is synchronized with the number of seconds of the voice broadcast. The traffic light and the countdown detection and recognition software module can set the number of seconds to start the countdown broadcast, and promptly drive the voice with a synchronous voice. The voice playback software module and the voice output interface in the voice output interface can be a general wired audio jack output and a wireless Bluetooth audio output.
本發明提供一種交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器，其包含：一攝影鏡頭，擷取行車時前方的影像；一交通 標誌影像偵測分類及辨識軟體模組，係接收該攝影鏡頭擷取之影像，將交通標誌影像的分類及辨識；一交通燈號與讀秒器偵測及辨識軟體模組，係接收該攝影鏡頭擷取之影像，將交通燈號與讀秒器影像分類及辨識；一行動運算處理裝置，係處理運算經由該交通標誌影像偵測分類及辨識軟體模組及該交通燈號與讀秒器偵測及辨識軟體模組所分類及辨識之影像；以及一語音播放軟體模組與一語音輸出介面，接收該行動運算處理裝置之處理運算結果，選取相對應的語音檔播出。 The invention provides a voice broadcaster for traffic sign, traffic light number and image recognition and identification of a countdown device, which comprises: a photographing lens for capturing an image in front of driving; a traffic The image detection classification and recognition software module receives the image captured by the camera lens and classifies and identifies the traffic sign image; a traffic light number and a countdown device detection and recognition software module receives the camera lens The image is captured and identified by the traffic signal and the image of the reader; a mobile computing device is used to process the classification and identification software module and the traffic signal and the countdown detector. Identifying the image classified and recognized by the software module; and a voice playing software module and a voice output interface, receiving the processing result of the motion computing processing device, and selecting the corresponding voice file to broadcast.
其中該行動運算處理裝置，包含一高速高效能多核心處理器結合協同運算處理器、一控制器及記憶體等所構成，一輸出入介面可與攝影鏡頭、麥克風連結。其中更包含：WiFi通訊埠、Bluetooth通訊埠、3G通訊埠、4G通訊埠、以及GPS接收器及三維空間重力加速偵測器。其中更包含一麥克風及一語音辨識之聲控軟體模組。其中更包含一具3D影像感測器片之後背鏡頭及手勢偵測控制軟體模組，提供非觸控手勢控制功能，直接以手勢指令啟動、選用或關閉相關偵測辨識功能。其中該交通標誌影像偵測分類及辨識軟體模組係依據政府公布的“道路交通標誌標線號誌設置規則”內所訂定標誌的顏色和形狀做交通標誌偵測。而在不同的光線強度下，顏色的呈現會有些微差異，為使特定的顏色能夠容易且正確地被萃取，顏色篩選的方式可利用RGB顏色系統，設定RGB數值與比例範圍來萃取目標物，或則是利用HSI顏色系統下色相(hue)的範圍來萃取目標物。其中該交通標誌影像偵測分類及辨識軟體模組，係依據政府公布的道路交通標誌標線號誌設置規則內所訂定的標誌設置規範來給予適當的模板，利用樣板比對法或Zernike moments距離比對法或採用鄰近的八個點方向尋找 輪廓，以內輪廓和基本圓形、三角形、半圓形及長方形的數學法則或SVM方法做交通標誌分類。其中該交通標誌影像偵測分類及辨識軟體模組，可依設定來對警告、禁制及指示等標誌內圖式、數字及文字等做全數或選擇性辨識。其中該交通燈號與讀秒器偵測及辨識軟體模組，係依據政府公布的道路交通標誌標線號誌設置規則內所訂定的燈號及其倒數計時顯示器的樣式及燈色來做偵測辨識。其中該交通燈號與讀秒器偵測及辨識軟體模組，在偵測到有倒數計時顯示器時，提供讀秒辨識同步播報功能，使倒數計時顯示器的秒數與語音播報之秒數同步。其中該交通燈號與讀秒器偵測及辨識軟體模組可設定開始倒數播報之秒數，適時以語音同步提醒駕駛。其中該語音播放軟體模組與該語音輸出介面中的語音輸出介面可為一般有線音訊接孔輸出及無線Bluetooth音訊輸出。 The mobile computing processing device comprises a high-speed and high-performance multi-core processor combined with a cooperative computing processor, a controller and a memory, and an input/output interface can be connected with the photographic lens and the microphone. It also includes: WiFi communication, Bluetooth communication, 3G communication, 4G communication, GPS receiver and 3D space gravity acceleration detector. The utility model further comprises a microphone and a voice recognition software module for voice recognition. The utility model further comprises a 3D image sensor film back lens and a gesture detection control software module, which provides a non-touch gesture control function, and directly activates, selects or turns off the relevant detection and recognition function by using a gesture command. The traffic sign image detection classification and identification software module is used for traffic sign detection according to the color and shape of the flag set in the "Road Traffic Sign Marking Code Setting Rules" published by the government. At different light intensities, the color will be slightly different. In order to make the specific color easy and correct to be extracted, the color filtering method can use the RGB color system to set the RGB value and the scale range to extract the target. Or the range of the hue under the HSI color system is used to extract the target. The traffic sign image detection classification and identification software module is based on the flag setting specification set by the government's published road traffic sign marking code setting rule to give an appropriate template, using the template comparison method or Zernike moments. Distance comparison or use the neighboring eight points to find Contours, classification of traffic signs with inner contours and basic circular, triangular, semi-circular and rectangular mathematical rules or SVM methods. The traffic sign image detection classification and identification software module can perform full or selective identification of the symbols, numbers and texts such as warnings, prohibitions and indications according to the settings. The traffic light and the countdown detector detection and identification software module are based on the light number set by the government's published road traffic sign markings and the color and color of the countdown display. Measurement identification. The traffic light and the countdown detection and recognition software module provide a countdown recognition synchronization broadcast function when the countdown display is detected, so that the number of seconds of the countdown display is synchronized with the number of seconds of the voice broadcast. The traffic light and the countdown detection and recognition software module can set the number of seconds to start the countdown broadcast, and promptly drive the voice with a synchronous voice. The voice playback software module and the voice output interface in the voice output interface can be a general wired audio jack output and a wireless Bluetooth audio output.
本發明與其他習用技術相互比較時，更具備下列優點： The invention has the following advantages when compared with other conventional technologies:
1.本發明可利用電子影像辨識技術協助辨識前方交通標誌、燈號或讀秒器數字，並以語音播報方式告知駕駛人員，讓駕駛人員行車時不需為道路上的交通號誌判讀分散目光注意力，以提升行車安全。。 1. The invention can use electronic image recognition technology to assist in identifying the traffic signs, lights or countdown digits in front, and inform the driver by means of voice broadcast, so that the driver does not need to distract the traffic signs on the road when driving. Force to improve driving safety. .
2.本發明可利用一麥克風供語音擷取輸入及一語音辨識之聲控軟體模組，讓駕駛可不必分散目光注意力，直接以語詞聲音指令啟動、選用或關閉相關偵測辨識功能。 2. The invention can utilize a microphone for voice capture input and a voice recognition voice control software module, so that the driver can start, select or turn off the relevant detection and identification function directly by using the voice sound command without distracting the eye.
3.本發明可利用一具3D影像感測器晶片之後背鏡頭及手勢偵測控制軟體模組，提供非觸控手勢控制功能，讓駕駛可不必分散目光注意力，直接以手勢指令啟動、選用或關閉相關偵測辨識功能，進一步提升行車安全。 3. The invention can utilize a 3D image sensor chip back lens and a gesture detection control software module to provide a non-touch gesture control function, so that driving can be started and selected by gesture instructions without distracting attention. Or turn off the relevant detection and identification function to further improve driving safety.
4.本發明具有讀秒辨識估算功能，可使倒數計時顯示器的秒數與語音播報之秒數同步，並可設定開始倒數播報之秒數，適時以語音提醒駕駛，讓駕駛人員在等紅燈時，以聽覺取代視覺等候綠燈，讓目光注意力可稍做休息，使駕車等紅綠燈時更輕鬆更安全。 4. The invention has the function of counting the count recognition, which can synchronize the number of seconds of the countdown display with the number of seconds of the voice broadcast, and can set the number of seconds to start the countdown broadcast, and promptly use the voice to remind the driver to let the driver wait for the red light. Instead of listening to the visual green light, you can make your eyes look a little rest, making it easier and safer to drive traffic lights and other traffic lights.
上列詳細說明係針對本發明之一可行實施例之具體說明，惟該實施例並非用以限制本發明之專利範圍，凡未脫離本發明技藝精神所為之等效實施或變更，均應包含於本案之專利範圍中。 The detailed description of the preferred embodiments of the present invention is intended to be limited to the scope of the invention, and is not intended to limit the scope of the invention. The patent scope of this case.
綜上所述，本案不但在空間型態上確屬創新，並能較習用物品增進上述多項功效，應已充分符合新穎性及進步性之法定發明專利要件，爰依法提出申請，懇請 貴局核准本件發明專利申請案，以勵發明，至感德便。 In summary, this case is not only innovative in terms of space type, but also can enhance the above-mentioned multiple functions compared with the customary items. It should fully meet the statutory invention patent requirements of novelty and progressiveness, and apply for it according to law. This invention patent application, in order to invent invention, to the sense of virtue.
11‧‧‧攝影鏡頭 11‧‧‧Photographic lens
12‧‧‧行動運算處理裝置 12‧‧‧Mobile computing device
13‧‧‧麥克風 13‧‧‧ microphone
14‧‧‧具3D影像感測晶片之後背鏡頭 14‧‧‧With 3D image sensing chip and back lens
15‧‧‧語音輸出介面 15‧‧‧Voice output interface
16‧‧‧手勢偵測控制軟體模組 16‧‧‧ gesture detection control software module
17‧‧‧語音辨識之聲控軟體模組 17‧‧‧Sound recognition voice control software module
18‧‧‧交通標誌影像偵測分類及辨識軟體模組 18‧‧‧ Traffic Sign Image Detection Classification and Identification Software Module
19‧‧‧交通燈號與讀秒器偵測及辨識軟體模組 19‧‧‧ Traffic Lights and Countdown Detection and Identification Software Module
20‧‧‧語音播放軟體模組 20‧‧‧Voice playback software module
21‧‧‧功能選用輸出輸入軟體介面 21‧‧‧ Function selection output input software interface
第1圖為本發明之交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器之架構示意圖。 FIG. 1 is a schematic structural diagram of a voice broadcaster for detecting and recognizing a traffic sign, a traffic light number, and a countdown image of the present invention.
為利 貴審查委員了解本發明之技術特徵、內容與優點及其所能達到之功效，茲將本發明配合附圖，並以實施例之表達形式詳細說明如下，而其中所使用之圖式，其主旨僅為示意及輔助說明書之用，未必為本發明實施後之真實比例與精準配置，故不應就所附之圖式的比例與配置 關係解讀、侷限本發明於實際實施上的權利範圍，合先敘明。 The technical features, contents, and advantages of the present invention, as well as the advantages thereof, can be understood by the reviewing committee, and the present invention will be described in detail with reference to the accompanying drawings. The subject matter is only for the purpose of illustration and supplementary instructions. It is not necessarily the true proportion and precise configuration after the implementation of the invention. Therefore, the proportion and configuration of the attached drawings should not be used. Interpretation of Relationships The limitations of the scope of the invention in actual practice are set forth above.
請參考第1圖，為本發明之交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器之架構示意圖，如圖所示，裝設有一攝影鏡頭11、麥克風13、具3D影像感測晶片之後背鏡頭14及語音輸出介面15於行動運算處理裝置12上，形成本發明之交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器之硬體主體，以交通標誌偵測分類及辨識軟體模組18及交通燈號與讀秒器偵測及辨識軟體模組19來偵測及辨識攝影鏡頭11所擷取到影像內之交通標誌及燈號，另以手勢偵測控制軟體模組16或語音辨識之聲控軟體模組17來辨識輸入的語音訊號指令或影像手勢指令，並以功能選用輸出輸入軟體介面21依語音訊號指令或影像手勢指令來選用交通標誌及燈號之偵測及辨識功能，再以語音播放軟體模組20選取相對應辨識結果的語音檔，經語音輸出介面15輸送到揚聲器、車上音響或BlueTooth耳機等播放。除以上的主要架構外，另亦可加入通訊埠(可為WiFi或Bluetooth或3G或4G等任何無線通訊方式之收發信器)、GPS接收器及三維空間重力加速偵測器，提供整合更多的行動服務功能。 Please refer to FIG. 1 , which is a schematic structural diagram of a voice broadcaster for detecting and recognizing a traffic sign, a traffic light number, and a countdown image of the present invention. As shown in the figure, a photographic lens 11 , a microphone 13 , and a 3D image are mounted. After the wafer is processed, the back lens 14 and the voice output interface 15 are formed on the mobile processing device 12 to form a hardware body of the voice broadcaster of the traffic sign, the traffic light number and the image recorder of the present invention, and the traffic sign is used as a traffic sign. The detection and identification software module 18 and the traffic signal and the countdown detection and recognition software module 19 are used to detect and recognize the traffic signs and lights captured in the image by the photographic lens 11 and to detect the gestures. The control software module 16 or the voice recognition voice control software module 17 recognizes the input voice signal command or the image gesture command, and selects the traffic signal and the light signal according to the voice input command or the image gesture command by using the function output output software interface 21 The detection and identification function, and then the voice playback software module 20 selects the voice file corresponding to the recognition result, and transmits it to the speaker and the car audio through the voice output interface 15. BlueTooth headsets and other players. In addition to the above main architecture, you can also add a communication port (a wireless transceiver such as WiFi or Bluetooth or 3G or 4G), a GPS receiver and a three-dimensional gravity acceleration detector to provide more integration. Action service features.
其中攝影鏡頭11，為行車時前方影像的擷取裝置，提供交通標誌偵測分類及辨識軟體模組18及交通燈號與讀秒器偵測及辨識軟體模組19所需偵測及辨識的影像來源。 The photographic lens 11 is a capture device for the front image during driving, and provides the image detection and classification software module 18 and the traffic signal and the reading and detecting device to detect and recognize the image required by the software module 19 source.
其中行動運算處理裝置12為一高速高效能多核心處理器，以其輸出入通道與協同運算處理器、控制器、記憶體、通訊埠及語音輸出介面15，成為一數位運算處理的硬體輸入輸出裝置，為軟體提供各式數位資料輸入、運算、處理、傳送、控制及輸出的能力，亦可連接攝影鏡頭11、 麥克風13、具3D影像感測晶片之後背鏡頭14，及語音輸出介面15連接語音播放裝置等，以構成此交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器的硬體。 The mobile computing processing device 12 is a high-speed and high-performance multi-core processor, and is input and input channels and a cooperative computing processor, a controller, a memory, a communication port, and a voice output interface 15 to become a hardware input for digital processing. The output device provides the software with the ability to input, calculate, process, transmit, control and output various digital data, and can also be connected to the photographic lens 11, The microphone 13 has a 3D image sensing chip and the back lens 14 and the voice output interface 15 are connected to a voice playing device to form a hardware of the voice broadcaster for the traffic sign, the traffic signal and the image recognition and recognition of the reader.
其中麥克風13為此交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器的語音擷取輸入的裝置，提供語音辨識之聲控軟體模組17的音訊來源，辨識出來的語音訊號指令，便可用來選用交通標誌及燈號之偵測及辨識功能，讓駕駛可不必分散目光注意力，直接以語詞聲音指令啟動、選用或關閉相關偵測辨識功能。 The microphone 13 provides the voice capture input device of the voice broadcaster for the traffic sign, the traffic light number and the countdown image detection and identification, and provides the voice source of the voice recognition software module 17 for the voice recognition, and the recognized voice signal command It can be used to select the detection and identification function of traffic signs and lights, so that driving can start, select or turn off the relevant detection and identification functions directly without using distracting attention.
其中具3D影像感測晶片之後背鏡頭14，為此交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器的手勢影像輸入的來源，並可提供初步的3D手勢辨識，另配合手勢偵測控制軟體模組16來提供非觸控手勢控制功能，讓駕駛可不必分散目光注意力，直接以手勢指令啟動、選用或關閉相關偵測辨識功能，進一步提升行車安全。 The 3D image sensing chip and the back lens 14 are used as a source of gesture image input for the traffic sign, the traffic light number and the read-write image detection and identification of the voice broadcaster, and can provide preliminary 3D gesture recognition, and cooperate with The gesture detection control software module 16 provides a non-touch gesture control function, so that the driver can directly activate, select or turn off the relevant detection and recognition function by using the gesture command to further improve the driving safety without distracting the attention.
其中語音輸出介面15，為此交通標誌、交通燈號及讀秒器影像偵測及辨識的語音播報器的辨識結果的聲音輸出裝置，當交通標誌偵測分類及辨識軟體模組18或交通燈號與讀秒器偵測及辨識軟體模組19，依語音訊號指令或影像手勢指令來選用交通標誌及燈號之偵測及辨識功能，取得相關辨識結果後，便可以語音播放軟體模組20選取相對應辨識結果的語音檔，經此語音輸出介面15輸送到揚聲器、車上音響或BlueTooth耳機等播放。 The voice output interface 15 is a sound output device for the identification result of the traffic signal, the traffic light number and the readout image detection and identification of the voice broadcaster, when the traffic sign detection classification and identification software module 18 or the traffic signal number And the reading and detecting software module 19, according to the voice signal command or the image gesture command, select the detection and identification function of the traffic sign and the light signal, and after obtaining the relevant identification result, the voice playing software module 20 can select the phase. The voice file corresponding to the identification result is transmitted to the speaker, the car stereo or the BlueTooth earphone through the voice output interface 15.
其中手勢偵測控制軟體模組16主要是以具3D影像感測晶片之後背鏡頭14所提供的3D手勢辨識功能，將輸入的手勢影像轉為功能 選用指令，並經功能選用輸出輸入軟體介面21來選用相關交通標誌及燈號之偵測及辨識功能。 The gesture detection control software module 16 mainly uses a 3D gesture recognition function provided by the back lens 14 with the 3D image sensing chip, and converts the input gesture image into a function. Select the command and use the output input software interface 21 to select the detection and identification function of the relevant traffic signs and lights.
其中語音辨識之聲控軟體模組17則是將經由麥克風13輸入的語音訊號，經數位取樣運算辨識後，找出其相對應的語音指令，再經功能選用輸出輸入軟體介面21來選用相對應之交通標誌及燈號之偵測及辨識功能。 The voice recognition software module 17 for voice recognition is to identify the voice signal input through the microphone 13 by digital sampling operation, and then find out the corresponding voice command, and then select the corresponding input software interface 21 to select the corresponding voice. Detection and identification of traffic signs and lights.
其中交通標誌偵測分類及辨識軟體模組18其偵測方法是依據政府公布的道路交通標誌標線號誌設置規則”內所訂定標誌的顏色和形狀做交通標誌偵測。而在不同的光線強度下，顏色的呈現會有些微差異，為使特定的顏色能夠容易且正確地被萃取，顏色篩選的方式可利用RGB顏色系統，設定RGB數值與比例範圍來萃取目標物。或是利用HSI顏色系統下色相(hue)的範圍來萃取目標物，當偵測到可能的交通標誌後便可同樣依據政府公布的道路交通標誌標線號誌設置規則內所訂定的標誌設置規範來給予適當的模板，利用樣板比對法或Zernike moments距離比對法或採用鄰近的八個點方向尋找輪廓，以內輪廓和基本圓形、三角形、半圓形及長方形的數學法則或SVM方法做交通標誌分類，當完成交通標誌分類後，便可依功能選用輸出輸入軟體介面21的設定來對警告、禁制及指示等標誌內圖式、數字及文字等做全數或選擇性辨識。 Among them, the traffic sign detection classification and identification software module 18 is detected in accordance with the color and shape of the flag set in the government-issued road traffic sign marking code setting rule. Under the light intensity, the color will be slightly different. In order to make the specific color easy and correct to be extracted, the color screening method can use the RGB color system to set the RGB value and scale range to extract the target. Or use HSI. The hue of the color system extracts the target. When a possible traffic sign is detected, it can be appropriately given according to the flag setting specification set by the government's published road traffic sign marking rules. Templates using the template comparison method or Zernike moments distance comparison method or using the adjacent eight-point direction to find the contour, and the inner contour and the basic circular, triangular, semi-circular and rectangular mathematical rules or SVM method for traffic sign classification After completing the classification of the traffic signs, the settings of the output input software interface 21 can be selected according to the function to warn, prohibit and indicate Within a logo style, and so do the numbers and text in full or selective identification.
其中交通燈號與讀秒器偵測及辨識軟體模組19同樣係依據政府公布的道路交通標誌標線號誌設置規則內所訂定的燈號及其倒數計時顯示器的樣式及燈色來做偵測。當偵測到相關燈號及其倒數計時顯示器後，除了以一般色彩影像辨識方法辨識出燈號外，更在偵測到有倒數計時顯示 數字時，以影像數字辨識比對提供讀秒辨識，並以「行動式影像辨識交通號誌播報器」本身的時脈及運算處理時程來估算校正將顯示秒數與將播報之秒數之時差，以使倒數計時顯示器的秒數與語音播報之秒數精準同步，並依設定開始倒數播報之秒數，精準同步的以語音提醒駕駛目前顯示的倒數秒數。讓駕駛人員在等待紅燈時，以聽覺取代視覺等候綠燈，讓目光注意力可稍做休息，減少行車疲勞，增進行車安全。 The traffic light number and the countdown detection and identification software module 19 are also based on the light number set by the government's published road traffic sign marking code setting rules and the style and color of the countdown display. Measurement. When the relevant lamp number and its countdown display are detected, in addition to recognizing the lamp number by the general color image recognition method, a countdown display is detected. For digital, the image digital recognition comparison provides the count recognition, and the time and the processing time of the "action image recognition traffic signal broadcaster" itself are used to estimate the time difference between the number of seconds the correction will be displayed and the number of seconds to be broadcast. In order to accurately synchronize the number of seconds of the countdown display with the number of seconds of the voice announcement, and start the number of seconds of the countdown broadcast according to the setting, the precise synchronization of the voice reminds the driving of the countdown seconds currently displayed. Let the driver wait for the red light to replace the visual waiting green light, so that the attention can be a little rest, reduce driving fatigue and increase the safety of the car.
其中語音播放軟體模組20可依交通標誌偵測分類及辨識軟體模組18或交通燈號與讀秒器偵測及辨識軟體模組19所辨識之結果，選取相對應辨識結果的語音檔，經語音輸出介面15輸送到揚聲器、車上音響或BlueTooth耳機等播放。 The voice playing software module 20 can select the voice file corresponding to the identification result by using the traffic sign detection classification and identification software module 18 or the traffic light number and the result of the recognition of the reading and detecting software module 19. The voice output interface 15 is delivered to a speaker, a car stereo, or a BlueTooth headset.
其中功能選用輸出輸入軟體介面21主要是依手勢偵測控制軟體模組16，將輸入的手勢影像所轉為功能選用之指令或依語音辨識之聲控軟體模組17將輸入的語音訊號所轉為功能選用之指令，來選用相關交通標誌及燈號之偵測及辨識功能。 The function selection output input software interface 21 is mainly based on the gesture detection control software module 16, and the input gesture image is converted into a function selection command or the voice recognition software module 17 converts the input voice signal into The function selection command is used to select the detection and identification function of the relevant traffic signs and lights.
上列詳細說明乃針對本發明之一可行實施例進行具體說明，惟該實施例並非用以限制本發明之專利範圍，凡未脫離本發明技藝精神所為之等效實施或變更，均應包含於本案之專利範圍中。 The detailed description of the present invention is intended to be illustrative of a preferred embodiment of the invention, and is not intended to limit the scope of the invention. The patent scope of this case.
綜上所述，本案不僅於技術思想上確屬創新，並具備習用之傳統方法所不及之上述多項功效，已充分符合新穎性及進步性之法定發明專利要件，爰依法提出申請，懇請 貴局核准本件發明專利申請案，以勵發明，至感德便。 To sum up, this case is not only innovative in terms of technical thinking, but also has many of the above-mentioned functions that are not in the traditional methods of the past. It has fully complied with the statutory invention patent requirements of novelty and progressiveness, and applied for it according to law. Approved this invention patent application, in order to invent invention, to the sense of virtue.
11‧‧‧攝影鏡頭 11‧‧‧Photographic lens
12‧‧‧行動運算處理裝置 12‧‧‧Mobile computing device
13‧‧‧麥克風 13‧‧‧ microphone
14‧‧‧具3D影像感測晶片之後背鏡頭 14‧‧‧With 3D image sensing chip and back lens
15‧‧‧語音輸出介面 15‧‧‧Voice output interface
16‧‧‧手勢偵測控制軟體模組 16‧‧‧ gesture detection control software module
17‧‧‧語音辨識之聲控軟體模組 17‧‧‧Sound recognition voice control software module
18‧‧‧交通標誌偵測分類及辨識軟體模組 18‧‧‧ Traffic Sign Detection Classification and Identification Software Module
19‧‧‧交通燈號與讀秒器偵測及辨識軟體模組 19‧‧‧ Traffic Lights and Countdown Detection and Identification Software Module
20‧‧‧語音播放軟體模組 20‧‧‧Voice playback software module
21‧‧‧功能選用輸出輸入軟體介面 21‧‧‧ Function selection output input software interface
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW102129234A TWI591593B (en) | 2013-08-15 | 2013-08-15 | Traffic signs, traffic lights and timers for video detection and identification of voice announcers |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW102129234A TWI591593B (en) | 2013-08-15 | 2013-08-15 | Traffic signs, traffic lights and timers for video detection and identification of voice announcers |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201506860A TW201506860A (en) | 2015-02-16 |
| TWI591593B true TWI591593B (en) | 2017-07-11 |
Family
ID=53019453
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW102129234A TWI591593B (en) | 2013-08-15 | 2013-08-15 | Traffic signs, traffic lights and timers for video detection and identification of voice announcers |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI591593B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI564849B (en) * | 2015-10-30 | 2017-01-01 | 元智大學 | Real-time pedestrian countdown displayer |
| TWI745752B (en) * | 2019-09-23 | 2021-11-11 | 神達數位股份有限公司 | Method and system for driving assisting and computer program product |
-
2013
- 2013-08-15 TW TW102129234A patent/TWI591593B/en not_active IP Right Cessation
Also Published As
| Publication number | Publication date |
|---|---|
| TW201506860A (en) | 2015-02-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6562239B2 (en) | Display control apparatus, display control method, display control program, and projection apparatus | |
| CN107004362B (en) | Drive assistance device and driving assistance method | |
| JP5529910B2 (en) | Vehicle periphery monitoring device | |
| US11030816B2 (en) | Electronic apparatus, control method thereof, computer program, and computer-readable recording medium | |
| CN111710189B (en) | Control method for electronic device, and recording medium | |
| RU2017124586A (en) | VEHICLE AND RELATED METHOD FOR PROJECTIVE DISPLAY (OPTIONS) | |
| KR20150140449A (en) | Electronic apparatus, control method of electronic apparatus and computer readable recording medium | |
| US20150211878A1 (en) | On-vehicle display apparatus | |
| CN107945284B (en) | Scene display method for automatic driving vehicle and intelligent glasses | |
| JP2019021306A (en) | Augmented reality vehicle support for color blind person | |
| CN201307337Y (en) | Automatic alarming and monitoring device for traffic-lights nonobservance of pedestrian | |
| CN104537857B (en) | Based reminding method and system based on driving video instrument identification traffic-control device | |
| US9566909B2 (en) | Vehicle control system for providing warning message and method thereof | |
| CN104916150A (en) | Traffic safety presentation method applied to electronic device and electronic device | |
| CN106143308A (en) | Lane Departure Warning System based on intelligent back vision mirror | |
| WO2020063614A1 (en) | Smart glasses tracking method and apparatus, and smart glasses and storage medium | |
| TWI591593B (en) | Traffic signs, traffic lights and timers for video detection and identification of voice announcers | |
| Chang et al. | Design and implementation of an intelligent motorcycle helmet for large vehicle approach intimation | |
| JP4813304B2 (en) | Vehicle periphery monitoring device | |
| CN110422168A (en) | Lane recognition system, method and autonomous driving vehicle | |
| US9127941B2 (en) | System for measuring vehicle distance and method thereof | |
| CN105572869A (en) | Intelligent glasses and control method of the intelligent glasses | |
| TWI451990B (en) | System and method for lane localization and markings | |
| JP2014002721A (en) | Vehicle behavior analysis system, vehicle behavior analysis device and vehicle behavior analysis program | |
| CN205507805U (en) | Towards non - wearing formula traffic police gesture recognition system of remotely piloted vehicle's multidimension |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |