TWI772078B - Method and system for evaluating vehicle driver competency - Google Patents
Method and system for evaluating vehicle driver competency Download PDFInfo
- Publication number
- TWI772078B TWI772078B TW110123634A TW110123634A TWI772078B TW I772078 B TWI772078 B TW I772078B TW 110123634 A TW110123634 A TW 110123634A TW 110123634 A TW110123634 A TW 110123634A TW I772078 B TWI772078 B TW I772078B
- Authority
- TW
- Taiwan
- Prior art keywords
- vehicle
- driver
- data
- image information
- information
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 238000011156 evaluation Methods 0.000 claims abstract description 72
- 230000006996 mental state Effects 0.000 claims abstract description 71
- 230000004044 response Effects 0.000 claims abstract description 47
- 230000007613 environmental effect Effects 0.000 claims abstract description 33
- 230000001815 facial effect Effects 0.000 claims abstract description 29
- 230000008921 facial expression Effects 0.000 claims description 22
- 230000014509 gene expression Effects 0.000 claims description 21
- 238000004458 analytical method Methods 0.000 claims description 19
- 230000035484 reaction time Effects 0.000 claims description 9
- 238000005516 engineering process Methods 0.000 claims description 8
- 230000004962 physiological condition Effects 0.000 claims description 6
- 230000001186 cumulative effect Effects 0.000 claims description 5
- 238000001514 detection method Methods 0.000 claims 1
- 239000002184 metal Substances 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 8
- 206010029216 Nervousness Diseases 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 208000019901 Anxiety disease Diseases 0.000 description 2
- 235000002673 Dioscorea communis Nutrition 0.000 description 2
- 241000544230 Dioscorea communis Species 0.000 description 2
- 208000035753 Periorbital contusion Diseases 0.000 description 2
- 230000036506 anxiety Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000010219 correlation analysis Methods 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 241001282135 Poromitra oscitans Species 0.000 description 1
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000003920 cognitive function Effects 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 206010016256 fatigue Diseases 0.000 description 1
- 231100001261 hazardous Toxicity 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003923 mental ability Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Electric Propulsion And Braking For Vehicles (AREA)
Abstract
Description
本發明是有關於車輛駕駛人適任性評估,特別是指一種車輛駕駛人適任性評估方法及系統。 The present invention relates to the assessment of the suitability of a vehicle driver, in particular to a method and system for assessing the suitability of a vehicle driver.
人類的壽命已隨著醫療與科技的進步而逐漸延長。在高齡社會中,高齡駕駛人容易因心智能力上的退化而導致交通事故的發生。為了增進駕駛行車安全,大部分的車輛可選擇配置先進駕駛輔助系統(Advanced Driver Assistance Systems,簡稱ADAS),以降低例如碰撞、車道偏離等情況的發生。然而,目前採用的ADAS尚未能達到完全自動駕駛之功效,故仍須結合駕駛者本身適當的操控能力才能將危險降至最低。 Human lifespan has been gradually extended with the advancement of medicine and technology. In an aging society, elderly drivers are prone to traffic accidents due to the deterioration of their mental abilities. In order to improve driving safety, most vehicles can be optionally equipped with Advanced Driver Assistance Systems (ADAS) to reduce the occurrence of situations such as collisions and lane departures. However, the ADAS currently used has not yet achieved the effect of fully autonomous driving, so it is still necessary to combine the driver's own appropriate control ability to minimize the danger.
目前對於高齡駕駛人的駕駛執照管理規劃是針對例如屆滿75歲的駕駛人進行例如體格檢查、認知功能測驗等審查,通過審查者才得換照。然而,如此的審查機制並不能客觀地評估出高齡駕駛人在駕駛時實際的操控反應能力。 The current driving license management plan for senior drivers is to conduct examinations such as physical examinations and cognitive function tests for drivers who have reached the age of 75, and only those who pass the examination can change their licenses. However, such a review mechanism cannot objectively evaluate the actual handling response ability of elderly drivers while driving.
因此,為了兼顧高齡駕駛人的駕車權益及行車安全,如何客觀地評估出高齡駕駛人的適任性遂成為目前政府監理機構及車險業者急需解決的議題之一。 Therefore, in order to take into account the driving rights and driving safety of elderly drivers, how to objectively evaluate the suitability of elderly drivers has become one of the urgent issues that government supervision agencies and auto insurance companies need to solve.
因此,本發明的目的,即在提供一種車輛駕駛人適任性評估方法及系統,其能克服現有技術至少一個缺點。 Therefore, the purpose of the present invention is to provide a vehicle driver's suitability assessment method and system, which can overcome at least one disadvantage of the prior art.
於是,本發明所提供的一種車輛駕駛人適任性評估方法,用於評估駕駛一車輛的一駕駛人的適任性並利用一電腦系統來執行,該車輛駕駛人適任性評估方法包含以下步驟:(A)蒐集來自一穿戴於該駕駛人的電子裝置在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及來自該車輛所配置的一車載系統在該駕駛期間內獲得有關該車輛的行車狀況資訊、有關該車輛所處的外部環境的環境影像資訊和有關該駕駛人的臉部影像資訊;(B)分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於至少一特定路況的車速控制反應資料,並分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料;(C)根據該車速控制反應資料、該精神狀態資料和預定參考反應資料產生與車速控制反應能力有關的第一評估結果,並根據該精神狀態資料產生與精神狀態控制能力有關的第二評估結果; 及(D)至少根據該第一評估結果和該第二評估結果產生有關於該駕駛人的適任性評估結果。 Therefore, a method for assessing the suitability of a vehicle driver provided by the present invention is used to assess the suitability of a driver who drives a vehicle and is executed by a computer system, and the method for assessing the suitability of a vehicle driver comprises the following steps: ( A) Collect physiological information obtained from an electronic device worn on the driver by detecting the driver's physiological condition during a driving period, and from an in-vehicle system configured on the vehicle during the driving period. The driving condition information of the vehicle, the environmental image information about the external environment in which the vehicle is located, and the facial image information about the driver; (B) analyze the environmental image information and the driving condition information to obtain information about the driver at least Speed control response data of a specific road condition, and analyze the environmental image information, the physiological information, and the facial image information to obtain mental state data related to the driver's mental state; (C) Control the response data according to the vehicle speed . The mental state data and the predetermined reference response data generate a first evaluation result related to the vehicle speed control reaction ability, and generate a second evaluation result related to the mental state control ability according to the mental state data; and (D) generating a suitability assessment result about the driver based on at least the first assessment result and the second assessment result.
本發明的車輛駕駛人適任性評估方法,該車載系統包含一駕駛輔助系統,且在步驟(D)之前還包含以下步驟:(E)蒐集來自該車載系統由該駕駛輔助系統所提供在該駕駛期間內與偵測到至少一特定危險情況下發出之警示有關的警示紀錄。在步驟(D)中,該電腦系統不僅根據該第一評估結果和該第二評估結果,還根據該警示紀錄產生該適任性評估結果。 In the vehicle driver's suitability assessment method of the present invention, the in-vehicle system includes a driving assistance system, and before step (D), it further includes the following steps: (E) collecting information from the in-vehicle system provided by the driving assistance system in the driving Alert records related to alerts issued when at least one specific hazardous situation was detected during the period. In step (D), the computer system generates the suitability evaluation result not only according to the first evaluation result and the second evaluation result, but also according to the warning record.
本發明的車輛駕駛人適任性評估方法中,該駕駛期間是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定里程的期間。 In the vehicle driver suitability evaluation method of the present invention, the driving period is a period during which the vehicle continuously drives for a predetermined period of time, or a period during which the vehicle accumulates a predetermined mileage.
本發明的車輛駕駛人適任性評估方法中,步驟(B)包括以下操作:對該環境影像資訊進行有關於該至少一特定路況的影像辨識以獲得該環境影像資訊中出現有該至少一特定路況所對應的路況時間資料,其中該路況時間資料包含該環境影像資訊中每次出現有該至少一特定路況所對應的時間段;對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與一個或多個特定精神狀態相關聯的一個或多個特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車 狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。 In the vehicle driver suitability assessment method of the present invention, step (B) includes the following operations: performing image recognition on the environmental image information about the at least one specific road condition to obtain the at least one specific road condition present in the environmental image information Corresponding road condition time data, wherein the road condition time data includes the time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; perform facial expression recognition on the facial image information to obtain the facial image The information has expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states, wherein the expression time data includes each occurrence of the specific facial expression(s) in the facial image information. The time period corresponding to one of the facial expressions; The condition information is retrieved and the vehicle speed control response time corresponding to all time periods included in the road condition time data is taken as the vehicle speed control response data; according to the road condition time data and the facial expression time data, the time corresponding to the road condition is extracted from the physiological information Heart rate data for all time periods included in the data and for all time periods included in the expression time data; and analyzing the matching between the road condition time data, the expression time data, and the heart rate data to determine the mental state data, wherein the The mental state data includes the duration of each time the driver is in one of the specific mental state(s) during the driving period and the cumulative number of times he is in each specific mental state.
本發明的車輛駕駛人適任性評估方法,在步驟(D)之後,還包含以下步驟:(F)將該適任性評估結果輸出或傳送到至少一用戶終端。 After step (D), the method for evaluating the suitability of a vehicle driver of the present invention further includes the following step: (F) outputting or transmitting the suitability assessment result to at least one user terminal.
於是,本發明所提供的一種車輛駕駛人適任性評估系統是用於評估駕駛一車輛的一駕駛人的適任性,並包含一接收模組、一分析模組、及一評估模組。 Therefore, a vehicle driver suitability assessment system provided by the present invention is used to assess the suitability of a driver driving a vehicle, and includes a receiving module, an analysis module, and an evaluation module.
該接收模組組配來蒐集來自一穿戴於該駕駛人的電子裝置在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及來自該車輛所配置的車載系統在該駕駛期間內獲得有關該車輛的行車狀況資訊、有關該車輛所處外部環境的環境影像資訊和有關該駕駛人的臉部影像資訊。 The receiving module is configured to collect physiological information obtained from an electronic device worn on the driver by detecting the driver's physiological condition during a driving period, and from an in-vehicle system configured in the vehicle during the driving period The information about the driving condition of the vehicle, the environmental image information about the external environment where the vehicle is located, and the image information about the driver's face are obtained within the system.
該分析模組連接該接收模組以接收該生理資訊、該行車 狀況資訊、該環境影像資訊和該臉部影像資訊,並操作來分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於至少一特定路況的車速控制反應資料,且分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料。 The analysis module is connected to the receiving module to receive the physiological information, the driving situation information, the environment image information and the face image information, and operate to analyze the environment image information and the driving situation information to obtain the driver's speed control response data about at least one specific road condition, and analyze the environment image information , the physiological information and the facial image information to obtain mental state data related to the mental state of the driver.
該評估模組連接該分析模組以接收該車速控制反應資料和該精神狀態資料,並操作來根據該車速控制反應資料、該精神狀態資料和預定參考反應資料產生與車速控制反應能力有關的第一評估結果,且根據該精神狀態資料產生與精神狀態控制能力有關的第二評估結果。 The evaluation module is connected to the analysis module to receive the vehicle speed control response data and the mental state data, and is operated to generate the first information related to the vehicle speed control response ability according to the vehicle speed control response data, the mental state data and the predetermined reference response data an assessment result, and generate a second assessment result related to the mental state control ability according to the mental state data.
該評估模組還操作來至少根據該第一評估結果和該第二評估結果產生有關於該駕駛人的適任性評估結果。 The assessment module is also operative to generate a fitness assessment result regarding the driver based at least on the first assessment result and the second assessment result.
本發明的車輛駕駛人適任性評估系統中,該車載系統包含一駕駛輔助系統,並且該接收模組還蒐集來自該車載系統由該駕駛輔助系統所提供在該駕駛期間內與偵測到至少一特定危險情況下發出之警示有關的警示紀錄。該評估模組還連接該接收模組以接收該警示紀錄,並且不僅根據該第一評估結果和該第二評估結果,還根據該警示紀錄產生該適任性評估結果。 In the vehicle driver's suitability assessment system of the present invention, the in-vehicle system includes a driving assistance system, and the receiving module further collects data from the in-vehicle system provided by the driving assistance system during the driving period and detected at least one Alert records related to alerts issued under specific hazard situations. The evaluation module is also connected to the receiving module to receive the warning record, and generates the suitability evaluation result not only according to the first evaluation result and the second evaluation result, but also according to the warning record.
本發明的車輛駕駛人適任性評估系統中,該駕駛期間是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定 里程的期間。 In the vehicle driver suitability evaluation system of the present invention, the driving period is a period during which the vehicle continuously drives for a predetermined period of time, or the vehicle accumulates for a predetermined period of time. mileage period.
本發明的車輛駕駛人適任性評估系統中,該分析模組進行以下操作:利用影像辨識技術,對該環境影像資訊進行有關於該至少一特定路況的影像辨識以獲得該環境影像資訊中出現有該至少一特定路況所對應的路況時間資料,其中該路況時間資料包含該環境影像資訊中每次出現有該至少一特定路況所對應的時間段;利用影像辨識技術,對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與一個或多個特定精神狀態相關聯的一個或多個特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。 In the vehicle driver's suitability evaluation system of the present invention, the analysis module performs the following operations: using image recognition technology to perform image recognition on the environmental image information related to the at least one specific road condition to obtain the presence of existing information in the environmental image information. The road condition time data corresponding to the at least one specific road condition, wherein the road condition time data includes the time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; image recognition technology is used to analyze the facial image information. Facial expression recognition to obtain the facial image information There is expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states, wherein the expression time data includes the facial image information The time period corresponding to one of the specific facial expressions(s) appearing in the The reaction time is used as the speed control response data; according to the road condition time data and the expression time data, the heart rate data corresponding to all time periods included in the road condition time data and all time periods included in the expression time data are extracted from the physiological information ; and analyzing the match between the road condition time data, the expression time data and the heart rate data to determine the mental state data, wherein the mental state data includes each time the driver is in the (etc.) The duration of one of the specified mental states and the cumulative number of times in each of the specified mental states.
本發明的車輛駕駛人適任性評估系統還包含一輸出模 組。該輸出模組連接該評估模組,並操作來將來自該評估模組的該適任性評估結果輸出或傳送到至少一用戶終端。 The vehicle driver's suitability evaluation system of the present invention further comprises an output module Group. The output module is connected to the evaluation module and operates to output or transmit the suitability evaluation result from the evaluation module to at least one user terminal.
本發明的功效在於:透過駕駛人的生理資訊和臉部影像資訊、車輛的行車狀況資訊、環境影像資訊等大數據在時間上的關聯性分析而獲得駕駛人有關於車速控制反應的第一評估結果以及有關於精神狀態控制能力的第二評估結果,因而根據該第一評估結果和該第二評估結果所獲得有關駕駛人的適任性評估結果確實能客觀地評估出如高齡駕駛人在駕駛時實際的操控反應能力和精神狀態控制能力。 The effect of the present invention lies in: obtaining the first evaluation of the driver's response to the speed control through the correlation analysis of big data such as the driver's physiological information and facial image information, the driving condition information of the vehicle, and the environmental image information. The result and the second evaluation result about the mental state control ability, so the driver's suitability evaluation result obtained according to the first evaluation result and the second evaluation result can indeed objectively evaluate whether an elderly driver is driving when driving. Actual manipulative reflexes and mental state control.
100:車輛駕駛人適任性評估系統 100: Vehicle Driver Competency Assessment System
11:接收模組 11: Receive module
12:分析模組 12: Analysis module
13:評估模組 13: Evaluation Module
14:輸出模組 14: Output module
200:車載系統 200: Vehicle System
21:電子控制單元 21: Electronic control unit
22:人臉拍攝裝置 22: Face camera device
23:行車紀錄器 23: Driving recorder
24:駕駛輔助系統 24: Driving assistance systems
300:電子裝置 300: Electronics
400:用戶終端 400: User terminal
S21-S26:步驟 S21-S26: Steps
本發明的其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中:圖1是一方塊圖,示例地說明與一車載系統和一穿戴式電子裝置合併來使用的本發明實施例的車輛駕駛人適任性評估系統之架構;及圖2是一流程圖,示例地說明該實施例對於駕駛一車輛的駕駛人如何執行一適任性評估程序。 Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, wherein: FIG. 1 is a block diagram illustrating the present invention used in combination with an in-vehicle system and a wearable electronic device. The architecture of the vehicle driver suitability assessment system of the embodiment; and FIG. 2 is a flow chart illustrating how the embodiment performs a suitability assessment procedure for a driver driving a vehicle.
在本發明被詳細描述之前,應當注意在以下的說明內容中,類似的元件是以相同的編號來表示。 Before the present invention is described in detail, it should be noted that in the following description, similar elements are designated by the same reference numerals.
參閱圖1,本發明實施例的一種車輛駕駛人適任性評估系統100係用於評估駕駛一車輛的一駕駛人的適任性,並可以與一配置於該車輛的車載系統200和一穿戴於該駕駛人的電子裝置300結合來使用。
Referring to FIG. 1 , a vehicle driver
較佳地,該車載系統200可以包含一與該車輛之行車控制有關的電子控制單元(Electronic Control Unit,簡稱ECU,亦稱作行車電腦)21、一用來拍攝該駕駛人的臉部的人臉拍攝裝置22、一用來拍攝該車輛的外部環境的行車紀錄器23、及一用來提供例如車道偏離警示、前方防撞警示、車側盲點警示等的駕駛輔助系統(Driver Assistance System,簡稱DAS)24。值得注意的是,在本實施例中,該駕駛輔助系統24還可提供偵測到的一種或多種特定危險情況(例如車道偏離、與前車相距太近等)所發出之警示有關的警示紀錄。
Preferably, the in-
該電子裝置300例如可以是一用來感測該駕駛人如心率/脈搏的生理狀況的電子手環或智慧腕錶,並可以利用無線通訊將所獲得的生理資訊發送出去,但不在此限。值得注意的是,在其他實施例中,該電子裝置300亦可以支援短距無線通訊,例如但不限於藍芽通訊,而該車載系統200亦可被設計成能與該電子裝置300通
訊連接,以致該電子裝置300能將獲得的生理資訊傳送至該車載系統200。
The
在本實施例中,該車輛駕駛人適任性評估系統100可以實施成一電腦系統,並包含例如一接收模組11、一連接該接收模組11的分析模組12、一連接該分析模組12和該接收模組11的評估模組13、及一連接該評估模組13的輸出模組14。
In this embodiment, the vehicle driver
在本實施例中,該接收模組11可以包含適於電連接該車載系統200的一介面單元(圖未示)及/或可以與該車載系統200和該電子裝置300通訊的通訊單元(圖未示)。於是,當該接收模組11與該車載系統200電連接或通訊連接時可以接收來自該車載系統200的任何資料或資訊,而當該接收模組11與該電子裝置300通訊連接時可以接收來自該電子裝置300的生理資訊。值得注意的是,在實際使用時,若該電子裝置300選擇與該車載系統200通訊連接時,該接收模組11接收到來自該車載系統200的資訊可以包含該電子裝置300傳送至該車載系統200的的生理資訊。特別要說明的是,由於該車載系統200是根據該行車紀錄器23啟動時所接收的GPS信號中所含的衛星時間來決定該車載系統200的絕對時間軸並且將相對於此絕對時間軸所產生或獲得的資料或資訊傳送至該接收模組11,因此該接收模組11所接收的資料或資訊可有效避免時間軸不一致(即,時間軸偏移)的問題。
In this embodiment, the
值得注意的是,該分析模組12可以支援影像辨識技術,特別是對於該車輛在行駛途中的一個或多個特定路況(例如十字路口、叉路口、多路交會口、行人穿越道、高架道路、連續彎道、高速公路等)、與該駕駛人的一個或多個特定精神狀態(例如緊張、焦慮、疲倦、注意力不集中等精神狀態)相關聯一個或多個特定臉部表情(例如緊張、焦慮、閉眼、打哈欠等臉部表情以及眼神(黑眼球移動)的微表情)的影像辨識。該評估模組13事先儲存有經由大數據蒐集和分析而獲得的預定參考反應資料。舉例來說,該預定參考反應資料例如包括但不限於一合格駕駛人對於每一特定路況在各種不同精神狀態(例如,正常、緊張、焦慮、疲倦、注意力不集中、平靜/和緩等精神狀態)下的參考煞車/減速反應時間。至於該分析模組12的其他操作以及該評估模組13的詳細操作將分述於下文中。
It is worth noting that the
在本實施例中,該輸出模組14可以包含一顯示模組或列印模組(圖未示),或者可以包含一可與一個或多個用戶終端400(圖1僅繪示出一個)通訊連接的通訊模組(圖未示)。該(等)用戶終端400可以包括與該駕駛人有關的用戶所持有的終端裝置(例如手機、個人電腦、平板電腦等),以及監理機構和保險機構所屬的伺服裝置其中至少一者。
In this embodiment, the
以下,將參閱圖1及圖2來示例地詳細說明該車輛駕駛人適任性評估系統100對於該駕駛人如何執行一適任性評估程序。該
適任性評估程序例如可包含以下步驟S21~S26。
Hereinafter, referring to FIG. 1 and FIG. 2 , how the vehicle driver
首先,在步驟S21中,該接收模組11透過與該車載系統200的電連接或通訊連接,蒐集該電子裝置300在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及該車載系統200在該駕駛期間內由該電子控制單元21獲得有關該車輛的行車狀況資訊(例如可包含相對於時間的油門、引擎加/減速、煞車、方向盤的角速度等資訊)、由該行車紀錄器23獲得有關該車輛所處外部環境的環境影像資訊和由該人臉拍攝裝置22獲得有關該駕駛人的臉部影像資訊,並將蒐集到的該生理資訊、該行車狀況資訊、該環境影像資訊和該臉部影像資訊輸出至該分析模組12。值得注意的是,在本實施例中,該駕駛期間可以是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定里程的期間。換言之,該駕駛期間可以依照實際需求來設定為一相對短的期間,或是一相對長的期間。
First, in step S21, the receiving
然後,在步驟S22中,該分析模組12操作來分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於該(等)特定路況的車速控制反應資料,且分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料,並將該車速控制反應資料和該精神狀態資料輸出至該評估模組13。更明確地,該分析模組12在步驟S22中進行以下操作;利用有關於
路況辨識的影像辨識技術,對該環境影像資訊進行有關於該(等)特定路況的影像辨識以獲得該環境影像資訊中出現有該(等)特定路況其中每一者所對應的路況時間資料,其中該路況時間資料可以包含該環境影像資訊中每次出現有該(等)特定路況其中一者所對應的時間段;利用有關於人臉表情辨識的影像辨識技術,對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與該(等)特定精神狀態相關聯的該(等)特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間(例如,煞車/減速反應時間)作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定在該特定路況下該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。
Then, in step S22, the
舉例來說,對於年長的駕駛人而言,當該車輛正駛近亮著紅燈的路口時,該分析模組12可以根據該臉部影像資訊來分析此
年長的駕駛人是否出現有注意在前上方的(紅綠燈)號誌的眼神(即,黑眼球上斜的移動),可以根據該車速控制反應資料來分析此年長的駕駛人有關減速/煞車的控制能力或習慣,而且可以根據該環境資訊來分析該車輛最後煞停的位置(即,與前車或停止線之間的距離)是否適當;或者,當該車輛要轉彎或變換車道時,該分析模組12可以根據該臉部影像資訊來分析此年長的駕駛人是否出現有瞄向車內或車外的照後鏡的眼神或者是否出現有頭部側轉的動作,且可以根據該行車狀況資訊來分析該車輛的方向盤的角速度。如此,若該分析模組12分析出此年長的駕駛人在該車輛接近紅燈的路口時並未瞄向號誌或該車輛的停止位置超越停止線時,或者分析出此年長的駕駛人在該車輛轉彎或變換車道時並未有轉頭或瞄向照後鏡而逕自快速轉動方向盤時,該分析模組12可進一步將相關資訊加以標註,此標註可以作為不良駕駛習慣的標記,以供該評估模組13後續評估時的參考。
For example, for an elderly driver, when the vehicle is approaching an intersection with a red light on, the
接著,在步驟S23中,該評估模組13根據接收到的該車速控制反應資料、該精神狀態資料和該預定參考反應資料產生與車速控制反應能力有關的第一評估結果,且根據接收到的該精神狀態資料產生與精神狀態控制能力有關的第二評估結果。更具體地,該評估模組13可以先透過查找該車速控制反應資料和該精神狀態資料,計算出該駕駛人對於每一特定路況且處於同一精神狀態的車速控
制(保持定速、煞車/減速)反應時間的平均反應時間,再將計算出的平均反應時間與該預定參考反應資料所含對應於該該特定路況和該精神狀態的參考煞車/減速反應時間進行比較以獲得對應的比較結果,然後將有關於所有特定路況與所有精神狀態的所有比較結果作為該第一評估結果。舉例來說,該第一評估結果可以與兩種指標有關,其一是針對突發狀況的煞車反應能力,藉此來評估出駕駛人是否會在行經複雜路口時因精神方面緊張而導致速度暴衝;而另一種指標是針對維持定速的穩定性能力。另一方面,該評估模組13可以透過查找該精神狀態資料,計算出特別是該駕駛人處於不利於駕駛安全的疲倦、注意力不集中等精神狀態的頻率和平均持續時間,並將計算出的相關頻率和平均持續時間作為該第二評估結果。
Next, in step S23, the
另一方面,在步驟S24中,該接收模組11還蒐集來自該車載系統200由該駕駛輔助系統24所提供在該駕駛期間內偵測到該(等)特定危險情況所發出之警示有關的警示紀錄。然而,在其他實施例中,若車輛並未配置任何駕駛輔助系統時,步驟S24可被省略。
On the other hand, in step S24, the receiving
在步驟S23及步驟S24之後的步驟S25中,該評估模組13根據該第一評估結果、該第二評估結果以及接收自該車載系統200的該警示紀錄,產生有關於該駕駛人的適任性評估結果,並將該適任性評估結果傳送給該輸出模組14。更明確地,該適任性評估結果
可以包含由該第一評估結果所評估出該駕駛人在車速控制反應能力上的表現(即,反應快、反應慢或一般反應)、由該第二評估結果所評估出該駕駛人在精神狀態控制能力上的表現(即,控制好、控制差或一般控制),以及由該警示紀錄所評估出該駕駛人在駕駛習慣上的表現(即,安全駕駛或危險駕駛)。具體而言,有關該警示紀錄所評估出的駕駛人表現,例如由該駕駛輔助系統因避免如前車碰撞及/或車道偏離而啟動相關輔助駕駛操作的次數過於頻繁的情況將使得該適任性評估結果反映出該駕駛人的駕駛習慣傾向於危險駕駛而不適合上路。值得注意的是,在車輛未配置任何駕駛輔助系統的其他實施例中,該評估模組13亦可僅根據該第一評估結果和該第二評估結果來產生該適任性評估結果。
In step S23 and step S25 following step S24, the
最後,在步驟S26中,該輸出模組14可以將接收自該評估模組13的該適任性評估結果以顯示或列印的方式輸出,或者可以將該適任性評估結果傳送到該(等)用戶終端400。更具體地,若該(等)用戶終端400包含與該駕駛人有關的用戶(例如,職業駕駛人的公司主管)所持有的終端裝置時,則該用戶可根據該適任性評估結果來決定該駕駛人是否適任(例如,職業駕駛的工作);若該(等)用戶終端400包含保險機構所屬的伺服裝置時,則該保險機構可根據該適任性評估結果來決定該駕駛人的車險保費費率;若該(等)用戶終端400包含監理構所屬的伺服裝置時,則該監理機構可利用該適任性
評估結果作為該駕駛人(例如高齡駕駛人)是否給予換照的客觀依據。
Finally, in step S26, the
綜上所述,本發明車輛駕駛人適任性評估系統100對於駕駛人以及所駕駛之車輛可以透過長期或短期的駕駛期間之監控而獲得的駕駛人的生理資訊和臉部影像資訊、車輛的行車狀況資訊、環境影像資訊等大數據在時間上的關聯性分析而獲得駕駛人有關於車速控制反應的第一評估結果以及有關於精神狀態控制能力的第二評估結果,以及獲得車輛的警示紀錄,因而根據該第一評估結果、該第二評估結果和該警示紀錄所獲得有關駕駛人的適任性評估結果確實能客觀地評估出如高齡駕駛人或職業駕駛人在駕駛時實際的操控反應能力、精神狀態控制能力和駕駛習慣。因此,本發明車輛駕駛人適任性評估系統100確實能達成本發明的目的。
To sum up, the vehicle driver
惟以上所述者,僅為本發明的實施例而已,當不能以此限定本發明實施的範圍,凡是依本發明申請專利範圍及專利說明書內容所作的簡單的等效變化與修飾,皆仍屬本發明專利涵蓋的範圍內。 However, the above are only examples of the present invention, and should not limit the scope of implementation of the present invention. Any simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the contents of the patent specification are still included in the scope of the present invention. within the scope of the invention patent.
S21~S26:步驟 S21~S26: Steps
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110123634A TWI772078B (en) | 2021-06-28 | 2021-06-28 | Method and system for evaluating vehicle driver competency |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW110123634A TWI772078B (en) | 2021-06-28 | 2021-06-28 | Method and system for evaluating vehicle driver competency |
Publications (2)
Publication Number | Publication Date |
---|---|
TWI772078B true TWI772078B (en) | 2022-07-21 |
TW202300366A TW202300366A (en) | 2023-01-01 |
Family
ID=83439736
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW110123634A TWI772078B (en) | 2021-06-28 | 2021-06-28 | Method and system for evaluating vehicle driver competency |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI772078B (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107953892A (en) * | 2016-10-12 | 2018-04-24 | 德尔福电子(苏州)有限公司 | A kind of vehicle carried driving behavior integration assessment and correction system |
CN111452799A (en) * | 2020-05-11 | 2020-07-28 | 吴海娟 | Driving behavior evaluation method and system |
CN111645694A (en) * | 2020-04-15 | 2020-09-11 | 南京航空航天大学 | Driver driving state monitoring system and method based on attitude estimation |
CN112215093A (en) * | 2020-09-23 | 2021-01-12 | 易显智能科技有限责任公司 | Method and device for evaluating vehicle driving ability level |
TWI722647B (en) * | 2019-11-11 | 2021-03-21 | 中華電信股份有限公司 | System for driver estimation and method thereof |
-
2021
- 2021-06-28 TW TW110123634A patent/TWI772078B/en active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107953892A (en) * | 2016-10-12 | 2018-04-24 | 德尔福电子(苏州)有限公司 | A kind of vehicle carried driving behavior integration assessment and correction system |
TWI722647B (en) * | 2019-11-11 | 2021-03-21 | 中華電信股份有限公司 | System for driver estimation and method thereof |
CN111645694A (en) * | 2020-04-15 | 2020-09-11 | 南京航空航天大学 | Driver driving state monitoring system and method based on attitude estimation |
CN111452799A (en) * | 2020-05-11 | 2020-07-28 | 吴海娟 | Driving behavior evaluation method and system |
CN112215093A (en) * | 2020-09-23 | 2021-01-12 | 易显智能科技有限责任公司 | Method and device for evaluating vehicle driving ability level |
Also Published As
Publication number | Publication date |
---|---|
TW202300366A (en) | 2023-01-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11375338B2 (en) | Method for smartphone-based accident detection | |
Chhabra et al. | A survey on driver behavior detection techniques for intelligent transportation systems | |
US20230169867A1 (en) | Vehicle collision alert system and method for detecting driving hazards | |
CN107832748B (en) | Shared automobile driver replacing system and method | |
CN109774471B (en) | Vehicle-mounted equipment suitable for safe driving | |
CN202472863U (en) | Driver fatigue monitoring network system based on image information comprehensive evaluation | |
US12030476B2 (en) | Safe driving support system based on mobile IoT agent and method for processing thereof | |
WO2009148188A1 (en) | System for automatic evaluation of driving behavior | |
Guria et al. | Iot-enabled driver drowsiness detection using machine learning | |
CN106541948B (en) | A kind of driving safety auxiliary method, system and AR equipment | |
TWI772078B (en) | Method and system for evaluating vehicle driver competency | |
Patil et al. | Drowsy driver detection using OpenCV and Raspberry Pi3 | |
RU2703341C1 (en) | Method for determining hazardous conditions on public roads based on monitoring the situation in the cabin of a vehicle | |
WO2021005975A1 (en) | State determination device, on-vehicle instrument, driving assessment system, state determination method, and program | |
CN115610429A (en) | Driver ability evaluation method and system | |
Kim et al. | Driver reaction acceptance and evaluation to abnormal driving situations | |
Tyagi et al. | Sanjyot–we save life using big data-apache spark | |
Kim | Effectiveness of Collision Avoidance Technology | |
WO2020153932A1 (en) | Driver stress prediction and mitigation | |
WO2024062769A1 (en) | Driver assistance device, driver assistance system, and driver assist method | |
Tushaar et al. | UDDSUI: An Unsafe Driving Detection System Using IoT | |
Begum et al. | Vehicle black box system | |
Poliak et al. | Road freight transport driver fatique test: A pilot study | |
Yadav et al. | Multisource Data Fusion-based Driver Vigilance State Estimation using Arduino Mega and Node MCU | |
Beňuš et al. | Comparison of driver awareness in real traffic and driving on a simulator |