TWI772078B - Method and system for evaluating vehicle driver competency - Google Patents

Method and system for evaluating vehicle driver competency Download PDF

Info

Publication number
TWI772078B
TWI772078B TW110123634A TW110123634A TWI772078B TW I772078 B TWI772078 B TW I772078B TW 110123634 A TW110123634 A TW 110123634A TW 110123634 A TW110123634 A TW 110123634A TW I772078 B TWI772078 B TW I772078B
Authority
TW
Taiwan
Prior art keywords
vehicle
driver
data
image information
information
Prior art date
Application number
TW110123634A
Other languages
Chinese (zh)
Other versions
TW202300366A (en
Inventor
莊宜璋
Original Assignee
神達數位股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 神達數位股份有限公司 filed Critical 神達數位股份有限公司
Priority to TW110123634A priority Critical patent/TWI772078B/en
Application granted granted Critical
Publication of TWI772078B publication Critical patent/TWI772078B/en
Publication of TW202300366A publication Critical patent/TW202300366A/en

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Electric Propulsion And Braking For Vehicles (AREA)

Abstract

A method for evaluating vehicle driver competency includes: collecting, during a driving period, the physiological information of a driver detected by an electronic device worn on the driver, and driving condition information, environmental image information of an external environment and facial image information of the driver from an on-board system; analyzing the environmental image information and the driving condition information to obtain speed control response data related to specific road condition(s), and analyzing the environmental image information, the physiological information and the facial image information to obtain mental state data related to the driver’s mental state; and generating a competency evaluation result of the driver based on a first evaluation result, which is related to a speed control response ability of the driver and is generated based on the speed control response data, the metal state data and predetermined reference response data, and on a second evaluation result, which is related to a mental state control ability and is generated based on the mental state data.

Description

車輛駕駛人適任性評估方法及系統Vehicle driver suitability assessment method and system

本發明是有關於車輛駕駛人適任性評估,特別是指一種車輛駕駛人適任性評估方法及系統。 The present invention relates to the assessment of the suitability of a vehicle driver, in particular to a method and system for assessing the suitability of a vehicle driver.

人類的壽命已隨著醫療與科技的進步而逐漸延長。在高齡社會中,高齡駕駛人容易因心智能力上的退化而導致交通事故的發生。為了增進駕駛行車安全,大部分的車輛可選擇配置先進駕駛輔助系統(Advanced Driver Assistance Systems,簡稱ADAS),以降低例如碰撞、車道偏離等情況的發生。然而,目前採用的ADAS尚未能達到完全自動駕駛之功效,故仍須結合駕駛者本身適當的操控能力才能將危險降至最低。 Human lifespan has been gradually extended with the advancement of medicine and technology. In an aging society, elderly drivers are prone to traffic accidents due to the deterioration of their mental abilities. In order to improve driving safety, most vehicles can be optionally equipped with Advanced Driver Assistance Systems (ADAS) to reduce the occurrence of situations such as collisions and lane departures. However, the ADAS currently used has not yet achieved the effect of fully autonomous driving, so it is still necessary to combine the driver's own appropriate control ability to minimize the danger.

目前對於高齡駕駛人的駕駛執照管理規劃是針對例如屆滿75歲的駕駛人進行例如體格檢查、認知功能測驗等審查,通過審查者才得換照。然而,如此的審查機制並不能客觀地評估出高齡駕駛人在駕駛時實際的操控反應能力。 The current driving license management plan for senior drivers is to conduct examinations such as physical examinations and cognitive function tests for drivers who have reached the age of 75, and only those who pass the examination can change their licenses. However, such a review mechanism cannot objectively evaluate the actual handling response ability of elderly drivers while driving.

因此,為了兼顧高齡駕駛人的駕車權益及行車安全,如何客觀地評估出高齡駕駛人的適任性遂成為目前政府監理機構及車險業者急需解決的議題之一。 Therefore, in order to take into account the driving rights and driving safety of elderly drivers, how to objectively evaluate the suitability of elderly drivers has become one of the urgent issues that government supervision agencies and auto insurance companies need to solve.

因此,本發明的目的,即在提供一種車輛駕駛人適任性評估方法及系統,其能克服現有技術至少一個缺點。 Therefore, the purpose of the present invention is to provide a vehicle driver's suitability assessment method and system, which can overcome at least one disadvantage of the prior art.

於是,本發明所提供的一種車輛駕駛人適任性評估方法,用於評估駕駛一車輛的一駕駛人的適任性並利用一電腦系統來執行,該車輛駕駛人適任性評估方法包含以下步驟:(A)蒐集來自一穿戴於該駕駛人的電子裝置在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及來自該車輛所配置的一車載系統在該駕駛期間內獲得有關該車輛的行車狀況資訊、有關該車輛所處的外部環境的環境影像資訊和有關該駕駛人的臉部影像資訊;(B)分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於至少一特定路況的車速控制反應資料,並分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料;(C)根據該車速控制反應資料、該精神狀態資料和預定參考反應資料產生與車速控制反應能力有關的第一評估結果,並根據該精神狀態資料產生與精神狀態控制能力有關的第二評估結果; 及(D)至少根據該第一評估結果和該第二評估結果產生有關於該駕駛人的適任性評估結果。 Therefore, a method for assessing the suitability of a vehicle driver provided by the present invention is used to assess the suitability of a driver who drives a vehicle and is executed by a computer system, and the method for assessing the suitability of a vehicle driver comprises the following steps: ( A) Collect physiological information obtained from an electronic device worn on the driver by detecting the driver's physiological condition during a driving period, and from an in-vehicle system configured on the vehicle during the driving period. The driving condition information of the vehicle, the environmental image information about the external environment in which the vehicle is located, and the facial image information about the driver; (B) analyze the environmental image information and the driving condition information to obtain information about the driver at least Speed control response data of a specific road condition, and analyze the environmental image information, the physiological information, and the facial image information to obtain mental state data related to the driver's mental state; (C) Control the response data according to the vehicle speed . The mental state data and the predetermined reference response data generate a first evaluation result related to the vehicle speed control reaction ability, and generate a second evaluation result related to the mental state control ability according to the mental state data; and (D) generating a suitability assessment result about the driver based on at least the first assessment result and the second assessment result.

本發明的車輛駕駛人適任性評估方法,該車載系統包含一駕駛輔助系統,且在步驟(D)之前還包含以下步驟:(E)蒐集來自該車載系統由該駕駛輔助系統所提供在該駕駛期間內與偵測到至少一特定危險情況下發出之警示有關的警示紀錄。在步驟(D)中,該電腦系統不僅根據該第一評估結果和該第二評估結果,還根據該警示紀錄產生該適任性評估結果。 In the vehicle driver's suitability assessment method of the present invention, the in-vehicle system includes a driving assistance system, and before step (D), it further includes the following steps: (E) collecting information from the in-vehicle system provided by the driving assistance system in the driving Alert records related to alerts issued when at least one specific hazardous situation was detected during the period. In step (D), the computer system generates the suitability evaluation result not only according to the first evaluation result and the second evaluation result, but also according to the warning record.

本發明的車輛駕駛人適任性評估方法中,該駕駛期間是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定里程的期間。 In the vehicle driver suitability evaluation method of the present invention, the driving period is a period during which the vehicle continuously drives for a predetermined period of time, or a period during which the vehicle accumulates a predetermined mileage.

本發明的車輛駕駛人適任性評估方法中,步驟(B)包括以下操作:對該環境影像資訊進行有關於該至少一特定路況的影像辨識以獲得該環境影像資訊中出現有該至少一特定路況所對應的路況時間資料,其中該路況時間資料包含該環境影像資訊中每次出現有該至少一特定路況所對應的時間段;對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與一個或多個特定精神狀態相關聯的一個或多個特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車 狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。 In the vehicle driver suitability assessment method of the present invention, step (B) includes the following operations: performing image recognition on the environmental image information about the at least one specific road condition to obtain the at least one specific road condition present in the environmental image information Corresponding road condition time data, wherein the road condition time data includes the time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; perform facial expression recognition on the facial image information to obtain the facial image The information has expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states, wherein the expression time data includes each occurrence of the specific facial expression(s) in the facial image information. The time period corresponding to one of the facial expressions; The condition information is retrieved and the vehicle speed control response time corresponding to all time periods included in the road condition time data is taken as the vehicle speed control response data; according to the road condition time data and the facial expression time data, the time corresponding to the road condition is extracted from the physiological information Heart rate data for all time periods included in the data and for all time periods included in the expression time data; and analyzing the matching between the road condition time data, the expression time data, and the heart rate data to determine the mental state data, wherein the The mental state data includes the duration of each time the driver is in one of the specific mental state(s) during the driving period and the cumulative number of times he is in each specific mental state.

本發明的車輛駕駛人適任性評估方法,在步驟(D)之後,還包含以下步驟:(F)將該適任性評估結果輸出或傳送到至少一用戶終端。 After step (D), the method for evaluating the suitability of a vehicle driver of the present invention further includes the following step: (F) outputting or transmitting the suitability assessment result to at least one user terminal.

於是,本發明所提供的一種車輛駕駛人適任性評估系統是用於評估駕駛一車輛的一駕駛人的適任性,並包含一接收模組、一分析模組、及一評估模組。 Therefore, a vehicle driver suitability assessment system provided by the present invention is used to assess the suitability of a driver driving a vehicle, and includes a receiving module, an analysis module, and an evaluation module.

該接收模組組配來蒐集來自一穿戴於該駕駛人的電子裝置在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及來自該車輛所配置的車載系統在該駕駛期間內獲得有關該車輛的行車狀況資訊、有關該車輛所處外部環境的環境影像資訊和有關該駕駛人的臉部影像資訊。 The receiving module is configured to collect physiological information obtained from an electronic device worn on the driver by detecting the driver's physiological condition during a driving period, and from an in-vehicle system configured in the vehicle during the driving period The information about the driving condition of the vehicle, the environmental image information about the external environment where the vehicle is located, and the image information about the driver's face are obtained within the system.

該分析模組連接該接收模組以接收該生理資訊、該行車 狀況資訊、該環境影像資訊和該臉部影像資訊,並操作來分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於至少一特定路況的車速控制反應資料,且分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料。 The analysis module is connected to the receiving module to receive the physiological information, the driving situation information, the environment image information and the face image information, and operate to analyze the environment image information and the driving situation information to obtain the driver's speed control response data about at least one specific road condition, and analyze the environment image information , the physiological information and the facial image information to obtain mental state data related to the mental state of the driver.

該評估模組連接該分析模組以接收該車速控制反應資料和該精神狀態資料,並操作來根據該車速控制反應資料、該精神狀態資料和預定參考反應資料產生與車速控制反應能力有關的第一評估結果,且根據該精神狀態資料產生與精神狀態控制能力有關的第二評估結果。 The evaluation module is connected to the analysis module to receive the vehicle speed control response data and the mental state data, and is operated to generate the first information related to the vehicle speed control response ability according to the vehicle speed control response data, the mental state data and the predetermined reference response data an assessment result, and generate a second assessment result related to the mental state control ability according to the mental state data.

該評估模組還操作來至少根據該第一評估結果和該第二評估結果產生有關於該駕駛人的適任性評估結果。 The assessment module is also operative to generate a fitness assessment result regarding the driver based at least on the first assessment result and the second assessment result.

本發明的車輛駕駛人適任性評估系統中,該車載系統包含一駕駛輔助系統,並且該接收模組還蒐集來自該車載系統由該駕駛輔助系統所提供在該駕駛期間內與偵測到至少一特定危險情況下發出之警示有關的警示紀錄。該評估模組還連接該接收模組以接收該警示紀錄,並且不僅根據該第一評估結果和該第二評估結果,還根據該警示紀錄產生該適任性評估結果。 In the vehicle driver's suitability assessment system of the present invention, the in-vehicle system includes a driving assistance system, and the receiving module further collects data from the in-vehicle system provided by the driving assistance system during the driving period and detected at least one Alert records related to alerts issued under specific hazard situations. The evaluation module is also connected to the receiving module to receive the warning record, and generates the suitability evaluation result not only according to the first evaluation result and the second evaluation result, but also according to the warning record.

本發明的車輛駕駛人適任性評估系統中,該駕駛期間是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定 里程的期間。 In the vehicle driver suitability evaluation system of the present invention, the driving period is a period during which the vehicle continuously drives for a predetermined period of time, or the vehicle accumulates for a predetermined period of time. mileage period.

本發明的車輛駕駛人適任性評估系統中,該分析模組進行以下操作:利用影像辨識技術,對該環境影像資訊進行有關於該至少一特定路況的影像辨識以獲得該環境影像資訊中出現有該至少一特定路況所對應的路況時間資料,其中該路況時間資料包含該環境影像資訊中每次出現有該至少一特定路況所對應的時間段;利用影像辨識技術,對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與一個或多個特定精神狀態相關聯的一個或多個特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。 In the vehicle driver's suitability evaluation system of the present invention, the analysis module performs the following operations: using image recognition technology to perform image recognition on the environmental image information related to the at least one specific road condition to obtain the presence of existing information in the environmental image information. The road condition time data corresponding to the at least one specific road condition, wherein the road condition time data includes the time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; image recognition technology is used to analyze the facial image information. Facial expression recognition to obtain the facial image information There is expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states, wherein the expression time data includes the facial image information The time period corresponding to one of the specific facial expressions(s) appearing in the The reaction time is used as the speed control response data; according to the road condition time data and the expression time data, the heart rate data corresponding to all time periods included in the road condition time data and all time periods included in the expression time data are extracted from the physiological information ; and analyzing the match between the road condition time data, the expression time data and the heart rate data to determine the mental state data, wherein the mental state data includes each time the driver is in the (etc.) The duration of one of the specified mental states and the cumulative number of times in each of the specified mental states.

本發明的車輛駕駛人適任性評估系統還包含一輸出模 組。該輸出模組連接該評估模組,並操作來將來自該評估模組的該適任性評估結果輸出或傳送到至少一用戶終端。 The vehicle driver's suitability evaluation system of the present invention further comprises an output module Group. The output module is connected to the evaluation module and operates to output or transmit the suitability evaluation result from the evaluation module to at least one user terminal.

本發明的功效在於:透過駕駛人的生理資訊和臉部影像資訊、車輛的行車狀況資訊、環境影像資訊等大數據在時間上的關聯性分析而獲得駕駛人有關於車速控制反應的第一評估結果以及有關於精神狀態控制能力的第二評估結果,因而根據該第一評估結果和該第二評估結果所獲得有關駕駛人的適任性評估結果確實能客觀地評估出如高齡駕駛人在駕駛時實際的操控反應能力和精神狀態控制能力。 The effect of the present invention lies in: obtaining the first evaluation of the driver's response to the speed control through the correlation analysis of big data such as the driver's physiological information and facial image information, the driving condition information of the vehicle, and the environmental image information. The result and the second evaluation result about the mental state control ability, so the driver's suitability evaluation result obtained according to the first evaluation result and the second evaluation result can indeed objectively evaluate whether an elderly driver is driving when driving. Actual manipulative reflexes and mental state control.

100:車輛駕駛人適任性評估系統 100: Vehicle Driver Competency Assessment System

11:接收模組 11: Receive module

12:分析模組 12: Analysis module

13:評估模組 13: Evaluation Module

14:輸出模組 14: Output module

200:車載系統 200: Vehicle System

21:電子控制單元 21: Electronic control unit

22:人臉拍攝裝置 22: Face camera device

23:行車紀錄器 23: Driving recorder

24:駕駛輔助系統 24: Driving assistance systems

300:電子裝置 300: Electronics

400:用戶終端 400: User terminal

S21-S26:步驟 S21-S26: Steps

本發明的其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中:圖1是一方塊圖,示例地說明與一車載系統和一穿戴式電子裝置合併來使用的本發明實施例的車輛駕駛人適任性評估系統之架構;及圖2是一流程圖,示例地說明該實施例對於駕駛一車輛的駕駛人如何執行一適任性評估程序。 Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, wherein: FIG. 1 is a block diagram illustrating the present invention used in combination with an in-vehicle system and a wearable electronic device. The architecture of the vehicle driver suitability assessment system of the embodiment; and FIG. 2 is a flow chart illustrating how the embodiment performs a suitability assessment procedure for a driver driving a vehicle.

在本發明被詳細描述之前,應當注意在以下的說明內容中,類似的元件是以相同的編號來表示。 Before the present invention is described in detail, it should be noted that in the following description, similar elements are designated by the same reference numerals.

參閱圖1,本發明實施例的一種車輛駕駛人適任性評估系統100係用於評估駕駛一車輛的一駕駛人的適任性,並可以與一配置於該車輛的車載系統200和一穿戴於該駕駛人的電子裝置300結合來使用。 Referring to FIG. 1 , a vehicle driver suitability assessment system 100 according to an embodiment of the present invention is used to assess the suitability of a driver driving a vehicle, and can be combined with an in-vehicle system 200 configured in the vehicle and a vehicle worn on the vehicle. The driver's electronic device 300 is used in combination.

較佳地,該車載系統200可以包含一與該車輛之行車控制有關的電子控制單元(Electronic Control Unit,簡稱ECU,亦稱作行車電腦)21、一用來拍攝該駕駛人的臉部的人臉拍攝裝置22、一用來拍攝該車輛的外部環境的行車紀錄器23、及一用來提供例如車道偏離警示、前方防撞警示、車側盲點警示等的駕駛輔助系統(Driver Assistance System,簡稱DAS)24。值得注意的是,在本實施例中,該駕駛輔助系統24還可提供偵測到的一種或多種特定危險情況(例如車道偏離、與前車相距太近等)所發出之警示有關的警示紀錄。 Preferably, the in-vehicle system 200 may include an electronic control unit (Electronic Control Unit, ECU for short, also called a trip computer) 21 related to the driving control of the vehicle, a person for photographing the driver's face. A face photographing device 22, a driving recorder 23 for photographing the external environment of the vehicle, and a driver assistance system (Driver Assistance System, referred to as abbreviated as Lane Departure Warning, Forward Collision Warning, Side Blind Spot Warning, etc.) DAS) 24. It should be noted that, in this embodiment, the driving assistance system 24 may also provide warning records related to warnings issued by one or more specific dangerous situations detected (eg, lane departure, too close to the preceding vehicle, etc.). .

該電子裝置300例如可以是一用來感測該駕駛人如心率/脈搏的生理狀況的電子手環或智慧腕錶,並可以利用無線通訊將所獲得的生理資訊發送出去,但不在此限。值得注意的是,在其他實施例中,該電子裝置300亦可以支援短距無線通訊,例如但不限於藍芽通訊,而該車載系統200亦可被設計成能與該電子裝置300通 訊連接,以致該電子裝置300能將獲得的生理資訊傳送至該車載系統200。 The electronic device 300 can be, for example, an electronic wristband or a smart watch used to sense the driver's physiological conditions such as heart rate/pulse, and can transmit the obtained physiological information through wireless communication, but not limited thereto. It should be noted that in other embodiments, the electronic device 300 can also support short-range wireless communication, such as but not limited to Bluetooth communication, and the in-vehicle system 200 can also be designed to communicate with the electronic device 300 The electronic device 300 can transmit the obtained physiological information to the in-vehicle system 200 .

在本實施例中,該車輛駕駛人適任性評估系統100可以實施成一電腦系統,並包含例如一接收模組11、一連接該接收模組11的分析模組12、一連接該分析模組12和該接收模組11的評估模組13、及一連接該評估模組13的輸出模組14。 In this embodiment, the vehicle driver suitability assessment system 100 can be implemented as a computer system, and includes, for example, a receiving module 11 , an analysis module 12 connected to the receiving module 11 , and a connection to the analysis module 12 . and the evaluation module 13 of the receiving module 11 , and an output module 14 connected to the evaluation module 13 .

在本實施例中,該接收模組11可以包含適於電連接該車載系統200的一介面單元(圖未示)及/或可以與該車載系統200和該電子裝置300通訊的通訊單元(圖未示)。於是,當該接收模組11與該車載系統200電連接或通訊連接時可以接收來自該車載系統200的任何資料或資訊,而當該接收模組11與該電子裝置300通訊連接時可以接收來自該電子裝置300的生理資訊。值得注意的是,在實際使用時,若該電子裝置300選擇與該車載系統200通訊連接時,該接收模組11接收到來自該車載系統200的資訊可以包含該電子裝置300傳送至該車載系統200的的生理資訊。特別要說明的是,由於該車載系統200是根據該行車紀錄器23啟動時所接收的GPS信號中所含的衛星時間來決定該車載系統200的絕對時間軸並且將相對於此絕對時間軸所產生或獲得的資料或資訊傳送至該接收模組11,因此該接收模組11所接收的資料或資訊可有效避免時間軸不一致(即,時間軸偏移)的問題。 In this embodiment, the receiving module 11 may include an interface unit (not shown in the figure) suitable for electrically connecting to the in-vehicle system 200 and/or a communication unit (not shown in the figure) capable of communicating with the in-vehicle system 200 and the electronic device 300 not shown). Therefore, when the receiving module 11 is electrically or communicatively connected to the in-vehicle system 200 , it can receive any data or information from the in-vehicle system 200 , and when the receiving module 11 is in communication with the electronic device 300 , it can receive any data or information from the in-vehicle system 200 . Physiological information of the electronic device 300 . It is worth noting that, in actual use, if the electronic device 300 chooses to communicate with the in-vehicle system 200, the information received by the receiving module 11 from the in-vehicle system 200 may include the electronic device 300 transmitting the information to the in-vehicle system 200 of physiological information. It should be noted that, because the in-vehicle system 200 determines the absolute time axis of the in-vehicle system 200 according to the satellite time contained in the GPS signal received when the driving recorder 23 is activated, and will be relative to the absolute time axis The generated or obtained data or information is transmitted to the receiving module 11 , so the data or information received by the receiving module 11 can effectively avoid the problem of time axis inconsistency (ie, time axis offset).

值得注意的是,該分析模組12可以支援影像辨識技術,特別是對於該車輛在行駛途中的一個或多個特定路況(例如十字路口、叉路口、多路交會口、行人穿越道、高架道路、連續彎道、高速公路等)、與該駕駛人的一個或多個特定精神狀態(例如緊張、焦慮、疲倦、注意力不集中等精神狀態)相關聯一個或多個特定臉部表情(例如緊張、焦慮、閉眼、打哈欠等臉部表情以及眼神(黑眼球移動)的微表情)的影像辨識。該評估模組13事先儲存有經由大數據蒐集和分析而獲得的預定參考反應資料。舉例來說,該預定參考反應資料例如包括但不限於一合格駕駛人對於每一特定路況在各種不同精神狀態(例如,正常、緊張、焦慮、疲倦、注意力不集中、平靜/和緩等精神狀態)下的參考煞車/減速反應時間。至於該分析模組12的其他操作以及該評估模組13的詳細操作將分述於下文中。 It is worth noting that the analysis module 12 can support image recognition technology, especially for one or more specific road conditions (such as intersections, forks, multi-way intersections, pedestrian crossings, elevated roads) on the way of the vehicle. , continuous curves, highways, etc.), one or more specific facial expressions (such as mental states such as nervousness, anxiety, fatigue, inattentiveness, etc.) associated with the driver’s specific mental state or states Image recognition of facial expressions such as nervousness, anxiety, eyes closed, yawning, and micro-expressions of eyes (black eye movements). The evaluation module 13 stores predetermined reference response data obtained through big data collection and analysis in advance. For example, the predetermined reference response data includes, but is not limited to, a qualified driver in various mental states (eg, normal, nervous, anxious, tired, inattention, calm/moderate, etc.) for each specific road condition. ) for reference braking/deceleration reaction times. Other operations of the analysis module 12 and detailed operations of the evaluation module 13 will be described below.

在本實施例中,該輸出模組14可以包含一顯示模組或列印模組(圖未示),或者可以包含一可與一個或多個用戶終端400(圖1僅繪示出一個)通訊連接的通訊模組(圖未示)。該(等)用戶終端400可以包括與該駕駛人有關的用戶所持有的終端裝置(例如手機、個人電腦、平板電腦等),以及監理機構和保險機構所屬的伺服裝置其中至少一者。 In this embodiment, the output module 14 may include a display module or a printing module (not shown), or may include a user terminal 400 (only one is shown in FIG. 1 ) that can be connected to one or more user terminals 400 . Communication module for communication connection (not shown). The user terminal(s) 400 may include a terminal device (such as a mobile phone, a personal computer, a tablet computer, etc.) held by the user related to the driver, and at least one of a server device belonging to a supervisory institution and an insurance institution.

以下,將參閱圖1及圖2來示例地詳細說明該車輛駕駛人適任性評估系統100對於該駕駛人如何執行一適任性評估程序。該 適任性評估程序例如可包含以下步驟S21~S26。 Hereinafter, referring to FIG. 1 and FIG. 2 , how the vehicle driver suitability assessment system 100 performs a suitability assessment procedure for the driver will be described in detail by way of example. Should The suitability evaluation procedure may include, for example, the following steps S21 to S26.

首先,在步驟S21中,該接收模組11透過與該車載系統200的電連接或通訊連接,蒐集該電子裝置300在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及該車載系統200在該駕駛期間內由該電子控制單元21獲得有關該車輛的行車狀況資訊(例如可包含相對於時間的油門、引擎加/減速、煞車、方向盤的角速度等資訊)、由該行車紀錄器23獲得有關該車輛所處外部環境的環境影像資訊和由該人臉拍攝裝置22獲得有關該駕駛人的臉部影像資訊,並將蒐集到的該生理資訊、該行車狀況資訊、該環境影像資訊和該臉部影像資訊輸出至該分析模組12。值得注意的是,在本實施例中,該駕駛期間可以是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定里程的期間。換言之,該駕駛期間可以依照實際需求來設定為一相對短的期間,或是一相對長的期間。 First, in step S21, the receiving module 11 collects the physiological information obtained by the electronic device 300 by detecting the physiological condition of the driver during a driving period through the electrical connection or communication connection with the in-vehicle system 200, and During the driving period, the in-vehicle system 200 obtains information about the driving conditions of the vehicle from the electronic control unit 21 (for example, it may include information such as accelerator, engine acceleration/deceleration, braking, angular velocity of the steering wheel, etc. relative to time), and from the driving The recorder 23 obtains the environmental image information about the external environment where the vehicle is located and the face image information about the driver obtained by the face photographing device 22, and collects the physiological information, the driving condition information, the environment The image information and the facial image information are output to the analysis module 12 . It should be noted that, in this embodiment, the driving period may be a period during which the vehicle continuously drives for a predetermined period of time, or a period during which the vehicle accumulates a predetermined mileage. In other words, the driving period can be set as a relatively short period or a relatively long period according to actual needs.

然後,在步驟S22中,該分析模組12操作來分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於該(等)特定路況的車速控制反應資料,且分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料,並將該車速控制反應資料和該精神狀態資料輸出至該評估模組13。更明確地,該分析模組12在步驟S22中進行以下操作;利用有關於 路況辨識的影像辨識技術,對該環境影像資訊進行有關於該(等)特定路況的影像辨識以獲得該環境影像資訊中出現有該(等)特定路況其中每一者所對應的路況時間資料,其中該路況時間資料可以包含該環境影像資訊中每次出現有該(等)特定路況其中一者所對應的時間段;利用有關於人臉表情辨識的影像辨識技術,對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與該(等)特定精神狀態相關聯的該(等)特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間(例如,煞車/減速反應時間)作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定在該特定路況下該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。 Then, in step S22, the analysis module 12 operates to analyze the environmental image information and the driving condition information to obtain the driver's speed control response data about the specific road condition(s), and analyze the environmental image information, The physiological information and the facial image information are obtained to obtain mental state data related to the mental state of the driver, and the vehicle speed control response data and the mental state data are output to the evaluation module 13 . More specifically, the analysis module 12 performs the following operations in step S22; An image recognition technology for road condition recognition, performing image recognition on the environmental image information about the specific road condition(s) to obtain road condition time data corresponding to each of the specific road conditions(s) appearing in the environmental image information, The road condition time data may include the time period corresponding to each occurrence of one of the specific road conditions(s) in the environmental image information; using the image recognition technology related to facial expression recognition, the facial image information is processed Facial expression recognition to obtain the facial image information There is expression time data corresponding to the specific facial expression(s) associated with the specific mental state(s), wherein the facial expression time data includes the facial image information The time period corresponding to one of the specific facial expressions(s) appearing in the Reaction time (eg, braking/deceleration reaction time) is used as the vehicle speed control response data; according to the road condition time data and the expression time data, extract all time periods and the expression time corresponding to the road condition time data from the physiological information heart rate data for all time periods included in the data; and analyzing the match between the road condition time data, the expression time data and the heart rate data to determine the mental state data under the specific road condition, wherein the mental state data includes the The duration of each time the driver is in one of the specific mental state(s) during the driving period and the cumulative number of times the driver is in each specific mental state.

舉例來說,對於年長的駕駛人而言,當該車輛正駛近亮著紅燈的路口時,該分析模組12可以根據該臉部影像資訊來分析此 年長的駕駛人是否出現有注意在前上方的(紅綠燈)號誌的眼神(即,黑眼球上斜的移動),可以根據該車速控制反應資料來分析此年長的駕駛人有關減速/煞車的控制能力或習慣,而且可以根據該環境資訊來分析該車輛最後煞停的位置(即,與前車或停止線之間的距離)是否適當;或者,當該車輛要轉彎或變換車道時,該分析模組12可以根據該臉部影像資訊來分析此年長的駕駛人是否出現有瞄向車內或車外的照後鏡的眼神或者是否出現有頭部側轉的動作,且可以根據該行車狀況資訊來分析該車輛的方向盤的角速度。如此,若該分析模組12分析出此年長的駕駛人在該車輛接近紅燈的路口時並未瞄向號誌或該車輛的停止位置超越停止線時,或者分析出此年長的駕駛人在該車輛轉彎或變換車道時並未有轉頭或瞄向照後鏡而逕自快速轉動方向盤時,該分析模組12可進一步將相關資訊加以標註,此標註可以作為不良駕駛習慣的標記,以供該評估模組13後續評估時的參考。 For example, for an elderly driver, when the vehicle is approaching an intersection with a red light on, the analysis module 12 can analyze this information according to the facial image information. Whether the older driver has eyes that pay attention to the (traffic light) sign above the front (i.e., the upward sloping movement of the black eye), the speed control response data of the older driver can be used to analyze the deceleration/braking of the older driver the control ability or habit, and can analyze whether the last braking position of the vehicle (that is, the distance from the preceding vehicle or the stop line) is appropriate based on the environmental information; or, when the vehicle is about to turn or change lanes, The analysis module 12 can analyze, according to the facial image information, whether the elderly driver is looking at the rear mirror in the car or outside the car, or whether there is a head turning action, Driving condition information to analyze the angular velocity of the vehicle's steering wheel. In this way, if the analysis module 12 analyzes that the elderly driver does not aim at the sign when the vehicle is approaching a red light intersection or the vehicle's stop position exceeds the stop line, or analyzes that the elderly driver When the person turns the steering wheel quickly without turning his head or aiming at the rear mirror when the vehicle turns or changes lanes, the analysis module 12 can further mark the relevant information, and the mark can be used as a sign of bad driving habits. For reference in the subsequent evaluation of the evaluation module 13 .

接著,在步驟S23中,該評估模組13根據接收到的該車速控制反應資料、該精神狀態資料和該預定參考反應資料產生與車速控制反應能力有關的第一評估結果,且根據接收到的該精神狀態資料產生與精神狀態控制能力有關的第二評估結果。更具體地,該評估模組13可以先透過查找該車速控制反應資料和該精神狀態資料,計算出該駕駛人對於每一特定路況且處於同一精神狀態的車速控 制(保持定速、煞車/減速)反應時間的平均反應時間,再將計算出的平均反應時間與該預定參考反應資料所含對應於該該特定路況和該精神狀態的參考煞車/減速反應時間進行比較以獲得對應的比較結果,然後將有關於所有特定路況與所有精神狀態的所有比較結果作為該第一評估結果。舉例來說,該第一評估結果可以與兩種指標有關,其一是針對突發狀況的煞車反應能力,藉此來評估出駕駛人是否會在行經複雜路口時因精神方面緊張而導致速度暴衝;而另一種指標是針對維持定速的穩定性能力。另一方面,該評估模組13可以透過查找該精神狀態資料,計算出特別是該駕駛人處於不利於駕駛安全的疲倦、注意力不集中等精神狀態的頻率和平均持續時間,並將計算出的相關頻率和平均持續時間作為該第二評估結果。 Next, in step S23, the evaluation module 13 generates a first evaluation result related to the vehicle speed control response ability according to the received vehicle speed control response data, the mental state data and the predetermined reference response data, and according to the received This mental state profile produces a second assessment related to the ability to control the mental state. More specifically, the evaluation module 13 can first calculate the speed control of the driver in the same mental state for each specific road condition by searching the speed control response data and the mental state data. Calculate the average reaction time of the reaction time (maintaining a constant speed, braking/decelerating), and then compare the calculated average reaction time with the reference braking/deceleration reaction time corresponding to the specific road condition and mental state contained in the predetermined reference reaction data Comparisons are made to obtain corresponding comparison results, and then there are all comparison results regarding all specific road conditions and all mental states as the first evaluation result. For example, the first evaluation result can be related to two indicators, one is the braking response ability in response to emergencies, so as to evaluate whether the driver will be mentally tense when passing through complex intersections and lead to speed violence. rush; and another indicator is the stability of the ability to maintain a constant speed. On the other hand, the evaluation module 13 can calculate the frequency and average duration of mental states such as fatigue, inattention, etc., which are not conducive to driving safety, by looking up the mental state data, and calculate the The correlation frequency and average duration of , as the second evaluation result.

另一方面,在步驟S24中,該接收模組11還蒐集來自該車載系統200由該駕駛輔助系統24所提供在該駕駛期間內偵測到該(等)特定危險情況所發出之警示有關的警示紀錄。然而,在其他實施例中,若車輛並未配置任何駕駛輔助系統時,步驟S24可被省略。 On the other hand, in step S24, the receiving module 11 also collects information from the in-vehicle system 200 provided by the driving assistance system 24 to detect the warning issued by the specific dangerous situation(s) during the driving period. Warning record. However, in other embodiments, if the vehicle is not equipped with any driving assistance system, step S24 may be omitted.

在步驟S23及步驟S24之後的步驟S25中,該評估模組13根據該第一評估結果、該第二評估結果以及接收自該車載系統200的該警示紀錄,產生有關於該駕駛人的適任性評估結果,並將該適任性評估結果傳送給該輸出模組14。更明確地,該適任性評估結果 可以包含由該第一評估結果所評估出該駕駛人在車速控制反應能力上的表現(即,反應快、反應慢或一般反應)、由該第二評估結果所評估出該駕駛人在精神狀態控制能力上的表現(即,控制好、控制差或一般控制),以及由該警示紀錄所評估出該駕駛人在駕駛習慣上的表現(即,安全駕駛或危險駕駛)。具體而言,有關該警示紀錄所評估出的駕駛人表現,例如由該駕駛輔助系統因避免如前車碰撞及/或車道偏離而啟動相關輔助駕駛操作的次數過於頻繁的情況將使得該適任性評估結果反映出該駕駛人的駕駛習慣傾向於危險駕駛而不適合上路。值得注意的是,在車輛未配置任何駕駛輔助系統的其他實施例中,該評估模組13亦可僅根據該第一評估結果和該第二評估結果來產生該適任性評估結果。 In step S23 and step S25 following step S24, the evaluation module 13 generates information about the driver's suitability according to the first evaluation result, the second evaluation result and the warning record received from the in-vehicle system 200 The evaluation result is sent to the output module 14 . More specifically, the suitability assessment results It can include the performance of the driver's speed control response ability (ie, fast response, slow response or general response) assessed by the first assessment result, and the driver's mental state assessed by the second assessment result. Control performance (ie, good control, poor control, or normal control), and the driver's performance in driving habits (ie, safe driving or dangerous driving) as assessed by the alert record. Specifically, with respect to the driver's performance as assessed by the warning record, such as the fact that the driving assistance system initiates the relevant driving assistance operations too frequently in order to avoid, for example, preceding vehicle collisions and/or lane departures, the suitability will be compromised. The assessment results reflect that the driver's driving habits tend to be dangerous and unsuitable for road use. It should be noted that, in other embodiments where the vehicle is not equipped with any driving assistance system, the evaluation module 13 may also generate the suitability evaluation result only according to the first evaluation result and the second evaluation result.

最後,在步驟S26中,該輸出模組14可以將接收自該評估模組13的該適任性評估結果以顯示或列印的方式輸出,或者可以將該適任性評估結果傳送到該(等)用戶終端400。更具體地,若該(等)用戶終端400包含與該駕駛人有關的用戶(例如,職業駕駛人的公司主管)所持有的終端裝置時,則該用戶可根據該適任性評估結果來決定該駕駛人是否適任(例如,職業駕駛的工作);若該(等)用戶終端400包含保險機構所屬的伺服裝置時,則該保險機構可根據該適任性評估結果來決定該駕駛人的車險保費費率;若該(等)用戶終端400包含監理構所屬的伺服裝置時,則該監理機構可利用該適任性 評估結果作為該駕駛人(例如高齡駕駛人)是否給予換照的客觀依據。 Finally, in step S26, the output module 14 may output the suitability assessment result received from the assessment module 13 in a display or print manner, or may transmit the suitability assessment result to the (etc.) User terminal 400 . More specifically, if the user terminal(s) 400 includes a terminal device held by a user related to the driver (for example, a company executive of a professional driver), the user can decide according to the result of the suitability evaluation. Whether the driver is qualified (for example, professional driving); if the user terminal(s) 400 includes a server device belonging to an insurance institution, the insurance institution can determine the driver's auto insurance premium according to the result of the assessment of suitability Rates; if the user terminal(s) 400 include a server device to which a supervisory authority belongs, the supervisory authority may take advantage of the suitability The evaluation result serves as an objective basis for the driver (such as an elderly driver) to grant a license replacement.

綜上所述,本發明車輛駕駛人適任性評估系統100對於駕駛人以及所駕駛之車輛可以透過長期或短期的駕駛期間之監控而獲得的駕駛人的生理資訊和臉部影像資訊、車輛的行車狀況資訊、環境影像資訊等大數據在時間上的關聯性分析而獲得駕駛人有關於車速控制反應的第一評估結果以及有關於精神狀態控制能力的第二評估結果,以及獲得車輛的警示紀錄,因而根據該第一評估結果、該第二評估結果和該警示紀錄所獲得有關駕駛人的適任性評估結果確實能客觀地評估出如高齡駕駛人或職業駕駛人在駕駛時實際的操控反應能力、精神狀態控制能力和駕駛習慣。因此,本發明車輛駕駛人適任性評估系統100確實能達成本發明的目的。 To sum up, the vehicle driver suitability evaluation system 100 of the present invention can monitor the driver and the vehicle he drives by monitoring the driver's physiological information and facial image information, and the driving condition of the vehicle through monitoring during long-term or short-term driving. The temporal correlation analysis of big data such as condition information and environmental image information is used to obtain the driver's first assessment result on the speed control response and the second assessment result on the mental state control ability, and obtain the vehicle's warning record, Therefore, according to the first evaluation result, the second evaluation result and the warning record, the driver's suitability evaluation result can indeed objectively evaluate, for example, the actual handling response ability of an elderly driver or a professional driver when driving, Mental state control and driving habits. Therefore, the vehicle driver's suitability evaluation system 100 of the present invention can indeed achieve the purpose of the present invention.

惟以上所述者,僅為本發明的實施例而已,當不能以此限定本發明實施的範圍,凡是依本發明申請專利範圍及專利說明書內容所作的簡單的等效變化與修飾,皆仍屬本發明專利涵蓋的範圍內。 However, the above are only examples of the present invention, and should not limit the scope of implementation of the present invention. Any simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the contents of the patent specification are still included in the scope of the present invention. within the scope of the invention patent.

S21~S26:步驟 S21~S26: Steps

Claims (10)

一種車輛駕駛人適任性評估方法,用於評估駕駛一車輛的一駕駛人的適任性並利用一電腦系統來執行,該車輛駕駛人適任性評估方法包含以下步驟:(A)蒐集來自一穿戴於該駕駛人的電子裝置在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及來自該車輛所配置的一車載系統在該駕駛期間內獲得有關該車輛的行車狀況資訊、有關該車輛所處的外部環境的環境影像資訊和有關該駕駛人的臉部影像資訊;(B)分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於至少一特定路況的車速控制反應資料,並分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料;(C)根據該車速控制反應資料、該精神狀態資料和預定參考反應資料產生與車速控制反應能力有關的第一評估結果,並根據該精神狀態資料產生與精神狀態控制能力有關的第二評估結果;及(D)至少根據該第一評估結果和該第二評估結果產生有關於該駕駛人的適任性評估結果。 A vehicle driver's suitability assessment method for assessing the suitability of a driver driving a vehicle and using a computer system to execute, the vehicle driver's suitability assessment method comprising the following steps: (A) collecting data from a vehicle wearing Physiological information obtained by the driver's electronic device detecting the driver's physiological condition during a driving period, and driving condition information about the vehicle obtained from an in-vehicle system configured in the vehicle during the driving period, relevant Environmental image information of the external environment where the vehicle is located and facial image information about the driver; (B) analyzing the environmental image information and the driving condition information to obtain the driver's speed control response to at least one specific road condition data, and analyze the environmental image information, the physiological information and the facial image information to obtain the mental state data related to the mental state of the driver; (C) control the response data, the mental state data and the predetermined state according to the vehicle speed generating a first evaluation result related to vehicle speed control response ability with reference to the response data, and generating a second evaluation result related to mental state control ability based on the mental state data; and (D) at least based on the first evaluation result and the second evaluation result The evaluation result produces a fitness evaluation result about the driver. 如請求項1所述的車輛駕駛人適任性評估方法,該車載系統包含一駕駛輔助系統,在步驟(D)之前還包含以下步驟:(E)蒐集來自該車載系統由該駕駛輔助系統所提供在該駕駛期間內與偵測到至少一特定危險情況時發出之 警示有關的警示紀錄;其中,在步驟(D)中,該電腦系統不僅根據該第一評估結果和該第二評估結果,還根據該警示紀錄產生該適任性評估結果。 According to the method for evaluating the suitability of a vehicle driver according to claim 1, the vehicle-mounted system includes a driving assistance system, and before step (D), it further comprises the following steps: (E) collecting information from the vehicle-mounted system provided by the driving assistance system Sent during the driving period and when at least one specific dangerous situation is detected The warning record related to the warning; wherein, in step (D), the computer system generates the suitability assessment result not only according to the first assessment result and the second assessment result, but also according to the warning record. 如請求項1或2所述的車輛駕駛人適任性評估方法,其中,該駕駛期間是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定里程的期間。 The method for evaluating the suitability of a vehicle driver according to claim 1 or 2, wherein the driving period is a period during which the vehicle continuously drives for a predetermined period of time, or a period during which the vehicle accumulates a predetermined mileage. 如請求項1或2所述的車輛駕駛人適任性評估方法,其中,步驟(B)包括以下操作:對該環境影像資訊進行有關於該至少一特定路況的影像辨識以獲得該環境影像資訊中出現有該至少一特定路況所對應的路況時間資料,其中該路況時間資料包含該環境影像資訊中每次出現有該至少一特定路況所對應的時間段;對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與一個或多個特定精神狀態相關聯的一個或多個特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該 表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。 The method for evaluating the suitability of a vehicle driver according to claim 1 or 2, wherein step (B) includes the following operation: performing image recognition on the at least one specific road condition on the environmental image information to obtain the environmental image information. There is road condition time data corresponding to the at least one specific road condition, wherein the road condition time data includes the time period corresponding to each occurrence of the at least one specific road condition in the environmental image information; facial expression is performed on the facial image information Identify to obtain the facial image information that there is expression time data corresponding to one or more specific facial expressions associated with one or more specific mental states, wherein the expression time data includes each time in the facial image information. There is a time period corresponding to one of the specific facial expressions(s); according to the road condition time data, the vehicle speed control reaction time corresponding to all time periods included in the road condition time data is extracted from the driving condition information as the vehicle speed control response data; according to the road condition time data and the facial expression time data, extract from the physiological information all the time periods and the time corresponding to the road condition time data. Heart rate data for all time periods included in the expression time data; and analyzing the match between the road condition time data, the expression time data and the heart rate data to determine the mental state data, wherein the mental state data includes the driver's The duration of each time in one of the specific mental state(s) during the driving period and the cumulative number of times in each specific mental state. 如請求項1或2所述的車輛駕駛人適任性評估方法,在步驟(D)之後,還包含以下步驟:(F)將該適任性評估結果輸出或傳送到至少一用戶終端。 The method for assessing the suitability of a vehicle driver according to claim 1 or 2, after step (D), further comprising the following step: (F) outputting or transmitting the suitability assessment result to at least one user terminal. 一種車輛駕駛人適任性評估系統,用於評估駕駛一車輛的一駕駛人的適任性,並包含:一接收模組,組配來蒐集來自一穿戴於該駕駛人的電子裝置在一駕駛期間內偵測該駕駛人之生理狀況所獲得的生理資訊,以及來自該車輛所配置的車載系統在該駕駛期間內獲得有關該車輛的行車狀況資訊、有關該車輛所處外部環境的環境影像資訊和有關該駕駛人的臉部影像資訊;一分析模組,連接該接收模組以接收該生理資訊、該行車狀況資訊、該環境影像資訊和該臉部影像資訊,並操作來分析該環境影像資訊和該行車狀況資訊以獲得該駕駛人有關於至少一特定路況的車速控制反應資料,且分析該環境影像資訊、該生理資訊和該臉部影像資訊以獲得與該駕駛人所處精神狀態有關的精神狀態資料;及 一評估模組,連接該分析模組以接收該車速控制反應資料和該精神狀態資料,並操作來根據該車速控制反應資料、該精神狀態資料和預定參考反應資料產生與車速控制反應能力有關的第一評估結果,且根據該精神狀態資料產生與精神狀態控制能力有關的第二評估結果;該評估模組還操作來至少根據該第一評估結果和該第二評估結果產生有關於該駕駛人的適任性評估結果。 A vehicle driver suitability assessment system for assessing the suitability of a driver driving a vehicle, and comprising: a receiving module configured to collect information from an electronic device worn by the driver during a driving period Physiological information obtained by detecting the physiological condition of the driver, and information about the driving condition of the vehicle, environmental image information about the external environment where the vehicle is located, and related information obtained from the vehicle-mounted system configured on the vehicle during the driving period the driver's face image information; an analysis module connected to the receiving module to receive the physiological information, the driving condition information, the environment image information and the face image information, and operate to analyze the environment image information and The driving condition information is obtained to obtain the driver's speed control response data about at least one specific road condition, and the environmental image information, the physiological information and the facial image information are analyzed to obtain the mental state related to the driver's state of mind. status information; and an evaluation module, connected to the analysis module to receive the vehicle speed control response data and the mental state data, and operated to generate a response capability related to the vehicle speed control according to the vehicle speed control response data, the mental state data and the predetermined reference response data a first evaluation result, and generating a second evaluation result related to mental state control ability based on the mental state data; the evaluation module is further operative to generate information about the driver based on at least the first evaluation result and the second evaluation result aptitude assessment results. 如請求項6所述的車輛駕駛人適任性評估系統,該車載系統包含一駕駛輔助系統,其中:該接收模組還蒐集來自該車載系統由該駕駛輔助系統所提供在該駕駛期間內與偵測到至少一特定危險情況時發出之警示有關的警示紀錄;及該評估模組還連接該接收模組以接收該警示紀錄,並且不僅根據該第一評估結果和該第二評估結果,還根據該警示紀錄產生該適任性評估結果。 The vehicle driver's suitability assessment system as claimed in claim 6, the vehicle-mounted system comprises a driving assistance system, wherein: the receiving module further collects data from the vehicle-mounted system provided by the driving assistance system during the driving period and the detection The warning record related to the warning issued when at least one specific dangerous situation is detected; and the evaluation module is also connected to the receiving module to receive the warning record, and not only according to the first evaluation result and the second evaluation result, but also according to The alert record produces the fitness assessment result. 如請求項6或7所述的車輛駕駛人適任性評估系統,其中,該駕駛期間是該車輛連續行駛一預定時段的期間,或者是該車輛累積行駛一預定里程的期間。 The vehicle driver suitability assessment system according to claim 6 or 7, wherein the driving period is a period during which the vehicle continuously drives for a predetermined period of time, or a period during which the vehicle accumulates a predetermined mileage. 如請求項6或7所述的車輛駕駛人適任性評估系統,其中,該分析模組進行以下操作:利用影像辨識技術,對該環境影像資訊進行有關於該至少一特定路況的影像辨識以獲得該環境影像資訊中出現有該至少一特定路況所對應的路況時間資料,其中該路況時間資料包含該環境影像資訊中每次出現有該至 少一特定路況所對應的時間段;利用影像辨識技術,對該臉部影像資訊進行臉部表情辨識以獲得該臉部影像資訊出現有與一個或多個特定精神狀態相關聯的一個或多個特定臉部表情所對應的表情時間資料,其中該表情時間資料包含該臉部影像資訊中每次出現有該(等)特定臉部表情其中一者所對應的時間段;根據該路況時間資料,從該行車狀況資訊擷取出對應於該路況時間資料所含的所有時間段的車速控制反應時間作為該車速控制反應資料;根據該路況時間資料和該表情時間資料,從該生理資訊擷取出對應於該路況時間資料所含所有時間段和該表情時間資料所含所有時間段的心率資料;及分析該路況時間資料、該表情時間資料和該心率資料彼此之間的相配性以確定該精神狀態資料,其中該精神狀態資料包含該駕駛人在該駕駛期間內每次處於該(等)特定精神狀態其中一者的持續時間以及處於每一特定精神狀態的累積次數。 The vehicle driver suitability assessment system according to claim 6 or 7, wherein the analysis module performs the following operations: using image recognition technology to perform image recognition on the at least one specific road condition on the environmental image information to obtain The road condition time data corresponding to the at least one specific road condition appears in the environmental image information, wherein the road condition time data includes each occurrence of the to-date in the environmental image information A time period corresponding to a specific road condition is omitted; using image recognition technology, facial expression recognition is performed on the facial image information to obtain that the facial image information has one or more associated with one or more specific mental states. Expression time data corresponding to a specific facial expression, wherein the expression time data includes the time period corresponding to each occurrence of one of the (or other) specific facial expressions in the facial image information; according to the road condition time data, The vehicle speed control response time corresponding to all time periods included in the road condition time data is extracted from the driving condition information as the vehicle speed control response data; Heart rate data of all time periods included in the road condition time data and all time periods included in the expression time data; and analyzing the match between the road condition time data, the expression time data, and the heart rate data to determine the mental state data , wherein the mental state data includes the duration of each time the driver is in one of the specific mental state(s) during the driving period and the cumulative number of times he is in each specific mental state. 如請求項6或7所述的車輛駕駛人適任性評估系統,還包含:一輸出模組,連接該評估模組,並操作來將來自該評估模組的該適任性評估結果輸出或傳送到至少一用戶終端。 The vehicle driver suitability assessment system according to claim 6 or 7, further comprising: an output module connected to the assessment module and operative to output or transmit the suitability assessment result from the assessment module to at least one user terminal.
TW110123634A 2021-06-28 2021-06-28 Method and system for evaluating vehicle driver competency TWI772078B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110123634A TWI772078B (en) 2021-06-28 2021-06-28 Method and system for evaluating vehicle driver competency

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110123634A TWI772078B (en) 2021-06-28 2021-06-28 Method and system for evaluating vehicle driver competency

Publications (2)

Publication Number Publication Date
TWI772078B true TWI772078B (en) 2022-07-21
TW202300366A TW202300366A (en) 2023-01-01

Family

ID=83439736

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110123634A TWI772078B (en) 2021-06-28 2021-06-28 Method and system for evaluating vehicle driver competency

Country Status (1)

Country Link
TW (1) TWI772078B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107953892A (en) * 2016-10-12 2018-04-24 德尔福电子(苏州)有限公司 A kind of vehicle carried driving behavior integration assessment and correction system
CN111452799A (en) * 2020-05-11 2020-07-28 吴海娟 Driving behavior evaluation method and system
CN111645694A (en) * 2020-04-15 2020-09-11 南京航空航天大学 Driver driving state monitoring system and method based on attitude estimation
CN112215093A (en) * 2020-09-23 2021-01-12 易显智能科技有限责任公司 Method and device for evaluating vehicle driving ability level
TWI722647B (en) * 2019-11-11 2021-03-21 中華電信股份有限公司 System for driver estimation and method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107953892A (en) * 2016-10-12 2018-04-24 德尔福电子(苏州)有限公司 A kind of vehicle carried driving behavior integration assessment and correction system
TWI722647B (en) * 2019-11-11 2021-03-21 中華電信股份有限公司 System for driver estimation and method thereof
CN111645694A (en) * 2020-04-15 2020-09-11 南京航空航天大学 Driver driving state monitoring system and method based on attitude estimation
CN111452799A (en) * 2020-05-11 2020-07-28 吴海娟 Driving behavior evaluation method and system
CN112215093A (en) * 2020-09-23 2021-01-12 易显智能科技有限责任公司 Method and device for evaluating vehicle driving ability level

Also Published As

Publication number Publication date
TW202300366A (en) 2023-01-01

Similar Documents

Publication Publication Date Title
US11375338B2 (en) Method for smartphone-based accident detection
Chhabra et al. A survey on driver behavior detection techniques for intelligent transportation systems
US20230169867A1 (en) Vehicle collision alert system and method for detecting driving hazards
CN107832748B (en) Shared automobile driver replacing system and method
CN109774471B (en) Vehicle-mounted equipment suitable for safe driving
CN202472863U (en) Driver fatigue monitoring network system based on image information comprehensive evaluation
US12030476B2 (en) Safe driving support system based on mobile IoT agent and method for processing thereof
WO2009148188A1 (en) System for automatic evaluation of driving behavior
Guria et al. Iot-enabled driver drowsiness detection using machine learning
CN106541948B (en) A kind of driving safety auxiliary method, system and AR equipment
TWI772078B (en) Method and system for evaluating vehicle driver competency
Patil et al. Drowsy driver detection using OpenCV and Raspberry Pi3
RU2703341C1 (en) Method for determining hazardous conditions on public roads based on monitoring the situation in the cabin of a vehicle
WO2021005975A1 (en) State determination device, on-vehicle instrument, driving assessment system, state determination method, and program
CN115610429A (en) Driver ability evaluation method and system
Kim et al. Driver reaction acceptance and evaluation to abnormal driving situations
Tyagi et al. Sanjyot–we save life using big data-apache spark
Kim Effectiveness of Collision Avoidance Technology
WO2020153932A1 (en) Driver stress prediction and mitigation
WO2024062769A1 (en) Driver assistance device, driver assistance system, and driver assist method
Tushaar et al. UDDSUI: An Unsafe Driving Detection System Using IoT
Begum et al. Vehicle black box system
Poliak et al. Road freight transport driver fatique test: A pilot study
Yadav et al. Multisource Data Fusion-based Driver Vigilance State Estimation using Arduino Mega and Node MCU
Beňuš et al. Comparison of driver awareness in real traffic and driving on a simulator