FR3100640B1 - Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule - Google Patents

Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule Download PDF

Info

Publication number
FR3100640B1
FR3100640B1 FR1909925A FR1909925A FR3100640B1 FR 3100640 B1 FR3100640 B1 FR 3100640B1 FR 1909925 A FR1909925 A FR 1909925A FR 1909925 A FR1909925 A FR 1909925A FR 3100640 B1 FR3100640 B1 FR 3100640B1
Authority
FR
France
Prior art keywords
driver
vehicle
yawn
yawns
detecting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
FR1909925A
Other languages
English (en)
Other versions
FR3100640A1 (fr
Inventor
Abdelaziz Omar Ben
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faurecia Interieur Industrie SAS
Original Assignee
Faurecia Interieur Industrie SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Faurecia Interieur Industrie SAS filed Critical Faurecia Interieur Industrie SAS
Priority to FR1909925A priority Critical patent/FR3100640B1/fr
Priority to CN202010933720.9A priority patent/CN112560568A/zh
Priority to DE102020123672.7A priority patent/DE102020123672A1/de
Priority to US17/017,631 priority patent/US20210073561A1/en
Publication of FR3100640A1 publication Critical patent/FR3100640A1/fr
Application granted granted Critical
Publication of FR3100640B1 publication Critical patent/FR3100640B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/23—Recognition of whole body movements, e.g. for sport training
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1103—Detecting eye twinkling
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6893—Cars
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D21/00—Measuring or testing not otherwise provided for
    • G01D21/02—Measuring two or more variables by means not covered by a single other subclass
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20—Workers
    • A61B2503/22—Motor vehicles operators, e.g. drivers, pilots, captains
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02—Operational features
    • A61B2560/0242—Operational features adapted to measure environmental factors, e.g. temperature, pollution
    • A61B2560/0247—Operational features adapted to measure environmental factors, e.g. temperature, pollution for compensation or correction of the measured physiological value
    • A61B2560/0252—Operational features adapted to measure environmental factors, e.g. temperature, pollution for compensation or correction of the measured physiological value using ambient temperature
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/029—Humidity sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biomedical Technology (AREA)
  • Cardiology (AREA)
  • Biophysics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physiology (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Data Mining & Analysis (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Dentistry (AREA)
  • Ophthalmology & Optometry (AREA)
  • Geometry (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Traffic Control Systems (AREA)

Abstract

Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule Le procédé de détection de bâillements d’un conducteur dans un habitacle d’un véhicule, le procédé comprenant : la capture d’images d’au moins une partie du visage du conducteur, l’analyse des images capturées par un module d’analyse d’image (14) pour détecter une ouverture de la bouche du conducteur, l’enregistrement du son dans l’habitacle du véhicule à l’aide d’au moins un microphone (26), la détection d’un bâillement du conducteur par un module de détection de bâillement (36) en fonction du résultat de l’analyse d’image et de l’enregistrement des sons, une ouverture de la bouche correspondant potentiellement à un bâillement étant considérée comme un bâillement effectif si elle est effectuée en combinaison avec un niveau sonore dans l’habitacle, pendant l’ouverture de la bouche, inférieur à un seuil sonore déterminé. Figure pour l'abrégé : Figure 1
FR1909925A 2019-09-10 2019-09-10 Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule Active FR3100640B1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
FR1909925A FR3100640B1 (fr) 2019-09-10 2019-09-10 Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule
CN202010933720.9A CN112560568A (zh) 2019-09-10 2020-09-08 用于检测交通工具驾驶员的打哈欠的方法和装置
DE102020123672.7A DE102020123672A1 (de) 2019-09-10 2020-09-10 Verfahren und Vorrichtung zum Ermitteln von Gähnen eines Fahrers eines Fahrzeugs
US17/017,631 US20210073561A1 (en) 2019-09-10 2020-09-10 Method and device for detecting yawning of a vehicle driver

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1909925A FR3100640B1 (fr) 2019-09-10 2019-09-10 Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule
FR1909925 2019-09-10

Publications (2)

Publication Number Publication Date
FR3100640A1 FR3100640A1 (fr) 2021-03-12
FR3100640B1 true FR3100640B1 (fr) 2021-08-06

Family

ID=68343138

Family Applications (1)

Application Number Title Priority Date Filing Date
FR1909925A Active FR3100640B1 (fr) 2019-09-10 2019-09-10 Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule

Country Status (4)

Country Link
US (1) US20210073561A1 (fr)
CN (1) CN112560568A (fr)
DE (1) DE102020123672A1 (fr)
FR (1) FR3100640B1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114255757A (zh) * 2020-09-22 2022-03-29 阿尔卑斯阿尔派株式会社 语音信息处理装置及语音信息处理方法
DE102021105311A1 (de) * 2021-03-05 2022-09-08 Dr. Ing. H.C. F. Porsche Aktiengesellschaft Verfahren und Vorrichtung zur Müdigkeitserkennung
CN113460073A (zh) * 2021-06-30 2021-10-01 恒大新能源汽车投资控股集团有限公司 疲劳驾驶提醒方法、装置及***
CN113838265B (zh) * 2021-09-27 2023-05-30 科大讯飞股份有限公司 疲劳驾驶预警方法、装置以及电子设备

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040123863A1 (en) * 2002-12-27 2004-07-01 Yi-Hua Wang Method of controlling oxygen inhaling through involuntary action of human and product thereof
US20060206379A1 (en) * 2005-03-14 2006-09-14 Outland Research, Llc Methods and apparatus for improving the matching of relevant advertisements with particular users over the internet
US10204625B2 (en) * 2010-06-07 2019-02-12 Affectiva, Inc. Audio analysis learning using video data
JP2019023767A (ja) * 2015-11-17 2019-02-14 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置
US20180012090A1 (en) * 2016-07-07 2018-01-11 Jungo Connectivity Ltd. Visual learning system and method for determining a driver's state
WO2019028798A1 (fr) * 2017-08-10 2019-02-14 北京市商汤科技开发有限公司 Procédé et dispositif de surveillance d'une condition de conduite, et dispositif électronique associé
TWI715958B (zh) * 2019-04-08 2021-01-11 國立交通大學 評估駕駛者之疲勞分數的方法

Also Published As

Publication number Publication date
US20210073561A1 (en) 2021-03-11
FR3100640A1 (fr) 2021-03-12
CN112560568A (zh) 2021-03-26
DE102020123672A1 (de) 2021-03-11

Similar Documents

Publication Publication Date Title
FR3100640B1 (fr) Procédé et dispositif de détection de bâillements d’un conducteur d’un véhicule
EP4234358A3 (fr) Véhicule, système et procédé d'inspection d'un rail utilisant un apprentissage automatique
EP1361543A3 (fr) Détermination du mouvement d'un object à partir de l'analyse du flux optique
EP2330582A1 (fr) Dispositif d'évaluation d'ouverture/de fermeture de l' il, dispositif pour estimer le degré d'ouverture de l' il et programme associé
CN102881106B (zh) 一种热成像视频双鉴林火识别***及其识别方法
DE102005013920A1 (de) Frontsicht-Überwachungsvorrichtung
JP4715738B2 (ja) 発話検出装置及び発話検出方法
EP3367358A3 (fr) Détection de particules
US11867592B2 (en) Structure displacement amount measurement apparatus
EP2012286A3 (fr) Appareil, méthode et programme pour la détection d'une déviation du regard
JP2006266718A (ja) スプレー噴射状態監視システム及びスプレー噴射状態監視プログラム
EP2012285A3 (fr) Appareil, méthode et programme pour la détection d'une déviation du regard
MA51935A1 (fr) Procédé d'évaluation de l'adéquation de conditions d'éclairage à une détection d'analyte dans un échantillon à l'aide d'une caméra d'un dispositif mobile
FR3062507B1 (fr) Procede et dispositif pour l'etalonnage d'un systeme de perception comportant un ensemble de telemetres lidar
FR3038770B1 (fr) Systeme de surveillance de l'etat de vigilance d'un operateur
FR3089328B1 (fr) Dispositif et procédé de détection de la distraction d’un conducteur d’un véhicule
KR20090000251A (ko) 매연차량 자동판독 시스템 및 그 방법
KR101404658B1 (ko) 촬영된 영상의 보정값을 고려한 차량녹화영상 분석 방법 및 장치
FR3101916B1 (fr) Système de surveillance d’un moteur
JP5442408B2 (ja) 画像補正方法
JP2009276848A (ja) 運転状態推定装置、及び運転状態推定方法
CN209087158U (zh) 水上物体预警***
JP2012167983A (ja) 霧検出装置
JP5475509B2 (ja) パンタグラフ監視装置
MA56381B1 (fr) Procédé de détermination d'une concentration d'un analyte dans un fluide corporel et dispositif mobile pour déterminer une concentration d'un analyte dans un fluide corporel

Legal Events

Date Code Title Description
PLFP Fee payment

Year of fee payment: 2

PLSC Publication of the preliminary search report

Effective date: 20210312

PLFP Fee payment

Year of fee payment: 3

PLFP Fee payment

Year of fee payment: 4

PLFP Fee payment

Year of fee payment: 5