CN112829754A - 车载智能机器人和车载智能机器人的运行方法 - Google Patents
车载智能机器人和车载智能机器人的运行方法 Download PDFInfo
- Publication number
- CN112829754A CN112829754A CN202110080545.8A CN202110080545A CN112829754A CN 112829754 A CN112829754 A CN 112829754A CN 202110080545 A CN202110080545 A CN 202110080545A CN 112829754 A CN112829754 A CN 112829754A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- algorithm execution
- driver
- image information
- signal processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 147
- 238000012545 processing Methods 0.000 claims abstract description 32
- 238000004891 communication Methods 0.000 claims abstract description 19
- 238000012544 monitoring process Methods 0.000 claims description 35
- 230000008909 emotion recognition Effects 0.000 claims description 34
- 230000001815 facial effect Effects 0.000 claims description 29
- 230000008921 facial expression Effects 0.000 claims description 16
- 230000004399 eye closure Effects 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 10
- 238000011017 operating method Methods 0.000 claims description 4
- 230000011664 signaling Effects 0.000 claims description 4
- 238000011161 development Methods 0.000 abstract description 8
- 230000008859 change Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 18
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000000644 propagated effect Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 239000000853 adhesive Substances 0.000 description 1
- 230000001070 adhesive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000003607 modifier Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/94—Hardware or software architectures specially adapted for image or video understanding
- G06V10/955—Hardware or software architectures specially adapted for image or video understanding using specific electronic processors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
- B60W2040/0827—Inactivity or incapacity of driver due to sleepiness
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Mathematical Physics (AREA)
- Automation & Control Theory (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Ophthalmology & Optometry (AREA)
- Software Systems (AREA)
- Image Analysis (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110080545.8A CN112829754B (zh) | 2021-01-21 | 2021-01-21 | 车载智能机器人和车载智能机器人的运行方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110080545.8A CN112829754B (zh) | 2021-01-21 | 2021-01-21 | 车载智能机器人和车载智能机器人的运行方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112829754A true CN112829754A (zh) | 2021-05-25 |
CN112829754B CN112829754B (zh) | 2023-07-25 |
Family
ID=75929261
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110080545.8A Active CN112829754B (zh) | 2021-01-21 | 2021-01-21 | 车载智能机器人和车载智能机器人的运行方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112829754B (zh) |
Citations (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009297892A (ja) * | 2000-09-19 | 2009-12-24 | Toyota Motor Corp | 移動体搭載用のロボット及びこれを搭載した移動体 |
CN105035074A (zh) * | 2015-06-23 | 2015-11-11 | 南京理工大学 | 基于便携式智能设备的车辆主动安全控制方法 |
CN106506937A (zh) * | 2016-10-11 | 2017-03-15 | 芜湖哈特机器人产业技术研究院有限公司 | 一种可供二次开发的智能相机 |
US20170108864A1 (en) * | 2015-10-16 | 2017-04-20 | Zf Friedrichshafen Ag | Vehicle system and method for enabling a device for autonomous driving |
WO2017140122A1 (zh) * | 2016-02-18 | 2017-08-24 | 广东百事泰电子商务股份有限公司 | 智能监控记录仪 |
CN107194346A (zh) * | 2017-05-19 | 2017-09-22 | 福建师范大学 | 一种汽车疲劳驾驶预测方法 |
CN107511832A (zh) * | 2016-06-15 | 2017-12-26 | 深圳光启合众科技有限公司 | 云端互动***及其多感知型智能机器人和感知互动方法 |
CN107521435A (zh) * | 2017-08-04 | 2017-12-29 | 安徽创融增材制造技术有限公司 | 基于车联网的驾驶员个性化设置*** |
CN206883648U (zh) * | 2017-03-28 | 2018-01-16 | 深圳光启合众科技有限公司 | 机器人 |
CN206906843U (zh) * | 2017-06-30 | 2018-01-19 | 深圳光启合众科技有限公司 | 机器人的控制装置及机器人 |
KR101821496B1 (ko) * | 2016-08-19 | 2018-03-08 | 동서대학교산학협력단 | 안전운전 보조 시스템 동작방법 |
CN109050396A (zh) * | 2018-07-16 | 2018-12-21 | 浙江合众新能源汽车有限公司 | 一种车载智能机器人 |
CN109376682A (zh) * | 2018-11-06 | 2019-02-22 | 东莞市凯木金电子科技有限公司 | 一种智能摄像头及疲劳状态识别方法 |
CN110103865A (zh) * | 2019-04-17 | 2019-08-09 | 浙江合众新能源汽车有限公司 | 基于人脸识别的驾驶员车载个性化配置应用*** |
CN110413113A (zh) * | 2019-07-18 | 2019-11-05 | 华勤通讯技术有限公司 | 一种车载机器人及交互方法 |
CN110606090A (zh) * | 2019-09-05 | 2019-12-24 | 成都亿盟恒信科技有限公司 | 一种基于疲劳检测的驾驶员监控***及方法 |
CN110789452A (zh) * | 2019-09-29 | 2020-02-14 | 浙江合众新能源汽车有限公司 | 一种汽车透明a柱*** |
US20200207358A1 (en) * | 2018-06-26 | 2020-07-02 | Eyesight Mobile Technologies Ltd. | Contextual driver monitoring system |
CN111409555A (zh) * | 2020-04-10 | 2020-07-14 | 中国科学院重庆绿色智能技术研究院 | 一种多功能智能识别车载后视镜 |
CN111547063A (zh) * | 2020-05-12 | 2020-08-18 | 武汉艾瓦客机器人有限公司 | 一种疲劳检测的智能车载情感交互装置 |
CN211493951U (zh) * | 2019-11-04 | 2020-09-15 | 深圳市航盛电子股份有限公司 | 车载机器人监测*** |
CN112172830A (zh) * | 2019-06-17 | 2021-01-05 | 上海博泰悦臻网络技术服务有限公司 | 驾驶员状态的监控方法、***、可读存储介质及车载终端 |
-
2021
- 2021-01-21 CN CN202110080545.8A patent/CN112829754B/zh active Active
Patent Citations (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009297892A (ja) * | 2000-09-19 | 2009-12-24 | Toyota Motor Corp | 移動体搭載用のロボット及びこれを搭載した移動体 |
CN105035074A (zh) * | 2015-06-23 | 2015-11-11 | 南京理工大学 | 基于便携式智能设备的车辆主动安全控制方法 |
US20170108864A1 (en) * | 2015-10-16 | 2017-04-20 | Zf Friedrichshafen Ag | Vehicle system and method for enabling a device for autonomous driving |
WO2017140122A1 (zh) * | 2016-02-18 | 2017-08-24 | 广东百事泰电子商务股份有限公司 | 智能监控记录仪 |
CN107511832A (zh) * | 2016-06-15 | 2017-12-26 | 深圳光启合众科技有限公司 | 云端互动***及其多感知型智能机器人和感知互动方法 |
KR101821496B1 (ko) * | 2016-08-19 | 2018-03-08 | 동서대학교산학협력단 | 안전운전 보조 시스템 동작방법 |
CN106506937A (zh) * | 2016-10-11 | 2017-03-15 | 芜湖哈特机器人产业技术研究院有限公司 | 一种可供二次开发的智能相机 |
CN206883648U (zh) * | 2017-03-28 | 2018-01-16 | 深圳光启合众科技有限公司 | 机器人 |
CN107194346A (zh) * | 2017-05-19 | 2017-09-22 | 福建师范大学 | 一种汽车疲劳驾驶预测方法 |
CN206906843U (zh) * | 2017-06-30 | 2018-01-19 | 深圳光启合众科技有限公司 | 机器人的控制装置及机器人 |
CN107521435A (zh) * | 2017-08-04 | 2017-12-29 | 安徽创融增材制造技术有限公司 | 基于车联网的驾驶员个性化设置*** |
US20200207358A1 (en) * | 2018-06-26 | 2020-07-02 | Eyesight Mobile Technologies Ltd. | Contextual driver monitoring system |
CN109050396A (zh) * | 2018-07-16 | 2018-12-21 | 浙江合众新能源汽车有限公司 | 一种车载智能机器人 |
CN109376682A (zh) * | 2018-11-06 | 2019-02-22 | 东莞市凯木金电子科技有限公司 | 一种智能摄像头及疲劳状态识别方法 |
CN110103865A (zh) * | 2019-04-17 | 2019-08-09 | 浙江合众新能源汽车有限公司 | 基于人脸识别的驾驶员车载个性化配置应用*** |
CN112172830A (zh) * | 2019-06-17 | 2021-01-05 | 上海博泰悦臻网络技术服务有限公司 | 驾驶员状态的监控方法、***、可读存储介质及车载终端 |
CN110413113A (zh) * | 2019-07-18 | 2019-11-05 | 华勤通讯技术有限公司 | 一种车载机器人及交互方法 |
CN110606090A (zh) * | 2019-09-05 | 2019-12-24 | 成都亿盟恒信科技有限公司 | 一种基于疲劳检测的驾驶员监控***及方法 |
CN110789452A (zh) * | 2019-09-29 | 2020-02-14 | 浙江合众新能源汽车有限公司 | 一种汽车透明a柱*** |
CN211493951U (zh) * | 2019-11-04 | 2020-09-15 | 深圳市航盛电子股份有限公司 | 车载机器人监测*** |
CN111409555A (zh) * | 2020-04-10 | 2020-07-14 | 中国科学院重庆绿色智能技术研究院 | 一种多功能智能识别车载后视镜 |
CN111547063A (zh) * | 2020-05-12 | 2020-08-18 | 武汉艾瓦客机器人有限公司 | 一种疲劳检测的智能车载情感交互装置 |
Also Published As
Publication number | Publication date |
---|---|
CN112829754B (zh) | 2023-07-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109426803B (zh) | 用于识别对象的方法和设备 | |
EP3617949B1 (en) | Method and apparatus for improving vehicle loss assessment image identification result, and server | |
US20160171321A1 (en) | Determination apparatus and determination method | |
US11775054B2 (en) | Virtual models for communications between autonomous vehicles and external observers | |
CN111552368A (zh) | 一种车载人机交互方法及车载设备 | |
US11592677B2 (en) | System and method for capturing a spatial orientation of a wearable device | |
CN110263737A (zh) | 图像处理方法、图像处理装置、终端设备及可读存储介质 | |
CN113782020A (zh) | 车内语音交互方法和*** | |
Abulkhair et al. | Mobile platform detect and alerts system for driver fatigue | |
CN114428577A (zh) | 一种车载交互方法、车载交互终端及车载*** | |
CN112083795A (zh) | 对象控制方法及装置、存储介质和电子设备 | |
CN104346552A (zh) | 一种信息处理的方法及一种电子设备 | |
CN112046497A (zh) | 驾驶辅助设备、驾驶辅助方法和驾驶辅助程序 | |
CN113766127B (zh) | 移动终端的控制方法及装置、存储介质及电子设备 | |
Sharara et al. | A real-time automotive safety system based on advanced ai facial detection algorithms | |
CN112829754B (zh) | 车载智能机器人和车载智能机器人的运行方法 | |
CN114084121B (zh) | 分体式能量管理的控制*** | |
CN115831077A (zh) | 车载屏幕亮度控制方法、装置及相关设备 | |
US11868446B2 (en) | Method of operating neural network model using DRM package and method of processing data using the same | |
CN113918265A (zh) | 动态调节车内显示信息的字体大小的方法和*** | |
CN114581627B (zh) | 基于arhud的成像方法和*** | |
CN113619607B (zh) | 汽车行驶的控制方法和控制*** | |
CN114581291A (zh) | 座舱内呈现人脸美妆图像的方法和*** | |
KR20190028888A (ko) | 차량용 hmi 시스템 및 방법 | |
CN115830580A (zh) | 一种汽车座舱的场景识别和仲裁方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant after: United New Energy Automobile Co.,Ltd. Address before: 314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant before: Hozon New Energy Automobile Co., Ltd. Address after: 314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant after: Hozon New Energy Automobile Co., Ltd. Address before: 314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant before: Hozon New Energy Automobile Co., Ltd. |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Operation methods of vehicle mounted intelligent robots and vehicle mounted intelligent robots Granted publication date: 20230725 Pledgee: Tongxiang Science and Technology Entrepreneurship Service Center Co.,Ltd. Pledgor: United New Energy Automobile Co.,Ltd. Registration number: Y2024330000709 |
|
PE01 | Entry into force of the registration of the contract for pledge of patent right |