CN116109818B - 一种基于面部视频的中医脉候判别***及方法和装置 - Google Patents
一种基于面部视频的中医脉候判别***及方法和装置 Download PDFInfo
- Publication number
- CN116109818B CN116109818B CN202310379090.9A CN202310379090A CN116109818B CN 116109818 B CN116109818 B CN 116109818B CN 202310379090 A CN202310379090 A CN 202310379090A CN 116109818 B CN116109818 B CN 116109818B
- Authority
- CN
- China
- Prior art keywords
- pulse
- face
- neural network
- signal
- time sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000001815 facial effect Effects 0.000 title claims abstract description 35
- 238000000034 method Methods 0.000 title claims abstract description 31
- 239000003814 drug Substances 0.000 title claims abstract description 25
- 238000013528 artificial neural network Methods 0.000 claims abstract description 35
- 238000001514 detection method Methods 0.000 claims abstract description 35
- 238000012549 training Methods 0.000 claims abstract description 28
- 238000000605 extraction Methods 0.000 claims abstract description 21
- 238000001914 filtration Methods 0.000 claims abstract description 18
- 238000001228 spectrum Methods 0.000 claims abstract description 13
- 238000003062 neural network model Methods 0.000 claims description 28
- 230000036772 blood pressure Effects 0.000 claims description 15
- 238000012937 correction Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 12
- 125000004122 cyclic group Chemical group 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 12
- 239000000284 extract Substances 0.000 claims description 11
- 238000005286 illumination Methods 0.000 claims description 6
- 238000002156 mixing Methods 0.000 claims description 5
- 238000005457 optimization Methods 0.000 claims description 5
- 238000000926 separation method Methods 0.000 claims description 5
- 238000011835 investigation Methods 0.000 claims description 4
- KQOMUSLQKQAVTD-UHFFFAOYSA-N sodium 4-hydroxy-3-[(4-nitrophenyl)diazenyl]naphthalene-1,5-disulfonic acid Chemical compound C1=CC2=C(C=C(C(=C2C(=C1)S(=O)(=O)O)O)N=NC3=CC=C(C=C3)[N+](=O)[O-])S(=O)(=O)O.[Na+] KQOMUSLQKQAVTD-UHFFFAOYSA-N 0.000 claims description 4
- 238000013527 convolutional neural network Methods 0.000 claims description 3
- 208000011726 slow pulse Diseases 0.000 claims 1
- 230000007547 defect Effects 0.000 abstract description 2
- 238000003745 diagnosis Methods 0.000 description 11
- 230000011218 segmentation Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000009499 grossing Methods 0.000 description 7
- 230000036541 health Effects 0.000 description 3
- 238000002372 labelling Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 210000004204 blood vessel Anatomy 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 1
- 102000001554 Hemoglobins Human genes 0.000 description 1
- 108010054147 Hemoglobins Proteins 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000002405 diagnostic procedure Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4854—Diagnosis based on concepts of traditional oriental medicine
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0062—Arrangements for scanning
- A61B5/0064—Body surface scanning
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/30—Noise filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/15—Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Heart & Thoracic Surgery (AREA)
- Artificial Intelligence (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Evolutionary Computation (AREA)
- Molecular Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Databases & Information Systems (AREA)
- Physiology (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Cardiology (AREA)
- Radiology & Medical Imaging (AREA)
- Mathematical Physics (AREA)
- Alternative & Traditional Medicine (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Fuzzy Systems (AREA)
- Signal Processing (AREA)
- Psychiatry (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Image Analysis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
Description
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310379090.9A CN116109818B (zh) | 2023-04-11 | 2023-04-11 | 一种基于面部视频的中医脉候判别***及方法和装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310379090.9A CN116109818B (zh) | 2023-04-11 | 2023-04-11 | 一种基于面部视频的中医脉候判别***及方法和装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN116109818A CN116109818A (zh) | 2023-05-12 |
CN116109818B true CN116109818B (zh) | 2023-07-28 |
Family
ID=86256477
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202310379090.9A Active CN116109818B (zh) | 2023-04-11 | 2023-04-11 | 一种基于面部视频的中医脉候判别***及方法和装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116109818B (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117423041B (zh) * | 2023-12-13 | 2024-03-08 | 成都中医药大学 | 一种基于计算机视觉的面部视频判别中医气血*** |
CN117671572A (zh) * | 2024-02-02 | 2024-03-08 | 深邦智能科技集团(青岛)有限公司 | 一种多平台联动的道路图像模型处理***及方法 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1242693A (zh) * | 1997-08-26 | 2000-01-26 | 精工爱普生株式会社 | 脉波诊断装置、运动指标检测装置、运动强度检测装置、心输出量检测装置、每搏输出量检测装置、心功能诊断装置及其检测方法 |
CN103845042A (zh) * | 2012-11-29 | 2014-06-11 | 沈阳工业大学 | 一种脉象采集装置及控制方法 |
CN103845043A (zh) * | 2014-03-12 | 2014-06-11 | 天津大学 | 一种快速脉象采集装置及控制方法 |
CN103932686A (zh) * | 2014-04-22 | 2014-07-23 | 北京印刷学院 | 一种脉象信号的提取方法和装置 |
CN103932687A (zh) * | 2014-04-22 | 2014-07-23 | 北京印刷学院 | 一种脉象信号预处理方法和装置 |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN2247504Y (zh) * | 1995-11-03 | 1997-02-19 | 乔元勋 | 心动监测器 |
CN102293639B (zh) * | 2011-06-30 | 2013-03-13 | 芜湖圣美孚科技有限公司 | 一种脉象信号时域特征提取方法 |
CN105011911B (zh) * | 2015-08-19 | 2018-09-04 | 之医(上海)健康科技有限公司 | 一种基于网络的中医健康咨询*** |
CN108334868A (zh) * | 2018-03-21 | 2018-07-27 | 华南师范大学 | 一种基于ppg信号和图像增强的脉象分析方法 |
CN110772235A (zh) * | 2019-08-22 | 2020-02-11 | 天津森宇科技股份有限公司 | 基于云计算和移动平台的中医智能健康分析*** |
CN112949349B (zh) * | 2019-12-09 | 2022-08-05 | 南宁莲现健康科技有限公司 | 基于人脸视频实时显示脉象波形的方法和*** |
CN111027485A (zh) * | 2019-12-11 | 2020-04-17 | 南京邮电大学 | 一种基于人脸视频检测与色度模型的心率检测方法 |
CN112151149B (zh) * | 2020-09-18 | 2024-06-07 | 南宁莲现健康科技有限公司 | 基于人脸视频辅助中医智能诊断的方法 |
CN112826458B (zh) * | 2021-01-08 | 2022-11-01 | 广州中医药大学(广州中医药研究院) | 脉诊***和脉诊方法 |
CN113488162A (zh) * | 2021-07-06 | 2021-10-08 | 李颖 | 一种非接触式中医脉象检测方法及装置 |
CN113542600B (zh) * | 2021-07-09 | 2023-05-12 | Oppo广东移动通信有限公司 | 一种图像生成方法、装置、芯片、终端和存储介质 |
CN114693653A (zh) * | 2022-04-01 | 2022-07-01 | 桂林电子科技大学 | 基于人体浅表动脉视频精确提取脉搏波的方法 |
-
2023
- 2023-04-11 CN CN202310379090.9A patent/CN116109818B/zh active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1242693A (zh) * | 1997-08-26 | 2000-01-26 | 精工爱普生株式会社 | 脉波诊断装置、运动指标检测装置、运动强度检测装置、心输出量检测装置、每搏输出量检测装置、心功能诊断装置及其检测方法 |
CN103845042A (zh) * | 2012-11-29 | 2014-06-11 | 沈阳工业大学 | 一种脉象采集装置及控制方法 |
CN103845043A (zh) * | 2014-03-12 | 2014-06-11 | 天津大学 | 一种快速脉象采集装置及控制方法 |
CN103932686A (zh) * | 2014-04-22 | 2014-07-23 | 北京印刷学院 | 一种脉象信号的提取方法和装置 |
CN103932687A (zh) * | 2014-04-22 | 2014-07-23 | 北京印刷学院 | 一种脉象信号预处理方法和装置 |
Also Published As
Publication number | Publication date |
---|---|
CN116109818A (zh) | 2023-05-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN116109818B (zh) | 一种基于面部视频的中医脉候判别***及方法和装置 | |
CN111407245B (zh) | 一种基于摄像头的非接触式心率、体温测量方法 | |
CN109247923B (zh) | 基于视频的非接触式脉搏实时估计方法及设备 | |
Gudi et al. | Real-time webcam heart-rate and variability estimation with clean ground truth for evaluation | |
CN113017630B (zh) | 一种视觉感知情绪识别方法 | |
CN111839489B (zh) | 非接触式生理心理健康检测*** | |
US20160317041A1 (en) | System and methods for measuring physiological parameters | |
CN106682616A (zh) | 基于双通道特征深度学习的新生儿疼痛表情识别方法 | |
CN112001122B (zh) | 基于端到端生成对抗网络的非接触式生理信号测量方法 | |
CN106793962A (zh) | 用于使用视频图像来连续估计人体血压的方法和装置 | |
CN112949349B (zh) | 基于人脸视频实时显示脉象波形的方法和*** | |
Wang et al. | Detail-preserving pulse wave extraction from facial videos using consumer-level camera | |
Hsu et al. | A deep learning framework for heart rate estimation from facial videos | |
Hassan et al. | Novel health monitoring method using an RGB camera | |
CN106491117A (zh) | 一种基于ppg心率测量技术的信号处理方法及装置 | |
CN116189884A (zh) | 一种基于面部视觉的多模态融合中医体质判别方法及*** | |
Karthick et al. | Analysis of vital signs using remote photoplethysmography (RPPG) | |
CN110060225A (zh) | 一种基于快速有限剪切波变换与稀疏表示的医学图像融合法 | |
CN116548942A (zh) | 非接触式心率变异性检测方法及*** | |
CN116758619B (zh) | 基于面部视频的情感分类方法、***、存储介质及设备 | |
Hamoud et al. | Contactless oxygen saturation detection based on face analysis: an approach and case study | |
CN113488162A (zh) | 一种非接触式中医脉象检测方法及装置 | |
CN115374831B (zh) | 多模态配准和时空特征注意的动静结合速度想象分类方法 | |
Yang et al. | Heart rate estimation from facial videos based on convolutional neural network | |
JPWO2020158804A1 (ja) | 血圧測定装置、モデル設定装置、および血圧測定方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20230512 Assignee: Guangdong Xinhuangpu Joint Innovation Institute of traditional Chinese Medicine Assignor: Chengdu University of Traditional Chinese Medicine Contract record no.: X2024980008196 Denomination of invention: A Traditional Chinese Medicine Pulse Syndrome Discrimination System and Method and Device Based on Facial Video Granted publication date: 20230728 License type: Common License Record date: 20240701 |