CN112529857A - 基于目标检测与策略梯度的超声图像诊断报告生成方法 - Google Patents
基于目标检测与策略梯度的超声图像诊断报告生成方法 Download PDFInfo
- Publication number
- CN112529857A CN112529857A CN202011399345.0A CN202011399345A CN112529857A CN 112529857 A CN112529857 A CN 112529857A CN 202011399345 A CN202011399345 A CN 202011399345A CN 112529857 A CN112529857 A CN 112529857A
- Authority
- CN
- China
- Prior art keywords
- diagnosis report
- generated
- target detection
- language generation
- generation model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003745 diagnosis Methods 0.000 title claims abstract description 71
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000001514 detection method Methods 0.000 title claims abstract description 50
- 230000006870 function Effects 0.000 claims abstract description 61
- 210000000056 organ Anatomy 0.000 claims abstract description 16
- 201000010099 disease Diseases 0.000 claims abstract description 11
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims abstract description 11
- 230000001575 pathological effect Effects 0.000 claims abstract description 9
- 230000003902 lesion Effects 0.000 claims description 22
- 230000015654 memory Effects 0.000 claims description 18
- 238000004422 calculation algorithm Methods 0.000 claims description 17
- 238000002604 ultrasonography Methods 0.000 claims description 14
- 238000004364 calculation method Methods 0.000 claims description 13
- 238000012549 training Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 12
- 238000012360 testing method Methods 0.000 claims description 12
- 230000000875 corresponding effect Effects 0.000 claims description 10
- 238000005070 sampling Methods 0.000 claims description 8
- 238000005457 optimization Methods 0.000 claims description 7
- 239000003795 chemical substances by application Substances 0.000 claims description 6
- 230000007787 long-term memory Effects 0.000 claims description 6
- 230000006403 short-term memory Effects 0.000 claims description 6
- 238000013527 convolutional neural network Methods 0.000 claims description 5
- 239000004576 sand Substances 0.000 claims description 4
- 238000009499 grossing Methods 0.000 claims description 3
- JEIPFZHSYJVQDO-UHFFFAOYSA-N iron(III) oxide Inorganic materials O=[Fe]O[Fe]=O JEIPFZHSYJVQDO-UHFFFAOYSA-N 0.000 claims description 3
- 235000019987 cider Nutrition 0.000 claims description 2
- 230000002596 correlated effect Effects 0.000 claims description 2
- 238000005259 measurement Methods 0.000 claims description 2
- 238000007476 Maximum Likelihood Methods 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000003759 clinical diagnosis Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Biomedical Technology (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011399345.0A CN112529857B (zh) | 2020-12-03 | 2020-12-03 | 基于目标检测与策略梯度的超声图像诊断报告生成方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011399345.0A CN112529857B (zh) | 2020-12-03 | 2020-12-03 | 基于目标检测与策略梯度的超声图像诊断报告生成方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112529857A true CN112529857A (zh) | 2021-03-19 |
CN112529857B CN112529857B (zh) | 2022-08-23 |
Family
ID=74998256
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011399345.0A Active CN112529857B (zh) | 2020-12-03 | 2020-12-03 | 基于目标检测与策略梯度的超声图像诊断报告生成方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112529857B (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113539408A (zh) * | 2021-08-31 | 2021-10-22 | 北京字节跳动网络技术有限公司 | 一种医学报告生成方法、模型的训练方法、装置及设备 |
CN114334068A (zh) * | 2021-11-15 | 2022-04-12 | 深圳市龙岗中心医院(深圳市龙岗中心医院集团、深圳市第九人民医院、深圳市龙岗中心医院针灸研究所) | 一种放射学报告生成方法、装置、终端及存储介质 |
CN114998607A (zh) * | 2022-05-11 | 2022-09-02 | 北京医准智能科技有限公司 | 超声图像的特征提取方法、装置、电子设备及存储介质 |
CN116631566A (zh) * | 2023-05-23 | 2023-08-22 | 重庆邮电大学 | 一种基于大数据的医学影像报告智能生成方法 |
CN116758341A (zh) * | 2023-05-31 | 2023-09-15 | 北京长木谷医疗科技股份有限公司 | 一种基于gpt的髋关节病变智能诊断方法、装置及设备 |
Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106846306A (zh) * | 2017-01-13 | 2017-06-13 | 重庆邮电大学 | 一种超声图像自动描述方法和*** |
CN107038221A (zh) * | 2017-03-22 | 2017-08-11 | 杭州电子科技大学 | 一种基于语义信息引导的视频内容描述方法 |
CN107145910A (zh) * | 2017-05-08 | 2017-09-08 | 京东方科技集团股份有限公司 | 医学影像的表现生成***、其训练方法及表现生成方法 |
CN107609563A (zh) * | 2017-09-15 | 2018-01-19 | 成都澳海川科技有限公司 | 图片语义描述方法及装置 |
WO2018094295A1 (en) * | 2016-11-18 | 2018-05-24 | Salesforce.Com, Inc. | Adaptive attention model for image captioning |
CN108376558A (zh) * | 2018-01-24 | 2018-08-07 | 复旦大学 | 一种多模态核磁共振影像病历报告自动生成方法 |
CN108416776A (zh) * | 2018-03-16 | 2018-08-17 | 京东方科技集团股份有限公司 | 图像识别方法、图像识别装置、计算机产品和可读存储介质 |
CN108875807A (zh) * | 2018-05-31 | 2018-11-23 | 陕西师范大学 | 一种基于多注意力多尺度的图像描述方法 |
CN109559295A (zh) * | 2018-06-04 | 2019-04-02 | 新影智能科技(昆山)有限公司 | 图像分析***、方法、计算机可读存储介质、及电子终端 |
CN109685116A (zh) * | 2018-11-30 | 2019-04-26 | 腾讯科技(深圳)有限公司 | 图像描述信息生成方法和装置及电子装置 |
CN110163230A (zh) * | 2018-06-15 | 2019-08-23 | 腾讯科技(深圳)有限公司 | 一种图像标注方法和装置 |
KR20190140504A (ko) * | 2018-05-25 | 2019-12-20 | 창원대학교 산학협력단 | 강화학습을 이용한 이미지 캡션 생성 방법 및 시스템 |
CN110909736A (zh) * | 2019-11-12 | 2020-03-24 | 北京工业大学 | 一种基于长短期记忆模型与目标检测算法的图像描述方法 |
CN110929640A (zh) * | 2019-11-20 | 2020-03-27 | 西安电子科技大学 | 一种基于目标检测的宽幅遥感描述生成方法 |
CN111063410A (zh) * | 2019-12-20 | 2020-04-24 | 京东方科技集团股份有限公司 | 一种医学影像文本报告的生成方法及装置 |
CN111144553A (zh) * | 2019-12-28 | 2020-05-12 | 北京工业大学 | 一种基于时空记忆注意力的图像描述方法 |
CN111325216A (zh) * | 2018-12-14 | 2020-06-23 | ***通信集团安徽有限公司 | 图像局部特征的描述方法、装置、计算机设备及存储介质 |
CN111582371A (zh) * | 2020-05-07 | 2020-08-25 | 广州视源电子科技股份有限公司 | 一种图像分类网络的训练方法、装置、设备及存储介质 |
-
2020
- 2020-12-03 CN CN202011399345.0A patent/CN112529857B/zh active Active
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018094295A1 (en) * | 2016-11-18 | 2018-05-24 | Salesforce.Com, Inc. | Adaptive attention model for image captioning |
CN106846306A (zh) * | 2017-01-13 | 2017-06-13 | 重庆邮电大学 | 一种超声图像自动描述方法和*** |
CN107038221A (zh) * | 2017-03-22 | 2017-08-11 | 杭州电子科技大学 | 一种基于语义信息引导的视频内容描述方法 |
CN107145910A (zh) * | 2017-05-08 | 2017-09-08 | 京东方科技集团股份有限公司 | 医学影像的表现生成***、其训练方法及表现生成方法 |
CN107609563A (zh) * | 2017-09-15 | 2018-01-19 | 成都澳海川科技有限公司 | 图片语义描述方法及装置 |
CN108376558A (zh) * | 2018-01-24 | 2018-08-07 | 复旦大学 | 一种多模态核磁共振影像病历报告自动生成方法 |
CN108416776A (zh) * | 2018-03-16 | 2018-08-17 | 京东方科技集团股份有限公司 | 图像识别方法、图像识别装置、计算机产品和可读存储介质 |
KR20190140504A (ko) * | 2018-05-25 | 2019-12-20 | 창원대학교 산학협력단 | 강화학습을 이용한 이미지 캡션 생성 방법 및 시스템 |
CN108875807A (zh) * | 2018-05-31 | 2018-11-23 | 陕西师范大学 | 一种基于多注意力多尺度的图像描述方法 |
CN109559295A (zh) * | 2018-06-04 | 2019-04-02 | 新影智能科技(昆山)有限公司 | 图像分析***、方法、计算机可读存储介质、及电子终端 |
CN110163230A (zh) * | 2018-06-15 | 2019-08-23 | 腾讯科技(深圳)有限公司 | 一种图像标注方法和装置 |
CN109685116A (zh) * | 2018-11-30 | 2019-04-26 | 腾讯科技(深圳)有限公司 | 图像描述信息生成方法和装置及电子装置 |
CN111325216A (zh) * | 2018-12-14 | 2020-06-23 | ***通信集团安徽有限公司 | 图像局部特征的描述方法、装置、计算机设备及存储介质 |
CN110909736A (zh) * | 2019-11-12 | 2020-03-24 | 北京工业大学 | 一种基于长短期记忆模型与目标检测算法的图像描述方法 |
CN110929640A (zh) * | 2019-11-20 | 2020-03-27 | 西安电子科技大学 | 一种基于目标检测的宽幅遥感描述生成方法 |
CN111063410A (zh) * | 2019-12-20 | 2020-04-24 | 京东方科技集团股份有限公司 | 一种医学影像文本报告的生成方法及装置 |
CN111144553A (zh) * | 2019-12-28 | 2020-05-12 | 北京工业大学 | 一种基于时空记忆注意力的图像描述方法 |
CN111582371A (zh) * | 2020-05-07 | 2020-08-25 | 广州视源电子科技股份有限公司 | 一种图像分类网络的训练方法、装置、设备及存储介质 |
Non-Patent Citations (9)
Title |
---|
DAQING LIU 等: "Context-Aware Visual Policy Network for Sequence-Level Image Captioning", 《MM’18》 * |
JUN HE 等: "Feedback evaluations to promote image captioning", 《IET IMAGE PROCESSING》 * |
SHENGFENG LIU 等: "Deep Learning in Medical Ultrasound Analysis: A Review", 《ENGINEERING》 * |
TORU NISHINO 等: "Reinforcement Learning with Imbalanced Dataset for Data-to-Text Medical Report Generation", 《FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: EMNLP 2020》 * |
XIANHUA ZENG 等: "Deep learning for ultrasound image caption generation based on object detection", 《NEUROCOMPUTING》 * |
XIANHUA ZENG 等: "Generating diagnostic report for medical image by high-middle-level visual information incorporation on double deep learning models", 《COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE》 * |
常致富 等: "基于深度学习的图像自动标注方法综述", 《山东大学学报(工学版)》 * |
汤鹏杰 等: "融合图像场景及物体先验知识的图像描述生成模型", 《中国图象图形学报》 * |
莫宏伟 等: "基于注意力融合的图像描述生成方法", 《智能***学报》 * |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113539408A (zh) * | 2021-08-31 | 2021-10-22 | 北京字节跳动网络技术有限公司 | 一种医学报告生成方法、模型的训练方法、装置及设备 |
CN114334068A (zh) * | 2021-11-15 | 2022-04-12 | 深圳市龙岗中心医院(深圳市龙岗中心医院集团、深圳市第九人民医院、深圳市龙岗中心医院针灸研究所) | 一种放射学报告生成方法、装置、终端及存储介质 |
CN114334068B (zh) * | 2021-11-15 | 2022-11-01 | 深圳市龙岗中心医院(深圳市龙岗中心医院集团、深圳市第九人民医院、深圳市龙岗中心医院针灸研究所) | 一种放射学报告生成方法、装置、终端及存储介质 |
CN114998607A (zh) * | 2022-05-11 | 2022-09-02 | 北京医准智能科技有限公司 | 超声图像的特征提取方法、装置、电子设备及存储介质 |
CN114998607B (zh) * | 2022-05-11 | 2023-01-31 | 北京医准智能科技有限公司 | 超声图像的特征提取方法、装置、电子设备及存储介质 |
CN116631566A (zh) * | 2023-05-23 | 2023-08-22 | 重庆邮电大学 | 一种基于大数据的医学影像报告智能生成方法 |
CN116631566B (zh) * | 2023-05-23 | 2024-05-24 | 广州合昊医疗科技有限公司 | 一种基于大数据的医学影像报告智能生成方法 |
CN116758341A (zh) * | 2023-05-31 | 2023-09-15 | 北京长木谷医疗科技股份有限公司 | 一种基于gpt的髋关节病变智能诊断方法、装置及设备 |
CN116758341B (zh) * | 2023-05-31 | 2024-03-19 | 北京长木谷医疗科技股份有限公司 | 一种基于gpt的髋关节病变智能诊断方法、装置及设备 |
Also Published As
Publication number | Publication date |
---|---|
CN112529857B (zh) | 2022-08-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112529857B (zh) | 基于目标检测与策略梯度的超声图像诊断报告生成方法 | |
Zhu et al. | Electrocardiogram generation with a bidirectional LSTM-CNN generative adversarial network | |
Shou et al. | Conversational emotion recognition studies based on graph convolutional neural networks and a dependent syntactic analysis | |
Ahmad et al. | Discriminative feature learning for skin disease classification using deep convolutional neural network | |
Wu et al. | Automatic depression recognition by intelligent speech signal processing: A systematic survey | |
CN112287089B (zh) | 用于自动问答***的分类模型训练、自动问答方法及装置 | |
CN111695591B (zh) | 基于ai的面试语料分类方法、装置、计算机设备和介质 | |
CN113408430B (zh) | 基于多级策略和深度强化学习框架的图像中文描述***及方法 | |
Lu et al. | Speech depression recognition based on attentional residual network | |
Kung | Research on signal processing technology optimization of contact image sensor based on BP neural network algorithm | |
Utsumi | A neurobiologically motivated analysis of distributional semantic models | |
CN117316369B (zh) | 平衡跨模态信息的胸部影像诊断报告自动生成方法 | |
CN111783473B (zh) | 医疗问答中最佳答案的识别方法、装置和计算机设备 | |
CN111627561B (zh) | 标准症状抽取方法、装置、电子设备和存储介质 | |
CN109101883A (zh) | 一种抑郁倾向评价装置及*** | |
Bedi et al. | Extractive text summarization for biomedical transcripts using deep dense LSTM‐CNN framework | |
Lian et al. | Cross modification attention-based deliberation model for image captioning | |
CN116978409A (zh) | 基于语音信号的抑郁状态评估方法、装置、终端及介质 | |
CN116720498A (zh) | 一种文本相似度检测模型的训练方法、装置及其相关介质 | |
CN116645980A (zh) | 一种聚焦样本特征间距的全生命周期语音情感识别方法 | |
CN116994695A (zh) | 报告生成模型的训练方法、装置、设备及存储介质 | |
Li et al. | Are lexical representations graded or discrete? | |
Ihor et al. | Exploring multimodal data approach in natural language processing based on speech recognition algorithms | |
Zhou | [Retracted] Analysis of Psychological and Emotional Tendency Based on Brain Functional Imaging and Deep Learning | |
Zeng et al. | Learning cross-modality features for image caption generation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240123 Address after: Room 801, 85 Kefeng Road, Huangpu District, Guangzhou City, Guangdong Province Patentee after: Guangzhou Dayu Chuangfu Technology Co.,Ltd. Country or region after: China Address before: 400065 Chongwen Road, Nanshan Street, Nanan District, Chongqing Patentee before: CHONGQING University OF POSTS AND TELECOMMUNICATIONS Country or region before: China |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240705 Address after: No. 117 Liuhua Road, Yuexiu District, Guangzhou City, Guangdong Province, 510010, Self Compiled Hall 18 Patentee after: Guangdong noble medical imaging diagnosis center Co.,Ltd. Country or region after: China Address before: Room 801, 85 Kefeng Road, Huangpu District, Guangzhou City, Guangdong Province Patentee before: Guangzhou Dayu Chuangfu Technology Co.,Ltd. Country or region before: China |