CN108830155A - A kind of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning - Google Patents

A kind of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning Download PDF

Info

Publication number
CN108830155A
CN108830155A CN201810441544.XA CN201810441544A CN108830155A CN 108830155 A CN108830155 A CN 108830155A CN 201810441544 A CN201810441544 A CN 201810441544A CN 108830155 A CN108830155 A CN 108830155A
Authority
CN
China
Prior art keywords
characteristic pattern
segmentation
heart
neural network
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810441544.XA
Other languages
Chinese (zh)
Other versions
CN108830155B (en
Inventor
徐波
梁枭
王筱斐
叶丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING HONGYUN ZHISHENG TECHNOLOGY Co.,Ltd.
Fuwai Hospital of CAMS and PUMC
Original Assignee
Beijing Hongyun Zhisheng Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Hongyun Zhisheng Technology Co Ltd filed Critical Beijing Hongyun Zhisheng Technology Co Ltd
Priority to CN201810441544.XA priority Critical patent/CN108830155B/en
Publication of CN108830155A publication Critical patent/CN108830155A/en
Application granted granted Critical
Publication of CN108830155B publication Critical patent/CN108830155B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/194Segmentation; Edge detection involving foreground-background segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/49Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30048Heart; Cardiac
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30101Blood vessel; Artery; Vein; Vascular
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03Recognition of patterns in medical or anatomical images

Abstract

The present invention provides a kind of, and method for distinguishing is divided and known to the heart coronary artery based on deep learning, by any one frame picture in selection segmentation heart radiography Dicom video as training sample, convolutional neural networks module in neural network carries out the segmentation and identification of blood vessel by the method for deep learning to the picture in training sample, and the cardiovascular characteristic pattern for being used to divide and identify is exported to pyramid module;The method of pyramid module application pyramid fusion exports the cardiovascular characteristic pattern of different scale to warp lamination;Warp lamination obtains the technical solution of heart coronary artery segmentation and identification vessel graph by the method for bilinear interpolation, can label to each pixel in picture, identify the type of different blood vessel in picture.Unbalanced problem of classifying caused by differing greatly due to background pixel and blood vessel pixel ratio is eliminated, the interference that the texture of similar vessel-like in image background introduces effectively is avoided, improves the accuracy of separation.

Description

A kind of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning
Technical field
The present invention relates to Internet technical field more particularly to it is a kind of based on deep learning heart coronary artery segmentation and Know method for distinguishing.
Background technique
The segmentation of coronarogram picture is important application of the image Segmentation Technology in medical domain, coronary artery Accurate extraction can assist diagnosis cardiovascular disease and determine suitable therapeutic scheme, while it is also blood vessel Three-dimensional Gravity The important foundation built, plays an important role in clinical treatment.
Existing technology is generally the characteristic based on coronary artery, designs corresponding filter and completes enhancing blood vessel spy It seeks peace and inhibits ambient noise task.The background and blood vessel color of usual contrastographic picture are very close, lack robustness, so mentioning It is easy to during taking by the strip extraction in background be blood vessel.This is greatly lowered the accuracy rate of segmentation.
Since the shape of heart contrastographic picture medium vessels is very much like, so the prior art is difficult to judge every blood vessel Concrete type.
Summary of the invention
The present invention provides a kind of, and method for distinguishing is divided and known to the heart coronary artery based on deep learning, solves heart The segmentation and identification problem of coronarogram picture.It can be divided according to the technical solution of the present invention by higher accuracy rate And identify the heart coronary artery in contrastographic picture, lesion, which is analyzed, for doctor provides auxiliary material at the same time as blood vessel three-dimensional The basis of reconstruction.
In order to achieve the above object, a kind of heart coronary artery segmentation and identification based on deep learning provided by the invention Method, including:
It chooses any one frame picture in segmentation heart radiography Dicom video and training sample is inputted into mind as training sample Through in network;The neural network is made of convolutional neural networks module, pyramid model and warp lamination;
Convolutional neural networks module in neural network receives the training sample, by the method for deep learning to training Picture in sample carries out the segmentation and identification of blood vessel, and the cardiovascular characteristic pattern for being used to divide and identify is exported to pyramid Module;
Pyramid module receives the cardiovascular characteristic pattern for dividing and identifying, defeated using the method that pyramid merges The cardiovascular characteristic pattern of different scale is to warp lamination out;
Warp lamination receives the cardiovascular characteristic pattern of different scale, obtains heart coronaries by the method for bilinear interpolation Artery segmentation and identification vessel graph.
Further, the acquisition methods of the segmentation heart radiography Dicom video include:
Receive the whole section of heart radiography Dicom video corresponding with lesion information stored in medical integrated database;
Based on lesion information, the key feature occurred in whole section of heart radiography Dicom video of SSN Cooperative Analysis is used Information.
Based on key feature information and position information is combined, whole section of Dicom video is segmented, and the iteration step, Meet the segmenting video of setting until eventually finding.
Further, the convolutional neural networks module is repeatedly stacked by multilayer same unit, and the unit is from upper Convolutional layer, batch standardization layer, quick articulamentum, activation primitive layer are followed successively by under.
Further, the convolutional layer receives training sample, to the block of pixels of each fixed size in training sample data 2D convolution algorithm is carried out, extracts the characteristic pattern for dividing and identifying contained in training sample data, and characteristic pattern is exported To batch standardization layer.
Further, described batch of standardization layer receives the characteristic pattern of convolutional layer output, subtract to feature diagram data It is worth the operation divided by variance, so that feature diagram data univesral distribution, and batch standardization characteristic pattern is output to quick articulamentum.
Further, the quick articulamentum receives batch output of standardization layer, by the input of convolutional layer and batch standardization The output of layer is added to obtain characteristic pattern by weight, and characteristic pattern is output to activation primitive layer.
Further, the activation primitive receives the output of quick articulamentum, carries out non-linear place to the data received Reason carries out relu operation to these characteristic patterns;By the convolutional layer of treated data input next unit;Until nerve net All feature extraction layers of convolutional network have been calculated in all units in network structure, obtain the cardiovascular for dividing and identifying Characteristic pattern, and the cardiovascular characteristic pattern for being used to divide and identify is inputted into pyramid module.
Further, the pyramid module receives the cardiovascular characteristic pattern for dividing and identifying, using pyramid The method of fusion first carries out convolution operation to characteristic pattern, exports the cardiovascular characteristic pattern of different scale;By the heart of different scale Dirty blood vessel characteristic pattern inputs warp lamination;
Warp lamination receives the cardiovascular characteristic pattern of different scale, by the method for bilinear interpolation by different scale Cardiovascular characteristic pattern is amplified to same size, is finally merged together along a dimension, obtains heart coronary artery segmentation And identification vessel graph.
Further, further include the steps that parameter updates, which includes:
Compare output heart coronary artery segmentation and identification vessel graph and doctor's essence mark heart coronary artery segmentation and The difference of identification vessel graph obtains penalty values, and the parameter by gradient descent method to each layer of neural network is updated;Iteration All steps are run, are lower than until by penalty values between neural network segmentation and the vessel graph identified and doctor's essence mark Preset threshold value.
It further, further include testing procedure, which includes:
Step 1:The heart radiography Dicom video file of the patient taken is read, key frame is extracted, inputs nerve net Network;And read the corresponding model parameter of the position.
Step 2:Neural network is initialized, and multilayer neural network structure is established, and reads trained corresponding position Model parameter.
Step 3:Neural network receives the heart radiography Dicom video image of patient, by the method for deep learning to defeated Enter segmentation and detection that picture carries out blood vessel, exports the blood vessel segmentation and identification picture of different position key frames;
Step 4:Step 1 is repeated to step 3 to different positions, is disposed until by the key frame of all positions.
A kind of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning provided by the invention, passes through to choose and divide Any one frame picture inputs training sample in neural network as training sample in section heart radiography Dicom video;The mind It is made of through network convolutional neural networks module, pyramid model and warp lamination;Convolutional neural networks mould in neural network Block receives the training sample, carries out the segmentation and identification of blood vessel to the picture in training sample by the method for deep learning, The cardiovascular characteristic pattern for being used to divide and identify is exported to pyramid module;Pyramid module is received for dividing and identifying Cardiovascular characteristic pattern export the cardiovascular characteristic pattern of different scale to warp lamination using the method that pyramid merges; Warp lamination receives the cardiovascular characteristic pattern of different scale, obtains heart coronary artery segmentation by the method for bilinear interpolation And the technical solution of identification vessel graph, the image Segmentation Technology based on deep learning is applied in coronary artery segmentation.It can be with It is automatically performed the segmentation and identification mission of heart contrastographic picture end to end.Divide positioning heart radiography figure with higher accuracy rate Coronary artery as in.It can label to each pixel in picture, to identify the type of different blood vessel in picture.It answers With the method for deep learning, on the one hand eliminates and classify not caused by being differed greatly due to background pixel and blood vessel pixel ratio On the other hand equalization problem also effectively avoids in image background the interference that the texture of similar vessel-like introduces, improve point Cut accuracy.
Detailed description of the invention
Fig. 1 is a kind of process of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning according to the present invention Figure.
Fig. 2 is a kind of unification of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning according to the present invention The characteristic pattern schematic diagram of distribution.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, below in conjunction in the embodiment of the present invention Attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people The model that the present invention protects all should belong in member's every other embodiment obtained without making creative work It encloses.
Embodiment one
Referring to Fig.1, Fig. 1 is shown, a kind of heart coronary artery segmentation and knowledge based on deep learning provided by the invention Method for distinguishing, including step S110- step S140:
In step s 110, choosing any one frame picture in segmentation heart radiography Dicom video will instruct as training sample Practice in sample input neural network;
The neural network is made of convolutional neural networks module, pyramid model and warp lamination.
In the step s 120, the convolutional neural networks module in neural network receives the training sample, by depth The method of habit carries out the segmentation and identification of blood vessel, the cardiovascular feature that will be used to divide and identify to the picture in training sample Figure is exported to pyramid module.
In step s 130, the pyramid module in neural network receives the cardiovascular feature for dividing and identifying Figure exports the cardiovascular characteristic pattern of different scale to warp lamination using the method that pyramid merges.
In step S140, the warp lamination in neural network receives the cardiovascular characteristic pattern of different scale, by double The method of linear interpolation obtains heart coronary artery segmentation and identification vessel graph.
Segmentation heart radiography Dicom video acquisition methods include:
Receive the whole section of heart radiography Dicom video corresponding with lesion information stored in medical integrated database; Based on lesion information, the key feature information occurred in whole section of heart radiography Dicom video of SSN Cooperative Analysis is used;Base In key feature information and position information is combined, whole section of Dicom video is segmented, and the iteration step, until finally looking for To the segmenting video for meeting setting.The relatively clear Digital Subtraction heart radiography of vessel profile is intercepted out from dicom file Image, and picture is handled as single pass gray scale picture, input convolutional neural networks.
Wherein, heart radiography Dicom sets of video data is by the Dicom coronary digital of about 100 patients with coronary heart disease Subtractive angiography (Digital imaging in medicine communication) file composition.Every patient has multiple Dicom files of different positions, often A Dicom file all includes the coronarography of several frames, and each frame has different types of blood vessel, including Left main artery, a left side Circumflex branch, left anterior descending branch, collateral, left branches of interventricular septum, right hat etc..It needs to divide in the present invention and the blood vessel identified is exactly these blood Pipe.For each frame image in video, doctor can carry out fine Pixel-level mark to the blood vessel in figure.Using these this A little data train network model, carry out the segmentation and identification of blood vessel using the model trained later.
The convolutional neural networks module is repeatedly stacked by multilayer same unit, and the unit is followed successively by from top to bottom Convolutional layer, batch standardization layer, quick articulamentum, activation primitive layer.
Further, the convolutional layer receives training sample, to the block of pixels of each fixed size in training sample data 2D convolution algorithm is carried out, extracts the characteristic pattern for dividing and identifying contained in training sample data, and characteristic pattern is exported To batch standardization layer.
High-dimensional feature in picture is extracted to reach by carrying out convolution algorithm again and again to input picture, Exactly these features contain all information used in segmentation and identification process.
Further, described batch of standardization layer receives the characteristic pattern of convolutional layer output, subtract to feature diagram data It is worth the operation divided by variance, so that feature diagram data univesral distribution, and batch standardization characteristic pattern is output to quick articulamentum.
The feature diagram data of univesral distribution as shown in Figure 2, under normal circumstances, training neural network generally require to arrive for three days One week time, along with experiment results are done, time cost often needs an important factor for considering.Criticize standardization layer just It is that can be substantially reduced a kind of method of time cost with acceleration model training speed.Batch standardization is by Identity Planization to same The lower convergence rate for accelerating network of suitable distribution, the first step of concrete operations is standardized to the feature of input, will be defeated The feature entered subtracts after its mean value divided by its variance, and detailed process is represented by:
WhereinFeature after indicating standardization, x indicate the feature of input, E [x(k)] indicate input feature vector mean value,Indicate the variance of input feature vector.
During extracting cardiovascular feature, time cost is also reduced.So after convolutional layer, to volume The image of the heart coronaries radiography of lamination output does one batch of standardization processing.One is carried out to the feature of convolutional layer output to subtract Mean value while needing to do each layer of mean value and variance one storage divided by the operation of variance so as to during the test can be with It directly uses, the heart contrastographic picture after convolution can be made to have unified data distribution, in this way so as to accelerate to mention Take the task of blood vessel feature.
Second step is to carry out Pan and Zoom to the feature of standardization, it is therefore an objective to network oneself be allowed to learn to be suitble to the defeated of network Out, detailed process is represented by:
Wherein γ(k)For the scaling parameter that can learn, β(k)For the translation parameters that can learn.
Further, the quick articulamentum receives batch output of standardization layer, by the input of convolutional layer and batch standardization The output of layer is added to obtain characteristic pattern by weight, and characteristic pattern is output to activation primitive layer.If entire neural network be exactly by Dry quick articulamentum, which is connected, to be formed.
The number of plies of neural network is deeper, and the dimension for the feature that can be acquired is also higher, therefore the number of plies is to neural network Have very big influence.But when the number of plies of neural network becomes deeper and deeper, deeper model is difficult table Up to the feature of low dimensional, so the problems such as just will appear gradient explosion, gradient disappearance.Quick connection unit is to solve this to ask The method of topic.Remember H (X)=F (X)+X, in extreme circumstances F (X) there is nothing study arrive, i.e. F (X)=0, at this time H (X)= X.This ensures that shallow-layer feature is transmitted backward, and the feature that whole network learns will not be too poor, and quick connection unit is used In the extracting the feature extraction of heart coronary artery contrastographic picture of the task.Model oneself is allowed to determine that it wants to extract characteristic dimension Just, accomplish the cardiovascular feature for retaining useful low dimensional as far as possible.It is asked to solve gradient explosion with what gradient disappeared Topic.
Entire quick connection procedure can be expressed as:
Y=F (x, { wi})+x
Wherein y indicates the feature of output, and x indicates the feature of input, and F (X, { Wi }) indicates to need the residual error of training to map letter Number, Wi indicate the weight of this layer.
Further, the activation primitive receives the output of quick articulamentum, carries out non-linear place to the data received Reason carries out relu operation to these characteristic patterns;By the convolutional layer of treated data input next unit;Until nerve net All feature extraction layers of convolutional network have been calculated in all units in network structure, obtain the cardiovascular for dividing and identifying Characteristic pattern, and the cardiovascular characteristic pattern for being used to divide and identify is inputted into pyramid module.
If it is simple these linear convolutions are connected to the network, then final effect is only single with one Convolution unit is the same.So needing to introduce activation primitive layer in actual use, the image that such as figure is activation primitive, tool Body process is represented by:
Y=G (X)
Wherein y is output feature, and x is input feature vector, and G is activation primitive.
During the test, also the heart coronary artery blood-vessel image that process of convolution is crossed subtract mean value divided by variance Operation guarantees that test is consistent with the distribution of training process cardiac coronary artery characteristics of image.
Further, the pyramid module receives the cardiovascular characteristic pattern for dividing and identifying, using pyramid The method of fusion first carries out convolution operation to characteristic pattern, exports the cardiovascular characteristic pattern of different scale;By the heart of different scale Dirty blood vessel characteristic pattern inputs warp lamination.
Pyramid module has merged the feature of 4 kinds of different scales of the heart coronary artery image extracted.I.e. by four kinds The fusion of different size of heart features, if figure the first row red is most coarse heart coronary artery characteristics of image, behind three rows It is the heart coronary artery image pond feature of different scale.In order to guarantee the weight of global characteristics, if pyramid share it is N number of Rank then will be reduced to rank channel using the convolution of 1x1 after each rank the 1/N of script.Pass through bilinear interpolation again Size before obtaining non-pond, is finally merged together along a dimension.
Warp lamination receives the cardiovascular characteristic pattern of different scale, by the method for bilinear interpolation by different scale Cardiovascular characteristic pattern is amplified to same size, is finally merged together along a dimension, obtains heart coronary artery segmentation And identification vessel graph.
Further, further include the steps that parameter updates, which includes:
Compare output heart coronary artery segmentation and identification vessel graph and doctor's essence mark heart coronary artery segmentation and The difference of identification vessel graph obtains penalty values, and the parameter by gradient descent method to each layer of neural network is updated;Iteration All steps are run, are lower than until by penalty values between neural network segmentation and the vessel graph identified and doctor's essence mark Preset threshold value.
It further, further include testing procedure, which includes:
Step 1:The heart radiography Dicom video file of the patient taken is read, key frame is extracted, inputs nerve net Network;And read the corresponding model parameter of the position.
Step 2:Neural network is initialized, and multilayer neural network structure is established, and reads trained corresponding position Model parameter.
Step 3:Neural network receives the heart radiography Dicom video image of patient, by the method for deep learning to defeated Enter segmentation and detection that picture carries out blood vessel, exports the blood vessel segmentation and identification picture of different position key frames;
Step 4:Step 1 is repeated to step 3 to different positions, is disposed until by the key frame of all positions.
One preferred embodiment, laboratory hardware:Intel Xeon CPU E5-2630 v4 CPU and NVIDIA GTX 1080 Ti GPU carry out Collaborative Control.
One, reading data
Step 1:The whole section of heart corresponding with the lesion information for receiving to store from medical integrated database is made Shadow Dicom video.
Step 2:Based on disease information, the key occurred in whole section of heart radiography Dicom video of SSN Cooperative Analysis is used Characteristic information.
Step 3:Based on key feature information and position information is combined, whole section of Dicom video is segmented, and iteration The step meets the segmenting video of setting until eventually finding.
Step 4:Any one frame in selecting video segmentation is inputted in neural network module as training sample.
Two, training network is split and detects to blood vessel
Step 1:Neural network is initialized, and multilayer neural network structure is established, repeatedly stacked by similar units and At, be followed successively by from top to bottom in a unit convolutional layer, batch standardization layer, quick articulamentum, activation primitive layer.It reads simultaneously pre- Training pattern parameter.
Step 2:Neural network receives digital subtraction angiography image, by the method for deep learning to input picture Carry out the segmentation and detection of blood vessel.
Step 3:Convolutional layer receives digital subtraction angiography image, to the pixel of each fixed size in data Block carries out 2D convolution algorithm, extracts the main information that can be used for dividing and identifying contained in data, and these information are defeated Out to batch standardization layer.
Step 4:The characteristic pattern that standardization layer receives convolutional layer output is criticized, subtract mean value divided by variance to data Operation, so that data be allowed to have a unified distribution, and is output to quick articulamentum for processed characteristic pattern.
Step 5:Quick articulamentum receives batch output of standardization layer, and inputting for convolutional layer is defeated with batch standardization layer It is added to obtain characteristic pattern by weight out, and is output to activation primitive layer.
Step 6:Pair activation primitive receives the output of quick articulamentum, carries out Nonlinear Processing to the data that receive, i.e., These characteristic patterns carry out relu operation.By the convolutional layer of treated data input next unit.
Step 7:All feature extraction layers of three to six steps until convolutional network has been calculated are repeated, final spy is obtained Sign figure.All main informations for blood vessel segmentation and identification are needed here it is us.By these information input pyramid modules.
Step 8:Pyramid module receives these cardiovascular characteristic patterns for dividing and identifying, melts using pyramid The method of conjunction first carries out convolution operation to characteristic pattern, exports the cardiovascular characteristic pattern of four kinds of different scales.By four kinds of different rulers The cardiovascular characteristic pattern of degree inputs warp lamination.
Step 9:Warp lamination receives the cardiovascular characteristic pattern of four kinds of different scales, passes through the method for bilinear interpolation The cardiovascular characteristic pattern of four kinds of different scales is amplified to same size, is finally merged together along a dimension.This is just Last segmentation identification vessel graph is obtained.
Step 10:The difference of the segmentation identification vessel graph and doctor's essence mark picture that more finally export obtains penalty values, The parameter by gradient descent method to each layer of neural network is updated later.
Step 11:Iteration operating procedure two to step 10 until divided by neural network and the vessel graph that identifies with Penalty values are lower than preset threshold value between doctor's essence mark.
Step 12:Model parameter after training and Artificial Neural Network Structures are stored, so as in later test process It uses.
Step 13:Train the model parameter of different position data and storage.
Test network is split and detects to blood vessel
Step 1:The Dicom file of the patient taken is read, key frame is extracted, inputs neural network.And read the body The corresponding model parameter in position.
Step 2:Neural network is initialized, and multilayer neural network structure, and trained correspondence before reading are established The model parameter of position.
Step 3:Neural network receives digital subtraction angiography image, by the method for deep learning to input picture The segmentation and detection for carrying out blood vessel export the blood vessel segmentation and identification picture of different position key frames.
Step 4:Above-mentioned one to three step is repeated to different positions, is disposed until by the key frame of all positions.
A kind of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning provided by the invention, passes through to choose and divide Any one frame picture inputs training sample in neural network as training sample in section heart radiography Dicom video;The mind It is made of through network convolutional neural networks module, pyramid model and warp lamination;Convolutional neural networks mould in neural network Block receives the training sample, carries out the segmentation and identification of blood vessel to the picture in training sample by the method for deep learning, The cardiovascular characteristic pattern for being used to divide and identify is exported to pyramid module;Pyramid module is received for dividing and identifying Cardiovascular characteristic pattern export the cardiovascular characteristic pattern of different scale to warp lamination using the method that pyramid merges; Warp lamination receives the cardiovascular characteristic pattern of different scale, obtains heart coronary artery segmentation by the method for bilinear interpolation And the technical solution of identification vessel graph, the image Segmentation Technology based on deep learning is applied in coronary artery segmentation.It can be with It is automatically performed the segmentation and identification mission of heart contrastographic picture end to end.Divide positioning heart radiography figure with higher accuracy rate Coronary artery as in.It can label to each pixel in picture, to identify the type of different blood vessel in picture.It answers With the method for deep learning, on the one hand eliminates and classify not caused by being differed greatly due to background pixel and blood vessel pixel ratio On the other hand equalization problem also effectively avoids in image background the interference that the texture of similar vessel-like introduces, improve point Cut accuracy.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (10)

1. a kind of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning, which is characterized in that including:
It chooses any one frame picture in segmentation heart radiography Dicom video and training sample is inputted into nerve net as training sample In network;
Convolutional neural networks module in neural network receives the training sample, by the method for deep learning to training sample In picture carry out blood vessel segmentation and identification, the cardiovascular characteristic pattern for being used to divide and identify is exported to pyramid mould Block;
Pyramid module in neural network receives the cardiovascular characteristic pattern for dividing and identifying, using pyramid fusion Method exports the cardiovascular characteristic pattern of different scale to warp lamination;
Warp lamination in neural network receives the cardiovascular characteristic pattern of different scale, is obtained by the method for bilinear interpolation Heart coronary artery segmentation and identification vessel graph.
2. the method as described in claim 1, which is characterized in that the acquisition methods packet of the segmentation heart radiography Dicom video It includes:
Receive the whole section of heart radiography Dicom video corresponding with lesion information stored in medical integrated database;
Based on lesion information, believed using the key feature occurred in whole section of heart radiography Dicom video of SSN Cooperative Analysis Breath.
Based on key feature information and position information is combined, whole section of Dicom video is segmented, and the iteration step, until Eventually find the segmenting video for meeting setting.
3. method according to claim 1 or 2, which is characterized in that the convolutional neural networks module is by multilayer same unit It repeatedly stacks, the unit is followed successively by convolutional layer, batch standardization layer, quick articulamentum, activation primitive layer from top to bottom.
4. method as claimed in claim 3, which is characterized in that the convolutional layer receives training sample, to training sample data In the block of pixels of each fixed size carry out 2D convolution algorithm, extract contain in training sample data for dividing and identifying Characteristic pattern, and characteristic pattern is exported to batch standardization layer.
5. the method as claimed in claim 3 or 4, which is characterized in that described batch of standardization layer receives the feature of convolutional layer output Figure, the operation for subtracting mean value divided by variance is carried out to feature diagram data, so that feature diagram data univesral distribution, and will batch standardization Characteristic pattern is output to quick articulamentum.
6. the method as described in one of claim 3-5, which is characterized in that the quick articulamentum receives the defeated of batch standardization layer Out, the input of convolutional layer is added to obtain characteristic pattern by weight with batch output of standardization layer, and characteristic pattern is output to activation Function layer.
7. the method as described in one of claim 3-6, which is characterized in that the activation primitive receives the defeated of quick articulamentum Out, Nonlinear Processing is carried out to the data received, i.e., relu operation is carried out to these characteristic patterns;By treated, data are inputted The convolutional layer of next unit;Until all feature extractions of convolutional network have been calculated in unit all in neural network structure Layer obtains the cardiovascular characteristic pattern for dividing and identifying, and the cardiovascular characteristic pattern for being used to divide and identify is inputted Pyramid module.
8. the method as described in one of claim 1-7, which is characterized in that the pyramid module is received for dividing and identifying Cardiovascular characteristic pattern, using pyramid merge method, first to characteristic pattern carry out convolution operation, export the heart of different scale Dirty blood vessel characteristic pattern;The cardiovascular characteristic pattern of different scale is inputted into warp lamination;
Warp lamination receives the cardiovascular characteristic pattern of different scale, by the method for bilinear interpolation by the heart of different scale Blood vessel characteristic pattern is amplified to same size, is finally merged together along a dimension, obtains heart coronary artery segmentation and knows Other vessel graph.
9. method as described in one of claim 1-8, which is characterized in that further include the steps that parameter updates, which includes:
Compare the heart coronary artery segmentation of output and identifies vessel graph and the mark heart coronary artery segmentation of doctor's essence and identification The difference of vessel graph obtains penalty values, and the parameter by gradient descent method to each layer of neural network is updated;Iteration operation All steps, it is default until being lower than by penalty values between neural network segmentation and the vessel graph identified and doctor's essence mark Threshold value.
10. method as claimed in one of claims 1 to 9, which is characterized in that further include testing procedure, which includes:
Step 1:The heart radiography Dicom video file of the patient taken is read, key frame is extracted, inputs neural network;And Read the corresponding model parameter of the position.
Step 2:Neural network is initialized, and multilayer neural network structure is established, and reads the mould of trained corresponding position Shape parameter.
Step 3:Neural network receives the heart radiography Dicom video image of patient, is schemed by the method for deep learning to input Piece carries out the segmentation and detection of blood vessel, exports the blood vessel segmentation and identification picture of different position key frames;
Step 4:Step 1 is repeated to step 3 to different positions, is disposed until by the key frame of all positions.
CN201810441544.XA 2018-05-10 2018-05-10 Heart coronary artery segmentation and identification method based on deep learning Active CN108830155B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810441544.XA CN108830155B (en) 2018-05-10 2018-05-10 Heart coronary artery segmentation and identification method based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810441544.XA CN108830155B (en) 2018-05-10 2018-05-10 Heart coronary artery segmentation and identification method based on deep learning

Publications (2)

Publication Number Publication Date
CN108830155A true CN108830155A (en) 2018-11-16
CN108830155B CN108830155B (en) 2021-10-15

Family

ID=64147721

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810441544.XA Active CN108830155B (en) 2018-05-10 2018-05-10 Heart coronary artery segmentation and identification method based on deep learning

Country Status (1)

Country Link
CN (1) CN108830155B (en)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109394269A (en) * 2018-12-08 2019-03-01 余姚市华耀工具科技有限公司 Cardiac objects are highlighted platform
CN109558904A (en) * 2018-11-21 2019-04-02 咪咕文化科技有限公司 Classification method, device and the storage medium of image local feature
CN109741332A (en) * 2018-12-28 2019-05-10 天津大学 A kind of image segmentation and mask method of man-machine coordination
CN109903840A (en) * 2019-02-28 2019-06-18 数坤(北京)网络科技有限公司 A kind of model integration method and apparatus
CN109919931A (en) * 2019-03-08 2019-06-21 数坤(北京)网络科技有限公司 Coronary stenosis degree evaluation model training method and evaluation system
CN110009604A (en) * 2019-03-20 2019-07-12 北京理工大学 The breath signal extracting method and device of angiographic image series
CN110009640A (en) * 2018-11-20 2019-07-12 腾讯科技(深圳)有限公司 Handle method, equipment and the readable medium of heart video
CN110288611A (en) * 2019-06-12 2019-09-27 上海工程技术大学 Coronary vessel segmentation method based on attention mechanism and full convolutional neural networks
CN110517279A (en) * 2019-09-20 2019-11-29 北京深睿博联科技有限责任公司 Neck vessel centerline extracting method and device
CN111311583A (en) * 2020-02-24 2020-06-19 广州柏视医疗科技有限公司 Method and system for naming pulmonary trachea and blood vessel in segmented mode
CN111353989A (en) * 2020-03-03 2020-06-30 重庆理工大学 Coronary artery vessel complete angiography image identification method
CN111369528A (en) * 2020-03-03 2020-07-03 重庆理工大学 Coronary artery angiography image stenosis region marking method based on deep convolutional network
CN111445449A (en) * 2020-03-19 2020-07-24 上海联影智能医疗科技有限公司 Region-of-interest classification method and device, computer equipment and storage medium
CN111507455A (en) * 2019-01-31 2020-08-07 数坤(北京)网络科技有限公司 Neural network system generation method and device, image processing method and electronic equipment
CN111657883A (en) * 2020-06-03 2020-09-15 北京理工大学 Coronary artery SYNTAX score automatic calculation method and system based on sequence radiography
CN111862046A (en) * 2020-07-21 2020-10-30 江苏省人民医院(南京医科大学第一附属医院) System and method for distinguishing position of catheter in cardiac coronary silhouette
CN112150476A (en) * 2019-06-27 2020-12-29 上海交通大学 Coronary artery sequence vessel segmentation method based on space-time discriminant feature learning
CN113487628A (en) * 2021-07-07 2021-10-08 广州市大道医疗科技有限公司 Model training method, coronary vessel identification method, device, equipment and medium
CN113706568A (en) * 2020-05-20 2021-11-26 阿里巴巴集团控股有限公司 Image processing method and device
CN113706559A (en) * 2021-09-13 2021-11-26 复旦大学附属中山医院 Blood vessel segmentation extraction method and device based on medical image
US11342078B2 (en) * 2019-07-11 2022-05-24 Acer Incorporated Blood vessel status evaluation method and blood vessel status evaluation device
EP4104765A4 (en) * 2020-02-10 2024-01-24 Medipixel Inc Method and device for extracting major vessel region on basis of vessel image

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100169263A1 (en) * 2006-09-26 2010-07-01 Korpman Ralph A Individual health record system and apparatus
US20140226872A1 (en) * 2007-04-06 2014-08-14 Seiko Epson Corporation Apparatus and method for biometric authentication
US9053551B2 (en) * 2012-05-23 2015-06-09 International Business Machines Corporation Vessel identification using shape and motion mapping for coronary angiogram sequences
CN106372390A (en) * 2016-08-25 2017-02-01 姹ゅ钩 Deep convolutional neural network-based lung cancer preventing self-service health cloud service system
CN106920227A (en) * 2016-12-27 2017-07-04 北京工业大学 Based on the Segmentation Method of Retinal Blood Vessels that deep learning is combined with conventional method
CN107545269A (en) * 2016-06-23 2018-01-05 西门子保健有限责任公司 The method and system of vascular diseases detection is carried out using recurrent neural network
CN107730507A (en) * 2017-08-23 2018-02-23 成都信息工程大学 A kind of lesion region automatic division method based on deep learning
CN107843861A (en) * 2013-03-15 2018-03-27 米利开尔文科技有限公司 Improved technology, system and machine readable program for magnetic resonance

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100169263A1 (en) * 2006-09-26 2010-07-01 Korpman Ralph A Individual health record system and apparatus
US20140226872A1 (en) * 2007-04-06 2014-08-14 Seiko Epson Corporation Apparatus and method for biometric authentication
US9053551B2 (en) * 2012-05-23 2015-06-09 International Business Machines Corporation Vessel identification using shape and motion mapping for coronary angiogram sequences
CN107843861A (en) * 2013-03-15 2018-03-27 米利开尔文科技有限公司 Improved technology, system and machine readable program for magnetic resonance
CN107545269A (en) * 2016-06-23 2018-01-05 西门子保健有限责任公司 The method and system of vascular diseases detection is carried out using recurrent neural network
CN106372390A (en) * 2016-08-25 2017-02-01 姹ゅ钩 Deep convolutional neural network-based lung cancer preventing self-service health cloud service system
CN106920227A (en) * 2016-12-27 2017-07-04 北京工业大学 Based on the Segmentation Method of Retinal Blood Vessels that deep learning is combined with conventional method
CN107730507A (en) * 2017-08-23 2018-02-23 成都信息工程大学 A kind of lesion region automatic division method based on deep learning

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
GUCAN LONG 等: "Learning Image Matching by Simply Watching Video", 《HTTPS://ARXIV.ORG/ABS/1603.06041》 *
HENGSHUANG ZHAO 等: "Pyramid Scene Parsing Network", 《HTTPS://ARXIV.ORG/ABS/1612.01105》 *
KAIMING HE 等: "Deep Residual Learning for Image Recognition", 《HTTPS://ARXIV.ORG/ABS/1512.03385》 *
SIYUAN YANG等: "Automatic Coronary Artery Segmentation in X-ray Angiograms by Multiple Convolutional Neural Networks", 《ICMIP 2018: PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MULTIMEDIA AND IMAGE PROCESSING》 *
TAO KONG 等: "HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection", 《2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)》 *
YUE ZHAO 等: "Temporal Action Detection with Structured Segment Networks", 《HTTPS://ARXIV.ORG/ABS/1704.06228》 *
ZHANG_CAN: "[行为识别论文详解]SSN(Temporal Action Detection with Structured Segment Networks)", 《HTTPS://BLOG.CSDN.NET/ZHANG_CAN/ARTICLE/DETAILS/79782387》 *

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110009640A (en) * 2018-11-20 2019-07-12 腾讯科技(深圳)有限公司 Handle method, equipment and the readable medium of heart video
CN110009640B (en) * 2018-11-20 2023-09-26 腾讯科技(深圳)有限公司 Method, apparatus and readable medium for processing cardiac video
CN109558904A (en) * 2018-11-21 2019-04-02 咪咕文化科技有限公司 Classification method, device and the storage medium of image local feature
CN109394269B (en) * 2018-12-08 2021-12-10 沈阳鹏悦科技有限公司 Cardiac target highlighting platform
CN109394269A (en) * 2018-12-08 2019-03-01 余姚市华耀工具科技有限公司 Cardiac objects are highlighted platform
CN109741332A (en) * 2018-12-28 2019-05-10 天津大学 A kind of image segmentation and mask method of man-machine coordination
CN111507455A (en) * 2019-01-31 2020-08-07 数坤(北京)网络科技有限公司 Neural network system generation method and device, image processing method and electronic equipment
CN111507455B (en) * 2019-01-31 2021-07-13 数坤(北京)网络科技股份有限公司 Neural network system generation method and device, image processing method and electronic equipment
CN109903840A (en) * 2019-02-28 2019-06-18 数坤(北京)网络科技有限公司 A kind of model integration method and apparatus
CN109919931A (en) * 2019-03-08 2019-06-21 数坤(北京)网络科技有限公司 Coronary stenosis degree evaluation model training method and evaluation system
CN110009604A (en) * 2019-03-20 2019-07-12 北京理工大学 The breath signal extracting method and device of angiographic image series
CN110009604B (en) * 2019-03-20 2021-05-14 北京理工大学 Method and device for extracting respiratory signal of contrast image sequence
CN110288611A (en) * 2019-06-12 2019-09-27 上海工程技术大学 Coronary vessel segmentation method based on attention mechanism and full convolutional neural networks
CN112150476B (en) * 2019-06-27 2023-10-27 上海交通大学 Coronary artery sequence blood vessel segmentation method based on space-time discriminant feature learning
CN112150476A (en) * 2019-06-27 2020-12-29 上海交通大学 Coronary artery sequence vessel segmentation method based on space-time discriminant feature learning
US11342078B2 (en) * 2019-07-11 2022-05-24 Acer Incorporated Blood vessel status evaluation method and blood vessel status evaluation device
CN110517279A (en) * 2019-09-20 2019-11-29 北京深睿博联科技有限责任公司 Neck vessel centerline extracting method and device
CN110517279B (en) * 2019-09-20 2022-04-05 北京深睿博联科技有限责任公司 Method and device for extracting central line of head and neck blood vessel
EP4104765A4 (en) * 2020-02-10 2024-01-24 Medipixel Inc Method and device for extracting major vessel region on basis of vessel image
CN111311583A (en) * 2020-02-24 2020-06-19 广州柏视医疗科技有限公司 Method and system for naming pulmonary trachea and blood vessel in segmented mode
CN111369528A (en) * 2020-03-03 2020-07-03 重庆理工大学 Coronary artery angiography image stenosis region marking method based on deep convolutional network
CN111353989B (en) * 2020-03-03 2022-07-01 重庆理工大学 Coronary artery vessel complete angiography image identification method
CN111369528B (en) * 2020-03-03 2022-09-09 重庆理工大学 Coronary artery angiography image stenosis region marking method based on deep convolutional network
CN111353989A (en) * 2020-03-03 2020-06-30 重庆理工大学 Coronary artery vessel complete angiography image identification method
CN111445449B (en) * 2020-03-19 2024-03-01 上海联影智能医疗科技有限公司 Method, device, computer equipment and storage medium for classifying region of interest
CN111445449A (en) * 2020-03-19 2020-07-24 上海联影智能医疗科技有限公司 Region-of-interest classification method and device, computer equipment and storage medium
CN113706568A (en) * 2020-05-20 2021-11-26 阿里巴巴集团控股有限公司 Image processing method and device
CN113706568B (en) * 2020-05-20 2024-02-13 阿里巴巴集团控股有限公司 Image processing method and device
CN111657883B (en) * 2020-06-03 2021-05-04 北京理工大学 Coronary artery SYNTAX score automatic calculation method and system based on sequence radiography
CN111657883A (en) * 2020-06-03 2020-09-15 北京理工大学 Coronary artery SYNTAX score automatic calculation method and system based on sequence radiography
CN111862046B (en) * 2020-07-21 2023-11-17 江苏省人民医院(南京医科大学第一附属医院) Catheter position discrimination system and method in heart coronary wave silhouette
CN111862046A (en) * 2020-07-21 2020-10-30 江苏省人民医院(南京医科大学第一附属医院) System and method for distinguishing position of catheter in cardiac coronary silhouette
CN113487628A (en) * 2021-07-07 2021-10-08 广州市大道医疗科技有限公司 Model training method, coronary vessel identification method, device, equipment and medium
CN113487628B (en) * 2021-07-07 2024-02-23 广州市大道医疗科技有限公司 Model training method, coronary vessel identification method, device, equipment and medium
CN113706559A (en) * 2021-09-13 2021-11-26 复旦大学附属中山医院 Blood vessel segmentation extraction method and device based on medical image

Also Published As

Publication number Publication date
CN108830155B (en) 2021-10-15

Similar Documents

Publication Publication Date Title
CN108830155A (en) A kind of heart coronary artery segmentation and knowledge method for distinguishing based on deep learning
CN109146872B (en) Heart coronary artery image segmentation and identification method based on deep learning and optical flow method
CN108257135A (en) The assistant diagnosis system of medical image features is understood based on deep learning method
CN109035255B (en) Method for segmenting aorta with interlayer in CT image based on convolutional neural network
CN111161290B (en) Image segmentation model construction method, image segmentation method and image segmentation system
CN109872328A (en) A kind of brain image dividing method, device and storage medium
CN111462047B (en) Vascular parameter measurement method, vascular parameter measurement device, vascular parameter measurement computer device and vascular parameter measurement storage medium
CN108052977A (en) Breast molybdenum target picture depth study classification method based on lightweight neutral net
CN110796670B (en) Dissection method and device for dissecting interbed artery
CN106530283A (en) SVM (support vector machine)-based medical image blood vessel recognition method
CN107368859A (en) Training method, verification method and the lesion pattern recognition device of lesion identification model
CN108280827A (en) Coronary artery pathological changes automatic testing method, system and equipment based on deep learning
CN109272510A (en) The dividing method of tubular structure in a kind of 3 d medical images
CN112686855B (en) Information association method of eye image and symptom information
CN104463837A (en) Method and device for automatic or semi-automatic segmentation
Rakhlin et al. Breast tumor cellularity assessment using deep neural networks
CN107274406A (en) A kind of method and device of detection sensitizing range
CN104504708B (en) DSA (digital subtraction angiography) cerebrovascular image auto-segmenting method based on adjacent image feature point sets
CN111340773B (en) Retinal image blood vessel segmentation method
CN110047075A (en) A kind of CT image partition method based on confrontation network
CN114820658A (en) Hepatic vein and portal vein segmentation method and device
CN109063557B (en) Method for quickly constructing heart coronary vessel identification data set
CN113034522B (en) CT image segmentation method based on artificial neural network
CN112700409A (en) Automatic retinal microaneurysm detection method and imaging method
CN111814891A (en) Medical image synthesis method, device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210125

Address after: 100086 1704-1705, 17th floor, Qingyun contemporary building, building 9, Manting Fangyuan community, Qingyun Li, Haidian District, Beijing

Applicant after: BEIJING HONGYUN ZHISHENG TECHNOLOGY Co.,Ltd.

Applicant after: FUWAI HOSPITAL, CHINESE ACADEMY OF MEDICAL SCIENCES

Address before: 100086 1704-1705, 17th floor, Qingyun contemporary building, building 9, Manting Fangyuan community, Qingyun Li, Haidian District, Beijing

Applicant before: BEIJING HONGYUN ZHISHENG TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant