WO2020135015A1

WO2020135015A1 - Method, apparatus and device for establishing medical imaging model, and storage medium

Info

Publication number: WO2020135015A1
Application number: PCT/CN2019/124239
Authority: WO
Inventors: 梁栋; 王珊珊; 柯子文; 刘新; 郑海荣
Original assignee: 深圳先进技术研究院
Priority date: 2018-12-27
Filing date: 2019-12-10
Publication date: 2020-07-02
Also published as: CN111383742A

Abstract

A method, apparatus and device for establishing a medical imaging model, and a storage medium. The method comprises: obtaining K-space under-sampled data of a medical image as training samples (101); inputting the training samples into a pre-constructed original neural network for training, and optimizing the original neural network according to model loss functions (102); and when the model loss functions converge, stopping the training of a machine learning model and using the trained original neural network as a target medical imaging model (103), wherein the original neural network comprises a frequency domain network and an image domain network; the model loss functions comprise a main loss function and at least one additional loss function, and the additional loss function comprises a k-space loss function and/or an image domain loss function.

Description

一种医学成像模型的建立方法、装置、设备及存储介质Method, device, equipment and storage medium for establishing medical imaging model

本申请要求在2018年12月27日提交中国专利局、申请号为201811654047.4的中国专利申请的优先权，该申请的全部内容通过引用结合在本申请中。This application requires the priority of the Chinese patent application with the application number 201811654047.4 filed by the China Patent Office on December 27, 2018. The entire content of this application is incorporated by reference in this application.

技术领域Technical field

本申请涉及磁共振成像技术领域，例如涉及一种医学成像模型的建立方法、装置、设备及存储介质。The present application relates to the technical field of magnetic resonance imaging, for example, to a method, device, equipment and storage medium for establishing a medical imaging model.

背景技术Background technique

磁共振心脏电影成像是一种非侵入式的成像技术，能够为临床诊断提供丰富的空间和时间信息。由于磁共振物理及硬件的制约，磁共振心脏电影成像往往伴随着扫描时间长及成像速度慢等缺点。因此，如何在保证成像质量的前提下，加速磁共振心脏电影成像尤为重要。Magnetic resonance cardiac imaging is a non-invasive imaging technique that can provide rich spatial and temporal information for clinical diagnosis. Due to the physical and hardware constraints of magnetic resonance, magnetic resonance cardiac film imaging is often accompanied by the disadvantages of long scanning time and slow imaging speed. Therefore, on the premise of ensuring the imaging quality, accelerated magnetic resonance cardiac film imaging is particularly important.

相关技术中，常用的加速磁共振心脏电影成像的方法，包括并行成像、压缩感知技术、深度学习的方法等。例如，动态广义自动校准部分并行采集(TGRAPPA)、利用时间滤波器的自适应敏感度编码(TSENSE)、利用时间频率稀疏性的焦欠定***(k-t FOCUSS)、利用动态冗余的卡尔基方法(k-t SLR)、低秩稀疏矩阵(L+S)等。在磁共振心脏电影成像领域，基于级联卷积网络的磁共振动态成像(D5C5)及卷积递归神经网络(CRNN)取得了良好的重建效果。这两种方法利用神经网络，直接学习从欠采图像到全采图像的映射关系。In the related art, commonly used methods of accelerated magnetic resonance cardiac film imaging include parallel imaging, compressed sensing technology, and deep learning methods. For example, dynamic generalized automatic calibration partial parallel acquisition (TGRAPPA), adaptive sensitivity coding (TSENSE) using time filters, focal underdetermination system (ktFOCUSS) using time-frequency sparsity, and Kalki method using dynamic redundancy (kt SLR), low rank sparse matrix (L+S), etc. In the field of magnetic resonance cardiac imaging, magnetic resonance dynamic imaging (D5C5) and convolutional recurrent neural network (CRNN) based on cascaded convolutional networks have achieved good reconstruction results. These two methods use neural networks to directly learn the mapping relationship from under-captured images to full-captured images.

传统的并行成像或者压缩感知技术，没有利用大数据先验，并且这种迭代优化方法往往是耗时的且参数较难选择。而基于深度学习的神经网络方法(D5C5、CRNN)也存在明显的不足。这两种深度模型只运用了一个损失函数用于训练整个网络，网络的中间结果并没有加以约束，无法更准确地优化神经网络模型，最终无法更准确地对磁共振心脏电影成像进行重建。Traditional parallel imaging or compressed sensing technology does not make use of big data priors, and this iterative optimization method is often time-consuming and difficult to select parameters. The neural network methods (D5C5, CRNN) based on deep learning also have obvious shortcomings. These two deep models use only one loss function to train the entire network. The intermediate results of the network are not constrained, and the neural network model cannot be optimized more accurately, and ultimately the magnetic resonance cardiac film imaging cannot be reconstructed more accurately.

发明内容Summary of the invention

本发明实施例提供了一种医学成像模型的建立方法、装置、设备及存储介质，以实现对网络的中间结果加以约束，更准确、更快速地对K空间欠采样医学图像进行重建。Embodiments of the present invention provide a method, device, equipment, and storage medium for establishing a medical imaging model, so as to restrain the intermediate results of the network, and more accurately and quickly reconstruct the K-space under-sampled medical images.

本发明实施例提供了一种医学成像模型的建立方法，该方法包括：An embodiment of the present invention provides a method for establishing a medical imaging model. The method includes:

获取医学图像的K空间欠采样数据作为训练样本；Obtain K-space under-sampled data of medical images as training samples;

将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络；Input the training samples to the pre-built original neural network for training, and optimize the original neural network according to the model loss function;

当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型；When the model loss function converges, stop training the machine learning model and use the trained original neural network as the target medical imaging model;

其中，所述原始神经网络包括频率域网络FDN以及图像域网络SDN，所述频率域网络FDN与所述图像域网络SDN之间通过傅里叶逆变换IFFT连接；所述模型损失函数包括主损失函数以及至少一个附加损失函数，所述附加损失函数包括k空间损失函数和/或图像域损失函数。Wherein, the original neural network includes a frequency domain network FDN and an image domain network SDN, and the frequency domain network FDN and the image domain network SDN are connected by an inverse Fourier transform IFFT; the model loss function includes a main loss Function and at least one additional loss function, the additional loss function including a k-space loss function and/or an image domain loss function.

本发明实施例还提供了一种医学成像模型的建立装置，该装置包括：An embodiment of the present invention also provides a device for establishing a medical imaging model. The device includes:

训练样本获取模块，设置为获取医学图像的K空间欠采样数据作为训练样本；The training sample acquisition module is set to acquire K-space undersampled data of medical images as training samples;

训练模块，设置为将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络；A training module configured to input the training samples into the pre-built original neural network for training, and optimize the original neural network according to a model loss function;

目标医学成像模型确定模块，设置为当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型；The target medical imaging model determination module is configured to stop training the machine learning model when the model loss function converges, and use the trained original neural network as the target medical imaging model;

本发明实施例还提供了一种设备，该设备包括：An embodiment of the present invention also provides a device, which includes:

一个或多个处理器；One or more processors;

存储器，用于存储一个或多个程序，Memory for storing one or more programs,

当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现本发明实施例中任一所述的医学成像模型的建立方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the method for establishing a medical imaging model according to any one of the embodiments of the present invention.

本发明实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现本发明实施例中任一所述的医学成像模型的建立方法。An embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the method for establishing a medical imaging model according to any of the embodiments of the present invention is implemented.

本发明实施例的技术方案获取医学图像的K空间欠采样数据作为训练样本，能够直接学习从欠采样图像到全采样图像的映射关系。进而，将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络，使神经网络更加准确地表征输入的样本。进而，当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型，用于K空间欠采样数据的重建。进而，其中，所述原始神经网络包括频率域网络FDN以及图像域网络SDN，所述频率域网络FDN与所述图像域网络SDN之间通过傅里叶逆变换IFFT连接；所述模型损失函数包括主损失函数以及至少一个附加损失函数，所述附加损失函数包括k空间损失函数和/或图像域损失函数，充分结合频率域与图像域信息，直接学习从欠采图像到全采图像的映射关系，对不同网络深度的重建结果加以约束，能够更加充分地利用不同深度的网络信息。上述技术方案解决了传统的并行成像或者压缩感知技术，没有利用大数据先验，耗时且调参繁琐、基于深度学习的神经网络方法无法充分地利用频率域信息，无法更准确地对欠采样的图像进行重建的问题，实现能够同时学习频率域与图像域特征，充分结合频率域与图像域信息，对不同网络深度的重建结果加以约束，能够更加充分地利用不同深度的网络信息，快速、准确地对欠采样的医学图像进行重建，能够避免耗时的迭代求解步骤以及繁琐的调参过程。The technical solution of the embodiment of the present invention acquires K-space under-sampled data of medical images as training samples, and can directly learn the mapping relationship from under-sampled images to fully sampled images. Furthermore, the training samples are input to the pre-built original neural network for training, and the original neural network is optimized according to the model loss function, so that the neural network more accurately characterizes the input samples. Furthermore, when the model loss function converges, the training of the machine learning model is stopped, and the trained original neural network is used as the target medical imaging model for reconstruction of K-space undersampled data. Furthermore, wherein the original neural network includes a frequency domain network FDN and an image domain network SDN, and the frequency domain network FDN and the image domain network SDN are connected by an inverse Fourier transform IFFT; the model loss function includes Main loss function and at least one additional loss function, the additional loss function includes a k-space loss function and/or image domain loss function, fully combines the frequency domain and image domain information, and directly learns the mapping relationship from the under-captured image to the full-captured image In order to constrain the reconstruction results of different network depths, the network information of different depths can be used more fully. The above technical solution solves the traditional parallel imaging or compressed sensing technology, which does not use big data priors, is time-consuming and cumbersome to adjust parameters, and the neural network method based on deep learning cannot fully utilize the frequency domain information and cannot accurately undersample. The problem of image reconstruction is realized, which can learn the characteristics of the frequency domain and the image domain at the same time, fully combine the information of the frequency domain and the image domain, and constrain the reconstruction results of different network depths, which can make full use of the network information of different depths. Reconstructing under-sampled medical images accurately can avoid time-consuming iterative solving steps and tedious parameter adjustment process.

附图说明BRIEF DESCRIPTION

图1a是本发明实施例一中提供的一种医学成像模型的建立方法的流程图；1a is a flowchart of a method for establishing a medical imaging model provided in Embodiment 1 of the present invention;

图1b是本发明实施例一中提供的一种原始神经网络的结构示意图；1b is a schematic structural diagram of an original neural network provided in Embodiment 1 of the present invention;

图2a是本发明实施例二中提供的一种医学成像模型的建立方法的流程图；2a is a flowchart of a method for establishing a medical imaging model provided in Embodiment 2 of the present invention;

图2b是本发明实施例二中提供的不同磁共振心脏电影重建方法的结果比较；2b is a comparison of results of different magnetic resonance cardiac film reconstruction methods provided in Example 2 of the present invention;

图3是本发明实施例三中提供的一种医学成像模型的建立装置的结构示意图；3 is a schematic structural diagram of an apparatus for establishing a medical imaging model provided in Embodiment 3 of the present invention;

图4是本发明实施例四中的提供的一种设备的结构示意图。4 is a schematic structural diagram of a device provided in Embodiment 4 of the present invention.

具体实施方式detailed description

下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是，此处所描述的具体实施例仅仅用于解释本申请，而非对本申请的限定。另外还需要说明的是，为了便于描述，附图中仅示出了与本申请相关的部分而非全部结构。The present application will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present application, rather than limit the present application. In addition, it should be noted that, in order to facilitate description, the drawings only show parts, but not all structures related to the present application.

实施例一Example one

图1a为本发明实施例一提供的医学成像模型的建立方法的流程图，本实施例可适用于建立医学成像模型的情况，尤其适用于建立K空间欠采样数据的成像模型。该方法可以由医学成像模型的建立装置来执行，该装置可以由硬件和/或软件来实现，该装置可集成于设备(例如计算机)中来执行，具体包括如下步骤：FIG. 1a is a flowchart of a method for establishing a medical imaging model according to Embodiment 1 of the present invention. This embodiment is applicable to the case of establishing a medical imaging model, and is particularly suitable for establishing an imaging model of K-space under-sampled data. The method may be executed by a device for establishing a medical imaging model, and the device may be implemented by hardware and/or software. The device may be integrated into a device (such as a computer) for execution, and specifically includes the following steps:

步骤101、获取医学图像的K空间欠采样数据作为训练样本。Step 101: Acquire K-space under-sampled data of a medical image as a training sample.

示例性地，医学图像可以是磁共振心脏电影图像。K空间是寻常空间在傅利叶转换下的对偶空间，主要应用在磁振造影的成像分析，其他如磁振造影中的射频波形设计，以及量子计算中的初始态准备亦用到k空间的概念。Illustratively, the medical image may be a magnetic resonance cardiac movie image. K-space is the dual space of ordinary space under Fourier transform. It is mainly used in the imaging analysis of magnetic resonance imaging. Others such as the design of RF waveforms in magnetic resonance imaging and the preparation of the initial state in quantum computing also use the concept of k-space.

K空间欠采样数据是指欠采样的K空间数据。K-space under-sampled data refers to under-sampled K-space data.

该步骤获取K空间欠采样数据用于模型的训练。This step obtains K-space undersampled data for model training.

步骤102、将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络。Step 102: Input the training samples into the pre-built original neural network for training, and optimize the original neural network according to the model loss function.

所述原始神经网络包括频率域网络FDN以及图像域网络SDN，所述频率域网络FDN与所述图像域网络SDN之间通过傅里叶逆变换IFFT连接；所述模型损失函数包括主损失函数以及至少一个附加损失函数，所述附加损失函数包括k空间损失函数和/或图像域损失函数。The original neural network includes a frequency domain network FDN and an image domain network SDN, and the frequency domain network FDN and the image domain network SDN are connected by an inverse Fourier transform IFFT; the model loss function includes a main loss function and At least one additional loss function, the additional loss function including a k-space loss function and/or an image domain loss function.

所述附加损失函数包括k空间损失函数和图像域损失函数的至少一个。The additional loss function includes at least one of a k-space loss function and an image domain loss function.

可选地，所述频率域网络包括第一预设数量的频率域模块Fnet，其中，每个频率域模块Fnet包含第二预设数量的三维卷积层3D Conv以及一个频率域数据一致层KDC。Optionally, the frequency domain network includes a first preset number of frequency domain modules Fnet, wherein each frequency domain module Fnet includes a second preset number of three-dimensional convolution layers 3D Conv and a frequency domain data consistency layer KDC .

频率域模块中的频率域数据一致层KDC不是必须包括的，频率域模块Fnet可以只包含第二预设数量的三维卷积层3D Conv。The frequency domain data consistency layer KDC in the frequency domain module does not have to be included, and the frequency domain module Fnet may only include the second preset number of three-dimensional convolution layers 3D Conv.

可选地，将所述训练样本作为第一个频率域模块的第一个三维卷积层的输入；Optionally, the training sample is used as the input of the first three-dimensional convolutional layer of the first frequency domain module;

将所述频率域模块的前一个三维卷积层的输出结果作为所述频率域模块的下一个三维卷积层的输入；Using the output result of the previous three-dimensional convolutional layer of the frequency domain module as the input of the next three-dimensional convolutional layer of the frequency domain module;

将所述频率域模块的最后一个三维卷积层的输出结果作为所述频率域模块频率域数据一致层KDC的输入，将所述频率域数据一致层KDC的输出结果作为所述频率域模块的输出结果；The output result of the last three-dimensional convolutional layer of the frequency domain module is used as the input of the frequency domain data consistency layer KDC of the frequency domain module, and the output result of the frequency domain data consistency layer KDC is used as the frequency domain module's output Output result

将前一频率域模块的输出结果作为下一个频率域模块的输入，将最后一个频率域模块的输出结果作为所述频率域网络的输出结果。The output result of the previous frequency domain module is used as the input of the next frequency domain module, and the output result of the last frequency domain module is used as the output result of the frequency domain network.

频率域网络FDN的输出结果经过傅里叶逆变换IFFT的结果作为图像域网络SDN的输入。The output result of the frequency domain network FDN undergoes the inverse Fourier transform IFFT as the input of the image domain network SDN.

假设频率域网络由M个频率域模块Fnet _m(Fnet _m,m＝1,...,M)构成，每个频率域模块包含L个3维卷积层(3DConv)及一个频率域数据一致层(KDC)。频率域网络的前向过程可由如下公式表示： Suppose that the frequency domain network is composed of M frequency domain modules Fnet _m (Fnet _m , m=1,...,M), each frequency domain module contains L 3D convolutional layers (3DConv) and one frequency domain data is consistent Layer (KDC). The forward process of the frequency domain network can be expressed by the following formula:

第一个频率域模块(m＝1)：The first frequency domain module (m=1):

后续的频率域模块(m＝2,...,M)Subsequent frequency domain modules (m=2,...,M)

其中，σ表示非线性激活函数，可以是神经网络模型中常用的非线性激活函数。k _u表示输入的医学图像的K空间欠采样数据，

分别是第m个频率域模块中第l个卷积层的卷积核和偏置项，l＝1,...,L,m＝1,...,M。

表示第m个频率域模块中第l个卷积层的输出。每个频率域模块除了最后一个卷积层，其余每个频率域模块的所有卷积层均由非线性激活函数σ进行激活。经过卷积层进行提取特征后，即得到

后，利用频率域数据一致层KDC来纠正网络预测的k空间，如公式(9)所示。 Among them, σ represents a nonlinear activation function, which can be a nonlinear activation function commonly used in neural network models. k _u represents the K-space undersampled data of the input medical image,

They are the convolution kernel and offset term of the lth convolutional layer in the mth frequency domain module, l=1,...,L,m=1,...,M.

Represents the output of the lth convolution layer in the mth frequency domain module. Except for the last convolutional layer of each frequency domain module, all other convolutional layers of each frequency domain module are activated by a nonlinear activation function σ. After extracting features through the convolution layer, you get

Then, the frequency domain data consistency layer KDC is used to correct the k-space predicted by the network, as shown in formula (9).

KDC用于执行频率域数据一致操作，公式如下：KDC is used to perform frequency domain data consistency operations, the formula is as follows:

表示对

进行纠正的结果。令所有已采集的医学图像的K空间欠采样数据坐标构成的集合为Ω。如果k空间坐标(k _x,k _y)在集合Ω内，则

将通过真实采集的k空间点进行纠正。λ用于控制数据一致的程度，如果λ→∞，可以直接将实际采样点去替代

对应的点。

Indicate right

The result of the correction. Let the set of K-space undersampled data coordinates of all collected medical images be Ω. If the k-space coordinates (k _x , k _y ) are within the set Ω, then

It will be corrected by the real collected k-space points. λ is used to control the degree of data consistency. If λ→∞, the actual sampling point can be directly replaced

The corresponding point.

频率域网络FDN最终的输出是

对

再进行傅里叶逆变换便可以得到图像域的数据S ₀，它也是图像域网络的输入，如以下公式(10)。 The final output of the frequency domain network FDN is

Correct

Then the inverse Fourier transform can be used to obtain the image domain data S ₀ , which is also the input of the image domain network, as shown in the following formula (10).

如果频率域模块不包括KDC,则

作为频率域网络FDN最终的输出。 If the frequency domain module does not include KDC, then

As the final output of the frequency domain network FDN.

可选地，所述图像域网络SDN包括第三预设数量的图像域模块Snet，其中，每个图像域模块包含第四预设数量的三维卷积层3D Conv、一个图像域数据一致层IDC以及一个残差连接。Optionally, the image domain network SDN includes a third preset number of image domain modules Snet, wherein each image domain module includes a fourth preset number of three-dimensional convolution layers 3D Conv, an image domain data consistency layer IDC And a residual connection.

图像域模块可以只包含第四预设数量的三维卷积层3D Conv以及一个残差连接，不包含IDC。The image domain module may only contain a fourth preset number of three-dimensional convolutional layers 3D Conv and a residual connection, but not IDC.

可选地，将所述频率域网络的输出结果经过傅里叶逆变换IFFT后的结果作为第一个图像域模块的第一个三维卷积层的输入；Optionally, the output result of the frequency domain network after inverse Fourier transform IFFT is used as the input of the first three-dimensional convolution layer of the first image domain module;

将所述图像域模块的前一个三维卷积层的输出结果作为所述图像域模块的下一个三维卷积层的输入；Using the output result of the previous three-dimensional convolutional layer of the image domain module as the input of the next three-dimensional convolutional layer of the image domain module;

将所述图像域模块的最后一个三维卷积层的输出结果与所述图像域模块的第一个三维卷积层的输入进行求和运算后，输入所述图像域模块图像域数据一致层IDC，将所述图像域数据一致层IDC的输出结果作为所述图像域模块的输出结果；After summing the output of the last three-dimensional convolutional layer of the image domain module and the input of the first three-dimensional convolutional layer of the image domain module, input the image domain data consistent layer IDC of the image domain module , The output result of the image domain data consistency layer IDC is used as the output result of the image domain module;

将前一图像域模块的输出结果作为下一个图像域模块的输入，将最后一个图像域模块的输出结果作为所述图像域网络的输出结果。The output result of the previous image domain module is used as the input of the next image domain module, and the output result of the last image domain module is used as the output result of the image domain network.

图像域网络的前向过程可由如下公式表示，假设图像域网络包含N个图像域模块Snet _n(Snet _n,n＝1,...,N)： The forward process of the image domain network can be expressed by the following formula, assuming that the image domain network contains N image domain modules Snet _n (Snet _n , n=1,...,N):

第一个图像域模块(n＝1)：The first image domain module (n=1):

后续的图像域模块(n＝2,...,N)Subsequent image domain modules (n=2,...,N)

IDC用于执行图像域数据一致操作，公式如下：IDC is used to perform data domain data consistency operations, the formula is as follows:

分别是第n个图像域模块中第l个卷积层的卷积核和偏置项，l＝1,...,L,n＝1,...,N。

是第n个图像域模块中第l个卷积层的输出。除了最后一个(第L个)卷积层，其余所有卷积层均由非线性激活函数σ进行激活。经过卷积层进行提取特征后，引入残差学习(通过残差连接实现)，公式(19)中的S _n是残差学习(即残差连接)的结果。然后对S _n进行图像域数据一致操作(IDC)。IDC比KDC多了频率域与图像域之间转换，即公式(21)，然后通过式(22)-(23)进行图像域数据一致操作。λ用于控制数据一致的程度。

是对S _n进行IDC后的结果。

These are the convolution kernel and offset term of the lth convolutional layer in the nth image domain module, l=1,...,L,n=1,...,N.

Is the output of the lth convolution layer in the nth image domain module. Except for the last (Lth) convolutional layer, all other convolutional layers are activated by a nonlinear activation function σ. After extraction features convolutional layer is introduced residual learning (implemented via residual connections), the equation (19) is S _n is the result of learning the residual (i.e., residual connection). Then the image domain data S _n coherency operation (IDC). IDC has more conversion between the frequency domain and the image domain than KDC, that is, formula (21), and then the image domain data consistency operation is performed by formulas (22)-(23). λ is used to control the degree of data consistency.

It is the result of S _n for IDC.

经过频率域网络(FDN)及图像域网络(SDN)之后，可以得到对医学图像的K空间欠采样数据进行重建的结果。After the frequency domain network (FDN) and the image domain network (SDN), the result of reconstructing the K-space undersampled data of medical images can be obtained.

频率域网络用于预测全采样的k空间，图像域网络用于提取图像特征，两个网络通过傅里叶逆变换进行连接。同时，频率域网络和图像域网络均使用了数据一致层，用于纠正k空间数据。The frequency domain network is used to predict the fully sampled k-space, the image domain network is used to extract image features, and the two networks are connected by inverse Fourier transform. At the same time, both the frequency domain network and the image domain network use a data consistency layer to correct k-space data.

可选地，根据如下公式计算所述k空间损失函数：Optionally, the k-space loss function is calculated according to the following formula:

其中，Kloss表示k空间损失，K _f表示医学图像的K空间欠采样数据对应的全采样k空间数据，

表示第m个频率域模块的输出，M表示频率域模块的数量，α _m表示第m个频率域模块对应的k空间损失函数的权重，m＝1,…,M。每个频率域模块都会计算相应的k空间损失，M个频率域模块的损失相加构成频率域网络损失(k空间损失)，可以Kloss _m(m＝1,…,M)表示，能够实现对不同深度的重建结果进行约束。 Among them, Kloss represents k-space loss, K _f represents full-sampled k-space data corresponding to under-sampled K-space data of medical images,

Represents the output of the m-th frequency domain module, M represents the number of frequency-domain modules, and α _m represents the weight of the k-space loss function corresponding to the m-th frequency domain module, m=1,...,M. Each frequency domain module calculates the corresponding k-space loss. The losses of the M frequency-domain modules add up to form the frequency-domain network loss (k-space loss), which can be expressed by Kloss _m (m=1,...,M). The reconstruction results of different depths are constrained.

可以理解的是，公式中的

(第m个频率域模块的输出)需要根据是否有KDC进行调整。 Understandably, in the formula

(The output of the m-th frequency domain module) needs to be adjusted according to whether there is a KDC.

可选地，根据如下公式计算所述图像域损失函数：Optionally, the image domain loss function is calculated according to the following formula:

其中，Sloss表示图像域损失，S表示医学图像的K空间欠采样数据对应的全采样的医学图像，S _n表示第n个图像域模块的输出，N表示图像域模块的数量，β _n表示第n个图像域模块对应的图像域损失函数的权重，可以根据重建结果对β _n进行设置，n＝1,…,N-1。每个图像域模块都会计算相应的损失，用Lloss _n(n＝1,…,N-1)表示，N-1个图像域模块的损失函数相加构成图像域损失函数。 Where Sloss represents the image domain loss, S represents the fully sampled medical image corresponding to the K-space undersampled data of the medical image, S _n represents the output of the nth image domain module, N represents the number of image domain modules, and β _n represents the weight loss function of the image field n images corresponding domain module weight beta] _n can be set according to the result of the reconstruction, n = 1, ..., N -1. Each image domain module calculates the corresponding loss, which is represented by Lloss _n (n=1,...,N-1), and the loss functions of the N-1 image domain modules are added to form the image domain loss function.

可以理解的是，公式中的S _n表示第n个图像域模块的输出，需要根据是否有IDC进行调整。 It can be understood that S _n in the formula represents the output of the n-th image domain module, which needs to be adjusted according to whether there is an IDC.

可选地，根据如下公式计算所述主损失函数：Optionally, the main loss function is calculated according to the following formula:

其中，Ploss表示主损失，S表示S是医学图像的K空间欠采样数据对应的全采样的医学图像，S _N表示第N个图像域模块的输出，如果包含KDC和IDC,则

Among them, Ploss represents the main loss, S represents S is the fully sampled medical image corresponding to the K-space undersampled data of the medical image, and S _N represents the output of the Nth image domain module. If KDC and IDC are included, then

可选地，所述方法还包括：Optionally, the method further includes:

将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数。Weighting at least one of the additional loss functions and performing a sum operation with the main loss function to obtain a model loss function.

步骤103、当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型。Step 103: When the model loss function converges, stop training the machine learning model, and use the trained original neural network as the target medical imaging model.

其中，训练样本经过训练后得到的原始神经网络作为目标医学成像模型，可以用于对医学图像的K空间欠采样数据进行重建。Among them, the original neural network obtained after the training samples are trained as the target medical imaging model can be used to reconstruct the K-space under-sampled data of medical images.

示例性地，本发明实施例的一种原始神经网络模型如图1b所示。网络的输入是K空间欠采样数据k _u，输出是重建的医学图像S _N(图像域网络的输出，当存在KDC和IDC时，为

)。原始神经网络由频率域网络(FDN)及图像域网络(SDN)组成，两者通过傅里叶逆变换(IFFT)连接。其中频率域网络由M个频率域模块(Fnet)构成，每个频率域模块包含第二预设数量的3维卷积层(3D Conv)及1个频率域数据一致层(也可以不包括频率域数据一致层)，每个频率域模块的损失用Kloss _m(m＝1,…,M)表示，M个频率域模块的损失相加构成频率域网络损失(k空间损失)。 Exemplarily, an original neural network model according to an embodiment of the present invention is shown in FIG. 1b. The input of the network is the k-space undersampled data k _u , and the output is the reconstructed medical image S _N (the output of the image domain network, when KDC and IDC exist, it is

). The original neural network consists of a frequency domain network (FDN) and an image domain network (SDN), which are connected by an inverse Fourier transform (IFFT). The frequency domain network is composed of M frequency domain modules (Fnet), and each frequency domain module includes a second preset number of 3D convolution layers (3D Conv) and a frequency domain data consistency layer (frequency may not be included) Domain data consistency layer), the loss of each frequency domain module is represented by Kloss _m (m=1,...,M), and the losses of the M frequency domain modules are added to form the frequency domain network loss (k-space loss).

图像域网络由N个图像域模块(Snet)构成，每个图像域模块包含第四预设数量的3维卷积层(3D Conv)、一个图像域数据一致层(也可以不包括图像域数据一致层)及一个残差连接，每个图像域模块的损失用Lloss _n，(n＝1,…,N-1)表示，N-1个图像域模块的损失函数相加构成图像域损失函数。最后一个图像域模块的输出与医学图像的K空间欠采样数据对应的全采样的医学图像进行运算得到主损失函数Ploss。对k空间损失函数、图像域损失函数和主损失函数得到模型损失函数。图中的Recon表示重建后图像。 The image domain network is composed of N image domain modules (Snet), and each image domain module contains a fourth preset number of 3D conv layers (3D Conv) and an image domain data consistency layer (or may not include image domain data Consistent layer) and a residual connection, the loss of each image domain module is represented by Lloss _n (n=1,...,N-1), and the loss functions of N-1 image domain modules are added to form the image domain loss function . The output of the last image domain module and the fully sampled medical image corresponding to the K-space undersampled data of the medical image are operated to obtain the main loss function Ploss. The model loss function is obtained for the k-space loss function, the image domain loss function and the main loss function. Recon in the figure represents the reconstructed image.

实施例二Example 2

图2a为本发明实施例二提供的一种医学成像模型的建立方法的流程图，本实施例在上述实施例的基础上，可选是所述将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数，包括：分别对k空间损失函数和图像域损失函数进行加权；将所述主损失函数、加权后的k空间损失函数以及加权后的图像域损失函数进行求和运算得到模型损失函数。FIG. 2a is a flowchart of a method for establishing a medical imaging model according to Embodiment 2 of the present invention. In this embodiment, based on the foregoing embodiment, optionally, the weighting of at least one of the additional loss functions and Summing the main loss function to obtain a model loss function, including: weighting the k-space loss function and the image domain loss function respectively; weighting the main loss function, the weighted k-space loss function, and the weighted image domain The loss function is summed to obtain the model loss function.

在此基础上，一些实施例中，本实施例的方法还包括：获取待成像的K空间欠采样数据；将所述待成像的K空间欠采样数据输入训练完成的所述目标医学成像模型中，得到重建医学图像。On this basis, in some embodiments, the method of this embodiment further includes: acquiring K-space under-sampled data to be imaged; inputting the K-space under-sampled data to be imaged into the target medical imaging model after training To get reconstructed medical images.

如图2a所示，具体包括以下步骤：As shown in Figure 2a, it specifically includes the following steps:

步骤201、获取医学图像的K空间欠采样数据作为训练样本。Step 201: Acquire K-space under-sampled data of a medical image as a training sample.

步骤202、将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络。Step 202: Input the training samples to the pre-built original neural network for training, and optimize the original neural network according to the model loss function.

可选地，将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数。Optionally, weighting at least one of the additional loss functions and performing a sum operation with the main loss function to obtain a model loss function.

可选地，所述将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数，包括：分别对k空间损失函数和图像域损失函数进行加权；将所述主损失函数、加权后的k空间损失函数以及加权后的图像域损失函数进行求和运算得到模型损失函数。Optionally, the weighting at least one of the additional loss functions and performing a sum operation with the main loss function to obtain a model loss function includes: separately weighting the k-space loss function and the image domain loss function; Summing the main loss function, the weighted k-space loss function and the weighted image domain loss function to obtain the model loss function.

例如，模型损失函数可以用如下公式进行表示：For example, the model loss function can be expressed by the following formula:

其中，Tloss为通过上述公式计算得到的模型损失，S表示医学图像的K空间欠采样数据对应的全采样的医学图像，S _n表示第n个图像域模块的输出，N表示图像域模块的数量，β _n表示第n个图像域模块对应的图像域损失函数的权重。K _f表示医学图像的K空间欠采样数据对应的全采样k空间数据，

表示第m个频率域模块的输出，M表示频率域模块的数量，α _m表示第m个频率域模块对应的k空间损失函数的权重。 Where Tloss is the model loss calculated by the above formula, S represents the fully sampled medical image corresponding to the K-space undersampled data of the medical image, S _n represents the output of the nth image domain module, and N represents the number of image domain modules , Β _n represents the weight of the image domain loss function corresponding to the n-th image domain module. K _f represents the fully sampled k-space data corresponding to the K-space under-sampled data of the medical image,

Represents the output of the m-th frequency domain module, M represents the number of frequency-domain modules, and α _m represents the weight of the k-space loss function corresponding to the m-th frequency domain module.

可以理解的是，上述Tloss的计算公式为单个训练样本的损失计算公式，当多个训练样本同时训练时，使用上述公式分别对各训练样本计算损失并求和，作为模型的损失。It can be understood that the calculation formula of the above-mentioned Tloss is a calculation formula of the loss of a single training sample. When multiple training samples are simultaneously trained, the above formula is used to calculate and sum the losses of each training sample separately as the loss of the model.

步骤203、判断所述模型损失函数是否收敛。若是，执行步骤204，若否，返回执行步骤202。Step 203: Determine whether the model loss function converges. If yes, go to step 204, if no, go back to step 202.

即判断模型损失函数计算的损失是否达到预设阈值。预设阈值可以根据经验值设置。That is to judge whether the loss calculated by the model loss function reaches a preset threshold. The preset threshold can be set based on empirical values.

步骤204、停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型。Step 204: Stop training the machine learning model, and use the trained original neural network as the target medical imaging model.

步骤205、获取待成像的K空间欠采样数据。Step 205: Acquire K-space under-sampled data to be imaged.

步骤206、将所述待成像的K空间欠采样数据输入训练完成的所述目标医学成像模型中，得到重建医学图像。Step 206: Input the K-space under-sampled data to be imaged into the target medical imaging model after training to obtain a reconstructed medical image.

以磁共振心脏电影成像为例，为了展示本发明实施例对磁共振心脏电影成像的有效性，将本发明实施例的方法与目前主流的压缩感知及深度学习方法进行对比。不同磁共振心脏电影重建方法的结果比较，如图2b所示。图2b表示了不同磁共振心脏电影重建方法的结果比较。方法分别为：时间频率稀疏性的焦欠定***k-t FOCUSS、动态冗余的卡尔基方法k-t SLR、低秩稀疏矩阵L+S、基于级联卷积网络的磁共振动态成像D5C5以及本实施例提供的方法。(a)表示全采样图像，(b)表示零填充图像，(c)表示采样模板及时间维度的展开，(d)表示k-t FOCUSS的重建结果，(e)表示k-t SLR的重建结果，(f)表示L+S的重建结果，(g)表示D5C5的重建结果，(h)本实施例提出的方法的重建结果；(i)，(j)，(k)，(l)和(m)分别是(d)，(e)，(f)，(g)和(h)对应的的重建结果与全采样图像(a)间的残差图。其中，残差越小，表示重建效果越好。从实验结果可以看出，本发明实施例的方法对磁共振心脏电影成像具有最好的重建结果。这充分说明了本发明实施例的方法的有效性。Taking magnetic resonance cardiac imaging as an example, in order to demonstrate the effectiveness of the embodiments of the present invention on magnetic resonance cardiac imaging, the method of the embodiments of the present invention is compared with the current mainstream compressed sensing and deep learning methods. The results of different magnetic resonance cardiac film reconstruction methods are compared, as shown in Figure 2b. Figure 2b shows a comparison of the results of different magnetic resonance cardiac film reconstruction methods. The methods are: the time-frequency sparsity of the focal underdetermination system ktFOFOSS, the dynamic redundancy Kalki method kt SLR, the low-rank sparse matrix L+S, the magnetic resonance dynamic imaging D5C5 based on the cascaded convolution network, and this embodiment The method provided. (a) indicates a fully sampled image, (b) indicates a zero-filled image, (c) indicates the expansion of the sampling template and time dimension, (d) indicates the reconstruction result of kt FOCUSS, (e) indicates the reconstruction result of kt SLR, (f ) Represents the reconstruction result of L+S, (g) represents the reconstruction result of D5C5, (h) the reconstruction result of the method proposed in this embodiment; (i), (j), (k), (l) and (m) These are the residual plots between the reconstruction results corresponding to (d), (e), (f), (g) and (h) and the fully sampled image (a). Among them, the smaller the residual, the better the reconstruction effect. It can be seen from the experimental results that the method of the embodiment of the present invention has the best reconstruction result for magnetic resonance cardiac film imaging. This fully illustrates the effectiveness of the method of the embodiments of the present invention.

本实施例的技术方案通过所述将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数，包括：分别对k空间损失函数和图像域损失函数进行加权；将所述主损失函数、加权后的k空间损失函数以及加权后的图像域损失函数进行求和运算得到模型损失函数，实现对不同深度的重建结果进行约束，为整个网络的训练提供了多个监督，每个监督损失函数都为网络的训练提供指导。进而，获取待成像的K空间欠采样数据；将所述待成像的K空间欠采样数据输入训练完成的所述目标医学成像模型中，得到重建医学图像，实现更快速、更准确地对K空间欠采样数据进行重建。The technical solution of this embodiment obtains a model loss function by summing at least one of the additional loss function and the main loss function, including: separately weighting the k-space loss function and the image domain loss function The sum of the main loss function, the weighted k-space loss function and the weighted image domain loss function are summed to obtain the model loss function, which constrains the reconstruction results of different depths and provides more training for the entire network. Supervision, each supervision loss function provides guidance for network training. Furthermore, obtain the K-space under-sampling data to be imaged; input the K-space under-sampling data to be imaged into the target medical imaging model after training to obtain a reconstructed medical image, and realize faster and more accurate K-space sampling Undersampling data for reconstruction.

实施例三Example Three

图3是本发明实施例三中提供的一种医学成像模型的建立装置的结构示意图。本发明实施例所提供的医学成像模型的建立装置可执行本发明任意实施例所提供的医学成像模型的建立方法，该装置的具体结构如下：训练样本获取模块31、训练模块32和目标医学成像模型确定模块33。3 is a schematic structural diagram of a medical imaging model building device provided in Embodiment 3 of the present invention. The apparatus for establishing a medical imaging model provided by an embodiment of the present invention can execute the method for establishing a medical imaging model provided by any embodiment of the present invention. The specific structure of the apparatus is as follows: a training sample acquisition module 31, a training module 32, and target medical imaging Model determination module 33.

训练样本获取模块31，设置为获取医学图像的K空间欠采样数据作为训练样本。The training sample acquisition module 31 is set to acquire K-space under-sampled data of medical images as training samples.

训练模块32，设置为将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络。The training module 32 is configured to input the training samples to the pre-built original neural network for training, and optimize the original neural network according to a model loss function.

目标医学成像模型确定模块33，设置为当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型。The target medical imaging model determination module 33 is configured to stop training the machine learning model when the model loss function converges, and use the trained original neural network as the target medical imaging model.

本发明实施例的技术方案获取医学图像的K空间欠采样数据作为训练样本，能够直接学习从欠采样图像到全采样图像的映射关系。进而，将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络，使神经网络更加准确地表征输入的样本。进而，当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型，用于K空间欠采样数据的重建。进而，其中，所述原始神经网络包括频率域网络FDN以及图像域网络SDN，所述频率域网络FDN与所述图像域网络SDN之间通过傅里叶逆变换IFFT连接；所述模型损失函数包括主损失函数以及至少一个附加损失函数，所述附加损失函数包括k空间损失函数和/或图像域损失函数，充分结合频率域与图像域信息，直接学习从欠采图像到全采图像的映射关系，对不同网络深度的重建结果加以约束，能够更加充分地利用不同深度的网络信息。上述技术方案解决了传统的并行成像或者压缩感知技术，没有利用大数据先验，耗时且调参繁琐、基于深度学习的神经网络方法无法充分地利用频率域信息，无法更准确地对欠采样的图像进行重建的问题，实现能够同时学习频率域与图像域特征，充分结合频率域与图像域信息，对不同网络深度的重建结果加以约束，能够更加充分地利用不同深度的网络信息，快速、准确地对欠采样的医学图像进行重建，能够避免耗时的迭代求解步骤以及繁琐的调参过程。The technical solution of the embodiment of the present invention acquires K-space under-sampled data of medical images as training samples, and can directly learn the mapping relationship from under-sampled images to fully sampled images. Furthermore, the training samples are input to the pre-built original neural network for training, and the original neural network is optimized according to the model loss function, so that the neural network more accurately characterizes the input samples. Furthermore, when the model loss function converges, the training of the machine learning model is stopped, and the trained original neural network is used as the target medical imaging model for reconstruction of K-space undersampled data. Furthermore, wherein the original neural network includes a frequency domain network FDN and an image domain network SDN, and the frequency domain network FDN and the image domain network SDN are connected by an inverse Fourier transform IFFT; the model loss function includes Main loss function and at least one additional loss function, the additional loss function includes k-space loss function and/or image domain loss function, fully combines the frequency domain and image domain information, and directly learns the mapping relationship from the under-captured image to the full-captured image In order to constrain the reconstruction results of different network depths, the network information of different depths can be used more fully. The above technical solution solves the traditional parallel imaging or compressed sensing technology, which does not use big data priors, is time-consuming and cumbersome to adjust parameters, and the neural network method based on deep learning cannot fully utilize the frequency domain information and cannot accurately undersample. The problem of image reconstruction is realized, which can learn the characteristics of the frequency domain and the image domain at the same time, fully combine the information of the frequency domain and the image domain, and constrain the reconstruction results of different network depths, which can make full use of the network information of different depths. Reconstructing under-sampled medical images accurately can avoid time-consuming iterative solving steps and tedious parameter adjustment process.

在上述技术方案的基础上，训练模块32，具体可设置为：所述频率域网络包括第一预设数量的频率域模块Fnet，每个频率域模块Fnet包含第二预设数量的三维卷积层3D Conv以及一个频率域数据一致层KDC。Based on the above technical solution, the training module 32 may be specifically set as follows: the frequency domain network includes a first preset number of frequency domain modules Fnet, and each frequency domain module Fnet includes a second preset number of three-dimensional convolutions Layer 3D Conv and a frequency domain data consistency layer KDC.

在上述技术方案的基础上，训练模块32，具体可设置为：根据如下公式计算所述k空间损失函数：Based on the above technical solution, the training module 32 may be specifically configured to calculate the k-space loss function according to the following formula:

表示第m个频率域模块的输出，M表示频率域模块的数量，α _m表示第m个频率域模块对应的k空间损失函数的权重。 Among them, Kloss represents k-space loss, K _f represents full-sampled k-space data corresponding to under-sampled K-space data of medical images,

在上述技术方案的基础上，训练模块32，具体可设置为：所述图像域网络SDN包括第三预设数量的图像域模块Snet，其中，每个图像域模块包含第四预设数量的三维卷积层3D Conv、一个图像域数据一致层IDC以及一个残差连接。On the basis of the above technical solution, the training module 32 may specifically be set as follows: the image domain network SDN includes a third preset number of image domain modules Snet, wherein each image domain module contains a fourth preset number of three-dimensional Convolutional layer 3D Conv, an image domain data consistency layer IDC and a residual connection.

在上述技术方案的基础上，训练模块32，具体可设置为：根据如下公式计算所述图像域损失函数：Based on the above technical solution, the training module 32 may be specifically configured to calculate the image domain loss function according to the following formula:

其中，Sloss表示图像域损失，S表示医学图像的K空间欠采样数据对应的全采样的医学图像，S _n表示第n个图像域模块的输出，N表示图像域模块的数量，β _n表示第n个图像域模块对应的图像域损失函数的权重。 Where Sloss represents the image domain loss, S represents the fully sampled medical image corresponding to the K-space undersampled data of the medical image, S _n represents the output of the nth image domain module, N represents the number of image domain modules, and β _n represents the The weight of the image domain loss function corresponding to n image domain modules.

在上述技术方案的基础上，医学成像模型的建立装置还包括加权模块。加权模块，设置为将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数。On the basis of the above technical solution, the device for establishing a medical imaging model further includes a weighting module. The weighting module is configured to weight at least one of the additional loss functions and perform a sum operation with the main loss function to obtain a model loss function.

在上述技术方案的基础上，加权模块，具体可设置为：所述将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数，包括：Based on the above technical solution, the weighting module may be specifically configured to: add the weighted at least one of the additional loss functions and perform a sum operation with the main loss function to obtain a model loss function, including:

分别对k空间损失函数和图像域损失函数进行加权；Weight the k-space loss function and the image domain loss function separately;

将所述主损失函数、加权后的k空间损失函数以及加权后的图像域损失函数进行求和运算得到模型损失函数。Summing the main loss function, the weighted k-space loss function and the weighted image domain loss function to obtain a model loss function.

在上述技术方案的基础上，医学成像模型的建立装置还包括：重建模块。On the basis of the above technical solution, the device for establishing the medical imaging model further includes: a reconstruction module.

重建模块，设置为获取待成像的K空间欠采样数据；The reconstruction module is set to obtain K-space under-sampled data to be imaged;

将所述待成像的K空间欠采样数据输入训练完成的所述目标医学成像模型中，得到重建医学图像。The K-space under-sampled data to be imaged is input into the target medical imaging model after training to obtain a reconstructed medical image.

本发明实施例所提供的医学成像模型的建立装置可执行本申请任一实施例所提供的医学成像模型的建立方法，具备执行方法相应的功能模块和有益效果。The apparatus for establishing a medical imaging model provided by an embodiment of the present invention can execute the method for establishing a medical imaging model provided by any embodiment of the present application, and has functional modules and beneficial effects corresponding to the execution method.

实施例四Example 4

图4为本发明实施例四提供的一种设备的结构示意图，如图4所示，该设备包括处理器40、存储器41、输入装置42和输出装置43；设备中处理器40的数量可以是一个或多个，图4中以一个处理器40为例；设备中的处理器40、存储器41、输入装置42和输出装置43可以通过总线或其他方式连接，图4中以通过总线连接为例。4 is a schematic structural diagram of a device according to Embodiment 4 of the present invention. As shown in FIG. 4, the device includes a processor 40, a memory 41, an input device 42, and an output device 43; the number of processors 40 in the device may be One or more, one processor 40 is taken as an example in FIG. 4; the processor 40, the memory 41, the input device 42 and the output device 43 in the device may be connected through a bus or other means, and FIG. 4 is taken as an example through a bus connection .

存储器41作为一种计算机可读存储介质，可用于存储软件程序、计算机可执行程序以及模块，如本发明实施例中的医学成像模型的建立方法对应的程序指令/模块(例如，医学成像模型的建立装置中的训练样本获取模块31、训练模块32和目标医学成像模型确定模块33)。处理器40通过运行存储在存储器41中的软件程序、指令以及模块，从而执行设备的各种功能应用以及数据处理，即实现上述的医学成像模型的建立方法。The memory 41 is a computer-readable storage medium that can be used to store software programs, computer executable programs, and modules, such as program instructions/modules corresponding to the method of establishing a medical imaging model in the embodiment of the present invention (for example, the The training sample acquisition module 31, the training module 32 and the target medical imaging model determination module 33 in the establishment device). The processor 40 executes various functional applications and data processing of the device by running software programs, instructions, and modules stored in the memory 41, that is, implementing the above-described method of establishing a medical imaging model.

存储器41可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作***、至少一个功能所需的应用程序；存储数据区可存储根据终端的使用所创建的数据等。此外，存储器41可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中，存储器41可进一步包括相对于处理器40远程设置的存储器，这些远程存储器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 41 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system and application programs required by at least one function; the storage data area may store data created according to the use of the terminal, and the like. In addition, the memory 41 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some examples, the memory 41 may further include memories remotely provided with respect to the processor 40, and these remote memories may be connected to the device through a network. Examples of the aforementioned network include, but are not limited to, the Internet, intranet, local area network, mobile communication network, and combinations thereof.

输入装置42可用于接收输入的医学图像的K空间欠采样数据，以及产生与设备的用户设置以及功能控制有关的信号输入。输出装置43可包括显示屏等显示设备。The input device 42 can be used to receive the K-space under-sampled data of the input medical image and generate signal input related to the user settings and function control of the device. The output device 43 may include a display device such as a display screen.

实施例五Example 5

本发明实施例五还提供一种包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行一种医学成像模型的建立方法，该方法包括：Embodiment 5 of the present invention also provides a storage medium containing computer-executable instructions, which when executed by a computer processor is used to perform a method for establishing a medical imaging model, the method includes:

当然，本发明实施例所提供的一种包含计算机可执行指令的存储介质,其计算机可执行指令不限于如上所述的方法操作，还可以执行本申请任一实施例所提供的医学成像模型的建立方法中的相关操作。Of course, a storage medium containing computer-executable instructions provided by an embodiment of the present invention is not limited to the method operations described above, but can also execute the medical imaging model provided by any embodiment of the present application. Related operations in the establishment method.

通过以上关于实施方式的描述，所属领域的技术人员可以清楚地了解到，本申请可借助软件及必需的通用硬件来实现，当然也可以通过硬件实现，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。Through the above description of the embodiments, those skilled in the art can clearly understand that the present application can be implemented by software and necessary general hardware, and of course can also be implemented by hardware, but in many cases the former is a better embodiment . Based on this understanding, the technical solutions of the present application can essentially be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as computer floppy disks, Read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), flash memory (FLASH), hard disk or optical disc, etc., including several instructions to make a computer device (which can be a personal computer, Server, or network equipment, etc.) to execute the method described in each embodiment of the present application.

值得注意的是，上述医学成像模型的建立装置的实施例中，所包括的各个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限制本申请的保护范围。It is worth noting that in the embodiment of the above medical imaging model building device, the various units and modules included are only divided according to functional logic, but it is not limited to the above division, as long as the corresponding functions can be achieved; In addition, the specific names of the functional units are only for the purpose of distinguishing each other, and are not used to limit the protection scope of the present application.

注意，上述仅为本申请的可选实施例及所运用技术原理。本领域技术人员会理解，本申请不限于这里所述的可选实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本申请的保护范围。因此，虽然通过以上实施例对本申请进行了较为详细的说明，但是本申请不仅仅限于以上实施例，在不脱离本申请构思的情况下，还可以包括更多其他等效实施例，而本申请的范围由所附的权利要求范围决定。Note that the above are only optional embodiments of the present application and applied technical principles. Those skilled in the art will understand that the present application is not limited to the optional embodiments described herein, and that those skilled in the art can make various obvious changes, readjustments, and substitutions without departing from the scope of protection of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the concept of the present application. The scope is determined by the scope of the appended claims.

Claims

一种医学成像模型的建立方法，包括：A method for establishing a medical imaging model includes:

获取医学图像的K空间欠采样数据作为训练样本；Obtain K-space under-sampled data of medical images as training samples;

将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络；Input the training samples to the pre-built original neural network for training, and optimize the original neural network according to the model loss function;

当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型；When the model loss function converges, stop training the machine learning model and use the trained original neural network as the target medical imaging model;

其中，所述原始神经网络包括频率域网络FDN以及图像域网络SDN，所述频率域网络FDN与所述图像域网络SDN之间通过傅里叶逆变换IFFT连接；所述模型损失函数包括主损失函数以及至少一个附加损失函数，所述附加损失函数包括k空间损失函数和/或图像域损失函数。Wherein, the original neural network includes a frequency domain network FDN and an image domain network SDN, and the frequency domain network FDN and the image domain network SDN are connected by an inverse Fourier transform IFFT; the model loss function includes a main loss Function and at least one additional loss function, the additional loss function including a k-space loss function and/or an image domain loss function.
根据权利要求1所述的方法，其中，所述频率域网络包括第一预设数量的频率域模块Fnet，其中，每个频率域模块Fnet包含第二预设数量的三维卷积层3D Conv以及一个频率域数据一致层KDC。The method according to claim 1, wherein the frequency domain network includes a first preset number of frequency domain modules Fnet, wherein each frequency domain module Fnet includes a second preset number of three-dimensional convolution layers 3D Conv and A frequency domain data consistency layer KDC.
根据权利要求2所述的方法，其中，根据如下公式计算所述k空间损失函数：The method according to claim 2, wherein the k-space loss function is calculated according to the following formula:

其中，Kloss表示k空间损失，K _f表示医学图像的K空间欠采样数据对应的全采样k空间数据，
表示第m个频率域模块的输出，M表示频率域模块的数量，α _m表示第m个频率域模块对应的k空间损失函数的权重。 Among them, Kloss represents k-space loss, K _f represents full-sampled k-space data corresponding to under-sampled K-space data of medical images,
Represents the output of the m-th frequency domain module, M represents the number of frequency-domain modules, and α _m represents the weight of the k-space loss function corresponding to the m-th frequency domain module.
根据权利要求1所述的方法，其中，所述图像域网络SDN包括第三预设数量的图像域模块Snet，其中，每个图像域模块包含第四预设数量的三维卷积层3D Conv、一个图像域数据一致层IDC以及一个残差连接。The method according to claim 1, wherein the image domain network SDN includes a third preset number of image domain modules Snet, wherein each image domain module includes a fourth preset number of three-dimensional convolution layers 3D Conv, An image domain data consistency layer IDC and a residual connection.
根据权利要求4所述的方法，其中，根据如下公式计算所述图像域损失函数：The method according to claim 4, wherein the image domain loss function is calculated according to the following formula:

其中，Sloss表示图像域损失，S表示医学图像的K空间欠采样数据对应的全采样的医学图像，S _n表示第n个图像域模块的输出，N表示图像域模块的数量，β _n表示第n个图像域模块对应的图像域损失函数的权重。 Where Sloss represents the image domain loss, S represents the fully sampled medical image corresponding to the K-space undersampled data of the medical image, S _n represents the output of the nth image domain module, N represents the number of image domain modules, and β _n represents the The weight of the image domain loss function corresponding to n image domain modules.
根据权利要求1所述的方法，还包括：The method of claim 1, further comprising:

将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数。Weighting at least one of the additional loss functions and performing a sum operation with the main loss function to obtain a model loss function.
根据权利要求6所述的方法，其中，所述将至少一项所述附加损失函数加权后与所述主损失函数进行求和运算得到模型损失函数，包括：The method according to claim 6, wherein the weighting at least one of the additional loss functions and performing a sum operation with the main loss function to obtain a model loss function includes:

分别对k空间损失函数和图像域损失函数进行加权；Weight the k-space loss function and the image domain loss function separately;

将所述主损失函数、加权后的k空间损失函数以及加权后的图像域损失函数进行求和运算得到模型损失函数。Summing the main loss function, the weighted k-space loss function and the weighted image domain loss function to obtain a model loss function.
根据权利要求1所述的方法，还包括：The method of claim 1, further comprising:

获取待成像的K空间欠采样数据；Obtain the K-space undersampled data to be imaged;

将所述待成像的K空间欠采样数据输入训练完成的所述目标医学成像模型中，得到重建医学图像。The K-space under-sampled data to be imaged is input into the target medical imaging model after training to obtain a reconstructed medical image.
一种医学成像模型的建立装置，包括：A device for establishing a medical imaging model includes:

训练样本获取模块，设置为获取医学图像的K空间欠采样数据作为训练样本；The training sample acquisition module is set to acquire K-space undersampled data of medical images as training samples;

训练模块，设置为将所述训练样本输入至预先构建的所述原始神经网络进行训练，并根据模型损失函数优化所述原始神经网络；A training module configured to input the training samples to the pre-built original neural network for training, and optimize the original neural network according to a model loss function;

目标医学成像模型确定模块，设置为当所述模型损失函数收敛时，停止训练所述机器学习模型，将训练完成的所述原始神经网络作为目标医学成像模型；The target medical imaging model determination module is configured to stop training the machine learning model when the model loss function converges, and use the trained original neural network as the target medical imaging model;

其中，所述原始神经网络包括频率域网络FDN以及图像域网络SDN，所述频率域网络FDN与所述图像域网络SDN之间通过傅里叶逆变换IFFT连接；所述模型损失函数包括主损失函数以及至少一个附加损失函数，所述附加损失函数包括k空间损失函数和/或图像域损失函数。Wherein, the original neural network includes a frequency domain network FDN and an image domain network SDN, and the frequency domain network FDN and the image domain network SDN are connected by an inverse Fourier transform IFFT; the model loss function includes a main loss Function and at least one additional loss function, the additional loss function including a k-space loss function and/or an image domain loss function.
一种设备，包括：A device, including:

一个或多个处理器；One or more processors;

存储器，用于存储一个或多个程序，Memory for storing one or more programs,

当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-8中任一项所述的医学成像模型的建立方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the medical imaging model establishment method according to any one of claims 1-8.
一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如权利要求1-8中任一项所述的医学成像模型的建立方法。A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the method for establishing a medical imaging model according to any one of claims 1-8 is realized.