CN106709986B

CN106709986B - Focus and/or organ modeling method and device for motif production

Info

Publication number: CN106709986B
Application number: CN201710144866.3A
Authority: CN
Inventors: 王薇; 薛华丹
Original assignee: Shanghai Shuli Intelligent Technology Co ltd
Current assignee: Shanghai Shuli Intelligent Technology Co ltd
Priority date: 2017-03-13
Filing date: 2017-03-13
Publication date: 2020-06-16
Anticipated expiration: 2037-03-13
Also published as: CN106709986A

Abstract

The present disclosure relates to a lesion and/or organ modeling method and apparatus for phantom fabrication. The focus and/or organ modeling method for motif making comprises the following steps: carrying out three-dimensional simulation modeling on the focus and/or organ to generate a first modeling file of the focus and/or organ; performing three-dimensional modeling of the lesion and/or organ based on medical images, and generating a second modeling file of the lesion and/or organ; and carrying out image registration and fusion on the first modeling file and the second modeling file to generate a third modeling file of the focus and/or organ. The modeling of the lesions and/or organs for phantom fabrication is achieved through registration and fusion of three-dimensional simulation modeling and three-dimensional modeling based on medical images.

Description

Focus and/or organ modeling method and device for motif production

Technical Field

The present disclosure relates to the field of medical imaging technologies, and in particular, to a method and an apparatus for modeling a lesion and/or an organ for motif production, and an electronic device.

Background

At present, the supply of medical models in the market from the technical to the clinical popularization is far from meeting the requirements of clinical diagnosis and treatment, such as large medical equipment CT and MR which are widely applied clinically. Most of CT mold bodies in the current market are designed by rays of testing equipment, most of CT mold bodies are spherical and cylindrical water molds or single PMMA mold bodies, and the shape and the imitative property of the CT mold bodies are very different from the clinical application; advanced CT motifs are rarely seen in clinical medical centers, are mostly used in advanced research centers or research and development departments of large-scale equipment companies, are mainly designed in mechanical shapes, are embedded with material samples with different attenuation densities, are mainly used for system debugging and testing, and are difficult to really realize clinical service.

At present, no clinical medical model body which can accurately reflect the detailed anatomy mechanism and focus/pathological information of a human body and has the performance of imaging medical equipment exists, and the stability (for example, under the long-term exposure of X-ray) and the cost payability of the medical model body are not concerned.

Therefore, there is still a need for improvement in the prior art solutions.

It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

An object of the present disclosure is to provide a lesion and/or organ modeling method, apparatus, and electronic device for phantom fabrication, which overcome, at least in part, one or more of the problems due to the limitations and disadvantages of the related art.

Additional features and advantages of the disclosure will be set forth in the detailed description which follows, or in part will be learned by practice of the disclosure.

According to an aspect of the present disclosure, there is provided a lesion and/or organ modeling method for phantom fabrication, comprising:

carrying out three-dimensional simulation modeling on the focus and/or organ to generate a first modeling file of the focus and/or organ;

performing three-dimensional modeling of the lesion and/or organ based on medical images, and generating a second modeling file of the lesion and/or organ;

and carrying out image registration and fusion on the first modeling file and the second modeling file to generate a third modeling file of the focus and/or the organ.

In an exemplary embodiment of the present disclosure, the method further comprises:

establishing clinical requirements, and analyzing system attributes of equipment suitable for the model body;

determining the structure and function of the phantom based on the clinical requirements and system attributes of the device.

In an exemplary embodiment of the present disclosure, the structure of the phantom is determined according to the anatomical characteristics of the lesion and/or organ and the highest spatial resolution required by the device.

In an exemplary embodiment of the present disclosure, the function of the phantom is determined based on system attributes of the device and the physiological function performed by the lesion and/or organ.

In an exemplary embodiment of the present disclosure, the method further comprises: and determining the composition material of the die body according to the structure and the function of the die body.

In an exemplary embodiment of the present disclosure, performing three-dimensional simulation modeling of the lesion and/or organ, generating the first modeling file of the lesion and/or organ comprises:

setting the modeling structure parameters of the focus and/or organ according to the clinical requirement and the system attribute of the equipment;

setting material parameters of the composition materials of the die body according to the clinical requirements and the system attributes of the equipment;

and generating a first modeling file of the focus and/or organ according to the modeling structure parameters of the focus and/or organ and the material parameters of the composition materials of the motif.

In an exemplary embodiment of the present disclosure, performing a three-dimensional medical image-based modeling of the lesion and/or organ, generating a second modeling file of the lesion and/or organ includes:

acquiring a first image file containing anatomical and functional information of the focus and/or organ through a first imaging device according to the type, function and/or clinical requirements of the phantom;

and carrying out image processing and three-dimensional modeling on the first image file to generate a second modeling file of the focus and/or the organ.

In an exemplary embodiment of the present disclosure, image processing and three-dimensional modeling the first picture file includes:

dividing regions of interest according to the first image file and the image characteristics of the first image file;

and carrying out image segmentation and modeling on the region of interest, so that each organ, function or focus independently forms a reconstruction file.

acquiring a plurality of first image files of different phases of the focus and/or organ through the first imaging device;

and carrying out image registration of an anatomical structure and phase time on the reconstructed files generated by the plurality of first image files to form registered modeling files of different phases of the plurality of first image files.

acquiring a second image file containing anatomical and functional information of the lesion and/or organ by a second imaging device;

and carrying out image registration on the second image file and the first image file according to anatomical feature points to form a modeling file after the first image file and the second image file are registered.

carrying out image registration of an anatomical structure and phase time on reconstructed files generated by the plurality of first image files to form registered modeling files of different phase periods of the plurality of first image files;

and carrying out image registration on the second image file and the registered modeling files of the plurality of first image files in different phases according to anatomical feature points to form the registered modeling files of the plurality of first image files and the plurality of second image files.

According to an aspect of the present disclosure, there is provided a lesion and/or organ modeling apparatus for phantom fabrication, comprising:

the first modeling module is used for carrying out three-dimensional simulation modeling on the focus and/or organ and generating a first modeling file of the focus and/or organ;

the second modeling module is used for performing three-dimensional modeling of the focus and/or organ based on medical images and generating a second modeling file of the focus and/or organ;

and the third modeling module is used for carrying out image registration and fusion on the first modeling file and the second modeling file to generate a third modeling file of the focus and/or the organ.

According to an aspect of the present disclosure, there is provided an electronic device including:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform any of the above described lesion and/or organ modeling methods for phantom fabrication.

In the focus and/or organ modeling method, device and electronic device for motif production provided by the embodiments of the present disclosure, a final modeling file of a focus and/or organ is generated by performing image registration and fusion on three-dimensional simulation modeling and three-dimensional modeling based on medical images. The final modeling file can be applied to manufacturing of the die body, and the die body printed by the final modeling file can accurately reflect the detailed anatomical structure, focus and/or pathological information of the human body and embody the performance of the image medical equipment.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.

Fig. 1 is a schematic flow chart of a lesion and/or organ modeling method for phantom fabrication in an exemplary embodiment of the present disclosure.

Fig. 2 is a schematic flow chart of another lesion and/or organ modeling method for phantom fabrication in an exemplary embodiment of the present disclosure.

Fig. 3 is a schematic flow chart of three-dimensional modeling based on medical images in an exemplary embodiment of the disclosure.

Fig. 4 is a schematic diagram of another medical image-based three-dimensional modeling in an exemplary embodiment of the present disclosure.

FIG. 5 is a schematic flow chart of three-dimensional simulation modeling in an exemplary embodiment of the present disclosure.

Fig. 6 is a schematic diagram of theoretical modeling of a pancreatic phantom, aorta, splenic arteries, inferior arteries, and branch arteries in an exemplary embodiment of the disclosure.

FIG. 7 is a schematic diagram of a theoretical modeling of a pancreas phantom, a pancreas, in an exemplary embodiment of the disclosure.

Fig. 8 is a schematic diagram of a series of CT pancreatic images of arterial phase in an exemplary embodiment of the disclosure.

Fig. 9 is a schematic diagram of a series of vein-phased CT pancreatic images in an exemplary embodiment of the disclosure.

Fig. 10 is a schematic diagram of an MR pancreatic imaging in an exemplary embodiment of the present disclosure.

Fig. 11 is a schematic diagram of modeling of a pancreatic phantom, aorta, splenic artery, inferior aorta, and branch arteries based on the arterial phase of the CT pancreatic image shown in fig. 8 according to an exemplary embodiment of the disclosure.

Fig. 12 is a graphical image modeling of a pancreas phantom based on the arterial phase of the CT pancreas image shown in fig. 8, based on the venous phase of the CT pancreas image shown in fig. 9, and based on the MR pancreas image shown in fig. 10, in an exemplary embodiment of the disclosure.

Fig. 13 is a schematic diagram of an image registration and fusion to generate a final modeling file of each lesion and organ in an exemplary embodiment of the present disclosure.

FIG. 14 is a schematic view of a 3D printed pancreas phantom in an exemplary embodiment of the disclosure.

Fig. 15 is a schematic view of a 3D printed pancreas phantom and pancreas monomers in an exemplary embodiment of the disclosure.

Fig. 16 is a block diagram representation of a lesion and/or organ modeling apparatus for phantom fabrication in an exemplary embodiment of the present disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

At present, the phantom is one of the main tools for measuring the radiation absorbed dose and controlling the quality of large medical equipment, and comprises a human body simulation phantom. The embodiment of the invention combines the 3D printing technology and image medicine, and provides a Medical application motif (Medical Phantom) for Medical image equipment applied to clinical diagnosis and treatment. The medical phantom is a special medical Imaging device, and is specially used for detecting, correcting, adjusting and optimizing system parameters and application algorithms of large medical Imaging devices (such as CT, MR, PET (positron Emission Tomography), SPECT (Single-Photon Emission Computed Tomography), MRI (Magnetic Resonance Imaging), and the like).

Fig. 1 is a schematic flow chart of a lesion and/or organ modeling method for phantom fabrication in an exemplary embodiment of the present disclosure. The phantom may be the medical phantom described above, but the disclosure is not limited thereto.

As shown in fig. 1, the method for modeling a lesion and/or organ for phantom fabrication may include the following steps.

In step S100, a three-dimensional simulation modeling of the lesion and/or organ is performed, and a first modeling file of the lesion and/or organ is generated.

In an exemplary embodiment, the method may further include: establishing clinical requirements, and analyzing system attributes of equipment suitable for the model body; determining the structure and function of the phantom based on the clinical requirements and system attributes of the device.

In an exemplary embodiment, the system properties of the imaging device to which the motif is applied may include system characteristics and application parameters of the imaging device to which the motif is applied. For example, when fabricating a CT phantom, the x-ray attenuation properties of a CT device using the CT phantom. The present disclosure is not limited thereto and may determine the structure and function of the manufactured phantom based on the specific system properties of the specific imaging device for which the phantom is intended.

In an exemplary embodiment, the structure of the phantom is determined based on anatomical characteristics of the lesion and/or organ and the highest spatial resolution required by the device.

In an exemplary embodiment, the function of the phantom is determined based on system attributes of the device and the physiological function performed by the lesion and/or organ.

In an exemplary embodiment, the method may further include: and determining the composition material of the die body according to the structure and the function of the die body.

For example, when the model body is determined to be a model body of a specific spine structure and function, hydroxyapatite and a synthetic material thereof which are close to the density of the spine material can be selected to be made into the model body with the known density. The present disclosure is not limited thereto.

In an exemplary embodiment, the step S100 performs three-dimensional simulation modeling of the lesion and/or organ, and generating the first modeling file of the lesion and/or organ may include: setting the modeling structure parameters of the focus and/or organ according to the clinical requirement and the system attribute of the equipment; setting material parameters of the composition materials of the die body according to the clinical requirements and the system attributes of the equipment; and generating a first modeling file of the focus and/or organ according to the modeling structure parameters of the focus and/or organ and the material parameters of the composition materials of the motif.

In step S110, a three-dimensional medical image-based modeling of the lesion and/or organ is performed, and a second modeling file of the lesion and/or organ is generated.

In an exemplary embodiment, the step S110 performs three-dimensional medical image-based modeling of the lesion and/or organ, and generating the second modeling file of the lesion and/or organ may include: acquiring a first image file containing anatomical and functional information of the focus and/or organ through a first imaging device according to the type, function and/or clinical requirements of the phantom; and carrying out image processing and three-dimensional modeling on the first image file to generate a second modeling file of the focus and/or the organ.

In an exemplary embodiment, the image processing and three-dimensional modeling of the first shadow file may include: dividing regions of interest according to the first image file and the image characteristics of the first image file; and carrying out image segmentation and modeling on the region of interest, so that each organ, function or focus independently forms a reconstruction file.

In an exemplary embodiment, the image processing and three-dimensional modeling of the first shadow file may include: acquiring a plurality of first image files of different phases of the focus and/or organ through the first imaging device; and carrying out image registration of an anatomical structure and phase time on the reconstructed files generated by the plurality of first image files to form registered modeling files of different phases of the plurality of first image files.

In an exemplary embodiment, the image processing and three-dimensional modeling of the first shadow file may include: acquiring a second image file containing anatomical and functional information of the lesion and/or organ by a second imaging device; and carrying out image registration on the second image file and the first image file according to anatomical feature points to form a modeling file after the first image file and the second image file are registered.

In an exemplary embodiment, the image processing and three-dimensional modeling of the first shadow file may include: acquiring a plurality of first image files of different phases of the focus and/or organ through the first imaging device; carrying out image registration of an anatomical structure and phase time on reconstructed files generated by the plurality of first image files to form registered modeling files of different phase periods of the plurality of first image files; acquiring a second image file containing anatomical and functional information of the lesion and/or organ by a second imaging device; and carrying out image registration on the second image file and the registered modeling files of the plurality of first image files in different phases according to anatomical feature points to form the registered modeling files of the plurality of first image files and the plurality of second image files.

In step S120, the first modeling file and the second modeling file are subjected to image registration and fusion, and a third modeling file of the lesion and/or organ is generated.

In an exemplary embodiment, the method may further include: and processing the third modeling file to form a preset format file which can be recognized by the 3D printer. For example, the preset format file is a triangle mesh file (. stl) required by a 3D printer, but the present disclosure is not limited thereto.

In an exemplary embodiment, the method may further include: and adjusting the preset format file according to the system parameters of the 3D printer and/or the material characteristics of the composition materials.

In an exemplary embodiment, the method may further include: and manufacturing the die body by a 3D printing method according to the third modeling file and the composition materials of the die body.

The focus and/or organ modeling method for manufacturing the motif, provided by the embodiment of the invention, can generate the clinical medicine motif which can accurately reflect the detailed anatomical mechanism and focus/pathological information of a human body and embody the performance of image equipment, has strong directivity and high accuracy on specific focuses and/or organs, and has stability.

As shown in fig. 2, the method for modeling a lesion and/or organ for phantom fabrication may include the following steps.

In step S201, a clinical need is established.

In step S202, system properties of the device to which the motif is applied are analyzed.

In step S203, the structure and function of the phantom are determined according to the clinical requirements and system attributes of the device.

In step S204, the constituent materials of the mold body are determined according to the structure and function of the mold body.

Most of CT (computed tomography) mold bodies in the existing market are designed for testing CT (computed tomography) equipment rays, most of the CT mold bodies are spherical and cylindrical water molds or single PMMA (Polymethyl Methacrylate) mold bodies, the CT mold bodies are manufactured by machine shearing or manual grinding, the CT mold bodies are single in shape, and the shape and the imitation of the CT mold bodies are quite different from those of clinical application. The advanced CT die body is also mainly in a standard mechanical shape, and material samples with different attenuation densities are embedded in the CT die body, so that the CT die body is mainly used for system debugging and testing and is difficult to really realize clinical service.

In the embodiment of the invention, the simulated tissue material with specific characteristics is generated based on the imaging characteristics and the principle of the imaging device which is suitable for the phantom.

For example, the imaging principle of the CT apparatus is based on the attenuation coefficient of x-rays to human tissue and organs, i.e. the attenuation values of x-rays passing through different human tissue and organs are different. To make CT-related phantom, the x-ray attenuation values of the material need to be measured and calibrated to be as close as possible to the simulated human tissue and organs. For example, the nano composite material can be prepared by PMMA (polymethyl methacrylate) and nano molecular materials with high attenuation values according to a certain proportion, and the CT values of the nano composite materials with different proportions in the x-ray are in a nearly linear relationship. For example, the phantom may also be infused with an iodine contrast agent mixed with saline to simulate the imaging of arteriovenous vessels in CT. As another example, polyurethane foam may be used to simulate lung structure. Also for example, epoxy may be used to simulate solid water, and the like. The present disclosure is not limited to the above-described simulated tissue material.

In step S205, a three-dimensional medical image-based modeling of the lesion and/or organ is performed.

Fig. 3 is a schematic flow chart of three-dimensional modeling based on medical images in an exemplary embodiment of the disclosure. As shown in fig. 3, the above step S205 may include the following steps.

In step S2051, image and data acquisition is performed.

First, based on the type and function of the phantom and its needs confirmed by the clinician and imaging specialist, for example: phantoms are used to optimize clinical scanning protocols for solid organs, which require accurate response to the anatomy, pathology/lesion characterization, and imaging device characteristics (e.g., x-ray absorption and attenuation in CT devices). According to the functional requirements of the phantom, the anatomical and functional information of the corresponding organ/lesion is collected, for example, CT and MR collect image files containing organ and lesion information which can accurately reflect the anatomical structure of the human body, and the files include DICOM files and naked data files. In order to obtain a three-dimensional reconstruction image with high enough spatial resolution, an image file of a high-end CT can be used as a base, the thickness of a data acquisition layer is generally less than 0.6mm, a specific algorithm is adopted to ensure that the thickness of the data acquisition layer is between 0.3mm and 0.6mm, the time resolution needs a cardiac cycle higher than 1/2, and the isotropy of the x-y-z axis is kept.

In step S2052, data preprocessing and 2-dimensional image reconstruction are performed.

In step S2053, the image is preprocessed.

In step S2054, 3-dimensional image reconstruction and image post-processing are performed.

In step S2055, image modeling based on the medical image is performed.

In an exemplary embodiment, the processing of the image may include image pre-processing, post-processing, and 2D conversion 3D image modeling. Based on DICOM images or naked data, according to image characteristics such as HU value and low contrast of CT, the images are subjected to region of interest division, image segmentation and 3D modeling, and each organ, functional block and focus independently form a reconstruction file. And registering the image registration, such as referring to the image of the same organ/focus under MR, with the obtained CT image with high spatial resolution according to the anatomical feature points to obtain clearer functional information.

DICOM, digital imaging and communications in medicine, is an international standard for medical images and related information (ISO 12052). It defines a medical image format that can be used for data exchange with a quality that meets clinical needs. DICOM is widely used in radiomedicine, cardiovascular imaging and radiodiagnosis (X-ray, CT, nuclear magnetic resonance, ultrasound, etc.) and is increasingly used in ophthalmology, dentistry, and other medical fields. Among the tens of thousands of in-use medical imaging devices, DICOM is one of the most widely deployed standards for medical information.

The term "raw data" is a term used in medical imaging, and may refer to data acquired directly from a detector, such as a 2-dimensional reconstructed image (DICOM) directly from a CT system, which has not been acquired directly from a detector, and which has undergone attenuation by the human body.

In step S2056, a modeling file in which a single lesion/organ based on a medical image embodies an anatomical structure is generated.

Fig. 4 is a schematic diagram of another medical image-based three-dimensional modeling in an exemplary embodiment of the present disclosure. The embodiment of the invention generates the second modeling file based on the DICOM file and/or the bare data.

According to the embodiment of the invention, according to the type, the function and the requirements of the phantom confirmed by clinicians and image expert engineers, clinical medical image data are collected and subjected to a series of image processing technologies such as image preprocessing, post-processing, reconstruction, format conversion and optimization, and a group of separable or combined triangular mesh files which can be identified by a 3D printer are formed. This is explained below with reference to fig. 2.

First, image and data acquisition is performed.

In one embodiment, the image that can be obtained here can be a dicom (digital Imaging and communications in medicine) image.

In another embodiment, raw data may be acquired and then subjected to data preprocessing and image reconstruction. For example: noise reduction, artifact removal, region of interest (roi) info, iterative reconstruction enhancement, and so on.

The region of interest may be selected, for example, to make the measured relative bone density value accurate and meaningful, and a uniform measurement region and measurement range are required, and the operator uses a cursor to make position information of the measurement region on the image according to an image processing method and records the information, thereby achieving the purpose of uniform measurement range.

Next, image processing is performed on the acquired image and data.

In the embodiment shown in fig. 4, the image processing may include image pre-processing. For example: image registration, region of interest enhancement, bone extraction, muscle extraction, image artifact removal, and the like.

With continuing reference to fig. 4, the image processing may further include: and (5) image post-processing. For example: image splitting, filtering, diffusing, quantizing, transforming, etc.

With continuing reference to fig. 4, the image processing may further include: and (5) modeling the image. For example: cutting, filtering, marking and the like.

The image modeling can adopt three-dimensional image reconstruction and display: performing three-dimensional reconstruction on the obtained sequence image on a computer by using a classical three-dimensional reconstruction algorithm; and the visualization technology is utilized to display each tomographic image data in the motif data, and the functions of cutting and zooming image processing are included, so that more interactive processing on the image is realized.

Through the iterative process of the image processing, and the image expert engineer and the clinician ensure that the image/motif can accurately present organ and focus information, and a 3D printing file is generated.

In step S206, three-dimensional simulation modeling of the lesion and/or organ is performed.

FIG. 5 is a schematic flow chart of three-dimensional simulation modeling in an exemplary embodiment of the present disclosure. As shown in fig. 5, the above step S206 may include the following steps.

In step S2061, the lesion/lesions 3D modeled structure parameter set.

In step S2062, the 3D modeling structure parameter of the functional organ is set.

In the embodiment of the invention, a motif prototype file is theoretically designed according to clinical requirements and image equipment attributes, and 3D modeling structure parameters of focuses and organs are required to be embodied by a motif. The modeling mainly provides a reference structure standard and data for final modeling.

In step S2063, 3D modeling material parameter settings for the lesion/lesions.

In step S2064, the 3D modeling material parameter of the functional organ is set.

In the embodiment of the invention, the material parameters of the phantom are designed according to clinical requirements and the attributes of imaging equipment, for example, the CT phantom mainly designs the x-ray attenuation coefficient of the material and the ray aging resistance of the material and similar linear change curves under different energy spectrum irradiation.

In step S2065, a three-dimensional simulation modeling file of the lesion and/or organ based on system properties of the device (which may include device system characteristics and application parameters, for example) is generated.

Prototype modeling of the phantom is generated based on steps S2061-S2064, the modeling parameters including dimensional structure parameters and material coefficient parameters.

In step S207, image registration and fusion are performed according to the medical image-based three-dimensional modeling of step S205 and the three-dimensional simulation modeling of step S206 described above.

And performing image registration and fusion on the motif modeling file formed by theory and the motif modeling file formed by medical image to generate the final modeling file of each focus and organ.

In the embodiment of the invention, a simulation model can be established through three-dimensional simulation modeling based on clinical requirements and system attributes of imaging equipment using the phantom, the simulation model and the modeling formed by medical images are subjected to image registration and fusion, and then the simulation model and the modeling formed by the medical images are imported into a 3D printer for printing.

In step S208, structural parameter adjustment, optimization or normalization is performed.

In step S209, material parameter adjustment, optimization, or normalization is performed.

After the three-dimensional reconstruction file formed by the DICOM and the theoretical modeling file are fused and registered, the three-dimensional reconstruction file needs to be converted into a triangular mesh file (. stl) to be recognized by a 3D printer. The STL file is a standard file type used by rapid prototyping systems and is comprised of closed surfaces or volumes. The modeling files of each focus and organ are converted into triangular mesh files one by one, the influence of precision variation and format conversion formed in the conversion on the modeling needs to be eliminated, and the printing precision can be ensured by adjusting the number and the size of the mesh files and by an interpolation method. In addition, the files which are not closed or opened are needed to be patched and filled, because the files which are not closed or opened are not accepted by the printer, the files must be patched by post-processing, for example, a method of multiple interpolation or a method of boundary growing can be adopted. Meanwhile, the influence of the post-processing step on the original modeling is avoided, namely, in the image post-processing, the deviation value between the final processing modeling and the modeling generated by the system attribute of the image equipment is within a preset range.

In step S210, a 3D printable modeling file of a single lesion/organ is generated.

In step S211, integration and configuration of a single modeling file are performed.

In an exemplary embodiment, different 3D printers have different requirements for the triangular mesh file due to different printing modes, for example, the minimum size, the minimum wall thickness, the minimum inclination, and the like, and the finally formed triangular mesh file needs to be further adjusted according to the system parameters of the 3D printer used and the material characteristics of the material forming the mold body. Since the minimum printable size, the minimum wall thickness, the inclination, etc. of different materials are different based on the density, hardness, and agglomeration time of the materials, these basic parameters are set according to the actually used materials.

For example, with a photosensitive resin material, the minimum dimension can reach 0.016mm, but with a rubber-like material, the minimum dimension can only be 1mm, with a wall thickness greater than 1 mm.

In step S212, a normalization of phantom modeling clinical parameters is performed.

And (3) carrying out clinical parameter standardization on the model structure parameters and the material parameters, generating a fitting curve, and providing clinical use as a comparison table. For example, a structural size comparison table for each scanning interface and an HU value comparison table for imaging under different energy spectrums. Of course, the appearance and color of the phantom may be uniformly defined, for example, blue veins, red arteries, glands are represented by translucent colors, but the disclosure is not limited thereto.

In an exemplary embodiment, the normalizing of the clinical parameters of the phantom comprises: the appearance characterization of the phantom is normalized.

In an exemplary embodiment, normalizing the appearance representation of the phantom includes: different color prescriptions are made for the respective organs and/or lesions.

Wherein the appearance of the phantom is standardized and the corresponding organ/lesion may be color-defined according to medical practice, e.g., aorta for red, veins for blue, glands for green, peripheral tissue for transparent or translucent, etc. The present disclosure is not limited thereto.

In an exemplary embodiment, the method further comprises: normalizing the functional properties of the phantom.

In an exemplary embodiment, normalizing the functional characteristics of the motif includes: according to the imaging characteristics of the imaging equipment, different organs and/or focuses are characterized by adopting different printing materials or adding bionic materials.

The functional characteristics of the phantom are standardized, and different organs/lesions adopt different printing materials or are marked with presentation characteristics of the phantom under the imaging of specific imaging equipment by adding bionic materials according to the system attributes of the imaging equipment.

For example, in CT imaging (HU values vary greatly depending on the energy spectrum of the x-generator, the material and thickness of the filter passed through, and are only illustrated here), the imaging characteristics of the blood vessel with contrast agent 400-600HU, then the CT value of the printing material or the bionic material used to print the blood vessel wall and the internal blood should also be within the range of 400-600 HU; the CT value of a parenchymal organ such as a liver, a pancreas, a spleen and a bionic material is between 100 and 300HU, so the CT value of the material for printing and representing the parenchymal organ or the bionic material is in the interval, and shows certain regular change according to different energy spectrums of different x-generators (the HU value changes according to the difference of the energy spectrums, the spatial resolution changes at the same time, and a change curve between an energy spectrum curve and the bionic material is particularly required to be drawn); the CT value of bone generally ranges between 400-1200HU, and varies with respect to different functional and anatomic locations, and the CT value for printing and characterizing bone material or biomimetic material should also fall within this interval. Wherein the CT value for realizing printing materials or adding bionic materials is controlled within a preset range, and the HU range can be controlled by using the nano composite material.

The filter is a device of the imaging apparatus itself for changing the image source characteristics, for example, an aluminum filter of the CT system, through which the energy spectrum of x-rays is changed, and thus the imaging attenuation of the organ is changed.

And 3D printing of the die body is carried out based on the generated 3D printing file.

The 3D printing process and the selection of the printing material may be performed first. For example: processing of photosensitive materials, mixing of digital resin materials, material density adjustment, color indication, and the like.

Subsequently, 3D printing is performed. For example: optimized uniform adjustment of a printing system, adjustment of rigidity and hardness of a die body and the like.

In an exemplary embodiment, different printed materials are selected for each modeling file (each modeling file may or may not have a material selection, as long as the lesion and organ are marked according to clinical needs and modeling files) according to the structural and functional requirements of the motif itself. For example, single curable liquid photosensitive resins, digital hybrid ultraviolet curable photosensitive resins, rubber-like photosensitive resins, transparent photosensitive resins, monochromatic rigid opaque and colored opaque or translucent photosensitive resins, and combinations of these miscible liquid photosensitive resins can range up to thousands of digital materials. These materials vary in density and color, may be incorporated into other materials, and may range in structure, color, and x-ray attenuation characteristics to mark different lesions and organs. By using the multi-composition (i.e. the infinite mixable type of digital materials, such as the pigment mixture of oil paintings), the real organ and lesion information can be reflected from the external features, such as color, shape, hardness, and the like, and the characteristics and parameters of the imaging device suitable for the phantom can be reflected from the functions, such as the density of the material, the absorption rate and attenuation characteristics of x-rays.

The selected simulated human tissue material is used as a printing material of each modeling file, and the printing of the anatomical structure of the lesion and/or organ is performed by using the simulated human tissue material, for example, by means of fusion, perfusion, sintering, and the like.

In an exemplary embodiment, the method may further include: and performing system calibration and/or parameter verification on the equipment by using the phantom.

And putting the generated medical phantom into imaging equipment for verification and test, and listing an equipment deviation correction table and specific change curve fitting for daily use and system calibration. The functional properties of the phantom may be indicated in a data table, for example, for a CT device, under scanning conditions: the voltage is 120kV, the current is 300mA, the filter is 10mm aluminum, wherein the CT value ranges of bones, parenchymal organs, muscles, blood vessels, lungs, brains and the like are respectively noted, and the CT value ranges are used as a clinical standard for calibrating and calibrating the imaging equipment, and clinical scanning protocols can be selected and optimized.

The method is exemplified below by a procedure for fabricating a pancreas phantom for use with a CT apparatus, the function of which is to adjust the settings of the optimal clinical scan parameters of the apparatus.

According to clinical requirements, the pancreatic body comprises pancreas, tumors in the pancreas, hydrops in main pancreatic duct dilation formed by tumors, cysts, splenic arteries, splenic veins, inferior vena cava/veins and arteriovenous involvement and position relation caused by the tumors.

According to the characteristics of the CT equipment, the die body needs to embody the X-ray attenuation properties of the focus and organs, ensure the ray aging resistance of materials and the similar linear change characteristics under different energy spectrum irradiation, ensure the continuity and smooth transition of the structure and the size in each modeling file, ensure the accuracy and the guidance of each scanning plane, and ensure that the deviation cannot be larger than the maximum value of the spatial resolution of the CT equipment.

Firstly, three-dimensional simulation modeling of focus and organ is carried out, theoretical modeling is carried out according to the size and the trend of arteriovenous of human body and the surface characteristics of pancreas, and printable material parameters are selected. Fig. 6 is a schematic diagram of theoretical modeling of a pancreatic phantom, aorta, splenic arteries, inferior arteries, and branch arteries in an exemplary embodiment of the disclosure.

FIG. 7 is a schematic diagram of a theoretical modeling of a pancreas phantom, a pancreas, in an exemplary embodiment of the disclosure. As shown in fig. 7, including the head, body and tail of the pancreas.

Then 3-dimensional modeling based on the medical image is performed. Firstly, two groups of data of an artery phase period and a vein phase period of the CT image can be acquired through data acquisition, wherein the artery phase period comprises pancreas, aorta, splenic artery and other artery information, the tumor boundary is obvious, and the accumulated liquid information in the main pancreatic duct is obvious; the venous phase comprises the main vein, the spleen vein and other vein information, and cyst information is obvious. Meanwhile, as the imaging boundary information of the pancreas belonging to the parenchymal organ in the CT is not obvious, the information presented by the MR nuclear magnetic resonance is required to be used as auxiliary reference. Therefore, three groups of images can be adopted for image registration and segmentation, and finally 3-dimensional modeling of the medical image is obtained. However, the present disclosure is not limited thereto, and in other embodiments, the 3-dimensional modeling of the medical image may be performed by using only the CT image arterial phase data or the CT image venous phase data, or the 3-dimensional modeling of the medical image may be obtained by performing image registration and segmentation by using the CT image arterial phase data and the CT image venous phase data.

Fig. 8 is a schematic diagram of a series of CT pancreatic images of arterial phase in an exemplary embodiment of the disclosure. As shown in fig. 8, the pancreas and artery information is visible in the series of CT images of the artery behavior.

Fig. 9 is a schematic diagram of a series of vein-phased CT pancreatic images in an exemplary embodiment of the disclosure. As shown in fig. 9, information of pancreas, veins, tumor effusion and cyst can be seen in the series of CT images of vein behavior.

Fig. 10 is a schematic diagram of an MR pancreatic imaging in an exemplary embodiment of the present disclosure. As shown in fig. 10, the MR image shows the information of the effusion of the main pancreatic duct tumor.

Fig. 12 is a graphical image modeling of a pancreas phantom based on the arterial phase of the CT pancreas image shown in fig. 8, based on the venous phase of the CT pancreas image shown in fig. 9, and based on the MR pancreas image shown in fig. 10, in an exemplary embodiment of the disclosure. As shown in fig. 12, the medical image modeling based on the CT image artery phase, vein phase and MR image includes aorta, splenic artery and branch artery, main vein, splenic vein and branch vein, cyst, pancreatic tumor, fluid accumulation in main pancreatic duct.

Image fusion and registration are then performed. And carrying out image registration and fusion on the theoretically formed motif modeling file and the motif modeling file formed by the medical image to generate a final modeling file of each focus and organ.

Fig. 13 is a schematic diagram of an image registration and fusion to generate a final modeling file of each lesion and organ in an exemplary embodiment of the present disclosure. As shown in fig. 13, after image registration and fusion are performed on a phantom modeling file formed by theory and a phantom modeling file formed by medical images, a final modeling file of each lesion and organ is generated.

In an exemplary embodiment, the medical image DICOM reconstruction and post-processing technology is used in conjunction with 3D printing technology and medical imaging technology to truly reflect organ/lesion information, the image transformation technology is used to transform the medical DICOM reconstruction file into a triangular mesh file (e.g., stl) that is acceptable to a 3D printer, the high resolution (e.g., 0.016mm)3D printing technology is used in conjunction with imaging features (e.g., x-ray absorption and attenuation features) of the medical imaging equipment to create a medical phantom that reproduces the organ/lesion information in physical form, accurately reflects the anatomy of the human body, is used for clinical scan protocol validation and optimization, system and parameter adjustment of large medical imaging equipment, and assists in generating new inspection standards and protocols for the medical imaging equipment.

In the embodiment of the invention, the 3D high-resolution printing technology is combined with the advanced simulated human tissue material capable of presenting the attributes and parameters of the imaging equipment, so that a die body capable of completely simulating each part and each visceral organ of a human body can be provided for clinic. Especially for magnetic resonance, a phantom body which is similar or identical to the hydrogen-containing proton quantity and form of a real human body can be manufactured, and the problem can be solved for clinic. The simulation teaching platform can provide convenience for clinical medical work, can provide simulation teaching possibility for professional teaching work such as radiological imaging technology and diagnosis, and has excellent application prospect in the future.

Fig. 15 is a schematic view of a 3D printed pancreas phantom and pancreas monomers in an exemplary embodiment of the disclosure. As shown in fig. 15, the 3D printed pancreas phantom including artery and vein, tumor information and pancreas monomers.

The embodiment of the invention combines the 3D printing technology and image medicine, and provides a Medical application motif (Medical Phantom) for Medical image equipment applied to clinical diagnosis and treatment. Medical phantoms are specialized medical imaging devices that are dedicated to detecting, correcting, adjusting, and optimizing system parameters and application algorithms for large medical imaging devices (e.g., CT, MR, PET, etc.).

By adopting the modeling method in the embodiment of the invention, on one hand, a clinical medical model body which accurately reflects human detail anatomical mechanism, focus/pathological information and embodies the performance of image medical equipment can be manufactured. On the other hand, the manufactured mold body has stability and cost payability. A novel simulation modeling method for manufacturing the medical model body is developed. Not only has high precision, but also has strong directivity to specific organs/focuses.

As shown in fig. 16, the lesion and/or organ modeling apparatus 10 for phantom fabrication may include a first modeling module 100, a second modeling module 110, and a third modeling module 120.

Wherein the first modeling module 100 may be configured to perform three-dimensional simulation modeling of the lesion and/or organ and generate a first modeling file of the lesion and/or organ.

The second modeling module 110 may be configured to perform three-dimensional medical image-based modeling of the lesion and/or organ and generate a second modeling file of the lesion and/or organ.

The third modeling module 120 may be configured to perform image registration and fusion on the first modeling file and the second modeling file to generate a third modeling file of the lesion and/or organ.

The specific details of each module/unit in the above-mentioned lesion and/or organ modeling apparatus for phantom fabrication have been described in detail in the corresponding lesion and/or organ modeling method for phantom fabrication, and thus are not described herein again.

Further, an embodiment of the present invention further provides an electronic device, which may include: a processor; and a memory for storing executable instructions of the processor.

Wherein the processor is configured to perform the lesion and/or organ modeling method for phantom fabrication described in any of the embodiments above.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as a memory comprising instructions, executable by a processor of an electronic device to perform the above aspects in an exemplary embodiment are also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

It should be noted that although in the above detailed description several modules or units of means/devices for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.

Moreover, although the steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Claims

1. A lesion and/or organ modeling method for phantom fabrication, comprising:

carrying out image registration and fusion on the first modeling file and the second modeling file to generate a third modeling file of the focus and/or the organ, and manufacturing the motif by a 3D printing method according to the third modeling file and the composition material of the motif;

wherein performing three-dimensional simulation modeling of the lesion and/or organ and generating a first modeling file of the lesion and/or organ comprises:

2. The lesion and/or organ modeling method for phantom fabrication according to claim 1, further comprising:

3. A lesion and/or organ modeling method for phantom fabrication according to claim 2, wherein the structure of the phantom is determined according to the anatomical characteristics of the lesion and/or organ and the highest spatial resolution required by the device.

4. A lesion and/or organ modeling method for phantom fabrication according to claim 2, wherein the function of the phantom is determined based on system attributes of the device and the physiological function performed by the lesion and/or organ.

5. A lesion and/or organ modeling method for phantom fabrication according to claim 2, further comprising: and determining the composition material of the die body according to the structure and the function of the die body.

6. A lesion and/or organ modeling method for phantom fabrication according to claim 1, wherein performing three-dimensional medical image-based modeling of the lesion and/or organ, generating a second modeling file of the lesion and/or organ comprises:

7. The lesion and/or organ modeling method for phantom fabrication according to claim 6, wherein image processing and three-dimensional modeling the first image file comprises:

8. The lesion and/or organ modeling method for phantom fabrication according to claim 6, wherein image processing and three-dimensional modeling the first image file comprises:

9. The lesion and/or organ modeling method for phantom fabrication according to claim 6, wherein image processing and three-dimensional modeling the first image file comprises:

10. The lesion and/or organ modeling method for phantom fabrication according to claim 6, wherein image processing and three-dimensional modeling the first image file comprises:

11. A lesion and/or organ modeling apparatus for phantom fabrication, comprising:

the first modeling module is used for establishing clinical requirements and analyzing system attributes of equipment suitable for the model body; carrying out three-dimensional simulation modeling on the focus and/or organ to generate a first modeling file of the focus and/or organ; setting the modeling structure parameters of the focus and/or organ according to the clinical requirement and the system attribute of the equipment; setting material parameters of the composition materials of the die body according to the clinical requirements and the system attributes of the equipment; generating a first modeling file of the focus and/or organ according to the modeling structure parameters of the focus and/or organ and the material parameters of the composition materials of the motif;

and the third modeling module is used for carrying out image registration and fusion on the first modeling file and the second modeling file to generate a third modeling file of the focus and/or the organ so as to manufacture the motif by a 3D printing method according to the third modeling file and the constituent materials of the motif.

12. An electronic device, comprising:

a processor; and

a memory for storing executable instructions of the processor;

wherein the processor is configured to perform a lesion and/or organ modeling method for phantom fabrication according to any of the preceding claims 1-10.