CN111563877B - Medical image generation method and device, medical image display method and storage medium - Google Patents
Medical image generation method and device, medical image display method and storage medium Download PDFInfo
- Publication number
- CN111563877B CN111563877B CN202010215361.3A CN202010215361A CN111563877B CN 111563877 B CN111563877 B CN 111563877B CN 202010215361 A CN202010215361 A CN 202010215361A CN 111563877 B CN111563877 B CN 111563877B
- Authority
- CN
- China
- Prior art keywords
- image
- images
- interest
- pixel
- gray value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
- G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30061—Lung
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Radiology & Medical Imaging (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Medical Informatics (AREA)
- Computer Graphics (AREA)
- Architecture (AREA)
- Quality & Reliability (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
The invention mainly discloses a method for generating medical images, which comprises the following steps: dividing the three-dimensional medical image to obtain first through N-th images of interest, wherein N is a natural number greater than or equal to 3; projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane; and in response to the first operation, superposing and displaying at least two images from the first to the N-th images. By adopting the scheme provided by the invention, convenience is provided for doctors, the experience of the doctors is improved, and the rapid diagnosis of the illness state of the doctors is facilitated and the diagnosis efficiency of the doctors is improved.
Description
Technical Field
The present invention relates to the field of medical technologies, and in particular, to a method and apparatus for generating a medical image, a display method, and a storage medium.
Background
Acquisition of chest images is currently generally performed by means of an X-ray radiography apparatus or a computed tomography apparatus. For the X-ray photographing apparatus, when X-rays pass through a human body, the absorption degree of the X-rays by different tissues and different parts is different, so that the internal structure information of the human body can present corresponding images according to the transmission level of the X-rays. The speed of the X-ray photographing device for collecting images is high, the dosage is low, but for the images collected by the X-ray photographing device, because the X-rays are limited by deep and shallow tissues, the images are overlapped and hidden, so that the X-ray photographing device sometimes needs to photograph X-rays at multiple angles to clearly see the part to be inspected, namely, the images collected by the X-ray photographing device may have partial detail defects.
The computerized tomography (CT, computed Tomography) device scans a certain layer of a human body with an X-ray beam, receives X-rays transmitted through the layer by a detector, converts the X-rays into visible light, converts the visible light into an electric signal by photoelectric conversion, converts the electric signal into a digital signal by an analog/digital converter, and inputs the digital signal into a computer for processing to obtain an image. The CT device is used for collecting images, the problems of overlapping and hiding of the images are avoided, the section images collected by the CT device are clearer, and the density resolution ratio is higher. However, CT imaging obtains cross-sectional information (cross-sectional, coronal, sagittal) of the examined region, which cannot intuitively give the overall information of the examined region. In order to know the condition of the part to be detected, a doctor needs to check all the sectional images and then diagnose the part to be detected, and taking the case of diagnosing whether the patient has pneumonia or not, the doctor usually needs to check the information such as the position, the density and the like of the lung focus in a plurality of cross-sectional images one by one, and then determine whether the patient has the pneumonia or not and the severity of the pneumonia, so that the diagnosis efficiency is reduced to a certain extent.
Therefore, how to provide a medical image to enable a doctor to intuitively obtain comprehensive information of a part to be detected, so that the doctor can read the film conveniently, and further, the diagnosis efficiency of the doctor is improved, and the method becomes one of the problems to be solved urgently at present.
Disclosure of Invention
The invention provides a method and a device for generating medical images, a display method and a storage medium, which can provide comprehensive information of a part to be detected in a more visual mode, facilitate the doctor to read the film and improve the diagnosis efficiency of the doctor to a great extent.
The invention provides a method for generating medical images, which comprises the following steps:
dividing the three-dimensional medical image to obtain first through N-th images of interest, wherein N is a natural number greater than or equal to 3;
projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
and in response to the first operation, superposing and displaying at least two images from the first to the N-th images.
Optionally, projecting the ith image of interest in the first direction to obtain the ith image includes: and taking the weighted average value of the gray values of the pixels in the first direction in the I-th image of interest as the gray value of the pixels projected in the first direction by the pixels in the first direction, wherein I is a natural number which is more than or equal to 1 and less than or equal to N.
Optionally, the three-dimensional medical image comprises a three-dimensional chest image, the first image of interest comprises a lung parenchyma image, and projecting the first image of interest along a first direction to obtain a first image comprises: and taking the gray value of the pixel with the smallest gray value in the pixels along the first direction in the first interested image as the gray value of the pixel projected in the first direction by the pixels along the first direction.
Optionally, the three-dimensional medical image comprises a three-dimensional chest image, the second image of interest comprises a lesion image, and projecting the second image of interest along the first direction to obtain the second image comprises: and taking the gray value of the pixel with the largest gray value in the pixel along the first direction in the second interested image as the gray value of the pixel projected in the first direction by the pixel along the first direction.
Optionally, the three-dimensional medical image includes a three-dimensional chest image, the third image of interest includes an airway image, and projecting the third image of interest along the first direction to obtain the third image includes: taking the average value of the gray values of the pixels in the first direction in the third interesting image as the gray value of the pixels projected in the first direction
Optionally, the method for generating a medical image further includes:
and respectively rendering the first to N colors for the first to N images.
Optionally, the method for generating a medical image further includes: and hiding at least one image of the first to N-th images displayed in a superimposed manner in response to a second operation.
The invention also provides a medical image display method, which comprises the following steps:
in response to a first operation, at least two images of the first to N-th images are superimposed and displayed, and at least two images of the first to N-th historical images are correspondingly superimposed and displayed, wherein the first to N-th images are generated by:
dividing the three-dimensional medical image to obtain first through N-th images of interest, wherein N is a natural number greater than or equal to 3;
projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
the historical first through nth images are generated as follows:
dividing the historical three-dimensional medical image to obtain historical first to historical N-th interesting images, wherein N is a natural number greater than or equal to 3;
Projecting the historical first to historical nth images of interest along a first direction to obtain corresponding historical first to historical nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
wherein the three-dimensional medical image and the historical three-dimensional medical image are images of the same part of the same subject at different times.
The invention also provides a device for generating the medical image, which comprises the following steps:
a segmentation unit for segmenting the three-dimensional medical image to obtain first to nth images of interest, wherein N is a natural number of 3 or more;
a mapping unit, configured to project the first to nth images of interest along a first direction to obtain corresponding first to nth images, where the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a cross section;
and the superposition unit is used for responding to the first operation, superposing and displaying at least two images from the first to the N images.
The invention also provides a computer device comprising at least one processor and at least one memory, wherein the memory stores a computer program which, when executed by the processor, enables the processor to perform the above-mentioned method for generating medical images or the above-mentioned method for displaying medical images.
The present invention also provides a computer readable storage medium, which when executed by a processor within a device, causes the device to perform the above-described method of generating a medical image, or the above-described method of displaying a medical image.
Compared with the prior art, the technical scheme of the invention has the following beneficial effects:
obtaining first to nth images of interest by segmenting the three-dimensional medical image, wherein N is a natural number of 3 or more. Projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane; and in response to the first operation, superposing and displaying at least two images from the first to the N-th images. According to the technical scheme, at least two images from the first to the N-th images can be overlapped and displayed through a first operation according to actual requirements (such as the images of interest to be checked), and as the first to the N-th images are obtained by projecting the images of interest separated from the three-dimensional medical images along the first direction, interference of other non-interested images on the images of interest in the diagnosis process is avoided, and further, the overlapping of the first to the N-th images obtained by projecting the N-th images of interest can be performed according to the actual requirements of doctors, so that convenience is provided for the doctors on one hand, the experience of the doctors is improved, and the doctors can quickly diagnose illness conditions on the other hand, and the diagnosis efficiency of the doctors is improved. In addition, the first direction can be the direction vertical to the coronal plane, the direction vertical to the sagittal plane and the direction vertical to the transverse plane, so that visual and comprehensive image information of the part to be detected (the image of interest) can be obtained, and the diagnosis efficiency of a doctor is improved, and the diagnosis accuracy is also improved to a certain extent.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
FIG. 1 is a flow chart of a method for generating medical images according to the present invention;
FIG. 2 is a schematic view of a lung parenchyma image projected onto a coronal plane, a sagittal plane, and a transverse plane according to an embodiment of the present invention;
FIG. 3 is a schematic view of a human body base surface and a base axis;
FIG. 4 is a schematic representation of a coronal plane map of a lung lesion and trachea according to an embodiment of the present invention;
FIG. 5 is a schematic representation of a coronal mapping of a colored lung lesion and trachea according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a medical image generating apparatus according to the present invention;
Fig. 7 is a schematic diagram of a medical image under a history comparison mode according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail below with reference to the accompanying drawings, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Fig. 1 is a flowchart of a medical image generation method according to the present invention, as shown in fig. 1, which can be implemented as steps S11 to S13 as follows:
step S11, segmenting the three-dimensional medical image to obtain first to N-th interesting images, wherein N is a natural number greater than or equal to 3.
Step S12, projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane.
Step S13, in response to the first operation, at least two images from the first to N-th images are overlapped and displayed.
In this embodiment, the three-dimensional medical image may be a three-dimensional chest image, a brain three-dimensional medical image, or the like, and the first to nth images of interest may be images of an area of interest when a doctor reads a film, or images that the doctor needs to view, and images of a part to be inspected. Taking a three-dimensional medical image as a three-dimensional chest image and N as 3 as an example, if a doctor needs to view the distribution of lesions in the lung, the first image of interest may be a lung parenchyma image, the second image of interest may be a lesion (inflammatory lesion, tumor lesion, etc.) image, and the third image of interest may be a tracheal image. If the doctor needs to check whether the brain has a tumor, the first interested image may be a brain image, the second interested image may be a tumor focus image, and the third interested image may be a brain blood vessel image.
In this embodiment, the first to nth images of interest may be segmented from different three-dimensional medical images, and the corresponding segmentation method may be selected according to the actual application, for example, a thresholding method, a region growing method, a method based on pattern classification, a method based on image registration and a shape model, etc., which are not limited in this embodiment, so long as the first to nth images of interest may be segmented from the three-dimensional medical images.
In this embodiment, the first direction may be a direction perpendicular to the coronal plane, a direction perpendicular to the sagittal plane, or a direction perpendicular to the transverse plane. In practical application, the first to nth images of interest can be projected along the determined first direction according to clinical requirements, of course, the first to nth images of interest can be projected along three directions respectively to obtain corresponding first to nth images, and at least two images of the first to nth images in different directions are respectively overlapped and displayed in response to the first operation, so that in the subsequent diagnosis process, diagnosis can be performed by combining the overlapped images in the three projection directions, and the accuracy of diagnosis is further improved.
In this embodiment, when the first to nth images of interest are projected in the first direction to obtain the corresponding first to nth images, for any one of the first images of interest, such as the ith image of interest (I is a natural number equal to or greater than 1 and equal to or less than N), projecting the ith image of interest in the first direction to obtain the ith image includes: and taking the weighted average value of the gray values of the pixels in the first direction in the I-th image of interest as the gray value of the pixels projected in the first direction by the pixels in the first direction. For example, if the straight line L in the I-th image of interest is perpendicular to the coronal plane, there are 200 pixels on the straight line L, each pixel has a corresponding gray value, when the pixels on the straight line L are projected along the direction perpendicular to the coronal plane, the 200 pixels on the straight line L are projected as one pixel, and the gray value of the projected pixels is a weighted average of the gray values of the 200 pixels, that is, each pixel of the 200 pixels is multiplied by the corresponding weight and added, and then divided by the gray value obtained after 200. And (3) projecting all pixel points on a straight line perpendicular to the coronal plane in the I-th image of interest in the manner described above, and finally obtaining an image of the I-th image of interest projected along the direction perpendicular to the coronal plane, namely the I-th image. Similarly, if the first direction is a direction perpendicular to the sagittal plane, the weighted average of the gray values of the pixels in the direction perpendicular to the sagittal plane in the I-th image of interest is set as the gray value of the pixels projected in the direction perpendicular to the sagittal plane for the pixels in the direction perpendicular to the sagittal plane. If the first direction is a direction perpendicular to the cross section, a weighted average of gray values of pixels in the direction perpendicular to the cross section in the first image of interest is used as the gray value of the pixels projected in the direction perpendicular to the cross section. In this embodiment, the weights of the pixels may be set according to actual clinical requirements, and when the ith image of interest needs to be highlighted, the distribution situation of the ith image of interest, clinical requirements, etc. may be combined to adjust the weights of each pixel in the ith image of interest, so as to adjust the gray value of the pixel of the ith image of interest projected on the projection plane (coronal plane, sagittal plane, cross section), so that a doctor can check the ith image of interest after projection. Such as: the image of the ith interest image projected on the projection surface is highlighted by adjusting the weight of each pixel in the ith interest image to enhance the gray value of the pixel of the ith interest image projected on the projection surface, or by adjusting the weight of each pixel in the non-ith interest image to weaken the gray value of the pixel of the non-ith interest image projected on the projection surface. In addition, when the I-th image of interest is projected, the gray values of the projected pixels may not be limited, but the first image of interest projected on the projection surface may be clearly distinguished from the N-th image of interest by color rendering, that is, the first image may be distinguished from the N-th image by rendering the first image to the N-th image with the first color respectively.
The technical solution of the present invention will be described in detail below by taking the three-dimensional medical image as a chest image, N as 3, the first image of interest as a lung parenchyma image, the second image of interest as a focus image, the third image of interest as a trachea image, and the first direction as a direction perpendicular to the coronal plane as an example.
Step S11 is performed to segment the three-dimensional chest image to obtain a lung parenchyma image, a focus image and a trachea image.
In this embodiment, the lung image including the lung parenchyma image and the trachea image (the trachea including the main trachea, bronchi and its lobes Duan Fenzhi) may be first coarsely extracted from the three-dimensional chest image. Specifically, the approximate range of CT values of the lung can be estimated by sampling the volume data of the three-dimensional chest image, and then analyzing the statistical histogram of CT values of the volume data of the three-dimensional chest image within the range by using the Ojin method to obtain the optimal segmentation threshold T 0 . For CT values greater than T 0 Labeled 0 for voxels (sternum, ribs, spine, skin, etc.) and background, for CT values less than T 0 Labeled 1 for voxels (lung parenchyma, main trachea, bronchi).
Then, based on the result after the 3D threshold rough segmentation, a 3D region growing method is adopted to further acquire a lung image. In this embodiment, the seed point may be the center of the left half of the middle slice in the three-dimensional medical image, and if the seed point is not in the lung parenchyma, a random algorithm may be used to search around the seed point until the seed point in the lung parenchyma is found. After the seed point is selected, adopting a 6-neighborhood rule to make CT value smaller than T 0 Is grown for voxels of (a).
Finally, the tracheal image is segmented from the pulmonary image to obtain a pulmonary parenchymal image. In this embodiment, in particular, the initiation layer of the trachea may be located from a two-dimensional image comprised by a three-dimensional lung image, if two-dimensionalIf the physical area of the trachea in the image is larger than a certain value (for example, 2 square millimeters), the current layer is positioned as the initial layer of the trachea, and if the physical area is smaller than or equal to a certain value (for example, 2 square millimeters), the detection is continued until the initial layer is detected. Starting from the center of the trachea of the initial layer at T 1 As a threshold, a level set algorithm is used to coarsely extract the trachea from the three-dimensional lung image. Adopting a morphological closing processing method to carry out smooth filling processing on lung parenchyma areas after the air pipes are roughly extracted in each layer of two-dimensional lung images respectively; and calculating a connected domain, and distinguishing left and right lung parenchyma according to centroid distribution. Continuing to take the center of the air pipe as the starting point and taking T as the starting point 2 And further extracting the trachea from the three-dimensional lung image by adopting a level set algorithm as a threshold value so as to obtain a segmented lung parenchyma image. T in the present embodiment 1 And T 2 For CT values, which can be determined by maximum inter-class variance, in particular T 1 Can be (-600, -400), T 2 The range of values for (a) may be (-1000, -660). In another embodiment, the wave front model method can be used for segmenting the trachea from the lung image, and in yet another embodiment, the deep learning-based trachea segmentation model can be used for segmenting the trachea from the lung image.
In this embodiment, the three-dimensional convolutional neural network model may be used to segment the three-dimensional chest image to obtain a lung image, then the three-dimensional U-Net network is used to segment the suspicious lesion from the lung image, and finally the three-dimensional two-class network is used to classify the suspicious lesion to remove the pseudo lesion and obtain the segmented lesion image. In another embodiment, a thresholding method may also be used to segment the lesion image from the three-dimensional chest image. In yet another embodiment, the lesion may be segmented in the lung parenchyma image obtained in the previous step.
In this embodiment, the method for segmenting the tracheal image when segmenting the lung parenchyma image from the three-dimensional chest image can be referred to as segmenting the tracheal image from the three-dimensional chest image. In other embodiments, the 3D region growing method may be directly used to primarily extract the trachea from the three-dimensional chest image; then, selecting a fine air pipe candidate region by using a morphological segmentation method, and synthesizing a result of primarily segmenting air pipes and the fine air pipe candidate region to obtain a primary air pipe image; finally, removing the pseudo-tracheal region by using the region growing method again to divide the final tracheal image.
In the present embodiment, the three-dimensional medical image is taken as a three-dimensional chest image, and N is taken as 3 as an example, specifically, the first image of interest is taken as a lung parenchyma image, the second image of interest is taken as a focus image, and the third image of interest is taken as a trachea image. When the three-dimensional medical image is not a three-dimensional chest image, the first image of interest is not a lung parenchymal image, the second image of interest is not a lesion image, and the third image of interest is not a tracheal image, the corresponding segmentation method can be selected according to the actual application so as to segment the first to the nth images of interest from different three-dimensional medical images. Therefore, the above method for segmenting the lung parenchyma image, the focus image and the trachea image should not be taken as a limitation of the present invention.
Step S12 is executed to project the lung parenchyma image, the focus image, and the tracheal image along a direction perpendicular to the coronal plane, so as to obtain a corresponding first image, a second image, and a third image.
In this embodiment, the image obtained by projecting the lung parenchyma image in the direction perpendicular to the coronal plane is a first image, the image obtained by projecting the focus image in the direction perpendicular to the coronal plane is a second image, and the image obtained by projecting the tracheal image in the direction perpendicular to the coronal plane is a third image.
Projecting the lung parenchyma image in a direction perpendicular to a coronal plane to obtain a first image comprises: and taking the gray value of the pixel with the smallest gray value in the pixel in the direction perpendicular to the coronal plane in the lung parenchymal image as the gray value of the pixel projected in the direction perpendicular to the coronal plane in the pixel in the direction perpendicular to the coronal plane. For example, if the straight line AB in the lung parenchyma image is perpendicular to the coronal plane, there are 100 pixels on the straight line AB, each pixel has a corresponding gray value, when the pixels on the straight line AB are projected along the direction perpendicular to the coronal plane, the 100 pixels on the straight line AB are projected as one pixel, and the gray value of the pixel after projection is the gray value of the pixel with the smallest gray value of the 100 pixels. And (3) projecting all pixel points on a straight line perpendicular to the coronal plane in the lung parenchymal image in the manner, and finally obtaining an image of the lung parenchymal image projected along the direction perpendicular to the coronal plane, namely a first image. Similarly, if the first direction is a direction perpendicular to the sagittal plane, the gray value of the pixel having the smallest gray value among the pixels in the direction perpendicular to the sagittal plane in the lung parenchymal image is set as the gray value of the pixel projected in the direction perpendicular to the sagittal plane for the pixel in the direction perpendicular to the sagittal plane. If the first direction is a direction perpendicular to the cross section, the gray value of the pixel with the smallest gray value among the pixels in the direction perpendicular to the cross section in the lung parenchyma image is taken as the gray value of the pixel projected in the direction perpendicular to the cross section of the pixel in the direction perpendicular to the cross section. Fig. 2 is a schematic view of a lung parenchymal image projected onto a coronal plane, a sagittal plane and a transverse plane according to an embodiment of the present invention, and from left to right in fig. 2, the lung parenchymal image is projected onto a transverse plane, a coronal plane and a sagittal plane sequentially.
In this embodiment, projecting the lesion image along a direction perpendicular to the coronal plane to obtain the second image includes: and taking the maximum gray value of the pixels in the direction perpendicular to the coronal plane in the focus image as the gray value of the pixels projected in the direction perpendicular to the coronal plane of the pixels in the direction perpendicular to the coronal plane. For example, if the straight line CD in the lesion image is perpendicular to the coronal plane, there are 50 pixels on the straight line CD, each pixel has a corresponding gray value, when the pixels on the straight line CD are projected along the direction perpendicular to the coronal plane, the 50 pixels on the straight line CD will be projected as one pixel, and the gray value of the projected pixel is the gray value of the pixel with the largest gray value of the 50 pixels. And (3) projecting all pixel points on a straight line perpendicular to the coronal plane in the focus image in the manner, and finally obtaining an image of the focus image projected along the direction perpendicular to the coronal plane, namely a second image. Similarly, if the first direction is a direction perpendicular to the sagittal plane, the maximum gray value of the pixels in the direction perpendicular to the sagittal plane in the lesion image is set as the gray value of the pixels projected in the direction perpendicular to the sagittal plane for the pixels in the direction perpendicular to the sagittal plane. If the first direction is a direction perpendicular to the cross section, the maximum gray value of the pixels in the direction perpendicular to the cross section in the focus image is taken as the gray value of the pixels projected in the direction perpendicular to the cross section.
In this embodiment, projecting the tracheal image in a direction perpendicular to the coronal plane to obtain a third image includes: and taking an average value of gray values of pixels in the direction perpendicular to the coronal plane in the tracheal image as the gray value of the pixels projected in the direction perpendicular to the coronal plane of the pixels in the direction perpendicular to the coronal plane. For example, if the straight line EF in the tracheal image is perpendicular to the coronal plane, 60 pixels are located on the straight line EF, each pixel has a corresponding gray value, when the pixels on the straight line EF are projected along the direction perpendicular to the coronal plane, the 60 pixels on the straight line EF are projected as one pixel, and the gray value of the projected pixels may be the average value of the gray values of the 60 pixels. And (3) projecting all pixel points on a straight line perpendicular to the coronal plane in the tracheal image in the manner, and finally obtaining an image of the tracheal image projected along the direction perpendicular to the coronal plane, namely a third image. Similarly, if the first direction is a direction perpendicular to the sagittal plane, the average value of the gray values of the pixels in the direction perpendicular to the sagittal plane in the tracheal image is set as the gray value of the pixels projected in the direction perpendicular to the sagittal plane for the pixels in the direction perpendicular to the sagittal plane. If the first direction is a direction perpendicular to the cross section, an average value of gray values of pixels in the direction perpendicular to the cross section in the tracheal image is taken as a gray value of pixels projected in the direction perpendicular to the cross section.
As described above, when the first perceived image is projected in the first direction, the weighted average of the gray values of the pixels in the first direction in the first perceived image may be used as the gray value of the pixel after the first direction is projected. When the interested images are the lung parenchyma image, the focus image and the trachea image in the three-dimensional chest image respectively, in order to enable a doctor to see the focus more clearly, the method is adopted to project, and then the images generated after at least two images of the first image, the second image and the third image are overlapped can be used for highlighting the focus image, so that the doctor can see the relation among the position, the size, the density and the trachea of the focus in the lung clearly, the doctor can diagnose the illness state conveniently, and the diagnosis efficiency of the doctor is improved.
Step S13 is performed, in response to the first operation, of superimposing and displaying at least two images of the first to third images.
In this embodiment, the first operation is an operation of selecting, overlapping and displaying at least two images of the first image, the second image and the third image. After responding to the first operation, the first to third images which are stored in advance and generated are selected, overlapped and displayed.
For example, when a doctor is viewing a CT image sequence of a certain subject, if he clicks on the first control of the image display interface: and (3) coronary surface mapping (lung+focus), automatically selecting and displaying a first image (obtained by projecting a lung parenchyma image along a direction perpendicular to the coronary surface) and a second image (obtained by projecting a focus image along a direction perpendicular to the coronary surface) corresponding to the CT image sequence of the detected person by the background in response to the clicking operation of the first control.
If the first control of the image display interface is clicked, the first control is: and (3) coronary surface mapping (lung+focus+trachea), automatically selecting a first image (obtained by projecting a lung parenchyma image in a direction perpendicular to the coronary surface), a second image (obtained by projecting a focus image in a direction perpendicular to the coronary surface) and a third image (obtained by projecting a trachea image in a direction perpendicular to the coronary surface) corresponding to the CT image sequence of the subject by the background in response to the click operation of the first control, and superposing and displaying.
Referring to fig. 4, fig. 4 is a schematic diagram of a coronary mapping of a lung focus and a trachea, and in fig. 4, a brighter portion near the trachea is a focus in a lung parenchymal image according to an embodiment of the present invention. By looking at the image, a doctor can quickly obtain the distribution of the focus in the lung, whether the position of the focus presses the trachea or not, and the like. Only the image of interest of the doctor is shown in the image, namely, the interference of other images irrelevant to diagnosis on the image of interest is avoided, and the diagnosis efficiency of the doctor and the diagnosis accuracy are improved.
Correspondingly, if the doctor clicks the sagittal plane mapping (lung+focus) in the second control of the image display interface, the background automatically selects and displays a first image (obtained by projecting a lung parenchyma image in a direction perpendicular to the sagittal plane) corresponding to the CT image sequence of the subject in response to the clicking operation of the second control, and a second image (obtained by projecting a focus image in a direction perpendicular to the sagittal plane) in a superimposed manner.
If the doctor clicks the sagittal plane mapping (lung+focus+trachea) in the second control of the image display interface, in response to the clicking operation of the second control, the background automatically selects a first image (obtained by projecting a lung parenchyma image in a direction perpendicular to the sagittal plane), a second image (obtained by projecting a focus image in a direction perpendicular to the sagittal plane), and a third image (obtained by projecting a trachea image in a direction perpendicular to the sagittal plane) corresponding to the CT image sequence of the subject, and superimposes and displays the images.
Correspondingly, if the doctor clicks the cross-sectional map (lung+focus) in the third control of the image display interface, the background automatically selects the first image (the lung parenchyma image is obtained by projection in the direction perpendicular to the cross section) corresponding to the CT image sequence of the subject and the second image (the focus image is obtained by projection in the direction perpendicular to the cross section) for superposition and display in response to the clicking operation of the third control.
If the doctor clicks the cross-sectional map (lung+focus+trachea) in the third control of the image display interface, in response to the clicking operation of the third control, the background automatically selects a first image (the lung parenchyma image is projected in a direction perpendicular to the cross section), a second image (the focus image is projected in a direction perpendicular to the cross section), and a third image (the trachea image is projected in a direction perpendicular to the cross section) corresponding to the CT image sequence of the subject, and superimposes and displays the images.
In addition, when needed, the doctor can also check the images projected and overlapped in the direction perpendicular to the coronal plane, projected and overlapped in the direction perpendicular to the sagittal plane and projected and overlapped in the direction perpendicular to the transverse plane by clicking the three-direction mapping (lung+focus) or the three-direction mapping (lung+focus+trachea) in the fourth control. The images of interest of the doctor are checked from multiple dimensions, so that the diagnosis efficiency and the diagnosis accuracy are further improved.
In addition, the images displayed after superposition can be displayed on the current display interface, and can also be displayed on the popped display interface in a floating window mode.
In this embodiment, superimposing the first to nth images includes: the first through N-th images are superimposed based on a relative position between the first through N-th images of interest. Taking the example that N is 3, the first image of interest is a lung parenchyma image, the second image of interest is a focus image, and the third image of interest is a trachea image, for the lung parenchyma image, the coordinates of the center point of any focus in the focus image and the coordinates of the center point of the trachea image are also known, and the three are located in the same coordinate system, so the relative positional relationship among the three can be known. Referring to fig. 3, fig. 3 is a schematic view of a basic plane and a basic axis of a human body, and if the basic plane is projected onto a coronal plane (YZ plane) along a direction perpendicular to the coronal plane, the coordinates of a center point of the lung on the YZ plane are identical to those of a center point of the lung in a three-dimensional space in the Y-axis and Z-axis, and likewise, the coordinates of a center point of the focus on the YZ plane are identical to those of a center point of the focus in the three-dimensional space in the Y-axis and Z-axis, and the coordinates of a center point of the trachea on the YZ plane are identical to those of a center point of the trachea in the three-dimensional space in the Y-axis and Z-axis. That is, the relative positional relationship of the lung center point, the focus center point and the tracheal center point in the Y-axis and the Z-axis is unchanged after projection. Therefore, on the premise of knowing the relative positions of the coordinates of the central point of the lung parenchyma image, the coordinates of the central point of the focus image and the coordinates of the central point of the trachea image in the three-dimensional space, at least two images from the first image to the third image can be overlapped according to the relative position relation among the three images, so that the relative positions of the three images before and after projection are not changed.
Accordingly, when the images obtained after projection of the lung parenchyma image, the focus image, and the tracheal image in the direction perpendicular to the sagittal plane are superimposed, the image may be performed based on the relative positional relationship of the lung parenchyma image, the focus image, and the tracheal image in space (the X coordinate and Z coordinate are not changed before and after projection). The superposition of the lung parenchyma image, the focus image, and the tracheal image obtained after projection in the direction perpendicular to the cross section may be performed based on the relative positional relationship of the lung parenchyma image, the focus image, and the tracheal image in space (the X coordinate and the Y coordinate are not changed before and after projection).
By the above-described manner, the first image of interest, the second image of interest, and the third image of interest, which are segmented from the three-dimensional medical image, can be projected in the first direction, and at least two images of the first to third images obtained after the projection are superimposed and displayed in response to the first operation. The superimposed images only comprise the images of interest of the doctor, so that the interference of other images on the images of interest is avoided, and in addition, the first direction can be any direction in the directions perpendicular to the coronal plane, the sagittal plane and the transverse plane, so that the doctor can conveniently view the images of interest from different dimensions, visual and more comprehensive image information is provided, the doctor can conveniently read the images, the diagnosis efficiency of the doctor is improved, and the diagnosis accuracy is improved to a certain extent.
Considering that in practical clinical application, when a doctor views the superimposed images, it may be necessary to hide other images to see a certain image, for example, when a doctor views a lung focus, it may be necessary to hide an image of a trachea, so in this embodiment, the method for generating a medical image further includes: and hiding at least one image of the first to N-th images displayed in a superimposed manner in response to a second operation. The second operation may be double clicking on the image to be hidden. Still taking N as 3 as an example, if the doctor clicks the coronal plane map (lung+focus+trachea), when it needs to hide the tracheal image, it can be hidden by double clicking the tracheal image.
In the above-mentioned steps, in order to highlight some of the images of interest, the gray values of the pixels projected on the projection surface may be set (may be implemented by weighting the gray values of the pixels, etc.) when the images of interest and other images of interest are projected in the process of obtaining the first to nth images. In other embodiments, the gray values of the pixels of the image of interest projected on the projection surface may not be defined, but different colors may be rendered for the first to nth images of different images of interest after being projected, specifically, the first color may be rendered for the first image, the second color may be rendered for the second image, the third color may be rendered for the third image, … …, and the nth color may be rendered for the nth image. Of course, for the I-th image, for example, the lesion image, different colors may be rendered for different lesions in the I-th image, or the same color with different shades may be used to render the lesions according to the change of the lesion density, for example, the ground glass, the semi-reality, the reality, and the calcification may be rendered with red with different shades. Still taking N as 3, the first to third images of interest as lung parenchyma image, focus image and trachea image, respectively, as an example, refer to FIG. 5, FIG. 5 is an embodiment of the present invention
Referring to fig. 5, fig. 5 is a schematic diagram illustrating a coronary mapping of a lung focus and a trachea according to an embodiment of the present invention, in fig. 5, a first image of a lung parenchyma image is rendered as blue, a second image, which is a projection of each focus image, is rendered with a different color, such as green, yellow, etc. as shown in fig. 5, and a third image of a trachea image is rendered as white. In order to prevent the air tube located in the lung from blocking the lung parenchyma image, the air tube image located in the lung is translucent when displayed, so that the air tube image located in the lung in fig. 5 is light blue.
The present invention also provides a medical image generating apparatus, referring to fig. 6, fig. 6 is a schematic structural diagram of the medical image generating apparatus according to the present invention, as shown in fig. 6, the medical image generating apparatus includes:
a segmentation unit 101 for segmenting the three-dimensional medical image to obtain first to nth images of interest, wherein N is a natural number of 3 or more.
The mapping unit 102 is configured to project the first to nth images of interest along a first direction to obtain corresponding first to nth images, where the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane, respectively.
And a superimposing unit 103 for superimposing and displaying at least two images among the first to nth images in response to a first operation.
The implementation of the medical image generating apparatus of this embodiment may refer to the implementation of the medical image generating method described above, and will not be described herein.
Example two
In practical applications, doctors usually need to compare images acquired in different periods to determine the development speed, changes, etc. of the disease. The embodiment also provides a medical image display method, which comprises the following steps:
in response to a third operation, at least two images of the first to N-th images are superimposed and displayed, and at least two images of the first to N-th historical images are correspondingly superimposed and displayed, wherein the first to N-th images are generated by:
dividing the three-dimensional medical image to obtain first through N-th images of interest, wherein N is a natural number greater than or equal to 3;
projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
the historical first through nth images are generated as follows:
Dividing the historical three-dimensional medical image to obtain historical first to historical N-th interesting images, wherein N is a natural number greater than or equal to 3;
projecting the historical first to historical nth images of interest along a first direction to obtain corresponding historical first to historical nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
wherein the three-dimensional medical image and the historical three-dimensional medical image are images of the same part of the same subject at different times.
In this embodiment, the methods for acquiring the first image and the first image are the same, the methods for acquiring the second image and the second image are the same, the methods for acquiring the third image and the third image are the same, … …, and the methods for acquiring the nth image and the nth image are the same. The difference is that a historical first image is obtained by projecting a first image of interest in a historical three-dimensional medical image in a first direction, and the first image is obtained by projecting a first image of interest in a three-dimensional medical image (which may also be referred to as a current three-dimensional medical image) in the first direction, a historical second image is obtained by projecting a second image of interest in a historical three-dimensional medical image in the first direction, and the second image is obtained by projecting a second image of interest in a three-dimensional medical image (current three-dimensional medical image) in the first direction, and similarly, a historical nth image is obtained by projecting an nth image of interest in a historical three-dimensional medical image in the first direction, and an nth image is obtained by projecting an nth image of interest in a three-dimensional medical image (current three-dimensional medical image) in the first direction. The historical three-dimensional medical image and the three-dimensional medical image (current three-dimensional medical image) are medical images of the same subject at the same site acquired at different times. For example, the subject last took chest CT at 29 months 2020, and before that, it took chest CT at 7 months 2020, 27 months 2020, and 19 months 2020, respectively. When a doctor views the chest CT of 29 th 2 months in the last 2020, the chest CT taken this time may be referred to as a three-dimensional medical image or a current three-dimensional medical image, and the chest CT images taken on 7 th 1 month, 27 th 1 month, and 19 th 2 months 2020 are historical three-dimensional medical images of the three-dimensional medical image (current three-dimensional medical image). By adopting the method for generating the first to N images, the historical three-dimensional medical images can be processed to obtain the historical first to N images in different periods.
In this embodiment, when at least two images of the first to nth images are displayed in a superimposed manner, at least two images of the first to nth images of the history three-dimensional medical image may be displayed in a superimposed manner, or at least two images of the first to nth images of the history of each of the plurality of history three-dimensional medical images may be displayed in a superimposed manner. Typically, at least two images from the first to nth images in the one-time history three-dimensional medical image closest to the three-dimensional medical image (current three-dimensional medical image) acquisition time are displayed by default superimposed. In practical application, at least two images from the first to the N-th images in several historical three-dimensional medical images in the plurality of historical three-dimensional medical images can be set to be displayed in a superimposed manner according to the requirements of doctors.
In the following, a description will be given of a response by taking, as an example, a first to third images in the current three-dimensional medical image are superimposed and displayed in response to the third operation, and a first to third images in the three historical three-dimensional medical images are respectively superimposed and displayed.
Referring to fig. 7, fig. 7 is a schematic diagram of a medical image under a history comparison mode according to an embodiment of the invention. When a doctor performs a third operation, such as clicking a fourth control crown mapping contrast (lung+focus+trachea), by clicking a history comparison mode control, a doctor responds to the third operation, and the first to third images corresponding to the chest CT of 29 months in 2020, the first to third images corresponding to the chest CT of 19 months in 2020, the first to third images corresponding to the chest CT of 27 months in 2020, and the first to third images corresponding to the chest CT of 7 months in 2020 are selected and displayed in a corresponding superimposed manner by the background. Through the coronal plane mapping (lung+focus+trachea) image in the history comparison mode shown in fig. 7, a doctor can clearly see the change of the focus size, the change of the position, the change of the density and the like. Specifically, as can be seen from fig. 7, at 1/7 of 2020, the lesion is localized to one lung lobe, the lesion density is low, at 1/27 of 2020, the lesion affects a plurality of lung lobes and the volume increases and the density increases. On day 19 and 2 in 2020, the lesion volume is further increased, the lesion density is further increased, and the lesions become solid. On 29 th year 2020, the focus density is reduced, the focus volume is reduced, and the disease condition is relieved.
In this embodiment, by displaying at least two images from the first to the N-th images in the three-dimensional medical images in different periods in a superimposed manner, a doctor can rapidly obtain the progress and change of the disease condition of the subject by comparing the images of the subject in different periods, know the severity of the disease condition, and improve the diagnosis efficiency of the doctor and the diagnosis accuracy.
Based on the same technical concept, the embodiment of the invention provides a computer device, which comprises at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor can execute the medical image generation method or the medical image display method.
Based on the same technical concept, embodiments of the present invention provide a computer-readable storage medium, which when executed by a processor within an apparatus, causes the apparatus to perform the above-described medical image generation method or the above-described medical image display method.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, or as a computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (6)
1. A method of generating a medical image, comprising:
Dividing the three-dimensional medical image to obtain first through N-th images of interest, wherein N is a natural number greater than or equal to 3;
projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
in response to a first operation, superimposing and displaying at least two images of the first to nth images;
the three-dimensional medical image includes a three-dimensional chest image, the first image of interest includes a lung parenchyma image, projecting the first image of interest along a first direction to obtain a first image includes: taking the gray value of the pixel with the smallest gray value in the pixel along the first direction in the first interested image as the gray value of the pixel projected in the first direction by the pixel along the first direction;
the three-dimensional medical image includes a three-dimensional chest image, the second image of interest includes a lesion image, projecting the second image of interest along a first direction to obtain a second image includes: taking the gray value of the pixel with the largest gray value in the pixel along the first direction in the second interested image as the gray value of the pixel projected in the first direction by the pixel along the first direction;
The three-dimensional medical image comprises a three-dimensional chest image, the third image of interest comprises an airway image, projecting the third image of interest along a first direction to obtain a third image comprises: taking an average value of gray values of pixels in the third interested image along the first direction as the gray value of the pixels projected in the first direction by the pixels in the first direction;
and respectively rendering the first to N colors for the first to N images.
2. The method of claim 1, wherein,
projecting the ith image of interest in a first direction to obtain the ith image includes: and taking the weighted average value of the gray values of the pixels in the first direction in the I-th image of interest as the gray value of the pixels projected in the first direction by the pixels in the first direction, wherein I is a natural number which is more than or equal to 1 and less than or equal to N.
3. The method as recited in claim 1, further comprising:
and hiding at least one image of the first to N-th images displayed in a superimposed manner in response to a second operation.
4. A method for displaying medical images, comprising:
In response to a third operation, at least two images of the first to N-th images are superimposed and displayed, and at least two images of the first to N-th historical images are correspondingly superimposed and displayed, wherein the first to N-th images are generated by:
segmenting the three-dimensional medical image to obtain first through N-th images of interest, wherein N is greater than or equal to 3;
projecting the first to nth images of interest along a first direction to obtain corresponding first to nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
the historical first through nth images are generated as follows:
dividing the historical three-dimensional medical image to obtain historical first to historical N-th interesting images, wherein N is more than or equal to 3;
projecting the historical first to historical nth images of interest along a first direction to obtain corresponding historical first to historical nth images, wherein the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a transverse plane;
wherein the three-dimensional medical image and the historical three-dimensional medical image are images of the same part of the same subject at different times;
The three-dimensional medical image includes a three-dimensional chest image, the first image of interest includes a lung parenchyma image, projecting the first image of interest along a first direction to obtain a first image includes: taking the gray value of the pixel with the smallest gray value in the pixel along the first direction in the first interested image as the gray value of the pixel projected in the first direction by the pixel along the first direction;
the three-dimensional medical image comprises a three-dimensional chest image, the second image of interest comprises a lesion image, projecting the second image of interest along a first direction to obtain a second image comprises: taking the gray value of the pixel with the largest gray value in the pixel along the first direction in the second interested image as the gray value of the pixel projected in the first direction by the pixel along the first direction;
the three-dimensional medical image comprises a three-dimensional chest image, the third image of interest comprises an airway image, projecting the third image of interest along a first direction to obtain a third image comprises: taking an average value of gray values of pixels in the third interested image along the first direction as the gray value of the pixels projected in the first direction by the pixels in the first direction;
And respectively rendering the first to N colors for the first to N images.
5. A medical image generation apparatus, comprising:
a segmentation unit for segmenting the three-dimensional medical image to obtain first to nth images of interest, wherein N is a natural number of 3 or more;
a mapping unit, configured to project the first to nth images of interest along a first direction to obtain corresponding first to nth images, where the first direction is any one direction of directions perpendicular to a coronal plane or a sagittal plane or a cross section;
a superimposing unit configured to superimpose and display at least two images among the first to nth images in response to a first operation;
the three-dimensional medical image includes a three-dimensional chest image, the first image of interest includes a lung parenchyma image, projecting the first image of interest along a first direction to obtain a first image includes: taking the gray value of the pixel with the smallest gray value in the pixel along the first direction in the first interested image as the gray value of the pixel projected in the first direction by the pixel along the first direction;
the three-dimensional medical image comprises a three-dimensional chest image, the second image of interest comprises a lesion image, projecting the second image of interest along a first direction to obtain a second image comprises: taking the gray value of the pixel with the largest gray value in the pixel along the first direction in the second interested image as the gray value of the pixel projected in the first direction by the pixel along the first direction;
The three-dimensional medical image comprises a three-dimensional chest image, the third image of interest comprises an airway image, projecting the third image of interest along a first direction to obtain a third image comprises: taking an average value of gray values of pixels in the third interested image along the first direction as the gray value of the pixels projected in the first direction by the pixels in the first direction;
and respectively rendering the first to N colors for the first to N images.
6. A computer readable storage medium, which when executed by a processor within a device, causes the device to perform a method of generating a medical image, or a method of displaying a medical image, the method comprising:
a method according to any one of claims 1 to 3; or alternatively
The method of claim 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010215361.3A CN111563877B (en) | 2020-03-24 | 2020-03-24 | Medical image generation method and device, medical image display method and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010215361.3A CN111563877B (en) | 2020-03-24 | 2020-03-24 | Medical image generation method and device, medical image display method and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111563877A CN111563877A (en) | 2020-08-21 |
| CN111563877B true CN111563877B (en) | 2023-09-26 |
Family
ID=72071479
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010215361.3A Active CN111563877B (en) | 2020-03-24 | 2020-03-24 | Medical image generation method and device, medical image display method and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111563877B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112185519A (en) * | 2020-09-01 | 2021-01-05 | 杭州依图医疗技术有限公司 | Medical image processing method and device and medical image display method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103914697A (en) * | 2012-12-29 | 2014-07-09 | 上海联影医疗科技有限公司 | Extraction method for region of interest of breast three-dimension image |
| CN109583440A (en) * | 2017-09-28 | 2019-04-05 | 北京西格码列顿信息技术有限公司 | It is identified in conjunction with image and reports the medical image aided diagnosis method edited and system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090309874A1 (en) * | 2008-06-11 | 2009-12-17 | Siemens Medical Solutions Usa, Inc. | Method for Display of Pre-Rendered Computer Aided Diagnosis Results |
| JP5606076B2 (en) * | 2010-01-08 | 2014-10-15 | 株式会社東芝 | Ultrasonic diagnostic apparatus, medical image processing apparatus, and medical image processing program |
-
2020
- 2020-03-24 CN CN202010215361.3A patent/CN111563877B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103914697A (en) * | 2012-12-29 | 2014-07-09 | 上海联影医疗科技有限公司 | Extraction method for region of interest of breast three-dimension image |
| CN109583440A (en) * | 2017-09-28 | 2019-04-05 | 北京西格码列顿信息技术有限公司 | It is identified in conjunction with image and reports the medical image aided diagnosis method edited and system |
Non-Patent Citations (2)
| Title |
|---|
| 杨鑫 ; 吴慧慧 ; 刘洋 ; 徐红卫 ; 梁华庚 ; 蔡文娟 ; 方梦捷 ; 王钰洁 ; 丁明跃 ; .基于三维超声图像的主颈动脉血管分割方法.中国医疗器械杂志.2013,(04),全文. * |
| 贾同 ; 赵大哲 ; 杨金柱 ; 王旭 ; .一种基于HRCT影像的肺结节计算机辅助检测方法.***仿真学报.2008,(14),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111563877A (en) | 2020-08-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6877868B2 (en) | Image processing equipment, image processing method and image processing program | |
| JP6080249B2 (en) | Three-dimensional image display apparatus and method, and program | |
| JP5687714B2 (en) | System and method for prostate visualization | |
| CN107563998B (en) | Method for processing heart image in medical image | |
| JP4728627B2 (en) | Method and apparatus for segmenting structures in CT angiography | |
| US7529396B2 (en) | Method, computer program product, and apparatus for designating region of interest | |
| CN105912874B (en) | Liver three-dimensional database system constructed based on DICOM medical image | |
| EP2896369B1 (en) | Device and method for displaying three-dimensional image, and program | |
| JP6031454B2 (en) | Method and apparatus for identifying latent anomalies in imaging data and its application to medical images | |
| CN111563876B (en) | Medical image acquisition method and medical image display method | |
| EP1995690A2 (en) | Generating an anatomical model using a rule-based segmentation and classification process | |
| EP2375379A2 (en) | Medical image processing apparatus and method, and computer readable recording medium on which is recorded program for the same | |
| WO2011122035A1 (en) | Projection image generation device, projection image generation programme, and projection image generation method | |
| JP2007202957A (en) | Wall motion measuring device and medical image diagnostic apparatus | |
| EP2401719B1 (en) | Methods for segmenting images and detecting specific structures | |
| CN109830289A (en) | Bone images display device | |
| CN107527341A (en) | The processing method and system of angiographic image | |
| JP2002078706A (en) | Computer-aided diagnosis method for supporting diagnosis of three-dimensional digital image data and program storage device | |
| US7868900B2 (en) | Methods for suppression of items and areas of interest during visualization | |
| WO2022105623A1 (en) | Intracranial vascular focus recognition method based on transfer learning | |
| CN102548480B (en) | Device and method for displaying medical image and program | |
| JP2006506163A (en) | Computer-aided detection of lung nodules | |
| CN111563877B (en) | Medical image generation method and device, medical image display method and storage medium | |
| Ropinski et al. | Multimodal vessel visualization of mouse aorta PET/CT scans | |
| JP4473578B2 (en) | Method and apparatus for forming an isolated visualized body structure |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220321 Address after: Room 705, building 8, No. 1818-2, Wenyi West Road, Yuhang District, Haidian District, Beijing 100089 Applicant after: BEIJING SHENRUI BOLIAN TECHNOLOGY Co.,Ltd. Applicant after: SHENZHEN DEEPWISE BOLIAN TECHNOLOGY Co.,Ltd. Address before: 200051 units 06 and 07, 23 / F, 523 Loushanguan Road, Changning District, Shanghai Applicant before: SHANGHAI YIZHI MEDICAL TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |