US20220036646A1 - Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic image - Google Patents
Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic image Download PDFInfo
- Publication number
- US20220036646A1 US20220036646A1 US17/497,980 US202117497980A US2022036646A1 US 20220036646 A1 US20220036646 A1 US 20220036646A1 US 202117497980 A US202117497980 A US 202117497980A US 2022036646 A1 US2022036646 A1 US 2022036646A1
- Authority
- US
- United States
- Prior art keywords
- dimensional
- blood vessel
- dimensional image
- image
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000004204 blood vessel Anatomy 0.000 title claims abstract description 188
- 238000000034 method Methods 0.000 title claims abstract description 79
- 230000003287 optical effect Effects 0.000 claims abstract description 79
- 238000012545 processing Methods 0.000 description 29
- 230000008569 process Effects 0.000 description 27
- 238000003384 imaging method Methods 0.000 description 16
- 239000002872 contrast media Substances 0.000 description 10
- 238000002583 angiography Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000002792 vascular Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000002347 injection Methods 0.000 description 5
- 239000007924 injection Substances 0.000 description 5
- 238000013500 data storage Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000007670 refining Methods 0.000 description 3
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000000747 cardiac effect Effects 0.000 description 2
- 238000007408 cone-beam computed tomography Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 210000000056 organ Anatomy 0.000 description 2
- 230000000241 respiratory effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- ZCYVEMRRCGMTRW-UHFFFAOYSA-N 7553-56-2 Chemical compound [I] ZCYVEMRRCGMTRW-UHFFFAOYSA-N 0.000 description 1
- 208000018152 Cerebral disease Diseases 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 208000029078 coronary artery disease Diseases 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013136 deep learning model Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 229910052740 iodine Inorganic materials 0.000 description 1
- 239000011630 iodine Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000002600 positron emission tomography Methods 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000002603 single-photon emission computed tomography Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 208000019553 vascular disease Diseases 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/50—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications
- A61B6/504—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment specially adapted for specific body parts; specially adapted for specific clinical applications for diagnosis of blood vessels, e.g. by angiography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/022—Stereoscopic imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/46—Arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/466—Displaying means of special interest adapted to display 3D data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/481—Diagnostic techniques involving the use of contrast agents
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
- A61B6/5235—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2211/00—Image generation
- G06T2211/40—Computed tomography
- G06T2211/404—Angiography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2016—Rotation, translation, scaling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
Definitions
- the present disclosure generally relates to image processing and analysis. More specifically, the present disclosure relates to a computer-implemented methods and devices for performing three-dimensional blood vessel reconstruction using a single-view angiographic image and refining the three-dimensional blood vessel reconstruction.
- Rotational two-dimensional (2D) X-ray angiographic images provide valuable geometric information on vascular structures for diagnoses of various vascular diseases, such as coronary artery diseases and cerebral diseases.
- a contrast agent usually an x-ray opaque material, such as iodine
- 3D vascular tree reconstruction using the 2D projection images is often beneficial to reveal the true 3D measurements, including diameters, curvatures and lengths, of various vessel segments of interests, for further functional assessments of the targeted vascular regions.
- Extant 3D reconstruction methods typically rely on 2D vessel structures segmented from multiple X-ray images from different imaging projection angles (such as a primary angle and a secondary angle). Usually, 2D vessel centerlines are first extracted from the segmented vessel regions, and 3D centerlines are then computed by establishing the proper projection imaging system geometry.
- One technical challenge presented by extant methods is the foreshortening issue.
- the vessel lengths are slightly different when viewed from different angles due to the nature of the projection imaging, causing foreshortening.
- foreshortening may be reduced by avoiding using images containing pronounced foreshortening vessel segments (represented with darker intensity) for 3D reconstruction.
- at least some level of foreshortening frequently occurs due to the curved geometrical nature of vessels and due to physiological motion of the patient during the imaging process (e.g., due to respiratory motion and cardiac motion).
- Embodiments of the disclosure address the above problems by systems and methods for improved three-dimensional blood vessel reconstructions.
- Embodiments of the present disclosure include computer-implemented methods and devices for performing three-dimensional blood vessel reconstruction using a single-view projection image and then refining the three-dimensional reconstruction based on optical path lengths of the blood vessel obtained through different approaches.
- the disclosure is directed to a computer-implemented method for performing three-dimensional blood vessel reconstruction.
- the computer-implemented method includes receiving a first two-dimensional image of a blood vessel of a patient, where the first two-dimensional image is a projection image acquired in a first projection direction.
- the method further includes reconstructing, by a processor, a three-dimensional model of the blood vessel based on at least the first two-dimensional image.
- the method additionally includes adjusting the three-dimensional model of the blood vessel, based on a comparison of a first optical path length determined from a second two-dimensional image of the blood vessel of the patient and a second optical path length determined from the three-dimensional model.
- the disclosure is further directed to a device for performing three-dimensional blood vessel reconstruction.
- the device includes an interface, which is configured to receive a first two-dimensional image of a blood vessel of a patient, where the first two-dimensional image is a projection image acquired in a first projection direction.
- the device further includes a processor, which is configured to reconstruct a three-dimensional model of the blood vessel based on at least the first two-dimensional image, and adjust the three-dimensional model of the blood vessel, based on a comparison of a first optical path length determined from a second two-dimensional image of the blood vessel of the patient and a second optical path length determined from the three-dimensional model.
- the disclosure is directed to a non-transitory computer-readable medium, having instructions stored thereon.
- the instructions when executed by a processor, perform a method for performing three-dimensional blood vessel reconstruction.
- the method includes receiving a first two-dimensional image of a blood vessel of a patient, where the first two-dimensional image is a projection image acquired in a first projection direction.
- the method further includes reconstructing a three-dimensional model of the blood vessel based on at least the first two-dimensional image.
- the method additionally includes adjusting the three-dimensional model of the blood vessel, based on a comparison of a first optical path length determined from a second two-dimensional image of the blood vessel of the patient and a second optical path length determined from the three-dimensional model
- the disclosed method and device can reduce the amount radiation exposure for doctor and patients. They also relax requirement for obtaining 3D vessel reconstruction, as it removes the stringent requirements for traditional multi-view reconstruction algorithm, which requires at least two projection views from sufficiently different angles that both show the target vessel clearly without overlapping with other nearby vessels. Reconstructing from a single-view projection image is also faster compared to multi-view reconstruction, which requires finding correspondence points among different views.
- the disclosed method and device may further make full use of the intensity (e.g., grayscale) distribution pattern of the two-dimensional vessel (when filled with contrast agent) which is normally neglected and three-dimensional projection path information implied therein, effectively reducing the foreshortening phenomenon in the three-dimensional reconstruction, thereby improving the reconstruction accuracy of three-dimensional vascular tree.
- the scheme of the present disclosure assists the reconstruction of the three-dimensional image by considering the image pixel intensity information, and improves the reconstruction accuracy.
- FIG. 1 shows a flowchart of an exemplary process for performing three-dimensional blood vessel reconstruction using one or more X-ray angiographic images according to an embodiment of the present disclosure.
- FIG. 2 illustrates an exemplary process for performing a single-view three-dimensional reconstruction according to an embodiment of the present disclosure.
- FIG. 3A illustrates an exemplary process for performing a single-view three-dimensional reconstruction using depth-based inference according to an embodiment of the present disclosure.
- FIG. 3B illustrates an exemplary process for performing a single-view three-dimensional reconstruction using model-based inference according to an embodiment of the present disclosure.
- FIG. 4 schematically shows an illustration of optical path length within a blood vessel at several positions in a three-dimensional blood vessel model according to an embodiment of the present disclosure, and its relationship with a grayscale value of corresponding position in a two-dimensional image.
- FIG. 5 illustrates a schematic diagram of a method of measuring an optical path length according to an embodiment of the present disclosure.
- FIG. 6 shows a linear relationship between the value at each position of the blood vessel and the length of optical path at the corresponding position.
- FIG. 7( a ) illustrates a first two-dimensional image I T .
- FIG. 7( b ) illustrates the estimated background image I B .
- FIG. 7( c ) illustrates the first processed image ln(I T ) ⁇ ln(I B ).
- FIG. 8 depicts a flowchart of an exemplary process 500 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images according to another embodiment of the present disclosure.
- FIG. 9 is a schematic diagram showing a three-dimensional reconstruction adjustment step in the embodiment of FIG. 8 .
- FIG. 10 depicts a flowchart of an exemplary process 700 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images according to yet another embodiment of the present disclosure.
- FIG. 11 is a schematic diagram showing a three-dimensional reconstruction adjustment step in the embodiment of FIG. 8 .
- FIG. 12 illustrates a block diagram of a device 900 for performing three-dimensional blood vessel reconstruction using one or more X-ray angiographic images.
- FIG. 13 illustrates a block diagram of a medical image processing device 1000 for performing three-dimensional blood vessel reconstruction using a single-view X-ray angiographic image.
- An “optical path” may be a geometric path of rays propagating within a subject (not a vacuum). Accordingly, an “optical path length” may be the length of a geometric path along which the rays propagate in the subject. Consistent with the disclosure, terms such as “first” and “second” are used, which can refer to the same or different components or items. For example, a “first two-dimensional image” and a “second two-dimensional image” can be the same or different images, and “first projection direction” and a “second projection direction” can be the same or different images.
- FIG. 1 shows a flowchart of an exemplary process 100 for performing three-dimensional blood vessel reconstruction using one or more X-ray angiographic images according to an embodiment of the present disclosure.
- the process 100 begins with step 101 : reconstructing a three-dimensional model of the blood vessel.
- reconstruction of a three-dimensional model of a blood vessel may be performed based on a first two-dimensional image acquired in a first projection direction (also referred to as a “single-view 2D image”). Accordingly, the three-dimensional reconstruction performed in step 101 may be a single-view three-dimensional reconstruction.
- the first two-dimensional image is an acquired two-dimensional image obtained by X-ray angiography of a blood vessel wherein transmitted X-rays are incident on a flat panel detector (CCD, CMOS, etc.).
- a pattern of the grayscale values in the two-dimensional image implies (encodes) three-dimensional projection path information.
- FIG. 2 illustrates an exemplary process 200 for performing the single-view three-dimensional reconstruction of step 101 according to an embodiment of the present disclosure.
- the process 200 contains two steps: a 3D information inference step 210 and a 3D model generation step 220 .
- the 3D information inference step 210 receives a single-view 2D image 201 and infers 3D information 203 necessary to reconstruct the 3D model of the blood vessel.
- the single-view 2D image 201 may be the two-dimensional image acquired in a single projection direction.
- the 3D information inference step 210 could be implemented by a depth-based reconstruction or a model-based reconstruction, or a hybrid of thereof.
- FIG. 3A illustrates an exemplary process 310 for performing a single-view three-dimensional reconstruction using depth-based inference according to an embodiment of the present disclosure
- FIG. 3B illustrates an exemplary process 320 for performing a single-view three-dimensional reconstruction using model-based inference according to an embodiment of the present disclosure.
- the 3D information 203 could be depth information 203 A on certain key points such as landmarks, centerline points, or dense points such as depth information for all pixel locations in the 2D single view image.
- process 310 may further include an optional key point detection step 311 for detecting these key points.
- the 3D information 203 could be model shape and pose parameters 203 B of a rigid or deformable model whose shape is controlled by a set of shape parameters, and projection specified by corresponding pose parameters.
- the 3D inference model estimates the shape parameter which determines the shape, and the pose parameter which determines the projection relationship.
- the 3D information inference step 210 can be performed by an inference learning model.
- the inference learning model may be a machine learning model or a deep learning model trained to infer the 3D information from a 2D projection image.
- the inference learning model can be trained using sample single-view images and their corresponding 3D model projection annotations.
- the 3D model projection annotation can be obtained in various ways.
- another modality from which the 3D model can be readily obtained For example, a 3D CT angiographic image can be obtained from which the 3D model can be constructed.
- the projection parameters can be derived from geometric parameters recorded by the imaging acquisition device (e.g., an imaging scanner). These parameters can also be refined by optimizing the alignment of projected 3D model and angiographic images.
- the 3D model projection annotation can be obtained using multi-view 3D model reconstruction algorithm.
- the 3D model projection annotation can also be synthetic data obtained by first rendering a 3D model and then projecting the 3D model to produce a synthetic single-view projection image using an image generator/renderer. The synthetic data could be realistic given a powerful image generator/renderer.
- human annotator can finetune annotations of 3D model and projection parameter.
- the 3D model generation step 220 receives the 3D information 203 and generates the 3D model and corresponding projection parameter 205 (such as rotation, distance, etc.) based on the 3D information 203 , e.g., the estimated depth information (e.g., FIG. 3A ) and/or the model shape and pose information (e.g., FIG. 3B ). Projecting the reconstructed 3D model according to the corresponding projection parameters matches the input single-view 2D image 201 .
- the 3D model could be represented in different forms, including a series of 3D centerline points with varying diameters, surface mesh or volumetric representation.
- the 3D information may be in the form of depth, i.e., distance from 3D point to the projected view image plane, for all or key pixels such as centerline in the single view projection image.
- the corresponding 3D model generation module reconstructs the 3D coordinates and model based on the (x, y) coordinate of each projected point and the corresponding depth, i.e., z coordinate.
- orthographic projection parallel projection
- the 3D information may be in the form of model shape parameters (such as the shape variation mode weights specified by the principal component analysis on training data), and pose parameters (such as rotation, and distance of the 3D model).
- model shape parameters such as the shape variation mode weights specified by the principal component analysis on training data
- pose parameters such as rotation, and distance of the 3D model.
- the process 100 may proceed to step 102 : acquiring a second two-dimensional image in a second projection direction of a blood vessel and the reconstructed three-dimensional model of the blood vessel.
- process 100 may skip step 101 and proceed directly to acquiring step 102 to acquire an already reconstructed three-dimensional model of the blood vessel from a stereoscopic imaging device.
- the first two-dimensional image i.e., the single-view 2D image
- the single-view 2D image may be reused as the second two-dimensional image referred to in the present disclosure.
- the first and second two-dimensional images are actually the same image, and the first and second projection directions are actually the same projection direction.
- the second two-dimensional image is a two-dimensional image captured by the imaging device, which is different from the first two-dimensional image based on which the three-dimensional model of the blood vessel is reconstructed.
- the imaging device captures two two-dimensional images in the first projection direction, and the second projection direction, respectively.
- One of the images e.g., the one acquired in the first projection direction
- the other image e.g., the second image obtained in the other direction (e.g., the second projection direction) serves as the second two-dimensional image mentioned in present disclosure.
- both the first and the second image may be used to reconstruct the three-dimensional model of a blood vessel as described in connection with step 101 (in which case, a multi-view reconstruction is performed), and one of the images may be used as the second two-dimensional image in step 102 .
- the imaging device captures two two-dimensional images in the first projection direction and captures one two-dimensional image in the second projection direction
- one of the two two-dimensional images in the first projection direction and the one two-dimensional image captured in the second projection direction may be used to reconstruct the three-dimensional model of the blood vessel in step 101
- the other two-dimensional image in the first projection direction may be used as the second two-dimensional image in step 102 .
- one image out of the obtained image sequences may serve as the second two-dimensional image.
- a simulated optical path length determining step 103 is performed.
- the simulated optical path length within the blood vessel at a position (i.e., at least one position) in the second projection direction may be determined based on the three-dimensional model of the blood vessel.
- the size at the position of the blood vessel in the second projection direction (a first X-ray transmission direction) in the three-dimensional model of the blood vessel may be determined as the simulated optical path length within the blood vessel at the corresponding position.
- the sizes x C1 , x C2 , . . . , and x Cn at multiple positions of the blood vessel in the second projection direction in the three-dimensional model of the blood vessel (three-dimensional geometry) may be measured. Then each of the measured sizes may be used as the optical path length within the blood vessel at the corresponding position.
- the simulated optical path length x C may be obtained by radius estimation.
- the direction pointed by the arrow is the second projection direction (beam direction).
- the three-dimensional model of the blood vessel is projected in the second projection direction to obtain a simulated two-dimensional projection image of the blood vessel three-dimensional model in the second projection direction.
- the diameter D of a certain segment of the blood vessel is measured, and the angle ⁇ between the center line of the segment of the blood vessel and the second projection direction is determined.
- the simulated optical path length x C of the segment of the blood vessel is calculated.
- reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted based on the simulated optical path length (x C1 , x C2 , . . . , and x Cn ) within the blood vessel at the position(s) in the second projection direction, intensity value at the corresponding position(s) of the blood vessel in the second two-dimensional image, and a relationship between intensity value at each position of a blood vessel in a second-dimensional image and an optical path length at the corresponding position.
- the adjusted reconstruction parameters may be utilized for three-dimension vessel reconstruction, so that a foreshortening of three-dimension vessel reconstruction may be rectified.
- embodiments of the present disclosure use grayscale values of the pixel to derive the optical path in the contrast agent (i.e., the optical path in the blood vessel) to infer the local vessel geometry.
- Equation (2) the relationship between x-ray attenuation and optical path in the contrast agent may be defined by following Equation (2).
- I T I I exp ⁇ [ - ( ⁇ C / ⁇ C ) ⁇ x C - ( ⁇ 0 / ⁇ 0 ) ⁇ x 0 ] Equation ⁇ ⁇ ( 2 )
- I I is the incident beam intensity
- I T is the transmitted beam intensity
- ⁇ / ⁇ is the mass attenuation coefficient
- x is the optical path.
- subscripts c and o represent contrast agent and organ (e.g., the vessel), respectively. In the absence of contrast agent, the x-ray beam absorption, due to the organ alone, is described by Equation (3).
- I B I I exp ⁇ [ - ( ⁇ 0 / ⁇ 0 ) ⁇ x 0 ] Equation ⁇ ⁇ ( 3 )
- I B is the transmitted beam intensity with only background.
- Equation (3) the relationship between the intensity of the light transmitted through the blood vessel at each position and the optical path length x C at the corresponding positions can be obtained, see Equation (4).
- I T I B exp ⁇ [ - ( ⁇ C / ⁇ C ) ⁇ x C ] Equation ⁇ ⁇ ( 4 )
- the light transmitted the blood vessel at each position thereof may be incident onto a flat panel detector, so as to obtain a gray-scale two-dimensional image.
- intensity value for example, gray value
- the conversion to grayscale does not destroy the described inherent relationship, so that the inherent relationship between the intensity of the light transmitted through the blood vessel at each position and the optical path length x C at the corresponding position is maintained between the intensity value at each position of the blood vessel in the two-dimensional image and the optical path length x C at the corresponding position.
- the reconstruction of the three-dimensional model can be guided by using the intensity values at the position(s) of the blood vessel in the two-dimensional images.
- the present disclosure considers the above relationship so that the reconstruction accuracy of the three-dimensional model can be improved.
- I T is used to denote the intensity value at position(s) of the blood vessel in the two-dimensional image
- I B is used to denote the background intensity at the corresponding position(s) of the blood vessel in the two-dimensional image.
- the reconstruction of the three-dimensional image may be assisted using the linear relationship between the processed intensity value at each position in the two-dimensional image and the optical path length x C at the corresponding position.
- the optical path length x C through the contrast agent is proportional to the processed image (i.e., that obtained by removing background from and logarithmically processing the image). That is, the value resulted by removing background and logarithmically processing the intensity value at each position of the blood vessel has a linear relationship with the optical path length x C at the corresponding position, as shown in FIG. 6 .
- the value resulted by removing background from and logarithmically processing the intensity value at each position of the blood vessel in a two-dimensional image may be obtained by the following steps: calculating the logarithm of the intensity value at each position of the blood vessel to obtain a first processed value ln(I T ); calculating the logarithm of background intensity value at each position of the blood vessel to obtain a second processed value ln(I B ); and subtracting the second processed value from the first processing value, so as to obtain the value resulted by removing background from and logarithmically processing the intensity value, ln(I T ) ⁇ ln(I B ).
- FIGS. 7( a ) to 7( c ) illustrate the image processing on how to obtain the value resulted by removing background from and logarithmically processing an intensity value at each position of a blood vessel in a two-dimensional image.
- FIG. 7( a ) illustrates a second two-dimensional image I T (e.g., an acquired X-ray angiographic image).
- FIG. 7( b ) illustrates for example a background image I B estimated for the second two-dimensional image I T by utilizing image inpainting technology.
- FIG. 7( c ) illustrates the first processed image resulted by removing background and logarithmically processing, ln(I T ) ⁇ ln(I B ).
- background may be estimated by methods such as image inpainting.
- the log signal of the background-removed image has a linear correlation with optical paths.
- the relationship between the intensity value at each position of the blood vessel in a two-dimensional image and the optical path length at the corresponding position may be established in advance, in previous angiography and three-dimensional reconstruction of the same patient under the same contrast injection conditions, or the relationship is established in advance for part of the blood vessel in the same angiography and three-dimensional reconstruction.
- the foreshortening phenomenon may be avoided or decreased for the part of blood vessel, which is easy to achieve.
- an accurate optical path length may be obtained by a reconstructed three-dimensional model based on the part of blood vessel, so that an accurate relationship between the intensity value at each position of the blood vessel in the two-dimensional image and the optical path lengths at the corresponding position may be established in advance.
- the relationship can be recalled directly in a subsequent application scenario that satisfies the same contrast agent injection conditions.
- the exemplary process 500 includes the following steps. It begins with an acquisition step 502 , wherein a reconstructed three-dimensional model of the blood vessel and a second two-dimensional image in the second projection direction corresponding thereto are acquired. Then, the process proceeds to a simulated light path length determining step 503 . At step 503 , the simulated optical path length within the blood vessel at position(s) in the second projection direction is determined based on the three-dimensional model of the blood vessel. After that, a three-dimensional reconstruction adjustment step is performed. With reference to both FIG. 8 and FIG. 9 , the three-dimensional reconstruction adjustment step may include the following steps 5041 ⁇ 5043 .
- a first processed image resulted by removing background from and logarithmically processing the second two-dimensional image may be calculated.
- the step of calculating the first processed image may include (not illustrated in the drawings): calculating the logarithm of an intensity value of each pixel of the second two-dimensional image to obtain a third logarithmically processed image; then, inpainting intensity values of the blood vessel portion in the second two-dimensional image based on intensity values of the background pixels of the periphery of the blood vessel portion; calculating the logarithm of an intensity value of each pixel of the imprinted second two-dimensional image, so as to obtain a fourth logarithmically processed image; and then subtracting the fourth logarithmically processed image from the third logarithmically processed image, so as to obtain the first processed image, which is exemplified by FIG. 7( c ) .
- the optical path length within the blood vessel at the position(s) may be estimated using the aforesaid linear relationship, which may be established in advance, based on the first processed image.
- the optical path length within the blood vessel at the position(s) may be compared with the determined simulated optical path length within the vessel blood at the corresponding position(s), and the size of the blood vessel at the corresponding position(s) in the second projection direction in the three-dimensional model thereof may be elongated based on the comparison.
- the step 5043 may include: determining difference between the optical path length within the blood vessel at the position(s) and the simulated optical path length at the corresponding position(s) of the blood vessel; providing a warning if the difference is greater than a first predetermined threshold, otherwise, elongating the size of the blood vessel at the corresponding position(s) in the X-ray transmitting direction in the three-dimensional model of the blood vessel based on the difference, so as to eliminate the difference.
- the first predetermined threshold may be a value preset empirically by a person skilled in the art, and this value is used to reflect the allowable degree of deviation of the reconstructed three-dimensional model. If the difference is greater than the first predetermined threshold, it means the deviation of the reconstructed three-dimensional model is relatively great, so a warning may be provided to draw the attention of a user (such as a surgeon or the like). Besides, if the difference is less than or equal to the first predetermined threshold, the size of the blood vessel at the corresponding position in the X-ray transmission direction in the three-dimensional model may directly modified (e.g., elongated) to eliminate the difference, thereby generating a calibrated blood vessel three-dimensional model.
- FIG. 20 a flowchart of an exemplary process 700 for performing three-dimensional blood vessel reconstruction using X-ray angiography images according to yet another embodiment of the present disclosure is described.
- the exemplary process 700 includes the following steps.
- a reconstructed three-dimensional model of a blood vessel and a second two-dimensional image in the second projection direction corresponding thereto may be acquired.
- a simulated light path length determining step 703 is performed.
- simulated optical path length within the blood vessel at position(s) in the second projection direction may be determined based on the three-dimensional model of the blood vessel.
- the three-dimensional reconstruction adjustment step includes the following steps 7041 ⁇ 7043 .
- a first processed image resulted by removing background from and logarithmically processing the second two-dimensional image may be calculated.
- the process of calculating the first processed image may be performed as in the exemplary process 500 .
- the second processed image resulted by removing the background from and logarithmically processing a simulated two-dimensional projection image may be estimated using the linear relationship based on the determined simulated optical path length, wherein the simulated two-dimensional projection image is obtained by projecting the three-dimensional model of the blood vessel in the second projection direction. That is, according to the simulated optical path length and the linear relationship, processed (including background removing and logarithmically processing) intensity values may be obtained for corresponding position of the blood vessel (more specifically, each pixel point of the blood vessel region).
- the first processed image may be compared with the second processed image, and the reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted based on the comparison.
- the adjusted reconstruction parameters may be used to perform three-dimensional blood vessel reconstruction using the X-ray angiographic images.
- the pixel value (i.e., the processed intensity value) at each pixel position of the first processed image may be compared with the processed intensity value at the corresponding pixel position of the second processed image, and the reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted based on the comparison. And three-dimensional vessel model reconstruction may be performed using the adjusted reconstruction parameters.
- the cost function is set as the difference obtained by the above comparison, and the reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted by minimizing the cost function.
- steps of the three-dimensional vessel reconstruction and reconstruction parameters may be performed iteratively, the cost function may be calculated and fed into an optimizer to update the reconstruction parameters and the corresponding three-dimensional blood vessel tree geometry (i.e., generating a calibrated three-dimensional model of a blood vessel).
- the reconstruction parameters can be gradually updated using a Newton iteration method or the like until optimized reconstruction parameters are obtained.
- the optimized reconstruction parameters may be used to reconstruct an accurate three-dimensional model of the blood vessel.
- step 7043 may include: determining a difference between the first processed image and the second processed image; providing a warning if the difference is greater than a second predetermined threshold, otherwise, adjusting the reconstruction parameters of the three-dimensional model of the blood vessel based on the comparison, so as to eliminate the difference.
- the second predetermined threshold may be a value preset empirically by a person skilled in the art, which reflects the allowable degree of deviation of the reconstructed three-dimensional model. If the difference is greater than the second predetermined threshold, the deviation of the reconstructed three-dimensional model is considered as relatively great, so a warning is provided to draw the attention of the user (such as a surgeon or the like), and if the difference is less than or equal to the second predetermined threshold, the reconstruction parameters of the three-dimensional model of the blood vessel may be directly adjusted, thus adjusting the corresponding three-dimensional geometry of the vessel tree.
- FIG. 12 illustrates a block diagram of a device 900 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images.
- the device 900 comprises: a three-dimensional model reconstruction unit 901 configured to reconstruct a 3D model of the blood vessel from a first two-dimensional image acquired in a first projection direction (i.e., the single-view projection image); an acquisition unit 902 , which is configured to acquire a second two-dimensional image in the second projection direction and the reconstructed three-dimensional model of the blood vessel reconstructed by the three-dimensional model reconstruction unit 901 ; a simulated light path length determining unit 903 , which is configured to determine simulated optical path length within the blood vessel at position(s) of the blood vessel in the second projection direction based on the three-dimensional model of the blood vessel; and a three-dimensional reconstruction adjustment unit 904 , which is configured to adjust reconstruction parameters of the three-dimensional model of the blood vessel, based on the simulated optical path length within the blood vessel at the position(s) in the second projection direction
- the acquisition unit 902 may acquire a vascular medical image from the medical image database 935 .
- the acquired vascular medical image may include a three-dimensional model of the blood vessel and/or a second two-dimensional image in the second projection direction corresponding to the three-dimensional model of the blood vessel.
- the acquiring unit 902 can directly acquire the three-dimensional model of a blood vessel and/or a second two-dimensional image corresponding to the three-dimensional model of the blood vessel in the second projection direction from an external device such as a medical image acquisition device (not shown).
- the acquisition unit 902 may acquire the above model and/or image from an image data storage device (not shown).
- the acquisition unit 902 can acquire the required models and images from at least two of the above sources.
- device 900 may further include a three-dimensional model reconstruction unit 901 .
- the three-dimensional model reconstruction unit 901 is configured to generate a reconstructed blood vessel three-dimensional model based on a single-view projection image (for example, the second two-dimensional image in the second projection direction may be used).
- the three-dimensional model reconstruction unit 901 may be connected to any one of the medical image database 935 , the image acquisition device, and the image data storage device, so as to acquire the two-dimensional image(s) based on which the reconstruction is performed.
- the acquisition unit 902 may acquire the reconstructed three-dimensional model of a blood vessel from the three-dimensional model reconstructing unit 901 .
- the acquisition unit 902 may also acquire, from the three-dimensional model reconstructing unit 901 , the first two-dimensional images, based on which the blood vessel three-dimensional model is reconstructed, and the device 900 may use the first two-dimensional image as the second two-dimensional image.
- the acquisition unit 902 transmits the acquired three-dimensional model of the blood vessel and the corresponding second two-dimensional image in the second projection direction to the simulated optical path length determining unit 903 .
- the simulated optical path length determination unit 903 transmits the determined simulation optical path length to the three-dimensional reconstruction adjustment unit 904 , so that it may adjust reconstruction parameters of the three-dimensional model of the blood vessel, based on the simulated optical path length within the blood vessel at position(s) thereof in the second projection direction, intensity value at the corresponding position(s) of the blood vessel on the second two-dimensional image, and a relationship between intensity value at each position of a blood vessel in a second-dimensional image and optical path length at the corresponding positions.
- the adjusted reconstruction parameters may be adopted to reconstruct the three-dimensional blood vessel model using X-ray angiographic images.
- the three-dimensional reconstruction adjustment unit 904 may output a calibrated three-dimensional model of a blood vessel.
- FIG. 13 illustrates a block diagram of a medical image processing device 1000 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images.
- the medical image processing device 1000 may include a network interface 1001 by which the device 1000 may be connected to a network (not shown) such as, but not limited to, a local area network in a hospital or the Internet.
- the network may connect the device 1000 with an external device such as an image acquisition device (not shown), a medical image database 2000 , and an image data storage device 3000 .
- the devices and methods disclosed in the embodiments may be implemented using a computer device.
- the medical image processing device 1000 may be a dedicated smart device or a general-purpose smart device.
- the medical image processing device 1000 may be a computer customized for image data acquisition and image data processing tasks, or a server placed in the cloud.
- the device 1000 may be integrated into an image acquisition device.
- the device may include or cooperate with a three-dimensional model reconstruction unit for generating a reconstructed three-dimensional model based on the two-dimensional images acquired by the image acquisition device.
- the medical image processing device 1000 may include an image processor 1002 and a memory 1003 , and may additionally include at least one of an input/output 1004 and an image display 1005 .
- the image processor 1002 may be a processing device including one or more general-purpose processing devices such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), and the like. More specifically, the image processor 1002 may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor that runs a combination of instruction sets.
- the image processor 1002 may also be one or more dedicated processing devices such as application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), digital signal processors (DSPs), system-on-chip (SoCs), and the like.
- ASICs application specific integrated circuits
- FPGAs field programmable gate arrays
- DSPs digital signal processors
- SoCs system-on-chip
- the image processor 1002 may be a special-purpose processor, rather than a general-purpose processor.
- the image processor 1002 may include one or more known processing devices, such as a microprocessor from the PentiumTM, CoreTM XeonTM, or Itanium® family manufactured by IntelTM, the TurionTM, AthlonTM, SempronTM OpteronTM, FXTM, PhenomTM family manufactured by AIVIDTM, or any of various processors manufactured by Sun Microsystems.
- the image processor 1002 may also include graphical processing units such as a GPU from the GeForce®, Quadro®, Tesla® family manufactured by NvidiaTM, GMA, IrisTM family manufactured by IntelTM, or the RadeonTM family manufactured by AMDTM.
- the image processor 1002 may also include accelerated processing units such as the Desktop A-4 (6, 8) Series manufactured by AIVIDTM, the Xeon PhiTM family manufactured by IntelTM.
- processors are not limited to any type of processor(s) or processor circuits otherwise configured to meet the computing demands of identifying, analyzing, maintaining, generating, and/or providing large amounts of imaging data or manipulating such imaging data to calibrate a three-dimensional vessel model or to manipulate any other type of data consistent with the disclosed embodiments.
- processor or “image processor” may include more than one processor, for example, a multi-core design or a plurality of processors each having a multi-core design.
- the image processor 1002 can execute sequences of computer program instructions, stored in memory 1003 , to perform various operations, processes, methods disclosed herein.
- the image processor 1002 may be communicatively coupled to the memory 1003 and configured to execute computer-executable instructions stored therein.
- the memory 1003 may include a read only memory (ROM), a flash memory, random access memory (RAM), a dynamic random-access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM, a static memory (e.g., flash memory, static random-access memory), etc., on which computer executable instructions are stored in any format.
- the memory 1003 may store computer-executable instructions of one or more image processing program(s) 923 and the data generated when the image processing program(s) are performed.
- the computer program instructions can be accessed by the image processor 1002 , read from the ROM, or any other suitable memory location, and loaded in the RAM for execution by the image processor 1002 , so as to implement each step of above methods.
- the image processor 1002 may also send/receive medical image data to/from storage 1003 .
- memory 1003 may store one or more software applications.
- Software applications stored in the memory 1003 may include, for example, an operating system (not shown) for common computer systems as well as for soft-controlled devices.
- memory 1003 may store an entire software application or only a part of a software application (e.g., the image processing program (s) 923 ) to be executable by the image processor 1002 .
- the image processing program 923 may include the simulated optical path length determining unit 903 and the three-dimensional reconstruction adjustment unit 904 shown in FIG. 12 as software units, for implementing each step of the method or process of three-dimensional reconstruction using X-ray angiographic images consistent with the present disclosure.
- the image processing program 923 may also include the three-dimensional model reconstructing unit 901 shown in FIG. 12 as a software unit.
- the memory 1003 may store data generated/cached when the computer program is executed, such as medical image data 1006 , which includes medical images transmitted from an image acquisition device, the medical image database 2000 , the image data storage device 3000 , and the like.
- Such medical image data 1006 may include a received three-dimensional vessel model to be calibrated and the two-dimensional angiographic images corresponding thereto.
- the medical image data 1006 may also include any one of a calibrated three-dimensional vessel model, the difference on the optical path length, and the adjusted reconstruction parameters.
- the image processor 1002 may execute an image processing program 923 to implement a method for three-dimensional vessel reconstruction using X-ray angiographic images.
- the image processor 1002 may associate the acquired reconstructed blood vessel three-dimensional model with the adjusted reconstruction parameters and the generated calibrated blood vessel three-dimensional model and store them in memory 1003 .
- the image processor 1002 may associate the acquired reconstructed blood vessel three-dimensional model with the adjusted reconstruction parameters and the generated calibrated blood vessel three-dimensional model and send them to the medical image database 2000 via the network interface 1001 .
- the device may include one or more processors and one or more memory devices.
- the processor(s) and storage device(s) may be configured in a centralized or distributed manner.
- the device 1000 may include one or more digital and/or analog communication device (input/output 1004 ).
- the input/output 1004 may include a keyboard and a mouse that allow the user to provide an input.
- the Network interface 1001 may include a network adapter, a cable connector, a serial connector, a USB connector, a parallel connector, a high-speed data transmission adapter such as optical fiber, USB 3.0, lightning, a wireless network adapter such as a WiFi adapter, a telecommunication (3G, 4G/LTE, etc.) adapters.
- the network may provide the functionality of local area network (LAN), a wireless network, a cloud computing environment (e.g., software as a service, platform as a service, infrastructure as a service, etc.), a client-server, a wide area network (WAN), and the like.
- the device 1000 may further include an image display 1005 .
- the image display 1005 may be any display device suitable for displaying a vascular angiographic image(s) and the three-dimensional reconstruction results.
- the image display 1005 may be an LCD, CRT, or LED display.
- Various operations or functions are described herein that may be implemented as software code or instructions or as software code or instructions. Such content may be directly executable source code or difference code (“incremental” or “block” code) (“object” or “executable” form).
- the software codes or instructions may be stored in a computer-readable storage medium and, when executed, may cause the machine to perform the described functions or operations and include any mechanism for storing information in a form accessible by the machine (e.g., computing devices, electronic systems, etc.), such as recordable or non-recordable media (e.g., read-only memory (ROM), random access memory (RAM), disk storage media, optical storage media, flash memory devices, etc.).
- imaging modalities in the disclosed systems and methods may be alternatively or additionally applied to other imaging modalities where the pixel intensity varies with the distance traveled by imaging particles, such as CT, cone beam computed tomography (CBCT), Spiral CT, positron emission tomography (PET), single-photon emission computed tomography (SPECT), etc.
- CT cone beam computed tomography
- Spiral CT positron emission tomography
- PET positron emission tomography
- SPECT single-photon emission computed tomography
- the phrase “A, B, C, and/or D” includes A, B, C, and D individually, but also includes any and all combinations and combinations of A, B, C, and D.
- the computer-readable medium may include volatile or non-volatile, magnetic, semiconductor, tape, optical, removable, non-removable, or other types of computer-readable medium or computer-readable storage devices.
- the computer-readable medium may be the storage device or the memory module having the computer instructions stored thereon, as disclosed.
- the computer-readable medium may be a disc or a flash drive having the computer instructions stored thereon.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Veterinary Medicine (AREA)
- Radiology & Medical Imaging (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Molecular Biology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Pathology (AREA)
- High Energy & Nuclear Physics (AREA)
- Optics & Photonics (AREA)
- Biophysics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Dentistry (AREA)
- Vascular Medicine (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Quality & Reliability (AREA)
- Architecture (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Geometry (AREA)
- Robotics (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
Description
- The present application is a continuation-in-part of U.S. application Ser. No. 16/895,573, filed Jun. 8, 2020, which is a continuation of U.S. application Ser. No. 16/106,077, filed Aug. 21, 2018, which claims the benefits of priority to U.S. Provisional Application No. 62/592,595, filed Nov. 30, 2017, now U.S. Pat. No. 10,709,399. The present application further claims the benefits of priority to U.S. Provisional Application No. 63/248,999, filed Sep. 27, 2021. The contents of all these applications are incorporated herein by reference in their entireties. The application further incorporates by reference the content of U.S. Provisional Application No. 62/591,437, filed Nov. 28, 2017.
- The present disclosure generally relates to image processing and analysis. More specifically, the present disclosure relates to a computer-implemented methods and devices for performing three-dimensional blood vessel reconstruction using a single-view angiographic image and refining the three-dimensional blood vessel reconstruction.
- Rotational two-dimensional (2D) X-ray angiographic images provide valuable geometric information on vascular structures for diagnoses of various vascular diseases, such as coronary artery diseases and cerebral diseases. After a contrast agent (usually an x-ray opaque material, such as iodine) is injected into the vessel, the image contrast of the vessel regions is generally enhanced. Three-dimensional (3D) vascular tree reconstruction using the 2D projection images is often beneficial to reveal the true 3D measurements, including diameters, curvatures and lengths, of various vessel segments of interests, for further functional assessments of the targeted vascular regions.
- Extant 3D reconstruction methods typically rely on 2D vessel structures segmented from multiple X-ray images from different imaging projection angles (such as a primary angle and a secondary angle). Usually, 2D vessel centerlines are first extracted from the segmented vessel regions, and 3D centerlines are then computed by establishing the proper projection imaging system geometry. One technical challenge presented by extant methods is the foreshortening issue. The vessel lengths are slightly different when viewed from different angles due to the nature of the projection imaging, causing foreshortening. Generally, foreshortening may be reduced by avoiding using images containing pronounced foreshortening vessel segments (represented with darker intensity) for 3D reconstruction. However, at least some level of foreshortening frequently occurs due to the curved geometrical nature of vessels and due to physiological motion of the patient during the imaging process (e.g., due to respiratory motion and cardiac motion).
- Embodiments of the disclosure address the above problems by systems and methods for improved three-dimensional blood vessel reconstructions.
- Embodiments of the present disclosure include computer-implemented methods and devices for performing three-dimensional blood vessel reconstruction using a single-view projection image and then refining the three-dimensional reconstruction based on optical path lengths of the blood vessel obtained through different approaches.
- In one aspect, the disclosure is directed to a computer-implemented method for performing three-dimensional blood vessel reconstruction. The computer-implemented method includes receiving a first two-dimensional image of a blood vessel of a patient, where the first two-dimensional image is a projection image acquired in a first projection direction. The method further includes reconstructing, by a processor, a three-dimensional model of the blood vessel based on at least the first two-dimensional image. The method additionally includes adjusting the three-dimensional model of the blood vessel, based on a comparison of a first optical path length determined from a second two-dimensional image of the blood vessel of the patient and a second optical path length determined from the three-dimensional model.
- In another aspect, the disclosure is further directed to a device for performing three-dimensional blood vessel reconstruction. The device includes an interface, which is configured to receive a first two-dimensional image of a blood vessel of a patient, where the first two-dimensional image is a projection image acquired in a first projection direction. The device further includes a processor, which is configured to reconstruct a three-dimensional model of the blood vessel based on at least the first two-dimensional image, and adjust the three-dimensional model of the blood vessel, based on a comparison of a first optical path length determined from a second two-dimensional image of the blood vessel of the patient and a second optical path length determined from the three-dimensional model.
- In yet another embodiment, the disclosure is directed to a non-transitory computer-readable medium, having instructions stored thereon. The instructions, when executed by a processor, perform a method for performing three-dimensional blood vessel reconstruction. The method includes receiving a first two-dimensional image of a blood vessel of a patient, where the first two-dimensional image is a projection image acquired in a first projection direction. The method further includes reconstructing a three-dimensional model of the blood vessel based on at least the first two-dimensional image. The method additionally includes adjusting the three-dimensional model of the blood vessel, based on a comparison of a first optical path length determined from a second two-dimensional image of the blood vessel of the patient and a second optical path length determined from the three-dimensional model
- Capable of using only one projection view to perform the initial reconstruction of a 3D vessel model, the disclosed method and device can reduce the amount radiation exposure for doctor and patients. They also relax requirement for obtaining 3D vessel reconstruction, as it removes the stringent requirements for traditional multi-view reconstruction algorithm, which requires at least two projection views from sufficiently different angles that both show the target vessel clearly without overlapping with other nearby vessels. Reconstructing from a single-view projection image is also faster compared to multi-view reconstruction, which requires finding correspondence points among different views.
- By using the same or another projection image to further refine the 3D model, the disclosed method and device may further make full use of the intensity (e.g., grayscale) distribution pattern of the two-dimensional vessel (when filled with contrast agent) which is normally neglected and three-dimensional projection path information implied therein, effectively reducing the foreshortening phenomenon in the three-dimensional reconstruction, thereby improving the reconstruction accuracy of three-dimensional vascular tree. The scheme of the present disclosure assists the reconstruction of the three-dimensional image by considering the image pixel intensity information, and improves the reconstruction accuracy.
- It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
- In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. Like numerals having different letter suffixes may represent different instances of similar components. The drawings illustrate generally, by way of example, but not by way of limitation, various embodiments, and together with the description and claims, serve to explain the disclosed embodiments. When appropriate, the same reference numbers are used throughout the drawings to refer to the same or like parts. Such embodiments are demonstrative and not intended to be exhaustive or exclusive embodiments of the present method, device, or non-transitory computer readable medium having instructions thereon for implementing the method.
-
FIG. 1 shows a flowchart of an exemplary process for performing three-dimensional blood vessel reconstruction using one or more X-ray angiographic images according to an embodiment of the present disclosure. -
FIG. 2 illustrates an exemplary process for performing a single-view three-dimensional reconstruction according to an embodiment of the present disclosure. -
FIG. 3A illustrates an exemplary process for performing a single-view three-dimensional reconstruction using depth-based inference according to an embodiment of the present disclosure. -
FIG. 3B illustrates an exemplary process for performing a single-view three-dimensional reconstruction using model-based inference according to an embodiment of the present disclosure. -
FIG. 4 schematically shows an illustration of optical path length within a blood vessel at several positions in a three-dimensional blood vessel model according to an embodiment of the present disclosure, and its relationship with a grayscale value of corresponding position in a two-dimensional image. -
FIG. 5 illustrates a schematic diagram of a method of measuring an optical path length according to an embodiment of the present disclosure. -
FIG. 6 shows a linear relationship between the value at each position of the blood vessel and the length of optical path at the corresponding position. -
FIG. 7(a) illustrates a first two-dimensional image IT. -
FIG. 7(b) illustrates the estimated background image IB. -
FIG. 7(c) illustrates the first processed image ln(IT)−ln(IB). -
FIG. 8 depicts a flowchart of an exemplary process 500 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images according to another embodiment of the present disclosure. -
FIG. 9 is a schematic diagram showing a three-dimensional reconstruction adjustment step in the embodiment ofFIG. 8 . -
FIG. 10 depicts a flowchart of an exemplary process 700 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images according to yet another embodiment of the present disclosure. -
FIG. 11 is a schematic diagram showing a three-dimensional reconstruction adjustment step in the embodiment ofFIG. 8 . -
FIG. 12 illustrates a block diagram of adevice 900 for performing three-dimensional blood vessel reconstruction using one or more X-ray angiographic images. -
FIG. 13 illustrates a block diagram of a medicalimage processing device 1000 for performing three-dimensional blood vessel reconstruction using a single-view X-ray angiographic image. - Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
- This description may use the phrases “in one embodiment,” “in another embodiment,” “in yet another embodiment,” or “in other embodiments,” all referring to one or more of the same or different embodiments in the present disclosure. Moreover, an element which appears in a singular form in the specific embodiments do not exclude that it may appear in a plurality (multiple) form. An “optical path” may be a geometric path of rays propagating within a subject (not a vacuum). Accordingly, an “optical path length” may be the length of a geometric path along which the rays propagate in the subject. Consistent with the disclosure, terms such as “first” and “second” are used, which can refer to the same or different components or items. For example, a “first two-dimensional image” and a “second two-dimensional image” can be the same or different images, and “first projection direction” and a “second projection direction” can be the same or different images.
-
FIG. 1 shows a flowchart of anexemplary process 100 for performing three-dimensional blood vessel reconstruction using one or more X-ray angiographic images according to an embodiment of the present disclosure. Theprocess 100 begins with step 101: reconstructing a three-dimensional model of the blood vessel. In some embodiments, reconstruction of a three-dimensional model of a blood vessel may be performed based on a first two-dimensional image acquired in a first projection direction (also referred to as a “single-view 2D image”). Accordingly, the three-dimensional reconstruction performed instep 101 may be a single-view three-dimensional reconstruction. The first two-dimensional image is an acquired two-dimensional image obtained by X-ray angiography of a blood vessel wherein transmitted X-rays are incident on a flat panel detector (CCD, CMOS, etc.). A pattern of the grayscale values in the two-dimensional image implies (encodes) three-dimensional projection path information. -
FIG. 2 illustrates anexemplary process 200 for performing the single-view three-dimensional reconstruction ofstep 101 according to an embodiment of the present disclosure. Theprocess 200 contains two steps: a 3Dinformation inference step 210 and a 3Dmodel generation step 220. The 3Dinformation inference step 210 receives a single-view 2D image3D information 203 necessary to reconstruct the 3D model of the blood vessel. The single-view 2D image - In some embodiments, the 3D
information inference step 210 could be implemented by a depth-based reconstruction or a model-based reconstruction, or a hybrid of thereof. For example,FIG. 3A illustrates anexemplary process 310 for performing a single-view three-dimensional reconstruction using depth-based inference according to an embodiment of the present disclosure, andFIG. 3B illustrates anexemplary process 320 for performing a single-view three-dimensional reconstruction using model-based inference according to an embodiment of the present disclosure. For the depth-based reconstruction such as shown inFIG. 3A , the3D information 203 could bedepth information 203A on certain key points such as landmarks, centerline points, or dense points such as depth information for all pixel locations in the 2D single view image. In some embodiments,process 310 may further include an optional keypoint detection step 311 for detecting these key points. For the model-based reconstruction such as shown inFIG. 3B , the3D information 203 could be model shape and poseparameters 203B of a rigid or deformable model whose shape is controlled by a set of shape parameters, and projection specified by corresponding pose parameters. In this case, the 3D inference model estimates the shape parameter which determines the shape, and the pose parameter which determines the projection relationship. - In some embodiments, the 3D
information inference step 210 can be performed by an inference learning model. The inference learning model may be a machine learning model or a deep learning model trained to infer the 3D information from a 2D projection image. The inference learning model can be trained using sample single-view images and their corresponding 3D model projection annotations. The 3D model projection annotation can be obtained in various ways. In some embodiments, another modality from which the 3D model can be readily obtained. For example, a 3D CT angiographic image can be obtained from which the 3D model can be constructed. The projection parameters can be derived from geometric parameters recorded by the imaging acquisition device (e.g., an imaging scanner). These parameters can also be refined by optimizing the alignment of projected 3D model and angiographic images. In some embodiments, the 3D model projection annotation can be obtained using multi-view 3D model reconstruction algorithm. In some embodiments, the 3D model projection annotation can also be synthetic data obtained by first rendering a 3D model and then projecting the 3D model to produce a synthetic single-view projection image using an image generator/renderer. The synthetic data could be realistic given a powerful image generator/renderer. In yet some embodiments, human annotator can finetune annotations of 3D model and projection parameter. - Returning to
FIG. 2 , the 3Dmodel generation step 220 receives the3D information 203 and generates the 3D model and corresponding projection parameter 205 (such as rotation, distance, etc.) based on the3D information 203, e.g., the estimated depth information (e.g.,FIG. 3A ) and/or the model shape and pose information (e.g.,FIG. 3B ). Projecting the reconstructed 3D model according to the corresponding projection parameters matches the input single-view 2D image - Accordingly, for depth-based inference (e.g.,
FIG. 3A ), the 3D information may be in the form of depth, i.e., distance from 3D point to the projected view image plane, for all or key pixels such as centerline in the single view projection image. The corresponding 3D model generation module reconstructs the 3D coordinates and model based on the (x, y) coordinate of each projected point and the corresponding depth, i.e., z coordinate. Although orthographic projection (parallel projection) is assumed here, it is contemplated that it could be easily extended to the perspective projection, in which the depth is along the projection ray. - For deformable model-based inference (e.g.,
FIG. 3B ), the 3D information may be in the form of model shape parameters (such as the shape variation mode weights specified by the principal component analysis on training data), and pose parameters (such as rotation, and distance of the 3D model). The corresponding 3D model generation module then reconstructs the 3D model from the shape parameters and pose parameters. - The
process 100 may proceed to step 102: acquiring a second two-dimensional image in a second projection direction of a blood vessel and the reconstructed three-dimensional model of the blood vessel. In some embodiments,process 100 may skipstep 101 and proceed directly to acquiringstep 102 to acquire an already reconstructed three-dimensional model of the blood vessel from a stereoscopic imaging device. - In some embodiments, the first two-dimensional image (i.e., the single-
view 2D image) based on which the blood vessel three-dimensional model is reconstructed may be also used as the second two-dimensional image. That is, the single-view 2D image may be reused as the second two-dimensional image referred to in the present disclosure. In that case, the first and second two-dimensional images are actually the same image, and the first and second projection directions are actually the same projection direction. By using the single-view projection image as both the image for initial reconstruction of the 3D model (step 101) and the image for refining the reconstructed 3D model (steps 103 and 104), the entire reconstruction process requires only one projection image acquired from a single projection direction. Accordingly, radiation exposure can be reduced, image acquisition is simplified, and reconstruction can be faster. - In other embodiments, the second two-dimensional image is a two-dimensional image captured by the imaging device, which is different from the first two-dimensional image based on which the three-dimensional model of the blood vessel is reconstructed. For example, when the imaging device captures two two-dimensional images in the first projection direction, and the second projection direction, respectively. One of the images (e.g., the one acquired in the first projection direction) may be used to reconstruct the three-dimensional model of a blood vessel as described in connection with
step 101, and the other image (e.g., the second image) obtained in the other direction (e.g., the second projection direction) serves as the second two-dimensional image mentioned in present disclosure. In some alternative embodiments, both the first and the second image may be used to reconstruct the three-dimensional model of a blood vessel as described in connection with step 101 (in which case, a multi-view reconstruction is performed), and one of the images may be used as the second two-dimensional image instep 102. In yet some alternative embodiments, when the imaging device captures two two-dimensional images in the first projection direction and captures one two-dimensional image in the second projection direction, one of the two two-dimensional images in the first projection direction and the one two-dimensional image captured in the second projection direction may be used to reconstruct the three-dimensional model of the blood vessel instep 101, and the other two-dimensional image in the first projection direction may be used as the second two-dimensional image instep 102. In addition, for example, when the imaging device continuously captures a two-dimensional image in at least one or more projection directions, one image out of the obtained image sequences may serve as the second two-dimensional image. - After the
acquisition step 102 is completed, a simulated optical pathlength determining step 103 is performed. Atstep 103, the simulated optical path length within the blood vessel at a position (i.e., at least one position) in the second projection direction may be determined based on the three-dimensional model of the blood vessel. - In one embodiment, the size at the position of the blood vessel in the second projection direction (a first X-ray transmission direction) in the three-dimensional model of the blood vessel may be determined as the simulated optical path length within the blood vessel at the corresponding position.
- For example, as shown in
FIG. 4 , the sizes xC1, xC2, . . . , and xCn at multiple positions of the blood vessel in the second projection direction in the three-dimensional model of the blood vessel (three-dimensional geometry) may be measured. Then each of the measured sizes may be used as the optical path length within the blood vessel at the corresponding position. - In another embodiment, the simulated optical path length xC may be obtained by radius estimation. As shown in
FIG. 5 , the direction pointed by the arrow is the second projection direction (beam direction). Firstly, the three-dimensional model of the blood vessel is projected in the second projection direction to obtain a simulated two-dimensional projection image of the blood vessel three-dimensional model in the second projection direction. Then, according to the simulated two-dimensional projection image, the diameter D of a certain segment of the blood vessel is measured, and the angle θ between the center line of the segment of the blood vessel and the second projection direction is determined. Then, by using the following equation (1), the simulated optical path length xC of the segment of the blood vessel is calculated. -
x C =D/sin θ Equation (1) - Then it proceeds to a three-dimensional
reconstruction adjustment step 104. At thestep 104, reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted based on the simulated optical path length (xC1, xC2, . . . , and xCn) within the blood vessel at the position(s) in the second projection direction, intensity value at the corresponding position(s) of the blood vessel in the second two-dimensional image, and a relationship between intensity value at each position of a blood vessel in a second-dimensional image and an optical path length at the corresponding position. The adjusted reconstruction parameters may be utilized for three-dimension vessel reconstruction, so that a foreshortening of three-dimension vessel reconstruction may be rectified. - As shown in
FIG. 4 , when X-rays travel longer (i.e., the optical path is longer), there is more X-ray attenuation, and the intensity value of the transmitted beam is smaller, and accordingly, the grayscale value of the pixel is also smaller. Thus, embodiments of the present disclosure use grayscale values of the pixel to derive the optical path in the contrast agent (i.e., the optical path in the blood vessel) to infer the local vessel geometry. - It is observed that there is an inherent relationship between the intensity value at each position of the blood vessel in the two-dimensional image and the optical path length at the corresponding position, under the same contrast agent injection condition for the same patient. When optical path length at each position of a blood vessel in a two-dimensional image are denoted by xC, exp[xC] has an inherent relationship with the intensity value, such as gray values gC, at the corresponding position of the blood vessel in a two-dimensional image, such as an approximately linear relationship. The value obtained by removing background from the intensity value (such as the gray-scale value gC) and logarithmically processing the intensity value at each position of the blood vessel, has a linear relationship with the optical path length xC at the corresponding position, as shown in
FIG. 6 . - The above-mentioned inherent relationship (for example, a linear relationship) can be explained through the following approximate derivation.
- Specifically, the relationship between x-ray attenuation and optical path in the contrast agent may be defined by following Equation (2).
-
- where II is the incident beam intensity, IT is the transmitted beam intensity, □μ/ρ is the mass attenuation coefficient and x is the optical path. In addition, the subscripts c and o represent contrast agent and organ (e.g., the vessel), respectively. In the absence of contrast agent, the x-ray beam absorption, due to the organ alone, is described by Equation (3).
-
- where IB is the transmitted beam intensity with only background.
- By incorporating Equation (3) into Equation (2), the relationship between the intensity of the light transmitted through the blood vessel at each position and the optical path length xC at the corresponding positions can be obtained, see Equation (4).
-
- The light transmitted the blood vessel at each position thereof may be incident onto a flat panel detector, so as to obtain a gray-scale two-dimensional image. Thereby, the intensity of the light transmitted through the blood vessel at each position is converted to intensity value (for example, gray value) at the corresponding position of the blood vessel in the two-dimensional image. It is verified that the conversion to grayscale does not destroy the described inherent relationship, so that the inherent relationship between the intensity of the light transmitted through the blood vessel at each position and the optical path length xC at the corresponding position is maintained between the intensity value at each position of the blood vessel in the two-dimensional image and the optical path length xC at the corresponding position. Therefore, the reconstruction of the three-dimensional model can be guided by using the intensity values at the position(s) of the blood vessel in the two-dimensional images. Compared with the existing three-dimensional reconstruction technology that ignores the intensity value of two-dimensional images, the present disclosure considers the above relationship so that the reconstruction accuracy of the three-dimensional model can be improved. Hereinafter, in order to facilitate description, the transition between the intensity of the light transmitted through the blood vessel at the position(s) of and the intensity value at corresponding position(s) of the corresponding blood vessel in the two-dimensional image is ignored, and IT is used to denote the intensity value at position(s) of the blood vessel in the two-dimensional image, and IB is used to denote the background intensity at the corresponding position(s) of the blood vessel in the two-dimensional image.
- In some embodiments, the reconstruction of the three-dimensional image may be assisted using the linear relationship between the processed intensity value at each position in the two-dimensional image and the optical path length xC at the corresponding position. By applying the logarithm to both sides of formula (4), the following Equation (5) can be obtained.
-
- It can be seen that the optical path length xC through the contrast agent is proportional to the processed image (i.e., that obtained by removing background from and logarithmically processing the image). That is, the value resulted by removing background and logarithmically processing the intensity value at each position of the blood vessel has a linear relationship with the optical path length xC at the corresponding position, as shown in
FIG. 6 . - In some embodiments, the value resulted by removing background from and logarithmically processing the intensity value at each position of the blood vessel in a two-dimensional image, i.e., ln(IT)−ln(IB), may be obtained by the following steps: calculating the logarithm of the intensity value at each position of the blood vessel to obtain a first processed value ln(IT); calculating the logarithm of background intensity value at each position of the blood vessel to obtain a second processed value ln(IB); and subtracting the second processed value from the first processing value, so as to obtain the value resulted by removing background from and logarithmically processing the intensity value, ln(IT)−ln(IB).
-
FIGS. 7(a) to 7(c) illustrate the image processing on how to obtain the value resulted by removing background from and logarithmically processing an intensity value at each position of a blood vessel in a two-dimensional image.FIG. 7(a) illustrates a second two-dimensional image IT (e.g., an acquired X-ray angiographic image).FIG. 7(b) illustrates for example a background image IB estimated for the second two-dimensional image IT by utilizing image inpainting technology. AndFIG. 7(c) illustrates the first processed image resulted by removing background and logarithmically processing, ln(IT)−ln(IB). The methods of U.S. Provisional Application No. 62/591,437 (filed Nov. 28, 2017), which is incorporated herein by reference, may be used to process the images as above. In some embodiments, for example, background may be estimated by methods such as image inpainting. The log signal of the background-removed image has a linear correlation with optical paths. - In some embodiments, the relationship between the intensity value at each position of the blood vessel in a two-dimensional image and the optical path length at the corresponding position may be established in advance, in previous angiography and three-dimensional reconstruction of the same patient under the same contrast injection conditions, or the relationship is established in advance for part of the blood vessel in the same angiography and three-dimensional reconstruction. In some embodiments, in the same angiography and three-dimensional reconstruction, the foreshortening phenomenon may be avoided or decreased for the part of blood vessel, which is easy to achieve. And thus an accurate optical path length may be obtained by a reconstructed three-dimensional model based on the part of blood vessel, so that an accurate relationship between the intensity value at each position of the blood vessel in the two-dimensional image and the optical path lengths at the corresponding position may be established in advance. After the relationship is established in advance, the relationship can be recalled directly in a subsequent application scenario that satisfies the same contrast agent injection conditions.
- When a three-dimensional model is reconstructed for a specific patient, difference in physiological characteristics (such as blood viscosity, respiratory motion, cardiac motion, etc.) and/or contrast agent parameters (such as injection time and injection volume) between previous and later angiographies may be small for him/her. Therefore, the relationship established in advance in the previous angiography and three-dimensional reconstruction or the relationship established in advance for the part of the blood vessel in the same angiography and three-dimensional reconstruction can be continuously adapted to the same patient. Compared to adopting the relationship obtained by means of the reconstruction of the three-dimensional model for other patients, it facilitates improving the accuracy of the reconstructed three-dimensional model of the blood vessel for the specific patient.
- In the following embodiment, as shown in
FIG. 8 , a flowchart of an exemplary process 500 for performing three-dimensional construction of a blood vessel using X-ray angiographic images according to another embodiment of the present disclosure is described. The exemplary process 500 includes the following steps. It begins with anacquisition step 502, wherein a reconstructed three-dimensional model of the blood vessel and a second two-dimensional image in the second projection direction corresponding thereto are acquired. Then, the process proceeds to a simulated light pathlength determining step 503. Atstep 503, the simulated optical path length within the blood vessel at position(s) in the second projection direction is determined based on the three-dimensional model of the blood vessel. After that, a three-dimensional reconstruction adjustment step is performed. With reference to bothFIG. 8 andFIG. 9 , the three-dimensional reconstruction adjustment step may include the followingsteps 5041˜5043. - At
step 5041, a first processed image resulted by removing background from and logarithmically processing the second two-dimensional image may be calculated. For example, in some embodiments, the step of calculating the first processed image may include (not illustrated in the drawings): calculating the logarithm of an intensity value of each pixel of the second two-dimensional image to obtain a third logarithmically processed image; then, inpainting intensity values of the blood vessel portion in the second two-dimensional image based on intensity values of the background pixels of the periphery of the blood vessel portion; calculating the logarithm of an intensity value of each pixel of the imprinted second two-dimensional image, so as to obtain a fourth logarithmically processed image; and then subtracting the fourth logarithmically processed image from the third logarithmically processed image, so as to obtain the first processed image, which is exemplified byFIG. 7(c) . - At
step 5042, the optical path length within the blood vessel at the position(s) may be estimated using the aforesaid linear relationship, which may be established in advance, based on the first processed image. - At
step 5043, the optical path length within the blood vessel at the position(s) may be compared with the determined simulated optical path length within the vessel blood at the corresponding position(s), and the size of the blood vessel at the corresponding position(s) in the second projection direction in the three-dimensional model thereof may be elongated based on the comparison. - In one embodiment, the
step 5043 may include: determining difference between the optical path length within the blood vessel at the position(s) and the simulated optical path length at the corresponding position(s) of the blood vessel; providing a warning if the difference is greater than a first predetermined threshold, otherwise, elongating the size of the blood vessel at the corresponding position(s) in the X-ray transmitting direction in the three-dimensional model of the blood vessel based on the difference, so as to eliminate the difference. - The first predetermined threshold may be a value preset empirically by a person skilled in the art, and this value is used to reflect the allowable degree of deviation of the reconstructed three-dimensional model. If the difference is greater than the first predetermined threshold, it means the deviation of the reconstructed three-dimensional model is relatively great, so a warning may be provided to draw the attention of a user (such as a surgeon or the like). Besides, if the difference is less than or equal to the first predetermined threshold, the size of the blood vessel at the corresponding position in the X-ray transmission direction in the three-dimensional model may directly modified (e.g., elongated) to eliminate the difference, thereby generating a calibrated blood vessel three-dimensional model.
- In the following embodiment, as shown in
FIG. 20 , a flowchart of an exemplary process 700 for performing three-dimensional blood vessel reconstruction using X-ray angiography images according to yet another embodiment of the present disclosure is described. The exemplary process 700 includes the following steps. - It begins with an
acquisition step 702. Atstep 702, a reconstructed three-dimensional model of a blood vessel and a second two-dimensional image in the second projection direction corresponding thereto may be acquired. - Then, a simulated light path
length determining step 703 is performed. Atstep 703, simulated optical path length within the blood vessel at position(s) in the second projection direction may be determined based on the three-dimensional model of the blood vessel. - After that, a three-dimensional reconstruction adjustment step is performed. With reference to
FIG. 10 andFIG. 11 , the three-dimensional reconstruction adjustment step includes the followingsteps 7041˜7043. Atstep 7041, a first processed image resulted by removing background from and logarithmically processing the second two-dimensional image may be calculated. The process of calculating the first processed image may be performed as in the exemplary process 500. - At
step 7042, the second processed image resulted by removing the background from and logarithmically processing a simulated two-dimensional projection image may be estimated using the linear relationship based on the determined simulated optical path length, wherein the simulated two-dimensional projection image is obtained by projecting the three-dimensional model of the blood vessel in the second projection direction. That is, according to the simulated optical path length and the linear relationship, processed (including background removing and logarithmically processing) intensity values may be obtained for corresponding position of the blood vessel (more specifically, each pixel point of the blood vessel region). - At
step 7043, the first processed image may be compared with the second processed image, and the reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted based on the comparison. The adjusted reconstruction parameters may be used to perform three-dimensional blood vessel reconstruction using the X-ray angiographic images. - Specifically, the pixel value (i.e., the processed intensity value) at each pixel position of the first processed image may be compared with the processed intensity value at the corresponding pixel position of the second processed image, and the reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted based on the comparison. And three-dimensional vessel model reconstruction may be performed using the adjusted reconstruction parameters.
- In some embodiments, the cost function is set as the difference obtained by the above comparison, and the reconstruction parameters of the three-dimensional model of the blood vessel may be adjusted by minimizing the cost function.
- In other embodiments, with the cost function defined as the above difference, steps of the three-dimensional vessel reconstruction and reconstruction parameters may be performed iteratively, the cost function may be calculated and fed into an optimizer to update the reconstruction parameters and the corresponding three-dimensional blood vessel tree geometry (i.e., generating a calibrated three-dimensional model of a blood vessel). For example, the reconstruction parameters can be gradually updated using a Newton iteration method or the like until optimized reconstruction parameters are obtained. The optimized reconstruction parameters may be used to reconstruct an accurate three-dimensional model of the blood vessel.
- In still other embodiments,
step 7043 may include: determining a difference between the first processed image and the second processed image; providing a warning if the difference is greater than a second predetermined threshold, otherwise, adjusting the reconstruction parameters of the three-dimensional model of the blood vessel based on the comparison, so as to eliminate the difference. - The second predetermined threshold may be a value preset empirically by a person skilled in the art, which reflects the allowable degree of deviation of the reconstructed three-dimensional model. If the difference is greater than the second predetermined threshold, the deviation of the reconstructed three-dimensional model is considered as relatively great, so a warning is provided to draw the attention of the user (such as a surgeon or the like), and if the difference is less than or equal to the second predetermined threshold, the reconstruction parameters of the three-dimensional model of the blood vessel may be directly adjusted, thus adjusting the corresponding three-dimensional geometry of the vessel tree.
-
FIG. 12 illustrates a block diagram of adevice 900 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images. Thedevice 900 comprises: a three-dimensionalmodel reconstruction unit 901 configured to reconstruct a 3D model of the blood vessel from a first two-dimensional image acquired in a first projection direction (i.e., the single-view projection image); anacquisition unit 902, which is configured to acquire a second two-dimensional image in the second projection direction and the reconstructed three-dimensional model of the blood vessel reconstructed by the three-dimensionalmodel reconstruction unit 901; a simulated light pathlength determining unit 903, which is configured to determine simulated optical path length within the blood vessel at position(s) of the blood vessel in the second projection direction based on the three-dimensional model of the blood vessel; and a three-dimensional reconstruction adjustment unit 904, which is configured to adjust reconstruction parameters of the three-dimensional model of the blood vessel, based on the simulated optical path length within the blood vessel at the position(s) in the second projection direction, intensity values at the corresponding position(s) of the blood vessel on the second two-dimensional image, and a relationship between intensity value at each position of a blood vessel in a second-dimensional image and the optical path length at the corresponding position. The adjusted reconstruction parameters of the three-dimensional model of the blood vessel may be adopted to perform three-dimensional blood vessel reconstruction with X-ray angiographic images. - In some embodiments, the
acquisition unit 902 may acquire a vascular medical image from themedical image database 935. The acquired vascular medical image may include a three-dimensional model of the blood vessel and/or a second two-dimensional image in the second projection direction corresponding to the three-dimensional model of the blood vessel. In some other embodiments, the acquiringunit 902 can directly acquire the three-dimensional model of a blood vessel and/or a second two-dimensional image corresponding to the three-dimensional model of the blood vessel in the second projection direction from an external device such as a medical image acquisition device (not shown). In still other embodiments, theacquisition unit 902 may acquire the above model and/or image from an image data storage device (not shown). In a modified embodiment, theacquisition unit 902 can acquire the required models and images from at least two of the above sources. - In one embodiment,
device 900 may further include a three-dimensionalmodel reconstruction unit 901. The three-dimensionalmodel reconstruction unit 901 is configured to generate a reconstructed blood vessel three-dimensional model based on a single-view projection image (for example, the second two-dimensional image in the second projection direction may be used). The three-dimensionalmodel reconstruction unit 901 may be connected to any one of themedical image database 935, the image acquisition device, and the image data storage device, so as to acquire the two-dimensional image(s) based on which the reconstruction is performed. Theacquisition unit 902 may acquire the reconstructed three-dimensional model of a blood vessel from the three-dimensionalmodel reconstructing unit 901. In one embodiment, theacquisition unit 902 may also acquire, from the three-dimensionalmodel reconstructing unit 901, the first two-dimensional images, based on which the blood vessel three-dimensional model is reconstructed, and thedevice 900 may use the first two-dimensional image as the second two-dimensional image. - The
acquisition unit 902 transmits the acquired three-dimensional model of the blood vessel and the corresponding second two-dimensional image in the second projection direction to the simulated optical pathlength determining unit 903. The simulated optical pathlength determination unit 903 transmits the determined simulation optical path length to the three-dimensional reconstruction adjustment unit 904, so that it may adjust reconstruction parameters of the three-dimensional model of the blood vessel, based on the simulated optical path length within the blood vessel at position(s) thereof in the second projection direction, intensity value at the corresponding position(s) of the blood vessel on the second two-dimensional image, and a relationship between intensity value at each position of a blood vessel in a second-dimensional image and optical path length at the corresponding positions. Thus the adjusted reconstruction parameters may be adopted to reconstruct the three-dimensional blood vessel model using X-ray angiographic images. In some embodiments, the three-dimensional reconstruction adjustment unit 904 may output a calibrated three-dimensional model of a blood vessel. - For the specific implementation steps and methods of each unit of the
device 900, reference may be made to corresponding steps and methods detailed in the foregoing method embodiments, and the description of which are omitted. -
FIG. 13 illustrates a block diagram of a medicalimage processing device 1000 for performing three-dimensional blood vessel reconstruction using X-ray angiographic images. The medicalimage processing device 1000 may include anetwork interface 1001 by which thedevice 1000 may be connected to a network (not shown) such as, but not limited to, a local area network in a hospital or the Internet. The network may connect thedevice 1000 with an external device such as an image acquisition device (not shown), amedical image database 2000, and an imagedata storage device 3000. - It is contemplated that the devices and methods disclosed in the embodiments may be implemented using a computer device. In some embodiments, the medical
image processing device 1000 may be a dedicated smart device or a general-purpose smart device. For example, the medicalimage processing device 1000 may be a computer customized for image data acquisition and image data processing tasks, or a server placed in the cloud. For example, thedevice 1000 may be integrated into an image acquisition device. Optionally, the device may include or cooperate with a three-dimensional model reconstruction unit for generating a reconstructed three-dimensional model based on the two-dimensional images acquired by the image acquisition device. - The medical
image processing device 1000 may include animage processor 1002 and amemory 1003, and may additionally include at least one of an input/output 1004 and animage display 1005. - The
image processor 1002 may be a processing device including one or more general-purpose processing devices such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), and the like. More specifically, theimage processor 1002 may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor that runs a combination of instruction sets. Theimage processor 1002 may also be one or more dedicated processing devices such as application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), digital signal processors (DSPs), system-on-chip (SoCs), and the like. As would be appreciated by those skilled in the art, in some embodiments, theimage processor 1002 may be a special-purpose processor, rather than a general-purpose processor. Theimage processor 1002 may include one or more known processing devices, such as a microprocessor from the Pentium™, Core™ Xeon™, or Itanium® family manufactured by Intel™, the Turion™, Athlon™, Sempron™ Opteron™, FX™, Phenom™ family manufactured by AIVID™, or any of various processors manufactured by Sun Microsystems. Theimage processor 1002 may also include graphical processing units such as a GPU from the GeForce®, Quadro®, Tesla® family manufactured by Nvidia™, GMA, Iris™ family manufactured by Intel™, or the Radeon™ family manufactured by AMD™. Theimage processor 1002 may also include accelerated processing units such as the Desktop A-4 (6, 8) Series manufactured by AIVID™, the Xeon Phi™ family manufactured by Intel™. - The disclosed embodiments are not limited to any type of processor(s) or processor circuits otherwise configured to meet the computing demands of identifying, analyzing, maintaining, generating, and/or providing large amounts of imaging data or manipulating such imaging data to calibrate a three-dimensional vessel model or to manipulate any other type of data consistent with the disclosed embodiments. In addition, the term “processor” or “image processor” may include more than one processor, for example, a multi-core design or a plurality of processors each having a multi-core design. The
image processor 1002 can execute sequences of computer program instructions, stored inmemory 1003, to perform various operations, processes, methods disclosed herein. - The
image processor 1002 may be communicatively coupled to thememory 1003 and configured to execute computer-executable instructions stored therein. Thememory 1003 may include a read only memory (ROM), a flash memory, random access memory (RAM), a dynamic random-access memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM, a static memory (e.g., flash memory, static random-access memory), etc., on which computer executable instructions are stored in any format. In some embodiments, thememory 1003 may store computer-executable instructions of one or more image processing program(s) 923 and the data generated when the image processing program(s) are performed. The computer program instructions can be accessed by theimage processor 1002, read from the ROM, or any other suitable memory location, and loaded in the RAM for execution by theimage processor 1002, so as to implement each step of above methods. Theimage processor 1002 may also send/receive medical image data to/fromstorage 1003. For example,memory 1003 may store one or more software applications. Software applications stored in thememory 1003 may include, for example, an operating system (not shown) for common computer systems as well as for soft-controlled devices. Further,memory 1003 may store an entire software application or only a part of a software application (e.g., the image processing program (s) 923) to be executable by theimage processor 1002. In some embodiments, the image processing program 923 may include the simulated optical pathlength determining unit 903 and the three-dimensional reconstruction adjustment unit 904 shown inFIG. 12 as software units, for implementing each step of the method or process of three-dimensional reconstruction using X-ray angiographic images consistent with the present disclosure. In some embodiments, the image processing program 923 may also include the three-dimensionalmodel reconstructing unit 901 shown inFIG. 12 as a software unit. In addition, thememory 1003 may store data generated/cached when the computer program is executed, such as medical image data 1006, which includes medical images transmitted from an image acquisition device, themedical image database 2000, the imagedata storage device 3000, and the like. Such medical image data 1006 may include a received three-dimensional vessel model to be calibrated and the two-dimensional angiographic images corresponding thereto. In addition, the medical image data 1006 may also include any one of a calibrated three-dimensional vessel model, the difference on the optical path length, and the adjusted reconstruction parameters. - The
image processor 1002 may execute an image processing program 923 to implement a method for three-dimensional vessel reconstruction using X-ray angiographic images. In some embodiments, when the image processing program 923 is executed, theimage processor 1002 may associate the acquired reconstructed blood vessel three-dimensional model with the adjusted reconstruction parameters and the generated calibrated blood vessel three-dimensional model and store them inmemory 1003. Alternatively, theimage processor 1002 may associate the acquired reconstructed blood vessel three-dimensional model with the adjusted reconstruction parameters and the generated calibrated blood vessel three-dimensional model and send them to themedical image database 2000 via thenetwork interface 1001. - It is contemplated that the device may include one or more processors and one or more memory devices. The processor(s) and storage device(s) may be configured in a centralized or distributed manner.
- The
device 1000 may include one or more digital and/or analog communication device (input/output 1004). For example, the input/output 1004 may include a keyboard and a mouse that allow the user to provide an input. -
Device 1000 may be connected to the network throughnetwork interface 1001. Thenetwork interface 1001 may include a network adapter, a cable connector, a serial connector, a USB connector, a parallel connector, a high-speed data transmission adapter such as optical fiber, USB 3.0, lightning, a wireless network adapter such as a WiFi adapter, a telecommunication (3G, 4G/LTE, etc.) adapters. The network may provide the functionality of local area network (LAN), a wireless network, a cloud computing environment (e.g., software as a service, platform as a service, infrastructure as a service, etc.), a client-server, a wide area network (WAN), and the like. - The
device 1000 may further include animage display 1005. In some embodiments, theimage display 1005 may be any display device suitable for displaying a vascular angiographic image(s) and the three-dimensional reconstruction results. For example, theimage display 1005 may be an LCD, CRT, or LED display. - Various operations or functions are described herein that may be implemented as software code or instructions or as software code or instructions. Such content may be directly executable source code or difference code (“incremental” or “block” code) (“object” or “executable” form). The software codes or instructions may be stored in a computer-readable storage medium and, when executed, may cause the machine to perform the described functions or operations and include any mechanism for storing information in a form accessible by the machine (e.g., computing devices, electronic systems, etc.), such as recordable or non-recordable media (e.g., read-only memory (ROM), random access memory (RAM), disk storage media, optical storage media, flash memory devices, etc.).
- Although described using X-ray images, imaging modalities in the disclosed systems and methods may be alternatively or additionally applied to other imaging modalities where the pixel intensity varies with the distance traveled by imaging particles, such as CT, cone beam computed tomography (CBCT), Spiral CT, positron emission tomography (PET), single-photon emission computed tomography (SPECT), etc.
- Following long-standing patent law convention, the terms “a”, “an”, and “the” refer to “one or more (at least one)” when used in this application, including the claims. Thus, for example, reference to “a unit” includes a plurality of such units, and so forth.
- As used herein, the term “and/or” when used in the context of a listing of entities, refers to the entities being present singly or in combination. Thus, for example, the phrase “A, B, C, and/or D” includes A, B, C, and D individually, but also includes any and all combinations and combinations of A, B, C, and D.
- Another aspect of the disclosure is directed to a non-transitory computer-readable medium storing instructions which, when executed, cause one or more processors to perform the methods, as discussed above. The computer-readable medium may include volatile or non-volatile, magnetic, semiconductor, tape, optical, removable, non-removable, or other types of computer-readable medium or computer-readable storage devices. For example, the computer-readable medium may be the storage device or the memory module having the computer instructions stored thereon, as disclosed. In some embodiments, the computer-readable medium may be a disc or a flash drive having the computer instructions stored thereon.
- It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed system and related methods. Other embodiments will be apparent to those skilled in the art from consideration of the specification and practice of the disclosed system and related methods.
- It is intended that the specification and examples be considered as exemplary only, with a true scope being indicated by the following claims and their equivalents.
Claims (20)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/497,980 US20220036646A1 (en) | 2017-11-30 | 2021-10-11 | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic image |
CN202210350217.XA CN115880418A (en) | 2021-09-27 | 2022-04-02 | Method and apparatus for reconstructing three-dimensional images from single-view projection images |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762592595P | 2017-11-30 | 2017-11-30 | |
US16/106,077 US10709399B2 (en) | 2017-11-30 | 2018-08-21 | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic images |
US16/895,573 US11141122B2 (en) | 2017-11-30 | 2020-06-08 | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic images |
US202163248999P | 2021-09-27 | 2021-09-27 | |
US17/497,980 US20220036646A1 (en) | 2017-11-30 | 2021-10-11 | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic image |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/895,573 Continuation-In-Part US11141122B2 (en) | 2017-11-30 | 2020-06-08 | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic images |
Publications (1)
Publication Number | Publication Date |
---|---|
US20220036646A1 true US20220036646A1 (en) | 2022-02-03 |
Family
ID=80004499
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/497,980 Pending US20220036646A1 (en) | 2017-11-30 | 2021-10-11 | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic image |
Country Status (1)
Country | Link |
---|---|
US (1) | US20220036646A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210012530A1 (en) * | 2018-12-21 | 2021-01-14 | Beijing Sensetime Technology Development Co., Ltd. | Image processing method and apparatus, electronic device and storage medium |
US12039685B2 (en) | 2019-09-23 | 2024-07-16 | Cathworks Ltd. | Methods, apparatus, and system for synchronization between a three-dimensional vascular model and an imaging device |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080091171A1 (en) * | 2006-09-18 | 2008-04-17 | Mediguide Ltd. | Method and system for navigating through an occluded tubular organ |
US20180028056A1 (en) * | 2016-07-27 | 2018-02-01 | Topcon Corporation | Ophthalmic image processing apparatus and ophthalmic imaging apparatus |
US20190159683A1 (en) * | 2017-11-28 | 2019-05-30 | Beijing Curacloud Technology Co., Ltd. | Methods and systems for determining lumen volume and coronary blood flow |
-
2021
- 2021-10-11 US US17/497,980 patent/US20220036646A1/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080091171A1 (en) * | 2006-09-18 | 2008-04-17 | Mediguide Ltd. | Method and system for navigating through an occluded tubular organ |
US20180028056A1 (en) * | 2016-07-27 | 2018-02-01 | Topcon Corporation | Ophthalmic image processing apparatus and ophthalmic imaging apparatus |
US20190159683A1 (en) * | 2017-11-28 | 2019-05-30 | Beijing Curacloud Technology Co., Ltd. | Methods and systems for determining lumen volume and coronary blood flow |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210012530A1 (en) * | 2018-12-21 | 2021-01-14 | Beijing Sensetime Technology Development Co., Ltd. | Image processing method and apparatus, electronic device and storage medium |
US12039685B2 (en) | 2019-09-23 | 2024-07-16 | Cathworks Ltd. | Methods, apparatus, and system for synchronization between a three-dimensional vascular model and an imaging device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11141122B2 (en) | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic images | |
US11164346B2 (en) | Posterior image sampling to detect errors in medical imaging | |
US11495357B2 (en) | Method and device for automatically predicting FFR based on images of vessel | |
US9754390B2 (en) | Reconstruction of time-varying data | |
CN109448072B (en) | Computer-implemented method and apparatus for three-dimensional vascular reconstruction using contrast images | |
US20220036646A1 (en) | Methods and devices for performing three-dimensional blood vessel reconstruction using angiographic image | |
US8068650B2 (en) | Lesion quantification and tracking using multiple modalities | |
US11369278B2 (en) | Methods and systems for determining lumen volume and coronary blood flow | |
CN109060849A (en) | A kind of mthods, systems and devices of determining dose of radiation modulation lines | |
US11813103B2 (en) | Methods and systems for modulating radiation dose | |
WO2022121493A1 (en) | Systems and methods for blood vessel assessment | |
US11055559B1 (en) | System, method and apparatus for assisting a determination of medical images | |
EP3203914B1 (en) | Radiation dose applied to different anatomical stages | |
CN111429502A (en) | Method and system for generating a centerline of an object and computer readable medium | |
CN111476791B (en) | Image processing method, image processing apparatus, and non-transitory computer readable medium | |
CN114596311B (en) | Blood vessel function evaluation method and blood vessel function evaluation device based on blood vessel image | |
CN109124666A (en) | A kind of mthods, systems and devices of determining dose of radiation modulation lines | |
CN110070534B (en) | Method for automatically acquiring feature sequence based on blood vessel image and device for predicting fractional flow reserve | |
Piccolomini et al. | A model-based optimization framework for iterative digital breast tomosynthesis image reconstruction | |
US11523744B2 (en) | Interaction monitoring of non-invasive imaging based FFR | |
US20140049542A1 (en) | Layer Display of Volume Data | |
US11869142B2 (en) | Methods and devices for three-dimensional image reconstruction using single-view projection image | |
US10262443B2 (en) | Radiation imaging apparatus and radiation image detection method | |
CN115880418A (en) | Method and apparatus for reconstructing three-dimensional images from single-view projection images | |
CN113205459A (en) | Motion correction of angiographic images for 3D reconstruction of coronary arteries |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SHENZHEN KEYA MEDICAL TECHNOLOGY CORPORATION, CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SONG, QI;YIN, YOUBING;LIU, SHUBAO;AND OTHERS;SIGNING DATES FROM 20211007 TO 20211008;REEL/FRAME:057748/0345 |
|
AS | Assignment |
Owner name: SHENZHEN KEYA MEDICAL TECHNOLOGY CORPORATION, CHINA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ATTORNEY DOCKET NUMBER TO 10002-01-0016-US-CON-CIP PREVIOUSLY RECORDED AT REEL: 057748 FRAME: 0345. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNEMNT;ASSIGNORS:SONG, QI;YIN, YOUBING;LIU, SHUBAO;AND OTHERS;SIGNING DATES FROM 20211007 TO 20211008;REEL/FRAME:057777/0597 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |