CN114468998B - Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method - Google Patents

Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method Download PDF

Info

Publication number
CN114468998B
CN114468998B CN202210096054.7A CN202210096054A CN114468998B CN 114468998 B CN114468998 B CN 114468998B CN 202210096054 A CN202210096054 A CN 202210096054A CN 114468998 B CN114468998 B CN 114468998B
Authority
CN
China
Prior art keywords
imaging
fluorescence
near infrared
image
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210096054.7A
Other languages
Chinese (zh)
Other versions
CN114468998A (en
Inventor
曹旭
马庆超
白婷婷
熊枭
鲜浩楠
王艺涵
王忠良
朱守平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN202210096054.7A priority Critical patent/CN114468998B/en
Publication of CN114468998A publication Critical patent/CN114468998A/en
Application granted granted Critical
Publication of CN114468998B publication Critical patent/CN114468998B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0073Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by tomography, i.e. reconstruction of 3D images from 2D projections
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0071Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03Computed tomography [CT]
    • A61B6/032Transmission computed tomography [CT]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • A61B6/5229Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
    • A61B6/5235Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02BCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
    • Y02B20/00Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Pulmonology (AREA)
  • Theoretical Computer Science (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Abstract

The invention belongs to the technical field of medical imaging, and discloses a single-view reflection type near infrared two-region fluorescence dynamic tomography system and a method, wherein the system comprises the following steps: the system comprises a fluorescence imaging module, a CT imaging module, a central control module, a data processing module and an auxiliary module. The invention uses the wide-field excitation light source to irradiate the imaging target, the acquisition camera and the excitation light source are in the same measurement, and the imaging speed is greatly improved by reflection imaging, so that real-time fluorescence tomography can be obtained. The invention adopts near infrared two-region imaging, which can improve the resolution of the three-dimensional reconstructed image; by utilizing the reflection type fluorescence tomography technology, only single-view reflection fluorescence data is used for three-dimensional fluorescence tomography reconstruction, so that wide-field excitation is hopefully realized to obtain high imaging speed, and real-time fluorescence tomography is obtained; and the single-view CT tomography technology combined with the depth reconstruction is used for acquiring the sample structure image, so that the rotation operation on the sample is not needed, the complexity of the system is reduced, and the imaging speed is improved.

Description

Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method
Technical Field
The invention belongs to the technical field of medical imaging, and particularly relates to a single-view reflection type near infrared two-region fluorescence dynamic tomography system and method.
Background
At present, the optical molecular image is widely applied to the research of biomedicine and is hopeful to be popularized to clinical diagnosis. In the near infrared fluorescence tomography technology, a targeted fluorescent probe is injected, the fluorescent probe is excited by utilizing exogenous excitation light, and the three-dimensional distribution of the in-vivo fluorescent probe is obtained by collecting fluorescence information. The noninvasive and noninvasive detection process can locate and quantify the focus and has the characteristic of high sensitivity. The optical imaging technology is combined with the traditional imaging technology such as CT and the like, so that not only can the structural information of the focus be obtained, but also the molecular information can be obtained, and the early focus can be analyzed and diagnosed.
However, when the near infrared one-region fluorescence imaging technology is used for optical molecular imaging of biological tissues, the problems of limited imaging depth and insufficient resolution exist, and the strong scattering effect of biological tissues causes that the near infrared one-region fluorescence is difficult to perform high-resolution imaging on a fluorescent probe at a depth position. Therefore, the near infrared one-area fluorescence tomography technology is difficult to meet the positioning requirement of the high-accuracy deep biological tissue three-dimensional fluorescence probe in biomedical research.
At present, transmission imaging is adopted in the near infrared two-region fluorescence tomography technology, a sample is required to rotate at multiple angles, an imaging body is excited from different visual angles, and rapid real-time tomography is difficult to realize. Therefore, there is a need to design a new single view imaging system to remedy the drawbacks of the prior art.
Through the above analysis, the problems and defects existing in the prior art are as follows:
(1) The existing near infrared one-area fluorescence tomography technology is difficult to meet the positioning requirement of the high-accuracy deep biological tissue three-dimensional fluorescence probe in biomedical research.
(2) At present, transmission imaging is adopted in the near infrared two-region fluorescence tomography technology, a sample is required to rotate at multiple angles, an imaging body is excited from different visual angles, and rapid real-time tomography is difficult to realize.
The difficulty of solving the problems and the defects is as follows: near infrared one-region fluorescence tomography technology has the defects of shallower penetration depth and larger scattering in organisms due to the limitation of fluorescence wavelength. Fluorescence at a wavelength having a deep penetration depth is not suitable for being collected by a near infrared one-area camera or the like. In addition, the conventional near infrared two-region transmission imaging cannot realize rapid real-time tomographic imaging because of the need of rotating a sample and other operations.
The meaning of solving the problems and the defects is as follows: by utilizing the near infrared two-region fluorescence tomography technology, the problems of shallow penetration depth and large scattering of the near infrared one-region imaging technology are overcome, a certain space can be saved by using the reflection imaging technology, repeated operation on a sample is not needed, so that the imaging speed is greatly improved, the problem of light leakage is avoided, the system is simple in structure, the tomography can be rapidly realized, and the focus analysis and diagnosis can be more timely. However, this method causes a problem of difficult reconstruction, which can be further overcome later by researching a good reconstruction algorithm.
Disclosure of Invention
Aiming at the problems of the existing infrared first-region fluorescence tomography technology, the invention provides a single-view reflection type near infrared two-region fluorescence dynamic tomography system and a method.
The invention is realized in such a way that a single-view reflective near-infrared two-region fluorescence dynamic tomographic imaging system comprises:
the fluorescence imaging module comprises an excitation module and a near infrared two-region fluorescence signal acquisition module; the excitation module consists of a halogen lamp and a multiband filter wheel, outputs wide-field excitation light with a specific wave band according to the absorption peak of the used fluorescent probe, and is used for irradiating the whole imaging organism; the near infrared two-region fluorescence signal acquisition module is composed of a scientific-grade deep refrigeration near infrared two-region camera coupling imaging lens and is used for shooting a reflective single-view near infrared two-region fluorescence image.
The CT imaging module comprises an X-ray light pipe and an X-ray flat panel detector; the X-ray light pipe emits cone beam X-ray to irradiate an imaging organism for imaging, and the X-ray flat panel detector detects the transmitted X-ray passing through the imaging organism to obtain a single-view X-ray projection image.
And the central control module is used for controlling the fluorescence excitation module, the near infrared two-region fluorescence acquisition module and the CT imaging module to work in a coordinated manner.
The data processing module is used for reading the fluorescence data and the CT projection data and preprocessing the fluorescence data and the CT projection data; according to the preprocessed CT projection data, reconstructing three-dimensional CT image data by using a deep learning tomographic reconstruction technology; and according to the preprocessed fluorescence data, an optical tomographic reconstruction mathematical model is established by combining structural image information obtained by CT imaging, and a three-dimensional space distribution image of the near infrared two-region fluorescence probe in the imaged organism is reconstructed.
Furthermore, an excitation module in the fluorescence imaging module irradiates the whole imaging organism with wide-field excitation light, a near-infrared two-region fluorescence detection camera is adopted, and a reflection type near-infrared two-region fluorescence signal for shooting a single visual angle is adopted on the same side for fluorescence fault reconstruction.
Furthermore, the cone beam X-ray emitted by the X-ray light bulb tube of the CT imaging module irradiates the whole imaging organism, the X-ray flat panel detector detects the transmitted X-ray passing through the imaging organism, only single-view X-ray projection data are collected, and three-dimensional CT image data are reconstructed by using a deep learning fault reconstruction technology.
Further, the data processing module includes:
the image reading unit is used for reading fluorescent images and CT projection images of the near infrared two-region fluorescent acquisition module and the CT imaging module;
the image preprocessing unit is used for preprocessing the read fluorescent image and CT projection image;
the CT image three-dimensional reconstruction unit is used for carrying out three-dimensional reconstruction on the CT projection image obtained by the CT imaging module in a deep learning mode to obtain a space structure image of the sample;
the optical reconstruction unit is used for performing fluorescence tomography reconstruction on the space structure image obtained by the image three-dimensional reconstruction unit and the fluorescence image obtained by the optical information acquisition module; the reconstruction process is to establish a forward equation in combination with tissue optical parameters, and to solve the forward equation by a regularization method, so as to finally obtain the dynamic real-time bimodal tomogram information of the organism;
and the image display unit is used for displaying the fluorescent image obtained by the optical information acquisition module, the CT projection image obtained by the CT imaging module and the organism dynamic real-time bimodal tomographic image information obtained by the optical reconstruction unit.
Further, the single view angle reflection type near infrared two-region fluorescence dynamic tomography system further comprises an auxiliary module, wherein the auxiliary module comprises:
an optical stage for supporting each of the different modules of the system;
the shading box is arranged on the optical platform and used for preventing other external light sources from entering;
the sample fixing plate is used for fixing the sample;
and the lifting platform is used for arranging the sample fixing plate on the lifting platform and can be lifted to a position convenient for imaging.
Another object of the present invention is to provide a single view reflection type near infrared two-area fluorescence dynamic tomographic imaging method using the single view reflection type near infrared two-area fluorescence dynamic tomographic imaging system, the single view reflection type near infrared two-area fluorescence dynamic tomographic imaging method comprising the steps of:
setting parameters such as a fluorescence excitation module, a near infrared two-region fluorescence acquisition module, a CT imaging module and the like through a central control module, and controlling the work of the modules;
step two, coupling an imaging lens by a near infrared two-area fluorescence detection camera to perform reflection acquisition on fluorescence signals, and acquiring transmission X-ray passing through an imaging organism by an X-ray flat panel detector;
transmitting a fluorescence signal acquired by a near infrared two-area fluorescence detection camera and an X-ray signal detected by an X-ray flat panel detector to a computer through a data line respectively, reading the fluorescence signal by an image reading unit of the computer, and performing preprocessing operation of an image preprocessing unit;
step four, carrying out three-dimensional reconstruction on the preprocessed CT projection image by a CT image three-dimensional reconstruction unit in a deep learning mode to obtain a space structure diagram;
and fifthly, utilizing a space structure diagram of three-dimensional reconstruction and a fluorescence image acquired by a near infrared two-region fluorescence detection camera, establishing a forward equation by combining tissue optical parameters, solving the forward equation by a regularization method, finally obtaining the dynamic real-time bimodal tomographic image information of the organism, and displaying the fluorescence image, the CT projection image and the dynamic real-time bimodal tomographic image information of the organism by an image display unit.
Further, in the second step, the broad-field laser is controlled by a computer and guided to the imaging organism through the optical fiber to excite the probe in the imaging organism. The near infrared two-area fluorescence detection camera is coupled with the imaging lens to carry out reflection type acquisition on the fluorescence signals, wherein the acquired fluorescence signals are filtered by the filter to filter out light sources except for probe excitation light. Meanwhile, the X-ray light pipe emits cone beam X-ray to irradiate the imaging organism for imaging, and the X-ray flat panel detector acquires the transmitted X-ray passing through the imaging organism to obtain a single-view X-ray projection image.
By combining all the technical schemes, the invention has the advantages and positive effects that: compared with the traditional near infrared one-area fluorescence tomography technology, the single-view reflection near infrared two-area fluorescence dynamic tomography system provided by the invention has the advantages of high imaging resolution and large imaging depth due to the characteristics of small scattering, high sensitivity and the like. In addition, the invention has the advantage of single-view reflection imaging, combines CT three-dimensional reconstruction, can reconstruct and obtain a sample space structure by only one CT projection image, greatly improves the imaging speed, and can obtain the dynamic real-time dual-mode tomogram information of organisms.
The near infrared two-region fluorescence tomography in the invention irradiates an imaging organism through a wide-field light source and acquires optical data through reflection fluorescence acquisition, and an optical tomography reconstruction mathematical model is established by combining structural image information obtained by CT imaging to reconstruct a three-dimensional space distribution image of a near infrared two-region fluorescence probe in the imaging organism. The CT imaging is performed with fluorescence imaging and single-view transmission scanning on the object, so that a CT projection image is obtained, and a three-dimensional structure image of the organism CT is obtained through a deep learning reconstruction technology. The imaging system uses near infrared two-region fluorescence for imaging, so that the detection depth and imaging spatial resolution of the biological fluorescent probe can be improved; and the optics and CT adopt single-view imaging, so that the imaging is realized simultaneously and in real time, and the dynamic real-time bimodal tomogram information of the organism is obtained.
The invention uses the wide-field excitation light source to irradiate the imaging target, the acquisition camera and the excitation light source are in the same measurement, and the imaging speed is greatly improved by reflection imaging, so that real-time fluorescence tomography can be obtained. The dynamic imaging can observe the dynamic distribution of the probe in the body in real time, and can dynamically analyze the focus.
The invention adopts near infrared two-region imaging, which can improve the resolution of the three-dimensional reconstructed image; by utilizing the reflection type fluorescence tomography technology, only single-view reflection fluorescence data is used for three-dimensional fluorescence tomography reconstruction, so that the wide-field excitation is hopefully realized to obtain high-speed imaging speed, and real-time fluorescence tomography is obtained; the sample structure image is acquired by combining the single-view CT tomography technology of depth reconstruction, the rotation operation on the sample is not needed, the complexity of the system is reduced, the imaging speed is improved, and the structure image at the same time as the fluorescence imaging is obtained.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments of the present invention will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic hardware structure diagram of a single-view reflection near-infrared two-region dynamic fluorescence tomography system according to an embodiment of the present invention.
FIG. 2 is a flow chart of the operation process of the single view angle reflection type near infrared two-area dynamic fluorescence tomography system provided by the embodiment of the invention.
Fig. 3 is a schematic view of fluorescence tomographic reconstruction of a single-view reflection near-infrared two-region dynamic fluorescence tomographic imaging system according to an embodiment of the present invention.
Fig. 4 is a flowchart of a single view reflection type near infrared two-area fluorescence dynamic tomography method according to an embodiment of the present invention.
In the figure: 1. a light shielding box; 2. a two-zone camera; 3. an X-ray light source; 4. an excitation light source; 5. a central control center; 6. an X-ray detector; 7. an operation table; 8. and a lifting platform.
Detailed Description
The present invention will be described in further detail with reference to the following examples in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Aiming at the problems existing in the prior art, the invention provides a single-view reflection type near infrared two-region fluorescence dynamic tomography system and a method, and the invention is described in detail below with reference to the accompanying drawings.
As shown in fig. 4, the single-view reflection near-infrared two-region fluorescence dynamic tomography method provided by the embodiment of the invention includes the following steps:
s101, setting parameters such as a fluorescence excitation module, a near infrared two-region fluorescence acquisition module, a CT imaging module and the like through a central control module, and controlling the work of the modules;
s102, performing reflection acquisition on fluorescent signals by coupling an imaging lens with a near infrared two-area fluorescent detection camera, and acquiring transmission X-ray passing through an imaging organism by an X-ray flat panel detector;
s103, transmitting fluorescent signals acquired by a near infrared two-area fluorescent detection camera and X-ray signals detected by an X-ray flat panel detector to a computer through data lines respectively, reading the fluorescent signals by an image reading unit of the computer, and performing preprocessing operation of an image preprocessing unit;
s104, carrying out three-dimensional reconstruction on the preprocessed CT projection image by a CT image three-dimensional reconstruction unit in a deep learning mode to obtain a space structure diagram;
s105, utilizing a space structure diagram of three-dimensional reconstruction and a fluorescence image acquired by a near infrared two-region fluorescence detection camera, establishing a forward equation by combining tissue optical parameters, solving the forward equation by a regularization method, finally obtaining living body dynamic real-time bimodal tomographic image information, and displaying the fluorescence image, the CT projection image and the living body dynamic real-time bimodal tomographic image information by an image display unit.
The technical scheme of the invention is further described below with reference to specific embodiments.
Example 1
In order to overcome the problems of the infrared one-region fluorescence tomography technology, the invention provides single-view reflection type near infrared two-region dynamic fluorescence tomography, and compared with the traditional near infrared one-region fluorescence tomography technology, the single-view reflection type near infrared two-region dynamic fluorescence tomography has the advantages of high imaging resolution and large imaging depth due to the characteristics of small scattering, high sensitivity and the like. In addition, the invention has the advantage of single-view reflection imaging, and can obtain the dynamic real-time bimodal tomogram information of organisms by combining CT three-dimensional reconstruction.
The invention provides a single-view reflection type near infrared two-region dynamic fluorescence tomography system, which comprises: the system comprises a fluorescence imaging module, a CT imaging module, a central control module, a data processing module and an auxiliary module.
The invention sets parameters such as the fluorescence excitation module, the near infrared two-region fluorescence acquisition module, the CT imaging module and the like through the central control module and controls the work of the modules. The broad field laser is computer controlled and guided to the imaging organism through optical fiber to excite the probe in the body. The near infrared two-area fluorescence detection camera is coupled with the imaging lens to carry out reflection type acquisition on the fluorescence signals, wherein the acquired fluorescence signals are filtered by the filter, and the light sources except the probe excitation light are filtered. Meanwhile, the X-ray light pipe emits cone beam X-ray to irradiate the imaging organism for imaging, and the X-ray flat panel detector acquires the transmitted X-ray passing through the imaging organism to obtain a single-view X-ray projection image.
The fluorescent signals collected by the near infrared two-area fluorescent detection camera and the X-ray signals detected by the X-ray flat panel detector are respectively transmitted to a computer through a data line, are read by an image reading unit of the computer, and then are subjected to preprocessing operation of an image preprocessing unit.
And carrying out three-dimensional reconstruction on the preprocessed CT projection image by a CT image three-dimensional reconstruction unit in a deep learning mode to obtain a space structure diagram. And establishing a forward equation by utilizing a space structure diagram of three-dimensional reconstruction and a fluorescence image acquired by a near infrared two-region fluorescence detection camera and combining tissue optical parameters, then solving the forward equation by a regularization method to finally obtain the dynamic real-time bimodal tomographic image information of the organism, and displaying the fluorescence image, the CT projection image and the dynamic real-time bimodal tomographic image information of the organism by an image display unit.
According to some embodiments of a single view reflective near infrared two-zone dynamic fluorescence tomography system of the present invention, the imaging system further comprises an auxiliary module comprising: an optical stage for supporting each component module of the system; the light shielding box 1 is arranged on the optical platform and can prevent other light sources from entering the light shielding box 1, the light shielding box 1 is provided with an openable door, so that the modules in the box can be conveniently operated, and the like, and the system is in a closed state when in operation; a fixation plate for fixing an imaging organism; a lifting table 8 on which an imaging organism fixing plate is provided and which can be lifted to a position convenient for imaging. The top of the light shielding box 1 is provided with a two-area camera 2, an X-ray light source 3 and an excitation light source 4, the bottom of the light shielding box 1 is provided with an X-ray detector 6, the middle position of the light shielding box 1 is provided with a lifting table 8, the light shielding box 1 is placed on an operating table 7, and a central control center 5 is connected with the two-area camera 2, the X-ray light source 3, the excitation light source 4, the X-ray detector 5 and the lifting table 8.
The invention adopts near infrared two-region imaging, which can improve the resolution of the three-dimensional reconstructed image; by utilizing the reflection type fluorescence tomography technology, only single-view reflection fluorescence data is used for three-dimensional fluorescence tomography reconstruction, so that the wide-field excitation is hopefully realized to obtain high-speed imaging speed, and real-time fluorescence tomography is obtained; the sample structure image is acquired by combining the single-view CT tomography technology of depth reconstruction, the rotation operation on the sample is not needed, the complexity of the system is reduced, the imaging speed is improved, and the structure image at the same time as the fluorescence imaging is obtained.
Example 2
The invention discloses a single-view reflection type near infrared two-region dynamic fluorescence tomography system, which comprises: the device comprises a fluorescence excitation module, a near infrared two-region fluorescence acquisition module, a CT imaging module, a data processing module and a central control module. The near infrared two-region fluorescence tomography in the invention irradiates an imaging organism through a wide-field light source and acquires optical data through reflection fluorescence acquisition, and an optical tomography reconstruction mathematical model is established by combining structural image information obtained by CT imaging to reconstruct a three-dimensional space distribution image of a near infrared two-region fluorescence probe in the imaging organism. The CT imaging is performed with fluorescence imaging and single-view transmission scanning on the object, so that a CT projection image is obtained, and a three-dimensional structure image of the organism CT is obtained through a deep learning reconstruction technology. The imaging system uses near infrared two-region fluorescence for imaging, so that the detection depth and imaging spatial resolution of the biological fluorescent probe can be improved; and the optics and CT adopt single-view imaging, so that the imaging is realized simultaneously and in real time, and the dynamic real-time bimodal tomogram information of the organism is obtained.
The single-view reflection type near infrared two-region dynamic fluorescence tomography system provided by the invention comprises:
the fluorescence imaging module comprises an excitation module and a near infrared two-region fluorescence signal acquisition module. The excitation module consists of a halogen lamp and a multiband filter wheel, and can output wide-field excitation light with specific wave bands according to the absorption peak of the used fluorescent probe for irradiating the whole imaging organism. The near-infrared two-region fluorescence signal acquisition module is composed of a scientific-grade deep refrigeration near-infrared two-region camera coupling imaging lens and is used for shooting a reflective single-view near-infrared two-region fluorescence image.
The CT imaging module comprises an X-ray light pipe and an X-ray flat panel detector. The X-ray light pipe emits cone beam X-ray to irradiate the imaging organism for imaging, and the X-ray flat panel detector detects the transmitted X-ray passing through the imaging organism to obtain a single-view X-ray projection image.
And the central control module controls the fluorescence excitation module, the near infrared two-region fluorescence acquisition module and the CT imaging module to work in a coordinated manner.
And the data processing module is used for reading the fluorescence data and the CT projection data and preprocessing the fluorescence data and the CT projection data. And reconstructing three-dimensional CT image data by using a deep learning tomographic reconstruction technology according to the preprocessed CT projection data. And according to the preprocessed fluorescence data, an optical tomographic reconstruction mathematical model is established by combining structural image information obtained by CT imaging, and a three-dimensional space distribution image of the near infrared two-region fluorescence probe in the imaged organism is reconstructed.
In the fluorescence imaging module provided by the invention, the excitation module irradiates the whole imaging organism with wide-field excitation light, a near-infrared two-region fluorescence detection camera is adopted, and reflection-type near-infrared two-region fluorescence signals for shooting single visual angles are adopted on the same side for fluorescence fault reconstruction.
In the CT imaging module provided by the invention, the cone beam X-ray emitted by the X-ray light bulb irradiates the whole imaging organism, the X-ray flat panel detector detects the transmitted X-ray passing through the imaging organism, only single-view X-ray projection data are acquired, and three-dimensional CT image data are reconstructed by using a deep learning fault reconstruction technology.
The data processing module provided by the invention specifically comprises the following units:
the image reading unit is used for reading fluorescent images and CT projection images of the near infrared two-region fluorescent acquisition module and the CT imaging module;
the image preprocessing unit is used for preprocessing the read fluorescent image and CT projection image;
the CT image three-dimensional reconstruction unit is used for carrying out three-dimensional reconstruction on the CT projection image obtained by the CT imaging module in a deep learning mode to obtain a space structure image of the sample;
and the optical reconstruction unit is used for performing fluorescence tomography reconstruction on the space structure image obtained by the image three-dimensional reconstruction unit and the fluorescence image obtained by the optical information acquisition module. The reconstruction process is to establish a forward equation in combination with tissue optical parameters, then the forward equation is solved by a regularization method, and finally the living body dynamic real-time bimodal tomogram information is obtained;
and the image display unit is used for displaying the fluorescent image obtained by the optical information acquisition module, the CT projection image obtained by the CT imaging module and the biological dynamic real-time dual-mode tomogram information obtained by the optical reconstruction unit.
The single-view reflection type near infrared two-region dynamic fluorescence tomography system provided by the invention further comprises an auxiliary module, wherein the auxiliary module comprises:
an optical stage for supporting each of the different modules of the system;
the shading box is arranged on the optical platform and used for preventing other external light sources from entering.
And a sample fixing plate for fixing the sample.
And a lifting table on which the sample fixing plate is arranged and which can be lifted to a position convenient for imaging.
Example 3
Near infrared two-region imaging is a molecular imaging technique, which is a technique for imaging a focus by using near infrared two-region fluorescence with the wavelength of 1000nm-1700 nm. Compared with the traditional near infrared one-area imaging, the method has the advantage of high imaging resolution. The near infrared two-region imaging technology is combined with traditional structural imaging such as CT and the like, and three-dimensional reconstruction of images is carried out through deep learning, so that near infrared two-region dynamic three-dimensional tomography of focus can be realized, and the focus of organisms can be positioned more accurately.
Fig. 1 is a schematic structural diagram of a single view angle reflection type near infrared two-region dynamic fluorescence tomography system according to an embodiment of the invention. As shown in fig. 1, the single-view reflective near-infrared two-region dynamic fluorescence tomography system includes: a CT imaging module consisting of an X-ray tube for emitting X-ray beam to irradiate the sample and a detector for receiving X-ray; a fluorescence excitation module composed of a laser and an optical fiber for emitting laser and guiding the laser to strike the sample; a fluorescence information acquisition module consisting of a two-zone camera for acquiring fluorescence information and a lens; the device comprises a shading box for shading an experiment, an operating platform for placing other modules, a lifting platform for fixing a sample and lifting the sample to a corresponding position, and an auxiliary module consisting of a sample fixing plate; a data processing module operated by a computer and a central control module.
According to some embodiments of a single view reflective near infrared two-zone dynamic fluorescence tomography system of the present invention, a fluorescence imaging module includes an excitation module and a near infrared two-zone fluorescence signal acquisition module. The fluorescence excitation module is composed of a halogen lamp and a multiband filter wheel, and can output wide-field excitation light with specific wave bands according to the absorption peak of the used fluorescence probe to irradiate the whole imaging organism. The near-infrared two-region fluorescence acquisition module comprises a scientific-grade deep refrigeration near-infrared two-region camera coupling imaging lens, a filter capable of filtering out wave bands except excitation light is arranged between the lens and the camera, and only near-infrared two-region fluorescence signals emitted by the fluorescence probe are acquired. Fluorescence acquisition uses reflection, and fluorescence tomographic image reconstruction is performed by single-view fluorescence imaging.
According to some embodiments of a single view reflective near infrared two-zone dynamic fluorescence tomography system of the present invention, a CT imaging module comprises: an X-ray light pipe for emitting a fan-shaped X-ray; an X-ray flat panel detector for detecting a passing through an imaging organism; a power line for powering the CT imaging module and a data line for transmitting CT projection image data. The X-ray light pipe emits cone beam X-ray to irradiate the imaging organism for imaging, and the X-ray flat panel detector detects the transmitted X-ray passing through the imaging organism to obtain a single-view X-ray projection image.
FIG. 2 is a flow chart of near infrared two-zone dynamic fluorescence tomography by a central control module and a data processing module of a single view reflective near infrared two-zone dynamic fluorescence tomography system according to an embodiment of the invention. Under the control of the central control module, the X-ray tube emits X-rays, and the detector collects the X-rays. Simultaneously, the laser generator emits laser, and the two-area camera collects fluorescence information. After the acquisition is completed, the data are all transmitted into a computer through a data line, the data are preprocessed through a data processing module, three-dimensional reconstruction is carried out on CT data, the fluorescent data are preprocessed, a bimodal tomographic image is obtained through fluorescent tomographic reconstruction, and finally CT projection images, fluorescent tomographic images and biological dynamic real-time bimodal tomographic image information are displayed. The three-dimensional reconstruction of the CT projection image is realized by utilizing a deep learning mode, inputting a single two-dimensional projection image, and performing processing such as a convolution layer representing a network, so as to realize semantic learning from an image domain to a feature domain. And converting the two-dimensional characteristics of the characteristic domain into three-dimensional characteristics through a conversion network. And finally, converting the three-dimensional features of the feature domain into a 3D volume image through a generation network to realize three-dimensional reconstruction.
According to some embodiments of a single view reflective near infrared two-zone dynamic fluorescence tomography system of the present invention, a data processing module comprises: an image reading unit for acquiring CT projection image and fluorescence image data; an image preprocessing unit for correcting the read CT projection image and preprocessing fluorescent image enhancement, denoising and the like of fluorescent data; an image three-dimensional reconstruction unit for performing deep learning on the preprocessed CT projection image and performing three-dimensional reconstruction; an optical three-dimensional reconstruction unit for performing fluorescence tomography reconstruction on the acquired fluorescence image; and the image display unit is used for displaying the CT projection image, the fluorescent image and the final biological dynamic real-time bimodal tomogram information.
The CT three-dimensional reconstruction method based on the deep learning comprises the steps of firstly, carrying out full-angle scanning on an object to obtain projection data of all angles, obtaining a 3D reconstruction image through a filtered back projection reconstruction technology, taking the 3D reconstruction image as a label of the deep learning, taking a single two-dimensional projection image of the object as a training set, and carrying out learning training to form a learning network. Then, a single two-dimensional projection image of the object is taken as input, and output is obtained through a learning network formed before. The training process is to input a single two-dimensional projection image, and the semantic learning from the image domain to the feature domain is realized through the processing of a convolution layer of a representation network and the like. And converting the two-dimensional characteristics of the characteristic domain into three-dimensional characteristics through a conversion network. And finally, converting the three-dimensional features of the feature domain into a 3D volume image through a generation network to realize three-dimensional reconstruction of the CT image. The optical reconstruction unit establishes a forward equation by combining tissue optical parameters, and then solves the forward equation by a regularization method to finally obtain a reconstruction result. Fig. 3 is a schematic diagram of near infrared two-region fluorescence tomographic reconstruction by a data processing module of a single view reflection near infrared two-region dynamic fluorescence tomographic imaging system according to an embodiment of the invention. From the figure, it can be seen that the forward equation can be established by combining the CT three-dimensional reconstruction result and fluorescence data processing with tissue optical parameters, and then the forward equation is solved by a regularization method, so that the reconstruction result can be obtained. The processing of the CT reconstruction result comprises CT result segmentation, 3D mesh subdivision and establishment of a radiation transmission equation. And the processing of the optical data includes mapping parameter calculation, 2D/3D mapping and 3D mapping surface light intensity distribution.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When used in whole or in part, is implemented in the form of a computer program product comprising one or more computer instructions. When loaded or executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL), or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk SolidStateDisk (SSD)), etc.
The foregoing is merely illustrative of specific embodiments of the present invention, and the scope of the invention is not limited thereto, but any modifications, equivalents, improvements and alternatives falling within the spirit and principles of the present invention will be apparent to those skilled in the art within the scope of the present invention.

Claims (7)

1. A single view reflective near infrared two-zone fluorescence dynamic tomographic imaging system, the single view reflective near infrared two-zone fluorescence dynamic tomographic imaging system comprising:
the fluorescence imaging module comprises an excitation module and a near infrared two-region fluorescence signal acquisition module; the excitation module consists of a halogen lamp and a multiband filter wheel, outputs wide-field excitation light with a specific wave band according to the absorption peak of the used fluorescent probe, and is used for irradiating the whole imaging organism; the near infrared two-region fluorescence signal acquisition module consists of a scientific-grade deep refrigeration near infrared two-region camera coupling imaging lens and is used for shooting a reflection type single-view near infrared two-region fluorescence image;
the CT imaging module comprises an X-ray light pipe and an X-ray flat panel detector; the X-ray light pipe emits cone beam X-ray to irradiate an imaging organism for imaging, and the X-ray flat panel detector detects the transmitted X-ray passing through the imaging organism to obtain a single-view X-ray projection image;
the central control module is used for controlling the fluorescence excitation module, the near infrared two-region fluorescence acquisition module and the CT imaging module to work in a coordinated manner;
the data processing module is used for reading the fluorescence data and the CT projection data and preprocessing the fluorescence data and the CT projection data; according to the preprocessed CT projection data, reconstructing three-dimensional CT image data by using a deep learning tomographic reconstruction technology; and according to the preprocessed fluorescence data, an optical tomographic reconstruction mathematical model is established by combining structural image information obtained by CT imaging, and a three-dimensional space distribution image of the near infrared two-region fluorescence probe in the imaged organism is reconstructed.
2. The single view reflective near infrared two-zone fluorescence dynamic tomographic imaging system of claim 1, wherein the excitation module in the fluorescence imaging module irradiates the whole imaging organism with wide field excitation light, employs a near infrared two-zone fluorescence detection camera, and employs reflection-type single view near infrared two-zone fluorescence signals on the same side for fluorescence tomographic reconstruction.
3. The single view reflective near infrared two-zone fluorescence dynamic tomographic imaging system of claim 1, wherein the cone beam X-ray emitted by the X-ray light bulb of the CT imaging module irradiates the whole imaging organism, the X-ray flat panel detector detects the transmitted X-ray passing through the imaging organism, only single view X-ray projection data is acquired, and three-dimensional CT image data is reconstructed using a deep learning tomographic reconstruction technique.
4. The single view reflective near infrared two region fluorescence dynamic tomography system of claim 1, wherein the data processing module comprises:
the image reading unit is used for reading fluorescent images and CT projection images of the near infrared two-region fluorescent acquisition module and the CT imaging module;
the image preprocessing unit is used for preprocessing the read fluorescent image and CT projection image;
the CT image three-dimensional reconstruction unit is used for carrying out three-dimensional reconstruction on the CT projection image obtained by the CT imaging module in a deep learning mode to obtain a space structure image of the sample;
the optical reconstruction unit is used for performing fluorescence tomography reconstruction on the space structure image obtained by the image three-dimensional reconstruction unit and the fluorescence image obtained by the optical information acquisition module; the reconstruction process is to establish a forward equation in combination with tissue optical parameters, and to solve the forward equation by a regularization method, so as to finally obtain the dynamic real-time bimodal tomogram information of the organism;
and the image display unit is used for displaying the fluorescent image obtained by the optical information acquisition module, the CT projection image obtained by the CT imaging module and the organism dynamic real-time bimodal tomographic image information obtained by the optical reconstruction unit.
5. The single view reflective near infrared two region fluorescence dynamic tomography system of claim 1, further comprising an auxiliary module comprising:
an optical stage for supporting each of the different modules of the system;
the shading box is arranged on the optical platform and used for preventing other external light sources from entering;
the sample fixing plate is used for fixing the sample;
and the lifting platform is used for arranging the sample fixing plate on the lifting platform and can be lifted to a position convenient for imaging.
6. A single view reflective near infrared two-zone fluorescence dynamic tomographic imaging method for operating the single view reflective near infrared two-zone fluorescence dynamic tomographic imaging system as in any one of claims 1 to 5, comprising the steps of:
setting parameters such as a fluorescence excitation module, a near infrared two-region fluorescence acquisition module, a CT imaging module and the like through a central control module, and controlling the work of the modules;
step two, coupling an imaging lens by a near infrared two-area fluorescence detection camera to perform reflection acquisition on fluorescence signals, and acquiring transmission X-ray passing through an imaging organism by an X-ray flat panel detector;
transmitting a fluorescence signal acquired by a near infrared two-area fluorescence detection camera and an X-ray signal detected by an X-ray flat panel detector to a computer through a data line respectively, reading the fluorescence signal by an image reading unit of the computer, and performing preprocessing operation of an image preprocessing unit;
step four, carrying out three-dimensional reconstruction on the preprocessed CT projection image by a CT image three-dimensional reconstruction unit in a deep learning mode to obtain a space structure diagram;
and fifthly, utilizing a space structure diagram of three-dimensional reconstruction and a fluorescence image acquired by a near infrared two-region fluorescence detection camera, establishing a forward equation by combining tissue optical parameters, solving the forward equation by a regularization method, finally obtaining the dynamic real-time bimodal tomographic image information of the organism, and displaying the fluorescence image, the CT projection image and the dynamic real-time bimodal tomographic image information of the organism by an image display unit.
7. The method of single view reflective near infrared two-zone fluorescence dynamic tomography according to claim 6, wherein in the second step, the broad field laser is controlled by a computer and guided to the imaging organism through the optical fiber to excite the probe in the imaging organism; the method comprises the steps that a near infrared two-region fluorescence detection camera is coupled with an imaging lens to carry out reflection type acquisition on fluorescent signals, wherein the acquired fluorescent signals are filtered by a filter to filter out light sources except probe excitation light; meanwhile, the X-ray light pipe emits cone beam X-ray to irradiate the imaging organism for imaging, and the X-ray flat panel detector acquires the transmitted X-ray passing through the imaging organism to obtain a single-view X-ray projection image.
CN202210096054.7A 2022-01-26 2022-01-26 Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method Active CN114468998B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210096054.7A CN114468998B (en) 2022-01-26 2022-01-26 Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210096054.7A CN114468998B (en) 2022-01-26 2022-01-26 Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method

Publications (2)

Publication Number Publication Date
CN114468998A CN114468998A (en) 2022-05-13
CN114468998B true CN114468998B (en) 2023-06-30

Family

ID=81476364

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210096054.7A Active CN114468998B (en) 2022-01-26 2022-01-26 Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method

Country Status (1)

Country Link
CN (1) CN114468998B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103239255A (en) * 2013-05-20 2013-08-14 西安电子科技大学 Cone-beam X-ray luminescence computed tomography method
CN106419837A (en) * 2016-08-26 2017-02-22 西北大学 Fluorescent molecular tomography system based on spiral motivation
CN109044277A (en) * 2018-08-10 2018-12-21 中国科学院自动化研究所 Two area's fluorescence computed tomography (SPECT) system of near-infrared

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110327020B (en) * 2019-07-04 2021-09-28 中国科学院自动化研究所 Near-infrared two-zone/one-zone bimodal fluorescence tomography system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103239255A (en) * 2013-05-20 2013-08-14 西安电子科技大学 Cone-beam X-ray luminescence computed tomography method
CN106419837A (en) * 2016-08-26 2017-02-22 西北大学 Fluorescent molecular tomography system based on spiral motivation
CN109044277A (en) * 2018-08-10 2018-12-21 中国科学院自动化研究所 Two area's fluorescence computed tomography (SPECT) system of near-infrared

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
组织仿体液中近红外荧光分子探针的3-D成像;胡刚;姚俊杰;宋小磊;白净;;航天医学与医学工程(第02期);全文 *

Also Published As

Publication number Publication date
CN114468998A (en) 2022-05-13

Similar Documents

Publication Publication Date Title
JP7279957B2 (en) Quantitative imaging system and its use
EP1968431B2 (en) Combined x-ray and optical tomographic imaging system
EP2579777B1 (en) Second generation hand-held optical imager
Pogue et al. Image analysis methods for diffuse optical tomography
US7804075B2 (en) Method and system for tomographic imaging using fluorescent proteins
CA2810822C (en) Systems and methods for virtual index-matching of diffusive media
CN105595968B (en) Subject information obtaining device and subject information obtaining method
Singh et al. In vivo demonstration of reflection artifact reduction in photoacoustic imaging using synthetic aperture photoacoustic-guided focused ultrasound (PAFUSion)
CN107468234B (en) Three-dimensional imaging system and imaging method for blood vessel blood flow projection chromatography
JP5911196B2 (en) Photoacoustic imaging device
WO2005089637A9 (en) Method and system for tomographic imaging using fluorescent proteins
JP2008161283A (en) Medical imaging system and method
WO2013134949A1 (en) Device and method for endoscopic x ray luminescence tomography imaging
Cai et al. In vivo deconvolution acoustic-resolution photoacoustic microscopy in three dimensions
CN112089404B (en) Endoscopic OCT-Raman dual-mode imaging device and imaging method
CN104825180A (en) Tri-modal breast imaging system and imaging method thereof
CN109044277A (en) Two area's fluorescence computed tomography (SPECT) system of near-infrared
Najafzadeh et al. Photoacoustic image improvement based on a combination of sparse coding and filtering
CN108272439A (en) Subject information processing unit and method for displaying image
CN114468998B (en) Single-view angle reflection type near infrared two-region fluorescence dynamic tomography system and method
EP1998665A1 (en) A device for imaging a turbid medium
Xing et al. Automatic force-controlled 3D photoacoustic system for human peripheral vascular imaging
EP1797818A2 (en) Method and system for tomographic imaging using fluorescent proteins
Kirchner et al. Freehand photoacoustic tomography for 3D angiography using local gradient information
Zou et al. PA-NeRF, a neural radiance field model for 3D photoacoustic tomography reconstruction from limited Bscan data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant