US20240112336A1 - X-ray computed tomography apparatus, information processing system, information processing method, and non-transitory computer-readable medium - Google Patents
X-ray computed tomography apparatus, information processing system, information processing method, and non-transitory computer-readable medium Download PDFInfo
- Publication number
- US20240112336A1 US20240112336A1 US18/478,731 US202318478731A US2024112336A1 US 20240112336 A1 US20240112336 A1 US 20240112336A1 US 202318478731 A US202318478731 A US 202318478731A US 2024112336 A1 US2024112336 A1 US 2024112336A1
- Authority
- US
- United States
- Prior art keywords
- inference
- unit
- image data
- display
- ray
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000002591 computed tomography Methods 0.000 title claims abstract description 211
- 230000010365 information processing Effects 0.000 title claims description 19
- 238000003672 processing method Methods 0.000 title claims description 10
- 239000000463 material Substances 0.000 claims abstract description 255
- 238000000354 decomposition reaction Methods 0.000 claims abstract description 217
- 238000012545 processing Methods 0.000 claims abstract description 63
- 238000003384 imaging method Methods 0.000 claims abstract description 46
- 230000003902 lesion Effects 0.000 claims description 29
- 230000004044 response Effects 0.000 claims description 11
- 239000002131 composite material Substances 0.000 claims description 8
- 238000010191 image analysis Methods 0.000 description 31
- 230000006870 function Effects 0.000 description 26
- OYPRJOBELJOOCE-UHFFFAOYSA-N Calcium Chemical compound [Ca] OYPRJOBELJOOCE-UHFFFAOYSA-N 0.000 description 18
- 229910052791 calcium Inorganic materials 0.000 description 18
- 239000011575 calcium Substances 0.000 description 18
- 238000001514 detection method Methods 0.000 description 16
- 238000013528 artificial neural network Methods 0.000 description 15
- ZCYVEMRRCGMTRW-UHFFFAOYSA-N 7553-56-2 Chemical compound [I] ZCYVEMRRCGMTRW-UHFFFAOYSA-N 0.000 description 13
- 229910052740 iodine Inorganic materials 0.000 description 13
- 239000011630 iodine Substances 0.000 description 13
- 238000000034 method Methods 0.000 description 12
- 238000004458 analytical method Methods 0.000 description 11
- 229910052751 metal Inorganic materials 0.000 description 11
- 239000002184 metal Substances 0.000 description 11
- 230000002308 calcification Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000012549 training Methods 0.000 description 6
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 6
- 229910001868 water Inorganic materials 0.000 description 6
- 206010028980 Neoplasm Diseases 0.000 description 5
- 238000004590 computer program Methods 0.000 description 5
- 238000013170 computed tomography imaging Methods 0.000 description 4
- 230000010354 integration Effects 0.000 description 4
- 230000011218 segmentation Effects 0.000 description 4
- 239000013077 target material Substances 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- PNDPGZBMCMUPRI-UHFFFAOYSA-N iodine Chemical compound II PNDPGZBMCMUPRI-UHFFFAOYSA-N 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 206010006187 Breast cancer Diseases 0.000 description 2
- 208000026310 Breast neoplasm Diseases 0.000 description 2
- 238000002083 X-ray spectrum Methods 0.000 description 2
- 229910052782 aluminium Inorganic materials 0.000 description 2
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 2
- 239000002872 contrast media Substances 0.000 description 2
- 210000005075 mammary gland Anatomy 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000005401 electroluminescence Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 210000002751 lymph Anatomy 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/032—Transmission computed tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/032—Transmission computed tomography [CT]
- A61B6/035—Mechanical aspects of CT
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/46—Arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5205—Devices using data or image processing specially adapted for radiation diagnosis involving processing of raw data to produce diagnostic data
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5217—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data extracting a diagnostic or physiological parameter from medical diagnostic data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/003—Reconstruction from projections, e.g. tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/40—Arrangements for generating radiation specially adapted for radiation diagnosis
- A61B6/4064—Arrangements for generating radiation specially adapted for radiation diagnosis specially adapted for producing a particular type of beam
- A61B6/4085—Cone-beams
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/42—Arrangements for detecting radiation specially adapted for radiation diagnosis
- A61B6/4208—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector
- A61B6/4241—Arrangements for detecting radiation specially adapted for radiation diagnosis characterised by using a particular type of detector using energy resolving detectors, e.g. photon counting
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/48—Diagnostic techniques
- A61B6/482—Diagnostic techniques involving multiple energy imaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
Definitions
- the present disclosure relates to an X-ray computed tomography (CT) apparatus equipped with a photon counting CT function, an information processing system, an information processing method, and a non-transitory computer-readable medium.
- CT computed tomography
- An X-ray computed tomography (CT) apparatus equipped with a photon counting CT function counts individual incident X-rays and measures the energy of the incident X-rays, thereby obtaining an X-ray spectrum.
- the X-ray CT apparatus is capable identifying a material included in a subject and generating material decomposition image data.
- the X-ray CT apparatus equipped with a photon counting CT function is also capable of reconstructing CT image data (integral image data) (for example, Japanese Patent Laid-Open No. 2018-175866).
- inference tasks performed by a neural network include a classification task of classifying a class of image data and a detection task of detecting what is captured at which position in image data.
- An inference result may vary depending on whether an inference task is performed on material decomposition image data or CT image data (integral image data) obtained by an X-ray CT apparatus equipped with a photon counting CT function.
- An X-ray CT apparatus includes an X-ray tube configured to radiate X-rays; a detector configured to detect X-rays radiated by the X-ray tube and passed through a subject; a reconstruction processing unit configured to reconstruct imaging data output by the detector and generate CT image data and material decomposition image data; a first inference unit configured to perform inference on the material decomposition image data; a second inference unit configured to perform inference on the CT image data; and a display control unit configured to cause a display unit to display at least one of an inference result of the first inference unit and an inference result of the second inference unit.
- An information processing system includes a first inference unit configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of an X-ray CT apparatus; a second inference unit configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; and a display control unit configured to cause a display unit to display at least one of an inference result of the first inference unit and an inference result of the second inference unit.
- An information processing method includes generating CT image data and material decomposition image data that are based on X-rays radiated by an X-ray tube and passed through a subject; and causing a display unit to display at least one of an inference result of a first inference unit configured to perform inference on the material decomposition image data and an inference result of a second inference unit configured to perform inference on the CT image data.
- FIG. 1 is a diagram illustrating an example configuration of an X-ray computed tomography (CT) apparatus according to an embodiment of the present disclosure.
- FIG. 2 is a diagram illustrating an example of a peripheral configuration of an inference unit of an X-ray CT apparatus according to an embodiment of the present disclosure.
- FIG. 3 is a diagram illustrating one display mode of a display unit in an X-ray CT apparatus according to an embodiment of the present disclosure.
- FIG. 4 is a diagram illustrating one display mode of a display unit in an X-ray CT apparatus according to an embodiment of the present disclosure.
- FIG. 5 is a flowchart illustrating an example operation of an X-ray CT apparatus according to an embodiment of the present disclosure.
- FIG. 6 is a diagram illustrating an example of a peripheral configuration of an inference unit of an X-ray CT apparatus according to an embodiment of the present disclosure.
- FIG. 7 is a flowchart illustrating an example operation of an X-ray CT apparatus according to an embodiment of the present disclosure.
- FIG. 8 is a diagram illustrating an example of a peripheral configuration of an inference unit of an X-ray CT apparatus according to an embodiment of the present disclosure.
- FIG. 9 is a flowchart illustrating an example operation of an X-ray CT apparatus according to an embodiment of the present disclosure.
- CT computed tomography
- An X-ray CT apparatus 1 illustrated in FIG. 1 includes a platform device (gantry) 10 , a bed device 30 , and a console device 40 .
- a rotational axis direction of a rotary frame 13 or a longitudinal direction of a top plate 33 of the bed device 30 in a non-tilted state is defined as a Z-axis direction
- an axis direction orthogonal to the Z-axis direction and horizontal to a floor surface is defined as an X-axis direction
- an axis direction orthogonal to the Z-axis direction and vertical to the floor surface is defined as a Y-axis direction.
- the platform device 10 and the bed device 30 are installed in a CT examination room, and the console device 40 is installed in a control room adjacent to the CT examination room.
- the console device 40 need not necessarily be installed in the control room.
- the console device 40 may be installed in the room having the platform device 10 and the bed device 30 installed therein.
- the platform device 10 , the bed device 30 , and the console device 40 are connected to each other in a wired or wireless manner so as to be capable of communicating with each other.
- the platform device 10 is a scanning device having a configuration for performing X-ray CT imaging on a subject P.
- the platform device 10 includes an X-ray tube 11 , a detector 12 , the rotary frame 13 , an X-ray high voltage device 14 , a control device 15 , a wedge 16 , a collimator 17 , and a data collection device 18 (hereinafter also referred to as a data acquisition system (DAS)).
- DAS data acquisition system
- the X-ray tube 11 is a vacuum tube that generates X-rays by radiating thermoelectrons from a cathode (filament) toward an anode (target) by application of a high voltage and supply of a filament current from the X-ray high voltage device 14 .
- X-rays are generated as a result of thermoelectrons colliding with the target.
- the X-ray tube 11 may be a rotating anode X-ray tube that generates X-rays by radiating thermoelectrons to a rotating anode.
- the X-rays generated by the X-ray tube 11 are shaped into a cone beam shape via, for example, the collimator 17 , and are radiated to the subject P.
- the X-ray tube 11 is an example of an X-ray generation unit.
- the detector 12 detects X-rays radiated by the X-ray tube 11 and passed through the subject P, and outputs a signal corresponding to an X-ray dosage to the DAS 18 .
- the detector 12 includes, for example, a plurality of X-ray detection element rows in each of which a plurality of X-ray detection elements are arranged in a channel direction along one arc with the focal point of the X-ray tube 11 being the center.
- the detector 12 has, for example, a row structure in which a plurality of X-ray detection element rows, in each of which a plurality of X-ray detection elements are arranged in the channel direction, are arranged in a slice direction (row direction).
- the detector 12 is a photon-counting detector.
- a reconstruction processing unit is capable of reconstructing CT image data (integral image data) with a high S/N ratio by counting the number of photons of X-rays passed through the subject P by using the photon-counting detector.
- the detector 12 may be classified into an energy integration function or a photon counting function depending on the method for measurement performed on a converted signal by the DAS 18 .
- the energy integration function integrates the energy of X-rays passed through the subject P for a certain period of time, thereby measuring the total sum of the energy of the X-rays passed during the certain period of time.
- the photon counting function measures the number of X-ray photons included in X-rays passed through the subject P, for each of a plurality of energy bands (also referred to as energy bins or simply as bins). This makes it possible to perform material decomposition based on imaging data obtained for each energy band.
- an imaging mode in which material decomposition is performed is referred to as a material decomposition mode (material decomposition image mode), and an imaging mode in which material decomposition is not performed is referred to as a non-material-decomposition mode (integral image mode).
- the rotary frame 13 supports an X-ray generation unit and an X-ray detection unit so as to be rotatable around the rotational axis Z.
- the rotary frame 13 is an annular frame that supports the X-ray tube 11 and the detector 12 so as to be opposed to each other, and rotates the X-ray tube 11 and the detector 12 by the control device 15 .
- the rotary frame 13 is rotatably supported by a fixed frame (not illustrated) formed of a metal such as aluminum.
- the rotary frame 13 is connected to an edge portion of the fixed frame via a bearing.
- the rotary frame 13 receives power from a driving mechanism of the control device 15 and rotates around the rotational axis Z at a constant angular velocity.
- the rotary frame 13 further includes and supports the X-ray high voltage device 14 and the DAS 18 in addition to the X-ray tube 11 and the detector 12 .
- the rotary frame 13 is accommodated in a substantially cylindrical housing having an opening (bore) 19 serving as an imaging space.
- the opening 19 substantially coincides with the FOV.
- the center axis of the opening 19 coincides with the rotational axis Z of the rotary frame 13 .
- Imaging data generated by the DAS 18 is transmitted, for example, from a transmitter including a light emitting diode (LED) to a receiver (not illustrated) including a photodiode provided in a non-rotating portion (fixed frame) of the platform device 10 by optical communication, and is transferred to the console device 40 .
- the method of transmitting the imaging data from the rotary frame 13 to the non-rotating portion of the platform device 10 is not limited to optical communication, and any non-contact data transmission method may be employed.
- the X-ray high voltage device 14 includes electric circuits such as a transformer and a rectifier, a high voltage generator having a function of generating a high voltage to be applied to the X-ray tube 11 and a filament current to be supplied to the X-ray tube 11 , and an X-ray controller that controls an output voltage in accordance with X-rays radiated by the X-ray tube 11 .
- the high voltage generator may employ a transformer scheme or an inverter scheme.
- the X-ray high voltage device 14 may be provided in the rotary frame 13 or on the fixed frame side of the platform device 10 .
- the control device 15 includes a processing circuit including a central processing unit (CPU) or the like, and a driving mechanism such as a motor or an actuator.
- the processing circuit includes, as hardware resources, a processor such as a CPU or a micro processing unit (MPU), and a memory such as a read only memory (ROM) or a random access memory (RAM).
- the control device 15 may be implemented by an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), another complex programmable logic device (CPLD), or a simple programmable logic device (SPLD).
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- CPLD complex programmable logic device
- SPLD simple programmable logic device
- the control device 15 controls the X-ray high voltage device 14 , the DAS 18 , and so forth in accordance with instructions from the console device 40 .
- the processor implements the above control by reading and executing a program stored in the memory.
- the wedge 16 is a filter for adjusting the dosage of X-rays radiated by the X-ray tube 11 .
- the wedge 16 is a filter that passes and attenuates the X-rays radiated by the X-ray tube 11 so that the X-rays radiated from the X-ray tube 11 to the subject P have a predetermined distribution.
- the wedge 16 (a wedge filter or a bow-tie filter) is a filter obtained by processing aluminum to have a predetermined target angle and a predetermined thickness.
- the collimator 17 is a lead plate or the like for narrowing down the radiation range of the X-rays passed through the wedge 16 , and has a slit in accordance with a combination of a plurality of lead plates or the like.
- the collimator 17 may be referred to as an X-ray aperture.
- the DAS 18 generates, for each of a plurality of energy bands, digital data (also referred to as imaging data) indicating a count value of X-ray photons detected by the detector 12 .
- the imaging data is a data set of count values identified by the channel number, row number, view number indicating an acquisition view (projection angle), and energy bin number of the X-ray detection elements as a generation source.
- the DAS 18 is implemented by, for example, an application specific integrated circuit (ASIC) having a circuit element capable of generating imaging data.
- ASIC application specific integrated circuit
- the bed device 30 is a device on which the subject P to be scanned is to be placed and moved, and includes a base 31 , a bed driving device 32 , the top plate 33 , and a support frame 34 .
- the base 31 is a housing that supports the support frame 34 so as to be movable in the vertical direction.
- the bed driving device 32 is a motor or an actuator that moves the top plate 33 on which the subject P is placed in the longitudinal direction of the top plate 33 .
- the bed driving device 32 moves the top plate 33 in accordance with control by the console device 40 or the control device 15 .
- the bed driving device 32 moves the top plate 33 in a direction orthogonal to the subject P so that the body axis of the subject P placed on the top plate 33 coincides with the central axis of the opening of the rotary frame 13 .
- the bed driving device 32 may move the top plate 33 in the direction of the body axis of the subject P in accordance with X-ray CT imaging performed using the platform device 10 .
- the bed driving device 32 generates power by being driven at a rotation speed corresponding to the duty ratio or the like of a driving signal from the control device 15 .
- the bed driving device 32 is implemented by, for example, a motor such as a direct drive motor or a servo motor.
- the top plate 33 provided on the upper surface of the support frame 34 is a plate on which the subject P is to be placed.
- the bed driving device 32 may move, in addition to the top plate 33 , the support frame 34 in the longitudinal direction of the top plate 33 .
- the console device 40 includes a memory 41 , a display unit 42 , an operation unit 43 , and a processing circuit 44 . Data communication among the memory 41 , the display unit 42 , the operation unit 43 , and the processing circuit 44 is performed via a bus. Although the console device 40 is described as a separate body separated from the platform device 10 , the console device 40 or some of the constituent elements of the console device 40 may be included in the platform device 10 .
- the memory 41 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or an integrated circuit storage device that stores various kinds of information.
- HDD hard disk drive
- SSD solid state drive
- integrated circuit storage device that stores various kinds of information.
- the memory 41 stores, for example, imaging data and reconstructed image data.
- the memory 41 is not limited to an HDD or SSD, and may be a drive device that reads and writes various kinds of information from and to a portable storage medium such as a compact disc (CD), a digital versatile disc (DVD), or a flash memory, a semiconductor memory element such as a random access memory (RAM), or the like.
- the storage area of the memory 41 may be in the X-ray CT apparatus 1 or in an external storage device connected via a network.
- the memory 41 stores data of a CT image and a display image.
- the memory 41 also stores a control program according to an embodiment.
- the display unit 42 displays various kinds of information.
- the display unit 42 outputs a medical image (CT image) generated by the processing circuit 44 and a graphical user interface (GUI) for receiving various operations from an operator.
- CT image medical image
- GUI graphical user interface
- a liquid crystal display (LCD) unit, a cathode ray tube (CRT) display unit, an organic electroluminescence display (OELD) unit, a plasma display unit, or any other display unit may be used as appropriate.
- the display unit 42 may be provided in the platform device 10 .
- the display unit 42 may be of a desktop type or may be constituted by a tablet terminal or the like capable of wirelessly communicating with the main body of the console device 40 .
- the operation unit 43 receives various input operations from the operator, converts the received input operations into electric signals, and outputs the electric signals to the processing circuit 44 .
- the operation unit 43 receives, from the operator, an acquisition condition for acquiring imaging data, a reconstruction condition for reconstructing a CT image, an image processing condition for generating a post-processed image from a CT image, and the like.
- a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch pad, or a touch panel display unit may be used as appropriate.
- the operation unit 43 is not limited to a unit including a physical operation component such as a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch pad, or a touch panel display unit.
- a physical operation component such as a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch pad, or a touch panel display unit.
- an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the apparatus and outputs the electric signal to the processing circuit 44 is also included in examples of the operation unit 43 .
- the operation unit 43 may be provided in the platform device 10 .
- the operation unit 43 may be constituted by a tablet terminal or the like capable of wirelessly communicating with the main body of the console device 40 .
- the processing circuit 44 controls the operation of the entire X-ray CT apparatus 1 in accordance with an electric signal of an input operation output from the operation unit 43 .
- the processing circuit 44 includes, as hardware resources, a processor such as a CPU, an MPU, or a graphics processing unit (GPU), and a memory such as a ROM or a RAM.
- the processing circuit 44 implements, by the processor that executes a program loaded in the memory, a control unit 441 , a reconstruction processing unit 442 , an image analysis unit 443 , an inference unit 444 , a selection unit 445 , and a display control unit 446 .
- the individual functions are not necessarily implemented by a single processing circuit.
- a plurality of independent processors may be combined to constitute a processing circuit, and the individual processors may execute a program to implement the individual functions.
- the control unit 441 controls each function of the processing circuit 44 in accordance with an input operation received from the operator via the operation unit 43 . Specifically, the control unit 441 reads out a control program stored in the memory 41 , loads the control program into the memory in the processing circuit 44 , and controls each unit of the X-ray CT apparatus 1 in accordance with the loaded control program. The control unit 441 performs preprocessing, such as logarithmic transformation processing, offset correction processing, inter-channel sensitivity correction processing, or beam hardening correction, on the imaging data output from the DAS 18 , thereby generating preprocessed imaging data.
- preprocessing such as logarithmic transformation processing, offset correction processing, inter-channel sensitivity correction processing, or beam hardening correction
- the reconstruction processing unit 442 has a function of generating CT image data, based on the imaging data output by the detector 12 (DAS 18 ).
- the reconstruction processing unit 442 reconstructs CT image data by performing, for example, back projection processing on the imaging data stored in the memory 41 .
- the back projection processing may be, for example, back projection processing based on a filtered back projection (FBP) method.
- the reconstruction processing unit 442 may perform reconstruction processing by using, for example, successive approximations.
- the reconstruction processing unit 442 generates CT image data by performing various kinds of image processing on the CT image data.
- the reconstruction processing unit 442 stores the reconstructed CT image data and the CT image data generated through various kinds of image processing in the memory 41 .
- the reconstruction processing unit 442 calculates energy integration data by using the sum (total value) of the counts of individual energy bins or the sum of the products of the representative values and the counts of energy bins, which is a signal obtained by the photon-counting detector 12 .
- the reconstruction processing unit 442 is capable of reconstructing CT image data (integral image data) by using the energy integration data.
- the reconstruction processing unit 442 is capable of performing material decomposition on imaging data and acquiring material decomposition information.
- the reconstruction processing unit 442 is also capable of reconstructing material decomposition image data indicating material decomposition by using material decomposition information, which is a result of material decomposition.
- imaging data generated from a counting result obtained by the photon-counting X-ray CT apparatus 1 includes information on the energy spectrum of X-rays attenuated as a result of passing through the subject P.
- the reconstruction processing unit 442 is capable of reconstructing, for example, material decomposition image data obtained by imaging a specific energy component.
- the image analysis unit 443 analyzes material decomposition image data. By analyzing the material decomposition image data, the image analysis unit 443 is capable of obtaining how much of a predetermined material is included in the material decomposition image data, or how much of a predetermined lesion is included in the material decomposition image data.
- the inference unit 444 is capable of performing inference on material decomposition image data.
- the inference unit 444 is capable of performing inference on CT image data (integral image data).
- the inference unit 444 is capable of performing inference on each of material decomposition image data and CT image data.
- the inference unit 444 is also capable of performing inference on composite image data composed of material decomposition image data and CT image data (integral image data).
- the inference unit 444 includes a first inference unit 450 and a second inference unit 451 .
- the first inference unit 450 performs inference on material decomposition image data or composite image data composed of material decomposition image data and CT image data by using a neural network.
- the second inference unit 451 performs inference on CT image data by using a neural network.
- the first inference unit 450 obtains teaching data in advance.
- the teaching data is determined in accordance with an inference task performed by the neural network or a classification target.
- Examples of an inference task performed by the neural network include a classification task of classifying the class of material decomposition image data, a detection task of detecting which material is present at which position in material decomposition image data, and a segmentation task of extracting a target region from material decomposition image data.
- the material decomposition image data used as teaching data is material decomposition image data or composite image data composed of material decomposition image data and CT image data.
- the first inference unit 450 obtains teaching data including a pair of material decomposition image data and a correct answer label, which is a label indicating a target material that is present in the material decomposition image data.
- the first inference unit 450 obtains, for material decomposition image data, teaching data including a pair of a region of interest (ROI) indicating the position of a target material that is present in the material decomposition image data and a correct answer image having a correct answer label, which is a label indicating the target.
- ROI region of interest
- the first inference unit 450 obtains, for material decomposition image data, teaching data including a pair of position information of pixels of a target material that is present in the material decomposition image data and a correct answer image having a correct answer label, which is a label indicating the target material.
- the second inference unit 451 obtains teaching data in advance.
- the teaching data is determined in accordance with an inference task performed by the neural network or a classification target.
- Examples of an inference task performed by the neural network include a classification task of classifying the class of CT image data (integral image data), a detection task of detecting which is present at which position in CT image data, and a segmentation task of extracting a target region from CT image data.
- the second inference unit 451 obtains teaching data including a pair of CT image data and a correct answer label, which is a label indicating a target that is present in the CT image data.
- the second inference unit 451 obtains, for CT image data, teaching data including a pair of a region of interest (ROI) indicating the position of a target that is present in the CT image data and a correct answer image having a correct answer label, which is a label indicating the target.
- ROI region of interest
- the second inference unit 451 obtains, for CT image data, teaching data including a pair of position information of pixels of a target that is present in the CT image data and a correct answer image having a correct answer label, which is a label indicating the target.
- the selection unit 445 selects at least one of an inference result of the first inference unit 450 that performs inference on material decomposition image data and an inference result of the second inference unit 451 that performs inference on CT image data (integral image data). That is, the selection unit 445 is capable of selecting which of the inference result of the first inference unit 450 that performs inference on material decomposition image data and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data) is to be displayed on the display unit 42 .
- the selection unit 445 is also capable of selecting at least one of the inference result of the first inference unit 450 and the inference result of the second inference unit 451 in accordance with an examination order. Specifically, in a case where the examination order includes an examination regarding mammary glands (calcification examination), the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on material decomposition image data including calcium information. In a case where the examination order includes an examination using a contrast medium (iodine examination), the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on material decomposition image data including iodine information.
- the examination order includes an examination regarding mammary glands (calcification examination)
- the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on material decomposition image data including calcium information.
- the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on material de
- the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on material decomposition image data including metal (stent) information.
- the selection unit 445 selects the inference result of the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects the inference result of the second inference unit 451 that performs inference on CT image data (integral image data). In a case where the examination order includes, for example, an examination regarding a node, the selection unit 445 selects the inference result of the second inference unit 451 that performs inference on CT image data (integral image data). In a case where the examination order includes an examination that is not executable only with material decomposition image data, the selection unit 445 selects the inference result of the second inference unit 451 that performs inference on CT image data (integral image data).
- the inference result of the first inference unit 450 that performs inference on material decomposition image data including calcium information and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data) are necessary.
- the second examination is different from the first examination.
- the selection unit 445 selects both the inference result of the first inference unit 450 that performs inference on material decomposition image data including calcium information and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data).
- the display control unit 446 controls the display unit 42 so as to display information on a progress status or a processing result in each function or processing of the processing circuit 44 .
- the display control unit 446 causes the display unit 42 to display the inference result selected by the selection unit 445 .
- FIG. 3 illustrates one display mode of the display unit 42 in the X-ray CT apparatus 1 according to an embodiment of the present disclosure.
- material decomposition image data is displayed on the display unit 42 as illustrated in FIG. 3 .
- the display unit 42 may display composite image data composed of material decomposition image data and CT image data.
- the display unit 42 displays material decomposition image data 300 .
- the material decomposition image data 300 is a sliced image of three-dimensional volume data.
- region information 302 and material name information 304 regarding the predetermined material are displayed.
- the operator is able to recognize which material is present at which position, from the region information 302 and the material name information 304 regarding the predetermined material.
- the display control unit 446 causes the display unit 42 to display region information 305 and lesion name information 307 regarding the lesion.
- the display control unit 446 is also capable of causing the display unit 42 to display information 306 indicating that the first inference unit 450 has performed inference on the material decomposition image data 300 .
- the operator is able to recognize that the material decomposition image data 300 has been used to infer the region information 302 and the material name information 304 regarding the predetermined material. Thus, the operator is able to recognize which material is present at which position.
- the operator is able to recognize that the material decomposition image data 300 has been used to infer the region information 305 and the lesion name information 307 regarding the lesion. Thus, the operator is able to recognize which lesion is present at which position.
- FIG. 4 illustrates one display mode of the display unit 42 in the X-ray CT apparatus 1 according to an embodiment of the present disclosure.
- CT image data is displayed on the display unit 42 as illustrated in FIG. 4 .
- the display unit 42 displays CT image data 301 .
- the CT image data 301 is a sliced image of three-dimensional volume data.
- the display control unit 446 causes the display unit 42 to display region information 308 and lesion name information 310 regarding the predetermined lesion. The operator is able to recognize which lesion is present at which position, from the region information 308 and the lesion name information 310 regarding the predetermined lesion.
- the display control unit 446 is also capable of causing the display unit 42 to display information 312 indicating that the second inference unit 451 has performed inference on the CT image data 301 .
- the operator is able to recognize that the CT image data 301 has been used for inference.
- console device 40 has been described as a device that executes a plurality of functions by a single console, the plurality of functions may be executed by different consoles.
- FIG. 5 is a flowchart illustrating an example operation of the X-ray CT apparatus 1 .
- S 100 Scanning is performed to perform X-ray CT imaging on the subject P.
- X-ray CT imaging is performed, with X-rays being generated by the X-ray tube 11 , and the X-ray tube 11 and the detector 12 being rotated about the rotational axis Z (the subject P).
- the detector 12 detects X-rays passed through the subject P, and obtains imaging data, which is a signal regarding the subject P.
- the imaging data is detection data obtained by bundling pieces of detection data from a predetermined number of detection elements in a spatial unit.
- the imaging data generated from a counting result obtained by the detector 12 includes information on the energy of X-rays attenuated as a result of passing through the subject P.
- the reconstruction processing unit 442 generates CT image data (integral image data), based on the imaging data output by the detector 12 .
- the reconstruction processing unit 442 is capable of reconstructing, for example, image data of a specific energy component.
- the reconstruction processing unit 442 performs material decomposition on the imaging data output by the detector 12 , and reconstructs material decomposition image data by using a result of the material decomposition.
- the reconstruction processing unit 442 generates material decomposition image data.
- the first inference unit 450 performs inference on the material decomposition image data and obtains an inference result.
- the second inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result.
- the selection unit 445 selects at least one of the inference result of the first inference unit 450 that performs inference on material decomposition image data and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data).
- the process proceeds to S 112 .
- the process proceeds to S 114 .
- the selection unit 445 outputs the inference result of the first inference unit 450 to the display control unit 446 .
- the display control unit 446 causes the display unit 42 to display the inference result of the first inference unit 450 and the material decomposition image data 300 , as illustrated in FIG. 3 .
- the display control unit 446 is also capable of causing the display unit 42 to display, on the same screen, composite image data composed of the material decomposition image data and the CT image data and the inference result of the first inference unit 450 .
- the display control unit 446 causes the display unit 42 to display the region information 302 and the material name information 304 regarding the predetermined material. In a case where the inference result of the first inference unit 450 includes a lesion, the display control unit 446 causes the display unit 42 to display the region information 305 and the lesion name information 307 regarding the lesion.
- the selection unit 445 may select both the inference result of the first inference unit 450 that performs inference on material decomposition image data and the inference result of the second inference unit 451 that performs inference on CT image data (integral image data). In this case, the selection unit 445 outputs the inference result of the first inference unit 450 and the inference result of the second inference unit 451 to the display control unit 446 .
- the display control unit 446 is capable of causing the display unit 42 to display, on the same screen, composite image data composed of the material decomposition image data and the CT image data, the inference result of the first inference unit 450 , and the inference result of the second inference unit 451 .
- the selection unit 445 outputs the inference result of the second inference unit 451 to the display control unit 446 .
- the display control unit 446 causes the display unit 42 to display the inference result of the second inference unit 451 and the CT image data 301 , as illustrated in FIG. 4 .
- the display control unit 446 is capable of causing the display unit 42 to display, on the same screen, the CT image data 301 and the inference result of the second inference unit 451 .
- the display control unit 446 causes the display unit 42 to display the region information 308 and the lesion name information 310 regarding the lesion.
- the inference unit 444 includes the first inference unit 450 that performs inference on material decomposition image data by using a neural network, and the second inference unit 451 that performs inference on CT image data by using a neural network.
- the selection unit 445 selects the inference result obtained by performing inference on the material decomposition image data. In a case where an inference result obtained by performing inference on CT image data (integral image data) includes information regarding a specific lesion, the selection unit 445 selects the inference result obtained by performing inference on the CT image data (integral image data).
- the selection unit 445 selects the inference result obtained by performing inference on the material decomposition image data and the inference result obtained by performing inference on the CT image data (integral image data).
- the first inference unit 450 performs inference on the material decomposition image data and obtains an inference result.
- the second inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result.
- the control unit 441 is capable of comparing the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data with the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data), calculating comparison information of the inference results, and causing the comparison information to be displayed.
- the comparison information of the inference results indicates whether the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data matches the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data).
- the selection unit 445 selects either one of the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data and the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data).
- the display control unit 446 may cause the display unit 42 to display information indicating that the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data matches the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data).
- the selection unit 445 selects the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data.
- the display control unit 446 causes the display unit 42 to display the inference result of the first inference unit 450 and the material decomposition image data 300 , as illustrated in FIG. 3 .
- the display control unit 446 may cause the display unit 42 to display information indicating that the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data is different from the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data).
- the display control unit 446 may perform emphasized display for a region in which the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data is different from the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data).
- the emphasized display is frame display, highlight display, or the like.
- the display control unit 446 is capable of performing display such that a region in which the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data is different from the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data) can be distinguished.
- the display control unit 446 causes the display unit 42 to display, on a composite image composed of the material decomposition image data and the CT image data (integral image data), the inference result of the first inference unit 450 obtained by performing inference on the material decomposition image data and the inference result of the second inference unit 451 obtained by performing inference on the CT image data (integral image data).
- the operator is able to recognize, from the individual inference results (detection information), which detection information has a difference.
- the X-ray CT apparatus includes the X-ray tube 11 configured to radiate X-rays; the detector 12 configured to detect X-rays radiated by the X-ray tube 11 and passed through a subject; the reconstruction processing unit 442 configured to reconstruct imaging data output by the detector 12 and generate CT image data and material decomposition image data; the first inference unit 450 configured to perform inference on the material decomposition image data; the second inference unit 451 configured to perform inference on the CT image data; and the display control unit 446 configured to cause the display unit 42 to display at least one of an inference result of the first inference unit 450 and an inference result of the second inference unit 451 .
- the X-ray CT apparatus is capable of displaying an inference result of the first inference unit 450 configured to perform inference on material decomposition image data and an inference result of the second inference unit 451 configured to perform inference on CT image data, and thus the operator is able to confirm the individual inference results.
- the information processing system includes the first inference unit 450 configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of the X-ray CT apparatus; the second inference unit 451 configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; and the display control unit 446 configured to cause the display unit 42 to display at least one of an inference result of the first inference unit 450 and an inference result of the second inference unit 451 .
- the information processing method includes generating CT image data and material decomposition image data that are based on X-rays radiated by the X-ray tube 11 and passed through a subject; and causing the display unit 42 to display at least one of an inference result of the first inference unit 450 configured to perform inference on the material decomposition image data and an inference result of the second inference unit 451 configured to perform inference on the CT image data.
- the second embodiment is different from the first embodiment in that the selection unit 445 selects at least one of the first inference unit 450 that performs inference on material decomposition image data and the second inference unit 451 that performs inference on CT image data (integral image data).
- the selection unit 445 selects at least one of the first inference unit 450 that performs inference on material decomposition image data and the second inference unit 451 that performs inference on CT image data (integral image data).
- differences from the first embodiment will be mainly described.
- the selection unit 445 selects the first inference unit 450 .
- the first inference unit 450 performs inference on the material decomposition image data.
- the selection unit 445 selects the second inference unit 451 .
- the second inference unit 451 performs inference on CT image data (integral image data).
- the reconstruction processing unit 442 has a function of generating CT image data (integral image data), based on imaging data output by the detector 12 .
- the display control unit 446 causes the display unit 42 to display the CT image data.
- the reconstruction processing unit 442 also has a function of performing material decomposition on imaging data output by the detector 12 and reconstructing material decomposition image data by using a result of the material decomposition.
- the display control unit 446 is capable of causing the display unit 42 to display the material decomposition image data.
- the selection unit 445 selects whether inference is to be performed on the material decomposition image data. In a case where the material decomposition image data is selected as an inference target (the first inference unit 450 is selected), the first inference unit 450 performs inference on the material decomposition image data and obtains an inference result. The first inference unit 450 outputs the inference result of the first inference unit 450 to the display control unit 446 .
- the selection unit 445 is capable of selecting at least one of the first inference unit 450 and the second inference unit 451 in accordance with an examination order. Specifically, in a case where the examination order includes an examination regarding mammary glands (calcification examination), the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data including calcium information. In a case where the examination order includes an examination using a contrast medium (iodine examination), the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data including iodine information. Furthermore, in a case where the examination order includes an examination regarding the presence/absence of metal (stent) (metal examination), the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data including metal (stent) information.
- the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects the second inference unit 451 that performs inference on CT image data (integral image data).
- the material decomposition image data is not selected as an inference target, that is, in a case where the CT image data (integral image data) is selected as an inference target (the second inference unit 451 is selected)
- the second inference unit 451 performs inference on the CT image data (integral image data).
- the second inference unit 451 outputs an inference result of the second inference unit 451 to the display control unit 446 .
- the examination order includes a predetermined second examination (an examination regarding breast cancer (a calcification examination and a tumor examination))
- an inference result of the first inference unit 450 that performs inference on material decomposition image data including calcium information and an inference result of the second inference unit 451 that performs inference on CT image data (integral image data) are necessary.
- the selection unit 445 selects both the first inference unit 450 that performs inference on material decomposition image data including calcium information and the second inference unit 451 that performs inference on CT image data (integral image data).
- FIG. 7 is a flowchart illustrating an example operation of the X-ray CT apparatus 1 .
- S 100 to S 104 are the same as in FIG. 5 , and thus the description thereof will be omitted.
- the selection unit 445 selects whether inference is to be performed on material decomposition image data. That is, the selection unit 445 selects at least one of the first inference unit 450 and the second inference unit 451 . In a case where inference is to be performed on material decomposition image data, that is, in the case of selecting the first inference unit 450 , the process proceeds to S 202 . In a case where inference is to be performed on CT image data (integral image data), that is, in the case of selecting the second inference unit 451 , the process proceeds to S 210 .
- a non-material-decomposition mode (integral image mode) is normally set as an imaging mode when material decomposition is not performed.
- CT image data (integral image data) is normally obtained, and thus the selection unit 445 selects the second inference unit 451 that performs inference on the CT image data (integral image data).
- the selection unit 445 in response to a material decomposition mode (material decomposition image mode) being set as an imaging mode for performing material decomposition, the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects, for example, at least one of the first inference unit 450 and the second inference unit 451 in accordance with an examination order.
- the reconstruction processing unit 442 reconstructs and generates material decomposition image data indicating material decomposition.
- the first inference unit 450 performs inference on the material decomposition image data and obtains an inference result.
- the first inference unit 450 outputs the inference result of the first inference unit 450 to the display control unit 446 .
- the display control unit 446 causes the display unit 42 to display the inference result of the first inference unit 450 and the material decomposition image data 300 , as illustrated in FIG. 3 .
- the second inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result.
- the second inference unit 451 outputs the inference result of the second inference unit 451 to the display control unit 446 .
- the display control unit 446 causes the display unit 42 to display the inference result of the second inference unit 451 and the CT image data 301 (integral image data), as illustrated in FIG. 4 .
- the X-ray CT apparatus includes the X-ray tube 11 configured to radiate X-rays; the detector 12 configured to detect X-rays radiated by the X-ray tube 11 and passed through a subject; the reconstruction processing unit 442 configured to reconstruct imaging data output by the detector 12 and generate CT image data and material decomposition image data; the first inference unit 450 configured to perform inference on the material decomposition image data; the second inference unit 451 configured to perform inference on the CT image data; and the selection unit 445 configured to select, based on an examination order, at least one of the first inference unit 450 and the second inference unit 451 .
- the X-ray CT apparatus is capable of displaying, based on an examination order, an inference result of the first inference unit 450 configured to perform inference on material decomposition image data and an inference result of the second inference unit 451 configured to perform inference on CT image data, and thus the operator is able to confirm an inference result corresponding to the examination order.
- the information processing system includes the first inference unit 450 configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of the X-ray CT apparatus; the second inference unit 451 configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; and the selection unit 445 configured to select, based on an examination order, at least one of the first inference unit 450 and the second inference unit 451 .
- the information processing method includes generating CT image data and material decomposition image data that are based on X-rays radiated by the X-ray tube 11 and passed through a subject; and performing, based on an examination order, inference on at least one of the CT image data and the material decomposition image data.
- the third embodiment is different from the first and second embodiments in that the image analysis unit 443 that analyzes material decomposition image data is provided and that the selection unit 445 selects, based on an analysis result of the image analysis unit 443 , at least one of the first inference unit 450 that performs inference on material decomposition image data and the second inference unit 451 that performs inference on CT image data (integral image data).
- the image analysis unit 443 that analyzes material decomposition image data
- the selection unit 445 selects, based on an analysis result of the image analysis unit 443 , at least one of the first inference unit 450 that performs inference on material decomposition image data and the second inference unit 451 that performs inference on CT image data (integral image data).
- the reconstruction processing unit 442 has a function of generating CT image data (integral image data), based on imaging data output by the detector 12 .
- the display control unit 446 causes the display unit 42 to display the CT image data.
- the reconstruction processing unit 442 performs material decomposition on the imaging data output by the detector 12 , and reconstructs material decomposition image data by using a result of the material decomposition.
- the display control unit 446 is capable of causing the display unit 42 to display the material decomposition image data.
- the image analysis unit 443 analyzes material decomposition image data.
- the image analysis unit 443 is capable of analyzing material decomposition image data and obtaining the type and amount of material included in the material decomposition image data.
- the selection unit 445 is capable of selecting an inference target, based on an analysis result of the image analysis unit 443 , that is, based on content information of a predetermined material included in the material decomposition image data.
- the selection unit 445 selects, based on an analysis result of the image analysis unit 443 , that is, based on content information of a predetermined material included in the material decomposition image data, at least one of the first inference unit 450 that performs inference on material decomposition image data and the second inference unit 451 that performs inference on CT image data (integral image data).
- the selection unit 445 is capable of selecting, based on an analysis result of the image analysis unit 443 , that is, based on content information of a predetermined lesion included in the material decomposition image data, at least one of the first inference unit 450 that performs inference on material decomposition image data and the second inference unit 451 that performs inference on CT image data (integral image data).
- the image analysis unit 443 is capable of analyzing material decomposition image data and obtaining the type and amount of lesion included in the material decomposition image data.
- the predetermined material is any one of calcium, water, iodine, and the like.
- the image analysis unit 443 is capable of obtaining, as content information of the predetermined material in the material decomposition image data, for example, the percentage of calcium included in the material decomposition image data.
- the image analysis unit 443 is also capable of determining whether calcium is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more). In a case where calcium is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects the second inference unit 451 that performs inference on CT image data (integral image data).
- the image analysis unit 443 is capable of obtaining, as content information of the predetermined material in the material decomposition image data, for example, the percentage of water included in the material decomposition image data. Water corresponds to, for example, blood, lymph, or the like.
- the image analysis unit 443 is also capable of determining whether water is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more). In a case where water is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects the second inference unit 451 that performs inference on CT image data (integral image data).
- the image analysis unit 443 is capable of obtaining, as content information of the predetermined material in the material decomposition image data, for example, the percentage of iodine included in the material decomposition image data.
- the image analysis unit 443 is also capable of determining whether iodine is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more). In a case where iodine is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects the second inference unit 451 that performs inference on CT image data (integral image data).
- the selection unit 445 selects the first inference unit 450 in a case where a predetermined material is included in the material decomposition image data at a predetermined ratio or more. In a case where a predetermined material is not included in the material decomposition image data at a predetermined ratio or more, the selection unit 445 selects the second inference unit 451 .
- a setting unit (operation unit 43 ) for setting the type of material to be analyzed by the image analysis unit 443 may be provided.
- the operator is able to select, via the setting unit, the type of material to be analyzed by the image analysis unit 443 .
- the operator selects, for example, calcium via the setting unit.
- the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects the second inference unit 451 that performs inference on CT image data (integral image data).
- the operator selects, for example, iodine via the setting unit.
- the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- the selection unit 445 selects the second inference unit 451 that performs inference on CT image data (integral image data).
- the operator is able to select, for example, calcium and tumor via the setting unit.
- the selection unit 445 selects the first inference unit 450 that performs inference on material decomposition image data.
- FIG. 9 is a flowchart illustrating an example operation of the X-ray CT apparatus 1 .
- S 100 to S 106 are the same as in FIG. 5 , and thus the description thereof will be omitted.
- the image analysis unit 443 analyses the material decomposition image data
- the selection unit 445 is capable of selecting an inference target, based on an analysis result of the image analysis unit 443 , that is, based on content information of a predetermined material included in the material decomposition image data.
- the selection unit 445 selects at least one of the first inference unit 450 that performs inference on material decomposition image data and the second inference unit 451 that performs inference on CT image data (integral image data).
- the process proceeds to S 302 .
- the process proceeds to S 310 .
- the first inference unit 450 performs inference on the material decomposition image data and obtains an inference result.
- the first inference unit 450 outputs the inference result of the first inference unit 450 to the display control unit 446 .
- the display control unit 446 causes the display unit 42 to display the inference result of the first inference unit 450 and the material decomposition image data 300 , as illustrated in FIG. 3 .
- the display control unit 446 is capable of causing the display unit 42 to display an analysis result of the image analysis unit 443 .
- the display control unit 446 is capable of causing the display unit 42 to display content information of a predetermined material and content information of a predetermined lesion in the material decomposition image data.
- the second inference unit 451 outputs the inference result of the second inference unit 451 to the display control unit 446 .
- the display control unit 446 causes the display unit 42 to display the inference result of the second inference unit 451 and the CT image data 301 (integral image data), as illustrated in FIG. 4 .
- the display control unit 446 is capable of causing the display unit 42 to display an analysis result of the image analysis unit 443 .
- the display control unit 446 is capable of causing the display unit 42 to display content information of a predetermined material in the material decomposition image data.
- the X-ray CT apparatus includes the X-ray tube 11 configured to radiate X-rays; the detector 12 configured to detect X-rays radiated by the X-ray tube 11 and passed through a subject; the reconstruction processing unit 442 configured to reconstruct imaging data output by the detector 12 and generate CT image data and material decomposition image data; the first inference unit 450 configured to perform inference on the material decomposition image data; the second inference unit 451 configured to perform inference on the CT image data; the image analysis unit 443 configured to analyze the material decomposition image data; and the selection unit 445 configured to select, based on an analysis result of the image analysis unit 443 , at least one of the first inference unit 450 and the second inference unit 451 .
- the operator is able to confirm the inference result corresponding to the material decomposition image data.
- the information processing system includes the first inference unit 450 configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of the X-ray CT apparatus; the second inference unit 451 configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; the image analysis unit 443 configured to analyze the material decomposition image data; and the selection unit 445 configured to select, based on an analysis result of the image analysis unit 443 , at least one of the first inference unit 450 and the second inference unit 451 .
- the information processing method includes generating CT image data and material decomposition image data that are based on X-rays radiated by the X-ray tube 11 and passed through a subject; analyzing the material decomposition image data; and performing, based on the analysis result, inference on at least one of the CT image data and the material decomposition image data.
- a computer program that implements the functions of the above-described embodiments may be supplied to a computer via a network or a memory (storage medium), and the computer program may be executed by a processor (not illustrated).
- the computer program causes the computer to execute the above-described information processing method. That is, the computer program is a program for implementing the functions of the information processing system by the computer.
- the memory stores the computer program.
- Embodiment(s) of the present disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s).
- computer executable instructions e.g., one or more programs
- a storage medium which may also be referred to more fully as a
- the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
- the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
- the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Biophysics (AREA)
- High Energy & Nuclear Physics (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Surgery (AREA)
- Molecular Biology (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Pulmonology (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Physiology (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
An X-ray computed tomography (CT) apparatus includes an X-ray tube configured to radiate X-rays; a detector configured to detect X-rays radiated by the X-ray tube and passed through a subject; a reconstruction processing unit configured to reconstruct imaging data output by the detector and generate CT image data and material decomposition image data; a first inference unit configured to perform inference on the material decomposition image data; a second inference unit configured to perform inference on the CT image data; and a display control unit configured to cause a display unit to display at least one of an inference result of the first inference unit and an inference result of the second inference unit.
Description
- The present disclosure relates to an X-ray computed tomography (CT) apparatus equipped with a photon counting CT function, an information processing system, an information processing method, and a non-transitory computer-readable medium.
- An X-ray computed tomography (CT) apparatus equipped with a photon counting CT function counts individual incident X-rays and measures the energy of the incident X-rays, thereby obtaining an X-ray spectrum. With use of the obtained X-ray spectrum, the X-ray CT apparatus is capable identifying a material included in a subject and generating material decomposition image data. The X-ray CT apparatus equipped with a photon counting CT function is also capable of reconstructing CT image data (integral image data) (for example, Japanese Patent Laid-Open No. 2018-175866).
- On the other hand, inference tasks performed by a neural network include a classification task of classifying a class of image data and a detection task of detecting what is captured at which position in image data.
- An inference result may vary depending on whether an inference task is performed on material decomposition image data or CT image data (integral image data) obtained by an X-ray CT apparatus equipped with a photon counting CT function.
- It is desired to appropriately display an inference result obtained by performing inference on material decomposition image data and an inference result obtained by performing inference on CT image data.
- An X-ray CT apparatus according to an embodiment of the present disclosure includes an X-ray tube configured to radiate X-rays; a detector configured to detect X-rays radiated by the X-ray tube and passed through a subject; a reconstruction processing unit configured to reconstruct imaging data output by the detector and generate CT image data and material decomposition image data; a first inference unit configured to perform inference on the material decomposition image data; a second inference unit configured to perform inference on the CT image data; and a display control unit configured to cause a display unit to display at least one of an inference result of the first inference unit and an inference result of the second inference unit.
- An information processing system according to an embodiment of the present disclosure includes a first inference unit configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of an X-ray CT apparatus; a second inference unit configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; and a display control unit configured to cause a display unit to display at least one of an inference result of the first inference unit and an inference result of the second inference unit.
- An information processing method according to an embodiment of the present disclosure includes generating CT image data and material decomposition image data that are based on X-rays radiated by an X-ray tube and passed through a subject; and causing a display unit to display at least one of an inference result of a first inference unit configured to perform inference on the material decomposition image data and an inference result of a second inference unit configured to perform inference on the CT image data.
- Further features of the present disclosure will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
-
FIG. 1 is a diagram illustrating an example configuration of an X-ray computed tomography (CT) apparatus according to an embodiment of the present disclosure. -
FIG. 2 is a diagram illustrating an example of a peripheral configuration of an inference unit of an X-ray CT apparatus according to an embodiment of the present disclosure. -
FIG. 3 is a diagram illustrating one display mode of a display unit in an X-ray CT apparatus according to an embodiment of the present disclosure. -
FIG. 4 is a diagram illustrating one display mode of a display unit in an X-ray CT apparatus according to an embodiment of the present disclosure. -
FIG. 5 is a flowchart illustrating an example operation of an X-ray CT apparatus according to an embodiment of the present disclosure. -
FIG. 6 is a diagram illustrating an example of a peripheral configuration of an inference unit of an X-ray CT apparatus according to an embodiment of the present disclosure. -
FIG. 7 is a flowchart illustrating an example operation of an X-ray CT apparatus according to an embodiment of the present disclosure. -
FIG. 8 is a diagram illustrating an example of a peripheral configuration of an inference unit of an X-ray CT apparatus according to an embodiment of the present disclosure. -
FIG. 9 is a flowchart illustrating an example operation of an X-ray CT apparatus according to an embodiment of the present disclosure. - Hereinafter, an X-ray computed tomography (CT) apparatus, an information processing system, an information processing method, and a non-transitory computer-readable medium storing a program according to embodiments will be described with reference to the drawings. The parts denoted by the same reference numerals perform similar operations, and repeated description will be omitted as appropriate. Hereinafter, embodiments will be described with reference to the drawings.
- A first embodiment of the present disclosure will be described with reference to
FIGS. 1 to 5 . An example configuration of an X-ray CT apparatus according to the first embodiment will be described with reference toFIG. 1 . An X-ray CT apparatus 1 illustrated inFIG. 1 includes a platform device (gantry) 10, abed device 30, and aconsole device 40. In the embodiments, a rotational axis direction of arotary frame 13 or a longitudinal direction of atop plate 33 of thebed device 30 in a non-tilted state is defined as a Z-axis direction, an axis direction orthogonal to the Z-axis direction and horizontal to a floor surface is defined as an X-axis direction, and an axis direction orthogonal to the Z-axis direction and vertical to the floor surface is defined as a Y-axis direction. - For example, the
platform device 10 and thebed device 30 are installed in a CT examination room, and theconsole device 40 is installed in a control room adjacent to the CT examination room. Theconsole device 40 need not necessarily be installed in the control room. For example, theconsole device 40 may be installed in the room having theplatform device 10 and thebed device 30 installed therein. In any case, theplatform device 10, thebed device 30, and theconsole device 40 are connected to each other in a wired or wireless manner so as to be capable of communicating with each other. - The
platform device 10 is a scanning device having a configuration for performing X-ray CT imaging on a subject P. Theplatform device 10 includes anX-ray tube 11, adetector 12, therotary frame 13, an X-rayhigh voltage device 14, acontrol device 15, awedge 16, acollimator 17, and a data collection device 18 (hereinafter also referred to as a data acquisition system (DAS)). - Here, only a part of the configuration is illustrated for convenience of description.
- The
X-ray tube 11 is a vacuum tube that generates X-rays by radiating thermoelectrons from a cathode (filament) toward an anode (target) by application of a high voltage and supply of a filament current from the X-rayhigh voltage device 14. Specifically, X-rays are generated as a result of thermoelectrons colliding with the target. For example, theX-ray tube 11 may be a rotating anode X-ray tube that generates X-rays by radiating thermoelectrons to a rotating anode. The X-rays generated by theX-ray tube 11 are shaped into a cone beam shape via, for example, thecollimator 17, and are radiated to the subject P. TheX-ray tube 11 is an example of an X-ray generation unit. - The
detector 12 detects X-rays radiated by theX-ray tube 11 and passed through the subject P, and outputs a signal corresponding to an X-ray dosage to theDAS 18. Thedetector 12 includes, for example, a plurality of X-ray detection element rows in each of which a plurality of X-ray detection elements are arranged in a channel direction along one arc with the focal point of theX-ray tube 11 being the center. Thedetector 12 has, for example, a row structure in which a plurality of X-ray detection element rows, in each of which a plurality of X-ray detection elements are arranged in the channel direction, are arranged in a slice direction (row direction). Thedetector 12 is a photon-counting detector. A reconstruction processing unit is capable of reconstructing CT image data (integral image data) with a high S/N ratio by counting the number of photons of X-rays passed through the subject P by using the photon-counting detector. - The
detector 12 may be classified into an energy integration function or a photon counting function depending on the method for measurement performed on a converted signal by theDAS 18. The energy integration function integrates the energy of X-rays passed through the subject P for a certain period of time, thereby measuring the total sum of the energy of the X-rays passed during the certain period of time. The photon counting function measures the number of X-ray photons included in X-rays passed through the subject P, for each of a plurality of energy bands (also referred to as energy bins or simply as bins). This makes it possible to perform material decomposition based on imaging data obtained for each energy band. Here, an imaging mode in which material decomposition is performed is referred to as a material decomposition mode (material decomposition image mode), and an imaging mode in which material decomposition is not performed is referred to as a non-material-decomposition mode (integral image mode). - The
rotary frame 13 supports an X-ray generation unit and an X-ray detection unit so as to be rotatable around the rotational axis Z. Specifically, therotary frame 13 is an annular frame that supports theX-ray tube 11 and thedetector 12 so as to be opposed to each other, and rotates theX-ray tube 11 and thedetector 12 by thecontrol device 15. Therotary frame 13 is rotatably supported by a fixed frame (not illustrated) formed of a metal such as aluminum. Specifically, therotary frame 13 is connected to an edge portion of the fixed frame via a bearing. Therotary frame 13 receives power from a driving mechanism of thecontrol device 15 and rotates around the rotational axis Z at a constant angular velocity. - The
rotary frame 13 further includes and supports the X-rayhigh voltage device 14 and theDAS 18 in addition to theX-ray tube 11 and thedetector 12. Therotary frame 13 is accommodated in a substantially cylindrical housing having an opening (bore) 19 serving as an imaging space. The opening 19 substantially coincides with the FOV. The center axis of the opening 19 coincides with the rotational axis Z of therotary frame 13. Imaging data generated by theDAS 18 is transmitted, for example, from a transmitter including a light emitting diode (LED) to a receiver (not illustrated) including a photodiode provided in a non-rotating portion (fixed frame) of theplatform device 10 by optical communication, and is transferred to theconsole device 40. The method of transmitting the imaging data from therotary frame 13 to the non-rotating portion of theplatform device 10 is not limited to optical communication, and any non-contact data transmission method may be employed. - The X-ray
high voltage device 14 includes electric circuits such as a transformer and a rectifier, a high voltage generator having a function of generating a high voltage to be applied to theX-ray tube 11 and a filament current to be supplied to theX-ray tube 11, and an X-ray controller that controls an output voltage in accordance with X-rays radiated by theX-ray tube 11. The high voltage generator may employ a transformer scheme or an inverter scheme. The X-rayhigh voltage device 14 may be provided in therotary frame 13 or on the fixed frame side of theplatform device 10. - The
control device 15 includes a processing circuit including a central processing unit (CPU) or the like, and a driving mechanism such as a motor or an actuator. The processing circuit includes, as hardware resources, a processor such as a CPU or a micro processing unit (MPU), and a memory such as a read only memory (ROM) or a random access memory (RAM). Thecontrol device 15 may be implemented by an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), another complex programmable logic device (CPLD), or a simple programmable logic device (SPLD). Thecontrol device 15 controls the X-rayhigh voltage device 14, theDAS 18, and so forth in accordance with instructions from theconsole device 40. The processor implements the above control by reading and executing a program stored in the memory. - The
wedge 16 is a filter for adjusting the dosage of X-rays radiated by theX-ray tube 11. - Specifically, the
wedge 16 is a filter that passes and attenuates the X-rays radiated by theX-ray tube 11 so that the X-rays radiated from theX-ray tube 11 to the subject P have a predetermined distribution. For example, the wedge 16 (a wedge filter or a bow-tie filter) is a filter obtained by processing aluminum to have a predetermined target angle and a predetermined thickness. - The
collimator 17 is a lead plate or the like for narrowing down the radiation range of the X-rays passed through thewedge 16, and has a slit in accordance with a combination of a plurality of lead plates or the like. Thecollimator 17 may be referred to as an X-ray aperture. - The
DAS 18 generates, for each of a plurality of energy bands, digital data (also referred to as imaging data) indicating a count value of X-ray photons detected by thedetector 12. The imaging data is a data set of count values identified by the channel number, row number, view number indicating an acquisition view (projection angle), and energy bin number of the X-ray detection elements as a generation source. TheDAS 18 is implemented by, for example, an application specific integrated circuit (ASIC) having a circuit element capable of generating imaging data. The imaging data is transferred to theconsole device 40. - The
bed device 30 is a device on which the subject P to be scanned is to be placed and moved, and includes a base 31, abed driving device 32, thetop plate 33, and a support frame 34. The base 31 is a housing that supports the support frame 34 so as to be movable in the vertical direction. - The
bed driving device 32 is a motor or an actuator that moves thetop plate 33 on which the subject P is placed in the longitudinal direction of thetop plate 33. Thebed driving device 32 moves thetop plate 33 in accordance with control by theconsole device 40 or thecontrol device 15. For example, thebed driving device 32 moves thetop plate 33 in a direction orthogonal to the subject P so that the body axis of the subject P placed on thetop plate 33 coincides with the central axis of the opening of therotary frame 13. Thebed driving device 32 may move thetop plate 33 in the direction of the body axis of the subject P in accordance with X-ray CT imaging performed using theplatform device 10. Thebed driving device 32 generates power by being driven at a rotation speed corresponding to the duty ratio or the like of a driving signal from thecontrol device 15. Thebed driving device 32 is implemented by, for example, a motor such as a direct drive motor or a servo motor. - The
top plate 33 provided on the upper surface of the support frame 34 is a plate on which the subject P is to be placed. Thebed driving device 32 may move, in addition to thetop plate 33, the support frame 34 in the longitudinal direction of thetop plate 33. - The
console device 40 includes amemory 41, adisplay unit 42, anoperation unit 43, and aprocessing circuit 44. Data communication among thememory 41, thedisplay unit 42, theoperation unit 43, and theprocessing circuit 44 is performed via a bus. Although theconsole device 40 is described as a separate body separated from theplatform device 10, theconsole device 40 or some of the constituent elements of theconsole device 40 may be included in theplatform device 10. - The
memory 41 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or an integrated circuit storage device that stores various kinds of information. - The
memory 41 stores, for example, imaging data and reconstructed image data. Thememory 41 is not limited to an HDD or SSD, and may be a drive device that reads and writes various kinds of information from and to a portable storage medium such as a compact disc (CD), a digital versatile disc (DVD), or a flash memory, a semiconductor memory element such as a random access memory (RAM), or the like. The storage area of thememory 41 may be in the X-ray CT apparatus 1 or in an external storage device connected via a network. For example, thememory 41 stores data of a CT image and a display image. Thememory 41 also stores a control program according to an embodiment. - The
display unit 42 displays various kinds of information. For example, thedisplay unit 42 outputs a medical image (CT image) generated by theprocessing circuit 44 and a graphical user interface (GUI) for receiving various operations from an operator. As thedisplay unit 42, for example, a liquid crystal display (LCD) unit, a cathode ray tube (CRT) display unit, an organic electroluminescence display (OELD) unit, a plasma display unit, or any other display unit may be used as appropriate. Thedisplay unit 42 may be provided in theplatform device 10. Thedisplay unit 42 may be of a desktop type or may be constituted by a tablet terminal or the like capable of wirelessly communicating with the main body of theconsole device 40. - The
operation unit 43 receives various input operations from the operator, converts the received input operations into electric signals, and outputs the electric signals to theprocessing circuit 44. For example, theoperation unit 43 receives, from the operator, an acquisition condition for acquiring imaging data, a reconstruction condition for reconstructing a CT image, an image processing condition for generating a post-processed image from a CT image, and the like. As theoperation unit 43, for example, a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch pad, or a touch panel display unit may be used as appropriate. In the embodiment, theoperation unit 43 is not limited to a unit including a physical operation component such as a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch pad, or a touch panel display unit. For example, an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the apparatus and outputs the electric signal to theprocessing circuit 44 is also included in examples of theoperation unit 43. Theoperation unit 43 may be provided in theplatform device 10. Theoperation unit 43 may be constituted by a tablet terminal or the like capable of wirelessly communicating with the main body of theconsole device 40. - The
processing circuit 44 controls the operation of the entire X-ray CT apparatus 1 in accordance with an electric signal of an input operation output from theoperation unit 43. For example, theprocessing circuit 44 includes, as hardware resources, a processor such as a CPU, an MPU, or a graphics processing unit (GPU), and a memory such as a ROM or a RAM. Theprocessing circuit 44 implements, by the processor that executes a program loaded in the memory, acontrol unit 441, areconstruction processing unit 442, animage analysis unit 443, aninference unit 444, aselection unit 445, and adisplay control unit 446. The individual functions (thecontrol unit 441, thereconstruction processing unit 442, theimage analysis unit 443, theinference unit 444, theselection unit 445, and the display control unit 446) are not necessarily implemented by a single processing circuit. A plurality of independent processors may be combined to constitute a processing circuit, and the individual processors may execute a program to implement the individual functions. - The
control unit 441 controls each function of theprocessing circuit 44 in accordance with an input operation received from the operator via theoperation unit 43. Specifically, thecontrol unit 441 reads out a control program stored in thememory 41, loads the control program into the memory in theprocessing circuit 44, and controls each unit of the X-ray CT apparatus 1 in accordance with the loaded control program. Thecontrol unit 441 performs preprocessing, such as logarithmic transformation processing, offset correction processing, inter-channel sensitivity correction processing, or beam hardening correction, on the imaging data output from theDAS 18, thereby generating preprocessed imaging data. - The
reconstruction processing unit 442 has a function of generating CT image data, based on the imaging data output by the detector 12 (DAS 18). Thereconstruction processing unit 442 reconstructs CT image data by performing, for example, back projection processing on the imaging data stored in thememory 41. The back projection processing may be, for example, back projection processing based on a filtered back projection (FBP) method. Thereconstruction processing unit 442 may perform reconstruction processing by using, for example, successive approximations. Thereconstruction processing unit 442 generates CT image data by performing various kinds of image processing on the CT image data. Thereconstruction processing unit 442 stores the reconstructed CT image data and the CT image data generated through various kinds of image processing in thememory 41. - The
reconstruction processing unit 442 calculates energy integration data by using the sum (total value) of the counts of individual energy bins or the sum of the products of the representative values and the counts of energy bins, which is a signal obtained by the photon-countingdetector 12. Thereconstruction processing unit 442 is capable of reconstructing CT image data (integral image data) by using the energy integration data. - As an application of the photon-counting X-ray CT apparatus 1, there is a technique of determining the type, the amount, the density, and so forth of a material included in the subject P by using the fact that each material has different X-ray absorption characteristic. This is called material decomposition. For example, the
reconstruction processing unit 442 is capable of performing material decomposition on imaging data and acquiring material decomposition information. Thereconstruction processing unit 442 is also capable of reconstructing material decomposition image data indicating material decomposition by using material decomposition information, which is a result of material decomposition. - For example, imaging data generated from a counting result obtained by the photon-counting X-ray CT apparatus 1 includes information on the energy spectrum of X-rays attenuated as a result of passing through the subject P. Thus, the
reconstruction processing unit 442 is capable of reconstructing, for example, material decomposition image data obtained by imaging a specific energy component. - The
image analysis unit 443 analyzes material decomposition image data. By analyzing the material decomposition image data, theimage analysis unit 443 is capable of obtaining how much of a predetermined material is included in the material decomposition image data, or how much of a predetermined lesion is included in the material decomposition image data. - The
inference unit 444 is capable of performing inference on material decomposition image data. Theinference unit 444 is capable of performing inference on CT image data (integral image data). Thus, theinference unit 444 is capable of performing inference on each of material decomposition image data and CT image data. Theinference unit 444 is also capable of performing inference on composite image data composed of material decomposition image data and CT image data (integral image data). - Specifically, as illustrated in
FIG. 2 , theinference unit 444 includes afirst inference unit 450 and asecond inference unit 451. Thefirst inference unit 450 performs inference on material decomposition image data or composite image data composed of material decomposition image data and CT image data by using a neural network. Thesecond inference unit 451 performs inference on CT image data by using a neural network. - The
first inference unit 450 obtains teaching data in advance. The teaching data is determined in accordance with an inference task performed by the neural network or a classification target. - Examples of an inference task performed by the neural network include a classification task of classifying the class of material decomposition image data, a detection task of detecting which material is present at which position in material decomposition image data, and a segmentation task of extracting a target region from material decomposition image data. The material decomposition image data used as teaching data is material decomposition image data or composite image data composed of material decomposition image data and CT image data.
- At the time of training a neural network that performs a classification task, the
first inference unit 450 obtains teaching data including a pair of material decomposition image data and a correct answer label, which is a label indicating a target material that is present in the material decomposition image data. - On the other hand, at the time of training a neural network that performs a detection task, the
first inference unit 450 obtains, for material decomposition image data, teaching data including a pair of a region of interest (ROI) indicating the position of a target material that is present in the material decomposition image data and a correct answer image having a correct answer label, which is a label indicating the target. - At the time of training a neural network that performs a segmentation task, the
first inference unit 450 obtains, for material decomposition image data, teaching data including a pair of position information of pixels of a target material that is present in the material decomposition image data and a correct answer image having a correct answer label, which is a label indicating the target material. - Similarly, the
second inference unit 451 obtains teaching data in advance. The teaching data is determined in accordance with an inference task performed by the neural network or a classification target. - Examples of an inference task performed by the neural network include a classification task of classifying the class of CT image data (integral image data), a detection task of detecting which is present at which position in CT image data, and a segmentation task of extracting a target region from CT image data.
- At the time of training a neural network that performs a classification task, the
second inference unit 451 obtains teaching data including a pair of CT image data and a correct answer label, which is a label indicating a target that is present in the CT image data. - On the other hand, at the time of training a neural network that performs a detection task, the
second inference unit 451 obtains, for CT image data, teaching data including a pair of a region of interest (ROI) indicating the position of a target that is present in the CT image data and a correct answer image having a correct answer label, which is a label indicating the target. - At the time of training a neural network that performs a segmentation task, the
second inference unit 451 obtains, for CT image data, teaching data including a pair of position information of pixels of a target that is present in the CT image data and a correct answer image having a correct answer label, which is a label indicating the target. - The
selection unit 445 selects at least one of an inference result of thefirst inference unit 450 that performs inference on material decomposition image data and an inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data). That is, theselection unit 445 is capable of selecting which of the inference result of thefirst inference unit 450 that performs inference on material decomposition image data and the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data) is to be displayed on thedisplay unit 42. - The
selection unit 445 is also capable of selecting at least one of the inference result of thefirst inference unit 450 and the inference result of thesecond inference unit 451 in accordance with an examination order. Specifically, in a case where the examination order includes an examination regarding mammary glands (calcification examination), theselection unit 445 selects the inference result of thefirst inference unit 450 that performs inference on material decomposition image data including calcium information. In a case where the examination order includes an examination using a contrast medium (iodine examination), theselection unit 445 selects the inference result of thefirst inference unit 450 that performs inference on material decomposition image data including iodine information. Furthermore, in a case where the examination order includes an examination regarding the presence/absence of metal (stent) (metal examination), theselection unit 445 selects the inference result of thefirst inference unit 450 that performs inference on material decomposition image data including metal (stent) information. - That is, in a case where the examination order includes a predetermined first examination (calcification examination, iodine examination, metal examination, or the like), the
selection unit 445 selects the inference result of thefirst inference unit 450 that performs inference on material decomposition image data. - In a case where the examination order does not include the predetermined first examination, the
selection unit 445 selects the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data). In a case where the examination order includes, for example, an examination regarding a node, theselection unit 445 selects the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data). In a case where the examination order includes an examination that is not executable only with material decomposition image data, theselection unit 445 selects the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data). - In a case where the examination order includes a predetermined second examination (an examination regarding breast cancer (a calcification examination and a tumor examination)), the inference result of the
first inference unit 450 that performs inference on material decomposition image data including calcium information and the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data) are necessary. The second examination is different from the first examination. Thus, theselection unit 445 selects both the inference result of thefirst inference unit 450 that performs inference on material decomposition image data including calcium information and the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data). - The
display control unit 446 controls thedisplay unit 42 so as to display information on a progress status or a processing result in each function or processing of theprocessing circuit 44. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result selected by theselection unit 445. -
FIG. 3 illustrates one display mode of thedisplay unit 42 in the X-ray CT apparatus 1 according to an embodiment of the present disclosure. In response to the inference result of thefirst inference unit 450 that performs inference on material decomposition image data being selected by theselection unit 445, material decomposition image data is displayed on thedisplay unit 42 as illustrated inFIG. 3 . Thedisplay unit 42 may display composite image data composed of material decomposition image data and CT image data. - The
display unit 42 displays materialdecomposition image data 300. The materialdecomposition image data 300 is a sliced image of three-dimensional volume data. In response to a predetermined material (calcium, iodine, metal, or the like) being detected in the materialdecomposition image data 300 by thefirst inference unit 450,region information 302 andmaterial name information 304 regarding the predetermined material are displayed. The operator is able to recognize which material is present at which position, from theregion information 302 and thematerial name information 304 regarding the predetermined material. In response to a predetermined lesion being detected in the materialdecomposition image data 300 by thefirst inference unit 450, thedisplay control unit 446 causes thedisplay unit 42 to displayregion information 305 andlesion name information 307 regarding the lesion. - The
display control unit 446 is also capable of causing thedisplay unit 42 to displayinformation 306 indicating that thefirst inference unit 450 has performed inference on the materialdecomposition image data 300. The operator is able to recognize that the materialdecomposition image data 300 has been used to infer theregion information 302 and thematerial name information 304 regarding the predetermined material. Thus, the operator is able to recognize which material is present at which position. The operator is able to recognize that the materialdecomposition image data 300 has been used to infer theregion information 305 and thelesion name information 307 regarding the lesion. Thus, the operator is able to recognize which lesion is present at which position. -
FIG. 4 illustrates one display mode of thedisplay unit 42 in the X-ray CT apparatus 1 according to an embodiment of the present disclosure. In response to the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data) being selected by theselection unit 445, CT image data is displayed on thedisplay unit 42 as illustrated inFIG. 4 . - The
display unit 42 displaysCT image data 301. TheCT image data 301 is a sliced image of three-dimensional volume data. In response to a predetermined lesion (node, tumor, or the like) being detected in theCT image data 301 by thesecond inference unit 451, thedisplay control unit 446 causes thedisplay unit 42 to displayregion information 308 andlesion name information 310 regarding the predetermined lesion. The operator is able to recognize which lesion is present at which position, from theregion information 308 and thelesion name information 310 regarding the predetermined lesion. - The
display control unit 446 is also capable of causing thedisplay unit 42 to displayinformation 312 indicating that thesecond inference unit 451 has performed inference on theCT image data 301. The operator is able to recognize that theCT image data 301 has been used for inference. - Although the
console device 40 has been described as a device that executes a plurality of functions by a single console, the plurality of functions may be executed by different consoles. - Next, an operation of the X-ray CT apparatus 1 according to an embodiment of the present disclosure will be described.
FIG. 5 is a flowchart illustrating an example operation of the X-ray CT apparatus 1. - S100: Scanning is performed to perform X-ray CT imaging on the subject P. X-ray CT imaging is performed, with X-rays being generated by the
X-ray tube 11, and theX-ray tube 11 and thedetector 12 being rotated about the rotational axis Z (the subject P). - S102: The
detector 12 detects X-rays passed through the subject P, and obtains imaging data, which is a signal regarding the subject P. The imaging data is detection data obtained by bundling pieces of detection data from a predetermined number of detection elements in a spatial unit. The imaging data generated from a counting result obtained by thedetector 12 includes information on the energy of X-rays attenuated as a result of passing through the subject P. - S104: The
reconstruction processing unit 442 generates CT image data (integral image data), based on the imaging data output by thedetector 12. Thereconstruction processing unit 442 is capable of reconstructing, for example, image data of a specific energy component. - S106: The
reconstruction processing unit 442 performs material decomposition on the imaging data output by thedetector 12, and reconstructs material decomposition image data by using a result of the material decomposition. Thereconstruction processing unit 442 generates material decomposition image data. - S108: The
first inference unit 450 performs inference on the material decomposition image data and obtains an inference result. Thesecond inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result. - S110: The
selection unit 445 selects at least one of the inference result of thefirst inference unit 450 that performs inference on material decomposition image data and the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data). In response to the inference result of thefirst inference unit 450 being selected by theselection unit 445, the process proceeds to S112. In response to the inference result of thesecond inference unit 451 being selected by theselection unit 445, the process proceeds to S114. - S112: The
selection unit 445 outputs the inference result of thefirst inference unit 450 to thedisplay control unit 446. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result of thefirst inference unit 450 and the materialdecomposition image data 300, as illustrated inFIG. 3 . Thedisplay control unit 446 is also capable of causing thedisplay unit 42 to display, on the same screen, composite image data composed of the material decomposition image data and the CT image data and the inference result of thefirst inference unit 450. In a case where the inference result of thefirst inference unit 450 includes a predetermined material (calcium, iodine, metal, or the like), thedisplay control unit 446 causes thedisplay unit 42 to display theregion information 302 and thematerial name information 304 regarding the predetermined material. In a case where the inference result of thefirst inference unit 450 includes a lesion, thedisplay control unit 446 causes thedisplay unit 42 to display theregion information 305 and thelesion name information 307 regarding the lesion. - The
selection unit 445 may select both the inference result of thefirst inference unit 450 that performs inference on material decomposition image data and the inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data). In this case, theselection unit 445 outputs the inference result of thefirst inference unit 450 and the inference result of thesecond inference unit 451 to thedisplay control unit 446. Thedisplay control unit 446 is capable of causing thedisplay unit 42 to display, on the same screen, composite image data composed of the material decomposition image data and the CT image data, the inference result of thefirst inference unit 450, and the inference result of thesecond inference unit 451. - S114: The
selection unit 445 outputs the inference result of thesecond inference unit 451 to thedisplay control unit 446. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result of thesecond inference unit 451 and theCT image data 301, as illustrated inFIG. 4 . Thedisplay control unit 446 is capable of causing thedisplay unit 42 to display, on the same screen, theCT image data 301 and the inference result of thesecond inference unit 451. In a case where the inference result of thesecond inference unit 451 includes a lesion, thedisplay control unit 446 causes thedisplay unit 42 to display theregion information 308 and thelesion name information 310 regarding the lesion. - As described above, the
inference unit 444 includes thefirst inference unit 450 that performs inference on material decomposition image data by using a neural network, and thesecond inference unit 451 that performs inference on CT image data by using a neural network. - In a case where an inference result obtained by performing inference on material decomposition image data includes information regarding a specific material, the
selection unit 445 selects the inference result obtained by performing inference on the material decomposition image data. In a case where an inference result obtained by performing inference on CT image data (integral image data) includes information regarding a specific lesion, theselection unit 445 selects the inference result obtained by performing inference on the CT image data (integral image data). - In a case where an inference result obtained by performing inference on material decomposition image data includes information regarding a specific material and where an inference result obtained by performing inference on CT image data (integral image data) includes information regarding a specific lesion, the
selection unit 445 selects the inference result obtained by performing inference on the material decomposition image data and the inference result obtained by performing inference on the CT image data (integral image data). - Now, a modification of the first embodiment will be described. As illustrated in
FIG. 5 , in S108, thefirst inference unit 450 performs inference on the material decomposition image data and obtains an inference result. Thesecond inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result. Thecontrol unit 441 is capable of comparing the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data with the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data), calculating comparison information of the inference results, and causing the comparison information to be displayed. The comparison information of the inference results indicates whether the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data matches the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data). - For example, in a case where the inference result of the
first inference unit 450 obtained by performing inference on the material decomposition image data matches the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data), theselection unit 445 selects either one of the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data and the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data). Thedisplay control unit 446 may cause thedisplay unit 42 to display information indicating that the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data matches the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data). - In a case where the inference result of the
first inference unit 450 obtained by performing inference on the material decomposition image data is different from the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data), there is a possibility that material decomposition affects the inference results, and thus theselection unit 445 selects the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result of thefirst inference unit 450 and the materialdecomposition image data 300, as illustrated inFIG. 3 . - The
display control unit 446 may cause thedisplay unit 42 to display information indicating that the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data is different from the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data). - The
display control unit 446 may perform emphasized display for a region in which the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data is different from the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data). The emphasized display is frame display, highlight display, or the like. Thedisplay control unit 446 is capable of performing display such that a region in which the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data is different from the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data) can be distinguished. - The
display control unit 446 causes thedisplay unit 42 to display, on a composite image composed of the material decomposition image data and the CT image data (integral image data), the inference result of thefirst inference unit 450 obtained by performing inference on the material decomposition image data and the inference result of thesecond inference unit 451 obtained by performing inference on the CT image data (integral image data). The operator is able to recognize, from the individual inference results (detection information), which detection information has a difference. - As described above, the X-ray CT apparatus according to the present embodiment includes the
X-ray tube 11 configured to radiate X-rays; thedetector 12 configured to detect X-rays radiated by theX-ray tube 11 and passed through a subject; thereconstruction processing unit 442 configured to reconstruct imaging data output by thedetector 12 and generate CT image data and material decomposition image data; thefirst inference unit 450 configured to perform inference on the material decomposition image data; thesecond inference unit 451 configured to perform inference on the CT image data; and thedisplay control unit 446 configured to cause thedisplay unit 42 to display at least one of an inference result of thefirst inference unit 450 and an inference result of thesecond inference unit 451. The X-ray CT apparatus according to the present embodiment is capable of displaying an inference result of thefirst inference unit 450 configured to perform inference on material decomposition image data and an inference result of thesecond inference unit 451 configured to perform inference on CT image data, and thus the operator is able to confirm the individual inference results. - The information processing system according to the present embodiment includes the
first inference unit 450 configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of the X-ray CT apparatus; thesecond inference unit 451 configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; and thedisplay control unit 446 configured to cause thedisplay unit 42 to display at least one of an inference result of thefirst inference unit 450 and an inference result of thesecond inference unit 451. - The information processing method according to the present embodiment includes generating CT image data and material decomposition image data that are based on X-rays radiated by the
X-ray tube 11 and passed through a subject; and causing thedisplay unit 42 to display at least one of an inference result of thefirst inference unit 450 configured to perform inference on the material decomposition image data and an inference result of thesecond inference unit 451 configured to perform inference on the CT image data. - Next, a second embodiment of the present disclosure will be described with reference to
FIGS. 6 and 7 . The second embodiment is different from the first embodiment in that theselection unit 445 selects at least one of thefirst inference unit 450 that performs inference on material decomposition image data and thesecond inference unit 451 that performs inference on CT image data (integral image data). In the present embodiment, differences from the first embodiment will be mainly described. - In the case of selecting material decomposition image data as an inference target, the
selection unit 445 selects thefirst inference unit 450. Thefirst inference unit 450 performs inference on the material decomposition image data. In the case of not selecting material decomposition image data as an inference target, theselection unit 445 selects thesecond inference unit 451. Thesecond inference unit 451 performs inference on CT image data (integral image data). - As illustrated in
FIG. 6 , thereconstruction processing unit 442 has a function of generating CT image data (integral image data), based on imaging data output by thedetector 12. Thedisplay control unit 446 causes thedisplay unit 42 to display the CT image data. Thereconstruction processing unit 442 also has a function of performing material decomposition on imaging data output by thedetector 12 and reconstructing material decomposition image data by using a result of the material decomposition. Thedisplay control unit 446 is capable of causing thedisplay unit 42 to display the material decomposition image data. - The
selection unit 445 selects whether inference is to be performed on the material decomposition image data. In a case where the material decomposition image data is selected as an inference target (thefirst inference unit 450 is selected), thefirst inference unit 450 performs inference on the material decomposition image data and obtains an inference result. Thefirst inference unit 450 outputs the inference result of thefirst inference unit 450 to thedisplay control unit 446. - The
selection unit 445 is capable of selecting at least one of thefirst inference unit 450 and thesecond inference unit 451 in accordance with an examination order. Specifically, in a case where the examination order includes an examination regarding mammary glands (calcification examination), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data including calcium information. In a case where the examination order includes an examination using a contrast medium (iodine examination), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data including iodine information. Furthermore, in a case where the examination order includes an examination regarding the presence/absence of metal (stent) (metal examination), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data including metal (stent) information. - That is, in a case where the examination order includes a predetermined first examination (calcification examination, iodine examination, metal examination, or the like), the
selection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. - In a case where the examination order does not include the predetermined first examination, the
selection unit 445 selects thesecond inference unit 451 that performs inference on CT image data (integral image data). In a case where the material decomposition image data is not selected as an inference target, that is, in a case where the CT image data (integral image data) is selected as an inference target (thesecond inference unit 451 is selected), thesecond inference unit 451 performs inference on the CT image data (integral image data). Thesecond inference unit 451 outputs an inference result of thesecond inference unit 451 to thedisplay control unit 446. - In a case where the examination order includes a predetermined second examination (an examination regarding breast cancer (a calcification examination and a tumor examination)), an inference result of the
first inference unit 450 that performs inference on material decomposition image data including calcium information and an inference result of thesecond inference unit 451 that performs inference on CT image data (integral image data) are necessary. Thus, theselection unit 445 selects both thefirst inference unit 450 that performs inference on material decomposition image data including calcium information and thesecond inference unit 451 that performs inference on CT image data (integral image data). - Next, an operation of the X-ray CT apparatus 1 according to an embodiment of the present disclosure will be described.
FIG. 7 is a flowchart illustrating an example operation of the X-ray CT apparatus 1. - S100 to S104 are the same as in
FIG. 5 , and thus the description thereof will be omitted. - S200: The
selection unit 445 selects whether inference is to be performed on material decomposition image data. That is, theselection unit 445 selects at least one of thefirst inference unit 450 and thesecond inference unit 451. In a case where inference is to be performed on material decomposition image data, that is, in the case of selecting thefirst inference unit 450, the process proceeds to S202. In a case where inference is to be performed on CT image data (integral image data), that is, in the case of selecting thesecond inference unit 451, the process proceeds to S210. - In the X-ray CT apparatus 1, a non-material-decomposition mode (integral image mode) is normally set as an imaging mode when material decomposition is not performed. Thus, CT image data (integral image data) is normally obtained, and thus the
selection unit 445 selects thesecond inference unit 451 that performs inference on the CT image data (integral image data). In the X-ray CT apparatus 1, in response to a material decomposition mode (material decomposition image mode) being set as an imaging mode for performing material decomposition, theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. Theselection unit 445 selects, for example, at least one of thefirst inference unit 450 and thesecond inference unit 451 in accordance with an examination order. - S202: In a case where material decomposition image data is selected as an inference target (the
first inference unit 450 is selected), thereconstruction processing unit 442 reconstructs and generates material decomposition image data indicating material decomposition. - S204: The
first inference unit 450 performs inference on the material decomposition image data and obtains an inference result. - S206: The
first inference unit 450 outputs the inference result of thefirst inference unit 450 to thedisplay control unit 446. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result of thefirst inference unit 450 and the materialdecomposition image data 300, as illustrated inFIG. 3 . - S210: In a case where the CT image data (integral image data) is selected as an inference target, that is, in a case where the
second inference unit 451 is selected, thereconstruction processing unit 442 does not reconstruct material decomposition image data indicating material decomposition by using material decomposition information which is a result of material decomposition. - That is, in a case where material decomposition image data is not selected as an inference target, material decomposition image data indicating material decomposition is not reconstructed by using material decomposition information which is a result of material decomposition. The
second inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result. - S212: The
second inference unit 451 outputs the inference result of thesecond inference unit 451 to thedisplay control unit 446. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result of thesecond inference unit 451 and the CT image data 301 (integral image data), as illustrated inFIG. 4 . - As described above, the X-ray CT apparatus according to the present embodiment includes the
X-ray tube 11 configured to radiate X-rays; thedetector 12 configured to detect X-rays radiated by theX-ray tube 11 and passed through a subject; thereconstruction processing unit 442 configured to reconstruct imaging data output by thedetector 12 and generate CT image data and material decomposition image data; thefirst inference unit 450 configured to perform inference on the material decomposition image data; thesecond inference unit 451 configured to perform inference on the CT image data; and theselection unit 445 configured to select, based on an examination order, at least one of thefirst inference unit 450 and thesecond inference unit 451. - The X-ray CT apparatus according to the present embodiment is capable of displaying, based on an examination order, an inference result of the
first inference unit 450 configured to perform inference on material decomposition image data and an inference result of thesecond inference unit 451 configured to perform inference on CT image data, and thus the operator is able to confirm an inference result corresponding to the examination order. - The information processing system according to the present embodiment includes the
first inference unit 450 configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of the X-ray CT apparatus; thesecond inference unit 451 configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; and theselection unit 445 configured to select, based on an examination order, at least one of thefirst inference unit 450 and thesecond inference unit 451. - The information processing method according to the present embodiment includes generating CT image data and material decomposition image data that are based on X-rays radiated by the
X-ray tube 11 and passed through a subject; and performing, based on an examination order, inference on at least one of the CT image data and the material decomposition image data. - Next, a third embodiment of the present disclosure will be described with reference to
FIGS. 8 and 9 . The third embodiment is different from the first and second embodiments in that theimage analysis unit 443 that analyzes material decomposition image data is provided and that theselection unit 445 selects, based on an analysis result of theimage analysis unit 443, at least one of thefirst inference unit 450 that performs inference on material decomposition image data and thesecond inference unit 451 that performs inference on CT image data (integral image data). In the present embodiment, differences from the first and second embodiments will be mainly described. - As illustrated in
FIG. 8 , thereconstruction processing unit 442 has a function of generating CT image data (integral image data), based on imaging data output by thedetector 12. Thedisplay control unit 446 causes thedisplay unit 42 to display the CT image data. Thereconstruction processing unit 442 performs material decomposition on the imaging data output by thedetector 12, and reconstructs material decomposition image data by using a result of the material decomposition. Thedisplay control unit 446 is capable of causing thedisplay unit 42 to display the material decomposition image data. - The
image analysis unit 443 analyzes material decomposition image data. Theimage analysis unit 443 is capable of analyzing material decomposition image data and obtaining the type and amount of material included in the material decomposition image data. Theselection unit 445 is capable of selecting an inference target, based on an analysis result of theimage analysis unit 443, that is, based on content information of a predetermined material included in the material decomposition image data. In other words, theselection unit 445 selects, based on an analysis result of theimage analysis unit 443, that is, based on content information of a predetermined material included in the material decomposition image data, at least one of thefirst inference unit 450 that performs inference on material decomposition image data and thesecond inference unit 451 that performs inference on CT image data (integral image data). - The
selection unit 445 is capable of selecting, based on an analysis result of theimage analysis unit 443, that is, based on content information of a predetermined lesion included in the material decomposition image data, at least one of thefirst inference unit 450 that performs inference on material decomposition image data and thesecond inference unit 451 that performs inference on CT image data (integral image data). Theimage analysis unit 443 is capable of analyzing material decomposition image data and obtaining the type and amount of lesion included in the material decomposition image data. - The predetermined material is any one of calcium, water, iodine, and the like. The
image analysis unit 443 is capable of obtaining, as content information of the predetermined material in the material decomposition image data, for example, the percentage of calcium included in the material decomposition image data. Theimage analysis unit 443 is also capable of determining whether calcium is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more). In a case where calcium is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. In a case where calcium is not included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thesecond inference unit 451 that performs inference on CT image data (integral image data). - The
image analysis unit 443 is capable of obtaining, as content information of the predetermined material in the material decomposition image data, for example, the percentage of water included in the material decomposition image data. Water corresponds to, for example, blood, lymph, or the like. Theimage analysis unit 443 is also capable of determining whether water is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more). In a case where water is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. In a case where water is not included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thesecond inference unit 451 that performs inference on CT image data (integral image data). - The
image analysis unit 443 is capable of obtaining, as content information of the predetermined material in the material decomposition image data, for example, the percentage of iodine included in the material decomposition image data. Theimage analysis unit 443 is also capable of determining whether iodine is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more). In a case where iodine is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. In a case where iodine is not included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thesecond inference unit 451 that performs inference on CT image data (integral image data). - That is, in a case where a predetermined material is included in the material decomposition image data at a predetermined ratio or more, the
selection unit 445 selects thefirst inference unit 450. In a case where a predetermined material is not included in the material decomposition image data at a predetermined ratio or more, theselection unit 445 selects thesecond inference unit 451. - A setting unit (operation unit 43) for setting the type of material to be analyzed by the
image analysis unit 443 may be provided. The operator is able to select, via the setting unit, the type of material to be analyzed by theimage analysis unit 443. As a material to be analyzed by theimage analysis unit 443, the operator selects, for example, calcium via the setting unit. In a case where calcium is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. In a case where calcium is not included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thesecond inference unit 451 that performs inference on CT image data (integral image data). - As a material to be analyzed by the
image analysis unit 443, the operator selects, for example, iodine via the setting unit. In a case where iodine is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. In a case where iodine is not included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thesecond inference unit 451 that performs inference on CT image data (integral image data). - As a material and lesion to be analyzed by the
image analysis unit 443, the operator is able to select, for example, calcium and tumor via the setting unit. In a case where the material (calcium) is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more) or in a case where the lesion (tumor) is included in the material decomposition image data at a predetermined ratio or more (at a predetermined content or more), theselection unit 445 selects thefirst inference unit 450 that performs inference on material decomposition image data. - Next, an operation of the X-ray CT apparatus 1 according to an embodiment of the present disclosure will be described.
FIG. 9 is a flowchart illustrating an example operation of the X-ray CT apparatus 1. - S100 to S106 are the same as in
FIG. 5 , and thus the description thereof will be omitted. - S300: The
image analysis unit 443 analyses the material decomposition image data, and theselection unit 445 is capable of selecting an inference target, based on an analysis result of theimage analysis unit 443, that is, based on content information of a predetermined material included in the material decomposition image data. Theselection unit 445 selects at least one of thefirst inference unit 450 that performs inference on material decomposition image data and thesecond inference unit 451 that performs inference on CT image data (integral image data). - In the case of selecting the material decomposition image data as an inference target, the process proceeds to S302. In the case of not selecting the material decomposition image data as an inference target, the process proceeds to S310.
- S302: The
first inference unit 450 performs inference on the material decomposition image data and obtains an inference result. - S304: The
first inference unit 450 outputs the inference result of thefirst inference unit 450 to thedisplay control unit 446. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result of thefirst inference unit 450 and the materialdecomposition image data 300, as illustrated inFIG. 3 . Thedisplay control unit 446 is capable of causing thedisplay unit 42 to display an analysis result of theimage analysis unit 443. Specifically, thedisplay control unit 446 is capable of causing thedisplay unit 42 to display content information of a predetermined material and content information of a predetermined lesion in the material decomposition image data. - S310: In a case where inference is to be performed on the CT image data (integral image data), that is, in the case of selecting the
second inference unit 451, thesecond inference unit 451 performs inference on the CT image data (integral image data) and obtains an inference result. - S312: The
second inference unit 451 outputs the inference result of thesecond inference unit 451 to thedisplay control unit 446. Thedisplay control unit 446 causes thedisplay unit 42 to display the inference result of thesecond inference unit 451 and the CT image data 301 (integral image data), as illustrated inFIG. 4 . Thedisplay control unit 446 is capable of causing thedisplay unit 42 to display an analysis result of theimage analysis unit 443. Specifically, thedisplay control unit 446 is capable of causing thedisplay unit 42 to display content information of a predetermined material in the material decomposition image data. - As described above, the X-ray CT apparatus according to the present embodiment includes the
X-ray tube 11 configured to radiate X-rays; thedetector 12 configured to detect X-rays radiated by theX-ray tube 11 and passed through a subject; thereconstruction processing unit 442 configured to reconstruct imaging data output by thedetector 12 and generate CT image data and material decomposition image data; thefirst inference unit 450 configured to perform inference on the material decomposition image data; thesecond inference unit 451 configured to perform inference on the CT image data; theimage analysis unit 443 configured to analyze the material decomposition image data; and theselection unit 445 configured to select, based on an analysis result of theimage analysis unit 443, at least one of thefirst inference unit 450 and thesecond inference unit 451. Thus, the operator is able to confirm the inference result corresponding to the material decomposition image data. - The information processing system according to the present embodiment includes the
first inference unit 450 configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of the X-ray CT apparatus; thesecond inference unit 451 configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; theimage analysis unit 443 configured to analyze the material decomposition image data; and theselection unit 445 configured to select, based on an analysis result of theimage analysis unit 443, at least one of thefirst inference unit 450 and thesecond inference unit 451. - The information processing method according to the present embodiment includes generating CT image data and material decomposition image data that are based on X-rays radiated by the
X-ray tube 11 and passed through a subject; analyzing the material decomposition image data; and performing, based on the analysis result, inference on at least one of the CT image data and the material decomposition image data. - A computer program that implements the functions of the above-described embodiments may be supplied to a computer via a network or a memory (storage medium), and the computer program may be executed by a processor (not illustrated). The computer program causes the computer to execute the above-described information processing method. That is, the computer program is a program for implementing the functions of the information processing system by the computer. The memory stores the computer program.
- Embodiment(s) of the present disclosure can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
- While the present disclosure has been described with reference to exemplary embodiments, it is to be understood that the present disclosure is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
- This application claims the benefit of Japanese Patent Application No. 2022-159395, filed Oct. 3, 2022, which is hereby incorporated by reference herein in its entirety.
Claims (18)
1. An X-ray computed tomography (CT) apparatus comprising:
an X-ray tube configured to radiate X-rays;
a detector configured to detect X-rays radiated by the X-ray tube and passed through a subject;
a reconstruction processing unit configured to reconstruct imaging data output by the detector and generate CT image data and material decomposition image data;
a first inference unit configured to perform inference on the material decomposition image data;
a second inference unit configured to perform inference on the CT image data; and
a display control unit configured to cause a display unit to display at least one of an inference result of the first inference unit and an inference result of the second inference unit.
2. The X-ray CT apparatus according to claim 1 , further comprising:
a selection unit configured to select at least one of the inference result of the first inference unit and the inference result of the second inference unit, wherein
the display control unit is configured to cause the display unit to display an inference result selected by the selection unit.
3. The X-ray CT apparatus according to claim 1 , wherein the CT image data is integral image data.
4. The X-ray CT apparatus according to claim 2 , wherein the selection unit is configured to select at least one of the inference result of the first inference unit and the inference result of the second inference unit in accordance with an examination order.
5. The X-ray CT apparatus according to claim 4 , wherein the selection unit is configured to, in a case where the examination order includes a predetermined first examination, select the inference result of the first inference unit.
6. The X-ray CT apparatus according to claim 4 , wherein the selection unit is configured to, in a case where the examination order does not include a predetermined first examination, select the inference result of the second inference unit.
7. The X-ray CT apparatus according to claim 1 , wherein the display control unit is configured to, in response to a predetermined material being detected in the material decomposition image data by the first inference unit, cause the display unit to display region information and material name information regarding the predetermined material.
8. The X-ray CT apparatus according to claim 1 , wherein the display control unit is configured to cause the display unit to display information indicating that inference has been performed on the material decomposition image data.
9. The X-ray CT apparatus according to claim 1 , wherein the display control unit is configured to, in response to a predetermined lesion being detected in the CT image data by the second inference unit, cause the display unit to display region information and lesion name information regarding the predetermined lesion.
10. The X-ray CT apparatus according to claim 1 , wherein the display control unit is configured to cause the display unit to display information indicating that inference has been performed on the CT image data.
11. The X-ray CT apparatus according to claim 2 , wherein the display control unit is configured to, in response to both the inference result of the first inference unit and the inference result of the second inference unit being selected by the selection unit, cause the display unit to display, on the same screen, composite image data composed of the material decomposition image data and the CT image data, the inference result of the first inference unit, and the inference result of the second inference unit.
12. The X-ray CT apparatus according to claim 2 , wherein the selection unit is configured to, in a case where the inference result of the first inference unit is different from the inference result of the second inference unit, select the inference result of the first inference unit.
13. The X-ray CT apparatus according to claim 12 , wherein the display control unit is configured to cause the display unit to display information indicating that the inference result of the first inference unit is different from the inference result of the second inference unit.
14. The X-ray CT apparatus according to claim 13 , wherein the display control unit is configured to perform emphasized display for a region in which the inference result of the first inference unit is different from the inference result of the second inference unit.
15. The X-ray CT apparatus according to claim 2 , wherein the selection unit is configured to, in a case where the inference result of the first inference unit matches the inference result of the second inference unit, select either one of the inference result of the first inference unit and the inference result of the second inference unit.
16. An information processing system comprising:
a first inference unit configured to perform inference on material decomposition image data generated by reconstructing imaging data output by a detector of an X-ray computed tomography (CT) apparatus;
a second inference unit configured to perform inference on CT image data generated by reconstructing the imaging data output by the detector of the X-ray CT apparatus; and
a display control unit configured to cause a display unit to display at least one of an inference result of the first inference unit and an inference result of the second inference unit.
17. An information processing method comprising:
generating computed tomography (CT) image data and material decomposition image data that are based on X-rays radiated by an X-ray tube and passed through a subject; and
causing a display unit to display at least one of an inference result of a first inference unit configured to perform inference on the material decomposition image data and an inference result of a second inference unit configured to perform inference on the CT image data.
18. A non-transitory computer-readable medium storing a program for causing a computer to execute the information processing method according to claim 17 .
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022-159395 | 2022-10-03 | ||
JP2022159395A JP2024053263A (en) | 2022-10-03 | 2022-10-03 | X-ray CT device, information processing system, information processing method and program |
Publications (1)
Publication Number | Publication Date |
---|---|
US20240112336A1 true US20240112336A1 (en) | 2024-04-04 |
Family
ID=90471050
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/478,731 Pending US20240112336A1 (en) | 2022-10-03 | 2023-09-29 | X-ray computed tomography apparatus, information processing system, information processing method, and non-transitory computer-readable medium |
Country Status (3)
Country | Link |
---|---|
US (1) | US20240112336A1 (en) |
JP (1) | JP2024053263A (en) |
CN (1) | CN117814821A (en) |
-
2022
- 2022-10-03 JP JP2022159395A patent/JP2024053263A/en active Pending
-
2023
- 2023-09-28 CN CN202311277500.5A patent/CN117814821A/en active Pending
- 2023-09-29 US US18/478,731 patent/US20240112336A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
CN117814821A (en) | 2024-04-05 |
JP2024053263A (en) | 2024-04-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7488037B2 (en) | Medical image diagnostic device, medical image diagnostic method, and program | |
JP7461102B2 (en) | Medical image processing equipment and X-ray CT equipment | |
US10706596B2 (en) | X-ray computed tomography apparatus and image generation apparatus | |
JP7179479B2 (en) | X-ray CT device | |
US20240112336A1 (en) | X-ray computed tomography apparatus, information processing system, information processing method, and non-transitory computer-readable medium | |
US20240148344A1 (en) | X-ray computed tomography apparatus, information processing system, information processing method, and non-transitory computer-readable medium | |
JP7391499B2 (en) | Radiation detector, radiation diagnostic equipment, and charge sharing determination method | |
JP2024053264A (en) | X-ray CT device, information processing system, information processing method and program | |
CN110881993A (en) | X-ray CT apparatus, medical image processing apparatus, and X-ray CT system | |
US20240180503A1 (en) | Photon counting computed tomography apparatus and photon-counting ct-scanning condition setting method | |
US20230346323A1 (en) | X-ray ct apparatus | |
US11717242B2 (en) | Photon counting computed tomography (CT) apparatus | |
US11478203B2 (en) | X-ray computed tomography apparatus and imaging condition management apparatus | |
JP7206163B2 (en) | X-ray CT apparatus, medical information processing apparatus, and medical information processing program | |
JP2020096693A (en) | X-ray CT system and processing program | |
US11559269B2 (en) | X-ray imaging apparatus, medical information processing apparatus, X-ray detector, and correction method of X-ray detector | |
US20230404514A1 (en) | Medical data processing method, model generating method, and medical data processing apparatus | |
US20240169531A1 (en) | Medical image processing apparatus, medical image processing method, and model generation method | |
US20240074715A1 (en) | X-ray ct apparatus, data processing method, and storage medium | |
US11874409B2 (en) | Correction X-ray detector, X-ray CT apparatus, and detector element determining method | |
US20240095977A1 (en) | Reconstruction device, x-ray ct apparatus, and image processing device | |
EP4092617A2 (en) | Medical information processing method and medical image processing apparatus | |
JP2024030428A (en) | Spectral imaging X-ray CT device, image-guided display method, and image-guided display program | |
JP2024057817A (en) | X-ray computed tomography apparatus, medical image correction method, and medical image correction program | |
JP2024066111A (en) | Medical image processing device and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |