WO2022163514A1 - 医療画像処理装置、方法及びプログラム - Google Patents
医療画像処理装置、方法及びプログラム Download PDFInfo
- Publication number
- WO2022163514A1 WO2022163514A1 PCT/JP2022/002133 JP2022002133W WO2022163514A1 WO 2022163514 A1 WO2022163514 A1 WO 2022163514A1 JP 2022002133 W JP2022002133 W JP 2022002133W WO 2022163514 A1 WO2022163514 A1 WO 2022163514A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- time measurement
- state
- time
- medical image
- image processing
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 159
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000005259 measurement Methods 0.000 claims abstract description 210
- 238000007689 inspection Methods 0.000 claims abstract description 92
- 230000008569 process Effects 0.000 claims abstract description 37
- 238000001514 detection method Methods 0.000 claims description 18
- 238000003672 processing method Methods 0.000 claims description 13
- 238000003860 storage Methods 0.000 claims description 10
- 238000004886 process control Methods 0.000 claims 1
- 238000003780 insertion Methods 0.000 description 14
- 230000037431 insertion Effects 0.000 description 14
- 230000006399 behavior Effects 0.000 description 13
- 238000001839 endoscopy Methods 0.000 description 13
- 238000003384 imaging method Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 239000003814 drug Substances 0.000 description 10
- 229940079593 drug Drugs 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 238000012937 correction Methods 0.000 description 9
- 210000002429 large intestine Anatomy 0.000 description 8
- 230000007704 transition Effects 0.000 description 8
- 230000008859 change Effects 0.000 description 7
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 7
- 238000005452 bending Methods 0.000 description 6
- 238000005286 illumination Methods 0.000 description 5
- 238000012216 screening Methods 0.000 description 4
- 238000001574 biopsy Methods 0.000 description 3
- 238000002052 colonoscopy Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 239000012530 fluid Substances 0.000 description 3
- 238000012323 Endoscopic submucosal dissection Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 210000004534 cecum Anatomy 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 238000012326 endoscopic mucosal resection Methods 0.000 description 2
- 239000007789 gas Substances 0.000 description 2
- 230000003902 lesion Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002496 gastric effect Effects 0.000 description 1
- 238000001727 in vivo Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 210000000664 rectum Anatomy 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 229940125723 sedative agent Drugs 0.000 description 1
- 239000000932 sedative agent Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 210000000813 small intestine Anatomy 0.000 description 1
- 239000007921 spray Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
- G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/0002—Operational features of endoscopes provided with data storages
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00045—Display arrangement
- A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00043—Operational features of endoscopes provided with output arrangements
- A61B1/00055—Operational features of endoscopes provided with output arrangements for alerting the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
- G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Definitions
- the present invention relates to a medical image processing apparatus, method and program, and more particularly to technology for informing the user of useful information while observing medical images.
- Patent Document 1 An endoscopy data recording system that records transitions in an examination data storage unit
- the endoscopy data recording system described in Patent Document 1 includes the use time of each irradiation light, the number of times each irradiation light is used, the observation time using each drug, and the use of each drug in endoscopy. Calculate the number of times of use, the execution time of each treatment, the number of times of each treatment, etc., record the calculated data in the examination data storage unit, , the number of times each irradiation light is used, the observation time using each drug, the number of times each drug is used, the time each treatment is performed, and the number of times each treatment is performed, etc., and the calculated data is inspected. It is recorded in the data storage section.
- the observation light usage start time and usage end time are specified by the observation light button, and the observation start time and observation end time using the drug are specified by the drug button. Two points, the implementation start time and the implementation end time, are designated by the action button.
- the endoscopy data recording system described in Patent Document 1 displays transitions of irradiation light type data, chemical spray data, and treatment execution data acquired during endoscopy on the screen of the display unit. It has a display control unit that allows
- the present invention has been made in view of such circumstances, and an object of the present invention is to provide a medical image processing apparatus, method, and program capable of automatically measuring the time relating to the inspection state of time-series medical images. .
- the invention according to a first aspect provides a medical image processing apparatus comprising a processor, wherein the processor performs medical image acquisition processing for sequentially acquiring time-series medical images, and based on the sequentially acquired medical images, an inspection state recognition process for recognizing an inspection state using a device, a time measurement process for measuring the time related to the inspection state, a time measurement control process for controlling the behavior of time measurement according to the recognition result of the inspection state, and a time measurement state and a notification process of notifying the user of information regarding the information by the notification unit.
- the examination state is automatically recognized based on the sequentially acquired medical images, and the time measurement behavior regarding the examination state is controlled according to the recognition result of the examination state. It is possible to reduce the user's burden for time measurement during examination using medical images.
- the notification unit since information about the state of time measurement is notified to the user by the notification unit, for example, when the automatic recognition of the inspection state fails, or when the inspection state is automatically recognized at a timing different from the timing intended by the user. , the user can be made aware of it.
- the notification process causes the notification unit to notify the user of information regarding the time measurement state only for a certain period based on the timing at which the time measurement state changes. is preferred. If information about the state of time measurement exceeds a certain period of time, it may interfere with the inspection, or information about the state of time measurement (for example, information indicating "measurement start") may interfere with the current inspection state (for example, This is because it may be far from "medium”).
- the notification process causes the first display area of the display unit functioning as the notification unit to display in real time information about the measured time by the time measurement process, and It is preferable to display information about the state of time measurement in a second display area different from the first display area, or to notify the information about the state of time measurement as sound information from a speaker functioning as a notification unit.
- the information on the measured time may be the measured time itself, or may be a bar graph or the like having a length corresponding to the measured time.
- the information about the state of time measurement includes information on one or more of start, end, pause, and restart of time measurement
- the time measurement control process includes: It is preferable to control one or more of starting, ending, suspending, or resuming time measurement in the time measurement process.
- the processor performs reception processing for receiving information regarding the state of time measurement from the user operation unit, and the time measurement control processing receives information regarding the state of time measurement from the user operation unit. is received, the received information about the state of time measurement is preferentially used instead of the recognition result in the inspection state recognition process, and the behavior of time measurement is preferably controlled.
- the user can manually instruct the information regarding the state of time measurement, thereby making it possible to perform correct time measurement.
- the processor performs a process of storing the time measurement result of the time measurement process in the storage unit.
- the time required for the inspection or the like can be confirmed after the fact.
- the time required for the examination is an index of the quality of the screening.
- the processor performs processing for storing the time measurement result of the time measurement processing in the storage unit, and the behavior of the time measurement control processing is controlled by user operation on the user operation unit.
- the processor it is preferable to change the method of storing the time measurement result in the storage unit according to the controlled behavior situation. As a result, it is possible to identify whether the time measurement result is measured only by the automatic recognition of the inspection state or is corrected by the user's operation due to an error in the automatic recognition of the inspection state.
- the examination state recognition processing recognizes whether the examination state is being treated based on the sequentially acquired medical images. This makes it possible to measure treatment time.
- the examination state recognition processing includes performing treatment tool detection processing for detecting the treatment tool based on the sequentially acquired medical images. It is preferable to recognize whether
- the medical image is an endoscopic image.
- the examination state recognition processing recognizes that the endoscope is being inserted, removed, or is outside the body based on sequentially acquired medical images.
- the inspection state recognition processing performs landmark detection processing for detecting landmarks in the lumen based on the sequentially acquired medical images, and the landmark detection result is Preferably, the inspection status is recognized accordingly.
- the inspection state recognition processing performs motion detection processing for detecting motion of the endoscope based on sequentially acquired medical images. It is preferable to recognize the inspection state according to the detection result. By recognizing the movement state of the endoscope, it is possible to determine that it is being inserted when it is advancing and that it is being removed when it is returning. Therefore, it is possible to determine that the timing of transition from insertion to removal is the start of removal.
- a fourteenth aspect of the invention there is provided a step of sequentially acquiring time-series medical images, an inspection state recognition step of recognizing information about an inspection state based on the sequentially acquired medical images, and a time measurement for measuring a time related to the inspection state.
- a time measurement control step of controlling the behavior of time measurement according to the recognition result of the inspection state; and a notification step of causing the notification unit to notify the user of information regarding the state of time measurement, wherein the processor performs each It is a medical image processing method for performing the processing of steps.
- the notification step causes the notification unit to notify the user of information regarding the time measurement state only for a certain period of time based on the timing at which the time measurement state changes. is preferred.
- the notifying step causes the first display area of the display unit functioning as the notifying unit to display in real time information about the time measured by the time measuring step, and It is preferable to display information about the state of time measurement in a second display area different from the first display area, or to notify the information about the state of time measurement as sound information from a speaker functioning as a notification unit.
- the medical image processing method includes a step of receiving information about the state of time measurement from the user operation unit, wherein the time measurement control step receives information about the state of time measurement from the user operation unit, It is preferable to preferentially use the received information about the state of time measurement instead of the recognition result in the inspection state recognition step to control the behavior of time measurement.
- the invention according to the eighteenth aspect is a medical image processing program that causes a processor to execute the processing of each step in the medical image processing method according to any one of the fourteenth to seventeenth aspects of the present invention.
- the present invention it is possible to automatically measure the time related to the inspection status of time-series medical images, and reduce the burden on the user during the inspection.
- FIG. 1 is a schematic diagram showing the overall configuration of an endoscope system including a medical image processing apparatus according to the present invention.
- FIG. 2 is a block diagram illustrating an embodiment of a medical image processing device.
- FIG. 3 is a diagram showing a first notification example by a display.
- FIG. 4 is a diagram showing a second example of notification by the indicator.
- FIG. 5 is a diagram showing an example of a screen displayed on the display when saving measurement results.
- FIG. 6 is a flow chart showing an embodiment of a medical image processing method according to the present invention.
- FIG. 1 is a schematic diagram showing the overall configuration of an endoscope system including a medical image processing apparatus according to the present invention.
- an endoscope system 9 includes an endoscope 10 that is an electronic endoscope, a light source device 11, an endoscope processor device 12, a display device 13, and a medical image processing device 14. , an operation unit 15 , and a display device 16 .
- the endoscope 10 captures time-series medical images including subject images, and is, for example, a lower gastrointestinal scope.
- the endoscope 10 includes an insertion section 20 which is inserted into a subject (in this example, the large intestine which is a hollow organ) and which has a distal end and a proximal end, and a proximal end side of the insertion section 20 connected to the insertion section 20 . It also has a hand operation unit 21 that is held by a doctor who is an operator to perform various operations, and a universal cord 22 connected to the hand operation unit 21 .
- the insertion portion 20 is formed in a long shape with a small diameter as a whole.
- the insertion portion 20 includes a flexible portion 25 that is flexible in order from the base end side to the distal end side, a bending portion 26 that can be bent by operating the hand operation portion 21, and an imaging optical system (not shown) (objective lens ) and a distal end portion 27 in which an imaging device 28 and the like are built in are arranged in series.
- the imaging device 28 is a CMOS (complementary metal oxide semiconductor) type or CCD (charge coupled device) type imaging device. Image light of the site to be observed passes through an observation window (not shown) opened on the distal end surface of the distal end portion 27 and an objective lens (not shown) arranged behind the observation window. is incident. The imaging device 28 captures (converts into an electrical signal) the image light of the site to be observed that has entered its imaging surface, and outputs an imaging signal.
- CMOS complementary metal oxide semiconductor
- CCD charge coupled device
- the hand operation unit 21 is provided with various operation members operated by a doctor (user). Specifically, the hand operation unit 21 has two types of bending operation knobs 29 used for bending operation of the bending portion 26, an air/water supply button 30 for air/water supply operation, and a suction button 31 for suction operation. , is provided.
- the hand operation unit 21 also includes a still image photographing instruction unit 32 for instructing photographing of a still image 39 of the site to be observed, A treatment instrument introduction port 33 into which a treatment instrument (not shown) is inserted is provided.
- the universal cord 22 is a connection cord for connecting the endoscope 10 to the light source device 11.
- the universal cord 22 includes a light guide 35, a signal cable 36, and a fluid tube (not shown) that are inserted through the insertion section 20.
- a connector 37a connected to the light source device 11 and a connector 37b branched from the connector 37a and connected to the endoscope processor device 12 are provided.
- the light guide 35 and the fluid tube (not shown) are inserted into the light source device 11 .
- necessary illumination light, water, and gas are supplied from the light source device 11 to the endoscope 10 via the light guide 35 and the fluid tube (not shown).
- illumination light is emitted from an illumination window (not shown) on the distal end surface of the distal end portion 27 toward the site to be observed.
- gas or water is jetted from an air/water supply nozzle (not shown) on the distal end surface of the distal end portion 27 toward an observation window (not shown) on the distal end surface. be.
- the signal cable 36 and the endoscope processor device 12 are electrically connected.
- an imaging signal of the site to be observed is output from the imaging device 28 of the endoscope 10 to the endoscope processor device 12 via the signal cable 36, and the endoscope processor device 12 outputs an image signal of the endoscope.
- a control signal is output to 10 .
- the light source device 11 supplies illumination light to the light guide 35 of the endoscope 10 via the connector 37a.
- the illumination light may be white light (light in a white wavelength band or light in a plurality of wavelength bands), light in one or more specific wavelength bands, or light in various wavelength bands according to the purpose of observation, such as a combination thereof. selected.
- the endoscope processor device 12 controls the operation of the endoscope 10 via the connector 37b and the signal cable 36.
- the endoscope processor device 12 also generates an image ( (also referred to as “moving image 38”).
- an image also referred to as “moving image 38”.
- the still image photographing instruction unit 32 is operated by the hand operation unit 21 of the endoscope 10
- the endoscope processor device 12 in parallel with the generation of the moving image 38, reproduces one image in the moving image 38.
- a still image 39 corresponding to the timing of the photographing instruction is used as the frame image.
- the moving image 38 and still image 39 are medical images captured inside the subject, that is, inside the living body. Furthermore, when the moving image 38 and the still image 39 are images obtained by light of the above-described specific wavelength band (special light), both are special light images. Then, the endoscope processor device 12 outputs the generated moving image 38 and still image 39 to the display device 13 and the medical image processing device 14, respectively.
- the endoscope processor device 12 may generate (acquire) a special light image having information on the specific wavelength band described above, based on the normal light image obtained with the white light described above.
- the endoscope processor device 12 functions as a special light image acquisition section. Then, the endoscope processor unit 12 converts the signals in the specific wavelength band into red, green, and blue [RGB (Red, Green, Blue)] or cyan, magenta, and yellow [CMY ( Cyan, Magenta, Yellow)] by performing an operation based on the color information.
- RGB Red, Green, Blue
- CMY Cyan, Magenta, Yellow
- the endoscope processor device 12 for example, based on at least one of the normal light image obtained by the above-described white light and the special light image obtained by the above-described light of the specific wavelength band (special light) Then, a feature amount image such as a known oxygen saturation image may be generated.
- the endoscope processor device 12 functions as a feature image generator.
- the moving image 38 or still image 39 including the in vivo image, the normal light image, the special light image, and the feature amount image are all captured or measured for the purpose of image diagnosis and inspection. It is a medical image imaging the result.
- the display device 13 is connected to the endoscope processor device 12 and functions as a display unit that displays the moving image 38 and the still image 39 input from the endoscope processor device 12 .
- the doctor (user) performs forward/backward operations of the insertion section 20 while confirming the moving image 38 displayed on the display device 13, and operates the still image photographing instruction section 32 when a lesion or the like is found in the site to be observed. Then, a still image of the site to be observed is captured, and treatment such as diagnosis and biopsy is performed.
- the medical image processing apparatus 14 recognizes the examination state based on time-series medical images, controls the behavior of time measurement regarding the examination state according to the recognition result of the examination state, and notifies the user of information regarding the state of time measurement.
- a personal computer is used.
- the operation unit 15 includes a keyboard, a mouse, etc., which are wired or wirelessly connected to the personal computer, as well as buttons provided on the hand operation unit 21 of the endoscope 10, and a display device (display unit).
- Various monitors such as a liquid crystal monitor connectable to a personal computer are used as 16 .
- FIG. 2 is a block diagram illustrating an embodiment of a medical image processing device.
- the medical image processing apparatus 14 shown in FIG. It is composed of a display control unit 46, a sound information reproduction processing unit 47, and a memory 48, and processing of each unit is realized by one or a plurality of processors.
- the CPU 41 operates based on the operating system stored in the memory 48 and various programs including the medical image processing program according to the present invention, and operates a medical image acquisition unit 40, an examination state recognition processing unit 42, a time measurement processing unit 43, It controls the time measurement control processing unit 44, the notification processing unit 45, the display control unit 46, and the sound information reproduction processing unit 47, and functions as a part of these units.
- the medical image acquisition unit 40 uses an image input/output interface (not shown) wired or wirelessly connected to the endoscope processor device 12 ( FIG. 1 ) to acquire time-series data including subject images from the endoscope processor device 12 . It is a medical image acquisition processing unit that sequentially acquires the frame images 38a as medical images. In this example, a moving image 38 captured by the endoscope 10 is acquired. Further, when the above-described still image 39 is captured by the endoscope 10 while the moving image 38 is being captured, the medical image acquisition unit 40 acquires the moving image 38 and the still image 39 from the endoscope processor device 12. get.
- the examination state recognition processing unit 42 is a part that recognizes the examination state based on the moving image 38 acquired by the medical image acquisition unit 40 .
- the inspection state recognition processing unit 42 performs landmark detection processing for detecting landmarks in the lumen based on the moving image 38 as an example of recognition of the inspection state.
- This example is an embodiment in which the endoscope 10 is inserted into the large intestine for endoscopic examination of the large intestine.
- the removal time (the time it takes to return to the rectum after insertion into the cecum) is an indicator of screening quality. Record the measurement results.
- the examination state recognition processing unit 42 detects the Bauhin valve of the ileocecal portion of the large intestine at the boundary between the large intestine and the small intestine as a landmark in the lumen. Whether or not the distal end of the insertion portion 20 of the endoscope 10 has reached the examination start position for endoscopic examination of the large intestine (inspection state) is determined according to the detection result of this landmark (Bauhin valve). recognize. Detection of intraluminal landmarks based on medical images can be performed, for example, by a known AI (Artificial Intelligence) technique.
- AI Artificial Intelligence
- the examination state recognition processing unit 42 recognizes that the endoscope 10 is being inserted, removed, or outside the body based on the moving image 38 .
- the timing at which the endoscope 10 switches from being inserted to being removed can be used as the timing to start removing (start measuring the removal time).
- start measuring the removal time the timing at which the endoscope 10 switches from being inserted to being removed.
- Whether the endoscope 10 is being inserted or removed is determined by, for example, a change in the size or position of a partial area in the frame images 38a that make up the moving image 38 between frames. If it is determined that the tip is advancing, it can be recognized that it is being inserted, and if it is determined that it is returning, it can be recognized that it is being removed.
- the examination state recognition processing unit 42 can determine that removal is completed (examination completed).
- the examination state recognition processing unit 42 recognizes whether or not the examination state is being treated based on the moving image 38 as still another example of recognition of the examination state.
- the examination state recognition processing unit 42 performs a treatment tool detection process for detecting a treatment tool based on the moving image 38, and recognizes whether or not treatment is being performed according to the detection result of the treatment tool. That is, when the treatment tool is detected from the moving image 38, it can be recognized that the treatment is being performed during the detection period.
- the timing at which the treatment instrument is first detected from the moving image 38 can be recognized as the start of treatment, and the timing at which the treatment instrument is no longer detected from the moving image 38 after the detection of the treatment instrument can be recognized as the end of treatment.
- the end of treatment may be recognized from the procedure of treatment.
- the treatment instrument is a biopsy forceps
- the timing at which the biopsy forceps are closed, or EMR (Endoscopic mucosal resection) or ESD (Endoscopic Submucosal Dissection) is recognized as the end of treatment. good too.
- the time measurement processing unit 43 is a part that measures time regarding the inspection state, and measures a specific time during the inspection.
- the following two types of specific time are measured by the time measurement processing unit 43.
- Removal time in colonoscopy Removal time is an indicator of screening quality because it has been reported that lesions are often overlooked if the removal time from reaching the cecum to the end of the examination is short.
- Treatment time such as treatment
- the time required for treatment is a reference for patient burden and administration of sedatives.
- the time measurement control processing unit 44 controls the behavior of time measurement by the time measurement processing unit 43 according to the inspection state recognition result recognized by the inspection state recognition processing unit 42 .
- the information about the state of time measurement by the time measurement processing unit 43 includes one or more information of start, end, pause, and restart of time measurement. Controls the start and end of time measurement.
- the time measurement control processing unit 44 detects a predetermined landmark (Bauhin valve) by the examination state recognition processing unit 42, and then detects the Bauhin valve.
- the timing at which is no longer detected is used as the timing to start removal, and time measurement processing is started by the time measurement processing unit 43, and the timing at which the test state recognition processing unit 42 first recognizes the outside of the body is used as the timing to end removal. Time measurement by the unit 43 can be terminated.
- the time measurement control processing unit 44 measures the timing of switching from insertion to removal as the removal start timing. Time measurement by the processing unit 43 may be started.
- the time measurement control processing unit 44 detects the treatment tool by the examination state recognition processing unit 42 and recognizes that treatment is being performed. Time measurement by the time measurement processing unit 43 is started with the timing at which the treatment tool is detected as the treatment start timing. The time measurement by the time measurement processing unit 43 is terminated by using the timing when the time is lost as the timing of the end of the treatment.
- the CPU 41 performs reception processing for receiving information regarding the state of time measurement from the operation unit 15, which is a user operation unit. It is preferable to preferentially use the information about the state of time measurement instead of the recognition result in the inspection state recognition processing unit 42 to control the behavior of time measurement.
- the inspection state recognition processing unit 42 recognizes information about the state of time measurement, if a recognition error occurs, the behavior of time measurement cannot be controlled correctly (time measurement cannot be performed correctly).
- the time measurement control processing unit 44 uses the information on the state of time measurement by user operation, prior to the recognition result of the inspection state recognition processing unit 42 .
- the notification processing unit 45 is a part that notifies the user of information regarding the state of time measurement in the time measurement processing unit 43 by at least one of the display 16 and the speaker 17 functioning as a notification unit. The details of the notification of the information regarding the state of time measurement notified by the notification processing unit 45 will be described later.
- the display control unit 46 generates image data for display based on the medical image (moving image 38) acquired by the medical image acquisition unit 40 and outputs the image data to the display device 16, and the notification processing unit 45. and an information display control unit 46B that generates image data for display indicating information about the state of time measurement based on the notified information and outputs the image data to the display 16.
- the display control unit 46 synthesizes the image data of the moving image 38 output from the image display control unit 46A and the image data indicating the information regarding the state of time measurement output from the information display control unit 46B, and synthesizes them. By outputting the image data to the display 16, the display 16 is caused to display (notify) information about the state of time measurement together with the medical image.
- the sound information reproduction processing unit 47 Based on the information input from the notification processing unit 45, the sound information reproduction processing unit 47 causes the speaker 17 to reproduce (notify) sound information indicating the state of time measurement.
- the sound information reproduction processing unit 47 stores a plurality of sound information according to the content of the information regarding the state of time measurement, selects the sound information corresponding to the information input from the notification processing unit 45, and outputs the sound information to the speaker 17. can be output to
- the memory 48 includes flash memory, ROM (Read-only Memory), RAM (Random Access Memory), hard disk device, and the like.
- the flash memory, ROM, and hard disk device store the measurement time (removal time, treatment time ), and a non-volatile memory for storing the photographed still image 39 and the like.
- the RAM is a volatile memory capable of high-speed data reading and writing, which functions as an area for temporarily storing various programs stored in the nonvolatile memory and as a work area for the CPU 41 .
- FIG. 3 is a diagram showing a first notification example by a display.
- a moving medical image 52 and character information 54 of "03:40" indicating the measurement time are displayed in the first display area of the display device 16. is displayed.
- the first display area in this example is the upper left area of the screen 50 in FIG. 3 adjacent to the display area of the medical image 52 .
- the notification processing unit 45 may display the character information 54 such as "00:00", or hide or gray out the entire display of the character information 54. You may This allows the user to grasp the measurement state during the inspection.
- the notification processing unit 45 displays the time measured by the time measurement processing unit 43 in real time. From the character information 54 of the measurement time that changes in real time, the user can grasp that the examination is in progress and the examination time from the start of the examination to the present.
- the character information 54 changes from "00:00" or when the inspection time is displayed from hidden or grayed out, the user can automatically recognize the start of the inspection and start measuring the time. you can figure out what you did.
- the user can automatically recognize that the examination has ended and that the time measurement has ended. can.
- FIG. 4A and 4B are diagrams showing a second example of notification by the display device, FIG. 4A shows the screen of the display device at the start of measurement, and FIG. 4B shows the screen of the display device during measurement. ing.
- a moving image medical image 52 and character information 54 of the measurement time are displayed, as in the first notification example.
- the notification processing unit 45 notifies the user of information regarding the state of time measurement by the display unit 16, which is a notification unit, only for a certain period based on the timing when the state of time measurement changes.
- the notification processing unit 45 detects a constant Only during the period, the display 16 is caused to display the character information 56 "Starting measurement" as information on the state of time measurement.
- the notification processing unit 45 displays the character information 54 of the measurement time in a second display area different from the first display area (in this example, a display area adjacent to the lower side of the display area of the medical image 52). Character information 56 is displayed.
- the certain period during which the character information 56 "Starting measurement” is displayed is, for example, about several seconds, and it is preferable that the period is visible to the user.
- the fixed period may be set by the user.
- the character information 56 it is preferable to display the character information 56 larger than the character information 54 that reports the measurement time so that the user can easily notice it.
- notifying the character information 56 in a conspicuous manner may interfere with the examination, so the character information 56 is terminated after a certain period of time from the start of measurement, as shown in FIG. 4(B).
- the state transition may be indicated by character information 56 as shown in FIG. 4, or symbols may be used.
- time display during measurement may be used together, or may not be used together.
- the notification processing unit 45 outputs the information regarding the state of time measurement as sound information to the user via the sound information reproduction processing unit 47 and the speaker 17 only for a certain period based on the timing when the state of time measurement changes. can be notified to For example, instead of the character information 56 "starting measurement” or together with the character information 56 “starting measurement", the voice "starting measurement” can be pronounced.
- the sound information is not limited to a voice indicating "measurement will start", etc., and may be a beep sound or the like that notifies that the state of time measurement has changed.
- the CPU 41 Since it is necessary to record the removal time or treatment time of the large intestine endoscopy measured by the time measurement processing unit 43 as an examination record, the CPU 41 associates the removal time or the treatment time with a diagnostic report or the like and stores it. (Memory 48) Save.
- the CPU 41 recognizes the time measurement result measured only by the recognition result of the automatic recognition by the inspection state recognition processing unit 42 and the time measurement result through the correction by the user operation (for example, the measurement start timing is set to the inspection state recognition processing). It is preferable to store (change the storage method of the time measurement results) in a format that allows the user to perform the measurement start operation due to an error by the unit 42).
- the information about the state of time measurement is information such as inspection time (withdrawal time), inspection start, and inspection end.
- inspection time withdrawal time
- inspection start for example, it includes information such as treatment time, treatment start, treatment end, etc. during treatment using the treatment instrument.
- FIG. 5 is a diagram showing an example of a screen displayed on the display when saving measurement results.
- the time information (X min Y sec), which is the measurement result the information "without user correction” or “with user correction” is added to the measurement result and recorded. That is, when the behavior of the time measurement control process (starting point of time measurement, etc.) is controlled by the user's operation on the operation unit 15, the method of saving the time measurement result in the storage unit is determined according to the controlled behavior. change.
- the user can check the measurement results of "without user correction” after the inspection is completed, and later check whether there are any measurement errors.
- FIG. 5 is a diagram showing a display example prompting confirmation of measurement results when recording "without user correction".
- an "OK” button 57 and an “NG” button 58 are displayed, and when the "OK” button 57 is selected, information “no user correction” is added to the automatically measured measurement result and saved. , when the "NG” button 58 is operated, the corrected measurement result after the correction of the measurement result by the user is added with the information "user corrected” and saved.
- Correction of the measurement result by the user can be performed by, for example, temporarily storing the time-stamped moving image 38 in the memory 48, and reproducing the saved moving image 38 while playing back the frame image at the start of the inspection measurement or at the end of the inspection.
- the measurement result can be corrected by the user selecting a frame image.
- FIG. 6 is a flow chart showing an embodiment of the medical image processing method according to the present invention, showing the processing procedure of each part of the medical image processing apparatus 14 shown in FIG.
- the examination state recognition processing unit 42 recognizes the examination state based on the medical images acquired in step S10 (including medical images acquired before the current time) (step S12, examination state recognition step). For example, in the case of endoscopy, it recognizes whether the endoscope is being inserted, removed, or outside the body, or whether treatment is being performed using a treatment tool.
- the determination of the inspection start time can be made based on the recognition result of the inspection state in step S14.
- the notification processing unit 45 notifies the information indicating the start of the examination by the display device 16 and/or the speaker 17 only for a certain period based on the timing of the examination start, and then transitions to step S12 (step S24, notification step).
- the character information 56 "Measurement will be started” is displayed on the display 16 (FIG. 4A).
- the character information 54 continues to be displayed.
- step S16 it is determined that the inspection is underway, and the process proceeds to step S26.
- step S26 it is determined whether or not it is time to end the inspection.
- the determination of the inspection end point can be made based on the recognition result of the inspection state in step S14.
- step S26 if it is determined that the inspection has not ended (if "No"), the measurement time during inspection (measuring) is displayed on the display 16, and the process returns to step S12 (step S28).
- step S26 when it is determined in step S26 that it is time to end the examination (in the case of "Yes"), the time measurement control processing unit 44 causes the time measurement processing unit 43 to end time measurement (step S30), and , the notification processing unit 45 notifies the information indicating the end of the examination through the display 16 and/or the speaker 17 only for a certain period based on the timing of the end of the examination (step S32, notification step).
- the examination time (withdrawal time) or treatment time of the endoscopy measured by the time measurement processing unit 43 is displayed on the display 16 (see FIG. 5) and stored in the memory 48 in association with a diagnostic report or the like. (step S34).
- the examination start point and the examination start point may be determined based on the instruction.
- the inspection start time point or the inspection start time point is specified by the user, instead of the recognition result in the inspection state recognition processing unit 42, the inspection start time point or the inspection end time point specified by the user is preferentially used, and the inspection time is determined. It is preferable to control the start and end of time measurement.
- the endoscope processor device and the medical image processing device are provided separately in the above embodiment, the endoscope processor device and the medical image processing device may be integrated. That is, the endoscope processor device may be provided with a function as a medical image processing device.
- the measured examination time or treatment time is linked to a diagnostic report or the like and stored in the memory within the medical image processing apparatus. ) can be saved.
- medical images are not limited to endoscopic images captured by an endoscope, and may be time-series images acquired by other modalities such as ultrasonic diagnostic equipment.
- the hardware structure that executes various controls of the medical image processing apparatus of the above embodiment is the following various processors.
- the circuit configuration can be changed after manufacturing, such as CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), which is a general-purpose processor that executes software (program) and functions as various control units.
- Programmable Logic Device PLD
- ASIC Application Specific Integrated Circuit
- One processing unit may be composed of one of these various processors, or composed of two or more processors of the same type or different types (for example, a plurality of FPGAs, or a combination of a CPU and an FPGA).
- a plurality of control units may be configured by one processor.
- one processor is configured with a combination of one or more CPUs and software, as typified by a computer such as a client or a server.
- a processor functions as multiple controllers.
- SoC System On Chip
- various control units are configured using one or more of the above various processors as a hardware structure.
- the present invention includes a medical image processing program that, when installed in a computer, causes the computer to function as the medical image processing apparatus according to the present invention, and a non-volatile storage medium in which this medical image processing program is recorded. .
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Optics & Photonics (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Endoscopes (AREA)
Abstract
Description
図1は、本発明に係る医療画像処理装置を含む内視鏡システムの全体構成を示す概略図である。
医療画像処理装置14は、時系列の医療画像に基づいて検査状態を認識し、検査状態の認識結果に応じて検査状態に関する時間計測の挙動を制御し、時間計測の状態に関する情報をユーザに報知するものであり、本実施形態では、例えばパーソナルコンピュータが用いられる。また、操作部15は、パーソナルコンピュータに有線接続又は無線接続されるキーボード及びマウス等の他に、内視鏡スコープ10の手元操作部21に設けられたボタン類を含み、表示器(表示部)16はパーソナルコンピュータに接続可能な液晶モニタ等の各種モニタが用いられる。
図2は、医療画像処理装置の実施形態を示すブロック図である。
盲腸到達から検査終了までの抜去時間が短いと病変見落としが多くなることが報告されているため、抜去時間はスクリーニングの質の指標となっている。
処置に要する時間は患者負担や鎮静剤投与の参考となる。
次に、報知処理部45により表示器16等を介してユーザに報知される時間計測の状態に関する情報について説明する。
図3は、表示器による第1報知例を示す図である。
図4は、表示器による第2報知例を示す図であり、図4(A)は、計測開始時の表示器の画面を示し、図4(B)は計測中の表示器の画面を示している。
図6は、本発明に係る医療画像処理方法の一実施形態を示すフローチャートであり、図2に示した医療画像処理装置14の各部の処理手順に関して示している。
上記実施形態では、内視鏡プロセッサ装置と医療画像処理装置とが別体に設けられているが、内視鏡プロセッサ装置と医療画像処理装置とが一体化されていてもよい。即ち、内視鏡プロセッサ装置に、医療画像処理装置としての機能を設けてもよい。
10 内視鏡スコープ
11 光源装置
12 内視鏡プロセッサ装置
13 表示装置
14 医療画像処理装置
15 操作部
16 表示器
17 スピーカ
20 挿入部
21 手元操作部
22 ユニバーサルコード
25 軟性部
26 湾曲部
27 先端部
28 撮像素子
29 湾曲操作ノブ
30 送気送水ボタン
31 吸引ボタン
32 静止画撮影指示部
33 処置具導入口
35 ライトガイド
36 信号ケーブル
37a、37b コネクタ
38 動画
38a フレーム画像
39 静止画
40 医療画像取得部
41 CPU
42 検査状態認識処理部
43 時間計測処理部
44 時間計測制御処理部
45 報知処理部
46 表示制御部
46A 画像表示制御部
46B 情報表示制御部
47 音情報再生処理部
48 メモリ
50 画面
52 医療画像
54、56 文字情報
57 「OK」ボタン
58 「NG」ボタン
F フラグ
S10~S34 ステップ
Claims (19)
- プロセッサを備えた医療画像処理装置において、
前記プロセッサは、
時系列の医療画像を順次取得する医療画像取得処理と、
前記順次取得した前記医療画像に基づいて検査状態を認識する検査状態認識処理と、
前記検査状態に関する時間計測を行う時間計測処理と、
前記検査状態の認識結果に応じて、前記時間計測の挙動を制御する時間計測制御処理と、
前記時間計測の状態に関する情報を、報知部によりユーザに報知させる報知処理と、
を行う医療画像処理装置。 - 前記報知処理は、前記時間計測の状態に変化が発生したタイミングを基準にした一定期間のみ、前記時間計測の状態に関する情報を前記報知部によりユーザに報知させる、
請求項1に記載の医療画像処理装置。 - 前記報知処理は、前記報知部として機能する表示部の第1表示領域に前記時間計測処理による計測時間に関する情報をリアルタイムに表示させ、かつ前記表示部の前記第1表示領域とは異なる第2表示領域に前記時間計測の状態に関する情報を表示させ、又は前記報知部として機能するスピーカから前記時間計測の状態に関する情報を音情報として報知させる、
請求項1又は2に記載の医療画像処理装置。 - 前記時間計測の状態に関する情報は、前記時間計測の開始、終了、一時停止、及び再開のうちの1以上の情報を含み、
前記時間計測制御処理は、前記時間計測処理における前記時間計測の開始、終了、一時停止、又は再開のうちの1以上の制御を行う、
請求項1から3のいずれか1項に記載の医療画像処理装置。 - 前記プロセッサは、ユーザ操作部から前記時間計測の状態に関する情報を受け付ける受付処理を行い、
前記時間計測制御処理は、前記ユーザ操作部から前記時間計測の状態に関する情報を受け付けると、前記受け付けた前記時間計測の状態に関する情報を、前記検査状態認識処理における認識結果に代えて優先的に使用し、前記時間計測の挙動を制御する、
請求項1から4のいずれか1項に記載の医療画像処理装置。 - 前記プロセッサは、前記時間計測処理による時間計測結果を保存部に保存させる処理を行う、
請求項1から5のいずれか1項に記載の医療画像処理装置。 - 前記プロセッサは、前記時間計測処理による時間計測結果を保存部に保存させる処理を行い、前記ユーザ操作部におけるユーザ操作により前記時間計測制御処理の挙動が制御された場合には、前記制御された挙動状況に応じて前記保存部への前記時間計測結果の保存方法を変更する、
請求項5に記載の医療画像処理装置。 - 前記検査状態認識処理は、前記順次取得した前記医療画像に基づいて前記検査状態が処置中であるか否かを認識する、
請求項1から7のいずれか1項に記載の医療画像処理装置。 - 前記検査状態認識処理は、前記順次取得した前記医療画像に基づいて処置具を検出する処置具検出処理を行い、前記処置具の検出結果に応じて前記処置中であるか否かを認識する、
請求項8に記載の医療画像処理装置。 - 前記医療画像は内視鏡画像である、
請求項1から9のいずれか1項に記載の医療画像処理装置。 - 前記検査状態認識処理は、前記順次取得した前記医療画像に基づいて内視鏡スコープの挿入中、抜去中または体外であることを認識する、
請求項10に記載の医療画像処理装置。 - 前記検査状態認識処理は、前記順次取得した前記医療画像に基づいて管腔内のランドマークを検出するランドマーク検出処理を行い、前記ランドマークの検出結果に応じて前記検査状態を認識する、
請求項10又は11に記載の医療画像処理装置。 - 前記検査状態認識処理は、前記順次取得した前記医療画像に基づいて内視鏡スコープの動きを検出する動き検出処理を行い、前記内視鏡スコープの動きの検出結果に応じて前記検査状態を認識する、
請求項11又は12に記載の医療画像処理装置。 - 時系列の医療画像を順次取得するステップと、
前記順次取得した前記医療画像に基づいて検査状態に関する情報を認識する検査状態認識ステップと、
前記検査状態に関する時間計測を行う時間計測ステップと、
前記検査状態の認識結果に応じて、前記時間計測の挙動を制御する時間計測制御ステップと、
前記時間計測の状態に関する情報を、報知部によりユーザに報知させる報知ステップと、を含み、
プロセッサが各ステップの処理を実行する医療画像処理方法。 - 前記報知ステップは、前記時間計測の状態に変化が発生したタイミングを基準にした一定期間のみ、前記時間計測の状態に関する情報を前記報知部によりユーザに報知させる、
請求項14に記載の医療画像処理方法。 - 前記報知ステップは、前記報知部として機能する表示部の第1表示領域に前記時間計測ステップによる計測時間に関する情報をリアルタイムに表示させ、かつ前記表示部の前記第1表示領域とは異なる第2表示領域に前記時間計測の状態に関する情報を表示させ、又は前記報知部として機能するスピーカから前記時間計測の状態に関する情報を音情報として報知させる、
請求項14又は15に記載の医療画像処理方法。 - ユーザ操作部から前記時間計測の状態に関する情報を受け付けるステップを含み、
前記時間計測制御ステップは、前記ユーザ操作部から前記時間計測の状態に関する情報を受け付けると、前記受け付けた前記時間計測の状態に関する情報を、前記検査状態認識ステップにおける認識結果に代えて優先的に使用し、前記時間計測の挙動を制御する、
請求項14から16のいずれか1項に記載の医療画像処理方法。 - 請求項14から17のいずれか1項に記載の医療画像処理方法における各ステップの処理を、前記プロセッサに実行させる医療画像処理プログラム。
- 非一時的かつコンピュータ読取可能な記録媒体であって、請求項18に記載のプログラムが記録された記録媒体。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202280011200.XA CN116744834A (zh) | 2021-01-27 | 2022-01-21 | 医疗图像处理装置、方法及程序 |
EP22745735.5A EP4285810A4 (en) | 2021-01-27 | 2022-01-21 | DEVICE, METHOD AND PROGRAM FOR PROCESSING MEDICAL IMAGES |
JP2022578319A JPWO2022163514A1 (ja) | 2021-01-27 | 2022-01-21 | |
US18/351,230 US20230360221A1 (en) | 2021-01-27 | 2023-07-12 | Medical image processing apparatus, medical image processing method, and medical image processing program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021-010915 | 2021-01-27 | ||
JP2021010915 | 2021-01-27 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/351,230 Continuation US20230360221A1 (en) | 2021-01-27 | 2023-07-12 | Medical image processing apparatus, medical image processing method, and medical image processing program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022163514A1 true WO2022163514A1 (ja) | 2022-08-04 |
Family
ID=82654451
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/002133 WO2022163514A1 (ja) | 2021-01-27 | 2022-01-21 | 医療画像処理装置、方法及びプログラム |
Country Status (5)
Country | Link |
---|---|
US (1) | US20230360221A1 (ja) |
EP (1) | EP4285810A4 (ja) |
JP (1) | JPWO2022163514A1 (ja) |
CN (1) | CN116744834A (ja) |
WO (1) | WO2022163514A1 (ja) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110167417B (zh) * | 2017-01-26 | 2022-01-07 | 奥林巴斯株式会社 | 图像处理装置、动作方法和存储介质 |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014053723A (ja) * | 2012-09-06 | 2014-03-20 | Fujifilm Corp | 医療画像管理装置、医療画像管理方法、医療画像管理プログラム |
JP2017012666A (ja) | 2015-07-06 | 2017-01-19 | オリンパス株式会社 | 内視鏡検査データ記録システム |
WO2018116572A1 (ja) * | 2016-12-22 | 2018-06-28 | オリンパス株式会社 | 内視鏡挿入形状観測装置 |
JP2018164722A (ja) * | 2017-03-28 | 2018-10-25 | オリンパス株式会社 | 内視鏡装置、内視鏡システム及び内視鏡画像の記録方法 |
WO2019049451A1 (ja) * | 2017-09-05 | 2019-03-14 | オリンパス株式会社 | ビデオプロセッサ、内視鏡システム、表示方法、及び表示プログラム |
WO2019054045A1 (ja) * | 2017-09-15 | 2019-03-21 | 富士フイルム株式会社 | 医療画像処理装置、医療画像処理方法及び医療画像処理プログラム |
WO2020017212A1 (ja) * | 2018-07-20 | 2020-01-23 | 富士フイルム株式会社 | 内視鏡システム |
WO2020039685A1 (ja) * | 2018-08-20 | 2020-02-27 | 富士フイルム株式会社 | 医療画像処理装置 |
WO2020040086A1 (ja) * | 2018-08-20 | 2020-02-27 | 富士フイルム株式会社 | 医療画像処理システム |
KR102185886B1 (ko) * | 2020-05-22 | 2020-12-02 | 주식회사 웨이센 | 인공지능을 이용한 대장 내시경 영상 분석 방법 및 장치 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018235420A1 (ja) * | 2017-06-19 | 2018-12-27 | オリンパス株式会社 | 医療情報処理システム |
JPWO2019138773A1 (ja) * | 2018-01-10 | 2020-12-10 | 富士フイルム株式会社 | 医療画像処理装置、内視鏡システム、医療画像処理方法及びプログラム |
WO2020054543A1 (ja) * | 2018-09-11 | 2020-03-19 | 富士フイルム株式会社 | 医療画像処理装置及び方法、内視鏡システム、プロセッサ装置、診断支援装置並びにプログラム |
WO2020170809A1 (ja) * | 2019-02-19 | 2020-08-27 | 富士フイルム株式会社 | 医療画像処理装置、内視鏡システム、及び医療画像処理方法 |
-
2022
- 2022-01-21 WO PCT/JP2022/002133 patent/WO2022163514A1/ja active Application Filing
- 2022-01-21 EP EP22745735.5A patent/EP4285810A4/en active Pending
- 2022-01-21 CN CN202280011200.XA patent/CN116744834A/zh active Pending
- 2022-01-21 JP JP2022578319A patent/JPWO2022163514A1/ja active Pending
-
2023
- 2023-07-12 US US18/351,230 patent/US20230360221A1/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014053723A (ja) * | 2012-09-06 | 2014-03-20 | Fujifilm Corp | 医療画像管理装置、医療画像管理方法、医療画像管理プログラム |
JP2017012666A (ja) | 2015-07-06 | 2017-01-19 | オリンパス株式会社 | 内視鏡検査データ記録システム |
WO2018116572A1 (ja) * | 2016-12-22 | 2018-06-28 | オリンパス株式会社 | 内視鏡挿入形状観測装置 |
JP2018164722A (ja) * | 2017-03-28 | 2018-10-25 | オリンパス株式会社 | 内視鏡装置、内視鏡システム及び内視鏡画像の記録方法 |
WO2019049451A1 (ja) * | 2017-09-05 | 2019-03-14 | オリンパス株式会社 | ビデオプロセッサ、内視鏡システム、表示方法、及び表示プログラム |
WO2019054045A1 (ja) * | 2017-09-15 | 2019-03-21 | 富士フイルム株式会社 | 医療画像処理装置、医療画像処理方法及び医療画像処理プログラム |
WO2020017212A1 (ja) * | 2018-07-20 | 2020-01-23 | 富士フイルム株式会社 | 内視鏡システム |
WO2020039685A1 (ja) * | 2018-08-20 | 2020-02-27 | 富士フイルム株式会社 | 医療画像処理装置 |
WO2020040086A1 (ja) * | 2018-08-20 | 2020-02-27 | 富士フイルム株式会社 | 医療画像処理システム |
KR102185886B1 (ko) * | 2020-05-22 | 2020-12-02 | 주식회사 웨이센 | 인공지능을 이용한 대장 내시경 영상 분석 방법 및 장치 |
Non-Patent Citations (1)
Title |
---|
See also references of EP4285810A4 |
Also Published As
Publication number | Publication date |
---|---|
EP4285810A1 (en) | 2023-12-06 |
JPWO2022163514A1 (ja) | 2022-08-04 |
CN116744834A (zh) | 2023-09-12 |
EP4285810A4 (en) | 2024-06-12 |
US20230360221A1 (en) | 2023-11-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11690494B2 (en) | Endoscope observation assistance apparatus and endoscope observation assistance method | |
JP4153963B2 (ja) | 内視鏡挿入形状検出装置 | |
JP5542021B2 (ja) | 内視鏡システム、内視鏡システムの作動方法、及びプログラム | |
JP5486432B2 (ja) | 画像処理装置、その作動方法およびプログラム | |
JP2006198032A (ja) | 手術支援システム | |
JP7289373B2 (ja) | 医療画像処理装置、内視鏡システム、診断支援方法及びプログラム | |
JP7125479B2 (ja) | 医療画像処理装置、医療画像処理装置の作動方法及び内視鏡システム | |
WO2020188682A1 (ja) | 診断支援装置、診断支援方法及びプログラム | |
WO2020090729A1 (ja) | 医療画像処理装置、医療画像処理方法及びプログラム、診断支援装置 | |
JP6203456B2 (ja) | 超音波観測装置、超音波観測装置の作動方法および超音波観測装置の作動プログラム | |
US20230360221A1 (en) | Medical image processing apparatus, medical image processing method, and medical image processing program | |
JP7493285B2 (ja) | 情報処理装置、情報処理方法、及びコンピュータプログラム | |
JP7289241B2 (ja) | ファイリング装置、ファイリング方法及びプログラム | |
US20230200626A1 (en) | Image processing apparatus, processor apparatus, endoscope system, image processing method, and program | |
JPWO2020184257A1 (ja) | 医用画像処理装置及び方法 | |
JP7264407B2 (ja) | 訓練用の大腸内視鏡観察支援装置、作動方法、及びプログラム | |
EP4302681A1 (en) | Medical image processing device, medical image processing method, and program | |
JP2005111081A (ja) | 内視鏡画像表示処理装置 | |
WO2024042895A1 (ja) | 画像処理装置、内視鏡、画像処理方法、及びプログラム | |
JP7257544B2 (ja) | 情報表示システムおよび情報表示方法 | |
US20240005500A1 (en) | Medical image processing apparatus, medical image processing method, and program | |
US20240074638A1 (en) | Medical image processing apparatus, medical image processing method, and program | |
WO2023195103A1 (ja) | 検査支援システムおよび検査支援方法 | |
WO2024121885A1 (ja) | 情報処理装置、情報処理方法、及び、記録媒体 | |
JP2023107919A (ja) | 大腸内視鏡観察支援装置、作動方法、及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22745735 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022578319 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280011200.X Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022745735 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2022745735 Country of ref document: EP Effective date: 20230828 |