JP6972049B2 - 脈管叢構造の弾性マッピングを用いた画像処理方法および画像処理装置 - Google Patents
脈管叢構造の弾性マッピングを用いた画像処理方法および画像処理装置 Download PDFInfo
- Publication number
- JP6972049B2 JP6972049B2 JP2019024250A JP2019024250A JP6972049B2 JP 6972049 B2 JP6972049 B2 JP 6972049B2 JP 2019024250 A JP2019024250 A JP 2019024250A JP 2019024250 A JP2019024250 A JP 2019024250A JP 6972049 B2 JP6972049 B2 JP 6972049B2
- Authority
- JP
- Japan
- Prior art keywords
- image data
- intraoperative
- preoperative
- vascular plexus
- intraoperative image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000002792 vascular Effects 0.000 title claims description 35
- 238000013507 mapping Methods 0.000 title description 6
- 238000003672 processing method Methods 0.000 title description 4
- 238000000034 method Methods 0.000 claims description 33
- 238000001228 spectrum Methods 0.000 claims description 20
- 210000001519 tissue Anatomy 0.000 claims description 19
- 210000004872 soft tissue Anatomy 0.000 claims description 18
- 230000003287 optical effect Effects 0.000 claims description 15
- 210000005166 vasculature Anatomy 0.000 claims description 15
- OAICVXFJPJFONN-UHFFFAOYSA-N Phosphorus Chemical compound [P] OAICVXFJPJFONN-UHFFFAOYSA-N 0.000 claims description 13
- 230000017531 blood circulation Effects 0.000 claims description 8
- 238000002329 infrared spectrum Methods 0.000 claims description 4
- 238000002189 fluorescence spectrum Methods 0.000 claims description 3
- 238000001356 surgical procedure Methods 0.000 description 17
- 239000008280 blood Substances 0.000 description 6
- 210000004369 blood Anatomy 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 238000002675 image-guided surgery Methods 0.000 description 4
- 210000004556 brain Anatomy 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- OYPRJOBELJOOCE-UHFFFAOYSA-N Calcium Chemical compound [Ca] OYPRJOBELJOOCE-UHFFFAOYSA-N 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 2
- 238000002583 angiography Methods 0.000 description 2
- 239000011575 calcium Substances 0.000 description 2
- 229910052791 calcium Inorganic materials 0.000 description 2
- 230000001054 cortical effect Effects 0.000 description 2
- MOFVSTNWEDAEEK-UHFFFAOYSA-M indocyanine green Chemical compound [Na+].[O-]S(=O)(=O)CCCCN1C2=CC=C3C=CC=CC3=C2C(C)(C)C1=CC=CC=CC=CC1=[N+](CCCCS([O-])(=O)=O)C2=CC=C(C=CC=C3)C3=C2C1(C)C MOFVSTNWEDAEEK-UHFFFAOYSA-M 0.000 description 2
- 229960004657 indocyanine green Drugs 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012634 optical imaging Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 210000001367 artery Anatomy 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 210000005013 brain tissue Anatomy 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000000004 hemodynamic effect Effects 0.000 description 1
- 230000003834 intracellular effect Effects 0.000 description 1
- 238000002595 magnetic resonance imaging Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 238000006213 oxygenation reaction Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 239000011574 phosphorus Substances 0.000 description 1
- 229910052698 phosphorus Inorganic materials 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
- 210000001835 viscera Anatomy 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
- A61B5/0037—Performing a preliminary scan, e.g. a prescan for identifying a region of interest
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0071—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/026—Measuring blood flow
- A61B5/0261—Measuring blood flow using optical means, e.g. infrared light
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/7425—Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/20—Surgical microscopes characterised by non-optical aspects
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/361—Image-producing devices, e.g. surgical cameras
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/14—Transformations for image registration, e.g. adjusting or mapping for alignment of images
- G06T3/153—Transformations for image registration, e.g. adjusting or mapping for alignment of images using elastic snapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2065—Tracking using image or pattern recognition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
- A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
- A61B2090/367—Correlation of different images or relation of image positions in respect to the body creating a 3D dataset from 2D images using position information
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/373—Surgical systems with images on a monitor during operation using light, e.g. by using optical scanners
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/3937—Visible markers
- A61B2090/3941—Photoluminescent markers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/397—Markers, e.g. radio-opaque or breast lesions markers electromagnetic other than visible, e.g. microwave
- A61B2090/3975—Markers, e.g. radio-opaque or breast lesions markers electromagnetic other than visible, e.g. microwave active
- A61B2090/3979—Markers, e.g. radio-opaque or breast lesions markers electromagnetic other than visible, e.g. microwave active infrared
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
- A61B2505/05—Surgical care
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
- G06T2207/10061—Microscopic image from scanning electron microscope
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
- G06T2207/30104—Vascular flow; Blood flow; Perfusion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/03—Recognition of patterns in medical or anatomical images
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biophysics (AREA)
- Radiology & Medical Imaging (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Optics & Photonics (AREA)
- Hematology (AREA)
- Gynecology & Obstetrics (AREA)
- Physiology (AREA)
- Cardiology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Epidemiology (AREA)
- Robotics (AREA)
- Artificial Intelligence (AREA)
- Primary Health Care (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Endoscopes (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Description
2 顕微鏡
4 メモリアセンブリ
6 術前三次元画像データ
8 カメラアセンブリ
10 視野
12 生体軟組織
14 術中画像データ
14a 蛍光発光術中画像データ
14b 可視光術中画像データ
16 入力フレーム
18 入力フレームの時系列
20 画素
22 蛍光体
24 フィルタアセンブリ
26 鏡面反射を阻止するためのフィルタ装置
28 蛍光発光に対するバンドパスフィルタ装置
32 照射アセンブリ
34 照射光
40 画像プロセッサアセンブリ
42 データコネクション
44 入力インタフェース
46 パターンマッチングモジュール
48 脈管叢構造
50 弾性マッチングモジュール
52 画像形成モジュール
54 出力画像データ
55 出力インタフェース
56 ディスプレイアセンブリ
58 ポジションセンサ
60 ポジショニングデータ
62 光学レンズシステム
64 血流方向
66 ロケーション
Claims (12)
- 手術中にリアルタイムに、生体軟組織(12)の出力画像データ(54)を表示するための医用観察装置(1)の動作方法であって、前記動作方法は、
前記生体軟組織(12)の術前三次元画像データ(6)を準備するステップと、
可視光スペクトルと近赤外スペクトルとのうちの少なくとも一方において、前記生体軟組織(12)の術中画像データ(14)を取得するステップと、
可視組織表面の下にある少なくとも1つの脈管叢構造(48)を前記術中画像データ(14)において自動的に識別するステップと、
少なくとも1つの識別された前記脈管叢構造(48)を前記術前三次元画像データ(6)において識別するステップと、
少なくとも1つの識別された前記脈管叢構造(48)に基づき、前記術前三次元画像データ(6)を前記術中画像データ(14)に弾性マッチングさせるステップと、
弾性マッチングされた前記術前三次元画像データ(6)と前記術中画像データ(14)とから出力画像データ(54)を形成するステップと、
を有し、
識別された前記脈管叢構造(48)における少なくとも1つのロケーション(66)において、前記術中画像データ(14)を用いて血流方向(64)を計算する、
動作方法。 - 識別される前記脈管叢構造(48)を、蛍光体(22)からの蛍光発光を用いて取得された術中画像データ(14)において識別する、
請求項1記載の動作方法。 - 前記術中画像データ(14)において識別された前記脈管叢構造(48)は、前記可視光スペクトルの光を用いて記録されていたものである、
請求項1または2記載の動作方法。 - 前記出力画像データ(54)を表示する、
請求項1から3までのいずれか1項記載の動作方法。 - 前記術中画像データ(14)を取得するために、鏡面反射を低減する少なくとも1つの光学フィルタ装置(26)を用いる、
請求項1から4までのいずれか1項記載の動作方法。 - ポジショニングデータ(60)を取得し、
前記ポジショニングデータ(60)は、前記術中画像データ(14)を取得するために用いられる光学レンズシステム(62)の焦点距離、前記光学レンズシステム(62)の被写界深度、前記光学レンズシステム(62)の間隔設定、前記術中画像データ(14)の取得時点における前記光学レンズシステム(62)の視野(10)の大きさ、寸法および配向、のうちの少なくとも1つを表し、
前記ポジショニングデータ(60)を、前記術前三次元画像データ(6)における前記脈管叢構造(48)の識別、前記術中画像データ(14)への前記術前三次元画像データ(6)の弾性マッチング、および前記出力画像データ(54)の表示、のうちの少なくとも1つにおいて用いる、
請求項1から5までのいずれか1項記載の動作方法。 - 手術中に、生体軟組織(12)の出力画像データ(54)を生成するための医用観察装置(1)、例えば顕微鏡(2)または内視鏡であって、前記医用観察装置(1)は、
前記生体軟組織(12)の術前三次元画像データ(6)を有するメモリアセンブリ(4)と、
可視光スペクトルと近赤外スペクトルとのうちの少なくとも一方において、前記生体軟組織(12)の術中画像データ(14)を取得するためのカメラアセンブリ(8)と、
画像プロセッサアセンブリ(40)と、
出力画像データ(54)を出力するための出力インタフェースと、
を有しており、
前記画像プロセッサアセンブリ(40)は、
可視組織表面の下にある少なくとも1つの脈管叢構造(48)を前記術中画像データ(14)において識別するための、および少なくとも1つの識別された前記脈管叢構造(48)を前記術前三次元画像データ(6)において識別するための、パターンマッチングモジュール(46)と、
少なくとも1つの識別された前記脈管叢構造(48)に基づき、前記術前三次元画像データ(6)を前記術中画像データ(14)に弾性マッチングさせるためのマッチングモジュール(50)と、
弾性マッチングされた前記術前三次元画像データ(6)の少なくとも一部を前記術中画像データ(14)と組み合わせて前記出力画像データ(54)を形成するための画像形成モジュール(52)と、
を有し、
前記画像プロセッサアセンブリ(40)は、識別された前記脈管叢構造(48)において、前記術中画像データ(14)を用いて血流方向(64)を計算するように構成されている、
医用観察装置(1)。 - 前記医用観察装置(1)は、さらに、前記出力画像データ(54)を表示するためのディスプレイアセンブリ(56)を有する、
請求項7記載の医用観察装置(1)。 - 前記カメラアセンブリ(8)は、鏡面反射を低減するための少なくとも1つのフィルタ装置(26)を有しており、前記フィルタ装置(26)は、少なくとも1つの交差偏光子ペアを有する、
請求項7または8記載の医用観察装置(1)。 - 前記カメラアセンブリ(8)は、少なくとも1つの蛍光体(22)の蛍光スペクトルにマッチされた通過帯域をもつ少なくとも1つのフィルタ装置(28)を有する、
請求項7から9までのいずれか1項記載の医用観察装置(1)。 - 前記カメラアセンブリ(8)は、光学レンズシステム(62)と、ポジショニングデータ(60)を取得するための少なくとも1つのポジションセンサ(58)と、を有しており、
前記ポジショニングデータ(60)は、前記光学レンズシステム(62)の焦点距離、被写界深度および間隔設定、視野(10)の大きさ、寸法および配向、のうちの少なくとも1つを表す、
請求項7から10までのいずれか1項記載の医用観察装置(1)。 - 請求項1から6までのいずれか1項記載の動作方法をコンピュータに実行させるプログラムを記憶している、非一時的コンピュータ可読媒体。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP18156906.2 | 2018-02-15 | ||
EP18156906.2A EP3527123B1 (en) | 2018-02-15 | 2018-02-15 | Image processing method and apparatus using elastic mapping of vascular plexus structures |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2019141578A JP2019141578A (ja) | 2019-08-29 |
JP6972049B2 true JP6972049B2 (ja) | 2021-11-24 |
Family
ID=61521289
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019024250A Active JP6972049B2 (ja) | 2018-02-15 | 2019-02-14 | 脈管叢構造の弾性マッピングを用いた画像処理方法および画像処理装置 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20190247142A1 (ja) |
EP (1) | EP3527123B1 (ja) |
JP (1) | JP6972049B2 (ja) |
CN (1) | CN110164528B (ja) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3540494B1 (en) | 2018-03-16 | 2022-11-23 | Leica Instruments (Singapore) Pte. Ltd. | Augmented reality surgical microscope and microscopy method |
CN112584738B (zh) * | 2018-08-30 | 2024-04-23 | 奥林巴斯株式会社 | 记录装置、图像观察装置、观察***、观察***的控制方法及存储介质 |
CN111292410B (zh) * | 2020-01-19 | 2022-04-12 | 华中科技大学同济医学院附属协和医院 | 一种静脉显影照相装置及其三维全景模型的生成方法 |
EP3991685A1 (en) * | 2020-11-03 | 2022-05-04 | Leica Instruments (Singapore) Pte. Ltd. | Surgical microscope system |
WO2022232264A1 (en) * | 2021-04-28 | 2022-11-03 | Smith & Nephew, Inc. | Computerized systems for arthroscopic applications using real-time blood-flow detection |
WO2023052534A1 (en) * | 2021-09-30 | 2023-04-06 | Leica Instruments (Singapore) Pte. Ltd. | Image processing for surgical applications |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0957750A1 (en) * | 1995-10-23 | 1999-11-24 | Cytometrics, Inc. | Method and apparatus for reflected imaging analysis |
DE10163813A1 (de) * | 2001-12-22 | 2003-07-03 | Philips Intellectual Property | Verfahren zur Darstellung von unterschiedlichen Bildern eines Untersuchungsobjektes |
JP4147033B2 (ja) * | 2002-01-18 | 2008-09-10 | オリンパス株式会社 | 内視鏡装置 |
PT1485007E (pt) * | 2002-03-20 | 2007-10-11 | Novadaq Technologies Inc | ''sistema e método para visualização do fluxo de fluido através de vasos'' |
US20060173358A1 (en) * | 2005-01-11 | 2006-08-03 | Olympus Corporation | Fluorescence observation endoscope apparatus and fluorescence observation method |
US8538108B2 (en) * | 2005-12-20 | 2013-09-17 | University Of Maryland, Baltimore | Method and apparatus for accelerated elastic registration of multiple scans of internal properties of a body |
JP5214876B2 (ja) * | 2006-12-15 | 2013-06-19 | 株式会社東芝 | 3次元画像処理装置及び医用画像診断装置 |
WO2010046838A1 (en) * | 2008-10-23 | 2010-04-29 | Koninklijke Philips Electronics N.V. | Cardiac- and/or respiratory-gated image acquisition system and method for virtual anatomy enriched real-time 2d imaging in interventional radiofrequency ablation or pacemaker placement procedures |
US8423117B2 (en) * | 2009-06-22 | 2013-04-16 | General Electric Company | System and method to process an acquired image of a subject anatomy to differentiate a portion of subject anatomy to protect relative to a portion to receive treatment |
JP2011104199A (ja) * | 2009-11-19 | 2011-06-02 | Fujifilm Corp | 内視鏡装置 |
US8761474B2 (en) * | 2011-07-25 | 2014-06-24 | Siemens Aktiengesellschaft | Method for vascular flow pattern analysis |
DE102011120937B4 (de) * | 2011-12-14 | 2019-03-14 | Carl Zeiss Meditec Ag | Anordnung und Verfahren zur Registrierung von Gewebeverschiebungen |
US11510600B2 (en) * | 2012-01-04 | 2022-11-29 | The Trustees Of Dartmouth College | Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance |
WO2015023990A1 (en) * | 2013-08-15 | 2015-02-19 | The Trustees Of Dartmouth College | Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance |
MY167083A (en) * | 2013-12-06 | 2018-08-10 | Mimos Berhad | An apparatus and method for volumetric and speed measurement of blood 'train' in visible vessels |
CA2935873C (en) * | 2014-01-06 | 2022-10-25 | Body Vision Medical Ltd. | Surgical devices and methods of use thereof |
JP2017536870A (ja) * | 2014-10-20 | 2017-12-14 | ボディ・ビジョン・メディカル・リミテッドBody Vision Medical Ltd. | 外科的デバイスおよび外科的デバイスの使用方法 |
US11844576B2 (en) * | 2015-01-22 | 2023-12-19 | Koninklijke Philips N.V. | Endograft visualization with optical shape sensing |
JP2016177327A (ja) * | 2015-03-18 | 2016-10-06 | 伸彦 井戸 | 動的計画法を適用する有向無閉路グラフの構成と格子点のコストとに特徴を持つ、2つの要素列の対応付け方法 |
EP3616595B1 (en) * | 2016-05-23 | 2023-03-29 | Leica Instruments (Singapore) Pte. Ltd. | Medical observation device such as a microscope or an endoscope, and method for displaying medical images |
WO2018002347A1 (en) * | 2016-06-30 | 2018-01-04 | Koninklijke Philips N.V. | Registering tomographic imaging and endoscopic imaging |
WO2018012080A1 (ja) * | 2016-07-12 | 2018-01-18 | ソニー株式会社 | 画像処理装置、画像処理方法、プログラム及び手術用ナビゲーションシステム |
-
2018
- 2018-02-15 EP EP18156906.2A patent/EP3527123B1/en active Active
-
2019
- 2019-02-07 US US16/269,968 patent/US20190247142A1/en not_active Abandoned
- 2019-02-13 CN CN201910112740.7A patent/CN110164528B/zh active Active
- 2019-02-14 JP JP2019024250A patent/JP6972049B2/ja active Active
Also Published As
Publication number | Publication date |
---|---|
CN110164528A (zh) | 2019-08-23 |
EP3527123A1 (en) | 2019-08-21 |
US20190247142A1 (en) | 2019-08-15 |
EP3527123B1 (en) | 2022-08-31 |
JP2019141578A (ja) | 2019-08-29 |
CN110164528B (zh) | 2023-12-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6972049B2 (ja) | 脈管叢構造の弾性マッピングを用いた画像処理方法および画像処理装置 | |
US11857317B2 (en) | Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance | |
US11129562B2 (en) | Surgical navigation with stereovision and associated methods | |
EP3540494B1 (en) | Augmented reality surgical microscope and microscopy method | |
AU2015202805B2 (en) | Augmented surgical reality environment system | |
US20160086380A1 (en) | Hyperspectral imager | |
US20180024341A1 (en) | Augmented stereoscopic microscopy | |
WO2015023990A1 (en) | Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance | |
KR20160089355A (ko) | 미리 결정된 생물학적 구조체의 비침습적 검출 디바이스 | |
JP2023088989A (ja) | 内視鏡設計における血流および灌流撮像および定量化のためのレーザ撮像方法およびシステムを用いたマルチスペクトル生理機能視覚化(mspv) | |
WO2015187620A1 (en) | Surgical navigation with stereovision and associated methods | |
US11690558B2 (en) | Surgical navigation with stereovision and associated methods | |
KR20190069751A (ko) | 복수의 후보 좌표를 이용한 특징점 기반 정합 장치 및 방법 | |
CN211325679U (zh) | 一种基于增强现实的近红外荧光成像*** | |
KR101977650B1 (ko) | 증강 현실을 이용한 의료 영상 처리 장치 및 의료 영상 처리 방법 | |
KR102084251B1 (ko) | 수술용 네비게이터를 위한 의료 영상 처리 장치 및 의료 영상 처리 방법 | |
WO2021044590A1 (ja) | 内視鏡システム、処理システム、内視鏡システムの作動方法及び画像処理プログラム | |
EP4333763A1 (en) | Augmented reality headset and probe for medical imaging | |
Medievsky et al. | Intraoperative Visualization of Anatomical Structures in Massive Bleeding Using Infrared Images | |
WO2018055061A1 (en) | Hyperspectral tissue imaging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190214 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200107 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20191226 |
|
A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20200406 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20200430 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200907 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20201126 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20210426 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20210609 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20211004 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20211102 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6972049 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |