WO2012123852A1 - Modélisation d'un volume de corps - Google Patents

Modélisation d'un volume de corps Download PDF

Info

Publication number
WO2012123852A1
WO2012123852A1 PCT/IB2012/051024 IB2012051024W WO2012123852A1 WO 2012123852 A1 WO2012123852 A1 WO 2012123852A1 IB 2012051024 W IB2012051024 W IB 2012051024W WO 2012123852 A1 WO2012123852 A1 WO 2012123852A1
Authority
WO
WIPO (PCT)
Prior art keywords
model
body volume
projection
projections
data representing
Prior art date
Application number
PCT/IB2012/051024
Other languages
English (en)
Inventor
Dirk Schäfer
Michael Grass
Original Assignee
Koninklijke Philips Electronics N.V.
Philips Intellectual Property&Standards Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V., Philips Intellectual Property&Standards Gmbh filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2012123852A1 publication Critical patent/WO2012123852A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4429—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units
    • A61B6/4435—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure
    • A61B6/4441—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure the rigid structure being a C-arm or U-arm
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/149—Segmentation; Edge detection involving deformable models, e.g. active contour models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10116—X-ray image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30048—Heart; Cardiac
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Definitions

  • the invention relates to a system and method for modeling a body volume from projections. Especially, the invention relates to a system and method for semi-automatically modeling a 3D model on the basis of at least one 2D projection of the body volume.
  • a deformable model fitting process may be guided by minimization of the sum of the external energy, based on image feature information, which attracts a mesh to the boundaries of the structure of interest, and an internal energy, which preserves the consistent shape of the mesh.
  • reliable feature information for example, image gradients
  • the surface of the structure of interest is not "visible" to the segmentation process, due to, for example, an insufficient gradient of the image data to attract the mesh. This may appear for several reasons: a poor discrimination of soft tissue, for example, in CT, a low image resolution or artifacts due to metal implants.
  • US 2006/0159341 Al proposes a method of segmenting a three-dimensional structure of interest containing a body volume from a plurality of two-dimensional images, i.e. slices of a 3D data set.
  • images of the plurality of two-dimensional images with insufficient feature information for the structure of interest are identified.
  • attractors in the form of at least a partial contour of the structure of interest are manually drawn in the images of the plurality of two-dimensional images with insufficient feature information.
  • the structure of interest is segmented in the plurality of images by using a segmentation algorithm, with the manually drawn attractors replacing structure points in the areas of two- dimensional images where feature information is insufficient.
  • the body volume is segmented utilizing all two-dimensional images, i.e. slices.
  • Patient specific mesh segmentations representing the surface of for example heart chambers may be used as roadmap overlay e.g. in interventional EP procedures such as Afib ablation.
  • a model may be adapted to a 3D reconstructed volume from the patient to obtain a patient specific model.
  • the reconstructed volume may be either obtained by pre-operative CT/MR imaging or by intra- procedural 3D rotational X-ray (ATG).
  • the invention proposes a simplified semiautomatic method for heart chamber surface segmentation from few 2D projections.
  • the method according to the invention consists of the steps of selecting a mean model to be adapted to the patient specific anatomy;
  • the adaptation of the model to the 2D projections may include the following sub-steps: Mesh nodes with a normal vector of the mesh of +/- 10 degree relative to a direction perpendicular to the projection direction of a 2D projection, are forward projected in the respective projection direction.
  • the resulting deviation is iteratively optimized by firstly allowing only affine transformations and then using pre-defined or ad-hoc chosen deformation control points on the mesh surface. Deformations of other mesh points are interpolated by for example thin plate spline warping.
  • a method for modeling a body volume from at least one projection comprises the steps of receiving data representing at least one 2D projection of the body volume, receiving data representing a 3D model of the body volume, interactively defining edges of the body volume in the at least one 2D projection, and adapting the 3D model of a body volume on the basis of the at least one 2D projection of the body volume, wherein the model may be a mean model based on a plurality of 3D data sets from different bodies.
  • the step of adapting the 3D model may include generating a 2D projection of the 3D model by forward projecting of the 3D model in a direction of the at least one 2D projection of the body volume, and may further include deforming the shape of the 3D model in accordance with the deviation of the 2D projection of the 3D model from the corresponding 2D projection of the body volume.
  • aspects of the method which might be executed automatically may be implemented by a computer program.
  • a corresponding computer program is preferably loaded into a work memory of the processing unit.
  • the processing unit or data processor is thus equipped to carry out the method of the invention.
  • the invention may relate to a computer-readable medium such as a CD-ROM at which the computer program may be stored.
  • the computer program may also be presented over a network like the World Wide Web and can be downloaded into the working memory of the data processor from such a network.
  • a system for modeling a body volume from projections comprises a processing unit adapted to receive data representing a model of the body volume and data representing at least one 2D projection of the body volume, and an interactive interface including a display device and an input device.
  • edges of the body volume are manually definable in the 2D projection and the model is adapted to the manually defined edges by means of the processing unit.
  • the adapted model is displayable on the display device.
  • the utilized model is a mean model based on a plurality of 3D data sets from different bodies, i.e. from for example a plurality of different humans.
  • a mean model may represent for example a European male or female, or an African male or female, but not a specific human.
  • not only one but a plurality of 2D projections is generated from different projection angles relative to the body volume. It is noted that a few projections, i.e. three up to six projections spanning a total angle of 120 degrees is preferred. For example, four projections separated by approximately 40 degrees from each other are utilized.
  • the model includes a 3D surface of the body volume represented by a mesh with a plurality of mesh nodes.
  • the input device may be a pointer for virtually painting in the image shown on the display.
  • the edges of the body volume may be definable by contour points. It is noted that also a line (a plurality of subsequently arranged points) may define a contour of the body volume. Further, also only parts of the contour of a body volume may be defined by contour points or lines.
  • system according to the invention further comprises a data base for storing models of body volumes or mean models of the body volume.
  • system according to the invention may further comprise an imaging device for generating the data representing the at least one 2D projection of the body volume.
  • Fig. 1 shows a flow chart of steps perfomed in accordance with the invention.
  • Fig. 2 shows a schematical illustration of a system according to the invention.
  • Fig. 3 shows an exemplary adaptation of a 3D model of a body volume.
  • Fig. 4 shows a schematical illustration of figure 3.
  • Fig. 5 shows an exemplary adaptation of a 3D model of a body volume based on three projections with different projection directions.
  • step SI data are received which represent at least one 2D projection of a body volume of interest. This or these representations may be shown on a display device, either simultaneous or subsequently.
  • edges are manually defined in the at least one 2D projection image by an operator.
  • An operator may use an input device like a keyboard or a mouse of a computer, or may use a pointer for painting directly on the surface of a screen of the display device.
  • step S3 data are received which represent a model of the body volume of interest.
  • this model may be generated on the basis of a plurality of 3D data sets of different humans.
  • the model is a 3D model of the body volume.
  • step S4 the 3D model is forward projected in a direction corresponding to the projection direction of the at least one 2D projection of step SI .
  • the 3D model may be forward projected in each of the respective projection directions of the 2D projections.
  • step S5 a 2D projection is compared with a correspondingly generated projection of the 3D model. As a result, a deviation of the edges of the 2D projection from the projection of the 3D model may be measured.
  • step S6 based on the measured deviation, the projection of the 3D model is adapted to the 2D projection data, wherein the deformation criteria are stored.
  • step S 7 the 3D model is adapted based on the deformation criteria, wherein areas which are not subject of a projection, are interpolated.
  • step S8 the adapted 3D model is displayed, wherein this 3D model may be displayed in another viewing angle compared with the respective angles of the original 2D projections.
  • steps 5 and 6 may also be performed simultaneously.
  • Figure 2 shows an exemplary embodiment of a system according to the invention, wherein the above mentioned method may be performed on this system.
  • a processing unit 100 together with a display device 400 and an input device 300 is part of the system.
  • the exemplary imaging device 200 includes an X-ray source 240, and an X-ray detector 260, wherein these two devices are mounted on a C-arm 220. It will be understood that the system in accordance with the invention may also comprise a non-invasive imaging modality like a computer tomography device, a magnetic resonance device, or an ultrasound device as imaging device instead of or additional to the shown C-arm based X-ray device.
  • a non-invasive imaging modality like a computer tomography device, a magnetic resonance device, or an ultrasound device as imaging device instead of or additional to the shown C-arm based X-ray device.
  • edges of a body volume of interest may be manually introduced into a 2D projection image.
  • Figure 3 illustrates three projection images of a heart of a human, generated in one projection direction.
  • the three images are arranged in a column A.
  • the first image I shows a 2D projection with manually introduced edge lines 520 (corresponding to method step S2).
  • the second image II shows a 2D projection together with a 3D model 540 as loaded from a data base (corresponding to method step S3).
  • the third image III shows a projection together with an adapted 3D model 560 (corresponding to method step S7).
  • Figure 4 is a schematically illustration of the images of figure 3, from which the principle of the invention may be taken. For the sake of a better visibility, the radiation images as shown in figure 3, are omitted in figure 4.
  • edges 520 have been added, for example by an operator.
  • the second image II show the outlines of a 3D model 540 which is selected from available models and which may be loaded from a data storage device like a data base.
  • an adapted 3D model 560 is illustrated in the third image III.
  • an exemplary aspect of the 3D model 540 is shown in image II of figure 4.
  • the outer contour projects like a nose 542.
  • This nose is located in the upper portion of the right side of the 3D model, beneath the truncated vascular element which looks like a finger pointing to the upper right corner of the image.
  • the 3D model 540 is deformed in accordance with the invention.
  • the 3D model 540 is deformed so that the exemplary aspect is shifted downwards and is formed more like a knee 562.
  • a 3D model is generated which sufficiently fits to the actual heart of a patient.
  • FIG. 5 illustrates an example with three 2D projections in line I as a start.
  • the projection directions of the 2D projections are used for the generation of corresponding projections of the used 3D mean model, as shown in line II.
  • Each of the projections of the mean model is then adapted on the basis of the edges manually drawn in the images of line I.
  • the 3D model is adapted, so that this adapted 3D model may be visualized in any viewing direction.
  • a computer program for executing the automatically performed steps of the method may be stored/distributed on a suitable medium such as an optical storage medium or a solid-state medium supplied together with or as a part of another hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Computer Graphics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Computer Hardware Design (AREA)
  • Biophysics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Architecture (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention porte sur un système et un procédé de modélisation d'un volume de corps à partir d'au moins une projection, les étapes du procédé suivantes pouvant être réalisées sur le système : (1) la réception de données représentant au moins une projection bidimensionnelle (2D) du volume de corps, (2) la réception de données représentant un volume tridimensionnel (3D) du volume de corps, (3) la définition de manière interactive de bords du volume de corps dans la ou les projections 2D, et (4) l'adaptation du modèle 3D d'un volume de corps sur la base de la ou des projections 2D du volume de corps, le modèle pouvant être un modèle moyen basé sur une pluralité d'ensembles de données 3D provenant de différents corps.
PCT/IB2012/051024 2011-03-17 2012-03-05 Modélisation d'un volume de corps WO2012123852A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP11158697.0 2011-03-17
EP11158697 2011-03-17

Publications (1)

Publication Number Publication Date
WO2012123852A1 true WO2012123852A1 (fr) 2012-09-20

Family

ID=45876825

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/051024 WO2012123852A1 (fr) 2011-03-17 2012-03-05 Modélisation d'un volume de corps

Country Status (1)

Country Link
WO (1) WO2012123852A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10402970B2 (en) 2014-11-28 2019-09-03 Koninklijke Philips N.V. Model-based segmentation of an anatomical structure

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001078015A2 (fr) * 2000-04-07 2001-10-18 Carnegie Mellon University Distraction osseuse assistee par ordinateur
US20060159341A1 (en) 2003-06-13 2006-07-20 Vladimir Pekar 3D image segmentation
US20060262112A1 (en) * 2005-05-23 2006-11-23 Carnegie Mellon University System and method for three-dimensional shape generation from partial and incomplete views, and interactive design system using same
WO2010113052A1 (fr) * 2009-04-03 2010-10-07 Koninklijke Philips Electronics N.V. Algorithme de point le plus proche itératif interactif pour segmentation d'organe

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001078015A2 (fr) * 2000-04-07 2001-10-18 Carnegie Mellon University Distraction osseuse assistee par ordinateur
US20060159341A1 (en) 2003-06-13 2006-07-20 Vladimir Pekar 3D image segmentation
US20060262112A1 (en) * 2005-05-23 2006-11-23 Carnegie Mellon University System and method for three-dimensional shape generation from partial and incomplete views, and interactive design system using same
WO2010113052A1 (fr) * 2009-04-03 2010-10-07 Koninklijke Philips Electronics N.V. Algorithme de point le plus proche itératif interactif pour segmentation d'organe

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CAROLINE PETITJEAN ET AL: "A review of segmentation methods in short axis cardiac MR images", MEDICAL IMAGE ANALYSIS, OXFORD UNIVERSITY PRESS, OXOFRD, GB, vol. 15, no. 2, 15 December 2010 (2010-12-15), pages 169 - 184, XP028364933, ISSN: 1361-8415, [retrieved on 20101224], DOI: 10.1016/J.MEDIA.2010.12.004 *
LÖTJÖNEN J ET AL: "Automatic Reconstruction of 3D Geometry Using Projections and a Geometric Prior Model", 1 January 2006, MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI '99 : SECOND INTERNATIONAL CONFERENCE, CAMBRIDGE, UK, SEPTEMBER 19 - 22, 1999; [LECTURE NOTES IN COMPUTER SCIENCE ; 1679], SPRINGER, BERLIN [U.A.], PAGE(S) 192 - 201, ISBN: 978-3-540-66503-8, XP019036163 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10402970B2 (en) 2014-11-28 2019-09-03 Koninklijke Philips N.V. Model-based segmentation of an anatomical structure

Similar Documents

Publication Publication Date Title
US11538574B2 (en) Registration of spatial tracking system with augmented reality display
JP7440534B2 (ja) ２次元画像投影を用いた、トラッキングシステムと画像との空間レジストレーション
AU2021202558B2 (en) Imaging system and method for use in surgical and interventional medical procedures
US10650513B2 (en) Method and system for tomosynthesis imaging
Weese et al. Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery
US8942455B2 (en) 2D/3D image registration method
US20080147086A1 (en) Integrating 3D images into interventional procedures
US20100061611A1 (en) Co-registration of coronary artery computed tomography and fluoroscopic sequence
CN109152566B (zh) 校正超声融合成像***中的探头引起的变形
US20180333112A1 (en) System for tracking an ultrasonic probe in a body part
US7620229B2 (en) Method and apparatus for aiding image interpretation and computer-readable recording medium storing program therefor
JP2011125568A (ja) 画像処理装置、画像処理方法、プログラム及び画像処理システム
CN111657978A (zh) 解剖体表示与实况图像的配对
KR20130018168A (ko) 의료 이미지 데이터 세트의 정합 품질의 시각화 방법 및 장치
JP5194138B2 (ja) 画像診断支援装置およびその動作方法、並びに画像診断支援プログラム
US20150015582A1 (en) Method and system for 2d-3d image registration
CN108430376B (zh) 提供投影数据集
EP4287120A1 (fr) Guidage pendant des procédures médicales
WO2023232492A1 (fr) Guidage pendant des procédures médicales
Higuera et al. Automatic adjustment of bidimensional transfer functions for direct volume visualization of intracranial aneurysms
EP3659514A1 (fr) Identification et localisation de dispositif à base d'image
WO2012123852A1 (fr) Modélisation d'un volume de corps
Hawkes et al. Three-dimensional multimodal imaging in image-guided interventions
WO2023018871A1 (fr) Système de réalité augmentée et procédés de projection stéréoscopique et de référencement croisé d'imagerie fluoroscopique assistée par rayons x en direct et d'imagerie tomographique par arceau pendant une intervention chirurgicale

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12710350

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12710350

Country of ref document: EP

Kind code of ref document: A1