WO2004047030A2 - Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object - Google Patents
Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object Download PDFInfo
- Publication number
- WO2004047030A2 WO2004047030A2 PCT/IB2003/005168 IB0305168W WO2004047030A2 WO 2004047030 A2 WO2004047030 A2 WO 2004047030A2 IB 0305168 W IB0305168 W IB 0305168W WO 2004047030 A2 WO2004047030 A2 WO 2004047030A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- model
- image
- resolution
- confidence
- feature
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/149—Segmentation; Edge detection involving deformable models, e.g. active contour models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Definitions
- an object of the invention proposes an image processing system having image data processing means for automatic adaptation of the mapping of a 3-D Mesh Model onto a three dimensional surface of an object represented in a gray level image; and having viewing means for displaying quantified and visual indications of the confidence of such a Mesh Model adaptation onto said object surface, in a coded manner, preferably in a color coded manner.
- the system processing means uses the system processing means, the three-dimensional surface of the three dimensional object of interest is registered in a three dimensional gray level image.
- the three dimensional Simplex Mesh Model is fitted onto the three dimensional surface according to a mesh model technique for fitting at best said surface.
- FIG. IB represents an object of interest (an organ) with a Mesh Model (a sphere) for segmenting this object using a Mesh Model deformation technique and the adaptation technique of the invention
- the complex surface OBJ poses a problem when the segmentation method described above is applied.
- the present invention is able to solve this problem.
- the surface denoted by OBJ, represented in FIG.IA and IB, has been chosen in order to demonstrate that the method of the invention may be applied to a great number of different and complex surfaces.
- the image segmentation method is based on utilization of discrete deformable models, like 2-Simplex Meshes Model described as prior art [Delingette].
- a three dimensional digital Simplex Mesh Model is generated as illustrated by FIG.1 A or FIG. IB.
- This refinement consists in introducing an algorithm for automatically increasing the Mesh resolution at parts of high curvature and at parts whose distance to the image data is higher than a threshold. Hence, at each iteration, the area of the spherical cells decreases. So, according to the known technique, since when the distance to the image data is large, as shown in FIG.IA, the surface of the cells decreases and the number of cells increases, the refinement algorithm would be unable to improve the result in said parts P'l, P'2.
- the automated technique of estimation of the adaptation comprises sub-steps of: 4.1) Constructing a Color Coding Table wherein predetermined colors are associated with given feature confidence for model adaptation represented by the confidence parameter.
- the present invention provides a visualization of the cells that are color coded in function of the confidence parameter. This visualization with different colors allows to supervise the deformation process and to locally assess its final quality.
- a predetermined color may be associated to one confidence parameter value; colors maybe classified in classes of colors, each class of colors corresponding to a range of confidence parameter values; each class of color may further be sub-divided according to a scale of hues for sub-dividing the range of confidence parameter values;
- FIG.3 shows a diagram of an image processing system 150 according to the invention for carrying out all the steps of the above-described method.
- the system has means 151 for acquiring digital image data of a sequence of images, and is coupled to computer means 153 for processing these data according to the processing steps of the method cited above.
- the medical viewing system can be used in the intervention room or near the intervention room for processing real time images. Steps of the present method can be applied on stored medical images, for example for estimating medical parameters.
- the medical viewing system provides the image data by connection 157 to the system 153.
- the system provides processed image data to display means and/or storage means.
- the display means 154 may be a screen.
- the storage means may be a memory of the system 153. Said storage means may be alternately external storage means.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Software Systems (AREA)
- Geometry (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Medical Informatics (AREA)
- Computer Graphics (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Image Processing (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Image Analysis (AREA)
- Coating With Molten Metal (AREA)
- Processing Or Creating Images (AREA)
- Heating, Cooling, Or Curing Plastics Or The Like In General (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Image Generation (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2003278538A AU2003278538A1 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object |
EP03769837A EP1565880B1 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object |
US10/535,466 US8437579B2 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-D mesh model onto a 3-D surface of an object |
DE60311865T DE60311865T2 (en) | 2002-11-20 | 2003-11-14 | IMAGE PROCESSING SYSTEM FOR AUTOMATICALLY ADAPTING A 3D MESH MODEL TO A 3D OBJECT AREA |
JP2004553008A JP2006506164A (en) | 2002-11-20 | 2003-11-14 | An image processing system that automatically adapts a 3D mesh model to the 3D surface of an object |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP02292884 | 2002-11-20 | ||
EP02292884.0 | 2002-11-20 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2004047030A2 true WO2004047030A2 (en) | 2004-06-03 |
WO2004047030A3 WO2004047030A3 (en) | 2004-10-07 |
Family
ID=32319683
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2003/005168 WO2004047030A2 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object |
Country Status (7)
Country | Link |
---|---|
US (1) | US8437579B2 (en) |
EP (1) | EP1565880B1 (en) |
JP (1) | JP2006506164A (en) |
AT (1) | ATE354140T1 (en) |
AU (1) | AU2003278538A1 (en) |
DE (1) | DE60311865T2 (en) |
WO (1) | WO2004047030A2 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2460411A (en) * | 2008-05-27 | 2009-12-02 | Simpleware Ltd | Variable mesh resolution in medical image generation |
WO2010046819A1 (en) * | 2008-10-22 | 2010-04-29 | Koninklijke Philips Electronics N.V. | 3-d ultrasound imaging |
US8526697B2 (en) | 2008-02-15 | 2013-09-03 | Koninklijke Philips N.V. | Apparatus for segmenting an object comprising sub-objects |
GB2539963A (en) * | 2015-07-03 | 2017-01-04 | Williams Justin | Thermographic imaging system |
WO2017001476A1 (en) | 2015-06-29 | 2017-01-05 | Koninklijke Philips N.V. | Interactive mesh editing |
US10346708B2 (en) | 2013-06-25 | 2019-07-09 | Synopsys, Inc. | Image processing method |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009016559A1 (en) * | 2007-08-01 | 2009-02-05 | Koninklijke Philips Electronics N.V. | Accessing medical image detabases using medically relevant terms |
WO2009122338A1 (en) * | 2008-04-04 | 2009-10-08 | Koninklijke Philips Electronics N.V. | Simultaneous model-based segmentation of objects satisfying pre-defined spatial relationships |
CN102099833B (en) * | 2008-04-07 | 2016-08-10 | 皇家飞利浦电子股份有限公司 | Mesh collision is avoided |
US8265363B2 (en) * | 2009-02-04 | 2012-09-11 | General Electric Company | Method and apparatus for automatically identifying image views in a 3D dataset |
WO2012035488A1 (en) * | 2010-09-17 | 2012-03-22 | Koninklijke Philips Electronics N.V. | Choosing anatomical variant model for image segmentation |
US8903088B2 (en) | 2011-12-02 | 2014-12-02 | Adobe Systems Incorporated | Binding of protected video content to video player with encryption key |
US8879731B2 (en) | 2011-12-02 | 2014-11-04 | Adobe Systems Incorporated | Binding of protected video content to video player with block cipher hash |
US9064318B2 (en) | 2012-10-25 | 2015-06-23 | Adobe Systems Incorporated | Image matting and alpha value techniques |
US10638221B2 (en) | 2012-11-13 | 2020-04-28 | Adobe Inc. | Time interval sound alignment |
US9201580B2 (en) | 2012-11-13 | 2015-12-01 | Adobe Systems Incorporated | Sound alignment user interface |
US9355649B2 (en) | 2012-11-13 | 2016-05-31 | Adobe Systems Incorporated | Sound alignment using timing information |
KR101339552B1 (en) * | 2012-11-15 | 2013-12-10 | 이화여자대학교 산학협력단 | Method of approximating object user-based and object approximation system |
US9076205B2 (en) | 2012-11-19 | 2015-07-07 | Adobe Systems Incorporated | Edge direction and curve based image de-blurring |
US10249321B2 (en) | 2012-11-20 | 2019-04-02 | Adobe Inc. | Sound rate modification |
US9451304B2 (en) | 2012-11-29 | 2016-09-20 | Adobe Systems Incorporated | Sound feature priority alignment |
US9135710B2 (en) * | 2012-11-30 | 2015-09-15 | Adobe Systems Incorporated | Depth map stereo correspondence techniques |
US10455219B2 (en) | 2012-11-30 | 2019-10-22 | Adobe Inc. | Stereo correspondence and depth sensors |
US9208547B2 (en) | 2012-12-19 | 2015-12-08 | Adobe Systems Incorporated | Stereo correspondence smoothness tool |
US10249052B2 (en) | 2012-12-19 | 2019-04-02 | Adobe Systems Incorporated | Stereo correspondence model fitting |
US9214026B2 (en) | 2012-12-20 | 2015-12-15 | Adobe Systems Incorporated | Belief propagation and affinity measures |
JP6762305B2 (en) | 2015-01-28 | 2020-09-30 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Finite element modeling of anatomical structures |
US10915680B2 (en) * | 2018-12-21 | 2021-02-09 | Dassault Systemes Simulia Corp. | Local control of design patterns on surfaces for enhanced physical properties |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002073536A2 (en) * | 2001-03-09 | 2002-09-19 | Koninklijke Philips Electronics N.V. | Image segmentation |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE69331719T2 (en) * | 1992-06-19 | 2002-10-24 | Agfa-Gevaert, Mortsel | Method and device for noise suppression |
WO1996041469A1 (en) | 1995-06-07 | 1996-12-19 | Geshwind David M | Systems using motion detection, interpolation, and cross-dissolving for improving picture quality |
CA2253719A1 (en) * | 1996-04-24 | 1997-10-30 | Shriners Hospitals For Children | Method and apparatus for recording three-dimensional topographies |
US6404920B1 (en) | 1996-09-09 | 2002-06-11 | Hsu Shin-Yi | System for generalizing objects and features in an image |
US5886702A (en) * | 1996-10-16 | 1999-03-23 | Real-Time Geometry Corporation | System and method for computer modeling of 3D objects or surfaces by mesh constructions having optimal quality characteristics and dynamic resolution capabilities |
GB9626676D0 (en) | 1996-12-23 | 1997-02-12 | Smith & Nephew Res | Imaging method |
US6351262B1 (en) | 1998-06-30 | 2002-02-26 | Lucent Technologies, Inc. | Display techniques for three-dimensional virtual reality |
JP2000175052A (en) | 1998-12-07 | 2000-06-23 | Xerox Corp | Processing method and system for pixel map expression |
US6968299B1 (en) * | 2000-04-14 | 2005-11-22 | International Business Machines Corporation | Method and apparatus for reconstructing a surface using a ball-pivoting algorithm |
-
2003
- 2003-11-14 US US10/535,466 patent/US8437579B2/en active Active
- 2003-11-14 EP EP03769837A patent/EP1565880B1/en not_active Expired - Lifetime
- 2003-11-14 AU AU2003278538A patent/AU2003278538A1/en not_active Abandoned
- 2003-11-14 DE DE60311865T patent/DE60311865T2/en not_active Expired - Lifetime
- 2003-11-14 WO PCT/IB2003/005168 patent/WO2004047030A2/en active IP Right Grant
- 2003-11-14 JP JP2004553008A patent/JP2006506164A/en not_active Withdrawn
- 2003-11-14 AT AT03769837T patent/ATE354140T1/en not_active IP Right Cessation
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002073536A2 (en) * | 2001-03-09 | 2002-09-19 | Koninklijke Philips Electronics N.V. | Image segmentation |
Non-Patent Citations (3)
Title |
---|
DELINGETTE H ED - INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS: "SIMPLEX MESHES: A GENERAL REPRESENTATION FOR 3D SHAPE RECONSTRUCTION" PROCEEDINGS OF THE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION. SEATTLE, JUNE 21 - 23, 1994, LOS ALAMITOS, IEEE COMP. SOC. PRESS, US, 21 June 1994 (1994-06-21), pages 856-859, XP000515947 ISBN: 0-8186-5827-4 cited in the application * |
DELINGETTE H: "General object reconstruction based on simplex meshes" INT. J. COMPUT. VIS. (NETHERLANDS), INTERNATIONAL JOURNAL OF COMPUTER VISION, 1999, KLUWER ACADEMIC PUBLISHERS, NETHERLANDS, vol. 32, no. 2, August 1999 (1999-08), pages 111-142, XP002289618 ISSN: 0920-5691 * |
PEKAR V ET AL: "SHAPE MODEL BASED ADAPTATION OF 3-D DEFORMABLE MESHES FOR SEGMENTATION OF MEDICAL IMAGES" PROCEEDINGS OF THE SPIE, SPIE, BELLINGHAM, VA, US, vol. 4322, 19 February 2001 (2001-02-19), pages 281-289, XP008020236 ISSN: 0277-786X * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8526697B2 (en) | 2008-02-15 | 2013-09-03 | Koninklijke Philips N.V. | Apparatus for segmenting an object comprising sub-objects |
GB2460411A (en) * | 2008-05-27 | 2009-12-02 | Simpleware Ltd | Variable mesh resolution in medical image generation |
GB2460411B (en) * | 2008-05-27 | 2012-08-08 | Simpleware Ltd | Image processing method |
US8384716B2 (en) | 2008-05-27 | 2013-02-26 | Simpleware Limited | Image processing method |
WO2010046819A1 (en) * | 2008-10-22 | 2010-04-29 | Koninklijke Philips Electronics N.V. | 3-d ultrasound imaging |
US10346708B2 (en) | 2013-06-25 | 2019-07-09 | Synopsys, Inc. | Image processing method |
WO2017001476A1 (en) | 2015-06-29 | 2017-01-05 | Koninklijke Philips N.V. | Interactive mesh editing |
GB2539963A (en) * | 2015-07-03 | 2017-01-04 | Williams Justin | Thermographic imaging system |
Also Published As
Publication number | Publication date |
---|---|
AU2003278538A1 (en) | 2004-06-15 |
WO2004047030A3 (en) | 2004-10-07 |
DE60311865T2 (en) | 2007-10-31 |
US8437579B2 (en) | 2013-05-07 |
EP1565880A2 (en) | 2005-08-24 |
AU2003278538A8 (en) | 2004-06-15 |
JP2006506164A (en) | 2006-02-23 |
ATE354140T1 (en) | 2007-03-15 |
DE60311865D1 (en) | 2007-03-29 |
US20060078194A1 (en) | 2006-04-13 |
EP1565880B1 (en) | 2007-02-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8437579B2 (en) | Image processing system for automatic adaptation of a 3-D mesh model onto a 3-D surface of an object | |
US7043062B2 (en) | Image processing method for displaying an image sequence of a deformable 3-D object with indications of the object wall motion | |
Park et al. | A non-self-intersecting adaptive deformable surface for complex boundary extraction from volumetric images | |
EP1685534B1 (en) | Three-dimensional segmentation using deformable surfaces | |
EP1451671A2 (en) | Image processing method for interacting with a 3-d surface represented in a 3-d image | |
JP3712234B2 (en) | Region of interest extraction method and image processing server | |
EP1709591A1 (en) | Real time user interaction with deformable surfaces of segmentation | |
CA2617227C (en) | Deformable model for segmenting patient contours versus support structures in medical images | |
JP4170096B2 (en) | Image processing apparatus for evaluating the suitability of a 3D mesh model mapped on a 3D surface of an object | |
Bro-Nielsen | Active nets and cubes | |
JP7456928B2 (en) | Abnormal display control method of chest X-ray image, abnormal display control program, abnormal display control device, and server device | |
US6434260B1 (en) | Facial imaging in utero | |
Nanayakkara et al. | Prostate segmentation by feature enhancement using domain knowledge and adaptive region based operations | |
EP2074591B1 (en) | Methods, system and computer program product for detecting a protrusion | |
WO2011127940A1 (en) | Method for segmentation of objects from a three dimensional image data set with a deformable model | |
EP1141894B1 (en) | Method and apparatus for processing images with regions representing target objects | |
WO2007096453A1 (en) | Method and system for reconstructing a model of an object | |
Jackowski et al. | A computer-aided design system for segmentation of volumetric images | |
Bankhele et al. | Detection of Protrusion on Curved Folded Surface In Colon Capsule Endoscopy |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2003769837 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2006078194 Country of ref document: US Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10535466 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2004553008 Country of ref document: JP |
|
WWP | Wipo information: published in national office |
Ref document number: 2003769837 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 10535466 Country of ref document: US |
|
WWG | Wipo information: grant in national office |
Ref document number: 2003769837 Country of ref document: EP |