WO2021181238A1 - A method for the segmentation of a discrete 3d grid - Google Patents
A method for the segmentation of a discrete 3d grid Download PDFInfo
- Publication number
- WO2021181238A1 WO2021181238A1 PCT/IB2021/051897 IB2021051897W WO2021181238A1 WO 2021181238 A1 WO2021181238 A1 WO 2021181238A1 IB 2021051897 W IB2021051897 W IB 2021051897W WO 2021181238 A1 WO2021181238 A1 WO 2021181238A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- point
- grid
- normal vector
- discrete
- points
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000011218 segmentation Effects 0.000 title claims description 13
- 239000013598 vector Substances 0.000 claims abstract description 64
- 238000004364 calculation method Methods 0.000 claims description 3
- 210000001519 tissue Anatomy 0.000 description 14
- 210000000988 bone and bone Anatomy 0.000 description 6
- 238000002595 magnetic resonance imaging Methods 0.000 description 4
- 210000000056 organ Anatomy 0.000 description 4
- 210000003491 skin Anatomy 0.000 description 4
- 210000001981 hip bone Anatomy 0.000 description 3
- 238000003709 image segmentation Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 210000003205 muscle Anatomy 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 3
- 208000010392 Bone Fractures Diseases 0.000 description 2
- 206010017076 Fracture Diseases 0.000 description 2
- 210000001217 buttock Anatomy 0.000 description 2
- 229940079593 drug Drugs 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 239000010410 layer Substances 0.000 description 2
- 238000003325 tomography Methods 0.000 description 2
- 208000006670 Multiple fractures Diseases 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 210000001087 myotubule Anatomy 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000001356 surgical procedure Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V10/267—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/174—Segmentation; Edge detection involving the use of two or more images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10088—Magnetic resonance imaging [MRI]
Definitions
- the present invention concerns a method for the segmentation of a discrete 3D grid.
- discrete 3D grid an ordered stack of images is intended, where all images have the same resolution and have been captured along the axis perpendicular to the image plane.
- the discrete 3D grid can be obtained, for example, by a scanner device such as, but not limited to, Magnetic Resonance Imaging (MRI) or Computerized Tomography (CT) or other known scanner.
- MRI Magnetic Resonance Imaging
- CT Computerized Tomography
- the discrete 3D grid is stored in a computer memory and the method described herein operates on such 3D grid.
- the method described in this document is not restricted to medical images, but can be used on all data given in a discrete 3D grid format, e.g. 3D-microscopie, geological scans, and other technical fields.
- MRI Magnetic Resonance Imaging
- CT Computerized Tomography
- the scanning devices use different means of scanning a human body and return a stack of 2D-grayscale-images. This stack allows medical professionals to non-invasively observe the scanned patient to identify problems and plan surgeries.
- a DICOM dataset is made up of 2D images, that provide a grayscale image through the scanner plane, with each image being captured at a certain distance along the axis perpendicular to that plane.
- the gray (or Hounsfield) value of an image point is determined by the interaction of the patient's body tissue at the position related to that image point. Since different material densities or consistencies lead to different interactions, the image shows different tissues in different gray values, allowing a medical professional to "see" the inside of the scanned patient.
- Medical image segmentation is used to classify the contents of the image. The goal is, to identify different tissue types and organs. The segmentation can then be used for different purposes, like creating a 3D-model for the scanned region.
- a significant problem in automatic medical image segmentation is, that the Hounsfield values are not identical within the same organ or tissue. This is due to noise created by the scanning device and differences in the tissue itself, which is not homogeneous within organs.
- Another reason for inhomogeneous Hounsfield values that can especially be observed in the bones is, that the bones do not have equal density among their surface. This is especially the case where bones are worn thin (for example at joints) or in patients with a fracture. Especially in the case of fractures, the patient is putting as little stress as possible on the injured bone, which in turn loses density.
- the Hounsfield value alone cannot be used to extract a reliable 3D-model, although it is used in practice to get at least a crude segmentation through thresholding.
- An object of the present invention is to create a method that is able to identify border regions between different tissue types and automatically generate the outlines of surfaces within the scanned data.
- a further aim of this invention is to solve the above mentioned problems in a rational and economical way.
- the above aims are obtained by a method for the segmentation of a discrete 3D grid, the discrete 3D grid being created from an ordered stack of images acquired by a scanning device in a single series, the method comprising at least the following steps:
- N c ⁇ N j ⁇ T 2 is verified, wherein N c is the normal vector of point V c , N j is the normal vector of point V j and T 2 is a predefined threshold until all the neighbor points V j of the current point V c have been considered and then erase the current point V c from the queue Q;
- the algorithm described in the present patent application is able to identify border regions between different tissue types and to automatically generate the outlines of surfaces within the scanned data.
- the present invention does not require any pre-processing of the data, nor does it require manual user interaction. Since the algorithm works directly on the gradients of the measured Hounsfield values, it works simultaneously with both MRI and CT data.
- the result of running the algorithm on data acquired by a medical scanning device is a set of separate 3D objects, each representing an object within the scanned region, e.g. one object for each disjoint bone or even bone fragment in case of broken bones present in the data, organs, muscles and skin.
- a further step of pre- selecting points lying near surfaces of the computer generated image and discarding points belonging to the same tissue can be performed, the preselecting step comprising the calculation of a number G i for each point V i , said number G i being representative of the number of point neighbors V j of the point V i having similar surface normal to the point V i .
- FIG. 1 illustrates a first step of a normal computation in 2D and a neighborhood of 1;
- Figure 2 illustrates the vectors from Figure 1 multiplied by the difference in the Hounsfield value of the point corresponding to the respective vector
- Figure 6a shows a single layer of a Digital Imaging and Communications in Medicine (DICOM).
- Figures 6b-6c show the different values computed for this slice and Figure 6d shows the resulting final segmentation;
- Figure 7a shows an image of the 3D-model generated by the segmentation of two feet of a patient ' s DICOM file
- Figures 7b-7d a 3D-model of the hip bone segmented from another DICOM file
- FIG. 8 shows the gluteal muscles in red on top and the skin of the buttocks of a patient in the lower part of the image.
- the algorithm proposed in the present patent application comprise a series of consecutive steps, depending on the data quality: 1. Compute normal vector in each data point
- DICOM-files are the de facto standard in storing medical image data, acquired by scanners like MRI, CT and similar scanning devices.
- point describes a single pixel element of a single DICOM image.
- grid will be used to describe the 3D-data structure that is created by all the points in a single series within a DICOM-file.
- the grid of a DICOM-file will therefore have the dimensions:
- Depth d number of images in the DICOM (considering a single series only)
- the notation V i is used to refer to an arbitrary point within the grid. Each point V i will initially have a Hounsfield-value of determined by the scanner output. This is the input that the algorithm of the present invention is operating on.
- V [xyz] is used to refer to the point with coordinates x ⁇ [0,w — 1],y ⁇ [0,h- 1],z ⁇ [0,d— 1] inside of the grid.
- the vector is the normalized vector from the center of to the center of V j and is computed using the grid coordinates of V i and
- n neighborhood of V i is then defined as the set of all points with a distance to smaller or equal to n:
- an error value E i and a normal vector can be computed for each grid point V i as follows:
- the following step of pre-selecting points near surfaces can be used.
- points that are not in close proximity to any surfaces can be excluded.
- Step 3 the step of pre-selecting points near surfaces should only be used when the data is very noisy. This step does not have positive effects in smooth data, since for this kind of data Step 3 is enough. Now we will create the surfaces contained within the Grid. To do that, we loop over all V i in the grid that were not discarded in step 2 (in case of noisy data).
- a final step of the method provides for restricting the surfaces identified to lie at the point of strongest contrast.
- the points in a single surface S i are points that share an angle smaller than T 2 with their direct neighbors. But due to the fact that the normal computation in the first step of the present method was carried out over a larger area, the surface is blurred out (see Figure 5 and Figure 6b). Instead of just containing the points where the gradient between different tissue types is strongest, it also contains the points that are close enough to this region.
- the result is an image stack with highly accurate segmentation of all the objects in this stack.
- a 3D-model of the scanned area is required, it is now trivial to construct it by different means.
- the one we used is to simply run a marching cubes algorithm over the whole grid, one surface at a time.For the algorithm to produce a good 3D model, the grid points are set to zero while only marking the points contained in the current surface to be above the threshold set for the marching cubes algorithm. This way, a precise 3D model is created for each surface within the scanned area.
- figure 1 illustrates a first step of a normal computation in 2D and a neighborhood n of 1, figure 1 and the following figures being merely an exemplification of the various possibilities of the method.
- the normal computation in 2D and a neighborhood n of starts with a normalized vector from the current point in the center, to the center of each of its 8 neighbors.
- Figure 2 illustrates the vectors from Figure 1 multiplied by the difference in the Hounsfield value of the point corresponding to the respective vector. Both vectors along the diagonal from top-left to bottom-right vanish, since the Hounsfield-values are equal along that diagonal in this example. Furthermore, three vectors have changed direction, due to the negative sign in the Hounsfield difference.
- Figure 3 shows the result of summing up the vectors from Figure 2.
- Figure 4 shows the resulting normal vector for the center pixel.
- Figure 5 shows the resulting vectors when applying the above described computation to every point in the given grid.
- Figures 6a-6d shows various images related to a slice of Digital Imaging and Communications in Medicine (DICOM).
- DICOM Digital Imaging and Communications in Medicine
- the image of Figure 6a shows the Hounsfield values in a slice of a DICOM.
- the image of Figure 6b shows the normal vectors computed from that data set.
- the 3D-vector is encoded in the RGB-space of the color-image.Thiswas done by taking each component of the vector, adding 1. 0 and multiplying it by 127. Since each component of the normalized vector is in the range [-1.0, 1.0], each color component of the resulting image will therefore be in the range [0, 254].
- the image visualizes the regularity of the vectors along borders used in the growing of the surfaces.
- the image of Figure 6c shows the error-value. Red pixels have an error value between -1.0 and -0.5 while blue pixels have an error value between 0.5 and 1.0. Green pixels show error values between -0.5 and 0.5.
- the image of Figure 6d shows the resulting segmentation using both the normal vectors for surface growth as well as the error values for border identification.
- Figure 7a shows on the left side of the image the segmentation of two feet of a patient segmented from one DICOM image
- Figures 7b- 7c show the hip bone segmented from another DICOM image.
- Figure 8 This image of Figure 8 was extracted from the same DICOM that produced the hip bone in Figures 7a-c.
- the algorithm described herein is capable of automatically segmenting all parts at once, while separating the different surfaces into different 3D-models.
- Figure 8 also demonstrates the extreme precision of the algorithm, showing every dent in the skin of the patient (lower part) and the clearly distinct muscle fibers.
- a preferred way to perform the computation of the described method is to compute the normal vectors in the 3D grid, which gives better results than performing this computation in each of the 2D images of the stack separately.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CH00269/20 | 2020-03-09 | ||
CH000269/2020A CH717198B1 (it) | 2020-03-09 | 2020-03-09 | Metodo per la segmentazione di una griglia 3D discreta. |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021181238A1 true WO2021181238A1 (en) | 2021-09-16 |
Family
ID=75143680
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2021/051897 WO2021181238A1 (en) | 2020-03-09 | 2021-03-08 | A method for the segmentation of a discrete 3d grid |
Country Status (2)
Country | Link |
---|---|
CH (1) | CH717198B1 (it) |
WO (1) | WO2021181238A1 (it) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116402988A (zh) * | 2023-05-11 | 2023-07-07 | 北京冰河起源科技有限公司 | 三维模型处理方法、装置及存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6366800B1 (en) * | 1994-10-27 | 2002-04-02 | Wake Forest University | Automatic analysis in virtual endoscopy |
WO2003070102A2 (en) * | 2002-02-15 | 2003-08-28 | The Regents Of The University Of Michigan | Lung nodule detection and classification |
US20070188490A1 (en) * | 2006-02-13 | 2007-08-16 | National University Corporation Hokkaido University | Apparatus, method and program for segmentation of mesh model data into analytic surfaces based on robust curvature estimation and region growing |
CN109325998A (zh) * | 2018-10-08 | 2019-02-12 | 香港理工大学 | 一种基于点云数据的室内3d建模方法、***及相关装置 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1975877B1 (en) * | 2005-11-23 | 2018-09-19 | Agfa HealthCare N.V. | Method for point-of-interest attraction in digital images |
CN104809730B (zh) * | 2015-05-05 | 2017-10-03 | 上海联影医疗科技有限公司 | 从胸部ct图像提取气管的方法和装置 |
-
2020
- 2020-03-09 CH CH000269/2020A patent/CH717198B1/it unknown
-
2021
- 2021-03-08 WO PCT/IB2021/051897 patent/WO2021181238A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6366800B1 (en) * | 1994-10-27 | 2002-04-02 | Wake Forest University | Automatic analysis in virtual endoscopy |
WO2003070102A2 (en) * | 2002-02-15 | 2003-08-28 | The Regents Of The University Of Michigan | Lung nodule detection and classification |
US20070188490A1 (en) * | 2006-02-13 | 2007-08-16 | National University Corporation Hokkaido University | Apparatus, method and program for segmentation of mesh model data into analytic surfaces based on robust curvature estimation and region growing |
CN109325998A (zh) * | 2018-10-08 | 2019-02-12 | 香港理工大学 | 一种基于点云数据的室内3d建模方法、***及相关装置 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116402988A (zh) * | 2023-05-11 | 2023-07-07 | 北京冰河起源科技有限公司 | 三维模型处理方法、装置及存储介质 |
CN116402988B (zh) * | 2023-05-11 | 2023-12-19 | 北京冰河起源科技有限公司 | 三维模型处理方法、装置及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CH717198B1 (it) | 2024-03-28 |
CH717198A1 (it) | 2021-09-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Lin et al. | Computer-aided kidney segmentation on abdominal CT images | |
CA2468456A1 (en) | Image segmentation | |
EP1791087B1 (en) | Method for point-of-interest attraction in digital images | |
Mahmood et al. | Image segmentation methods and edge detection: An application to knee joint articular cartilage edge detection | |
Liu et al. | Interactive separation of segmented bones in CT volumes using graph cut | |
WO2021181238A1 (en) | A method for the segmentation of a discrete 3d grid | |
Capek et al. | Robust and fast medical registration of 3D-multi-modality data sets | |
Kaushik et al. | Medical image segmentation using genetic algorithm | |
KR20070083467A (ko) | 병터 검출 방법 | |
Rulaningtyas et al. | CT scan image segmentation based on hounsfield unit values using Otsu thresholding method | |
Nishiyama et al. | Deep generative models for automated muscle segmentation in computed tomography scanning | |
JP2021511575A (ja) | 3d医用画像の解剖学的ジオメトリに従った、構造化された畳み込みを通した1つまたはいくつかのニューラルネットワークによる3d医用画像の自動セグメンテーションプロセス | |
Sengupta et al. | Colour space-based thresholding for segmentation of skin lesion images | |
Udupa et al. | Fuzzy connected object definition in images with respect to co-objects | |
Arica et al. | A plain segmentation algorithm utilizing region growing technique for automatic partitioning of computed tomography liver images | |
Afifi et al. | New region growing based on thresholding technique applied to MRI data | |
TSAI | Automatic segmentation of liver structure in CT images using a neural network | |
CN106023144A (zh) | 在断层影像中分割股骨的方法 | |
Imielinska et al. | Hybrid segmentation of the visible human data | |
Pandey et al. | Enhancement of medical images using Kalman filter | |
Ampilova et al. | Application of fractal and multifractal analysis algorithms to image segmentation and classification | |
Massey | Creating AustinMan: an electromagnetic voxel model of the visible human | |
Kalinin et al. | A classification approach for anatomical regions segmentation | |
Stringham et al. | Probabilistic segmentation using edge detection and region growing | |
El-Feghi et al. | X-ray image segmentation using auto adaptive fuzzy index measure |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21713749 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21713749 Country of ref document: EP Kind code of ref document: A1 |