GB2576434A - Image Processing Method - Google Patents

Image Processing Method Download PDF

Info

Publication number
GB2576434A
GB2576434A GB1913964.1A GB201913964A GB2576434A GB 2576434 A GB2576434 A GB 2576434A GB 201913964 A GB201913964 A GB 201913964A GB 2576434 A GB2576434 A GB 2576434A
Authority
GB
United Kingdom
Prior art keywords
representation
mesh model
boundary representation
model representation
vertices
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1913964.1A
Other versions
GB2576434B (en
GB201913964D0 (en
Inventor
Georges Young Philippe
Raymont David
Paranjape Sumit
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Synopsys Inc
Original Assignee
Synopsys Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Synopsys Inc filed Critical Synopsys Inc
Priority to GB1913964.1A priority Critical patent/GB2576434B/en
Priority claimed from GB201311293A external-priority patent/GB2515510B/en
Publication of GB201913964D0 publication Critical patent/GB201913964D0/en
Publication of GB2576434A publication Critical patent/GB2576434A/en
Application granted granted Critical
Publication of GB2576434B publication Critical patent/GB2576434B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • G06T17/205Re-meshing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/10Geometric CAD
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • G06F30/23Design optimisation, verification or simulation using finite element methods [FEM] or finite difference methods [FDM]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Image Generation (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A method suitable for improving a 3D mesh model representation of a three-dimensional object, the 3D mesh model representation comprising a plurality of vertices, comprising: receiving a master boundary representation of the 3D object 801; automatically detecting region(s) in the 3D mesh model representation 802, each region having a displacement relative to a corresponding region in the master boundary representation; and modifying the 3D mesh model representation by selecting vertices having position in a first one of the detected regions and updating the position of the selected vertices to reduce the displacement of the first detected region relative to the corresponding region in the master boundary representation 816. In another embodiment the 3D mesh model representation may be used to manufacture a physical model. The 3D mesh model representation may comprise a plurality of contiguous polygons or cells, wherein each vertex is a point at an intersection between two or more contiguous polygons or cells. The 3D mesh model representation may be generated by isosurfacing a digitized 3D representation of the object by implementing a marching cubes algorithm, or by generating a volume mesh of a digitized 3D representation of the object.

Description

IMAGE PROCESSING METHOD
The invention relates to the preparation of images for further processing. For example, the prepared images may be for use in subsequent analysis techniques, such as finite element analysis or computational fluid dynamic (CFD) analysis, or as a more robust image for computer-assisted design (CAD) manipulation. In another example, an image may be prepared for use in a manufacturing process, such as threedimensional printing, CNC machining, injection moulding or the like .
CAD models are often constructed in a way that makes certain types of subsequent processing, such as the creation of real physical models (e.g. by three-dimensional printing or rapid prototyping) or volume and surface meshes, not possible without manual intervention. Often this can arise because some applications, such as visualisation, have less stringent requirements for the CAD model than other applications. CAD models which do not meet the requirements of a given process are often referred to as having defects or invalid geometries. Correcting the defects in CAD models so that they are suitable for the subsequent processing is sometimes termed fixing or healing the CAD data.
Herein we use the term CAD model to mean any conventional boundary representation of a three-dimensional geometry, either through the use of NURBS, polygons or other surface representations .
Examples of invalid geometries include:
(1) Surface mismatch, where the surface patches or polygons which make up the boundary representation create a small gap or overlap at shared edges in the surface (even though they may visually appear to conform). This can occur even when the vertices of the shared edge are the same if the polynomial order of interpolating function differs from patch to patch. Models with this type of invalid geometry are sometimes referred to as not being watertight or closed.
(2) Holes, where the edges and/or vertices of adjacent surface patches or polygons which make up the boundary representation are not shared. Models with this type of invalid geometry are also sometimes referred to as not being watertight or closed.
(3) Shell surfaces, where the model includes one or more surfaces which do not enclose a finite volume, i.e. they simply define a two-dimensional entity in space, with no solid region or thickness. Whilst such a surface can be clearly visualised, it cannot be used for a number of applications, such as generating a rapid prototyped model or a volume mesh, for which a closed model with a finite volume is reguired.
Another potential problem can be the complexity of CAD models, e.g. CAD models which include many detailed features such as short edges, fillets, etc. Such highly detailed features can present a challenge to generating a mesh for subsequent Computer Aided Engineering (CAE) analysis techniques such as modelling using finite element analysis (FEA) and computational fluid dynamics (CFD) because they introduce additional complexities, e.g. increased processing time and memory usage, more challenging meshing, etc. In many circumstances, the detailed features are not required for analysis purposes, and therefore a solution is to manually remove them from the CAD model. This process is known as CAD de-featuring.
A further problem may arise where a CAD model comprises multiple (two or more) interrelated component parts, where each component part is represented by a separate (independent) CAD model. For example, the component parts may make up an assembly which need to be agglomerated or concatenated to form a single CAD model. In one example, the component parts may be an engine block, inlet and exhaust manifolds, and pistons, which together form a car engine assembly. In other examples one of the interrelated component parts may be subtracted from another, e.g. the interrelated component parts may be a model of a femur bone and a reaming tool, whereby the combined CAD model is obtained by subtracting the reaming tool from the bone. For the purposes of further processing, it may be desirable to generate either a single or several new CAD models in which the component part CAD models are combined,
e.g. based on Boolean operations (union, intersection, etc.). For example, it may be desirable to analyse air flow over the complete car engine assembly or to perform finite element analysis on bone after the reaming tool is subtracted.
However, the result of the Boolean operations in CAD space may introduce defects in the resulting CAD model due to differences in geometry of surfaces of the component parts which are intended to interact with one another, e.g. by contact, mating, etc. For example, surface patches or polygons which make up the boundary representation at interfaces between components typically will not be perfectly conforming, thereby creating gaps or overlaps. These defects may be a result of the CAD models for the component parts being generated on separate systems, e.g. different CAD programs or on the same system without direct regard to one another. These defects may need to be manually fixed before processing of the new CAD model can take place.
A number of tools exist for addressing the problems either by operating directly on the CAD model or by creating a new CAD model using for example a shrink wrapping process. However these approaches can be difficult to use, may require considerable user interaction and may not give desired results. One example of such a tool is CADfix® by International TechneGroup Incorporated.
At its most general, the present invention proposes a technique for selectively recovering the features of an original CAD model after the original CAD model has been converted to a digitised image and a new CAD model generated from the digitised image. The original boundary representation may be effectively used as a template to recover accuracy and reintroduce feature edges and feature corners as well as other detailed features to the CAD model obtained from the digitised image, e.g. to enable detailed features to be retained that would otherwise be lost due to the lossy conversion into image space. The enhanced method may ensure reconstructed boundary vertices lie on original CAD model surfaces and feature edges and corners are recovered.
Thus, according to the invention, there may be provided a method of generating a representation of a virtual threedimensional object, the method comprising: obtaining a master boundary representation of the virtual three-dimensional object; sampling a bounding volume containing the master boundary representation to generate a digitised threedimensional representation of the object; generating a slave boundary representation from the digitised three-dimensional representation of the object; modifying the slave boundary representation with reference to the master boundary representation to make the slave boundary representation more similar to the master boundary representation. The aim of the modifying step may be to bring the overall geometry of the slave boundary representation closer to that of the master boundary representation, i.e. so that it appears exactly the same as the master boundary representation. Thus, the modifying step may enable the slave boundary representation to more accurately resemble the master boundary representation and/or may reintroduce one or more features of the master boundary representation.
The method may be for preparing a virtual threedimensional object to be suitable for three-dimensional printing, or for further Computer Aided Engineering (CAE) analysis techniques, such as FEA and CFD.
Herein, the term boundary representation may mean a CAD model in any suitable format, e.g. data representative of a surface in three dimensions, e.g. defined using a NURBS mathematical model, a plurality of polygonal surfaces or a volume mesh.
The process of converting the master boundary representation to image data and then reconstructing a surface from the image data inevitably leads to geometric inaccuracy in the reconstructed surfaces and a loss of feature edges and feature corners. The method of the invention therefore includes modifying the slave boundary representation to reintroduce a feature (or a plurality of features) of the master boundary representation. Thus, by referencing back to the master boundary representation (i.e. the original CAD model), geometric accuracy/fidelity and key features can be recovered. In this context, a feature may be any aspect of the shape or configuration of the master boundary representation, e.g. the position of its surfaces, the nature of its edges or corners, etc.
Modifying the slave boundary representation may be done to align or register a surface on the slave with a corresponding surface on the master boundary representation, and/or to recreate detailed edges or corners that are lost in the sampling process. Thus, modifying the slave boundary representation may comprise: comparing the slave boundary representation with the master boundary representation; and mapping a displaced portion of the slave boundary representation to a modified position to match the corresponding portion of the master boundary representation. Herein, displaced portion means a part of the slave boundary representation that is not in the same position as the corresponding part of the master boundary representation. In practice, the process of generating the slave boundary representation means that the master boundary representation and the slave boundary representation share a common frame of reference. If this is not the case, the comparing step may include co-registering the master boundary representation and the slave boundary representation. As mentioned above, the displaced portion may be a surface, edge, or corner.
Mapping the displaced portion may comprise moving a plurality of points on the slave boundary representation to respective locations on the co-registered master boundary representation. This may be a technique for registering a surface or an edge or a corner of the slave boundary representation with the master boundary representation. The method may include selecting one or more features on the master boundary representation to which corresponding portions of the slave boundary representation are to be mapped.
Each of the plurality of points may be moved on to the surface of the master boundary representation that is closest to it in a direction normal to the surface of the master boundary representation. Alternatively, each of the plurality of points may be moved on to the surface of the master boundary representation that is closest to it in a direction normal to the surface of the slave boundary representation. For example, the slave boundary representation may comprise a plurality of contiguous polygons, and wherein each of the plurality of points may be a vertex at the intersection between two or more of the plurality of contiguous polygons.
Alternatively, the slave boundary representation may comprise a volume mesh having a plurality of contiguous cells, and wherein each of the plurality of points is a vertex at the intersection between two or more of the plurality of contiguous cells .
In another embodiment, the slave boundary representation may comprise a NURBS surface, and wherein each of the plurality of points is a grid point on the NURBS surface.
Mapping the displaced portion may comprise spawning a new point on the slave boundary representation, wherein moving the plurality of points comprises moving the new point. For example, where the slave boundary representation may comprise a plurality of contiguous polygons, a new point may be spawned by dividing a polygon in the displaced portion to spawn a new vertex, wherein moving the plurality of points comprises moving the spawned vertex. The technique may be particularly useful for corners and edges, as it can reduce the magnitude of distortion of the polygons in the displaced region.
The displaced portion may be any of a surface, an edge and a corner.
The method may include outputting the modified slave boundary representation, e.g. for display or further processing. For example, the modified slave boundary representation may be communicated to a three-dimensional printer or CNC machine. The modified slave boundary representation may also be suitable for further operations in polygonal (i.e. CAD) space, e.g. adaptive decimation, generating volume meshes, converting to higher order NURBS surfaces, etc.
The step of generating a slave boundary representation from the digitised three-dimensional representation of the object may use any conventional surface reconstruction technique, e.g. an isosurfacing technique such as the marching cubes algorithm. The slave boundary representation may thus comprise one or more closed polygonal surfaces, which in turn may be formed from a plurality of contiguous polygons. If the object comprises a plurality of component parts which are intended to conform with one another, generating the slave boundary representation may comprises using the multi-part marching cube algorithm to ensure conformity at all part interfaces .
Alternatively, the step of generating the slave boundary representation may comprise generating a volume mesh of the digitised three-dimensional representation, e.g. using any known technique such as advancing front or Delaunay meshing.
The method may include manipulating the digitised threedimensional representation before generating the slave boundary representation. Manipulating the digitised threedimensional representation may include digitally altering or de-featuring a region of the digitised three-dimensional representation of the object.
Herein, digital altering may mean any technique for changing the image data obtained from the sampling step. For example, the image data may be altered using known image processing techniques, such as paint/unpaint, filtering, smoothing, flood filling, etc. Alternatively or additionally, the step of digitally altering may comprise performing a morphological operation.
If the object is an assembly of sub-components, digital altering may comprise joining the sub-components, e.g. by connecting regions (e.g. voxelised volumes) in the digitised three-dimensional representation that are intended to be in contact or joined. The surfaces may be joined by filling or morphological closing operations. Alternatively or additionally, if the object is an assembly of sub-components, the digital altering step may comprises performing one or more Boolean operations, e.g. union or intersection, to effectively merge the sub-components into a single object or to create different new modified components. This technique may be particularly useful if it is desirable to model the interaction between the original CAD model and a separate image. Boolean operations may be used on the digitised threedimensional representation and the separate image, before converting the result back to form the slave boundary representation. The Boolean operations may act to split the digitised image representation or to amalgamate or concatenate it with the separate image.
Manipulating the digitised three-dimensional representation may be for the purpose of healing defects in the master boundary representation. The method may thus include identifying an invalid portion of the master boundary representation; and selecting a healing technique to be applied based on the identified invalid portion, wherein digitally altering a region of the digitised three-dimensional representation comprises applying a healing technique to heal defects in the master boundary representation.
There may be a number of available healing techniques that can be applied, depending on the type of defect. The method may therefore include: identifying an invalid portion of the master boundary representation; and selecting the healing technique to be applied based on the identified invalid portion. In some circumstances, explained below, the act of converting the master boundary representation into a digitised image, i.e. the step of sampling the bounding volume containing the master boundary representation, may in itself result in obtaining the healed digitised three-dimensional representation. The sampling process itself is lossy, which means that detail can be lost from the master boundary representation. If the defects exist at the level of detail that is lost, i.e. they have dimensions of the same order of magnitude of the sampling rate or less, they may be healed by the sampling process itself.
The region that is digitally altered may correspond to the identified invalid portion of the master boundary representation.
The digitised three-dimensional representation of the object may comprise a voxelised model of the virtual threedimensional object, e.g. obtained by a conventional voxelisation process. The step of digitally altering a region of the digitised three-dimensional representation may thus comprise painting the region to add or remove voxels in the digitised three-dimensional representation.
The identified invalid portion may include a gap in the master boundary representation. For such an invalid portion, the selected healing technique may include selecting a sampling spacing that is greater than the magnitude of the gap. As mentioned above, this may result in the healed digitised three-dimensional representation of the object being automatically obtained from the step of sampling the bounding volume to create the digitised representation.
The identified invalid portion may include an overlap of bounding surfaces in the master boundary representation. For such an invalid portion, the selected healing technique includes selecting a sampling spacing that is greater than the magnitude of the overlap, i.e. the distance between the two overlapping surfaces. As mentioned above, this may result in the healed digitised three-dimensional representation of the object being automatically obtained from the step of sampling the bounding volume to create the digitised representation.
The conversion into image data, i.e. the sampling stage, may be performed using any standard technique. For example, the sampling step may include a binary voxelisation step, where voxels in the image data are marked as either inside or outside the master boundary representation. This technique may be appropriate for closed surfaces or surfaces with gaps smaller than the sampling rate.
Alternatively or additionally, the sampling step may be include assigning values to the voxels based on a signed distance function, where voxels near the surface of the master boundary representation are assigned values which reflect their distance to that surface. Voxels inside the master boundary representation are given negative values, whereas those outside are given positive values. This technique may also be appropriate (and more accurate) for closed surfaces or surfaces with gaps smaller than the sampling rate. But additional requirement for running this technique successfully is the ability to distinguish whether sampling points lie inside or outside the object. This breaks for shell surfaces because there are then no points 'inside' the geometry.
Alternatively or additionally, the sampling step may be include assigning values to the voxels based on an unsigned distance function, where voxels near the surface of the master boundary representation reflect their distance to that surface without any distinction between what is inside and what is outside. Thus, the voxels that are far away from the surface are given low values. This technique may provide a solution to the problem of shell surfaces because it permits extraction of an isosurface at a given distance from the surface of the master boundary representation (i.e. the shell), which is thus effectively given an arbitrary thickness. This technique thus provides an alternative in image space to the step of extruding the shell surface (to create an offset) on the master boundary representation (i.e. in CAD space).
Thus, the identified invalid portion may include a shell. For such an invalid portion, the selected healing technique may include sampling the bounded volume by applying an unsigned distance function to a region of the bounding volume that includes the invalid portion. The healing technique may include extracting an isosurface from the digitised threedimensional representation of the object, the isosurface defining a volume corresponding to (e.g. enclosing or mimicking) the shell. The method may include a step of thinning the isosurface so that it better conforms to the original shell. If the shell is closed, i.e. completely encloses a finite volume, this may be done by flood filling the isosurface in image space and then eroding one of more voxel layers from the isosurface.
The above healing techniques may be applied alone or in any combination. Thus, the healing technique may represent a hybrid of any or all of the techniques mentioned above. For example, different parts of the master boundary representation may be voxelised using different methods. Providing each part is voxelised at the same sample rate or, where spatially distinct, an appropriate transitioning scheme is used, the individual volumes can be unioned to produce a final volume representing the entire model.
The digitised three-dimensional representation of the object is effectively an approximate bitmapped representation of the master boundary representation, wherein the degree of approximation can be controlled by selecting the sampling rate
As explained above, once the object is represented in image space, additional image manipulation (i.e. additional to the sampling process itself) may be performed. In addition to the techniques discussed above, the digitised representation may also be subject to localised smoothing or Boolean operations in order to de-feature (i.e. simplify) a geometry.
The invention may also be expressed as a computer program product comprising a computer-readable storage medium having software instructions stored thereon, the software instructions being executable by a computer to perform the steps of any of the methods outlined above.
In a second aspect, the invention may provide a method of manufacturing a physical model, the method comprising: inputting a master boundary representation of the virtual three-dimensional object; sampling a bounding volume containing the master boundary representation to generate a digitised three-dimensional representation of the object; generating a slave boundary representation from the digitised three-dimensional representation of the object; modifying the slave boundary representation with reference to the master boundary representation to make the slave boundary representation more similar to the master boundary representation; outputting the slave boundary representation to a manufacturing unit; and operating the manufacturing unit to create a physical model corresponding to the slave boundary representation. The manufacturing unit may be a threedimensional printer, CNC machine or the like. Any of the steps of the first aspect may also be applied to the second aspect.
The disclosure herein also defines a method of correcting a defective representation of a virtual three-dimensional object, the method comprising: obtaining a master boundary representation of a virtual three-dimensional object; healing defects in the master boundary representation by applying a healing technique that comprises: sampling a bounding volume containing the master boundary representation to generate a digitised three-dimensional representation of the object, and obtaining a healed digitised three-dimensional representation of the object; and generating a slave boundary representation from the healed digitised three-dimensional representation of the object. This method teaches applying a healing technique which takes the master boundary representation into image space, where a healed version is obtained and then converted back to the slave boundary representation.
Examples of the invention as discussed in detail below with reference to the accompanying drawings, in which:
Figs. 1A to IF illustrate the effect of various steps of a method that is an embodiment of the invention on a virtual three-dimensional object;
Figs. 2A and 2B illustrate the steps of registering an edge on a 2D slave boundary representation with an edge on a 2D master boundary representation;
Fig. 3 illustrates the step of registering a surface on a 3D slave boundary representation with a surface on a 3D master boundary representation;
Figs. 4A and 4B illustrate the steps of recovering corner features on a 2D slave boundary representation by moving existing vertices;
Figs. 5A and 5B illustrate the steps of recovering corner features on a 2D slave boundary representation by spawning new vertices;
Fig. 6 illustrates the step of recovering edge and corner features on a 3D slave boundary representation by moving existing vertices and spawning new vertices;
Fig. 7 is a flow chart illustrating a procedure for recovering a surface in a 3D slave boundary representation; and
Fig. 8 is a flow chart illustrating a procedure for recovering edges in a 3D slave boundary representation;
An overview of a method that is an embodiment of the invention is discussed first with reference to Figs. 1A to IF. Fig. 1A shows the master boundary representation of a virtual three-dimensional object, also referred to below as the original CAD model. This may be obtained from or created by any conventional CAD software package.
Fig. IB shows the result of converting the CAD model into digital image data. Thus, Fig. IB is a digitised threedimensional representation of the object. In this example, the original CAD model is voxelised. As can be seen in Fig. IB, voxelisation is a lossy technique, so the process defeatures the original CAD model. The amount of de-featuring depends on the chosen sampling rate. For solid objects, as the sampling rate increases, the image representation (and in particular any boundary representation extracted by isosurfacing the image representation) will converge to the original CAD model, but finer digitisation can lead to significant computational costs both in terms of CPU time and memory.
In some embodiments, the inherent approximation in the digitisation can itself resolve problems with the original model. For example, in the case where there exists poorly conforming surfaces, a sampling rate can be chosen such that invalid portions of the original CAD model are not captured.
CAD models can be converted into images data (voxelised/digitised) using a number of different methods, each of which is suitable for different kinds of model. The following techniques can be used with the invention:
(1) Binary voxelisation: voxels in the image data are marked as either inside or outside of the CAD model.
(2) Signed distance function: voxel values reflect their distance to the surface. Those inside are given negative values, those outside are given positive values.
(3) Unsigned distance function: voxel values near the surface of the CAD reflect their distance to the surface. Those far away are given low values. No distinction is made between inside and outside. This technique allows a shell surface to be given a real thickness, e.g. by extracting an isosurface at a given distance.
(4) Unsigned distance function with erosion: as for (3) above, followed by a flood fill and erosion to reduce the thickening effect so that the isosurface lies more closely to the original surface.
(5) Hybrid: some combination of the above. Different parts of a CAD model can be voxelised using different methods. Providing each part is voxelised at the same sample rate or, where spatially distinct, an appropriate transitioning scheme is used, the individual volumes can be unioned to produce a final volume representing the entire model.
Fig. IC shows a modified (i.e. digitally altered) version of the digitised representation of the object. The purpose of the modification may be manifold. For example, the modification may be for healing invalid portions of the original CAD model. However, the modification process may also be used on valid CAD models, e.g. to defeature or edit the CAD to remove features that are unwanted or unnecessary for subsequent processing, or to perform Boolean operations with other images. These other images may themselves be digitised version of CAD models or they may be original digital data, e.g. obtained by a scanning a real object or physical volume. The modification step may thus be a technique for healing invalid CAD models, or for combining the original CAD model in some way with other image data, or simply for editing the original CAD model to prepare it for subsequent processing. In this example, the modification comprises removing (e.g. painting out) two small projections on a surface of the object. In other embodiments, other types of known image-based operators can be used, e.g. morphological operators (e.g. dilate, erode, close and open), manual painting, image filtering, etc. Localised smoothing or Boolean operations may be used to de-feature a geometry. Invalid portions of the original CAD model can be corrected in this manner.
Fig. ID shows a slave boundary representation, i.e. a healthy new CAD model, obtained by converting the healed version of the digitised representation using any known surface reconstruction technigue, e.g. the marching cubes or other algorithm can be used to extract an isosurface from the image data. This will result in one or more closed polygonal surfaces being produced. Where several conforming but distinct image models then multi-part marching cube algorithm can be used which will ensure conformity at all part interfaces (i.e. no gaps/overlaps). The slave boundary representation is a near approximation of original surfaces. To bring the slave boundary representation closer to the master boundary representation (original CAD model), further correction techniques are needed. In this embodiment, these further corrections are performed by referring to the surfaces of the original CAD model.
Fig. IE shows a modified version of the slave boundary representation in which the planar surfaces of the original CAD model are recovered by moving vertices on the slave boundary representation. Typically, the vertices of the polygons forming the reconstructed surface model will not lie exactly on the polygon(s) in the original CAD model by virtue of the process. How close they lie to original surface will depend on how fine a sampling rate was chosen for digitisation. However, for example, by finding the shortest distance from a vertex on the new surface to the original/master surface and moving vertex to that point and repeating this for every polygon vertex will recover surface accuracy.
The objective of surface recovery is to reduce the spatial discrepancy between the original CAD model and the reconstructed surface. The surface recovery algorithm involves updating the position of each vertex in the reconstructed surface to an appropriate/suitable position (generally the closest point) on the CAD model. This technique is discussed in more detail with reference to Figs. 2, 3 and 7 below.
Fig. IF shows the result of carrying out a similar correction technique to recover feature edges and corners of the original CAD model. The surface recovery technique used to obtain the modified slave boundary representation in Fig. IE is effective in recovering flat or smooth surfaces, but leaves behind bevelled facets in the slave boundary representation in place of sharp features in the CAD model. By referencing the bevelled edges or corners to corresponding edges or corner in the original CAD model, these detailed features can be recovered by moving existing vertices or spawning new vertices which are then moved to the position of the original edge or corner. This technique is discussed in more detail with reference to Figs. 4 to 6 and 8 below.
The technique of modifying the slave boundary representation to recover surfaces (e.g. planar surfaces) from the original CAD model is discussed now with reference to Figs. 2 and 3. The objective of surface recovery is to eliminate the spatial discrepancy between the original CAD model and the surface vertices of the slave boundary representation. The surface recovery technique involves comparing the slave boundary representation with the original CAD model, and updating the position of each vertex in the slave boundary representation to an appropriate point (e.g. the closest point, and generally not an original vertex) on the surface of the original CAD model.
Figs. 2A and 2B illustrate the surface recovery technigue applied to a 2D mesh. The original CAD model is a regular shape, comprising an outer square and an inner regular octagon. The slave boundary representation is an irregular 2D mesh. By virtue of the process of generating the slave boundary representation, it is spatially co-registered with the master boundary representation, i.e. they have the same frame of reference. This enables direct comparison of corresponding surfaces and other features (e.g. edges and corners). As shown in Fig. 2A, the vertices on the 2D mesh are moved to the closest point on the CAD model edge (in a direction normal to that edge). Fig. 2B shows the result of this process .
Fig. 3 illustrates the same surface recovery technique applied to a 3D mesh. It can be seen that the surface recovery technique is effective in recovering flat or smooth surfaces (e.g. the outer square of the original CAD model in the Fig. 2 example). However, the algorithm leaves behind bevelled facets in the reconstructed surface in place of sharp features in the CAD model.
The process of digitisation/voxelisation and isosurfacing means that a priori all feature edges are bevelled. Whilst the process of moving vertices to the closest point on the surface of the original CAD recovers vertex accuracy, edges will remain bevelled as the moved vertices will not necessarily or usually sit along the feature edge. Again by referencing the original CAD, a correction can be applied to the new CAD to recover these feature edges. The technique of modifying the slave boundary representation to recover sharp edges and corners from the original CAD model is discussed now with reference to Figs. 4, 5 and 6.
The feature edges in the original CAD need to be identified (they can either be flagged as such by the user or identified in automated fashion using a range of algorithms
e.g. based on threshold angle between polygon faces).
Once identified, several approaches are possible for modifying the slave boundary representation to conform to the original CAD model. For example, vertices on polygons on either face straddling the feature edge can be moved to the edge thereby recovering the edge. Alternatively polygons straddling the feature edge can be split into several polygons with a new central vertex and this new spawned central vertex can be snapped (e.g. shortest distance) to the feature edge. Similarly, feature corners to be recovered can be identified automatically or flagged by the user. To recover feature corners either a suitable existing vertex or a new vertex created by splitting the closest polygon in the new CAD are moved to the corner vertex position on the surface of the original CAD model.
The procedure for converting smoothed, bevelled or chamfered features edges and corners into sharp ones is complicated because it requires the deduction of the exact location of the sharp feature relative to the existing slave boundary representation and non-trivial modification of mesh topology and/or vertex positions. Previous implementations [13] use thresholds on the angle of separation between surface normal for deducing the location where feature edges must be generated. In contrast, the embodiments of the invention make use of information available in the original CAD model as a reference for locating sharp features.
Figs. 4A and 4B illustrate the feature edge/corner recovery technique applied to the 2D mesh of Fig. 2. In Fig. 4A, the vertices closest to the sharp features are identified and moved to match the location of the sharp feature. Fig. 4B shows the result. As in the surface recovery algorithm, the topology of the mesh is preserved but some elements of a subsequently generated volume mesh might be highly stretched or skewed.
Figs. 5A and 5B illustrate an alternative feature edge/corner recovery technique applied to the 2D mesh of Fig.
2. In this example, edges in the mesh closest to the sharp feature are identified and split at the midpoint. As shown in Fig. 5A, the triangles connected to these edges are bisected in order to avoid hanging vertices. The new vertices are moved to match the location of sharp features, shown in Fig. 5B.
Fig. 6 illustrates the same feature edge/corner recovery technique applied to a 3D mesh. It is possible to use a combination of the techniques shown in Figs. 5A and 5B depending on the local topology of the boundary representation and the distance from the feature edge.
Fig. 7 is a flowchart depicting the steps of the surface recovery technique discussed above with reference to Figs. 2 and 3. The inputs to the method are the slave boundary representation 701 and original CAD model (master boundary representation) 703. The method includes a loop which repeats the position updating step for each vertex in the slave boundary representation. At a first step 702, a vertex to be updated is selected. A flag may be set for each vertex at this stage so the fact that its position has been updated is recorded. In a second step 704, the selected vertex in the slave boundary representation is compared with the original CAD model to identify an optimal position with reference to the original boundary representation. For example, the optimal position may be the closest point to the vertex on the CAD model surface (e.g. along a normal to the original CAD surface). In a third step 706, the selected vertex is moved to the optimal position. In a fourth step 708, the method then assesses whether all of the vertices have been updated (e.g. by referring to the state of the flags stored for each vertex). If all the vertices have been updated, the process ends. If not, the method loops back to the first step 702 to select the next vertex.
Fig. 8 is a flowchart depicting the steps of the feature edge recovery technique discussed above with reference to Fig. 4. A similar process can be used to recover corner features. Again, the inputs for this technique are the master boundary representation 801 (original CAD model) and the slave boundary representation 803 (which may have been modified by the process discussed above with reference to Fig. 7). In a first step 802, the edges (or corners) in the master boundary representation that are to be designated as sharp features for recovery are identified. This step may thus generate a list of feature edges (and/or corners) to be recovered. In a second step 804, one of the identified features is selected. The method includes a loop which repeats the recovery steps for each identified feature. For each feature, there are two alternative recovery processes. The particular process used may depend on the nature of the selected feature. It may be automatically selected, e.g. based on parameters of the feature, or manually selected.
The first alternative recovery technique begins with a step 806 of identifying elements in the slave boundary representation which straddle the selected feature. Herein elements may refer to the contiguous polygons which define the surface of the slave boundary representation. In step 808, each of the straddling elements is divided to spawn a new vertex. In step 810, the position of the new vertex is updated to lie on the selected feature edge (or at the feature corner). Following step 810, the process proceeds to a step 812 of querying whether or not all of the identified features have been recovered. If the answer is no, the process loops back to the selection step 804. If the answer is yes, the process terminates.
The second alternative recovery technique begins with a step 814 of identifying vertices in the slave boundary representation which are closest to the selected feature edge (or corner). After the closest vertices are identified, the technique moves to a step 816 of updating the position of the closest vertices so that they lie on the selected feature edge (or at the feature corner). Following the updating step 816, the process proceeds to the step 812 of querying whether or not all of the identified features have been recovered.
The healing techniques listed above can be applied in the following example of invalid CAD models:
1. CAD model with non-conforming patches
- voxelise CAD model using a signed distance function and a sample rate of 1 mm;
- extract isosurface using marching cubes algorithm;
- store isosurface as a triangulated surface in an STL file .
2. CAD model composed of shells:
- voxelise CAD model using an unsigned distance function and a sample rate of 1 mm;
- extract isosurface using marching cubes algorithm;
- store isosurface as a triangulated surface in an STL file .
3. CAD model with holes:
- voxelise CAD model using an unsigned distance function and a sample rate of 1 mm;
- paint closed holes in the surface;
- perform inverted floodfill to solidify the model;
- extract isosurface using marching cubes algorithm;
- store isosurface as a triangulated surface in an STL file .
4. CAD model composed of shells and closed surfaces
- identify and separate shells and closed surfaces;
- voxelise shells using an unsigned distance function and a sample rate of 1 mm;
- voxelise closed surfaces using a signed distance function and a sample rate of 1 mm;
union voxelised shells and closed surfaces to produce final volume;
- extract isosurface using the marching cubes algorithm (isosurface for voxelised shells chosen to achieve a predefined thickness);
- store isosurface as a triangulated surface in an STL file .
5. An assembly of closed surface parts with poor conformity (between parts):
- merge parts into a single, intersecting, part.
- voxelise single part using a signed distance function;
- perform a morphological close operation to close the cavities between parts;
- extract an isosurface using the marching cubes algorithm;
- store the isosurface is stored as a triangulated surface in an STL file.
Triangulated surfaces, generated from CAD models, are often used to define the input geometry for rapid prototyping. The methods described above can therefore be applied directly to a triangulated surface to produce a valid STL file (i.e. a robust closed surface).
Aspects of the above disclosure may be expressed in the following clauses:
1. A method of generating a representation of a virtual three-dimensional object, the method comprising: obtaining a master boundary representation of the virtual threedimensional object; sampling a bounding volume containing the master boundary representation to generate a digitised threedimensional representation of the object; generating a slave boundary representation from the digitised three-dimensional representation of the object; modifying the slave boundary representation with reference to the master boundary representation to make the slave boundary representation more similar to the master boundary representation.
2. A method according to clause 1, wherein modifying the slave boundary representation comprises: comparing the slave boundary representation with the master boundary representation; mapping a displaced portion of the slave boundary representation to a modified position to match the corresponding portion of the master boundary representation.
3. A method according to clause 2, wherein mapping the displaced portion comprises moving each of a plurality of points on the slave boundary representation to a respective location on the master boundary representation.
4. A method according to clause 3, wherein each of the plurality of points is moved on to the surface of the master boundary representation that is closest to it in a direction normal to the surface of the master boundary representation.
5. A method according to clause 3, wherein each of the plurality of points is moved on to the surface of the master boundary representation that is closest to it in a direction normal to the surface of the slave boundary representation.
6. A method according to any one of clauses 3 to 5, wherein the slave boundary representation comprises a plurality of contiguous polygons, and wherein each of the plurality of points is a vertex at the intersection between two or more of the plurality of contiguous polygons.
7. A method according to any one of clauses 3 to 5, wherein the slave boundary representation comprises a volume mesh having a plurality of contiguous cells, and wherein each of the plurality of points is a vertex at the intersection between two or more of the plurality of contiguous cells at the surface of the object.
8. A method according to any one of clauses 3 to 5, wherein the slave boundary representation comprises a NURBS surface, and wherein each of the plurality of points is a control point on the NURBS surface.
9. A method according to any one of clauses 3 to 8 including spawning a new point on the slave boundary representation, wherein moving the plurality of points comprises moving the new point.
10 . A method according to any one of clauses 2 to 9,
wherein the displaced portion is any of a surface, an edge and
a corner .
11. A method according to any preceding clause including
outputting the modified slave boundary representation.
12. A method according to any preceding clause, wherein generating the slave boundary representation comprises isosurfacing the digitised three-dimensional representation using the marching cubes algorithm.
13. A method according to any one of clauses 1 to 11, wherein generating the slave boundary representation comprises generating a volume mesh of the digitised three-dimensional representation.
. A method according to any preceding clause including digitally altering a region of the digitised three-dimensional representation of the object before generating the slave boundary representation.
15. A method according to clause 14, wherein the digitised three-dimensional representation of the object comprises a voxelized model of the virtual three-dimensional object, and wherein digitally altering a region of the digitised three-dimensional representation comprises painting the region to add or remove voxels in the digitised threedimensional representation.
16. A method according to clause 14, wherein digitally altering a region of the digitised three-dimensional representation comprises performing a morphological operation on the region.
17. A method according to clause 14 including: identifying an invalid portion of the master boundary representation; selecting a healing technique to be applied based on the identified invalid portion, wherein digitally altering a region of the digitised three-dimensional representation comprises applying a healing technique to heal defects in the master boundary representation.
18. A method according to clause 17, wherein the identified invalid portion includes a shell, and wherein the selected healing technique includes sampling the bounded volume by applying an unsigned distance function to a region of the bounding volume that includes the invalid portion.
19. A method according to clause 14, wherein digitally altering a region of the digitised three-dimensional representation comprises performing a Boolean operation.
20. A computer program product comprising a computerreadable storage medium having software instructions stored thereon, the software instructions being executable by a computer to perform the steps of a method according to any preceding clause .
21. A method of manufacturing a physical model, the method comprising: inputting a master boundary representation of the virtual three-dimensional object; sampling a bounding volume containing the master boundary representation to generate a digitised three-dimensional representation of the object; generating a slave boundary representation from the digitised three-dimensional representation of the object; modifying the slave boundary representation with reference to the master boundary representation to make the slave boundary representation more similar to the master boundary representation; outputting the slave boundary representation to a manufacturing unit; and operating the manufacturing unit to create a physical model corresponding to the slave boundary representation.
22. A method according to clause 21, wherein the manufacturing unit is a three-dimensional printer or a CNC machine .
REFERENCES [1] M. Attene, B. Falcidieno, J. Rossignac and M. Spagnuolo, Sharpen&Bend: Recovering curved sharp edges in triangle meshes produced by feature-insensitive sampling. IEEE Transactions on Visualization and Computer Graphics, 2005.
[2] Marco Attene , Bianca Falcidieno, Jarek Rossignac, Michela Spagnuolo, Edge-sharpener: recovering sharp features in triangulations of non-adaptively re-meshed surfaces, Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing, June 2003.
[3] Charlie C. L. Wang, Incremental Reconstruction of Sharp Edges on Mesh Surfaces. Computer-Aided Design, Volume 38, Issue 6, June 2006

Claims (19)

1. A computer-implemented method of improving a 3D mesh model representation of a three-dimensional object in a computer having a processor and a memory device, the 3D mesh model representation comprising a plurality of vertices, the method comprising:
receiving a master boundary representation of the threedimensional object;
utilizing the computer to automatically detect one or more regions in the 3D mesh model representation, each of the detected regions having a displacement relative to a corresponding region of the master boundary representation; and modifying by the computer the 3D mesh model representation using code executed by the computer including selecting vertices having positions in a first one of the detected regions of the 3D mesh model representation, and updating the positions of the selected vertices to reduce the displacement of the first detected region relative to the corresponding region of the master boundary representation.
2. The method according to claim 1, wherein the 3D mesh model representation comprises a plurality of contiguous polygons, and wherein each of the plurality of vertices is a point at an intersection between two or more of the plurality of contiguous polygons.
3. The method according to claim 1, wherein the 3D mesh model representation comprises a plurality of contiguous cells, and wherein each of the plurality of points is a vertex at the intersection between two or more of the plurality of contiguous cells at the surface of the object.
4. The method according to any one of claims 1 to 3 including generating the 3D mesh model representation by isosurfacing a digitized three-dimensional representation of the object by implementing a marching cubes algorithm.
5. The method according to any one of claims 1 to 3 including generating the 3D mesh model representation by generating a volume mesh of a digitized three-dimensional representation of the object.
6. The method according to any preceding claim, wherein automatically detecting one or more regions in the 3D mesh model representation includes processing a digitized threedimensional representation of the object.
7. The method according to any preceding claim further comprising receiving from a user identification of the first one of the detected regions.
8. The method according to any preceding claim further comprising further modifying by the computer the 3D mesh model representation using code executed by the computer including selecting vertices having positions in a second one of the detected regions of the 3D mesh model representation, and updating the positions of the selected vertices in the second detected region to reduce the displacement of the second detected region relative to the corresponding region of the master boundary representation.
9. A computer-implemented method of manufacturing a physical model, the method performed by a computer having a processor and a memory device, and the method comprising:
receiving a master boundary representation of the physical model and a 3D mesh model representation of the physical model in the memory device, the 3D mesh model including a plurality of vertices;
utilizing the computer to automatically detect one or more regions in the 3D mesh model representation, each of the detected regions having a displacement relative to a corresponding region of the master boundary representation;
modifying by the computer the 3D mesh model representation using code executed by the computer including selecting vertices having positions in a first one of the detected regions of the 3D mesh model representation, and updating the positions of the selected vertices to reduce the displacement of the first detected region relative to the corresponding region of the master boundary representation;
outputting the 3D mesh model representation to a manufacturing unit; and operating the manufacturing unit to create a physical model corresponding to the 3D mesh model representation.
10. The method according to claim 9, wherein the 3D mesh model representation comprises a plurality of contiguous polygons, and wherein each of the plurality of vertices is a point at an intersection between two or more of the plurality of contiguous polygons.
11. The method according to claim 9, wherein the 3D mesh model representation comprises a plurality of contiguous cells, and wherein each of the plurality of points is a vertex at the intersection between two or more of the plurality of contiguous cells at the surface of the object.
12. The method according to any one of claims 9 to 11 including generating the 3D mesh model representation by isosurfacing a digitized three-dimensional representation of the physical model by implementing a marching cubes algorithm.
13. The method according to any one of claims 9 to 11 including generating the 3D mesh model representation by generating a volume mesh of a digitized three-dimensional representation of the physical model.
14. The method according to any one of claims 9 to 13, wherein automatically detecting one or more regions in the 3D mesh model representation includes processing a digitized three-dimensional representation of the object.
15. The method according to any one of claims 9 to 14, wherein the manufacturing unit is a three-dimensional printer or a CNC machine.
16. The method according to any one of claims 9 to 15 further comprising receiving from a user identification of the first one of the detected regions.
17. The method according to any one of claims 9 to 16 further comprising further modifying by the computer the 3D mesh model representation using code executed by the computer including selecting vertices having positions in a second one 5 of the detected regions of the 3D mesh model representation, and updating the positions of the selected vertices in the second detected region to reduce the displacement of the second detected region relative to the corresponding region of the master boundary representation.
18 . A system for improving a 3D mesh model representation of a three-dimensional object, the system comprising a memory and a data processor coupled to the memory, the data processor configured to perform the method of 15 any one of claims 1 to 17.
19. A computer program for implementing the method of any of claims 1 to 17.
GB1913964.1A 2013-06-25 2013-06-25 Image Processing Method Active GB2576434B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB1913964.1A GB2576434B (en) 2013-06-25 2013-06-25 Image Processing Method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB201311293A GB2515510B (en) 2013-06-25 2013-06-25 Image processing method
GB1913964.1A GB2576434B (en) 2013-06-25 2013-06-25 Image Processing Method

Publications (3)

Publication Number Publication Date
GB201913964D0 GB201913964D0 (en) 2019-11-13
GB2576434A true GB2576434A (en) 2020-02-19
GB2576434B GB2576434B (en) 2020-09-16

Family

ID=68539094

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1913964.1A Active GB2576434B (en) 2013-06-25 2013-06-25 Image Processing Method

Country Status (1)

Country Link
GB (1) GB2576434B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2607046A (en) * 2021-05-26 2022-11-30 Vitaware Ltd Image processing method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2808844A2 (en) * 2013-05-31 2014-12-03 Siemens Aktiengesellschaft Segmentation of a calcified blood vessel
US20180096451A1 (en) * 2016-09-30 2018-04-05 Oracle International Corporation System and method providing automatic alignment of aerial/satellite imagery to known ground features
WO2019139441A1 (en) * 2018-01-12 2019-07-18 삼성전자 주식회사 Image processing device and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2808844A2 (en) * 2013-05-31 2014-12-03 Siemens Aktiengesellschaft Segmentation of a calcified blood vessel
US20180096451A1 (en) * 2016-09-30 2018-04-05 Oracle International Corporation System and method providing automatic alignment of aerial/satellite imagery to known ground features
WO2019139441A1 (en) * 2018-01-12 2019-07-18 삼성전자 주식회사 Image processing device and method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2607046A (en) * 2021-05-26 2022-11-30 Vitaware Ltd Image processing method
WO2022248507A1 (en) * 2021-05-26 2022-12-01 Vitaware Ltd Image processing method

Also Published As

Publication number Publication date
GB2576434B (en) 2020-09-16
GB201913964D0 (en) 2019-11-13

Similar Documents

Publication Publication Date Title
US10346708B2 (en) Image processing method
Ding et al. Automatic multi-direction slicing algorithms for wire based additive manufacturing
Attene et al. Polygon mesh repairing: An application perspective
EP3251095B1 (en) Generating slice data from a voxel representation
Sederberg et al. Watertight trimmed NURBS
US7814441B2 (en) System and method for identifying original design intents using 3D scan data
KR101250163B1 (en) Process for creating from a mesh an isotopologic set of parameterized surfaces
Campen et al. A Practical Guide to Polygon Mesh Repairing.
Shum et al. Solid reconstruction from orthographic opaque views using incremental extrusion
WO2006097926A2 (en) Methods and systems for creating and altering cad models
Mao et al. Robust surface reconstruction of teeth from raw pointsets
Joy et al. Efficient milling part geometry computation via three-step update of frame-sliced voxel representation workpiece model
US20070088531A1 (en) Methods For Generating Digital Or Visual Representations Of A Closed Tessellated Surface Geometry
Chen et al. Half-space power diagrams and discrete surface offsets
GB2576434A (en) Image Processing Method
Bénière et al. Recovering primitives in 3D CAD meshes
Kumbhar et al. Improved intermediate point curve model for integrating reverse engineering and rapid prototyping
Attene et al. On converting sets of tetrahedra to combinatorial and PL manifolds
Patel et al. Automatic CAD model topology generation
Patel et al. Stitching and filling: Creating conformal faceted geometry
CN113781642B (en) Three-dimensional model multi-level LOD generation method based on face reduction algorithm
US20240242439A1 (en) Image processing method
Thakur et al. Optimization of Direct Slicing Process Using DICOMS for Additive Manufacturing
Adhikary et al. Direct global editing of STL mesh model for product design and rapid prototyping
Sheffer et al. CAD data repair based on virtual topology