CN102236913A - Volumetric mesh deformation method - Google Patents
Volumetric mesh deformation method Download PDFInfo
- Publication number
- CN102236913A CN102236913A CN 201110094168 CN201110094168A CN102236913A CN 102236913 A CN102236913 A CN 102236913A CN 201110094168 CN201110094168 CN 201110094168 CN 201110094168 A CN201110094168 A CN 201110094168A CN 102236913 A CN102236913 A CN 102236913A
- Authority
- CN
- China
- Prior art keywords
- deformation
- model
- volume mesh
- skin surface
- distortion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Prostheses (AREA)
Abstract
The invention discloses a volumetric mesh deformation method. The method is used for the interactive design of a simulation system for a hump nose plastic surgery; in the system, the Laplace coordinate-based deformation method on surface meshes is popularized to the volumetric meshes, and a high-quality volumetric mesh deformation effect is achieved in a simple and convenient interactive operation mode, so that the geometric detail characteristic and model volume are kept invariant as much as possible; meanwhile, the influence of non-uniform material parameters on deformation is considered fully to achieve a similar effect of physical deformation. In the simulation system for the hump nose plastic surgery, the original input data is computed tomography (CT) scanning volumetric data of patients and is imported into an image segmentation module and a three-dimensional model reconstruction module.
Description
Technical field
The present invention relates to a kind of virtual three-dimensional manikin parametrization and the adjustment by parameter be changed the three-dimensional (3 D) manikin shape, i.e. the volume mesh deformation method of driving parameter skeleton and Soft Tissue Deformation.
Background technology
Simulation for the Nose raising opthopedic operation, most common form is the analogue system that adopts based on morphing, AlterImage Cosmetic Surgery Simulation system as the U.S., this type systematic input patient's side portrait photo, then the nasal area of image is carried out local stretching and torsional deformation. still, the image simulation of two dimension obviously lacks three-dimensional depth information, can not rotate the form of watching any visual angle, simultaneously having little significance for surgical guidance.
For this reason, the minority scholar's research (surface mesh that laser scanning is obtained is out of shape for Free-form Deformation, Nose raising opthopedic surgery systems FFD) based on the Free Transform technology.FFD The deformation calculation amount is little, but needs to make up extra encirclement control mesh, utilizes control mesh that the spatial domain that is comprised is out of shape, inconvenient operation, and deformation effect is controlled the restriction of grid.People such as Lee adopt the volume data deformation technology based on the feature line segment to carry out the augmentation rhinoplasty simulation, are a kind of Embedded spatial domain deformation method equally, and are the same with the FFD distortion, are difficult to the effect of controlled deformation.
Simultaneously, numerous scholar's research is arranged and explored general plastic operation analogue system, what its crucial deformation technology adopted at most is mass spring model and Finite Element Method.The mass spring model is a kind of discrete, particle interaction models of simplifying, realize easily, and calculated amount is less relatively, can carry out mutual even real-time simulation.But,, be that the deformation result precision that calculates is relatively poor to the cost of continuum mechanics designs simplification.The elastic constant of spring determines roughly that often some physical constraints also are difficult to obtain express simultaneously, can not press character just to be difficult to accurately consider in modeling as volume.Finite Element Method is directly to obtain from the continuum mechanics equation inference, can describe the material properties of soft tissue more accurately, and the deformation simulative of the stronger sense of reality is provided.But the calculated amount of Finite Element Method is relatively large, is difficult to carry out real-time, interactive, and simultaneously, the finite element ratio juris is comparatively complicated, is not easy to reach the Numerical Implementation of robust.In addition, the operation of the three-dimensional artificial system that these are general and mutual more complicated are unfavorable for applying.
Summary of the invention
A kind of volume mesh deformation method in providing is provided at the deficiencies in the prior art.
The objective of the invention is to be achieved through the following technical solutions: a kind of volume mesh deformation method, this method are applied to may further comprise the steps in the augmentation rhinoplasty surgery simulation system:
(1) patient's CT scan volume data is imported to the image segmentation and the reconstructing three-dimensional model module of system, utilize automatic and automanual image segmentation algorithm, reconstruct three-dimensional skull model and skin surface model;
(2) tetrahedral grid of the facial soft tissue of generation, when generating volume mesh, system's CT pixel average gray value in each tetrahedron element place soft tissue area of sampling automatically, and adopt the identical mapping algorithm of biomechanics field Finite Element Method, obtain the non-homogeneous material parameter of each tetrahedron element
(3) carry out the three-dimensional head anatomic measurement, on skull model and skin surface model, choose predefined anatomic landmark point, system generates anatomic measurement device commonly used in the Nose raising opthopedic automatically then, comprise various air line distances, vertical line distance, line segment angle or the like, and compare with the standard figures added up in the database, be used to instruct the pre-operative surgical design; Simultaneously, utilize the several anatomic landmark dot generation section on the The midsagittal plane of being arranged in choose, and the two dimension view in section in generating, sample and show the cutting 2-d contour of CT scan data texturing and skin surface model on this plane;
(4) system is provided with automatically and drives the required boundary condition of distortion; Local segment for nasal area in the 2-d contour that section cutting skin surface model obtained during system used fits to SPL, and the reference mark of the SPL that distributes automatically and reasonably, the user can change the shape of control curve easily by operating these reference mark during the back interactive simulation, and is used for driving distortion; On the other hand, the fixed area that the zone with on the contacted inner boundary face of bone model of system's soft tissue volume mesh is set to be out of shape, the position of affiliated net point is constant in the process of distortion;
(5) set the boundary condition zone after, system is integrated matrix of finding the solution distortion automatically
, and carry out Cholesky predecomposition; Subsequently, the user can be arbitrarily on two dimension view operating point control change the shape of control curve, system obtains the reposition of previously defined driving deformation point, the volume mesh apex coordinate after the quick back substitution of system update boundary condition obtains being out of shape by interpolation; On the other hand because the resolution of soft tissue volume mesh is not high and partial model just, system further with the deformation map of volume mesh to complete skin surface model.
The invention has the beneficial effects as follows, volume mesh deformation method of the present invention is when obtaining high-quality volume mesh deformation effect, make it keep geometric detail feature and model constancy of volume as much as possible, simultaneously, take into full account the influence of material parameter heterogeneous, to obtain the effect of similar physical distortion to distortion.This method is applied in the augmentation rhinoplasty surgery simulation system, and the realization of being convenient to operate helps promoting.
Description of drawings
Fig. 1 is the Soft Tissue Deformation process flow diagram based on Laplce's volume mesh deformation method;
Fig. 2 is three-dimensional nose anatomic measurement system figure;
Fig. 3 is for driving the two dimension view of deformation operation;
Fig. 4 is the initial soft tissue volume mesh that generates;
Fig. 5 is the soft tissue volume mesh figure after the augmentation rhinoplasty distortion;
The stacking diagram of the skin surface model of rebuilding from true postoperative CT data that Fig. 6 is good for the skin surface model before the art and registration align;
Fig. 7 is for the skin surface model after the augmentation rhinoplasty distortion with from the stacking diagram of true postoperative skin surface model.
Embodiment
The present invention is generalized to the deformation method based on Laplce's coordinate on the veil lattice on the volume mesh, and step is as follows:
1, the tetrahedral grid with input is expressed as one two tuple
, wherein
It is the point set in the three dimensional euclidean space;
Be an abstract simplicial complex, describe whole adjacency informations of grid, comprise vertex set
, the limit subclass
, the face collection
, and tetrahedron subclass
Laplace operator on the volume mesh is applied to each grid vertex to define volume mesh Laplce coordinate:
2, adopt the weights of the volume mesh Laplace operator of material weighting
, wherein
Be the material parameter of each tetrahedron element, can be used for being provided with of the influence of the inner material properties heterogeneous of physical entity distortion;
Be the limit
Opposite side
The length of side,
Be opposite side
Dihedral angle.
Adopt the matrix-vector form of the overall situation, formula (1) can be expressed as:
Wherein,
It is respectively the vector representation of three components of former grid vertex coordinate and Laplce's coordinate;
The symmetrical sparse linear matrix of expression volume mesh Laplace operator:
3, obvious, if Laplce's coordinate of given volume mesh can be rebuild and the counter world coordinates of asking grid vertex i.e. solving equation system (three components can distinguish separately calculate)
But because the laplace coefficient matrix is non-positive definite, need fix an apex coordinate at least, make equation system that unique solution be arranged as boundary condition.Certainly, the user also needs to be provided with these boundary conditions, to express the intention of its editor and distortion.Adopt the form of soft-constraint to add boundary condition, promptly for each known vertex position
, increase equation
In system,
The weights size of boundary condition can be set.Adopt least square method to find the solution the overdetermined equation system then
4, new system matrix
Be sparse symmetric positive definite matrix, and only with input volume mesh and relevant as the grid vertex sequence number of boundary condition, ought choose fixed area like this and drive deformed region, just can adopt precomputation speed technology based on the Cholesky decomposition, right
Carry out predecomposition.Subsequently, the user can be provided with the position that drives the deformed region grid vertex, the volume mesh apex coordinate after system obtains being out of shape by three quick back substitutions arbitrarily alternately.
Owing to adopted the form of soft-constraint to handle boundary condition,, can also adopt the point on the grid limit except grid vertex
, drive distortion as boundary condition, promptly increase equation
In system, the solution procedure of system is constant.Like this, can adopt the contour curve driving body distortion of the mesh that is defined on the grid easily, be particularly suitable as the interactive operation mode of Nose raising opthopedic operation simulation system.
The performing step that volume mesh deformation method of the present invention is applied to the augmentation rhinoplasty surgery simulation system is as follows:
1, patient's CT scan volume data (DICOM) is imported to the image segmentation and the reconstructing three-dimensional model module of system, utilize automatic and automanual image segmentation algorithm, reconstruct three-dimensional skull model and skin surface model;
2, generate the tetrahedral grid of facial soft tissue, when generating volume mesh, system's CT pixel average gray value in each tetrahedron element place soft tissue area of sampling automatically, and adopt the identical mapping algorithm of biomechanics field Finite Element Method, obtain the non-homogeneous material parameter of each tetrahedron element
3, carry out the three-dimensional head anatomic measurement, on skull model and skin surface model, choose predefined anatomic landmark point, system generates anatomic measurement device commonly used in the Nose raising opthopedic automatically then, comprise various air line distances, vertical line distance, line segment angle or the like, and compare with the standard figures added up in the database, be used to instruct the pre-operative surgical design.Simultaneously, utilize the several anatomic landmark dot generation section on the The midsagittal plane of being arranged in choose, and the two dimension view in section in generating, sample and show the cutting 2-d contour of CT scan data texturing and skin surface model on this plane.
4, system is provided with automatically and drives the required boundary condition of distortion.The core concept here is the left-right symmetric that makes full use of head part's model, particularly for nasal area, the 2-d contour that the section cutting obtained during our experiment was found can drive the distortion that the said three-dimensional body grid is simulated the augmentation rhinoplasty operation very convenient, accurately.Specifically, local segment for nasal area in the 2-d contour that section cutting skin surface model obtained during system used fits to SPL, and the reference mark of the SPL that distributes automatically and reasonably, the user can change the shape of control curve easily by operating these reference mark during the back interactive simulation, and is used for driving distortion.On the other hand, the fixed area that the zone with on the contacted inner boundary face of bone model of system's soft tissue volume mesh is set to be out of shape, the position of affiliated net point is constant in the process of distortion.
5, set the boundary condition zone after, system is the integrated matrix A of finding the solution distortion automatically, and carries out Cholesky predecomposition.Subsequently, the user is the shape of operating point control change control curve on two dimension view arbitrarily, system obtains the reposition of previously defined driving deformation point by interpolation, the volume mesh apex coordinate after the quick back substitution of system update boundary condition obtains being out of shape, as shown in Figure 2.On the other hand because the resolution of soft tissue volume mesh is not high and partial model just, system further with the deformation map of volume mesh to complete skin surface model, as shown in Figure 3.
The foregoing description is used for the present invention that explains, rather than limits the invention, and in the protection domain of spirit of the present invention and claim, any modification and change to the present invention makes all fall into protection scope of the present invention.
Claims (1)
1. a volume mesh deformation method is characterized in that, this method is applied to may further comprise the steps in the augmentation rhinoplasty surgery simulation system:
(1) patient's CT scan volume data is imported to the image segmentation and the reconstructing three-dimensional model module of system, utilize automatic and automanual image segmentation algorithm, reconstruct three-dimensional skull model and skin surface model;
(2) tetrahedral grid of the facial soft tissue of generation, when generating volume mesh, system's CT pixel average gray value in each tetrahedron element place soft tissue area of sampling automatically, and adopt the identical mapping algorithm of biomechanics field Finite Element Method, obtain the non-homogeneous material parameter of each tetrahedron element
(3) carry out the three-dimensional head anatomic measurement, on skull model and skin surface model, choose predefined anatomic landmark point, system generates anatomic measurement device commonly used in the Nose raising opthopedic automatically then, comprise various air line distances, vertical line distance, line segment angle or the like, and compare with the standard figures added up in the database, be used to instruct the pre-operative surgical design; Simultaneously, utilize the several anatomic landmark dot generation section on the The midsagittal plane of being arranged in choose, and the two dimension view in section in generating, sample and show the cutting 2-d contour of CT scan data texturing and skin surface model on this plane;
(4) system is provided with automatically and drives the required boundary condition of distortion; Local segment for nasal area in the 2-d contour that section cutting skin surface model obtained during system used fits to SPL, and the reference mark of the SPL that distributes automatically and reasonably, the user can change the shape of control curve easily by operating these reference mark during the back interactive simulation, and is used for driving distortion; On the other hand, the fixed area that the zone with on the contacted inner boundary face of bone model of system's soft tissue volume mesh is set to be out of shape, the position of affiliated net point is constant in the process of distortion;
(5) set the boundary condition zone after, system is integrated matrix of finding the solution distortion automatically
, and carry out Cholesky predecomposition; Subsequently, the user can be arbitrarily on two dimension view operating point control change the shape of control curve, system obtains the reposition of previously defined driving deformation point, the volume mesh apex coordinate after the quick back substitution of system update boundary condition obtains being out of shape by interpolation; On the other hand because the resolution of soft tissue volume mesh is not high and partial model just, system further with the deformation map of volume mesh to complete skin surface model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110094168 CN102236913A (en) | 2011-04-15 | 2011-04-15 | Volumetric mesh deformation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201110094168 CN102236913A (en) | 2011-04-15 | 2011-04-15 | Volumetric mesh deformation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102236913A true CN102236913A (en) | 2011-11-09 |
Family
ID=44887534
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201110094168 Pending CN102236913A (en) | 2011-04-15 | 2011-04-15 | Volumetric mesh deformation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102236913A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107170009A (en) * | 2017-04-28 | 2017-09-15 | ***广州总医院 | A kind of curved data measuring method of goggles base based on medical image |
| CN107851337A (en) * | 2015-06-29 | 2018-03-27 | 皇家飞利浦有限公司 | Interactive gridding editor |
| CN107920859A (en) * | 2015-08-17 | 2018-04-17 | 皇家飞利浦有限公司 | Simulate breast deformation |
| CN109242789A (en) * | 2018-08-21 | 2019-01-18 | 成都旷视金智科技有限公司 | Image processing method, image processing apparatus and storage medium |
| CN110619683A (en) * | 2019-09-04 | 2019-12-27 | 广东虚拟现实科技有限公司 | Three-dimensional model adjusting method and device, terminal equipment and storage medium |
| CN111105502A (en) * | 2019-10-29 | 2020-05-05 | 王枫 | Biological rib nose and lower jaw simulation plastic technology based on artificial bone repair material |
| CN111839728A (en) * | 2020-07-17 | 2020-10-30 | 哈尔滨理工大学 | Nose plastic simulation method |
| CN114366187A (en) * | 2022-01-17 | 2022-04-19 | 中国中医科学院广安门医院 | Anorectal operation auxiliary system and method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101131730A (en) * | 2007-09-25 | 2008-02-27 | 浙江大学 | Three-dimensional face recognizing method weakening influence of expression changes |
| CN101203861A (en) * | 2005-06-22 | 2008-06-18 | 微软公司 | Large mesh deformation using the volumetric graph laplacian |
| CN101826217A (en) * | 2010-05-07 | 2010-09-08 | 上海交通大学 | Rapid generation method for facial animation |
| CN101916454A (en) * | 2010-04-08 | 2010-12-15 | 董洪伟 | Method for reconstructing high-resolution human face based on grid deformation and continuous optimization |
-
2011
- 2011-04-15 CN CN 201110094168 patent/CN102236913A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101203861A (en) * | 2005-06-22 | 2008-06-18 | 微软公司 | Large mesh deformation using the volumetric graph laplacian |
| CN101131730A (en) * | 2007-09-25 | 2008-02-27 | 浙江大学 | Three-dimensional face recognizing method weakening influence of expression changes |
| CN101916454A (en) * | 2010-04-08 | 2010-12-15 | 董洪伟 | Method for reconstructing high-resolution human face based on grid deformation and continuous optimization |
| CN101826217A (en) * | 2010-05-07 | 2010-09-08 | 上海交通大学 | Rapid generation method for facial animation |
Non-Patent Citations (1)
| Title |
|---|
| 《Computer Animation and Virtual Worlds》 20100524 Shenghui Liao et. al Inhomogeneous volumetric laplacian deformation for rhinoplasty planning and simulation system 第21卷, * |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107851337A (en) * | 2015-06-29 | 2018-03-27 | 皇家飞利浦有限公司 | Interactive gridding editor |
| CN107920859B (en) * | 2015-08-17 | 2020-12-08 | 皇家飞利浦有限公司 | Simulating breast deformation |
| CN107920859A (en) * | 2015-08-17 | 2018-04-17 | 皇家飞利浦有限公司 | Simulate breast deformation |
| US11246660B2 (en) | 2015-08-17 | 2022-02-15 | Koninklijke Philips N.V. | Simulating breast deformation |
| CN107170009A (en) * | 2017-04-28 | 2017-09-15 | ***广州总医院 | A kind of curved data measuring method of goggles base based on medical image |
| CN107170009B (en) * | 2017-04-28 | 2021-04-20 | ***广州总医院 | Medical image-based goggle base curve data measurement method |
| CN109242789A (en) * | 2018-08-21 | 2019-01-18 | 成都旷视金智科技有限公司 | Image processing method, image processing apparatus and storage medium |
| CN110619683A (en) * | 2019-09-04 | 2019-12-27 | 广东虚拟现实科技有限公司 | Three-dimensional model adjusting method and device, terminal equipment and storage medium |
| CN110619683B (en) * | 2019-09-04 | 2023-07-14 | 广东虚拟现实科技有限公司 | Three-dimensional model adjustment method, device, terminal equipment and storage medium |
| CN111105502A (en) * | 2019-10-29 | 2020-05-05 | 王枫 | Biological rib nose and lower jaw simulation plastic technology based on artificial bone repair material |
| CN111839728A (en) * | 2020-07-17 | 2020-10-30 | 哈尔滨理工大学 | Nose plastic simulation method |
| CN114366187A (en) * | 2022-01-17 | 2022-04-19 | 中国中医科学院广安门医院 | Anorectal operation auxiliary system and method |
| CN114366187B (en) * | 2022-01-17 | 2022-08-23 | 中国中医科学院广安门医院 | Anorectal operation auxiliary system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102236913A (en) | Volumetric mesh deformation method | |
| CN106023288B (en) | A kind of dynamic scapegoat's building method based on image | |
| CN103208133B (en) | The method of adjustment that in a kind of image, face is fat or thin | |
| CN100562895C (en) | A kind of method of the 3 D face animation based on Region Segmentation and speced learning | |
| Delingette et al. | Craniofacial surgery simulation testbed | |
| CN102525662B (en) | Three-dimensional visual tissue organ operation navigation system | |
| US20220198954A1 (en) | Vision-haptics fused augmented reality simulator for dental surgical skill training | |
| CN101882326A (en) | Three-dimensional craniofacial reconstruction method based on overall facial structure shape data of Chinese people | |
| CN105938627A (en) | Processing method and system for virtual plastic processing on face | |
| CN106952336B (en) | Feature-preserving human three-dimensional head portrait production method | |
| CN106504329B (en) | Gum deformation simulation method based on mass point spring model of tooth long axis | |
| KR20160004865A (en) | The face model generation method for the Dental procedure simulation | |
| CN110782528A (en) | Free deformation human face shaping simulation method, system and storage medium | |
| CN110148209A (en) | Manikin generation method, image processing equipment and the device with store function | |
| CN102034272B (en) | Generating method of individualized maxillofacial soft tissue hexahedral mesh | |
| CN109431632B (en) | Method for simulating gum deformation | |
| CN103700130A (en) | Method for generating lattice animation of vocal organs | |
| Adams et al. | Development and evaluation of an immersive virtual reality system for medical imaging of the ear | |
| CN111105502A (en) | Biological rib nose and lower jaw simulation plastic technology based on artificial bone repair material | |
| Mahoney et al. | Computer-generated facial depiction | |
| CN117113452A (en) | Muscle model, construction method thereof and motion simulation method | |
| CN104318615B (en) | Vocal organ three-dimensional modeling method | |
| CN114267219B (en) | Virtual operation simulation device and simulation system | |
| Furqan et al. | Surface-based virtual dental surgical simulator using haptic display | |
| Cheng et al. | Facial morphology prediction after complete denture restoration based on principal component analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20111109 |