CN107578467B

CN107578467B - Three-dimensional modeling method and device for medical instrument

Info

Publication number: CN107578467B
Application number: CN201710785574.8A
Authority: CN
Inventors: 姜峰; 张帆; 姜浩天
Original assignee: Suzhou Yingnuomai Medical Innovation Services Co ltd
Current assignee: Suzhou Yingnuomai Medical Innovation Services Co ltd
Priority date: 2017-09-04
Filing date: 2017-09-04
Publication date: 2020-12-29
Anticipated expiration: 2037-09-04
Also published as: CN107578467A

Abstract

The invention provides a three-dimensional modeling method and a three-dimensional modeling device for medical instruments, wherein the method comprises the following steps: according to view information of a medical instrument to be modeled, constructing an initial model of the medical instrument to be modeled; determining at least one sub-model according to the initial model; carrying out modeling processing on each sub-model; combining the sub-models after modeling treatment to form an integral model; and carrying out surface reduction operation on the overall model according to the application scene to form a final model aiming at the application scene. Therefore, the scheme provided by the invention can reduce the data volume of the three-dimensional model of the medical instrument.

Description

Three-dimensional modeling method and device for medical instrument

Technical Field

The invention relates to the technical field of image processing, in particular to a medical instrument three-dimensional modeling method and device.

Background

With the rapid development of three-dimensional virtual technology, in order to publicize its own products, each enterprise generally uses three-dimensional virtual technology to make the products into three-dimensional models. And then transplanting the three-dimensional model into the internet to display each product.

At present, the method for making a three-dimensional model of a product is generally as follows: and directly importing the view information related to the product into three-dimensional modeling software such as 3 dmax. And then the service personnel make the view information into a three-dimensional model according to drawing experience. However, in order to restore the appearance of the product to a high degree, the data volume of the manufactured three-dimensional model is huge, so that the model occupies a larger memory, rendering time and animation manufacturing time are longer, and the mortgage effect is obvious when the three-dimensional model is browsed.

Disclosure of Invention

The embodiment of the invention provides a medical instrument three-dimensional modeling method and device, which can reduce the data volume of a medical instrument three-dimensional model.

In a first aspect, an embodiment of the present invention provides a medical apparatus three-dimensional modeling method, where the method includes:

according to view information of a medical instrument to be modeled, constructing an initial model of the medical instrument to be modeled;

determining at least one sub-model according to the initial model;

carrying out modeling processing on each sub-model;

combining the sub-models after modeling treatment to form an integral model;

and carrying out surface reduction operation on the overall model according to the application scene to form a final model aiming at the application scene.

Preferably, the first and second electrodes are formed of a metal,

the constructing of the initial model of the medical instrument to be modeled according to the view information of the medical instrument to be modeled comprises the following steps:

determining all objects included in the view information;

extracting structural data of each object from the view information;

and constructing an initial model of the medical instrument to be modeled according to the extracted structural data of each object.

Preferably, the first and second electrodes are formed of a metal,

the determining at least one sub-model according to the initial model comprises:

constructing a three-dimensional coordinate system, and placing the initial model in the three-dimensional coordinate system;

determining each part with a connection relation included in the initial model;

delineating a UV normal to each of the parts;

judging whether the total amount of the UV normal lines corresponding to each part is larger than a preset number threshold value or not;

when the total quantity of the UV normal lines corresponding to the current component is judged to be larger than the quantity threshold value, determining the current component as a sub-model;

when the total quantity of the UV normal lines corresponding to the current component is judged to be not larger than the quantity threshold value, continuously judging whether the current component needs to be provided with an animation effect or not, and if so, determining the current component as a sub-model; otherwise, determining the current component as a module in the combined model;

and determining the combined model as a sub-model.

Preferably, the first and second electrodes are formed of a metal,

the modeling processing of each sub-model comprises:

and executing each submodel, baking each UV line of a part corresponding to the current submodel into a white mold, carrying out mapping treatment on the white mold, and carrying out visual effect adjustment on the white mold after mapping treatment.

Preferably, the first and second electrodes are formed of a metal,

the combination of the sub-models after modeling processing comprises:

determining components corresponding to the sub-models respectively;

and combining the submodels according to the connection relation of the components.

Preferably, the first and second electrodes are formed of a metal,

the performing a face reduction operation on the overall model according to the application scenario to form a final model for the application scenario includes:

determining all vertices in the integral model;

determining edges between each of the vertices;

determining at least one collapse edge in each edge according to the application scene;

and collapsing each collapse edge to form the final model aiming at the application scene.

Preferably, the first and second electrodes are formed of a metal,

determining at least one collapse edge in each edge according to the application scene, wherein the step comprises the following steps:

determining a collapse threshold according to the application scene;

determining a first endpoint and a second endpoint corresponding to each edge;

for each of the edges, determining a first set of triangles in the overall model that includes a first endpoint of the current edge, determining a second set of triangles in the overall model that includes both the first endpoint and a second endpoint of the current edge;

calculating a collapse value corresponding to each edge through formula (1);

wherein, c isost(u，v)_nCharacterizing a collapse value for the nth of said edges; the u represents the coordinates of the first endpoint of the nth edge; the v represents the coordinates of the second endpoint of the nth edge; the Tu characterizes a first set of triangles; the Tuv characterizes a second set of triangles; normal characterizes the first normal; normal characterizes the second normal;

and executing aiming at each edge, judging whether the collapse value corresponding to the current edge is larger than the collapse threshold value, and if so, determining that the current edge is a collapse edge.

Preferably, the first and second electrodes are formed of a metal,

the view information includes: at least one image video, and/or at least one picture.

In a second aspect, an embodiment of the present invention provides a three-dimensional modeling apparatus for a medical device, the apparatus including:

the construction module is used for constructing an initial model of the medical instrument to be modeled according to the view information of the medical instrument to be modeled;

the determining module is used for determining at least one sub-model according to the initial model constructed by the constructing module;

the modeling processing module is used for modeling each sub-model determined by the determining module;

the combination module is used for combining the submodels modeled by the modeling processing module to form an integral model;

and the surface reducing module is used for carrying out surface reducing operation on the integral model formed by the combined module according to the application scene to form a final model aiming at the application scene.

Preferably, the first and second electrodes are formed of a metal,

the building module comprises: an extraction unit and a construction unit;

the extracting unit is used for determining all objects included in the view information; extracting structural data of each object from the view information;

the construction unit is used for constructing an initial model of the medical instrument to be modeled according to the structural data of each object extracted by the extraction unit.

Preferably, the first and second electrodes are formed of a metal,

the determining module includes: the device comprises a drawing unit, a first determining unit, a second determining unit and a third determining unit;

the delineation unit is used for constructing a three-dimensional coordinate system and placing the initial model in the three-dimensional coordinate system; determining each part with a connection relation included in the initial model; delineating a UV normal to each of the parts;

the first determining unit is used for judging whether the total amount of the UV normal lines corresponding to each component is larger than a preset number threshold value or not; when the total quantity of the UV normal lines corresponding to the current component is judged to be larger than the quantity threshold value, determining the current component as a sub-model; when the total quantity of the UV normals corresponding to the current component is judged to be not larger than the quantity threshold value, triggering the second determining unit;

the second determining unit is used for continuously judging whether the current component needs to be provided with an animation effect or not under the trigger of the first determining unit, and if so, determining the current component as a sub-model; otherwise, determining the current component as a module in the combined model;

the third determining unit is used for determining the combined model as a sub-model.

Preferably, the first and second electrodes are formed of a metal,

the face reducing module comprises: an edge determining unit and a collapse unit;

the edge determining unit is used for determining all vertexes in the whole model; determining edges between each of the vertices;

the collapse unit is used for determining at least one collapse edge in each edge according to the application scene; and collapsing each collapse edge to form the final model aiming at the application scene.

Preferably, the first and second electrodes are formed of a metal,

when the determining module comprises: when the drawing unit, the first determining unit, the second determining unit and the third determining unit are used,

the modeling processing module is used for executing each sub-model, baking each UV line of a part corresponding to the current sub-model into a white mold, performing mapping processing on the white mold, and performing visual effect adjustment on the white mold after mapping processing.

Preferably, the first and second electrodes are formed of a metal,

the combination module is used for determining parts corresponding to the submodels respectively; and combining the submodels according to the connection relation of the components.

Preferably, the first and second electrodes are formed of a metal,

when the de-contouring module includes an edge determining cell and a collapsing cell,

the collapse unit comprises: determining a subunit, calculating the subunit and determining the subunit by a collapse edge;

the determining subunit is configured to determine a collapse threshold according to the application scenario; determining a first endpoint and a second endpoint corresponding to each edge; for each of the edges, determining a first set of triangles in the overall model that includes a first endpoint of the current edge, determining a second set of triangles in the overall model that includes both the first endpoint and a second endpoint of the current edge;

the calculating subunit is configured to calculate, according to formula (1), a collapse value corresponding to each of the edges;

wherein, the cost (u, v)_nCharacterizing a collapse value for the nth of said edges; the u represents the coordinates of the first endpoint of the nth edge; the v represents the coordinates of the second endpoint of the nth edge; the Tu characterizes a first set of triangles; the Tuv characterizes a second set of triangles; normal characterization of theA first normal line; normal characterizes the second normal;

and the collapse edge determining subunit is configured to execute for each edge, determine whether a collapse value corresponding to the current edge is greater than the collapse threshold, and if so, determine that the current edge is a collapse edge.

The embodiment of the invention provides a three-dimensional modeling method and a three-dimensional modeling device for a medical instrument. And then determining a certain number of sub models in the initial model, and respectively carrying out modeling processing on each sub model. And after the modeling treatment of each sub-model is finished, combining the sub-models subjected to modeling treatment to form an integral model. And then, carrying out surface reduction operation on the whole model according to the application scene to form a final model aiming at the application scene. According to the modeling method, each sub-model is subjected to independent modeling processing in the medical instrument modeling process. And after combining the sub-models subjected to modeling processing to form an integral model, carrying out surface reduction operation on the integral model according to an application scene so as to reduce the number of surfaces in the three-dimensional model. Therefore, the data volume of the three-dimensional model of the medical instrument can be reduced by the scheme provided by the embodiment of the invention.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a flow chart of a method for three-dimensional modeling of a medical device according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an overall model including partial edges according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of an overall model including partial edges after a face reduction operation is performed according to an embodiment of the present invention;

FIG. 4 is a flow chart of a method for three-dimensional modeling of a medical device according to another embodiment of the invention;

fig. 5 is a hardware structure diagram of a device in which a three-dimensional modeling apparatus for medical instruments according to an embodiment of the present invention is provided;

FIG. 6 is a schematic structural diagram of a three-dimensional modeling apparatus for a medical device according to an embodiment of the invention;

FIG. 7 is a schematic structural diagram of a three-dimensional modeling apparatus for a medical device, which includes an extracting unit and a constructing unit according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a three-dimensional modeling apparatus for a medical device according to another embodiment of the invention;

fig. 9 is a schematic structural diagram of a three-dimensional modeling apparatus for a medical device, which includes an edge determination unit and a collapse unit according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of a three-dimensional modeling apparatus for a medical device according to yet another embodiment of the invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer and more complete, the technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention, and based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts belong to the scope of the present invention.

As shown in fig. 1, an embodiment of the present invention provides a three-dimensional modeling method for a medical device, which may include the following steps:

step 101: according to view information of a medical instrument to be modeled, constructing an initial model of the medical instrument to be modeled;

step 102: determining at least one sub-model according to the initial model;

step 103: carrying out modeling processing on each sub-model;

step 104: combining the sub-models after modeling treatment to form an integral model;

step 105: and carrying out surface reduction operation on the overall model according to the application scene to form a final model aiming at the application scene.

According to the embodiment shown in fig. 1, an initial model of the medical instrument to be modeled is first constructed from view information of the medical instrument to be modeled. And then determining a certain number of sub models in the initial model, and respectively carrying out modeling processing on each sub model. And after the modeling treatment of each sub-model is finished, combining the sub-models subjected to modeling treatment to form an integral model. And then, carrying out surface reduction operation on the whole model according to the application scene to form a final model aiming at the application scene. According to the modeling method, each sub-model is subjected to independent modeling processing in the medical instrument modeling process. And after combining the sub-models subjected to modeling processing to form an integral model, carrying out surface reduction operation on the integral model according to an application scene so as to reduce the number of surfaces in the three-dimensional model. Therefore, the data volume of the three-dimensional model of the medical instrument can be reduced by the scheme provided by the embodiment of the invention.

In an embodiment of the present invention, the type of the medical device to be modeled in the flowchart shown in fig. 1 may be determined according to business requirements. Such as a B-ultrasonic diagnostic apparatus.

In an embodiment of the present invention, the view information related to step 101 in the flowchart shown in fig. 1 may include: at least one image video, and/or at least one picture.

In the embodiment, the image video, the number of pictures and the picture type can be determined according to the service requirement. It should be noted that, in order to improve the fidelity of the initial model to the medical device to be modeled, the image video and the picture should include the orientation images of the medical device to be modeled.

In this embodiment, the specific content included in the view information may be determined according to the following principle:

when no movable part exists in the medical device to be modeled, the view information can comprise at least one image video of the medical device to be modeled and/or at least one picture of the medical device to be modeled.

Secondly, when the movable part exists in the medical apparatus to be modeled, the view information needs to include views of all directions of the medical apparatus to be modeled, an image video of the action of the movable part, at least one picture of the movable part and at least one picture of the medical apparatus to be modeled.

The following description will be given taking the acquisition of view information of the medical instrument a as an example: the medical device a includes a movable member a. First, a field image of the medical instrument a is taken, and views of the medical instrument a in various orientations are acquired. Such as a front view, a side view, a top view, etc. And then, recording a video of the movable part a, wherein the recorded video comprises the operating states of all the orientations of the movable part a.

According to the above embodiment, the content included in the view information may select either one or both of the image video and the picture according to the service requirement. Because the image video or the picture comprises the characteristics of the medical instrument to be modeled, the model is constructed according to the view information, and the reduction degree of the medical instrument to be modeled can be improved.

In an embodiment of the present invention, the application scenario referred to in the flowchart shown in fig. 1 includes network configuration information and/or hardware configuration information. The network configuration information may include a network speed, among others. The hardware configuration information may include the processing speed of the cpu, the memory size, the hard disk size, and the like.

In an embodiment of the present invention, the constructing, in step 101 of the flowchart shown in fig. 1, an initial model of a medical device to be modeled according to view information of the medical device to be modeled may include:

determining all objects included in the view information;

extracting structural data of each object from the view information;

In this embodiment, each pixel included in the view information is acquired, and each contour line is determined according to a pixel value of each pixel. And then, drawing an image according to each contour line, and determining each object included in the view information according to the drawn image. After each object in the view information is determined, the section and section information included in each object is obtained from the view information. And then, rotating and stretching the section and the section to construct an initial model of the medical instrument to be modeled.

According to the embodiment, all objects included in the view information of the medical instrument to be modeled are determined, and then the initial model of the medical instrument to be modeled is constructed according to the structural data of each object. Because the initial model of the medical instrument to be modeled is constructed according to the structural data, the matching degree of the initial model and the medical instrument to be modeled is higher.

In an embodiment of the present invention, the step 102 of the flowchart shown in fig. 1 for determining at least one sub-model according to the initial model may include:

determining each part with a connection relation included in the initial model;

delineating a UV normal to each of the parts;

and determining the combined model as a sub-model.

In the present embodiment, a three-dimensional coordinate system is constructed, wherein the X-axis corresponds to the U-axis, the Y-axis corresponds to the V-axis, and the Z-axis corresponds to the W-axis. The UV normal is the UV axis coordinate normal. And after the three-dimensional coordinate system is constructed, placing the initial model of the medical instrument to be modeled in the three-dimensional coordinate system.

In this embodiment, at least two methods of determining the components having the connection relationship included in the initial model may exist:

the first method comprises the following steps: acquiring coordinates of each connecting position input from the outside, and determining each part with a connecting relation according to each coordinate;

and the second method comprises the following steps: and determining each contour line included in the initial model, and determining each part with a connection relation according to each contour line.

In this embodiment, each vertex in the initial model is determined, and the UV coordinates of each vertex are determined according to the three-dimensional coordinate system. And then drawing the UV normal of each part according to each UV coordinate. And when the UV normal line sketching of each part is finished, counting the total amount of the UV normal lines corresponding to each part. And then judging the relation between the total amount of the UV normal lines corresponding to each part and a preset number threshold value.

In this embodiment, when it is determined that the total amount of the UV normals corresponding to the current component is greater than the number threshold, it indicates that the structure of the current component is complex. It needs to be split from the initial model to increase the speed of the modeling process. The current component is thus determined as a submodel.

In this embodiment, when it is determined that the total amount of the UV normals corresponding to the current component is not greater than the quantity threshold, it is indicated that the structural complexity of the current component is low, and it is necessary to continuously determine whether the current component needs to set an animation effect. When the animation effect needs to be set on the current component, the current component is split and processed and is independently placed in a fixed position to make the animation effect. And when the current part does not need to set the animation effect, determining the current part as a module in the combined model. And when the relation between the total UV normal amount corresponding to each component and the preset amount threshold is judged to be finished, determining the combined model as a sub-model so as to perform independent modeling processing on the sub-model.

According to the above-described embodiment, the respective components having the connection relationship included in the initial model are first determined. Then, the UV normal of each part is sketched, and the total amount of the UV normal of each part is counted. And splitting the initial model by judging the relation between the total amount of the UV normal of each part and a preset quantity threshold value and judging whether each part needs to set an animation effect. So as to carry out modeling processing on each sub-model, thereby reducing the complexity of the modeling processing.

In an embodiment of the present invention, the modeling, performed by the step 103 in the flowchart shown in fig. 1, of each sub-model may include:

In this embodiment, the following description will be made by taking one sub-model as an example: the corresponding part was baked into a white mold according to the respective UV lines included. And then determining at least one mapping area in the sub-model, and determining mapping information corresponding to each mapping area according to the view information. And determining the map corresponding to each map area according to the map information, and placing each map in the corresponding map area, thereby completing the map processing of the sub-model. And after the image sticking processing is finished, the visual effect of the sub-model is adjusted by adopting the processing of materials, light, shadow and the like. Thereby completing the modeling process of the sub-model.

According to the embodiment, the UV lines of the parts corresponding to the sub models are baked into the white mold, then the obtained white mold is subjected to mapping treatment, and the visual effect of the white mold after mapping treatment is adjusted. Because the modeling processing process of each sub-model is carried out independently, the targeted modeling processing can be carried out according to the characteristics of each sub-model.

In an embodiment of the present invention, the combining the sub-models after the modeling process in step 104 of the flowchart shown in fig. 1 may include:

determining components corresponding to the sub-models respectively;

In the present embodiment, at least two methods of combining the respective submodels according to the connection relationship of the respective components may exist:

the first method comprises the following steps: and acquiring coordinates of each connecting position input from the outside, and determining the connecting relation among the components according to the coordinates. And then combining the sub models according to the connection relation and the coordinates.

And the second method comprises the following steps: determining each contour line included in each submodel, determining each part with a connection relation according to each contour line, and then combining each submodel according to the connection relation and each contour line.

In this embodiment, the combining process of each sub-model may be: the submodels are combined in sequence. For example, submodel 1, submodel 2, and submodel 3 are present. The submodel 1 and the submodel 2 are combined together, and then the submodel 1 and the submodel 2 are adjusted according to the connecting position of the submodel 1 and the submodel 2 and the transition condition of the contour line of the connecting part, so that the optimal combination state is achieved. And then combining the submodel 3 with the combined submodel 1 and submodel 2.

According to the embodiment, parts corresponding to each submodel are firstly determined, and then the submodels are combined to form an integral model according to the connection relation of the parts, so that the integral model is obtained, and the medical instrument to be modeled is restored by using the integral model.

In an embodiment of the present invention, the performing, in step 105 of the flowchart shown in fig. 1, a surface reduction operation on the overall model according to an application scenario to form a final model for the application scenario may include:

determining all vertices in the integral model;

determining edges between each of the vertices;

In the present embodiment, all vertices included in the entire model are first determined in the three-dimensional coordinate system, and then the respective vertices are connected, respectively, thereby forming the respective edges. And then determining each collapse margin according to the network configuration information and/or the hardware configuration information in the application scene, and collapsing each determined collapse margin, thereby forming a final model for the application scene.

It should be noted that, when determining at least one collapse edge according to an application scenario, the fidelity of the application scenario and a model is considered comprehensively to ensure that a final model can meet the requirements of the application scenario and the fidelity at the same time. In addition, the determined collapsed edge should be one that does not disrupt the overall model structure.

For example, when the application scene is a mobile phone end, a final model meeting the requirements of the mobile phone end is manufactured. Because the current display card and hardware configuration of the mobile phone is low, and the running speed is low, a low-standard model is generally used. Among them, the number of sides undergoing collapse is large in the low standard model.

For example, when the application scene is a web page end, a final model satisfying the web page end is created. Because the network downloading speed of each user is different, a large amount of surface reduction operations are generally used, and a low-standard model is manufactured to improve the network running speed.

For example, when the application scene is a next-generation game (local game) and local running software, a final model satisfying the local running is created. Because the computer display card and the hardware are higher in configuration and higher in running speed, and can bear higher models, the standard models are generally used. Wherein, the number of edges of the middle standard model for collapse is less.

For example, when the application scene is a CG animation, a final model satisfying the CG animation is created. In order to ensure animation quality without considering hardware configuration problems, a high-precision model or an extremely high-precision model is used to improve animation quality. The number of edges of the high-standard model subjected to collapse is small.

According to the above embodiment, at least one slump is determined in the overall model according to the application scenario. Each collapsed edge is then collapsed, forming a final model for the application scenario. Since the whole model is subjected to the face reduction operation by using the collapsed edges, the size of the data volume in the model is reduced.

In an embodiment of the present invention, the steps in the above embodiment: determining at least one collapsed collapse edge in each of the edges according to the application scenario may include:

determining a collapse threshold according to the application scene;

determining a first endpoint and a second endpoint corresponding to each edge;

calculating a collapse value corresponding to each edge through formula (1);

wherein, the cost (u, v)_nCharacterizing a collapse value for the nth of said edges; the u represents the coordinates of the first endpoint of the nth edge; the v represents the coordinates of the second endpoint of the nth edge; the Tu characterizes a first set of triangles; the Tuv characterizes a second set of triangles; normal characterizes the first normal; normal characterizes the second normal;

In this embodiment, the determination of the collapse edge is described below by taking a part of the whole model as an example: as shown in fig. 2, there are 15 edges in fig. 2, and then two end points of each edge are determined. For example, the first end point of the edge UV is determined as U and the second end point is determined as V. Take edge UV as an example: determining, in the overall model, a first set of triangles including the first endpoint U as: 201. 202, 206, 207 and 208. Determining, in the overall model, a second set of triangles including the first endpoint U and the second endpoint V as: 202 and 206. The coordinates of the first endpoint U and the second endpoint V are determined. The collapse value of the edge UV is then calculated from the first set of triangles, the second set of triangles, and equation (1). And comparing the collapse value of the edge UV with a preset collapse threshold, for example, determining that the collapse value of the edge UV is greater than the collapse threshold after comparison, and determining that the edge UV is a collapse edge.

In this embodiment, when the edge UV is determined to be a collapse edge, the collapse operation is performed on the edge UV. Wherein the collapsing operation may be: the edge UV is subtracted such that the first end point U and the second end point V coincide, resulting in the result shown in fig. 3. As can be seen in fig. 3, after subtracting the side UV,

triangles

201 and 202 merge into 201A,

triangles

206 and 207 merge into 207A, and the first endpoint U and the second endpoint V coincide as endpoint V.

In this embodiment, the collapse threshold may be determined according to a specific service. However, it should be noted that the collapse threshold value is to consider the fidelity of the application scenario and the model together to ensure that the final model can satisfy the requirements of both the application scenario and the fidelity.

According to the embodiment, the collapse value of each edge in the overall model is calculated firstly, then each collapse value is compared with the preset collapse threshold value, and each collapse edge is determined according to the comparison result. Therefore, the determination of the collapse edge is more accurate.

The following takes a medical device a with a movable component as an example, and further details the three-dimensional modeling method of a medical device provided by the embodiment of the present invention, as shown in fig. 4, the method may include the following steps:

step 401: and acquiring view information of the medical instrument to be modeled.

In this step, the view information includes pictures of each orientation of the medical apparatus a to be modeled, an image video of the motion of the movable part in the medical apparatus a, and pictures of each orientation of the movable part.

Step 402: all objects included in the view information are determined.

In this step, each pixel point included in each view information is acquired, and each contour line is determined according to the pixel value of each pixel point. And then, drawing an image according to each contour line, and determining each object included in the view information according to the drawn image.

Step 403: the structure data of each object is extracted from the view information.

In this step, the section and section information included in each object are acquired from the view information.

Step 404: and constructing an initial model of the medical instrument to be modeled according to the extracted structural data of each object.

In this step, an initial model of the medical instrument a is constructed by performing rotation and stretching processing on the cut surfaces and the cross sections using the respective pieces of configuration data extracted in step 403.

Step 405: and constructing a three-dimensional coordinate system, and placing the initial model in the three-dimensional coordinate system.

In the step, a three-dimensional coordinate system is constructed, wherein an X axis in the three-dimensional coordinate system corresponds to a U axis, a Y axis in the three-dimensional coordinate system corresponds to a V axis, and a Z axis in the three-dimensional coordinate system corresponds to a W axis. And placing the initial model in the constructed three-dimensional coordinate system.

Step 406: determining the components with connection relations included in the initial model.

In this step, coordinates of each connection position externally input are acquired, and each component having a connection relationship is determined from each coordinate.

Step 407: the UV normal of each part is outlined.

In this step, each vertex in the initial model is determined, and the UV coordinates of each vertex are determined according to the three-dimensional coordinate system. And then drawing the UV normal of each part according to each UV coordinate.

Step 408: one component is selected as the current component in each component in turn.

Step 409: judging whether the total amount of the UV normal corresponding to the current component is larger than a preset number threshold, if so, executing a step 411; otherwise, step 410 is performed.

Step 410: judging whether the current component needs to set an animation effect, if so, executing a step 411; otherwise, step 412 is performed.

Step 411: the current component is determined to be a sub-model and 413 is performed.

Step 412: the current component is determined as a module in the combined model.

Step 413: judging whether the current component is the last component, if so, executing step 414; otherwise, step 408 is performed.

Step 414: the combined model is determined as a sub-model.

In this step, when the relationship between the total amount of UV normals corresponding to each component and the preset number threshold is determined, the combined model is determined as a sub-model to be subjected to a separate modeling process.

Step 415: and executing each submodel, baking each UV line of the part corresponding to the current submodel into a white mold, carrying out mapping treatment on the white mold, and carrying out visual effect adjustment on the white mold after mapping treatment.

In this step, a sub-model is described as an example below: the corresponding part was baked into a white mold according to the respective UV lines included. And then determining at least one mapping area in the sub-model, and determining mapping information corresponding to each mapping area according to the view information. And determining the map corresponding to each map area according to the map information, and placing each map in the corresponding map area, thereby completing the map processing of the sub-model. And after the image sticking processing is finished, the visual effect of the sub-model is adjusted by adopting the processing of materials, light, shadow and the like.

Step 416: and determining parts corresponding to the sub models after modeling.

Step 417: and combining the submodels according to the connection relation of the components to form an integral model.

In this step, coordinates of each connection position externally input are acquired, and the connection relationship between each component is determined based on each coordinate. And then combining the sub models according to the connection relation and the coordinates.

Step 418: all vertices in the overall model are determined.

In this step, all vertices included in the overall model are determined in the three-dimensional coordinate system.

Step 419: edges between the vertices are determined.

In this step, the vertices determined in step 418 are connected to form edges, respectively.

Step 420: a collapse threshold is determined according to the application scenario.

In this step, the determined collapse threshold value should comprehensively consider the fidelity of the application scenario and the model, so as to ensure that the final model can simultaneously meet the requirements of the application scenario and the fidelity. Such as 20.

Step 421: and determining a first endpoint and a second endpoint corresponding to each edge.

In this step, which is illustrated by taking fig. 2 as an example, there are 15 edges in fig. 2, and then two end points of each edge are determined. For example, the first end point of the edge UV is determined as U and the second end point is determined as V.

Step 422: for each edge, a first set of triangles is determined in the overall model that includes the first endpoint of the current edge, and a second set of triangles is determined in the overall model that includes both the first endpoint and the second endpoint of the current edge.

In this step, taking fig. 2 as an example for explanation, the first triangle set including the first endpoint U is determined in the overall model as: 201. 202, 206, 207 and 208. Determining, in the overall model, a second set of triangles including the first endpoint U and the second endpoint V as: 202 and 206.

Step 423: and calculating the corresponding collapse value of each edge.

In this step, the collapse value of the edge UV is calculated according to the first triangle set, the second triangle set, and formula (1).

Step 424: and selecting sides with the collapse values larger than the preset collapse threshold value from the sides, and determining the selected sides as collapse sides.

Step 425: and collapsing each collapsed edge to form a final model for the application scene.

In this step, the collapse operation is performed on the edge UV when the edge UV is determined to be the collapse edge, as illustrated in fig. 3. Wherein the collapsing operation may be: the edge UV is subtracted such that the first end point U and the second end point V coincide, resulting in the result shown in fig. 3. As can be seen in fig. 3, after subtracting the side UV,

triangles

201 and 202 merge into 201A,

triangles

As shown in fig. 5 and 6, the embodiment of the invention provides a three-dimensional modeling device for a medical instrument. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. From a hardware level, as shown in fig. 5, a hardware structure diagram of a device in which a three-dimensional modeling apparatus for medical equipment provided in an embodiment of the present invention is located is shown, where in addition to the processor, the memory, the network interface, and the nonvolatile memory shown in fig. 5, the device in the embodiment may also include other hardware, such as a forwarding chip responsible for processing a message. Taking a software implementation as an example, as shown in fig. 6, as a logical apparatus, the apparatus is formed by reading, by a CPU of a device in which the apparatus is located, corresponding computer program instructions in a non-volatile memory into a memory for execution. The three-dimensional modeling device for the medical instrument provided by the embodiment comprises:

the building module 601 is used for building an initial model of the medical instrument to be modeled according to the view information of the medical instrument to be modeled;

a determining module 602, configured to determine at least one sub-model according to the initial model constructed by the constructing module 601;

a modeling processing module 603, configured to perform modeling processing on each of the sub-models determined by the determining module 602;

a combination module 604, configured to combine the sub-models modeled by the modeling processing module 603 to form an overall model;

a face reducing module 605, configured to perform a face reducing operation on the overall model formed by the combining module 404 according to an application scenario, so as to form a final model for the application scenario.

According to the embodiment shown in fig. 6, an initial model of the medical instrument to be modeled is first constructed by the construction module according to the view information of the medical instrument to be modeled. And then the determining module determines each sub-model according to the initial model constructed by the constructing module. And the modeling processing module carries out modeling processing on each sub-model. And the combination module combines each sub-model after modeling into an integral model. And the face reducing module performs face reducing operation on the whole model according to the application scene to form a final model aiming at the application scene. According to the modeling method, each sub-model is subjected to independent modeling processing in the medical instrument modeling process. And after combining the sub-models subjected to modeling processing to form an integral model, carrying out surface reduction operation on the integral model according to an application scene so as to reduce the number of surfaces in the three-dimensional model. Therefore, the data volume of the three-dimensional model of the medical instrument can be reduced by the scheme provided by the embodiment of the invention.

In an embodiment of the present invention, as shown in fig. 7, the building module 601 may include: an extraction unit 701 and a construction unit 702;

the extracting unit 701 is configured to determine all objects included in the view information; extracting structural data of each object from the view information;

the building unit 702 is configured to build an initial model of the medical instrument to be modeled according to the structural data of each object extracted by the extracting unit 701.

In an embodiment of the present invention, as shown in fig. 8, the determining module 602 may include: a delineation unit 801, a first determination unit 802, a second determination unit 803, and a third determination unit 804;

the delineation unit 801 is configured to construct a three-dimensional coordinate system, and place the initial model in the three-dimensional coordinate system; determining each part with a connection relation included in the initial model; delineating a UV normal to each of the parts;

the first determining unit 802 is configured to determine whether a total amount of the UV normals corresponding to each component is greater than a preset number threshold; when the total quantity of the UV normal lines corresponding to the current component is judged to be larger than the quantity threshold value, determining the current component as a sub-model; when the total quantity of the UV normals corresponding to the current component is judged to be not larger than the quantity threshold value, triggering the second determining unit;

the second determining unit 803 is configured to, under the trigger of the first determining unit 802, continuously determine whether the component currently needs to set an animation effect, and if so, determine the component currently as a sub-model; otherwise, determining the current component as a module in the combined model;

the third determining unit 804 is configured to determine the combined model as a sub-model.

In an embodiment of the invention, as shown in fig. 9, the face reduction module 605 may include: an edge determination unit 901 and a collapse unit 902;

the edge determining unit 901 is configured to determine all vertices in the entire model; determining edges between each of the vertices;

the collapse unit 902 is configured to determine at least one collapsed collapse edge in each of the edges according to the application scenario; and collapsing each collapse edge to form the final model aiming at the application scene.

In one embodiment of the present invention, when the delineation unit 801, the first determination unit 802, the second determination unit 803 and the third determination unit 804 are included in the determination module 602,

the modeling processing module 603 is configured to execute for each sub-model, bake each UV line of a component corresponding to the current sub-model into a white mold, perform mapping processing on the white mold, and perform visual effect adjustment on the white mold after mapping processing.

the combination module 604 is configured to determine components corresponding to the sub-models respectively; and combining the submodels according to the connection relation of the components.

In one embodiment of the present invention, as shown in fig. 10, when the de-contouring module 605 includes an edge determination unit 901 and a collapse unit 902,

the collapsing unit 902 may include: a determination subunit 1001, a calculation subunit 1002, and a collapse edge determination subunit 1003;

the determining subunit 1001 is configured to determine a collapse threshold according to the application scenario; determining a first endpoint and a second endpoint corresponding to each edge; for each of the edges, determining a first set of triangles in the overall model that includes a first endpoint of the current edge, determining a second set of triangles in the overall model that includes both the first endpoint and a second endpoint of the current edge;

the calculating subunit 1002 is configured to calculate a collapse value corresponding to each of the edges according to formula (1);

the collapsed edge determining subunit 1003 is configured to execute, on each of the edges, to determine whether a collapsed value corresponding to the current edge is greater than the collapsed threshold, and if yes, determine that the current edge is a collapsed edge.

In one embodiment of the present invention, a readable medium is provided, the readable medium including: executing instructions, and when the processor of the storage controller executes the executing instructions, the storage controller executes the medical instrument three-dimensional modeling method.

In one embodiment of the present invention, there is provided a memory controller including: a processor, a memory, and a bus; the memory is used for storing execution instructions; the processor and the memory are connected through the bus; when the storage controller is operated, the processor executes the execution instructions stored in the memory to enable the storage controller to execute the medical instrument three-dimensional modeling method.

Because the information interaction, execution process, and other contents between the units in the device are based on the same concept as the method embodiment of the present invention, specific contents may refer to the description in the method embodiment of the present invention, and are not described herein again.

In summary, the embodiments of the present invention can at least achieve the following beneficial effects:

1. in the embodiment of the invention, an initial model of the medical instrument to be modeled is constructed according to the view information of the medical instrument to be modeled. And then determining a certain number of sub models in the initial model, and respectively carrying out modeling processing on each sub model. And after the modeling treatment of each sub-model is finished, combining the sub-models subjected to modeling treatment to form an integral model. And then, carrying out surface reduction operation on the whole model according to the application scene to form a final model aiming at the application scene. According to the modeling method, each sub-model is subjected to independent modeling processing in the medical instrument modeling process. And after combining the sub-models subjected to modeling processing to form an integral model, carrying out surface reduction operation on the integral model according to an application scene so as to reduce the number of surfaces in the three-dimensional model. Therefore, the data volume of the three-dimensional model of the medical instrument can be reduced by the scheme provided by the embodiment of the invention.

2. In the embodiment of the present invention, the content included in the view information may select any one or both of the image video and the picture according to the service requirement. Because the image video or the picture comprises the characteristics of the medical instrument to be modeled, the model is constructed according to the view information, and the reduction degree of the medical instrument to be modeled can be improved.

3. In the embodiment of the invention, all objects included in the view information of the medical instrument to be modeled are determined, and then the initial model of the medical instrument to be modeled is constructed according to the structural data of each object. Because the initial model of the medical instrument to be modeled is constructed according to the structural data, the matching degree of the initial model and the medical instrument to be modeled is higher.

4. In the embodiment of the present invention, the components having connection relationships included in the initial model are first determined. Then, the UV normal of each part is sketched, and the total amount of the UV normal of each part is counted. And splitting the initial model by judging the relation between the total amount of the UV normal of each part and a preset quantity threshold value and judging whether each part needs to set an animation effect. So as to carry out modeling processing on each sub-model, thereby reducing the complexity of the modeling processing.

5. In the embodiment of the invention, the UV lines of the parts corresponding to the sub-models are baked into the white mold, then the obtained white mold is subjected to mapping treatment, and the visual effect of the white mold subjected to mapping treatment is adjusted. Because the modeling processing process of each sub-model is carried out independently, the targeted modeling processing can be carried out according to the characteristics of each sub-model.

6. In the embodiment of the invention, parts respectively corresponding to each submodel are firstly determined, and then each submodel is combined to form an integral model according to the connection relation of each part, so that the integral model is obtained, and the medical instrument to be modeled is restored by using the integral model.

7. In the embodiment of the invention, at least one collapse edge is determined in the overall model according to the application scene. Each collapsed edge is then collapsed, forming a final model for the application scenario. Since the whole model is subjected to the face reduction operation by using the collapsed edges, the size of the data volume in the model is reduced.

8. In the embodiment of the invention, the collapse value of each edge in the integral model is firstly calculated, then each collapse value is compared with the preset collapse threshold value, and each collapse edge is determined according to the comparison result. Therefore, the determination of the collapse edge is more accurate.

9. In the embodiment of the invention, an initial model of the medical instrument to be modeled is constructed by utilizing a construction module according to the view information of the medical instrument to be modeled. And then the determining module determines each sub-model according to the initial model constructed by the constructing module. And the modeling processing module carries out modeling processing on each sub-model. And the combination module combines each sub-model after modeling into an integral model. And the face reducing module performs face reducing operation on the whole model according to the application scene to form a final model aiming at the application scene. According to the modeling method, each sub-model is subjected to independent modeling processing in the medical instrument modeling process. And after combining the sub-models subjected to modeling processing to form an integral model, carrying out surface reduction operation on the integral model according to an application scene so as to reduce the number of surfaces in the three-dimensional model. Therefore, the data volume of the three-dimensional model of the medical instrument can be reduced by the scheme provided by the embodiment of the invention.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a" does not exclude the presence of other similar elements in a process, method, article, or apparatus that comprises the element.

Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it is to be noted that: the above description is only a preferred embodiment of the present invention, and is only used to illustrate the technical solutions of the present invention, and not to limit the protection scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A method for three-dimensional modeling of a medical device, comprising:

determining at least one sub-model according to the initial model;

carrying out modeling processing on each sub-model;

combining the sub-models after modeling treatment to form an integral model;

carrying out surface reduction operation on the integral model according to an application scene to form a final model aiming at the application scene;

determining each part with a connection relation included in the initial model;

delineating a UV normal to each of the parts;

and determining the combined model as a sub-model.

2. The method of claim 1,

determining all objects included in the view information;

extracting structural data of each object from the view information;

3. The method of claim 1,

the modeling processing of each sub-model comprises:

performing for each submodel, baking each UV line of a part corresponding to the current submodel into a white mold, performing mapping processing on the white mold, and performing visual effect adjustment on the white mold after mapping processing;

and/or the presence of a gas in the gas,

the combination of the sub-models after modeling processing comprises:

determining components corresponding to the sub-models respectively;

4. The method of claim 1,

determining all vertices in the integral model;

determining edges between each of the vertices;

5. The method of claim 4,

determining a collapse threshold according to the application scene;

determining a first endpoint and a second endpoint corresponding to each edge;

calculating a collapse value corresponding to each edge through a first formula;

the first formula includes:

wherein, the cost (u, v)_nCharacterizing a collapse value for the nth of said edges; the u represents the coordinates of the first endpoint of the nth edge; the v represents the coordinates of the second endpoint of the nth edge; the Tu characterizes a first set of triangles; said Tuv characterizing a secondA set of triangles; normal characterizes the first normal; normal characterizes the second normal;

6. The method according to any one of claims 1 to 5,

7. A medical instrument three-dimensional modeling apparatus, comprising:

the face reducing module is used for carrying out face reducing operation on the integral model formed by the combined module according to an application scene to form a final model aiming at the application scene;

8. The apparatus of claim 7,

the building module comprises: an extraction unit and a construction unit;

the construction unit is used for constructing an initial model of the medical instrument to be modeled according to the structural data of each object extracted by the extraction unit;

and/or the presence of a gas in the gas,

9. The apparatus of claim 8,

the modeling processing module is used for executing each submodel, baking each UV line of a part corresponding to the current submodel into a white mold, carrying out mapping processing on the white mold, and carrying out visual effect adjustment on the white mold after mapping processing;

and/or the presence of a gas in the gas,

the combination module is used for determining parts corresponding to the submodels respectively; combining the submodels according to the connection relation of the components;

and/or the presence of a gas in the gas,

the calculating subunit is configured to calculate, according to a first formula, a collapse value corresponding to each of the edges;

the first formula includes:

wherein, the cost (u, v)_nCharacterizing a collapse value for the nth of said edges; the u represents the coordinates of the first endpoint of the nth edge; the v represents the coordinates of the second endpoint of the nth edge; the Tu characterizes a first set of triangles(ii) a The Tuv characterizes a second set of triangles; normal characterizes the first normal; normal characterizes the second normal;