CN107887018B - Preoperative evaluation system and preoperative evaluation method - Google Patents
Preoperative evaluation system and preoperative evaluation method Download PDFInfo
- Publication number
- CN107887018B CN107887018B CN201610873604.6A CN201610873604A CN107887018B CN 107887018 B CN107887018 B CN 107887018B CN 201610873604 A CN201610873604 A CN 201610873604A CN 107887018 B CN107887018 B CN 107887018B
- Authority
- CN
- China
- Prior art keywords
- computer model
- server
- module
- dimensional
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Medical Treatment And Welfare Office Work (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a preoperative evaluation system and a preoperative evaluation method, the preoperative evaluation system comprises a server and a client, the server comprises a first input module, an image processing module and a first output module which are sequentially communicated, the client comprises a second input module, an image evaluation module and a second output module which are sequentially communicated, the client transmits image data of a focus part of a human body to the first input module of the server through the second output module, the server obtains a first three-dimensional focus part computer model through the image processing module and according to the image data of the focus part of the human body, and sends the first three-dimensional focus part computer model to the second input module of the client through the first output module, and the client evaluates the first three-dimensional focus part computer model through the image evaluation module, and feeding back the first evaluation result to the server through a second output module.
Description
Technical Field
The invention relates to the technical field of medical instruments, in particular to a preoperative evaluation system and a preoperative evaluation method.
Background
In conventional diagnosis and surgery, an attending physician mainly understands basic features of a lesion, such as a position, a size, a shape, surrounding tissues, etc., through two-dimensional image data, such as X-ray, CT, MRI, or ultrasound, etc., to perform preoperative planning of a surgical plan, and then performs surgery according to a three-dimensional impression formed in the brain by the attending physician. This practice makes most of the surgery dependent on the experience and skill of the attending physician, and therefore, the reproducibility and systematicness of the surgical protocol is poor.
Specifically, during the pre-operative assessment, after the radiologist performs the data scanning and basic measurement assessment, the CT/MRI/ultrasound film and the measurement data are handed over to the attending physician who then finally completes the imaging assessment and implant planning based on the obtained data. The problem is that even if the film obtained by the main doctor contains images of a plurality of angles, the main doctor still can not rotate and observe the film at any angle according to the requirement, so the intuition is low, and particularly in some specific operations such as endoscopic surgery, if the guidance of a 3D model can not be obtained, the judgment and decision of the main doctor on the condition in the operation are influenced, thereby the success rate of the operation is influenced.
Disclosure of Invention
The invention aims to provide a preoperative evaluation system and a preoperative evaluation method, and aims to solve the problem that an attending doctor cannot visually observe an anatomical structure of a diseased part in the prior art.
To achieve the above and other related objects, the present invention provides a preoperative evaluation system, comprising:
the server comprises a first input module, an image processing module and a first output module which are sequentially in communication connection; and
the client comprises a second input module, an image evaluation module and a second output module which are sequentially in communication connection;
the client communicates with the server, and transmits the image data of the focus part of the human body to the first input module of the server through a second output module; the server side obtains a first three-dimensional lesion part computer model through the image processing module and according to the image data of the human body lesion part, and sends the first three-dimensional lesion part computer model to a second input module of the client side through the first output module; the client side evaluates the first three-dimensional lesion site computer model through the image evaluation module, and feeds back a first evaluation result to the server side through the second output module.
Preferably, in the preoperative evaluation system, the first three-dimensional lesion site computer model is a simplified computer model, the server further processes the image data of the lesion site of the human body through the image processing module to obtain a second three-dimensional lesion site computer model, the second three-dimensional lesion site computer model is a complete computer model, and the simplified computer model is obtained by converting the complete computer model.
Preferably, in the preoperative evaluation system, when the first evaluation result is a positive result, the server sends the second three-dimensional lesion site computer model to the client through the first output module.
Preferably, in the preoperative evaluation system, when the first evaluation result is a negative result, the server re-processes the image data of the human body focal site to obtain a new first three-dimensional focal site computer model.
Preferably, in the preoperative evaluation system, the server further includes a first human-computer interaction module, which is in communication connection with the first input module, the image processing module and the first output module respectively; the client further comprises a second man-machine interaction module which is in communication connection with the second input module, the image evaluation module and the second output module respectively;
the image processing module receives a control instruction from the first human-computer interaction module to execute the creation of a three-dimensional lesion site computer model; the image evaluation module receives a first instruction from the second human-computer interaction module to generate the first evaluation result.
Preferably, in the preoperative evaluation system, the server further includes a surgical planning module, which is in communication connection with the image processing module and the first human-computer interaction module respectively; the client also comprises a surgical planning evaluation module which is in communication connection with the second human-computer interaction module;
the client selectively sends a surgery planning request to the server through a second output module through the second human-computer interaction module, and the server creates a surgery scheme based on the second three-dimensional lesion site computer model through the surgery planning module and sends the surgery scheme to the client; the client evaluates the operation scheme through the operation planning evaluation module and feeds back a second evaluation result to the server through the second output module; and the operation planning evaluation module receives a second instruction from the second human-computer interaction module to generate a second evaluation result.
Preferably, in the preoperative evaluation system, when the second evaluation result is a negative result, the surgical planning module of the server reschedules a new surgical plan.
Preferably, in the preoperative evaluation system, the server creates a three-dimensional tool computer model of a surgical aid through the image processing module and according to any one of the surgical plan, the image data of the human lesion site or a combination of the two.
Preferably, in the preoperative evaluation system, when the second evaluation result is a positive result, the server sends the three-dimensional tool computer model to the client through a first output module.
Preferably, in the preoperative evaluation system, the data file size of the simplified computer model is smaller than the data file size of the complete computer model.
Preferably, in the preoperative evaluation system, the server creates the three-dimensional lesion site computer model according to the image data of the lesion site of the human body, which is obtained by scanning with an imaging device.
Preferably, in the preoperative evaluation system, the client and the server communicate through a wired and/or wireless network.
Preferably, in the preoperative evaluation system, the preoperative evaluation system further includes:
the 3D printing terminal equipment is in communication connection with the client and/or the server;
and the 3D printing terminal equipment creates a three-dimensional entity model of the focus part according to the second three-dimensional focus part computer model.
To achieve the above and other related objects, the present invention provides a preoperative assessment method comprising:
processing the image data of the focus part of the human body by a server to obtain a first three-dimensional focus part computer model; and
and evaluating the first three-dimensional lesion site computer model by a client to generate a first evaluation result and feeding the first evaluation result back to the server.
Preferably, in the preoperative assessment method, the method further comprises:
and processing the image data of the human body focus part by the server side to obtain a second three-dimensional focus part computer model, wherein the first three-dimensional focus part computer model is a simplified computer model, the second three-dimensional focus part computer model is a complete computer model, and the simplified computer model is obtained by converting the complete computer model.
Preferably, in the preoperative assessment method, the method further comprises:
when the first evaluation result is a positive result, the server side processes the image data of the human body focus part to obtain a second three-dimensional focus part computer model, and sends the second three-dimensional focus part computer model to the client side; and when the first evaluation result is a negative result, the server-side reprocesses the image data of the human body focus part to obtain a new first three-dimensional focus part computer model.
Preferably, in the preoperative assessment method, the preoperative assessment method further includes:
the client selectively sends an operation planning request to the server; the server side creates a surgical scheme according to the operation planning request and the second three-dimensional lesion part computer model, and sends the surgical scheme to a client side; the client evaluates the surgical plan to generate a second evaluation result and feeds the second evaluation result back to the server;
wherein the server re-plans a new surgical plan when the second assessment result is a negative result; when the second evaluation result is a positive result, the server creates a three-dimensional tool computer model of a surgical assistant tool according to the surgical plan, the image data of the focus part of the human body, or a combination of the two, and sends the three-dimensional tool computer model to the client.
Preferably, in the preoperative assessment method, the client and the server communicate through a wired and/or wireless network.
Preferably, in the preoperative assessment method, when the first assessment result is a positive result, the server or the client creates a three-dimensional lesion site solid model through a 3D printing terminal device.
Preferably, in the preoperative assessment method, before creating the three-dimensional lesion site computer model, the server evaluates the human lesion site image data to generate a third evaluation result;
when the third evaluation result is a positive result, the server creates the three-dimensional lesion site computer model; and when the third evaluation result is a negative result, the server receives the image data of the human body focus part again.
In summary, the preoperative evaluation system and the preoperative evaluation method provided by the invention have the following advantages:
first, the technical scheme of the invention can provide the three-dimensional focus part computer model which is evaluated and confirmed by the client before the operation to the operating doctor, compared with the prior art, the three-dimensional focus part computer model not only is convenient for the operating doctor to visually watch the anatomical structure of the focus part, but also has high accuracy because the three-dimensional focus part computer model is confirmed by the client.
Secondly, the technical scheme of the invention avoids the problem of repeated modeling caused by the fact that the three-dimensional lesion part computer model is not evaluated and confirmed by a client side in the follow-up process, improves the three-dimensional modeling efficiency of the lesion part, further saves the pre-operation evaluation time, and improves the pre-operation evaluation efficiency.
Thirdly, in the technical scheme of the invention, the server sends the simplified first three-dimensional lesion part computer model to the client for evaluation, and compared with sending the complete second three-dimensional lesion part computer model, the size of the data file of the simplified computer model is smaller than that of the data file of the complete computer model, so that the system occupies less resources, the data transmission efficiency is high, and the preoperative evaluation efficiency is high.
Fourthly, in the technical scheme of the invention, the server creates the operation scheme based on the second three-dimensional lesion site computer model according to the operation planning request sent by the client and sends the operation scheme to the client for evaluation and confirmation, so that further reference and basis are provided for the operation doctor to perform preoperative evaluation and operation planning.
Fifth, in the technical solution of the present invention, the server may further create a three-dimensional tool computer model of the surgical assistant tool according to any one of the surgical plan and the image data of the focal region of the human body, or a combination of the two, thereby simplifying the process of developing the surgical assistant tool and saving the development period.
Drawings
FIG. 1 is a flow chart of a preoperative assessment method in accordance with one embodiment of the present invention;
fig. 2 is a block diagram of a preoperative evaluation system according to an embodiment of the invention.
The labels in the figures are illustrated as follows:
100-preoperative assessment method;
200-preoperative evaluation system;
210-a server;
211-a first input module; 212-image processing module; 213-a first output module; 214-a first human-machine interaction module; 215-surgical planning module;
220-a client;
221-a second input module; 222-image evaluation module; 223-a second output module; 224-a second human-machine interaction module; 225-surgical plan evaluation module;
230-3D printing terminal equipment;
240-network side;
110-1, 110, 120, 130, 140 and 150.
Detailed Description
The core idea of the invention is that an integrated system is provided for information transmission (such as scanning data and modeling data of a focus part), communication interaction and result interaction between an operating doctor and an assistant by using the Internet, and a three-dimensional reconstruction is performed on a two-dimensional image by using a 3D technology, so that the three-dimensional, visualization and concretization of an anatomical structure of a lesion part are realized, and accurate reference and basis are provided for preoperative evaluation and operation planning of the doctor.
The inventor researches and discovers that the 3D technology and the Internet technology can better solve the technical problem to be solved by the invention, so the invention provides a preoperative evaluation system based on the Internet and the 3D technology.
Specifically, the 3D technology includes a 3D printing technology and a 3D virtual technology. The 3D printing technology is a new forming technology developed based on a computer three-dimensional digital forming technology and a multilayer continuous printing technology, and the principle is to realize additive manufacturing by carrying out layering processing, layering processing and overlapping forming on a model. The technology can be used for manufacturing geometric models with any complex shapes, greatly reduces the manufacturing difficulty of products with complex structures, and greatly improves the production efficiency and the forming precision. The 3D virtual technology is also called flexible mirror technology, and is a computer advanced human-computer interface with immersion, interactivity and imagination as basic characteristics. The system comprehensively utilizes computer graphics, simulation technology, multimedia technology, artificial intelligence technology, computer network technology, parallel processing technology and multi-sensor technology, simulates the sense functions of human vision, hearing, touch and the like, enables the human to be immersed in a virtual boundary generated by a computer, and can interact with the virtual boundary in real time in natural modes such as language, gestures and the like, thereby creating a multi-dimensional information space which is suitable for humanization.
On the other hand, since the birth of the last century, internet technology is applied by more and more commercial organizations due to the advantages of rapidness, real-time performance, multimedia interaction and the like. While the internet technology brings great changes to the fields of traditional media, commerce, education, and the like, the internet technology also starts to gradually penetrate into the medical field. At present, the application of the internet technology in the medical field is mainly embodied in the aspects of network registration, health monitoring, mobile APP and the like, and is rarely applied to preoperative assessment and operation planning.
In order to make the objects, advantages and features of the present invention more clear, the preoperative evaluation system and the preoperative evaluation method proposed by the present invention are further described in detail with reference to fig. 1-2. It is to be noted that the drawings are in a very simplified form and are not to precise scale, which is merely for the purpose of facilitating and distinctly claiming the embodiments of the present invention.
As used in this specification and the appended claims, the singular forms "a", "an", and "the" include plural referents unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term "or" is generally employed in its sense including "and/or" unless the content clearly dictates otherwise.
Referring to fig. 1 and 2, fig. 1 is a flowchart illustrating a preoperative evaluation method according to an embodiment of the present invention, and fig. 2 is a block diagram illustrating a preoperative evaluation system according to an embodiment of the present invention. The preoperative evaluation method 100 of the present embodiment employs a preoperative evaluation system 200 to perform preoperative evaluation, the preoperative evaluation system 200 includes a server 210 and a client 220 which are in communication with each other, and the preoperative evaluation method 100 includes the following steps:
in step 110, the server 210 processes the image data of the lesion site of the human body to obtain a first three-dimensional lesion site computer model. The image data of the focus part of the human body is obtained by scanning by an imaging device, such as electronic data formed by scanning in a CT (computed tomography), X-ray, MRI (magnetic resonance imaging) or ultrasonic mode. The electronic data scanned and obtained by the imaging device may be imported into an application program of the server 210, so as to process and obtain a first three-dimensional lesion site computer model.
In step 120, the client 220 evaluates the first three-dimensional lesion site computer model to generate a first evaluation result, and feeds the first evaluation result back to the server 210. Similarly, the first three-dimensional lesion site computer model may be imported into an application program of the client 220, and the first three-dimensional lesion site computer model may be displayed through the application program of the client 220.
In a preferred embodiment, the server 210 further processes the image data of the human body focal region to obtain a second three-dimensional focal region computer model, specifically, the first three-dimensional focal region computer model is a simplified computer model, the second three-dimensional focal region computer model is an integrated computer model, and the simplified computer model is obtained by converting the integrated computer model.
In this embodiment, the size of the data file of the simplified computer model is smaller than the size of the data file of the complete computer model.
In a preferred embodiment, when the first evaluation result is a positive result, that is, when the first evaluation result is a positive result, the server 210 sends the second three-dimensional lesion site computer model to the client 220. When the first evaluation result is a negative result, that is, the first evaluation result is a negative result, the server 210 re-processes the image data of the lesion site of the human body to obtain a new first three-dimensional lesion site computer model.
Preferably, when the first evaluation result is a positive result, any one of the server 210 and the client 220 creates a three-dimensional solid model of the lesion site through the 3D printing terminal device 230, and specifically, the 3D printing terminal device 230 creates a three-dimensional solid model of the lesion site based on the second three-dimensional lesion site computer model.
Further, the preoperative evaluation method 100 further includes steps 130, 140 and 150, wherein the step 130 selectively sends a surgical planning request to the server 210 for the client 220, the step 140 creates a surgical plan for the server 210 according to the surgical planning request and the second three-dimensional lesion site computer model and sends the surgical plan to the client 220, and the step 150 evaluates the surgical plan for the client 220 to generate a second evaluation result and feeds the second evaluation result back to the server 210.
When the second evaluation result is a negative result, the server 210 replans a new surgical plan, and when the second evaluation result is a positive result, the server 210 creates a three-dimensional tool computer model of the surgical assistant tool according to the surgical plan and/or the image data of the human body focus part and transmits the three-dimensional tool computer model to the client 220.
In this embodiment, when the second evaluation result is a positive result, the client 220 receives the three-dimensional tool computer model sent back by the server 210, and the three-dimensional tool computer model may be 3D printed along with the three-dimensional lesion site computer model.
When creating the surgical plan, the server 210 plans the position, direction, angle and depth of the surgical incision (or resection), the implant type selection, the alignment, the implant simulated placement position, the lesion physical property, and other surgical parameters based on the second three-dimensional lesion site computer model, so as to obtain the surgical plan related to the lesion site. Preferably, the server 210 can also compare the states (such as length, direction, angle, etc.) of the organ (or tissue) before and after the operation to form a comparison report, and feed the comparison report back to the client 220 together with the operation plan. Specifically, taking the knee joint as an example, the server 210 may create a lower limb force line and an anatomical axis based on the second three-dimensional lesion site computer model, so as to plan an osteotomy scheme according to the requirements of the operating surgeon. Osteotomy protocols include, without limitation, lower limb length, inclination, rotation, osteotomy thickness, prosthesis model, and the like. In addition, the server 210 can compare the sizes before and after osteotomy for the reference of the surgeon.
Further, the surgical plan of the present embodiment may be created by a professional based on the second three-dimensional lesion site computer model and combined with the empirical values, and may be output to the client 220 through a slide-like electronic report, or the surgical plan may be automatically analyzed by a special planning software. For example, after creating a three-dimensional diseased heart computer model, no surgical planning is required, as the surgeon only needs to know the structure of the diseased heart, such as the ventricular rupture location, the ventricular septal defect location, and the size.
Further, before creating the three-dimensional lesion site computer model (specifically, before creating the first three-dimensional lesion site computer model, and/or before creating the second three-dimensional lesion site computer model), the preoperative assessment method 100 further includes a step 110-1 of evaluating the image data of the human lesion site, specifically, the server 210, to generate a third assessment result. When the third evaluation result is a positive result, the server 210 creates the three-dimensional lesion site computer model. When the third evaluation result is a negative result, the server 210 receives the image data of the human body focal region again. Specifically, during scanning, if the interval between the fault layers is too large, or the scanned human body carries metal interferents and the like, the accuracy of subsequent modeling is affected, and if the conditions exist, the image data of the focus part of the human body does not meet the modeling requirement, and the focus part needs to be rejected for rescanning.
Optionally, the client 220 evaluates the first three-dimensional lesion site computer model according to physical attribute parameters of the shape, size, location, etc. of the lesion site, for example, when the shape, size, location, etc. of the lesion site is completely reconstructed, the client 220 generates a positive first evaluation result.
In addition, the first three-dimensional lesion site computer model may be output to the client 220 in the following format: (a) picture data files, such as pictures in jpg, bmp, gif formats; (b) a first three-dimensional lesion site computer model is recorded on an electronic data file in a PDF format, that is, a PDF file. However, the present invention includes, but is not limited to, sending a picture data file or an electronic data file in PDF format to the client 220, and other ways of reducing the size of the data file transmission may be suitable, so as to improve the efficiency of model evaluation.
In addition, the second three-dimensional lesion site computer model may be output to the client 220 by: the digital model data file can be imported into three-dimensional computer software to view a second three-dimensional lesion site computer model, or imported into the 3D printing terminal device 340 to be printed by a three-dimensional entity; or, the real virtual data file is an electronic file that can be recognized by a virtual reality device, such as 3D glasses, a 3D television, or other electronic device with a 3D display function, to observe the second three-dimensional lesion site computer model through the virtual reality device.
In this embodiment, the server 210 mainly uses computer software such as mics, 3-Matic, solid works, UG, AutoCAD, and the like to process the computer model to obtain the three-dimensional lesion site computer model. However, the present invention is not limited to such computer software, and other computer software having equivalent functions may be adapted to the present invention. For example, the server 210 performs filtering, segmentation, growth, and other processing on the two-dimensional image data of the human body focal site based on the Mimics software, so as to establish a three-dimensional focal site (e.g., knee joint) computer model. In a preferred embodiment, after the three-dimensional lesion site computer model is initially created, the server 210 further edits the three-dimensional lesion site computer model to make the surface of the model smooth and conform to the physiological and anatomical features, for example, based on 3-Matic software, and preferably meet the technical requirements of 3D printing.
The technical requirements of 3D printing include, for example, smoothness of the three-dimensional lesion site computer model surface, complexity of the structure, and the like. The complexity of the structure of the three-dimensional lesion site computer model is, for example, the minimum wall thickness, the minimum overhang angle of the projection, the maximum horizontal support span of the model structure, etc., and if the three-dimensional lesion site computer model does not meet the technical requirements of 3D printing, it is difficult to print a three-dimensional solid model through a 3D printing terminal device, or the printed three-dimensional solid model is easily broken or distorted.
In an embodiment of the present invention, the server 210 and the client 220 communicate with each other through a wired or wireless network, and specifically, the pre-operation assessment system 200 further includes a network 240 communicatively connected to the client 220 and/or the server 210, where the network 240 is used to connect the pre-operation assessment system 200 to the internet, so as to communicate with the outside through the network, and implement data transmission and sharing. The network end 240 may be a server. It should be understood that the network end 240 may be other electronic devices with network storage function in addition to the server.
In one embodiment, the server 210 and the client 220 implement data transmission and sharing via the network 240. In other embodiments, the server 210 and the client 220 communicate directly through an internal bus, in which case, the pre-operation assessment system 200 is an integrated device, and at least one of the server 210 and the client 220 is communicatively connected to the network 240, so as to connect the pre-operation assessment system 200 to the internet.
If the device is not an integrated device, the server 210 and the client 220 both store the shared data in a server, and the data of the other party can be obtained by accessing the server. Optionally, the client 220 directly receives the image data of the focal region of the human body sent by the imaging department personnel in the medical unit, then the client 220 uploads the image data of the focal region of the human body to the server, and the server 210 directly downloads the image data of the focal region of the human body from the server and processes the image data.
If the integrated device is used, the imaging department personnel of the medical unit directly uploads the image data of the human body focus part to the server, then the client 220 directly downloads the image data of the human body focus part from the server, and then transmits the image data of the human body focus part to the server 210 through the internal bus.
In the above embodiment, in order to facilitate reading, a target folder corresponding to the patient is set on the server to store the image data of the focal region of the human body of the patient. The target folder may be set by the imaging department staff or the user of the preoperative evaluation system 200, and the present invention is not particularly limited thereto. The pre-operative assessment system 200 may perform subsequent processing by reading image data of the lesion site of the human body in the target folder.
In a preferred embodiment, the server 210 sends the second three-dimensional lesion site computer model and the three-dimensional tool computer model to the client 220 if and only if the first and second assessment results are positive results.
Further, the present embodiment also provides a preoperative evaluation system 200 for implementing the preoperative evaluation method 100, and the structure of the preoperative evaluation system 200 of the present embodiment is shown in fig. 2. For simplicity, the network 240 is connected to the server 210 and the client 220 in a communication manner, and the 3D printing terminal device 230 is connected to the server 210 in a communication manner, which should not be limited thereto.
As shown in fig. 2, the server 210 includes a first input module 211, an image processing module 212, and a first output module 213, which are sequentially connected in a communication manner, and the client 220 includes a second input module 221, an image evaluation module 222, and a second output module 223, which are sequentially connected in a communication manner.
The client 220 transmits the image data of the lesion site of the human body to the first input module 211 of the server 210 through the second output module 223. As shown in fig. 2, the image data of the focal region of the human body output by the second output module 223 is first uploaded to the network 240, and then the server 210 downloads the image data of the focal region of the human body from the network 240 through the first input module 211.
After the first input module 211 downloads the image data of the lesion site of the human body, the server 210 processes the image data of the lesion site of the human body through the image processing module 212 to obtain a first three-dimensional lesion site computer model, and sends the first three-dimensional lesion site computer model to the second input module 221 of the client 220 through the first output module 213. As disclosed in fig. 2, the first output module 213 first uploads the first three-dimensional lesion site computer model to the network 240, and then the client 220 downloads the first three-dimensional lesion site computer model from the network 240 through the second input module 221.
After the second input module 221 downloads the first three-dimensional lesion site computer model, the client 220 evaluates the first three-dimensional lesion site computer model through the image evaluation module 222, and feeds back a first evaluation result to the server 210 through the second output module 223.
In addition, the image processing module 212 further processes the image data of the lesion site of the human body to obtain the second three-dimensional lesion site computer model. In addition, when the first evaluation result is a positive result, the first output module 213 transmits a second three-dimensional lesion site computer model to the second input module 221 of the client 220. When the first evaluation result is a negative result, the image processing module 212 re-processes the image data of the human body focal site to obtain a new first three-dimensional focal site computer model.
Then, when the image processing module 212 processes the image data of the human body focal site to obtain a three-dimensional focal site computer model, the establishment of the three-dimensional focal site computer model is automatically operated by computer software, the operation method comprises filtering, segmentation, growth and the like, and operation parameters are preset by background staff so as to reconstruct the three-dimensional focal site (such as the heart) computer model. Optionally, the three-dimensional lesion site (such as the heart site of a structural heart disease patient) computer model is edited by using 3-Matic software, so that the model can clearly show the characteristics of the lesion site, and meanwhile, the requirement of 3D printing production is met. And when the three-dimensional lesion part computer model passes through the model evaluation step and meets the requirements, entering the next stage.
In an embodiment of the present invention, the first output module 213 and the second output module 223 are configured to provide an interface for a download function and a cloud import/export function, so that an external device can read data in the pre-operation assessment system 200 or read data of the external device. The external device includes but is not limited to a U disk and a mobile hard disk.
With reference to fig. 2, the server 210 further includes a first human-machine interaction module 214, and the first human-machine interaction module 214 is respectively connected to the first input module 211, the image processing module 212, and the first output module 213 in a communication manner. The first human-machine interaction module 214 is used for controlling data transmission among the modules, and the image processing module 212 receives a control command from the first human-machine interaction module 214 to perform the creation of the three-dimensional lesion site computer model.
The client 220 further includes a second human-machine interaction module 224, and the second human-machine interaction module 224 is respectively connected to the second input module 221, the image evaluation module 222, and the second output module 223 in a communication manner. The second human-machine interaction module 224 is used for controlling data transmission among the modules, and the image evaluation module receives 222 a first command from the second human-machine interaction module 224 to generate the first evaluation result.
Further, the server 210 further includes a surgical planning module 215, and the surgical planning module 215 is respectively connected to the image processing module 212 and the first human-computer interaction module 214 in a communication manner. Meanwhile, the client 220 further comprises a surgical plan evaluation module 225, and the surgical plan evaluation module 225 is communicatively connected with the second human-machine interaction module 224.
The creation of the surgical plan is automatically performed by the planning software installed in the surgical planning module 215, or is performed by a professional on the module according to an empirical value, and the present invention is not particularly limited.
The client 220 selectively sends a surgical planning request to the server 210 through the second output module 223 through the second human-computer interaction module 224, and after receiving the surgical planning request, the server 210 creates a surgical plan based on the second three-dimensional lesion site computer model through the surgical planning module 215 and sends the surgical plan to the client 220. The client 220 evaluates the surgical plan through the surgical plan evaluation module 225, and feeds back a second evaluation result to the server 210 through the second output module 223. Here, the surgical plan evaluation module 225 receives a second instruction from the second human-machine interaction module 224 to generate the second evaluation result.
Further, when the second evaluation result is a negative result, the surgical planning module 215 re-plans a new surgical plan. When the second evaluation result is a positive result, the first output module 213 sends the three-dimensional tool computer model to the client 220.
In this embodiment, the second output module 223 receives a third instruction from the second human-machine interaction module 224 to output a specific electronic data file related to the three-dimensional lesion site computer model, such as a picture data file, a digital model data file, a real virtual data file, etc. as described in the above embodiments. Alternatively, the first output module 213 receives a fourth instruction from the first human-machine interaction module 214 to output a specific electronic data file related to the three-dimensional lesion site computer model.
The first human-computer interaction module 214 includes a first input keyboard for receiving a first signal input from the outside to control operations such as image processing, surgical planning, input and output, and a first display for displaying data and a computer model. Similarly, the second human-machine interaction module 224 includes a second input keyboard, which can also receive a second signal input from the outside to control the operations of image evaluation, operation planning evaluation, input and output, and a second display, which can display data of computer model, operation plan, etc. in real time. Referring to fig. 2, the image evaluation module 222 receives a first command from the second input keyboard to generate a positive or negative first evaluation result. The surgical planning module 225 receives a second command from a second input keypad to generate a second negative or positive assessment result.
Further, the client 220 also establishes and stores the basic information of the patient through the second human-computer interaction module 224. The basic information of the patient comprises the data of the name, the sex, the medical history, the illness state, the focus and the like of the patient. Referring to fig. 2, before surgery, a surgeon creates a new case on the preoperative evaluation system 200 through the second human-computer interaction module 224, and inputs basic information of a patient, data file output requirements of a computer model, a surgery planning request, and the like. It should be appreciated that the pre-operative assessment system 200 has management software installed thereon, on which cases can be created and relevant information can be entered. By applying the management software, systematic management of preoperative evaluation conditions of each patient is facilitated, and the safety and reliability of preoperative evaluation are high.
In order to more intuitively disclose the technical scheme of the present invention and to highlight the beneficial effects of the present invention, the communication relationships among the human-machine interaction module, the image processing module, the image evaluation module, the operation planning module and the operation planning evaluation module in this embodiment are only examples, and should not be considered as limitations to the technical scheme of the present invention.
In summary, the preoperative evaluation system and the preoperative evaluation method provided by the invention have the following advantages:
first, the technical scheme of the invention can provide the three-dimensional focus part computer model which is evaluated and confirmed by the client before the operation to the operating doctor, compared with the prior art, the three-dimensional focus part computer model not only is convenient for the operating doctor to visually watch the anatomical structure of the focus part, but also has high accuracy because the three-dimensional focus part computer model is confirmed by the client.
Secondly, the technical scheme of the invention avoids the problem of repeated modeling caused by the fact that the three-dimensional lesion part computer model is not evaluated and confirmed by a client side in the follow-up process, improves the three-dimensional modeling efficiency of the lesion part, further saves the pre-operation evaluation time, and improves the pre-operation evaluation efficiency.
Thirdly, in the technical scheme of the invention, the server sends the simplified first three-dimensional lesion part computer model to the client for evaluation, and compared with sending the complete second three-dimensional lesion part computer model, the data file size of the simplified computer model file is smaller than that of the complete computer model file, so that the system occupies less resources, the data transmission efficiency is high, and the preoperative evaluation efficiency is high.
Fourthly, in the technical scheme of the invention, the server creates the operation scheme based on the second three-dimensional lesion site computer model according to the operation planning request sent by the client and sends the operation scheme to the client for evaluation and confirmation, so that further reference and basis are provided for the operation doctor to perform preoperative evaluation and operation planning.
Fifth, in the technical solution of the present invention, the server may further create a three-dimensional tool computer model of the surgical assistant tool according to any one of the surgical plan and the image data of the focal region of the human body, or a combination of the two, thereby simplifying the process of developing the surgical assistant tool and saving the development period.
The above description is only for the purpose of describing the preferred embodiments of the present invention, and is not intended to limit the scope of the present invention, and any variations and modifications made by those skilled in the art based on the above disclosure are within the scope of the appended claims.
Claims (19)
1. A pre-operative assessment system, comprising:
the server comprises a first human-computer interaction module, a first input module, an image processing module and a first output module which are sequentially in communication connection, wherein the first human-computer interaction module is respectively in communication connection with the first input module, the image processing module and the first output module; and
the client comprises a second human-computer interaction module, and a second input module, an image evaluation module and a second output module which are sequentially in communication connection, wherein the second human-computer interaction module is respectively in communication connection with the second input module, the image evaluation module and the second output module;
the client communicates with the server, and transmits the image data of the focus part of the human body to the first input module of the server through a second output module; the server side obtains a first three-dimensional lesion part computer model through the image processing module and according to the image data of the human body lesion part, and sends the first three-dimensional lesion part computer model to a second input module of the client side through the first output module; the client side evaluates the first three-dimensional lesion site computer model through the image evaluation module and feeds back a first evaluation result to the server side through the second output module; the image processing module receives a control instruction from the first human-computer interaction module to execute the creation of a three-dimensional lesion site computer model; the image evaluation module receives a first instruction from the second human-computer interaction module to generate the first evaluation result.
2. The preoperative evaluation system of claim 1, wherein the first three-dimensional lesion site computer model is a simplified computer model, and the server further processes the image processing module and the image data of the human lesion site to obtain a second three-dimensional lesion site computer model, wherein the second three-dimensional lesion site computer model is a complete computer model, and the simplified computer model is transformed from the complete computer model.
3. The preoperative evaluation system of claim 2, wherein when the first evaluation result is a positive result, the server sends the second three-dimensional lesion site computer model to the client through the first output module.
4. The preoperative evaluation system of claim 2, wherein when the first evaluation result is a negative result, the server re-processes the image data of the human lesion to obtain a new first three-dimensional lesion site computer model.
5. The pre-operative assessment system of claim 2, wherein the server further comprises a surgical planning module communicatively coupled to the image processing module and the first human-machine interaction module, respectively; the client also comprises a surgical planning evaluation module which is in communication connection with the second human-computer interaction module;
the client selectively sends a surgery planning request to the server through a second output module through the second human-computer interaction module, and the server creates a surgery scheme based on the second three-dimensional lesion site computer model through the surgery planning module and sends the surgery scheme to the client; the client evaluates the operation scheme through the operation planning evaluation module and feeds back a second evaluation result to the server through the second output module; and the operation planning evaluation module receives a second instruction from the second human-computer interaction module to generate a second evaluation result.
6. The preoperative evaluation system of claim 5, wherein when the second evaluation result is a negative result, the surgical planning module of the server reschedules a new surgical plan.
7. The pre-operative assessment system of claim 5, wherein the server creates a three-dimensional tool computer model of a surgical assistant tool through the image processing module and according to either the surgical plan, the human lesion site image data, or a combination thereof.
8. The pre-operative assessment system of claim 7, wherein the server sends the three-dimensional tool computer model to the client via a first output module when the second assessment result is a positive result.
9. The pre-operative evaluation system of any one of claims 2 to 8, wherein a data file size of the simplified computer model is smaller than a data file size of the complete computer model.
10. The pre-operative assessment system according to any one of claims 1 to 8, wherein the server creates the three-dimensional lesion site computer model based on the image data of the human lesion site scanned by an imaging device.
11. The pre-operative assessment system according to any one of claims 1 to 8, wherein the client and server communicate via a wired and/or wireless network.
12. The preoperative assessment system of any one of claims 2-8, further comprising:
the 3D printing terminal equipment is in communication connection with the client and/or the server;
and the 3D printing terminal equipment creates a three-dimensional entity model of the focus part according to the second three-dimensional focus part computer model.
13. A method of pre-operative assessment, comprising:
processing image data of a human focus part by a service end according to a control instruction generated by human-computer interaction of the service end to obtain a first three-dimensional focus part computer model; and
and evaluating the first three-dimensional lesion site computer model by a client according to a first instruction generated by human-computer interaction of the client to generate a first evaluation result and feed the first evaluation result back to the server.
14. The preoperative assessment method of claim 13, further comprising:
and processing the image data of the human body focus part by the server side to obtain a second three-dimensional focus part computer model, wherein the first three-dimensional focus part computer model is a simplified computer model, the second three-dimensional focus part computer model is a complete computer model, and the simplified computer model is obtained by converting the complete computer model.
15. The preoperative assessment method of claim 14, further comprising:
when the first evaluation result is a positive result, the server side sends the second three-dimensional lesion site computer model to a client side; and when the first evaluation result is a negative result, the server-side reprocesses the image data of the human body focus part to obtain a new first three-dimensional focus part computer model.
16. The preoperative assessment method of claim 15, further comprising:
the client selectively sends an operation planning request to the server; the server side creates a surgical scheme according to the operation planning request and the second three-dimensional lesion part computer model, and sends the surgical scheme to a client side; the client evaluates the surgical plan to generate a second evaluation result and feeds the second evaluation result back to the server;
wherein the server re-plans a new surgical plan when the second assessment result is a negative result; when the second evaluation result is a positive result, the server creates a three-dimensional tool computer model of a surgical assistant tool according to the surgical plan, the image data of the focus part of the human body, or a combination of the two, and sends the three-dimensional tool computer model to the client.
17. The pre-operative assessment method according to any one of claims 13 to 16, wherein said client and server communicate via wired and/or wireless network.
18. The pre-operative assessment method according to any one of claims 13 to 16, wherein when the first assessment result is a positive result, the server or the client creates a lesion site three-dimensional solid model through a 3D printing terminal device.
19. The pre-operative assessment method according to any one of claims 13 to 16, wherein prior to creating the three-dimensional lesion site computer model, the server evaluates the human lesion site image data to generate a third evaluation result;
when the third evaluation result is a positive result, the server creates the three-dimensional lesion site computer model; and when the third evaluation result is a negative result, the server receives the image data of the human body focus part again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610873604.6A CN107887018B (en) | 2016-09-30 | 2016-09-30 | Preoperative evaluation system and preoperative evaluation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610873604.6A CN107887018B (en) | 2016-09-30 | 2016-09-30 | Preoperative evaluation system and preoperative evaluation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107887018A CN107887018A (en) | 2018-04-06 |
| CN107887018B true CN107887018B (en) | 2021-09-10 |
Family
ID=61768914
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610873604.6A Active CN107887018B (en) | 2016-09-30 | 2016-09-30 | Preoperative evaluation system and preoperative evaluation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107887018B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200297422A1 (en) * | 2017-12-14 | 2020-09-24 | Olympus Corporation | Operation supporting device and method of operating operation supporting device |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109509555A (en) * | 2018-11-26 | 2019-03-22 | 刘伟民 | A kind of surgical operation preview appraisal procedure and system based on 3-dimensional image |
| CN113674841A (en) * | 2021-08-23 | 2021-11-19 | 东成西就教育科技有限公司 | Template measuring system for preoperative image |
| CN116959697A (en) * | 2023-06-19 | 2023-10-27 | 华平祥晟(上海)医疗科技有限公司 | Preoperative scheme auxiliary evaluation system and method based on artificial intelligence |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102117378A (en) * | 2009-12-31 | 2011-07-06 | 苏州瑞派宁科技有限公司 | Hepatic tumor comprehensive surgical planning analogy method and system thereof based on three-dimensional multimode images |
| CN103136785A (en) * | 2013-02-01 | 2013-06-05 | 上海交通大学医学院附属第九人民医院 | Human body medical model three-dimensional visualization system used for mobile terminal and realizing method thereof |
| CN103488904A (en) * | 2013-09-27 | 2014-01-01 | 中国人民解放军第三军医大学 | Medical image remote communication system, server and terminal |
| CN104318057A (en) * | 2014-09-25 | 2015-01-28 | 新乡医学院第一附属医院 | Medical image three-dimensional visualization system |
| CN105534476A (en) * | 2015-12-05 | 2016-05-04 | 新乡医学院第一附属医院 | Early detection system for kidney diseases and injuries of department of pediatrics |
-
2016
- 2016-09-30 CN CN201610873604.6A patent/CN107887018B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102117378A (en) * | 2009-12-31 | 2011-07-06 | 苏州瑞派宁科技有限公司 | Hepatic tumor comprehensive surgical planning analogy method and system thereof based on three-dimensional multimode images |
| CN103136785A (en) * | 2013-02-01 | 2013-06-05 | 上海交通大学医学院附属第九人民医院 | Human body medical model three-dimensional visualization system used for mobile terminal and realizing method thereof |
| CN103488904A (en) * | 2013-09-27 | 2014-01-01 | 中国人民解放军第三军医大学 | Medical image remote communication system, server and terminal |
| CN104318057A (en) * | 2014-09-25 | 2015-01-28 | 新乡医学院第一附属医院 | Medical image three-dimensional visualization system |
| CN105534476A (en) * | 2015-12-05 | 2016-05-04 | 新乡医学院第一附属医院 | Early detection system for kidney diseases and injuries of department of pediatrics |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200297422A1 (en) * | 2017-12-14 | 2020-09-24 | Olympus Corporation | Operation supporting device and method of operating operation supporting device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107887018A (en) | 2018-04-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Ong et al. | Role of virtual reality in congenital heart disease | |
| Li et al. | Feasibility study applying a parametric model as the design generator for 3D–printed orthosis for fracture immobilization | |
| JP6457262B2 (en) | Method and system for simulating surgery | |
| CN107822690B (en) | Hybrid image/scene renderer with hands-free control | |
| US20190051215A1 (en) | Training and testing system for advanced image processing | |
| JP6081907B2 (en) | System and method for computerized simulation of medical procedures | |
| CN107887018B (en) | Preoperative evaluation system and preoperative evaluation method | |
| Schendel et al. | Three-dimensional imaging and computer simulation for office-based surgery | |
| US20120290976A1 (en) | Network distribution of anatomical models | |
| WO2021011668A1 (en) | Augmented reality system and method for tele-proctoring a surgical procedure | |
| EP3274967A1 (en) | System and method for medical procedure planning | |
| TW201935490A (en) | System and method for patient engagement | |
| Jiang et al. | Registration technology of augmented reality in oral medicine: A review | |
| CN113643790A (en) | Replacement modeling method and system for spine | |
| JP2015506002A (en) | Interaction with 3D object datasets | |
| Scharver et al. | Designing cranial implants in a haptic augmented reality environment | |
| CN115005981A (en) | Surgical path planning method, system, equipment, medium and surgical operation system | |
| CN116052864B (en) | Digital twinning-based puncture operation robot virtual test environment construction method | |
| Xin et al. | Image fusion in craniofacial virtual reality modeling based on CT and 3dMD photogrammetry | |
| WO2016110816A1 (en) | Orthopedic surgery planning system | |
| Schendel et al. | Image fusion in preoperative planning | |
| Berkley et al. | Creating fast finite element models from medical images | |
| Schendel et al. | A web-based, integrated simulation system for craniofacial surgical planning | |
| CN116747017A (en) | Cerebral hemorrhage operation planning system and method | |
| Priya et al. | From Vision to Reality: Virtual Reality’s Impact on Baffle Planning in Congenital Heart Disease |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211025 Address after: 201203 room B08, 21 / F, Zhangjiang building, No. 289, Chunxiao Road, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Patentee after: Shanghai Weiwei Investment Holding Co.,Ltd. Address before: 201 203 No. 501, Newton Road, Zhangjiang High-tech Park, Pudong New Area, Shanghai Patentee before: SHANGHAI MICROPORT MEDICAL (GROUP) Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 201203 room B08, 21 / F, Zhangjiang building, No. 289, Chunxiao Road, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Patentee after: Minimally invasive Investment Holdings Ltd. Address before: 201203 room B08, 21 / F, Zhangjiang building, No. 289, Chunxiao Road, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Patentee before: Shanghai Weiwei Investment Holding Co.,Ltd. |