WO2020177725A1 - 一种靶点路径的确定方法 - Google Patents
一种靶点路径的确定方法 Download PDFInfo
- Publication number
- WO2020177725A1 WO2020177725A1 PCT/CN2020/077846 CN2020077846W WO2020177725A1 WO 2020177725 A1 WO2020177725 A1 WO 2020177725A1 CN 2020077846 W CN2020077846 W CN 2020077846W WO 2020177725 A1 WO2020177725 A1 WO 2020177725A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- dimensional
- projection
- position information
- coordinate system
- Prior art date
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/50—Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
- G06V20/647—Three-dimensional objects by matching two-dimensional images to three-dimensional objects
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
- A61B2017/00681—Aspects not otherwise provided for
- A61B2017/00725—Calibration or performance testing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/107—Visualisation of planned trajectories or target regions
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2065—Tracking using image or pattern recognition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/363—Use of fiducial points
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/04—Constructional details of apparatus
- A61B2560/0437—Trolley or cart-type apparatus
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/10—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges for stereotaxic surgery, e.g. frame-based stereotaxis
- A61B90/11—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges for stereotaxic surgery, e.g. frame-based stereotaxis with guides for needles or instruments, e.g. arcuate slides or ball joints
- A61B90/13—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges for stereotaxic surgery, e.g. frame-based stereotaxis with guides for needles or instruments, e.g. arcuate slides or ball joints guided by light, e.g. laser pointers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/50—Supports for surgical instruments, e.g. articulated arms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/03—Recognition of patterns in medical or anatomical images
Definitions
- the application number is 201910161726.6, the application name is “Projection method, device and system and readable storage medium”; the application number is 201910161268.6, the application name is “Determining the target path
- the application number is 201910161263.3, the application name is “target path determination method, device and system, readable storage medium”; the application number is 201910161265.2, the application name is “positioning System and target location method”; the application number is 201910161266.7, the application name is "method, device and system for determining surgical path, readable storage medium”; priority of the Chinese patent application, the entire content of which is incorporated into this application by reference in.
- This application relates to the field of medical technology, and in particular to a method for determining the path of a target point.
- This application provides a method for determining the path of a target point to solve the deficiencies in the related technology.
- a method for determining a path of a target point which is characterized in being applied to a determination system, the determination system includes a separate imaging device and a positioning device, and is connected to the imaging device
- the calibration device, the positioning device includes a guide structure, and the determination method includes:
- the guidance structure is adjusted so that the guidance direction of the guidance structure is consistent with the virtual The path corresponds to the surgical guide path matching.
- step S2 the step of matching the simulated two-dimensional image obtained based on the three-dimensional partial image projection and the two-dimensional projected image obtained based on the affected part includes:
- step S23 the step of obtaining the coincidence degree of the simulated two-dimensional image and the two-dimensional projection image includes:
- the degree of coincidence is calculated according to the degree of edge contour matching between the first projection area and the second projection area.
- step S23 the step of obtaining the coincidence degree of the simulated two-dimensional image and the two-dimensional projection image includes:
- step S23 if the degree of coincidence is less than a preset threshold, adjust the spatial posture of the three-dimensional partial image; and/or adjust the projection parameters for the three-dimensional partial image.
- the step of adjusting the spatial posture of the three-dimensional partial image includes at least one of the following:
- the step of adjusting the projection parameters for the three-dimensional partial image includes at least one of the following:
- the imaging resolution is adjusted, and the imaging resolution is related to the size of the projection imaging plane of the three-dimensional partial image and the image size of the simulated two-dimensional image.
- step S3 it further includes:
- step S32 the step of adjusting the guide structure based on the first image position information includes:
- the guiding structure is adjusted according to the image position information of the multiple position points on the projection path.
- the calibration device includes a calibration plate and a first identification plate, the calibration plate is provided with a plurality of first preset marking points, the first identification plate is provided with a plurality of second preset marking points, in the projection direction, The calibration plate and the first identification plate are arranged at intervals in parallel with each other;
- step S32 the step of adjusting the guidance structure based on the first image position information includes:
- the calibration position information and image position information of the first preset mark point adjust all The guide structure.
- Optional also includes:
- the calibrated two-dimensional projection image is obtained according to the first conversion relationship.
- the positioning device includes a second identification plate on which a plurality of third preset marking points are provided, and the calibration device is separated from the positioning device;
- the positioning coordinate information of the second identification plate in the positioning coordinate system the first conversion relationship and the image of the second identification plate in the image coordinate system
- the coordinate information determines the second conversion relationship
- the perspective coordinate system is related to the focal position information
- the calibration position information in the calibration coordinate system and the first conversion relationship determine the Focus position information.
- step S4 the step of adjusting the guidance structure so that the guidance direction of the guidance structure matches the surgical guidance path corresponding to the virtual path includes:
- the guiding structure is adjusted so that the guiding direction of the guiding structure is the same as the surgical guiding path
- the extension directions coincide.
- the guiding structure includes a beam emitting component
- step S3 the light beam emitted by the light beam component points to the target point
- step S4 the light beam emitted by the beam component matches the path of the target point
- the guiding structure includes an instrument guiding channel
- step S3 the central axis of the instrument guide channel points to the target point
- step S4 the central axis of the instrument guide channel matches the target path.
- the target path determination system further includes a projection device, and in step S4, further includes:
- the three-dimensional local image and the three-dimensional posture information of the virtual path determine the projection position information of the affected part in the projection coordinate system to perform projection according to the projection position information.
- the step of obtaining a third conversion relationship between the projection coordinate system based on the projection device and the perspective coordinate system includes:
- the third conversion relationship between the projection coordinate system and the perspective coordinate system is determined according to the projection position information of the third preset marking point and the positioning coordinate information in the positioning coordinate system.
- the guiding structure includes an instrument guiding channel, it further includes:
- the guiding structure is adjusted so that the guiding direction of the guiding structure points to the target point in the body.
- the present application can determine the perspective coordinate information of the target path through the three-dimensional posture information of the virtual path, so as to assist medical staff in introducing instruments and improve the accuracy of surgery; Moreover, the positioning device in the present application is separated from the shooting device, so that the shooting device can be removed after the first conversion relationship is determined, and the target path can be determined by the positioning device, which avoids the occupation of the surgical space by the shooting device, and is useful for medical care. Personnel perform operations to free up more space.
- the shooting device and the positioning device in this application are independent of each other.
- the positioning ball on the calibration device and the positioning device is used to identify the relative position relationship, so that the shooting device can be removed after the relative position relationship is determined.
- the positioning device is based on the relative position
- the conversion relationship between the relationship and the coordinate system can adjust the guiding structure to point to the target in the body, and realize the positioning of the target in the body. Colleagues avoid the space occupied by the camera.
- This application obtains the three-dimensional posture parameters of the three-dimensional partial image when the simulated two-dimensional image is matched with the two-dimensional image, thereby obtaining the perspective position information of the affected area based on the camera, and further converts the perspective position information to the projection coordinate system through the coordinate conversion relationship Projection is performed in the lower position, so that medical staff can project any suitable position of the affected area according to their needs, which is beneficial to observe the operation process at any time, and realize non-invasive real-time projection.
- Especially the projection of virtual path can provide assistance for medical staff to enter the needle, which is beneficial to improve The accuracy of the operation.
- the surgical path in the affected area is obtained by matching the simulated two-dimensional image and the two-dimensional projection image based on the physical posture parameters of the imaging device, so that the pointing structure can be adjusted to sequentially point to multiple targets constituting the surgical path according to the physical posture parameters.
- a planned route corresponding to the surgical path on the body surface can be obtained.
- the planned route can assist medical staff in implanting surgical instruments and assist in intraoperative path planning, which is beneficial to improve the accuracy of the operation and reduce the pain of the patient.
- This application matches the simulated two-dimensional image with the two-dimensional projection image, and in the case of confirming that the simulated two-dimensional image matches the two-dimensional projection image, according to the projection of the virtual path in the simulated two-dimensional image, the two-dimensional projection image is determined
- the path information allows medical staff to intuitively understand the path information to assist medical staff in determining the current needle entry point and needle entry angle, which is beneficial to improve the accuracy of the operation and reduce the pain of the patient.
- Fig. 1 is a flowchart of a method for determining a target path of the present invention.
- Fig. 2 is a block diagram showing the steps of a method for determining a target path according to an exemplary embodiment.
- Fig. 3 is a block diagram of another method for determining a target path according to an exemplary embodiment.
- Fig. 4 is a schematic structural diagram showing a determination system according to an exemplary embodiment.
- Fig. 5 is a flowchart showing a method for determining a target path according to an exemplary embodiment.
- Fig. 6 is a flowchart showing another method for determining a target path according to an exemplary embodiment.
- Fig. 7 is a schematic diagram showing a simulated two-dimensional image according to an exemplary embodiment.
- Fig. 8 is a schematic diagram showing a two-dimensional projected image according to an exemplary embodiment.
- Fig. 9 is a flow chart for assisting in locating a target according to an exemplary embodiment.
- Fig. 10 is an algorithm model diagram for assisting in locating a target according to an exemplary embodiment.
- Fig. 11 is a flowchart showing yet another projection method according to an exemplary embodiment
- Fig. 12 is a schematic structural diagram showing a calibration device according to an exemplary embodiment.
- Fig. 13 is a flow chart showing a method for positioning a target according to an exemplary embodiment.
- the path determination method of the present invention may include the following steps:
- step S1 a three-dimensional partial image for the affected area and a virtual path located in the three-dimensional partial image are acquired.
- the scan information can be obtained through CT scan or MR image, and the scan information can be input to the computer for reconstruction to obtain a three-dimensional partial image.
- a virtual path can be established for the affected area according to the current state of the affected area shown in the three-dimensional partial image.
- the affected area in this embodiment may include limbs, spine, waist, chest, or head, etc., which is not limited.
- the virtual path can be linear, and the length, width, and angle of the virtual path can be adjusted in the three-dimensional partial image.
- the specific implantable device specifications shall prevail, and the implanted device may include steel nails and the like.
- step S2 the simulated two-dimensional image obtained based on the three-dimensional partial image projection and the two-dimensional projected image obtained based on the affected part are matched.
- a C-arm machine or other X-ray imaging equipment can be used to photograph the affected area to obtain a two-dimensional projection image point.
- the position information of the simulated two-dimensional image and the virtual path in the simulated two-dimensional image can be obtained through the DRR algorithm based on the three-dimensional partial image.
- the degree of coincidence between the two-dimensional projected image and the simulated two-dimensional image can be determined, and when the degree of coincidence is not less than a preset threshold, it can be considered that the two-dimensional projected image matches the simulated two-dimensional image.
- the three-dimensional partial image can be adjusted by Obtain the adjusted simulated two-dimensional image based on the spatial posture of the or the projection parameters of the three-dimensional partial image, and match the adjusted simulated two-dimensional image with the two-dimensional projection image.
- the difference between the simulated two-dimensional image and the two-dimensional projection image may be fed back according to the degree of coincidence between the simulated two-dimensional image and the two-dimensional projection image, so that the three-dimensional The spatial posture of the partial image or adjust the projection parameters for the three-dimensional partial image.
- the process of matching the simulated two-dimensional image and the two-dimensional projection image can also simultaneously adjust the spatial posture of the three-dimensional partial image and the projection parameters for the three-dimensional partial image.
- the simulated two-dimensional image obtained based on the three-dimensional partial image projection matches the two-dimensional projected image obtained based on the affected part, the three-dimensional posture information of the virtual path is acquired. Adjust the spatial posture or projection parameters of the three-dimensional partial image in turn at regular intervals.
- the three-dimensional posture parameter of the three-dimensional partial image at this time is the perspective position information of the affected part relative to the perspective coordinate system of the imaging device.
- the posture information can be used as the perspective position information of the surgical path to be established in the affected area in the perspective coordinate system.
- perspective projection can be performed on the affected area to obtain a two-dimensional projection image; a three-dimensional partial image can be projected to obtain a simulated two-dimensional image; the coincidence degree of the simulated two-dimensional image and the two-dimensional projected image can be obtained, and the coincidence degree is not less than a preset threshold
- the difference between the simulated two-dimensional image and the two-dimensional projected image can be fed back according to the degree of coincidence between the simulated two-dimensional image and the two-dimensional projection image, so as to adjust the spatial posture and/or the three-dimensional partial image according to the degree of coincidence.
- Adjust the projection parameters for 3D partial images may be adjusted sequentially at certain regular intervals, which is not limited in this application.
- Adjusting the spatial posture of the three-dimensional partial image may be adjusting the rotation angle of the three-dimensional partial image with respect to at least one coordinate axis, or may be adjusting the displacement of the three-dimensional partial image with respect to at least one coordinate axis. Of course, in other embodiments, the rotation angle and displacement of any coordinate axis can also be adjusted.
- Adjusting the projection parameters for the three-dimensional partial image may be adjusting one or more parameters among the position of the virtual light source, the focal length of the virtual light source, and the imaging resolution. Among them, the imaging resolution is used to characterize the relationship between the pixel and the geometric size, which is related to the size of the projected imaging plane of the three-dimensional partial image and the image size of the two-dimensional projected image.
- the degree of overlap between the simulated two-dimensional image and the two-dimensional projection image can be implemented in the following manner:
- the degree of coincidence may be obtained by matching the two-dimensional projected image and the simulated two-dimensional image by the user.
- the first projection area in the simulated two-dimensional image and the second projection area in the two-dimensional projection image can be extracted, and according to the degree of edge contour matching between the first projection area and the second projection area, Coincidence degree.
- both the simulated two-dimensional image and the two-dimensional projection image may be divided along a preset direction according to a preset ratio, and each divided area of the simulated two-dimensional image and the divided area corresponding to the two-dimensional projection image may be divided. Match to get the degree of coincidence.
- step S3 when the simulated two-dimensional image and the two-dimensional projection image match, the surgical guide path corresponding to the virtual path on the two-dimensional projection image is determined according to the position information of the virtual path on the simulated two-dimensional image.
- the posture information of the three-dimensional partial image at this time can be used as the perspective position information of the affected part based on the perspective coordinate system of the shooting device, so that the three-dimensional partial image at this time
- the position information of the virtual path in the simulated two-dimensional image can be used as the posture information of the surgical path in the two-dimensional projection image, so that the surgical path in the two-dimensional projection image can be obtained, which is helpful for medical staff to understand the needle insertion of the surgical instrument
- the point and the angle of the needle will then help improve the accuracy of the operation and reduce the pain of the patient.
- Fig. 3 is a flowchart showing a determining method according to another exemplary embodiment.
- step S4 when the simulated two-dimensional image and the two-dimensional projection image match, the three-dimensional posture information of the virtual path on the three-dimensional partial image is obtained as the surgical guide path based on the perspective coordinate system
- the perspective coordinate information of, the perspective coordinate system is formed based on the camera;
- the guidance structure is adjusted so that the guidance direction of the guidance structure matches the surgical guidance path corresponding to the virtual path.
- the three-dimensional posture information of the virtual path is the perspective position information of the surgical path to be established in the affected area relative to the perspective coordinate system on the imaging device, and according to the second conversion relationship, it can be obtained that the surgical path is in the positioning coordinate system
- the positioning position information of the guide structure is located on the positioning device, so that the positioning position information of the guide structure relative to the positioning coordinate system is known, so the positioning position information of the surgical path in the positioning coordinate system and the guide structure relative to the positioning coordinates Adjust the guidance structure to make the guidance direction of the guidance structure match the virtual path.
- the path determination method of the present invention can also perform step S4 while performing step S3, and the execution process is the same as the above steps, and will not be repeated here.
- the determination system may include a photographing device 1, a calibration device 2, a positioning device 3.
- the display device 4 may optionally include a two-dimensional positioning device (not shown in the figure) and a projection module 5.
- the positioning device 3 is physically separated from the photographing device 1, and the positioning device 3 may include a guiding structure 31.
- the imaging device can be used to photograph the affected area to obtain a two-dimensional projection image.
- the calibration device 2 is connected to the imaging device 1, and the projection light emitted by the imaging device 1 passes through the calibration device 2.
- the above-mentioned second conversion relationship can be obtained through the positioning coordinate system of the positioning device 3 and the perspective coordinate system based on the photographing device 1, and the display device can be connected to the photographing device in a wired or wireless manner.
- the display device may also include a display, which may be used to show related images such as a three-dimensional partial image, a two-dimensional projected image, and a simulated two-dimensional image.
- the computer may also include a processor (not shown in the figure) and a memory for storing instructions executable by the processor.
- the projection module 5 determines the projection position information of the affected part in the projection coordinate system according to the three-dimensional partial image and the three-dimensional posture information of the virtual path and the third conversion relationship, so as to perform projection according to the projection position information.
- the coordinate system identified based on the camera 1 is the perspective coordinate system
- the coordinate system identified based on the calibration device 2 is the calibration coordinate system
- the coordinate system identified based on the positioning device 3 is the positioning coordinate system.
- the light emitted by the photographing device 1 passes through the calibration device 2, thereby obtaining the projection image of the calibration device 2, and according to various presets in the projection image of the calibration device 2
- the image position information of the point in the image coordinate system and the calibration position information of the preset point in the calibration coordinate system determine the first conversion relationship between the focus position information, the image coordinate system and the calibration coordinate system of the photographing device 1.
- the calibration device 2 includes a calibration plate 21 and a first identification plate 22, the calibration plate 21 includes a plurality of first positioning balls, and the first identification plate 22 includes a plurality of second positioning balls 221.
- the positioning device 3 includes a second identification plate 31 and a beam emitting structure 32.
- the second identification plate 31 includes a plurality of third positioning balls, and the plurality of third positioning balls are used to determine the positioning coordinate system and the perspective.
- the positioning system also includes a calculation device (not shown in the figure), which can be based on the focus position information, the first conversion relationship, the second conversion relationship, the image coordinate information and the positioning coordinates of the target in the image coordinate system
- the position information of the guidance structure is tied, and an adjustment instruction is generated, and the adjustment instruction is used to adjust the guidance structure so that the guidance structure points to the target point.
- the guiding structure includes a beam emitting component, the light emitted by the beam emitting component is directed to a target in the body, and the position information of the beam can be positioned later to adjust the guiding channel; or, the guiding structure can also include an instrument surgical channel, The instrument can be positioned through the instrument guide channel; or, the positioning device 3 can also include both the beam emitting component and the instrument guide channel.
- the positioning device 3 may further include a mechanical arm 34 connected to the clamping structure 33, so that when the mechanical arm 34 drives the clamping structure 33 to move or rotate, the second The identification plate 31 and the guiding structure 32 move or rotate synchronously, so that the position of the guiding structure 32 can be moved so that the light emitted by it is directed to the target point in the body (the specific method will be described in detail later).
- the positioning device 3 may further include a sliding base 35.
- the sliding base 35 may be a trolley structure, and a shelf may be provided on the sliding base 35 for placing other supporting structures.
- the posture parameters of the three-dimensional partial image can be used as the physical posture parameters of the affected area based on the imaging device. Therefore, the posture parameters of the virtual path can be used as the actual surgical path based on the physical posture parameters of the camera. Therefore, according to the image position information of multiple position points on the virtual path on the simulated two-dimensional image, the guidance structure can be adjusted, and the guidance direction of the guidance structure can point to the corresponding target points in the affected area in turn.
- the determination method of the present invention is based on the above determination system which can be applied to determine the target path on the perspective image.
- a two-dimensional positioning device is used to install on the camera 1 of the determination system.
- the calibration device 2 is removed, and the two-dimensional positioning device is installed at the position where the calibration device 2 is installed on the imaging device 1.
- the two-dimensional positioning device has the same double-layer board structure as the calibration device 2, and the interval between the double-layer boards is the same as the interval between the double-layer boards of the calibration device 2.
- the determination system can obtain the first preset mark point (i.e., the first positioning ball) and the second preset mark point (i.e., the second positioning ball 221) that are arranged at intervals in the projection direction on the original calibration device 2
- the image position information of each first preset mark point and second preset mark point in the image coordinate system where the image coordinate system is formed based on the projection image of the two-dimensional positioning device replacing the calibration device 2; Image position information of a preset marker point in the image coordinate system, positioning coordinate information of a plurality of first preset marker points in the positioning coordinate system of the two-dimensional positioning device, and image position of each position point in the image coordinate system Information, it is determined that the first positioning point is based on the positioning coordinate information of the positioning coordinate system, and the first positioning point and the corresponding position point coincide in the image coordinate system; according to the image position information of the plurality of second preset marking points in the image coordinate system, Positioning coordinate information of multiple second preset marking points in the positioning coordinate system of the two-dimensional positioning device, image position information
- the image position information of the projection path matching the two-dimensional projection image with the virtual path can be obtained through the image position information of the virtual path on the two-dimensional simulation image, and the image position information of the projection path matching the virtual path can be obtained according to the position information of multiple position points on the projection path.
- the image position information adjusts the guide structure.
- the first conversion between the positioning coordinate system and the image coordinate system may be determined according to the positioning position information of the plurality of third preset marking points in the positioning coordinate system and the image coordinate information in the image coordinate system According to the first conversion relationship, a calibrated two-dimensional projection image is obtained to reduce image distortion and distortion, and improve the accuracy of pointing the pointing structure to the target point.
- the process of determining the surgical guide path corresponding to the virtual path on the two-dimensional projection image may include the following steps:
- step 101 a three-dimensional partial image is reconstructed according to the scan information.
- step 102 a virtual path located in the three-dimensional partial image is acquired, where the method of acquiring the virtual path is as described above, and will not be repeated here.
- step 103 the spatial posture and/or projection parameters of the three-dimensional partial image are adjusted.
- the adjustment method is as mentioned before, and will not be repeated here.
- step 104 projection is performed on the three-dimensional partial image to obtain a simulated two-dimensional image.
- step 105 the first projection area is extracted based on the simulated two-dimensional image.
- step 106 the affected area is photographed to obtain a two-dimensional projection image.
- step 107 the second projection area is extracted based on the two-dimensional projection image.
- this application uses image processing to extract the first projection area in the simulated two-dimensional image and the second projection area in the two-dimensional projection image.
- the image processing may be based on gray value extraction of the patient area in the simulated two-dimensional image and the patient area in the two-dimensional projection image.
- step 108 the edge contours of the first projection area and the second projection area are matched to obtain the degree of coincidence.
- the edge contours of the first projection area and the second projection area may be matched to obtain the degree of coincidence between the two-dimensional projection image and the simulated two-dimensional image. For example, based on the marking point on the first projection area and the corresponding position of the marking point on the second projection area, the relative position of the first projection area and the second projection area may be adjusted so that the marking point and the marking The corresponding positions of the points on the second projection area basically coincide, and then edge contour matching is performed.
- the marking point may be a special area on the affected part, such as a nerve marking point, a bone marking point, etc., which is not limited in this application.
- step 109 it is determined whether the degree of coincidence is greater than a preset threshold.
- step 110 when the distance between the two-dimensional projection image and the simulated two-dimensional image is greater than or equal to the preset threshold, step 110 is executed, and when the distance between the two-dimensional projection image and the simulated two-dimensional image is less than the preset threshold, step 103 is executed.
- the adjustment amount and adjustment direction for the three-dimensional local image space attitude and the projection parameter can be determined according to the degree of coincidence, so as to improve the matching efficiency.
- step 110 the position information of the virtual path in the simulated two-dimensional image is obtained.
- step 111 according to the position information of the virtual path in the simulated two-dimensional image, the position information of the surgical path in the two-dimensional projection image (that is, the surgical guide path) is determined.
- the degree of coincidence between the simulated two-dimensional image and the two-dimensional projection image is already greater than or equal to the preset threshold. Therefore, based on the projection information of the virtual path in the simulated two-dimensional image, the position information of the surgical path on the two-dimensional partial image can be determined, and the needle insertion point and needle insertion direction can be obtained.
- Steps S1 to S3 the process of determining the surgical guidance path corresponding to the virtual path on the two-dimensional projection image may include the following steps:
- step 201 a three-dimensional partial image is reconstructed according to the scan information.
- step 202 a virtual path located in the three-dimensional partial image is acquired.
- step 203 the spatial posture and projection parameters of the three-dimensional partial image are adjusted.
- step 204 the three-dimensional partial image is projected to obtain a simulated two-dimensional image.
- steps 201-204 can refer to steps 101-104 in the embodiment shown in FIG. 5, which will not be repeated here.
- step 205 the simulated two-dimensional image is divided along a preset direction according to a preset ratio.
- step 206 the affected area is photographed to obtain a two-dimensional projection image.
- step 207 the two-dimensional projection image is divided along a preset direction according to a preset ratio.
- each segmented image of the simulated two-dimensional image is matched with the segmented image of the corresponding area on the two-dimensional projection image.
- step 209 according to the matching result, the degree of coincidence between the simulated two-dimensional image and the two-dimensional projection image is calculated.
- each divided area in FIG. 7 has a corresponding area in FIG. 8, for example, the divided area D1 in the second row and third column in FIG. , Corresponding to the segmented area d1 in the second row and third column in FIG. 8, and the segmented area D1 can be further matched with d1 to obtain a matching value.
- other segmented regions in FIG. 7 can be matched with the corresponding segmented regions in FIG. 8 to obtain the degree of coincidence.
- each divided region may correspond to a weight coefficient, and the sum of the product of the matching degree and the weight coefficient of each divided region and the product of the matching degree and the weight coefficient of other divided regions is the degree of coincidence.
- step 210 it is determined whether the degree of coincidence is greater than a preset threshold.
- step 211 when the distance between the two-dimensional projection image and the simulated two-dimensional image is greater than or equal to the preset threshold, step 211 is executed, and when the distance between the two-dimensional projection image and the simulated two-dimensional image is less than the preset threshold, step 203 is executed. .
- step 211 the position information of the virtual path in the simulated two-dimensional image is obtained.
- step 212 according to the position information of the virtual path in the simulated two-dimensional image, the surgical path (that is, the surgical guide path) pointing to the target point in the two-dimensional projection image is determined.
- steps 211 and 212 can refer to steps 110 and 111 in the embodiment shown in FIG. 5, which will not be repeated here.
- the process of the auxiliary method for determining the target point may include the following steps:
- step 301 the calibration position information O 1 _2d of the first preset mark point O in the calibration coordinate system XOY is acquired.
- the captured image of the C-arm machine can be calibrated by the preset calibration device.
- the preset calibration device can be provided with multiple first preset mark points, the calibration coordinate system is located at any position on the preset calibration device, and each first preset mark point is located on the calibration device, so that each The calibration position information of a first preset mark point is known.
- a calibration coordinate system XOY can be established based on the extension direction of the upper surface, and the physical structure size of the calibration plate can be used to obtain the position of each first positioning ball. Calibration position information in the calibration coordinate system XOY.
- the positioning position information of the plurality of first preset marking points O may be represented as O 1 _2d.
- the positioning position information O 1 _2d may include O1 (X1, Y1), O2 (X2, Y2)... (Xn, Yn), the specific number is Application is not restricted.
- step 302 the image position information O 2 _2d when the distortion of the first preset mark point O occurs in the image coordinate system MON is obtained.
- the image coordinate system is formed based on the two-dimensional image projected by the C-arm machine.
- the two-dimensional image will include a plurality of projection points corresponding to the first preset mark points, and the image positions of the plurality of projection points when the image coordinate system MON is distorted Information O 2 _2d.
- the image position information O 2 _2d when the distortion occurs may include O1 (M1, N1), O2 (M2, N2)... (Mn, Nn) The specific number is not limited in this application.
- step 303 the first conversion relationship T1 between the calibration coordinate system XOY and the image coordinate system MON is calculated according to the calibration position information O 1 _2d of the first preset mark point and the distorted image position information O 2 _2d when the distortion occurs.
- step 304 the affected area is projected, and the calibrated two-dimensional projection image is obtained according to the first conversion relationship T1.
- the functional relationship between the calibration position information and the distorted image position information can be established by mathematical methods, and the first conversion relationship T1 can be solved according to the functional relationship.
- N b 0 +b 1 X+b 2 Y+b 3 X 2 +b 4 XY+b 5 Y 2 +b 6 X 3 +b 7 X 2 Y+b 8 XY 2 +b 9 Y 3 +...
- (M, N) is the image position information when distortion occurs
- (X, Y) is the calibration position information
- a 0 La 9 , b 0 L b 9 are used to represent the first conversion relationship T1.
- the first conversion relationship T1 represents the conversion relationship between the distorted image and the undistorted image. Therefore, after the two-dimensional projection image of the affected area in a distorted state is obtained by shooting with the C-arm machine, calibration can be performed through the first conversion relationship, so as to obtain a calibrated two-dimensional projection image.
- step 305 a three-dimensional partial image and a virtual path located in the three-dimensional partial image are acquired.
- three-dimensional reconstruction can be performed based on the scan information of the C-arm machine or the scan information of other equipment, so as to obtain a three-dimensional partial image based on the affected area. Further, a virtual path can be established for the affected area according to the current state of the affected area shown in the three-dimensional partial image.
- step 306 the three-dimensional partial image is projected to obtain a simulated two-dimensional image.
- step 307 the degree of coincidence between the simulated two-dimensional image and the two-dimensional projection image is acquired, and when the degree of coincidence is not less than a preset threshold, it is determined that the simulated two-dimensional image matches the two-dimensional projection image.
- step 305 to step 307 can be seen in the embodiment shown in FIG. 5 to FIG. 8.
- step 308 the image position information B1_2d of the multiple position points B of the virtual path in the image coordinate system is obtained.
- the image position information of each position point in the virtual path in the image coordinate system at this time can be used as the surgical path in the affected area.
- step 309 obtain the image position information P1_2d, Q1_2d, and the positioning position information in the positioning coordinate system of the plurality of first preset marking points P and the plurality of second preset marking points Q in the image coordinate system MON. P2_2d, Q2_2d.
- the target path assisting method can be applied to an assisting system for determining a target path.
- the assisting system for determining a target path may include a positioning device, and the positioning device may include a plurality of locations on the first plane.
- the positioning position information of each positioning mark point in the positioning coordinate system formed by the positioning device can be obtained, where the positioning position information of the multiple first preset mark points P can be expressed as P 2 _2d, multiple The location information of the second preset marking point Q is represented as Q 2 _2d.
- the calibrated image position information P 1 _2d of the first preset marker point P and the calibrated image position information of the second preset marker point Q can be obtained based on the first conversion relationship T1 when the positioning device is photographed by the C-arm machine.
- Image location information Q 1 _2d the first preset mark point P and the second preset mark point Q are on different planes, so as to facilitate the subsequent construction of the slave station based on the position information of the first preset mark point P and the second preset mark point Q on different planes.
- step 310 the beam emitting device is adjusted according to P1_2d, P2_2d, B1_2d, Q1_2d, and Q2_2d, so that the light emitted by the beam emitting device points to the target point.
- the first preset marking point P includes marking points P1 and P2
- the second preset marking point Q includes marking points Q1 and Q2
- point B is the target point.
- the coordinate system MON is established on the plane perpendicular to the central ray T; then, in the M-axis direction in the MOT plane, the calibrated image position information T1 and T2 of P1 and P2 can be obtained, and the position information can be marked according to the positioning coordinate system
- and the number of pixels between the marked points P1 and P2 in the image coordinate system determine the resolution of the projected image, and further according to the resolution of the projected image, mark the point P1
- the beam emitting device can be adjusted according to the position information of the beam emitting device in the positioning coordinate system and the positional relationship between the beam emitting device and points P1 and Q1. The light emitted by the beam emitting device passes through points P1 and Q1, Therefore, the beam will point to the target point B.
- step 309 and step 310 are respectively performed for multiple position points on the virtual path, the planned path formed by the points when the light beam passes through the body surface can be obtained, so that the planned path can assist medical staff in performing surgery and improve accuracy degree.
- Fig. 11 is a flowchart showing a projection method according to an exemplary embodiment. It can be applied to the device shown in FIG. 4, the target path determination system can include a projection device 5, and a projection coordinate system can be established based on the projection device. As shown in Figure 11, the following steps may be included:
- step 601 the coordinates E 1_ 3d of the fourth positioning ball E based on the calibration coordinate system are acquired.
- the fourth positioning ball E may be set on the calibration device, so that the coordinates E 1_ 3d of the fourth positioning ball E relative to the calibration coordinate system are known.
- step 602 the fourth positioning ball acquired by the projection device is based on the coordinates E 2 _3d in the projection coordinate system.
- step 603 the third conversion relationship T3 between the projection coordinate system and the perspective coordinate system is calculated according to the coordinates E 1 _3d and E 2 _3d.
- the focus position information J_3d of the camera is solved by the calibration device, that is, the focus position information J_3d is based on the position coordinate information in the calibration coordinate system, and the perspective coordinate system is The focal point of the camera is the coordinate system established by the origin, so the conversion relationship between the calibration coordinate system and the perspective coordinate system is known, which is recorded as the fourth conversion relationship T4.
- step 604 projection is performed according to the focus position information, the third conversion relationship, and the posture information of the three-dimensional partial image.
- the third conversion relationship between the projection coordinate system based on the projection device and the perspective coordinate system based on the shooting device is acquired. Furthermore, when the simulated two-dimensional image obtained based on the three-dimensional partial image projection matches the two-dimensional projection image obtained based on the affected area, the three-dimensional posture information of the three-dimensional partial image is obtained; according to the three-dimensional partial image and the three-dimensional posture information of the virtual path, the third The conversion relationship is used to determine the image position information of the affected part in the projection coordinate system to perform projection according to the image position information.
- the fluoroscopic position information of the instrument guiding channel in the fluoroscopy coordinate system can be obtained according to the second conversion relationship and the positioning position information of the instrument guiding channel in the positioning coordinate system; according to the third conversion relationship, the instrument
- the perspective position information of the guide channel in the perspective coordinate system is used to obtain the projection position information of the instrument guide channel in the projection coordinate system to perform projection according to the projection position information, so as to perform the projection of the operation or the surgical process, which can guide the affected area and the instrument
- the channel is projected to a position that is convenient for medical staff to view, and it is convenient to perform surgical operations.
- the present application obtains the 3D posture parameters of the 3D partial image when the simulated 2D image is matched with the 2D image, so as to obtain the perspective position information of the affected area based on the imaging device, and further transform the perspective position through the coordinate conversion relationship.
- the information is converted to the projection coordinate system for projection, so that medical staff can project any suitable position of the affected area according to their needs, which is beneficial to observe the operation process at any time and realize non-invasive real-time projection, especially the projection of virtual path can be used for medical staff to enter the needle Provide assistance to improve the accuracy of the operation.
- Fig. 13 is a flow chart showing another target location method according to an exemplary embodiment. As shown in Fig. 13, the target location method may include the following steps:
- step 701 the calibration position information O 1 _2d of the first positioning ball (that is, the first preset mark point) O in the calibration coordinate system XOY is obtained.
- the calibration position information O 1 _2d of the first positioning ball (that is, the first preset mark point) O in the calibration coordinate system XOY is obtained.
- step 702 the image position information O 2 _2d of the first positioning ball O in the image coordinate system MON is obtained. For details, refer to step 302.
- step 703 according to the calibration position information O 1 _2d of the first positioning ball 211 and the image position information O 2 _2d of the first positioning ball 211, a first conversion relationship T1 between the calibration coordinate system and the image coordinate system is calculated, See steps 303-304 for details.
- step 704 the image position information P 1 _2d of the second positioning ball 221 in the image coordinate system MON is acquired.
- the image position information P of the second positioning ball 221 1 _2d may include P1 (M1, N1), P2 (M2, N2) & Pn (Mn, Nn).
- step 705 according to the first conversion relationship T1 and the image position information of the second positioning ball 221, the three-dimensional coordinates P 2 _3d of the projection of the second positioning ball on the plane where the first positioning ball is located are calculated.
- the plane where the first positioning ball 211 is located is the position of the calibration plate 21.
- the projected coordinates P 3 _2d of the second positioning ball 221 on the calibration plate 21 can be obtained, and the P 3 _2d may include P1 (X1, Y1), P2 (X2, Y2)... Pn (Xn, Yn) ), and in this embodiment, it can be assumed that the calibration coordinate system is located on the calibration plate, so the Z coordinate of the projection point of the second positioning ball 221 on the calibration plate 21 is zero, thereby obtaining the three-dimensional coordinate P 2 _3d projected by the second positioning ball 221 : P1 (X1, Y1, 0), P2 (X2, Y2, 0)... Pn (Xn, Yn, 0).
- step 706 the calibration position information P 3 _3d of the second positioning ball P in the calibration coordinate system XOY is acquired.
- the calibration position information of each second positioning ball on the first identification plate 22 in the calibration coordinate system can be obtained, and the calibration position
- the information P 3 _3d may indicate that it includes Pj1 (X1, Y1, Z1), Pj2 (X2, Y3, Z3)...Pj3 (X1, Y1, Z1).
- step 707 the focus position information J_3d is obtained according to P 2 _3d and P 3 _3d.
- each second positioning ball 221 on the first identification plate 22 can form a projection point on the calibration plate 21.
- the projection of the second positioning ball 221 on the calibration plate 21 has a physical space corresponding to the second positioning ball 221.
- the calibration position information of a second positioning ball 221 in the calibration coordinate system is Pj1 (X1, Y1, Z1)
- the position information projected by the second positioning ball 221 on the calibration plate 21 is P1 (X1, Y1, 0)
- P1 (X1, Y1, 0) and Pj1 (X1, Y1) , Z1 The straight line between the two points must pass through the light source.
- the position information of the light source that is, focus position information J_3d
- the Z-axis coordinates of the focus position information J_3d are the light source and the projection imaging plane. the distance between.
- the projection transformation matrix A between the three-dimensional coordinates of any point in the perspective coordinate system and the corresponding point in the projection image can be obtained.
- step 708 the image obtaining position information of the third positioning the ball in the image coordinate system Q 1- 2d.
- the two-dimensional coordinates Q 1 _2d may include Q1 (M1, N1), Q2 (M2, N2)... Qn (Mn , Nn).
- step 709 the positioning position information Q 3 _3d of the third positioning ball 311 in the positioning coordinate system is acquired.
- a positioning coordinate system can be established on the positioning device 3, and since the relative position relationship between the various structures on the positioning device 3 is known, the positioning position of the third positioning ball 311 in the positioning coordinate system can be obtained.
- Information Q 3 _3d is the position of the third positioning ball 311 in the positioning coordinate system.
- step 710 the coordinate information from the focus J_3d, third detent ball 311 of the positioning position information Q 3 _3d, positioning the ball third two-dimensional coordinates in the image coordinate system Q of 1- 2d, fluoroscopy coordinate system and acquires positioning coordinates The second conversion relationship between T2.
- the perspective position information of the third positioning ball in the perspective coordinate system is Q 2 _3d
- Q Q 1- 2d F2 (T1, a, Q 2 _3d).
- a third detent ball 311 of the positioning position information Q 3 _3d are known, can be calculated location coordinates
- the matrix can be continuously matched through the optimization algorithm, and the optimal matrix obtained is the second conversion relationship.
- the least square method or other optimization algorithms can be used, and this application is not limited.
- step 711 obtain the image coordinate information B_2d of the target point in the body (that is, the image information of the surgical path on the two-dimensional projection image) in the image coordinate system, and obtain the image coordinate information B_2d based on the first conversion relationship T1, the focus position information J_3d, and the second conversion With relation T2, the positioning position information B_3d of the target in the body under the positioning coordinate system is obtained.
- the three-dimensional coordinates B_3d of the target point in the body based on the positioning device 3 can be obtained.
- step 712 the positioning position information G_3d of the guiding structure 32 in the positioning coordinate system is obtained.
- the positioning position information of the guiding structure 32 can be calculated from the position information of the second identification plate 31.
- the positioning position information G_3d of the guide structure 32 can also be obtained in other ways, for example, in a pre-stored way, which is not limited in this application.
- step 713 according to the positioning position information B_3d of the target in the body in the positioning coordinate system and the positioning position information G_3d of the guide structure 32, the guide structure 32 is adjusted so that the guide structure 32 points to the target in the body.
- the beam emission can be adjusted by the movement of the mechanical arm 34 or the joint movement of the mechanical arm 34 and the sliding base 35. Location of structure 32.
- step 710 the following steps may be performed to realize the three-dimensional positioning of the robotic arm:
- the calibrated two-dimensional projection image is obtained through the first transformation relationship T1.
- the degree of coincidence between the simulated two-dimensional image and the calibrated two-dimensional projection image is acquired, and when the degree of coincidence is not less than a preset threshold, it is determined that the simulated two-dimensional image matches the two-dimensional projection image.
- the posture information of the virtual path According to the posture information of the virtual path and the second conversion relationship, the positioning position information of the virtual path in the positioning coordinate system is obtained.
- the beam emitting component is adjusted so that the light emitted by the beam emitting component matches the virtual path.
- an adjustment instruction can be generated to adjust the beam emitting component.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Molecular Biology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Robotics (AREA)
- Computing Systems (AREA)
- Artificial Intelligence (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- Software Systems (AREA)
- Gynecology & Obstetrics (AREA)
- Radiology & Medical Imaging (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Pathology (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
一种靶点路径的确定方法,应用于确定***,确定***包括相互分离的拍摄装置(1)和定位装置(3),与拍摄装置(1)相连接的校准装置(2),包括:S1.获取针对患处的三维局部图像和位于三维局部图像内的虚拟路径;S2.匹配基于三维局部图像投影得到的仿真二维图像和基于患处得到的二维投影图像;S3.当仿真二维图像和二维投影图像匹配时,根据虚拟路径在仿真二维图像上的位置信息,确定二维投影图像上与虚拟路径对应的手术导引路径;和/或,S4.当仿真二维图像和二维投影图像匹配时,获取虚拟路径在三维局部图像上的三维姿态信息;根据透视坐标信息、透视坐标系和基于定位装置(3)的定位坐标系之间的第二转换关系,使指引结构(32)的方向与手术导引路径匹配。
Description
本申请要求于2019年03月04日提交中国专利局,申请号为201910161726.6、申请名称为“投影方法、装置及***和可读存储介质”;申请号为201910161268.6、申请名称为“确定靶点路径的辅助方法、装置和***、可读存储介质”;申请号为201910161263.3、申请名称为“靶点路径的确定方法、装置和***、可读存储介质”;申请号为201910161265.2、申请名称为“定位***和靶点定位方法”;申请号为201910161266.7、申请名称为“手术路径的确定方法、装置和***、可读存储介质”;的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及医疗技术领域,尤其涉及一种靶点路径的确定方法。
当前,在通过手术器械对患处进行手术时,通常需要***患处内部,而准确获取患肢内的路径,可以大大提高手术的精度,减少X片的拍摄次数,减少辐射,减低患者痛苦。基于路径的重要性,如何提高路径精度已然成为了实际人员亟待解决的一个技术难题。
发明内容
本申请提供一种靶点路径的确定方法,以解决相关技术中的不足。
根据本申请实施例的第一方面,提供一种靶点路径的确定方法,其特征在于,应用于确定***,所述确定***包括相互分离的拍摄装置和定位装置,与所述拍摄装置相连接的校准装置,所述定位装置包括指引结构,所述确定方法包括:
S1.获取针对患处的三维局部图像和位于所述三维局部图像内的虚拟路径;
S2.匹配基于所述三维局部图像投影得到的仿真二维图像和基于患处 得到的二维投影图像;
S3.当所述仿真二维图像和所述二维投影图像匹配时,根据所述虚拟路径在所述仿真二维图像上的位置信息,确定所述二维投影图像上与所述虚拟路径对应的手术导引路径;和/或,
S4.当所述仿真二维图像和所述二维投影图像匹配时,获取所述虚拟路径在所述三维局部图像上的三维姿态信息,以作为所述手术导引路径基于透视坐标系的透视坐标信息,所述透视坐标系基于所述拍摄装置形成;
根据所述手术导引路径的透视坐标信息、所述透视坐标系和基于所述定位装置的定位坐标系之间的第二转换关系,调整指引结构使得所述指引结构的指引方向与所述虚拟路径对应的手术导引路径匹配。
可选的,步骤S2中,匹配基于所述三维局部图像投影得到的仿真二维图像和基于患处得到的二维投影图像的步骤中包括:
S21.对所述患处进行透视投影得到所述二维投影图像;
S22.对所述三维局部图像进行投影得到所述仿真二维图像;
S23.获取所述仿真二维图像和所述二维投影图像的重合度,在所述重合度不小于预设阈值时,确定为所述仿真二维图像与所述二维投影图像匹配。
可选的,步骤S23中,获取所述仿真二维图像和所述二维投影图像的重合度的步骤中包括:
提取所述仿真二维图像中的第一投影区域和所述二维投影图像中的第二投影区域;
根据所述第一投影区域和所述第二投影区域之间的边缘轮廓匹配程度计算所述重合度。
可选的,步骤S23中,获取所述仿真二维图像和所述二维投影图像的重合度的步骤中包括:
将所述仿真二维图像和所述二维投影图像均按照预设比例沿预设方向进行分割;
将所述仿真二维图像的每一分割区域与所述二维投影图像对应的分割区域进行匹配得到所述重合度。
可选的,步骤S23中,若所述重合度小于预设阈值时,调整所述三维局部图像的空间姿态;和/或,调整针对所述三维局部图像的投影参数。
可选的,调整所述三维局部图像的空间姿态的步骤中包括下述至少之一:
调整所述三维局部图像针对至少一个坐标轴的旋转角度;
调整所述三维局部图像针对至少一个坐标轴的位移;
调整针对所述三维局部图像的投影参数的步骤中包括下述至少之一:
调整焦距;
调整虚拟光源的位置;
调整成像分辨率,所述成像分辨率与所述三维局部图像的投影成像平面的尺寸以及所述仿真二维图像的图像尺寸相关。
可选的,步骤S3中,还包括:
S31.获取所述二维投影图像上与所述虚拟路径对应的多个位置点的第一图像位置信息;
S32.基于所述第一图像位置信息调整指引结构,使得所述指引结构的指引方向依次指向患处对应于所述手术导引路径上多个位置点的多个靶点。
可选的,步骤S32中,基于所述第一图像位置信息调整指引结构的步骤中包括:
根据所述虚拟路径在所述二维仿真图像上的图像位置信息,获取所述二维投影图像上与所述虚拟路径匹配的投影路径的图像位置信息;
根据所述投影路径上多个位置点的图像位置信息调整所述指引结构。
可选的,所述校准装置包括校准板和第一标识板,校准板设置有多个第一预设标记点、第一标识板设置有多个第二预设标记点,在投影方向上,所述校准板和所述第一标识板相互平行的间隔设置;
步骤S32中,基于所述第一图像位置信息调整指引结构的步骤中包括:
获取第一平面上每一第一预设标记点和第二平面上每一所述第二预设标记点在校准坐标系中的校准位置信息;
获取第一平面上每一第一预设标记点和第二平面上每一所述第二预设标记点在图像坐标系中的图像位置信息,所述图像坐标系基于所述校准装 置的投影图像形成;
根据所述第一预设标记点的校准位置信息和图像位置信息、所述第二预设标记点的校准位置信息和图像位置信息、虚拟路径上任一位置点的第一图像位置信息,调整所述指引结构。
可选的,还包括:
根据所述校准装置上的多个第一预设标记点在校准坐标系中的校准位置信息和在图像坐标系中的图像坐标信息,确定所述校准坐标系和所述图像坐标系之间的第一转换关系;
根据所述第一转换关系得到校准后的所述二维投影图像。
可选的,所述定位装置包括第二标识板,所述第二标识板上设置有多个第三预设标记点,所述校准装置与所述定位装置分离;
所述第二转换关系通过下述方式获取:
获取所述校准坐标系和所述图像坐标系之间的第一转换关系和所述拍摄装置的焦点位置信息;
根据所述拍摄装置的焦点位置信息、所述第二标识板在所述定位坐标系下的定位坐标信息、所述第一转换关系和所述第二标识板在所述图像坐标系中的图像坐标信息,确定所述第二转换关系,所述透视坐标系与所述焦点位置信息相关。
可选的,基于多个所述第二预设标记点在图像坐标系中的图像位置信息、基于所述校准坐标系下的校准位置信息和所述第一转换关系,确定所述拍摄装置的焦点位置信息。
可选的,步骤S4中,调整指引结构使得所述指引结构的指引方向与所述虚拟路径对应的手术导引路径匹配的步骤中,包括:
根据所述靶点路径的透视坐标信息、所述第二转换关系,得到所述手术导引路径在所述定位坐标系下的定位位置信息;
根据所述手术导引路径的定位位置信息、和所述指引结构在所述定位坐标系下的定位位置信息,调整所述指引结构,使得所述指引结构的指引方向与所述手术导引路径的延伸方向重合。
可选的,所述指引结构包括光束发射部件,
在步骤S3中,所述光束部件发射的光束指向靶点;
在步骤S4中,所述光束部件发射的光束与所述靶点路径匹配;
或者,所述指引结构包括器械导向通道,
在步骤S3中,所述器械导向通道的中轴线指向所述靶点;
在步骤S4中,所述器械导向通道的中轴线与所述靶点路径匹配。
可选的,所述靶点路径确定***还包括投影装置,在步骤S4中还包括:
获取基于所述投影装置的投影坐标系与所述透视坐标系之间的第三转换关系;
根据所述三维局部图像和所述虚拟路径的三维姿态信息、所述第三转换关系,确定所述患处在所述投影坐标系下的投影位置信息,以根据所述投影位置信息进行投影。
可选的,获取基于所述投影装置的投影坐标系与所述透视坐标系之间的第三转换关系的步骤中,包括:
通过所述投影装置获取所述定位装置中的第三预设标记点在所述投影坐标系下的投影位置信息;
根据所述第三预设标记点的投影位置信息和在所述定位坐标系下的定位坐标信息,确定所述投影坐标系与所述透视坐标系之间的第三转换关系。
可选的,若所述指引结构包括器械导向通道,还包括:
获取所述器械导向通道在所述定位坐标系下的定位位置信息,并根据所述第一转换关系和所述第三转换关系获取所述器械导向通道在所述投影坐标系下的投影位置信息,以根据所述器械导向通道的投影位置信息进行投影。
可选的,根据定位坐标系下所述指引结构的定位位置信息、所述焦点位置信息、所述第一转换关系、所述第二转换关系和图像坐标系中的投影靶点的位置信息,调整所述指引结构使得所述指引结构的指引方向指向体内靶点。
本申请的实施例提供的技术方案可以包括以下有益效果:
本申请在仿真二维图像与二维投影图像匹配时,能够通过虚拟路径的三维姿态信息,确定出靶点路径的透视坐标信息,从而辅助医护人员进行 器械导入,提高了手术时的精准度;而且本申请中的定位装置与拍摄装置分离,从而当第一转换关系确定后即可移除拍摄装置,通过定位装置即可确定出靶点路径,避免了拍摄装置对手术空间的占用,为医护人员执行手术腾出更大的空间。
本申请中的拍摄装置和定位装置之间相互独立,利用校准装置和定位装置上的定位球进行标识,获取相对位置关系,从而在相对位置关系确定后能够移除拍摄装置,定位装置根据相对位置关系以及坐标系之间的转换关系即可调整指引结构使之指向体内靶点,实现对体内靶点的定位,同事避免拍摄装置占用空间。
本申请通过在仿真二维图像与二维图像匹配时获取三维局部图像的三维姿态参数,从而得到患处在基于拍摄装置时的透视位置信息,进一步通过坐标转换关系将透视位置信息转换至投影坐标系下进行投影,使得医护人员可以根据需求将患处投影的任一合适位置,有利于随时观察手术进程,实现无创实时投影,尤其在虚拟路径的投影可以为医护人员的进针提供辅助,有利于提高手术的精准度。
本申请通过匹配仿真二维图像与二维投影图像得到患处内的手术路径基于拍摄装置的物理姿态参数,从而根据该物理姿态参数可以调整指向结构使之依次指向构成手术路径的多个靶点。基于此,可以得到体表上与手术路径对应的规划路线,该规划路线可以辅助医护人员植入手术器械,辅助术中路径规划,有利于提高手术的精准性,降低病患痛苦。
本申请通过匹配仿真二维图像与二维投影图像,并在确认仿真二维图像与二维投影图像相匹配的情况下,根据仿真二维图像中虚拟路径的投影,确定二维投影图像中的路径信息,使得医护人员可以直观地了解路径信息,以辅助医护人员确定当前的入针点和入针角度,有利于提高手术的精准性,降低病患痛苦。
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。
图1是本发明的一种靶点路径的确定方法的流程图。
图2是根据一示例性实施例示出的一种靶点路径的确定方法的步骤框图。
图3是根据一示例性实施例示出的另一种靶点路径的确定方法的步骤框图。
图4是根据一示例性实施例示出的一种确定***的结构示意图。
图5是是根据一示例性实施例示出的一种靶点路径的确定方法的流程图。
图6是是根据一示例性实施例示出的另一种靶点路径的确定方法的流程图。
图7是根据一示例性实施例示出的一种仿真二维图像的示意图。
图8是根据一示例性实施例示出的一种二维投影图像的示意图。
图9是根据一示例性实施例示出的用于辅助定位靶点的流程图。
图10是根据一示例性实施例示出的用于辅助定位靶点的算法模型图。
图11是根据一示例性实施例示出的又一种投影方法的流程图
图12是根据一示例性实施例示出的一种校准装置的结构示意图。
图13是根据一示例性实施例示出的一种靶点定位方法的流程图。
下面结合附图和具体实施方式对本发明作详细地描述,实施方式不能在此一一赘述,但本发明的实施方式并不因此限定于以下实施方式。
结合图1和图2所示,本发明的路径确定方法可以包括以下步骤:
在步骤S1中,获取针对患处的三维局部图像和位于三维局部图像内的虚拟路径。
在本步骤中包括:
S11.根据扫描信息重建三维局部图像。
S12.获取位于三维局部图像内的虚拟路径。
在本实施例中,可以通过CT扫描或者MR影像得到扫描信息,该扫描信息可以被输入到计算机使之进行重建,得到三维局部图像。可以根据三维局部图像所示出的当前患处的状态,针对患处建立虚拟路径。其中,本实施例中所述的患处可以包括四肢、脊椎、腰部、胸部或者头部等位置,对此并不进行限制。 该虚拟路径可以是直线型,在三维局部图像中可以针对该虚拟路径进行长度、宽度以及角度的调整。具体可以植入的器械规格为准,该植入的器械可以包括钢钉等。
在步骤S2中,匹配基于所述三维局部图像投影得到的仿真二维图像、和基于患处得到的二维投影图像。
在本实施例中,可以通过C臂机或者其他X射线成像设备对患处进行拍摄得到二维投影图像点。可以基于三维局部图像通过DRR算法得到仿真二维图像以及虚拟路径在仿真二维图像中的位置信息。进一步地,可以确定二维投影图像与仿真二维图像之间的重合度,当重合度不小于预设阈值时则可以认为二维投影图像与仿真二维图像匹配。
进一步地,当二维投影图像与仿真二维图像之间的重合度小于预设阈值时,可以认为此时二维投影图像与仿真二维图像之间的差异较大,可以通过调节三维局部图像的空间姿态或者针对三维局部图像的投影参数,得到调整后的仿真二维图像,并将调整后的仿真二维图像与二维投影图像进行匹配。
具体而言,在一实施例中,可以根据仿真二维图像与二维投影图像之间的重合度,反馈仿真二维图像与二维投影图像之间的差异,从而根据该重合度再调整三维局部图像的空间姿态或者调整针对三维局部图像的投影参数。
当然,匹配仿真二维图像和二维投影图像的过程中也可以是同时调节三维局部图像的空间姿态以及针对三维局部图像的投影参数。进而,当基于所述三维局部图像投影得到的仿真二维图像与基于患处得到的二维投影图像匹配时,获取所述虚拟路径的三维姿态信息。按照一定规律间隔依次调整三维局部图像的空间姿态或者投影参数。
在本实施例中,当仿真二维图像与二维投影图像匹配时,说明此时三维局部图像的三维姿态参数即为患处相对拍摄装置的透视坐标系得透视位置信息,此时虚拟路径的三维姿态信息可以作为即将在患处内建立的手术路径在透视坐标系系下的透视位置信息。
具体而言,可以对患处进行透视投影得到二维投影图像;对三维局部图像进行投影得到仿真二维图像;获取仿真二维图像和二维投影图像的重合度,在重合度不小于预设阈值时,确定为仿真二维图像与二维投影图像匹配。例如还 可以根据仿真二维图像与二维投影图像之间的重合度,反馈仿真二维图像与二维投影图像之间的差异,从而根据该重合度再调整三维局部图像的空间姿态和/或调整针对三维局部图像的投影参数。当然,在其他实施例中,也可以时按照一定规律间隔依次调整三维局部图像的空间姿态或者投影参数,本申请并不进行限制。
调整三维局部图像的空间姿态可以是调整三维局部图像针对至少一个坐标轴的旋转角度,或者,可以是调整三维局部图像针对至少一个坐标轴的位移。当然,在其他实施例中,也可以是对任一坐标轴的旋转角度和位移均进行调节。调整针对三维局部图像的投影参数可以是调整虚拟光源的位置,虚拟光源的焦距和成像分辨率中的一个参数或者多个参数。其中,成像分辨率用于表征像素与几何尺寸之间的关系,其与三维局部图像的投影成像平面的尺寸以及二维投影图像的图像尺寸相关。
在上述各个实施例中,对于仿真二维图像与二维投影图像之间的重合度可以通过下述方式实施:
在一实施例中,可以是通过用户个人针对二维投影图像和仿真二维图像进行匹配,得到重合度。
在另一实施例中,可以提取仿真二维图像中的第一投影区域和二维投影图像中的第二投影区域,根据第一投影区域和第二投影区域之间的边缘轮廓匹配程度,得到重合度。
在又一实施例中,可以将仿真二维图像和二维投影图像均按照预设比例沿预设方向进行分割,将仿真二维图像的每一分割区域和二维投影图像对应的分割区域进行匹配,从而得到重合度。
在步骤S3中,当仿真二维图像和二维投影图像匹配时,根据虚拟路径在仿真二维图像上的位置信息,确定二维投影图像上与虚拟路径对应的手术导引路径。
在本实施例中,当仿真二维图像与二维投影图像匹配时,可以认为此时三维局部图像的姿态信息可以作为患处基于拍摄装置的透视坐标系的透视位置信息,从而此时三维局部图像中的虚拟路径在仿真二维图像中的位置信息、即可作为二维投影图像中手术路径的姿态信息,从而可以得到二维投影图像中的 手术路径,有利于医护人员了解手术器械的入针点和入针角度,进而有利于提高手术的精准性,降低病患痛苦。
本发明的路径确定方法在步骤S3之后,还可选择性的包含以下步骤S4。具体的,图3是根据另一示例性实施例示出的一种确定方法的流程图。结合图1和图3所示,在步骤S4中,当仿真二维图像和二维投影图像匹配时,获取虚拟路径在三维局部图像上的三维姿态信息,以作为手术导引路径基于透视坐标系的透视坐标信息,透视坐标系基于拍摄装置形成;
根据手术导引路径的透视坐标信息、透视坐标系和基于定位装置的定位坐标系之间的第二转换关系,调整指引结构使得指引结构的指引方向与虚拟路径对应的手术导引路径匹配。
在本实施例中,虚拟路径的三维姿态信息即为欲建立在患处内的手术路径相对于拍摄装置上透视坐标系的透视位置信息,而根据第二转换关系可以得到手术路径在定位坐标系下的定位位置信息,而指引结构位于定位装置上,从而该指引结构相对于定位坐标系的定位位置信息已知,所以能够通过手术路径在定位坐标系下的定位位置信息和指引结构相对于定位坐标系的定位位置信息,调整指引结构,使得指引结构的指引方向与虚拟路径匹配。
需要指出的是,根据上述方案,本发明的路径确定方法中还可在执行步骤S3的同时,执行步骤S4,其执行过程与上述步骤相同,在此不再赘述。
为进一步说明本发明,基于本申请的上述技术方案,提供了一种应用于该确定方法的确定***,如图4所示,该确定***可以包括拍摄装置1、校准装置2、定位装置3、展示装置4,以及可选择的包括二维定位装置(图中未示出)、投影模块5,该定位装置3与拍摄装置1在物理结构上相互分离,定位装置3可以包括指引结构31。在本实施方式中,该拍摄装置可以用于拍摄患处以获取二维投影图像,在本实施方式中,校准装置2连接于拍摄装置1,且拍摄装置1发射的投影光线经过该校准装置2,通过定位装置3的定位坐标系和基于拍摄装置1的透视坐标系可获取上述第二转换关系,展示装置有与拍摄装置之间可以通过有线或者无线的方式进行通信连接。该展示装置还可包括显示器,该显示器可以用于示出三维局部图像、二维投影图像和仿真二维图像等相关图像。该计算机还可以包括处理器(图中未示出)和用于存储处理器可执 行指令的存储器。在本实施方式中,投影模块5根据三维局部图像和虚拟路径的三维姿态信息、第三转换关系,确定患处在投影坐标系下的投影位置信息,以根据投影位置信息进行投影。
在下述各个实施例中,以基于拍摄装置1建立的坐标系标识为透视坐标系、基于校准装置2建立的坐标系标识为校准坐标系、以基于定位装置3建立的坐标系标识为定位坐标系、基于拍摄装置1得到的投影图像中的坐标系标识为图像坐标系。
结合图4和图12所示,在本实施方式中,拍摄装置1发射的光线经过该校准装置2,从而获取该校准装置2的投影图像,并根据该校准装置2的投影图像内各个预设点在图像坐标系中的图像位置信息、和该预设点在校准坐标系中的校准位置信息,确定拍摄装置1的焦点位置信息、图像坐标系与校准坐标系之间的第一转换关系。在本实施方式中,校准装置2包括校准板21和第一标识板22,该校准板21包括多个第一定位球,第一标识板22包括多个第二定位球221。
在本实施方式中,定位装置3包括第二标识板31和光束发射结构32,该第二标识板31包括多个第三定位球,该多个第三定位球用于确定定位坐标系和透视坐标系之间的第二转换关系。该定位***还包括计算装置(图中未示出),该计算装置可以根据所述焦点位置信息、第一转换关系、第二转换关系、靶点在图像坐标系中的图像坐标信息和定位坐标系下指引结构的位置信息,并生成调整指令,该调整指令用于调整指引结构使得指引结构指向靶点。
在本实施方式中,指引结构包括光束发射部件,该光束发射部件发射的光线指向体内靶点,后续可以定位出光束的位置信息调整导向通道;或者,该指引结构也可以包括器械手术通道,手术器械可以通过该器械导向通道进行定位;再或者,定位装置3也可以同时包括光束发射部件和器械导向通道。
进一步地,为了便于执行操作,该定位装置3还可以包括机械臂34,该机械臂34与夹持结构33连接,从而当机械臂34带动夹持结构33进行移动或者旋转时,可以使得第二标识板31和指引结构32同步移动或者旋转,从而能够移动指引结构32的位置,使之发射的光线指向体内靶点(具体方式后续将进行详细阐述)。
更进一步地,为了增大机械臂34的可操作范围,该定位装置3还可以包括滑动底座35。该滑动底座35可以为小车结构,且该滑动底座35上可以设置置物架,以用于放置其他配套结构。
根据本发明的一种实施方式,当二维投影图像与仿真二维投影图匹配时,该三维局部图像的姿态参数即可作为患处基于拍摄装置的物理姿态参数。从而虚拟路径的姿态参数即可作为实际手术路径基于拍摄装置的物理姿态参数。所以根据虚拟路径上多个位置点在仿真二维图像上的图像位置信息,可以调节指引结构,并使得该指引结构的指引方向依次指向患处内对应的靶点。
在一实施例中,本发明的确定方法基于上述确定***可以应用于透视图像上确定靶点路径,在应用过程中,采用二维定位装置安装在确定***的拍摄装置1上,在本实施方式中,将校准装置2拆下,在拍摄装置1上安装校准装置2的位置安装该二维定位装置。该二维定位装置为与校准装置2结构相同的双层板结构,且该双层板之间间隔与校准装置2的双层板之间的间隔是相同的。进而该确定***即可基于原来校准装置2上在投影方向上相互间隔设置的第一预设标记点(即第一定位球)和第二预设标记点(即第二定位球221),获取每一第一预设标记点和第二预设标记点在图像坐标系中的图像位置信息,而这里图像坐标系是基于替换校准装置2的二维定位装置的投影图像形成;根据多个第一预设标记点在图像坐标系下的图像位置信息、多个第一预设标记点在二维定位装置的定位坐标系下的定位坐标信息,每一位置点在图像坐标系下的图像位置信息,确定第一定位点基于定位坐标系的定位坐标信息,第一定位点与对应位置点在图像坐标系中重合;根据多个第二预设标记点在图像坐标系下的图像位置信息、多个第二预设标记点在二维定位装置的定位坐标系下的定位坐标信息,每一位置点在图像坐标系下的图像位置信息,确定第二定位点基于定位坐标系的定位坐标信息,所述第二定位点与对应位置点在图像坐标系中重合;根据第一定位点的定位位置信息、第二定位点的定位位置信息调整该指引结构
在另一实施例中,可以通过虚拟路径在二维仿真图像上的图像位置信息,获取二维投影图像与虚拟路径匹配的投影路径的图像位置信息,进一步可以根据投影路径上多个位置点的图像位置信息调整指引结构。
在上述各个实施例中,还可以包括对二维投影图像进行校准。例如,可以根据多个第三预设标记点在定位坐标系中的定位位置信息和在图像坐标系中的图像坐标信息,确定所述定位坐标系和所述图像坐标系之间的第一转换关系,根据该第一转换关系得到校准后的二维投影图像,以减少图像畸变和失真,提高指向结构指向靶点的精准度。
通过以上对本发明方案的整体概述,以下通过实例对说明本方案作进一步说明。
实施例1
如图5所示,确定二维投影图像上与虚拟路径对应的手术导引路径的流程可包括下述步骤:
在步骤101中,根据扫描信息重建三维局部图像。
在步骤102中,获取位于三维局部图像内的虚拟路径,其中,虚拟路径的获取方式如前所述,在此不再赘述。
在步骤103中,调整该三维局部图像的空间姿态和/或投影参数。调整方式如前所述,在此不再赘述。
在步骤104中,针对三维局部图像进行投影,得到仿真二维图像。
在步骤105中,基于该仿真二维图像提取第一投影区域。
在步骤106中,拍摄患处得到二维投影图像。
在步骤107中,基于二维投影图像提取第二投影区域。
在本实施例中,基于投影平面尺寸以及虚拟光源所覆盖的区域,该仿真二维图像中除了存在三维局部图像所对应的区域外,固然还会存在其他区域。相类似的,在二维投影图像中除了病灶所对应的区域外,固然还可以存在其他区域。所以,本申请通过图像处理,提取仿真二维图像中的第一投影区域、和二维投影图像中的第二投影区域。其中,该图像处理可以是基于灰度值提取仿真二维图像中病患区域、和二维投影图像中的病患区域。
在步骤108中,将第一投影区域和第二投影区域的边缘轮廓进行匹配得到重合度。
在本实施例中,可以将第一投影区域和第二投影区域的边缘轮廓进行匹配,以得到二维投影图像与仿真二维图像之间的重合度。举例而言,可以基于第一 投影区域上的标记点,以及该标记点在第二投影区域上的对应位置,调整第一投影区域和第二投影区域的相对位置,使得该标记点与该标记点在第二投影区域上的对应位置基本重合,然后进行边缘轮廓匹配。其中,该标记点可以是患处上特殊区域,例如神经标识点、骨骼标识点等,本申请并不对此进行限制。
在步骤109中,判断重合度是否大于预设阈值。
在本实施例中,当二维投影图像与仿真二维图像之间大于等于预设阈值时,执行步骤110,当二维投影图像与仿真二维图像之间小于预设阈值时,执行步骤103。其中,可以根据重合度确定针对三维局部图像空间姿态和针对投影参数的调整量以及调整方向,以提升匹配效率。
在步骤110中,获取虚拟路径在仿真二维图像中的位置信息。
在步骤111中,根据虚拟路径在仿真二维图像中的位置信息,确定二维投影图像中的手术路径(即手术导引路径)的位置信息。
在本实施例中,由于仿真二维图像与二维投影图像重合度已经大于或者等于预设阈值。所以,基于仿真二维图像内虚拟路径的投影信息,可以确定二维局部图像上手术路径的位置信息,得到入针点和入针方向。
如图6所示,针对上述方案,下述将基于另一具体实施例进行详细说明。步骤S1至S3,确定所述二维投影图像上与所述虚拟路径对应的手术导引路径的流程可包括下述步骤:
在步骤201中,根据扫描信息重建三维局部图像。
在步骤202中,获取位于三维局部图像内的虚拟路径。
在步骤203中,调整该三维局部图像的空间姿态和投影参数。
在步骤204中,针对三维局部图像进行投影,得到仿真二维图像。
在本实施例中,步骤201-204可以参考图5所示实施例中的步骤101-104,在此不再一一赘述。
在步骤205中,按照预设比例沿预设方向分割仿真二维图像。
在步骤206中,拍摄患处得到二维投影图像。
在步骤207中,按照预设比例沿预设方向分割二维投影图像。
在本实施例中,如图7、图8所示,可以沿箭头A所示方向和箭头B所示方向成行成列的、对图7的仿真二维图像和图8的二维图像进行分割,分别得 到N个尺寸为D×D的分割区域。
在步骤208中,将仿真二维图像的每一分割图像与二维投影图像上对应区域的分割图像进行匹配。
在步骤209中,根据匹配结果,计算仿真二维图像和二维投影图像之间的重合度。
在本实施例中,仍以图7、图8所示,图7中每一分割区域在图8中均存在对应的区域,例如,图7中的位于第二行第三列的分割区域D1、与图8中位于第二行第三列的分割区域d1对应,进一步可以将该分割区域D1与d1进行匹配得到匹配值。相类似的,可以将图7中的其他分割区域与图8中的对应分割区域进行匹配,最后得到重合度。例如,每一分割区域可以对应一个权重系数,每一分割区域的匹配度与权重系数之积与其他分割区域的匹配度与权重系数之积的和为重合度。
在步骤210中,判断重合度是否大于预设阈值。
在本实施例中,当二维投影图像与仿真二维图像之间大于等于预设阈值时,执行步骤211,当二维投影图像与仿真二维图像之间小于预设阈值时,执行步骤203。
在步骤211中,获取虚拟路径在仿真二维图像中的位置信息。
在步骤212中,根据虚拟路径在仿真二维图像中的位置信息,确定二维投影图像中的指向靶点的手术路径(即手术导引路径)。
在本实施例中,步骤211、212可以参考图5所示实施例中的步骤110、111,在此不再一一赘述。
实施例2
如图9所示,该确定靶点的辅助方法流程可以包括下述步骤:
在步骤301中,获取第一预设标记点O在校准坐标系XOY中的校准位置信息O
1_2d。
在本实施例中,可以通过预设校准装置对C臂机的拍摄图像进行校准。且该预设校准装置上可以设置多个第一预设标记点,校准坐标系位于该预设校准装置上的任一位置,且每一第一预设标记点位于该校准装置上,从而每一第一预设标记点的校准位置信息均已知。在本实施例中,假定原点位于校准板的上 表面,那么基于该上表面的延伸方向可以建立一校准坐标系XOY,并且能够根据校准板自身的物理结构尺寸,得到每一第一定位球在校准坐标系XOY中的校准位置信息。在此,可以将该多个第一预设标记点O的定位位置信息表示为O
1_2d。其中,由于该第一预设标记点的数量为多个,所以该定位位置信息O
1_2d可以包括O1(X1,Y1)、O2(X2,Y2)……(Xn,Yn),具体数量本申请并不限制。
在步骤302中,获取第一预设标记点O在图像坐标系MON中的发生畸变时的图像位置信息O
2_2d。
在本实施例中,图像坐标系是基于C臂机投影得到的二维图像形成。当C臂机拍摄校准装置得到二维图像时,该二维图像上会包括多个与第一预设标记点对应的投影点,该多个投影点在图像坐标系MON的发生畸变时图像位置信息O
2_2d。相类似的,由于第一预设标记点的数量为多个,所以该发生畸变时图像位置信息O
2_2d可以包括O1(M1,N1)、O2(M2,N2)……(Mn,Nn),具体数量本申请并不限制。
在步骤303中,根据第一预设标记点的校准位置信息O
1_2d和发生畸变时畸变图像位置信息O
2_2d,计算校准坐标系XOY和图像坐标系MON之间的第一转换关系T1。
在步骤304中,对所述患处进行投影,并根据第一转换关系T1得到校准后的所述二维投影图像。
在本实施例中,可以通过数学方法建立校准位置信息和畸变图像位置信息之间的函数关系,根据函数关系求解该第一转换关系T1。
例如,可以建立下述函数关系:
M=a
0+a
1X+a
2Y+a
3X
2+a
4XY+a
5Y
2+a
6X
3+a
7X
2Y+a
8XY
2+a
9Y
3+…
N=b
0+b
1X+b
2Y+b
3X
2+b
4XY+b
5Y
2+b
6X
3+b
7X
2Y+b
8XY
2+b
9Y
3+…
其中,(M,N)为发生畸变时的图像位置信息、(X,Y)为校准位置信息,a
0L a
9,b
0L b
9用于表示第一转换关系T1。换言之,该第一转换关系T1表征了畸变图像与未畸变图像之间的换算关系。所以,当通过C臂机拍摄获得针对患处的处于畸变状态的二维投影图像后,可以通过第一转换关系进行校准,从而得到校准后的二维投影图像。
在步骤305中,获取三维局部图像和位于三维局部图像内的虚拟路径。
在本实施例中,可以基于C臂机扫描信息或者其他设备仪器的扫描信息进行三维重建,从而得到基于患处的三维局部图像。进一步地,可以根据三维局部图像所示出的当前患处的状态,针对患处加建立虚拟路径。
在步骤306中,对三维局部图像进行投影得到仿真二维图像。
在步骤307中,获取仿真二维图像和二维投影图像的重合度,在所述重合度不小于预设阈值时,确定为仿真二维图像与二维投影图像匹配。
在本实施例中,步骤305-步骤307的具体实施方式可见图5-图8所示实施例。
在步骤308中,获取虚拟路径在图像坐标系中多个位置点B的图像位置信息B1_2d。
在本实施例中,由于此时仿真二维图像与校准后的二维投影图像匹配,所以此时虚拟路径中每一位置点在图像坐标系中的图像位置信息、可以作为患处内手术路径上对应点在校准后二维投影图像中的图像位置信息。
在步骤309中,获取多个第一预设标记点P、多个第二预设标记点Q在图像坐标系MON中校准后的图像位置信息P1_2d、Q1_2d、在定位坐标系中的定位位置信息P2_2d、Q2_2d。
在本实施例中,该靶点路径辅助方法可以被应用于确定靶点路径的辅助***,该确定靶点路径的辅助***可以包括定位装置,该定位装置上可以包括多个位于第一平面上的第一预设标记点P和多个位于第一平面上的第二预设标记点Q以及指向结构,在投影方向上,所述第一平面和所述第二平面之间具有间隔。
基于此,可以得到每一定位标记点在基于定位装置所形成的定位坐标系中的定位位置信息,在此可以将多个第一预设标记点P的定位位置信息表示为P
2_2d、多个第二预设标记点Q的定位位置信息表示为Q
2_2d。
进一步地,可以通过C臂机拍摄定位装置时,并基于第一转换关系T1得到第一预设标记点P的校准后的图像位置信息P
1_2d、第二预设标记点Q的校准后的图像位置信息Q
1_2d。其中,该第一预设标记点P和第二预设标记点Q处于不同平面,以便于后续通过第一预设标记点P和第二预设标记点Q在不同 平面上的位置信息构建从拍摄装置上光源出发并指向靶点的直线。
在步骤310中,根据P1_2d、P2_2d、B1_2d、Q1_2d、Q2_2d调整光束发射装置,使得光束发射装置的发射的光线指向靶点。
进一步地,如图10所示,假定第一预设标记点P包括标记点P1和P2,第二预设标记点Q包括标记点Q1、Q2,点B为靶点,假定在与拍摄装置的中心射线T相垂直的平面上建立坐标系MON;那么,在MOT平面内的M轴方向上,可以得到P1、P2的校准后的图像位置信息T1、T2,此时可以根据定位坐标系中标记点P1和P2之间的物理间距|P1P2|与图像坐标系中标记点P1和P2之间像素点的数量,确定出在投影图像的分辨率,进一步根据投影图像的分辨率,标记点P1的投影点T1与靶点的投影点T3之间的像素点数量,可知定位坐标系中标记点P1与靶点B之间的间距|P1B|
M,相类似的,可以得到|P1B|
N、|Q1B|
M、|Q1B|
N。
所以,当标记点P1沿M轴运动|P1B|
M、沿N轴运动的|P1B|
N距离后,该P1点与靶点在图像坐标系中的位置重合;当标记点Q1沿M轴运动|Q1B|
M、沿N轴运动的|Q1B|
N距离后,该Q1点与靶点在图像坐标系中的位置重合。换言之,此时P1、Q1和B位于同一条投影光束上。所以,可以根据光束发射装置在定位坐标系中的定位位置信息,以及该光束发射装置与P1、Q1点之间的位置关系,调整光束发射装置,光束发射装置发射的光线经过P1、Q1点,从而该光束固然会指向靶点B。
当针对虚拟路径上的多个位置点分别执行步骤309、和步骤310时,可以得到该光束经过体表时的点所构成的规划路径,从而通过该规划路径可以辅助医护人员执行手术,提高精准度。
实施例3
图11是根据一示例性实施例示出一种投影方法的流程图。可以被应用于如图4所示的装置,该靶点路径确定***可以包括投影装置5,并可基于该投影装置建立投影坐标系。如图11所示,可以包括下述步骤:
在步骤601中,获取第四定位球E基于校准坐标系时的坐标E
1_3d。
在本实施例中,该第四定位球E可以设置于校准装置上,从而相对于校准坐标系该第四定位球E的坐标E
1_3d为已知。
在步骤602中,通过投影装置获取到的第四定位球基于投影坐标系时的坐标E
2_3d。
在步骤603中,根据坐标E
1_3d和E
2_3d,计算投影坐标系和透视坐标系之间的第三转换关系T3。
在本实施例中,在上述实施例中,由于拍摄装置的焦点位置信息J_3d是通过校准装置求解而来,即焦点位置信息J_3d是基于校准坐标系下的位置坐标信息,而透视坐标系是以拍摄装置的焦点为原点建立的坐标系,所以校准坐标系与透视坐标系的转换关系为已知,记为第四转换关系T4。
所以,可以建立函数关系:
E
2_3d=F3(T3,T4,E
1_3d)
从而计算得到第三转换关系T3。
在步骤604中,根据焦点位置信息、第三转换关系和三维局部图像的姿态信息进行投影。
在本实施例中,当仿真二维图像与二维投影匹配时,该三维局部图像的姿态信息即为实际患处在透视坐标系下的姿态信息K
1_3d,患处在投影坐标系中的位置信息K
2_3d=F4(T3,K
1_3d),基于此从而投影装置可以根据K
2_3d进行投影。
在上述实施例中,包括了获取基于投影装置的投影坐标系与基于拍摄装置时透视坐标系之间的第三转换关系。进而当基于所述三维局部图像投影得到的仿真二维图像与基于患处得到的二维投影图像匹配时,获取三维局部图像的三维姿态信息;根据三维局部图像和虚拟路径的三维姿态信息、第三转换关系,确定患处在所述投影坐标系下的图像位置信息,以根据图像位置信息进行投影。当指引结构包括器械手术通道时,可以根据第二转换关系、器械导向通道在定位坐标系下的定位位置信息,获取器械导向通道在透视坐标系下的透视位置信息;根据第三转换关系、器械导向通道在透视坐标系下的透视位置信息,得到器械导向通道在投影坐标系下的投影位置信息,以根据投影位置信息进行投影,从而进行手术即手术过程的投影,可以在将患处以及器械导向通道投影至方便医护人员查看的位置,便于执行手术操作。
由上述实施例可知,本申请通过在仿真二维图像与二维图像匹配时获取三 维局部图像的三维姿态参数,从而得到患处在基于拍摄装置时的透视位置信息,进一步通过坐标转换关系将透视位置信息转换至投影坐标系下进行投影,使得医护人员可以根据需求将患处投影的任一合适位置,有利于随时观察手术进程,实现无创实时投影,尤其在虚拟路径的投影可以为医护人员的进针提供辅助,有利于提高手术的精准度。
实施例4
图13是根据一示例性实施例示出的另一种靶点定位方法的流程图,如图13所示,该靶点定位方法可以包括以下步骤:
在步骤701中,获取第一定位球(即第一预设标记点)O在校准坐标系XOY中的校准位置信息O
1_2d,具体参见步骤301。
在步骤702中,获取第一定位球O在图像坐标系MON中的图像位置信息O
2_2d,具体参见步骤302。
在步骤703中,根据第一定位球211的校准位置信息O
1_2d、和第一定位球211的图像位置信息O
2_2d,计算校准坐标系和图像坐标系之间的第一转换关系T1,具体参见步骤303-304。
在步骤704中,获取第二定位球221在图像坐标系MON中的图像位置信息P
1_2d。
在本实施例中,基于校准装置2在拍摄装置1下的投影图像,进一步可以基于图像坐标系MON,得到各个第二定位球221的图像位置信息,该第二定位球221的图像位置信息P
1_2d可以包括P1(M1,N1)、P2(M2,N2)……Pn(Mn,Nn)。
在步骤705中,根据第一转换关系T1和第二定位球221的图像位置信息,计算第二定位球在第一定位球所处平面投影的三维坐标P
2_3d。
在本实施例中,第一定位球211所处的平面即为校准板21的位置。通过第一转换关系T1可以得到第二定位球221在校准板21上投影坐标P
3_2d,该P
3_2d可以包括P1(X1,Y1)、P2(X2,Y2)……Pn(Xn,Yn),而本实施例中可以假定校准坐标系位于校准板上,所以第二定位球221在校准板21上投影点的Z坐标为零,从而得到第二定位球221投影的三维坐标P
2_3d:P1(X1,Y1,0)、P2(X2,Y2,0)……Pn(Xn,Yn,0)。
在步骤706中,获取第二定位球P在校准坐标系XOY中的校准位置信息P
3_3d。
在本实施例中,根据校准板21和第一标识板22之间的相对位置关系,可以得到第一标识板22上每一第二定位球在校准坐标系中的校准位置信息,该校准位置信息P
3_3d可以表示包括Pj1(X1,Y1,Z1)、Pj2(X2,Y3,Z3)……Pj3(X1,Y1,Z1)。
在步骤707中,根据P
2_3d和P
3_3d得到焦点位置信息J_3d。
在本实施例中,第一标识板22上每一第二定位球221均可以在校准板21上形成一投影点。换言之,第二定位球221在校准板21的投影均存在一物理空间上的第二定位球221与之对应,举例而言,假定一个第二定位球221在校准坐标系中的校准位置信息为Pj1(X1,Y1,Z1),该第二定位球221在校准板21上投影的位置信息为P1(X1,Y1,0),那么过P1(X1,Y1,0)和Pj1(X1,Y1,Z1)两点的直线必然经过光源。所以,通过该多个第二定位球221可以得到多条经过光源的直线,因而可以计算得到光源的位置信息亦即焦点位置信息J_3d,该焦点位置信息J_3d的Z轴坐标即光源与投影成像平面之间的距离。基于焦点位置信息J_3d,可以得到透视坐标系下的任一点的三维坐标与投影图像中对应点之间的投影变换矩阵A。
在步骤708中,获取第三定位球在图像坐标系中的图像位置信息Q
1-2d。
在本实施例中,由于第三定位球311存在多个,所以基于图像坐标系MON,该二维坐标Q
1_2d可以包括Q1(M1,N1)、Q2(M2,N2)……Qn(Mn,Nn)。
在步骤709中,获取第三定位球311在定位坐标系下的定位位置信息Q
3_3d。
在本实施例中,可以在定位装置3上建立定位坐标系,而由于定位装置3上各个结构之间的相对位置关系已知,从而可以得到第三定位球311在定位坐标系下的定位位置信息Q
3_3d。
在步骤710中,根据焦点坐标信息J_3d、第三定位球311的定位位置信息Q
3_3d、第三定位球在图像坐标系中的二维坐标Q
1-2d,获取透视坐标系和定位坐标系之间的第二转换关系T2。
在本实施例中,可以假定第三定位球在透视坐标系下的透视位置信息为Q
2_3d,那么可以得到Q
2_3d=F1(T2,Q
3_3d),而根据焦点坐标信息J_3d可以 得到拍摄装置的投影变换矩阵A,即可以得到函数关系第三定位球Q的图像位置信息Q
1-2d=F2(T1,A,Q
2_3d)。所以,联合Q
1-2d=F2(T1,A,Q
2_3d)和Q
2_3d=F1(T2,Q
3_3d),可以得到第三定位球Q的图像位置信息Q
1-2d=F3(T1,A,T2,Q
3_3d)。其中,第三定位球Q的图像位置信息Q
1-2d、第一转换关系T1、投影变换矩阵A和第三定位球311的定位位置信息Q
3_3d均为已知,从而可以计算得到定位坐标系和透视坐标系之间的第二转换关系T2。例如,可以通过优化算法不断匹配矩阵,得到最优的矩阵即为第二转换关系,例如可以通过最小二乘法或者其他优化算法,本申请并不限制。
在步骤711中,获取体内靶点(即手术路径在二维投影图像上的图像信息)在图像坐标系中的图像坐标信息B_2d,并基于第一转换关系T1、焦点位置信息J_3d和第二转换关系T2,得到定位坐标系下体内靶点的定位位置信息B_3d。
在本实施例中,可以建立函数关系如下:
B_2d=F4(T1,T2,A,B_3d)
基于此,可以得到基于定位装置3时体内靶点的三维坐标B_3d。
在步骤712中,获取指引结构32在定位坐标系下的定位位置信息G_3d。
在本实施例中,由于指引结构32与第二标识板31之间相对位置关系固定,从而可以通过第二标识板31的位置信息计算得到指引结构32的定位位置信息。当然,也可以通过其他方式获取得到指引结构32的定位位置信息G_3d,例如通过预先存储的方式,本申请并不对此进行限制。
在步骤713中,根据定位坐标系下体内靶点的定位位置信息B_3d和指引结构32的定位位置信息G_3d,调整指引结构32使得指引结构32指向体内靶点。
在本实施例中,由于定位坐标系下体内靶点和指引结构32的定位位置信息均为已知,从而可以通过机械臂34的运动或者机械臂34和滑动底座35的共同运动,调整光束发射结构32的位置。
在上述实施例中,在步骤710之后还可以执行以下步骤实现机械臂的三维定位:
获取三维局部图像和指向虚拟靶点的虚拟路径。
对患处进行投影得到二维投影图像。通过第一变换关系T1得到校准后的 二维投影图像。
对三维局部图像进行投影得到仿真二维图像。
获取仿真二维图像和所述校准后的二维投影图像的重合度,在重合度不小于预设阈值时,确定为仿真二维图像与二维投影图像匹配。
获取虚拟路径的姿态信息根据虚拟路径的姿态信息和第二转换关系,得到虚拟路径在定位坐标系下的定位位置信息。
获取光束发射部件在定位坐标系下的定位位置信息G_3d。
根据光束发射部件和虚拟路径在定位坐标系下的定位位置信息,调整光束发射部件,使得光束发射部件发射的光线与虚拟路径匹配。
在本实施例中,由于光束发射部件和欲建立手术路径在定位坐标系下的定位位置信息均已知,所以可以生成调整指令,调整光束发射部件。
本领域技术人员在考虑说明书及实践这里公开的公开后,将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本申请未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本申请的真正范围和精神由下面的权利要求指出。
应当理解的是,本申请并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本申请的范围仅由所附的权利要求来限制。
Claims (18)
- 一种靶点路径的确定方法,其特征在于,应用于确定***,所述确定***包括相互分离的拍摄装置和定位装置,与所述拍摄装置相连接的校准装置,所述定位装置包括指引结构,所述确定方法包括:S1.获取针对患处的三维局部图像和位于所述三维局部图像内的虚拟路径;S2.匹配基于所述三维局部图像投影得到的仿真二维图像和基于患处得到的二维投影图像;S3.当所述仿真二维图像和所述二维投影图像匹配时,根据所述虚拟路径在所述仿真二维图像上的位置信息,确定所述二维投影图像上与所述虚拟路径对应的手术导引路径;和/或,S4.当所述仿真二维图像和所述二维投影图像匹配时,获取所述虚拟路径在所述三维局部图像上的三维姿态信息,以作为所述手术导引路径基于透视坐标系的透视坐标信息,所述透视坐标系基于所述拍摄装置形成;根据所述手术导引路径的透视坐标信息、所述透视坐标系和基于所述定位装置的定位坐标系之间的第二转换关系,调整指引结构使得所述指引结构的指引方向与所述虚拟路径对应的手术导引路径匹配。
- 根据权利要求1所述的确定方法,其特征在于,步骤S2中,匹配基于所述三维局部图像投影得到的仿真二维图像和基于患处得到的二维投影图像的步骤中包括:S21.对所述患处进行透视投影得到所述二维投影图像;S22.对所述三维局部图像进行投影得到所述仿真二维图像;S23.获取所述仿真二维图像和所述二维投影图像的重合度,在所述重合度不小于预设阈值时,确定为所述仿真二维图像与所述二维投影图像匹配。
- 根据权利要求2所述的确定方法,其特征在于,步骤S23中,获取所述仿真二维图像和所述二维投影图像的重合度的步骤中包括:提取所述仿真二维图像中的第一投影区域和所述二维投影图像中的第 二投影区域;根据所述第一投影区域和所述第二投影区域之间的边缘轮廓匹配程度计算所述重合度。
- 根据权利要求2所述的确定方法,其特征在于,步骤S23中,获取所述仿真二维图像和所述二维投影图像的重合度的步骤中包括:将所述仿真二维图像和所述二维投影图像均按照预设比例沿预设方向进行分割;将所述仿真二维图像的每一分割区域与所述二维投影图像对应的分割区域进行匹配得到所述重合度。
- 根据权利要求2至4任一项所述的确定方法,其特征在于,步骤S23中,若所述重合度小于预设阈值时,调整所述三维局部图像的空间姿态;和/或,调整针对所述三维局部图像的投影参数。
- 根据权利要求5所述的确定方法,其特征在于,调整所述三维局部图像的空间姿态的步骤中包括下述至少之一:调整所述三维局部图像针对至少一个坐标轴的旋转角度;调整所述三维局部图像针对至少一个坐标轴的位移;调整针对所述三维局部图像的投影参数的步骤中包括下述至少之一:调整焦距;调整虚拟光源的位置;调整成像分辨率,所述成像分辨率与所述三维局部图像的投影成像平面的尺寸以及所述仿真二维图像的图像尺寸相关。
- 根据权利要求6所述的确定方法,其特征在于,步骤S3中,还包括:S31.获取所述二维投影图像上与所述虚拟路径对应的多个位置点的第一图像位置信息;S32.基于所述第一图像位置信息调整指引结构,使得所述指引结构的指引方向依次指向患处对应于所述手术导引路径上多个位置点的多个靶点。
- 根据权利要求7所述的确定方法,其特征在于,步骤S32中,基于所述第一图像位置信息调整指引结构的步骤中包括:根据所述虚拟路径在所述二维仿真图像上的图像位置信息,获取所述二维投影图像上与所述虚拟路径匹配的投影路径的图像位置信息;根据所述投影路径上多个位置点的图像位置信息调整所述指引结构。
- 根据权利要求8所述的确定方法,其特征在于,所述校准装置包括校准板和第一标识板,校准板设置有多个第一预设标记点、第一标识板设置有多个第二预设标记点,在投影方向上,所述校准板和所述第一标识板相互平行的间隔设置;步骤S32中,基于所述第一图像位置信息调整指引结构的步骤中包括:获取第一平面上每一第一预设标记点和第二平面上每一所述第二预设标记点在校准坐标系中的校准位置信息;获取第一平面上每一第一预设标记点和第二平面上每一所述第二预设标记点在图像坐标系中的图像位置信息,所述图像坐标系基于所述校准装置的投影图像形成;根据所述第一预设标记点的校准位置信息和图像位置信息、所述第二预设标记点的校准位置信息和图像位置信息、虚拟路径上任一位置点的第一图像位置信息,调整所述指引结构。
- 根据权利要求9所述的确定方法,其特征在于,还包括:根据所述校准装置上的多个第一预设标记点在校准坐标系中的校准位置信息和在图像坐标系中的图像坐标信息,确定所述校准坐标系和所述图像坐标系之间的第一转换关系;根据所述第一转换关系得到校准后的所述二维投影图像。
- 根据权利要求10所述的确定方法,其特征在于,所述定位装置包括第二标识板,所述第二标识板上设置有多个第三预设标记点,所述校准装置与所述定位装置分离;所述第二转换关系通过下述方式获取:获取所述校准坐标系和所述图像坐标系之间的第一转换关系和所述拍摄装置的焦点位置信息;根据所述拍摄装置的焦点位置信息、所述第二标识板在所述定位坐标系下的定位坐标信息、所述第一转换关系和所述第二标识板在所述图像坐 标系中的图像坐标信息,确定所述第二转换关系,所述透视坐标系与所述焦点位置信息相关。
- 根据权利要求11所述的确定方法,其特征在于,基于多个所述第二预设标记点在图像坐标系中的图像位置信息、基于所述校准坐标系下的校准位置信息和所述第一转换关系,确定所述拍摄装置的焦点位置信息。
- 根据权利要求12所述的确定方法,其特征在于,步骤S4中,调整指引结构使得所述指引结构的指引方向与所述虚拟路径对应的手术导引路径匹配的步骤中,包括:根据所述靶点路径的透视坐标信息、所述第二转换关系,得到所述手术导引路径在所述定位坐标系下的定位位置信息;根据所述手术导引路径的定位位置信息、和所述指引结构在所述定位坐标系下的定位位置信息,调整所述指引结构,使得所述指引结构的指引方向与所述手术导引路径的延伸方向重合。
- 根据权利要求13所述的确定方法,其特征在于,所述指引结构包括光束发射部件,在步骤S3中,所述光束部件发射的光束指向靶点;在步骤S4中,所述光束部件发射的光束与所述靶点路径匹配;或者,所述指引结构包括器械导向通道,在步骤S3中,所述器械导向通道的中轴线指向所述靶点;在步骤S4中,所述器械导向通道的中轴线与所述靶点路径匹配。
- 根据权利要求1或14所述的确定方法,其特征在于,所述靶点路径确定***还包括投影装置,在步骤S4中还包括:获取基于所述投影装置的投影坐标系与所述透视坐标系之间的第三转换关系;根据所述三维局部图像和所述虚拟路径的三维姿态信息、所述第三转换关系,确定所述患处在所述投影坐标系下的投影位置信息,以根据所述投影位置信息进行投影。
- 根据权利要求15所述的确定方法,其特征在于,获取基于所述投影装置的投影坐标系与所述透视坐标系之间的第三转换关系的步骤中,包 括:通过所述投影装置获取所述校准装置中的预设标记点在所述投影坐标系下的投影位置信息;根据所述第三预设标记点的投影位置信息和在所述透视坐标系下的坐标信息,确定所述投影坐标系与所述透视坐标系之间的第三转换关系。
- 根据权利要求16所述的确定方法,其特征在于,若所述指引结构包括器械导向通道,还包括:获取所述器械导向通道在所述透视坐标系下的位置信息,根据所述第三转换关系获取所述器械导向通道在所述投影坐标系下的投影位置信息,以根据所述器械导向通道的投影位置信息进行投影。
- 根据权利要求16或17所述的确定方法,其特征在于,根据定位坐标系下所述指引结构的定位位置信息、所述焦点位置信息、所述第一转换关系、所述第二转换关系和图像坐标系中的投影靶点的位置信息,调整所述指引结构使得所述指引结构的指引方向指向体内靶点。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/431,683 US12035974B2 (en) | 2019-03-04 | 2020-03-04 | Method for determining target spot path |
Applications Claiming Priority (10)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910161726.6 | 2019-03-04 | ||
CN201910161268.6A CN109925054B (zh) | 2019-03-04 | 2019-03-04 | 确定靶点路径的辅助方法、装置和***、可读存储介质 |
CN201910161268.6 | 2019-03-04 | ||
CN201910161266.7 | 2019-03-04 | ||
CN201910161263.3 | 2019-03-04 | ||
CN201910161266.7A CN109925053B (zh) | 2019-03-04 | 2019-03-04 | 手术路径的确定方法、装置和***、可读存储介质 |
CN201910161265.2 | 2019-03-04 | ||
CN201910161265.2A CN109938848B (zh) | 2019-03-04 | 2019-03-04 | 定位***和靶点定位方法 |
CN201910161726.6A CN109993792B (zh) | 2019-03-04 | 2019-03-04 | 投影方法、装置及***和可读存储介质 |
CN201910161263.3A CN109925052B (zh) | 2019-03-04 | 2019-03-04 | 靶点路径的确定方法、装置和***、可读存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020177725A1 true WO2020177725A1 (zh) | 2020-09-10 |
Family
ID=72338381
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/077846 WO2020177725A1 (zh) | 2019-03-04 | 2020-03-04 | 一种靶点路径的确定方法 |
Country Status (2)
Country | Link |
---|---|
US (1) | US12035974B2 (zh) |
WO (1) | WO2020177725A1 (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116459000B (zh) * | 2023-03-29 | 2023-09-19 | 北京诺亦腾科技有限公司 | 确定空间路径的方法、装置、设备和介质 |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120106819A1 (en) * | 2009-04-25 | 2012-05-03 | Siemens Aktiengesellschaft | method and a system for assessing the relative pose of an implant and a bone of a creature |
CN106420052A (zh) * | 2016-08-31 | 2017-02-22 | 北京市计算中心 | 一种靶点位置的导航方法及*** |
CN106794044A (zh) * | 2015-06-05 | 2017-05-31 | 陈阶晓 | 术中追踪方法 |
CN107679574A (zh) * | 2017-09-29 | 2018-02-09 | 深圳开立生物医疗科技股份有限公司 | 超声图像处理方法及*** |
CN109044529A (zh) * | 2018-08-20 | 2018-12-21 | 杭州三坛医疗科技有限公司 | 导向通道的构建方法、装置和电子设备 |
CN109195527A (zh) * | 2016-03-13 | 2019-01-11 | 乌泽医疗有限公司 | 用于与骨骼手术一起使用的设备及方法 |
CN109925053A (zh) * | 2019-03-04 | 2019-06-25 | 杭州三坛医疗科技有限公司 | 手术路径的确定方法、装置和***、可读存储介质 |
CN109925052A (zh) * | 2019-03-04 | 2019-06-25 | 杭州三坛医疗科技有限公司 | 靶点路径的确定方法、装置和***、可读存储介质 |
CN109925054A (zh) * | 2019-03-04 | 2019-06-25 | 杭州三坛医疗科技有限公司 | 确定靶点路径的辅助方法、装置和***、可读存储介质 |
CN109993792A (zh) * | 2019-03-04 | 2019-07-09 | 杭州三坛医疗科技有限公司 | 投影方法、装置及***和可读存储介质 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1931237A2 (en) * | 2005-09-14 | 2008-06-18 | Neoguide Systems, Inc. | Methods and apparatus for performing transluminal and other procedures |
EP2852326B1 (en) * | 2012-05-22 | 2018-12-05 | Mazor Robotics Ltd. | On-site verification of implant positioning |
US10191615B2 (en) * | 2016-04-28 | 2019-01-29 | Medtronic Navigation, Inc. | Method and apparatus for image-based navigation |
EP3306335A1 (en) * | 2016-10-07 | 2018-04-11 | Ion Beam Applications S.A. | Apparatus and method for localizing the bragg peak of a hadron beam traversing a target tissue by magnetic resonance imaging |
US11779192B2 (en) * | 2017-05-03 | 2023-10-10 | Covidien Lp | Medical image viewer control from surgeon's camera |
US10874469B2 (en) * | 2017-05-22 | 2020-12-29 | Tsinghua University | Remotely operated orthopedic surgical robot system for fracture reduction with visual-servo control method |
US20220079675A1 (en) * | 2018-11-16 | 2022-03-17 | Philipp K. Lang | Augmented Reality Guidance for Surgical Procedures with Adjustment of Scale, Convergence and Focal Plane or Focal Point of Virtual Data |
US11553969B1 (en) * | 2019-02-14 | 2023-01-17 | Onpoint Medical, Inc. | System for computation of object coordinates accounting for movement of a surgical site for spinal and other procedures |
-
2020
- 2020-03-04 WO PCT/CN2020/077846 patent/WO2020177725A1/zh active Application Filing
- 2020-03-04 US US17/431,683 patent/US12035974B2/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120106819A1 (en) * | 2009-04-25 | 2012-05-03 | Siemens Aktiengesellschaft | method and a system for assessing the relative pose of an implant and a bone of a creature |
CN106794044A (zh) * | 2015-06-05 | 2017-05-31 | 陈阶晓 | 术中追踪方法 |
CN109195527A (zh) * | 2016-03-13 | 2019-01-11 | 乌泽医疗有限公司 | 用于与骨骼手术一起使用的设备及方法 |
CN106420052A (zh) * | 2016-08-31 | 2017-02-22 | 北京市计算中心 | 一种靶点位置的导航方法及*** |
CN107679574A (zh) * | 2017-09-29 | 2018-02-09 | 深圳开立生物医疗科技股份有限公司 | 超声图像处理方法及*** |
CN109044529A (zh) * | 2018-08-20 | 2018-12-21 | 杭州三坛医疗科技有限公司 | 导向通道的构建方法、装置和电子设备 |
CN109925053A (zh) * | 2019-03-04 | 2019-06-25 | 杭州三坛医疗科技有限公司 | 手术路径的确定方法、装置和***、可读存储介质 |
CN109925052A (zh) * | 2019-03-04 | 2019-06-25 | 杭州三坛医疗科技有限公司 | 靶点路径的确定方法、装置和***、可读存储介质 |
CN109925054A (zh) * | 2019-03-04 | 2019-06-25 | 杭州三坛医疗科技有限公司 | 确定靶点路径的辅助方法、装置和***、可读存储介质 |
CN109993792A (zh) * | 2019-03-04 | 2019-07-09 | 杭州三坛医疗科技有限公司 | 投影方法、装置及***和可读存储介质 |
Also Published As
Publication number | Publication date |
---|---|
US20220133409A1 (en) | 2022-05-05 |
US12035974B2 (en) | 2024-07-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210022809A1 (en) | Robotic fluoroscopic navigation | |
CN107468350B (zh) | 一种三维图像专用标定器、手术定位***及定位方法 | |
AU2018202088B2 (en) | Integration between 3d maps and fluoroscopic images | |
CN109925052B (zh) | 靶点路径的确定方法、装置和***、可读存储介质 | |
EP3711700B1 (en) | System for neuronavigation registration and robotic trajectory guidance, and related methods and devices | |
CN109993792B (zh) | 投影方法、装置及***和可读存储介质 | |
US9693748B2 (en) | System and method for automatically determining calibration parameters of a fluoroscope | |
CN109925054B (zh) | 确定靶点路径的辅助方法、装置和***、可读存储介质 | |
EP3295887B1 (en) | Robotic fluoroscopic navigation | |
CN109925053A (zh) | 手术路径的确定方法、装置和***、可读存储介质 | |
JP2021146218A (ja) | ニューロナビゲーション位置合わせおよびロボット軌道誘導のためのシステム、ならびに関連する方法およびデバイス | |
CN117179896A (zh) | 具有平板配准夹具的外科导航*** | |
WO2020177725A1 (zh) | 一种靶点路径的确定方法 | |
CN214549596U (zh) | 医疗*** | |
JP2019505271A (ja) | 投影データセットの提供 | |
CN210228333U (zh) | 定位*** | |
TW201519856A (zh) | 手術定位方法 | |
WO2022078110A1 (zh) | 医疗*** | |
CN115530978A (zh) | 一种导航定位方法及*** | |
CN109938848B (zh) | 定位***和靶点定位方法 | |
US20200297431A1 (en) | System for neuronavigation registration and robotic trajectory guidance, and related methods and devices | |
KR101863574B1 (ko) | 레이저 표적 투영장치와 C-arm 영상의 정합 방법, 이를 수행하기 위한 기록 매체 및 정합용 툴을 포함하는 레이저 수술 유도 시스템 | |
KR20210016433A (ko) | 간 수술을 위한 정렬 시스템 | |
US20240074819A1 (en) | Robotic fluoroscopic navigation | |
JP2022521615A (ja) | 介入装置追跡 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20766258 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20766258 Country of ref document: EP Kind code of ref document: A1 |