WO2022265772A1 - Robot-assisted surgical guide system for performing surgery - Google Patents
Robot-assisted surgical guide system for performing surgery Download PDFInfo
- Publication number
- WO2022265772A1 WO2022265772A1 PCT/US2022/029066 US2022029066W WO2022265772A1 WO 2022265772 A1 WO2022265772 A1 WO 2022265772A1 US 2022029066 W US2022029066 W US 2022029066W WO 2022265772 A1 WO2022265772 A1 WO 2022265772A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- surgical
- surgical guide
- guide
- sensor
- instrument
- Prior art date
Links
- 238000001356 surgical procedure Methods 0.000 title description 33
- 238000013519 translation Methods 0.000 claims abstract description 24
- 230000003287 optical effect Effects 0.000 claims description 38
- 230000007246 mechanism Effects 0.000 claims description 19
- 230000003746 surface roughness Effects 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 description 49
- 230000014616 translation Effects 0.000 description 22
- 238000000034 method Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 10
- 238000002594 fluoroscopy Methods 0.000 description 9
- 230000008901 benefit Effects 0.000 description 7
- 238000005259 measurement Methods 0.000 description 7
- 238000006073 displacement reaction Methods 0.000 description 6
- 230000035515 penetration Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000005855 radiation Effects 0.000 description 5
- 238000003780 insertion Methods 0.000 description 4
- 230000037431 insertion Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 210000001367 artery Anatomy 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 239000002184 metal Substances 0.000 description 3
- 210000000056 organ Anatomy 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 238000003325 tomography Methods 0.000 description 3
- 230000005355 Hall effect Effects 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000005530 etching Methods 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 238000002324 minimally invasive surgery Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000002601 radiography Methods 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 210000003462 vein Anatomy 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 206010051763 Bone marrow oedema Diseases 0.000 description 1
- 241001631457 Cannula Species 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000002591 computed tomography Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 238000002224 dissection Methods 0.000 description 1
- 235000012489 doughnuts Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004049 embossing Methods 0.000 description 1
- 239000002783 friction material Substances 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000036512 infertility Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 229920001296 polysiloxane Polymers 0.000 description 1
- 239000004810 polytetrafluoroethylene Substances 0.000 description 1
- 229920001343 polytetrafluoroethylene Polymers 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000007788 roughening Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 230000002747 voluntary effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/10—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges for stereotaxic surgery, e.g. frame-based stereotaxis
- A61B90/11—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges for stereotaxic surgery, e.g. frame-based stereotaxis with guides for needles or instruments, e.g. arcuate slides or ball joints
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2055—Optical tracking systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2059—Mechanical position encoders
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2065—Tracking using image or pattern recognition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
- A61B2090/061—Measuring instruments not otherwise provided for for measuring dimensions, e.g. length
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
- A61B2090/062—Measuring instruments not otherwise provided for penetration depth
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/06—Measuring instruments not otherwise provided for
- A61B2090/064—Measuring instruments not otherwise provided for for measuring force, pressure or mechanical tension
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
- A61B2090/3762—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
- A61B2090/3966—Radiopaque markers visible in an X-ray image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/25—User interfaces for surgical systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/90—Identification means for patients or instruments, e.g. tags
- A61B90/98—Identification means for patients or instruments, e.g. tags using electromagnetic means, e.g. transponders
Definitions
- the present disclosure relates generally to the field of medical systems and, in particular, to a robot-assisted sensorized surgical guide that may be used in combination with an imaging device or system.
- the present disclosure is directed to various embodiments of a system and method for performing robot-assisted surgery.
- the system may include a radiological imaging device or system, a bed to support a patient, a robotic arm disposed adjacent to the radiological imaging system, and a sensorized surgical guide attached to the robotic arm and that holds a surgical instrument and measures the translation of a surgical instrument along an axis of intervention and the rotation of the surgical instrument about the axis of intervention.
- the axis of intervention point is determined, and the robotic arm positions the sensorized surgical guide in line with the axis of intervention point so that the surgical instrument may be guided to the target area of the patient.
- the surgical guide are included.
- FIG. 1 shows an exemplary surgical system including a radiological imaging system and a sensorized surgical guide attached to a robotic arm, according to an embodiment of the present invention
- FIG. 2 shows another exemplary surgical system including a radiological imaging system and a sensorized surgical guide attached to a robotic arm, according to an embodiment of the present invention
- FIG. 3 shows an exemplary sensorized surgical guide having a hinged structure, according to an embodiment of the present invention
- FIG. 4 shows the sensorized surgical guide of FIG. 3 in use with a cannula positioned in a distal guide and a surgical instrument positioned in a proximal guide and the cannula, according to an embodiment of the present invention
- FIG. 5 shows an exemplary sensorized surgical guide including distance sensors disposed on the distal end of the sensor guide, according to an embodiment of the present invention
- FIG. 6 shows another exemplary sensorized surgical guide including a depth indicator to alert a surgeon to the depth of a surgical instrument inside a patient, according to an embodiment of the present invention
- FIG. 7 shows another exemplary sensorized surgical guide having a generally U-shape attached to a robotic arm, according to an embodiment of the present invention
- FIGS. 8-12 show exemplary steps to perform a surgical procedure using a surgical system including a radiological imaging system and a sensorized surgical guide attached to a robotic arm, according to an embodiment of the present invention.
- FIGS. 13A and 13B are exemplary screen shots from a display of a surgical system showing fluoroscopic images and indicators used by a surgeon during surgery, according to an embodiment of the present invention;
- FIG. 14 shows another exemplary embodiment of a sensorized surgical guide attached to a robotic arm
- FIGS. 15-18 show exemplary steps to perform a surgical procedure using a surgical system including the sensorized surgical guide shown in FIG. 14, according to an embodiment of the present invention
- FIG. 19 is an exemplary screen shot from a display of a surgical system showing a fluoroscopic image and a colored bar code indicating the distance between the surgical instrument and the target area, according to an embodiment of the present invention
- FIG. 20 is a schematic diagram of the sensorized surgical guide depicted in FIG. 7, according to an embodiment of the present invention.
- FIGS. 21 A and 21 B are exemplary pictures showing what the surface reader of a sensorized surgical guide sees, according to an embodiment of the present invention.
- FIG. 22 is a schematic diagram showing the energizing of a shutter for a sensorized surgical guide, according to an embodiment of the present invention
- FIGS. 23A and 23B are schematic diagrams showing the shutter assembly of a sensorized surgical guide, according to an embodiment of the present invention
- FIG. 24 is a flowchart of a process that controls the use of a surgical instrument during surgery, according to an embodiment of the present invention
- FIG. 25 is another view of the sensorized surgical guide depicted in FIG. 7 and attached to a robotic arm, according to an embodiment of the present invention
- FIG. 26A is a schematic diagram of the sensorized surgical guide of FIG. 25;
- FIG. 26B is a side view of the sensorized surgical guide of FIG. 25;
- FIG. 27 shows the main components of the sensorized surgical guide of
- FIG. 29 shows how the sensorized surgical guide of FIG. 25 may be opened to insert a cannula and a surgical instrument
- FIG. 30 is a block diagram of an integrated circuit that includes a camera sensor and an LED;
- FIG. 31 is a cross-section of the integrated circuit whose block diagram is shown in FIG. 30;
- FIG. 32 shows a pairing slider
- FIG. 33 shows background noise of the sensor and surface readings
- FIG. 34 shows an embodiment of the sensorized guide having sterile and/or disposable parts
- FIG. 35 shows another exemplary sensorized surgical guide attached to a robotic arm
- FIG. 36 is a detailed view of parts of the sensorized surgical guide of FIG. 35, including a motion detector;
- FIG. 37 shows several embodiments of the fixed part of the motion detector of FIG. 36.
- FIGS. 38A and 38B show several views of the removable part of the motion detector of FIG. 36.
- surgical system 10 includes radiological imaging system 12, robotic arm 14, sensorized surgical guide 16, and bed 18.
- System 10 may be useful in both medical and veterinary applications for performing radiological imaging and robotic assisted surgeries.
- Radiological imaging system 12 is used to view at least a portion of a patient surrounding a target area for surgery.
- sensorized surgical guide 16 may be used with a variety of surgical instruments relating to dissection, occlusion, retraction, grasping, energy (e.g., laser), ultrasound, cameras, and the like.
- the surgical instrument may be radio opaque marked such that it is more visible using the radiological imaging system.
- the surgical instrument may include additional markers internally or externally indicating the length of the surgical instrument.
- robotic arm 14 positions sensorized surgical guide 16 at a determined location and angle relative to the patient in order to allow a surgeon to use the sensorized surgical guide for a set of surgical instruments during an intervention.
- Sensorized surgical guide 16 may include at least one sensor to measure the translation of the inserted surgical instrument along an axis of intervention or rotation about the axis of intervention that can be used to continuously monitor the insertion depth of the inserted surgical instrument.
- the radiological imaging system and sensorized surgical guide can provide constant feedback to the surgeon about the position of the inserted surgical instrument in the patient.
- the system may also include a display having a graphical user interface and navigation software capable of acquiring images from the radiological imaging system and referencing the position and orientation of a surgical instrument fed through the sensorized surgical guide.
- radiological imaging system 12 is suitable for performing radiological imaging examinations including, but not limited to, X-rays, CT scans, and fluoroscopy.
- the imaging system includes a control unit suitable to control the radiological imaging system.
- Bed 18 extends along main direction 20 (shown in FIG. 2) and has a support surface for the patient.
- radiological imaging system 12 includes a gantry 22 suitable to perform the radiological imaging of at least one portion of the patient and defining an analysis zone 24 suitable to house at least a portion of bed 18.
- the gantry may have a circular shape as shown in FIGS. 1 and 2, which is suitable to house at least one portion of bed 18 and the patient.
- the radiological imaging system shown in the embodiment of FIG. 2 includes a load-bearing structure 26 suitable to support gantry 22.
- gantry 22 contains various components for performing a radiological scan. Examples of the components contained in gantry 22 include, but are not limited to, the following.
- the gantry may also include at least one detector 30 suitable to receive the radiation emitted by source 28 and suitable to be positioned substantially on the opposite side of bed 18 from the source.
- gantry 22 may include housing 32 suitable to contain at least partially the aforementioned components, and the housing may contain additional components as needed.
- detector 30 is suitable to detect the radiation (e.g., X-ray) that has traversed the patient’s body during a scan.
- detector 30 may include a sensing element such as a flat panel and/or a linear sensor.
- the system may not include a gantry, and the locations of the source and detector may define the analysis zone.
- load-bearing structure 26 includes base 34 suitable to support gantry 22.
- the structure includes translating component 36 suitable to move gantry 22 in a sliding direction substantially parallel to main direction 20.
- the structure may include wheels 38, which may be pivoting wheels, suitable to roll on the floor when moving system 10.
- translating component 36 includes a linear guide 40 suitable to control the translational motion along the sliding direction that is substantially parallel to main direction 20.
- Translating component 36 may include a carriage 42 suitable to slide along linear guide 40. In one embodiment, the carriage moves along the linear guide with the assistance of a motor. Any suitable mechanism may be used to move the gantry 22, either manually or mechanically/automatically.
- the radiological imaging system includes a rotation device (not shown) suitable to rotate gantry 22 about an axis of rotation that is substantially perpendicular to main direction 20 and, specifically, substantially perpendicular to the floor.
- the rotation device may include a first plate that is integrally attached to carriage 42.
- the rotation device may also include a second plate integrally attached to gantry 22.
- the rotation device may include a rotation component (not shown) that has pins, bearings, or other known mechanical elements suitable to permit the second plate, and thereby gantry 22, to rotate about the axis of rotation, in relation to the first plate, and therefore to the rest of radiological imaging system 12.
- the rotation device may also have a control lever or other mechanism, suitable to be held by an operator, to control the rotation of gantry 22 about the axis.
- a handle or any other type of grip may be used to control the rotation of gantry 22 about the axis.
- the rotation device and the control lever permit gantry 22 to be disposed in at least two configurations.
- One possible configuration is a working configuration in which gantry 22 is substantially perpendicular to main direction 20.
- Another possible configuration is a rest configuration in which gantry 22 is substantially parallel to main direction 20. In the rest configuration the bed may no longer be attached to the imaging system.
- the rotation device and control lever may also permit the gantry to be in a variety of other positions and angles relative to main direction 20.
- the robotic arm may also be put into a rest configuration in which the robot arm is not extended and allows the entire system to be transported more easily.
- detector 30 detects radiation when performing at least one of tomography, fluoroscopy, radiography, and multimodality and generates data signals based on the radiation received.
- at least one detector includes at least one flat panel sensor and/or at least one linear sensor.
- the flat panel sensor is selectably operable in at least a flat panel mode and a linear sensor mode obtained, for example, by activating one or more pixel rows that are, preferably, substantially perpendicular to the axis of the bore.
- the senor in the flat panel mode, performs at least one of fluoroscopy and tomography and, in the linear sensor mode, performs at least one of radiography and tomography.
- an imaging system are disclosed in U.S. Pat. Nos. 9,510,793, 10,136,867, 10,154,824, and 10,265,042, each of which is incorporated herein by reference in its entirety, as if set forth fully herein.
- the system disclosed in this application may incorporate any of the imaging systems disclosed in these referenced applications, as robotic arm 14 and sensorized surgical guide 16 may be attached to a portion of any of these referenced imaging systems.
- Robotic arm 14 and sensorized surgical guide 16 may be used with various other imaging devices or systems such as MRI devices.
- Robotic arm 14 and sensorized surgical guide 16 may be designed such that the robotic arm attaches to bed 18 or the imaging system for examination, and then may be detached from the bed or imaging system after the examination.
- robotic arm 14 includes base 50 and several arm segments 52 connected to one another. Arm segments 52 are able to rotate and move in relation to each other by way of a motor or individual motors and gears located at the junction between each arm segment.
- the base may be attached to radiological imaging system 12 or bed 18.
- the base of the robotic arm may be moved in any direction, both parallel and perpendicular to the main axis.
- base 50 may be positioned independent of the radiological imaging system or the bed and be independently positioned near the area of interest.
- the robotic arm may include wheels that allow movement in any direction to be in proper position adjacent to the patient. The wheels of the robotic arm in this embodiment may lock in place.
- the robotic arm may be positioned independently on the floor and not be connected to the imaging system or the bed.
- base 50 of the robotic arm may be removably attached to the imaging system, the bed, or other object in the surgery room.
- the base may house a motor capable of moving one or more of the arm segments.
- the last arm segment holds sensorized surgical guide 16, which may be removably or permanently attached to the arm segment of robotic arm 14.
- robotic arm base 50 may be mounted on base 34 of the radiological imaging system.
- the robotic arm base moves in the same translational direction of the gantry over the target and/or bed.
- the robotic arm may be a modular arm that may be removed from the gantry track or any other mounting point of the radiological imaging system, for ease of use, and mount and dismount from the radiological imaging system.
- the modular robotic arm may be mounted upon a mobile cart that is motorized (on treads, wheels, etc.) or manually driven by a user from one location to another location.
- the modular robotic arm is mounted directly to the gantry, at a fixed point or on an internal or external track that is separate from the gantry track, or to either end of the base platform of the radiological imaging system.
- more than one modular robotic arm is mounted to the radiological imaging system.
- Each of the modular robotic arms may be equipped with a unique tool to perform a specific task.
- the robotic arm may incorporate six-degree-of- freedom force sensors, to be used to obtain controlled compliance in case of contact (voluntary or not) with the surgeon. This compliance may be obtained just along the intervention axis or along any other axis, depending on a pre-setting in control software. These compliances may be used to adapt the robotic arm position with respect to a cannula and the patient.
- System 10 may also include a system computer or server that is in communication with radiological imaging system 12, robotic arm 14, and sensorized surgical guide 16. The system computer or server also may be in communication with a display and graphical user interface.
- the system computer includes navigation software capable of referencing a position and orientation of an axis of intervention point and instructing robotic arm 14 to move sensorized surgical guide 16 to align with the axis of intervention point.
- Data from the sensorized surgical guide related to the translation and rotational movement of a surgical instrument positioned through the sensorized surgical guide may be sent to the system computer in order to monitor the movement of the surgical instrument within the body of the patient.
- Images from the radiological imaging system 12 may also be sent to the system computer and displayed, which may allow the surgeon to view the target area to be treated.
- the navigation software may allow the surgeon to find the best axis of intervention point. Any data from a patient monitoring or tracking device may also be sent to the system computer.
- the surgical instrument may also be marked or coated such that it is more visible using the radiological imaging system.
- the surgical instrument is radio-opaque.
- only certain instruments, with special markings or the like, may be recognized by sensorized surgical guide 16. In this way, the system may more precisely be calibrated to provide more accurate translation and rotation measurements, because the software that handles the measurements may recognize the particular instrument and load the related calibration table. This result may be obtained by using a coated texture (that the sensor on the surgical guide could recognize) or by an RFID or other embedded identification system.
- Embodiments of a display 200 associated with the system computer and navigation software are shown in FIGS. 13A and 13B.
- the system computer may show images 204 from radiological imaging system 12.
- the navigation software on the system computer may show the axis of intervention point and even determine or assist in determining the safest and most efficient axis of intervention point.
- the system computer also may show on display 200 a color-coded bar 202 (whose different colors are indicated by different cross-hatch patterns) indicating the depth of the surgical instrument in the body of the patient. Other indicia indicating the depth of the surgical instrument also may be shown on the display.
- the surgical team may select the images, information, or color-coded bars to show on the display.
- FIG. 3 One embodiment 16a of sensorized surgical guide 16 is shown in FIG. 3.
- the sensorized surgical guide includes a proximal or rotational section 60 attached to a distal or fixed section 62.
- Hinges 64 may attach the proximal section to the distal section. The hinges allow proximal section 60 to rotate up to 180 degrees with respect to the plane defined by distal section 62.
- distal section 62 may be fixed or rigidly connected to the last arm segment of robotic arm 14.
- a proximal guide 66 is disposed on proximal section 60 and a distal guide 68 is disposed on distal section 62.
- the proximal and distal guides have through holes 70, 72 in alignment with one another.
- the proximal and distal guides each include ball bearings 74, 76. The ball bearings help translate a surgical instrument through the proximal and distal guides.
- the ball bearings may be spring loaded to put pressure on any instrument being slid through the guides.
- the diameters of through holes 70, 72 may have different sizes.
- the inner diameter of distal through hole 72 may be equal to the outer diameter of a surgical instrument such as a cannula.
- the diameter of proximal through hole 70 may be equal to or slightly larger than the inner diameter of the cannula in order to accommodate surgical instruments that may be inserted through the cannula.
- the diameter of through hole 70 may range from about 1.9 mm to about 15 mm.
- proximal guide 66 may include a surface reader 69 capable of measuring the translation of a surgical instrument.
- Surface reader 69 may also be used to measure the rotation of the surgical instrument.
- the surface reader may be an Optical Navigation Chip.
- the surface reader may be similar to a sensor in a PC mouse.
- surface reader 69 may include a camera that is disposed over a movable opaque surface and illuminated. In this embodiment, the surface movements of the surgical instrument are detected by surface reader 69, and X, Y quadrature digital signals may be outputted by the surface reader as a result of the movement.
- the Optical Navigation Chip may provide X, Y displacements on a serial line, and each time the Optical navigation Chip is read, the X, Y registers are reset. The reader is then able to accumulate the X, Y displacements and rescale them in order to make the expected translation/rotation measurement.
- the quadrature signals may be used as the equivalent of two incremental encoders and sent, with a specific interface between, to a computer operating navigation software, where those signals may be used for monitoring in real time the penetration of the surgical instrument in the body.
- FIG. 4 shows one embodiment for using sensorized surgical guide 16a.
- the proximal section is rotated (not shown) in order to place a cannula 80 through the hole of distal guide 68.
- the inner diameter of the distal guide should be sized such that the cannula is able to translate along the distal guide in a straight line without allowing the cannula to wobble or move in an angle that is not parallel to through hole 72.
- the proximal section is rotated and locked such that guides 66 and 68 are aligned with one another.
- An instrument such as a gripper 82, may be slid through proximal guide 66 and into cannula 80.
- the working end of the gripper may exit the distal end of the cannula as shown in FIG. 4.
- sensorized surgical guide 16a may include at least one, and preferably two, distance sensors 90 on the distal end of distal section 62 as shown in FIG. 5.
- the distance sensors are capable of sensing in real-time the distance between the sensorized surgical guide and the skin of the patient.
- the distance sensors may be time-of-flight laser ranging sensors.
- an alarm signal could be produced and sent to a controller of robotic arm 14 to activate a safety function.
- the threshold range may be set to any distance, in one embodiment, the threshold range may be from about 3 mm to about 100 cm. If the threshold distance between the sensors and the patient is breached, the robotic arm may be programed to move away from the patient along the intervention axis, the surgical instruments may be released from the sensorized surgical guide, or the robotic arm could disengage along the insertion point.
- the sensorized surgical guide 16a may include a bar display 92 as shown in FIG. 6.
- the bar display may include LED lights or other illuminators that indicate distance between the guide and the patient body or the depth of the surgical instrument inside the patient body based on color or a distance reader (e.g., a bar graph).
- the bar display 92 may include a display indicating the distance and depth information as a numeric value. The same information indicated by the bar display may be shown on a monitor, but the display may not be in the surgeon’s view. For this reason, it may be beneficial to include the bar display on the sensorized surgical guide so that the information concerning the depth of the surgical instrument is in the surgeon’s view when performing the operation.
- the depth indicator on the bar display may be driven by the system computer running the navigation software.
- sensorized surgical guide 16b is generally U-shaped and includes a proximal or rotational section 100 attached to a distal or fixed section 102.
- a pivot 104 such as a pin or a bolt, may attach proximal section 100 to distal section 102.
- the pivot allows proximal section 100 to rotate up to 360 degrees or 90 degrees in any direction around the axis of the pivot.
- distal section 102 may be connected to end portion 106 on the last arm segment of robotic arm 14.
- End portion 106 or the last segment of the robotic arm may be able to rotate up to 360 degrees around the axis formed by the last arm segment of the robotic arm, and the end portion may be able to tilt in any direction to adjust the location of the sensorized surgical guide.
- a proximal guide 108 is disposed on proximal section 100 and a distal guide 110 is disposed on distal section 102.
- the proximal and distal guides each have a through hole in alignment with one another along an axis of intervention 112.
- Proximal guide 108 and distal guide 110 may be the same as the proximal and distal guides described above with respect to sensorized surgical guide 16a.
- the proximal and distal guides may each include ball bearings that help translate a surgical instrument through the proximal and distal guides along the axis of intervention 112.
- the ball bearings may be spring loaded to put pressure on any instrument being slid through the guides.
- the diameters of the through holes on the proximal and distal guides may have different sizes.
- the inner diameter of the through hole on the distal section may be equal to the outer diameter of a surgical instrument such as a cannula.
- the through hole of the proximal section may be equal to or slightly larger than the inner diameter of the cannula in order to accommodate surgical instruments that may be inserted through the cannula.
- the diameter of the through hole may range from about 1.9 mm to about 15 mm.
- proximal guide 108 may include a surface reader or a displacement sensor 109 capable of measuring the translation of a surgical instrument.
- the surface reader or displacement sensor also may be used to measure the rotation of the surgical instrument.
- the various types of surface readers described above with respect to surface reader 69 may also be used with sensorized surgical guide 16b.
- the connection between distal section 102 and end portion 106 of the robotic arm may be a releasable connection, such as an electro magnetic connection.
- This connection may also be pneumatic, hydraulic, or the like.
- the connection may be controlled by the system computer or may manually be released. In use, if there were an issue, the system computer or surgeon could release the connection between distal section 102 and end portion 106 of the robotic arm to abort the robot-assisted holding of the cannula or other surgical instrument.
- the releasable connection may be an electro-magnetic connection, pneumatic, hydraulic, or the like.
- the releasable connection(s) in this embodiment may be controlled by the system computer or manually released by the surgeon in case aborting the robot-assisted holding of the cannula or other surgical instrument is necessary.
- proximal guide 108 and/or distal guide 110 may include a locking mechanism to prevent the movement of a surgical instrument or cannula, respectively.
- the locking mechanism may be controlled by the system computer or may be manually activated by the surgeon.
- the locking mechanism may be a mechanical spring-based device or an electro magnetic coil-based device. In use, if sensors determine that the patient body has moved or the sensorized surgical guide or robotic arm breaches a threshold distance to the patient body, the system computer may activate the locking mechanism and prevent further translation of the cannula or surgical instrument.
- proximal section 100 is rotated approximately 90 degrees in order to place a cannula through the hole of distal guide 110.
- the inner diameter of the distal guide should be sized such that the cannula is able to translate along the distal guide in a straight line without allowing the cannula to wobble or move in an angle that is not parallel to the axis of intervention 112.
- proximal section 100 is rotated back into its original working configuration and locked such that guides 108 and 110 are aligned with one another.
- An instrument may be slid through proximal guide 108 and into cannula 80 held within distal guide 110. The working end of the surgical instrument may exit the distal end of the cannula.
- a method of using system 10 will be described using sensorized surgical guide 16b.
- the sensorized surgical guide 16a could be used in place of sensorized surgical guide 16b.
- a surgical team diagnoses a patient and identifies a defect or target area, such as a tumor, that needs to be removed from the body.
- the surgical team plans the needed surgery including the point and angle of intervention into the body of the patient.
- Radiological imaging system 12 may be used to visualize a portion of the patient’s body in order to plan the surgery and determine the intervention point and angle.
- the surgical team plans to remove a tumor from the patient.
- system 10 may constantly monitor the position of the body or at least the target area on the patient. This may be done by reading sensors attached to the body of the patient, such as infrared (IR) sensors or other sensors that may be monitored by the navigation software system. Other technologies that monitor distance and location, such as a stereo IR camera and the like may be used. In addition to knowing the position of the body or at least the target area, the surgical team enters the intervention point and angle through the user interface of the system computer.
- IR infrared
- system computer and navigation software may determine the axis of intervention point.
- the navigation software running on the system computer supplies the intervention point, angle, and direction (axis) of intervention to robotic arm 14, which moves to place sensorized surgical guide 16b (or 16a) along the axis of intervention and at a certain distance from the patient body as shown in FIGS. 7 and 8.
- the surgeon may open proximal section 100 of the sensorized surgical guide as shown in FIG. 9.
- the surgeon may insert a trocar and cannula 114, in one example, through distal guide 110 as shown in FIG. 10.
- the physician may then insert the trocar into the body of the patient as robotic arm 14 holds sensorized surgical guide 16b in position, which allows the surgeon to move the trocar in the insertion point direction only.
- the surgeon removes the cutting portion of the trocar, leaving in site the cannula.
- the surgeon may then close proximal section 100 of sensorized surgical guide 16b as shown in FIG. 11. With proximal guide 108 in line with axis of intervention 112, the surgeon may insert a surgical instrument 116 through proximal guide 108 and into cannula 114 as shown in FIG. 12 to perform the surgical procedure.
- the surgical procedure may be continually assessed to monitor the location of the surgical instrument with respect to the target area and other structures (veins, arteries, organs, etc.) in the body.
- displacement sensor 109 of sensorized surgical guide 16b reads the surgical instrument’s penetration depth and sends this information to the navigation software on the system computer.
- the navigation software may display the surgical instrument’s penetration depth on display 200 using a color-coded bar 202 or other visual stimulus.
- a 2-D fluoroscopy image(s) 204 may be shown on the display to visually monitor the location of the surgical image as shown in FIGS. 13A and 13B.
- the surgeon may use and take a fluoroscopy image at any point during the surgical procedure, and, in other embodiments, the fluoroscopy image may continuously be taken during the surgical procedure so the entire procedure may be followed on the display. Other information useful to the surgeon may also be shown on the display.
- sensorized surgical guide 16c includes a holder arm 120 having a proximal end 122 and a distal end 124, with proximal end 122 attached to the last arm segment of the robotic arm.
- holder arm 120 is generally tubular shaped and includes a window 126.
- a proximal guide 128 is disposed near proximal end 122 and may be movable from within holder arm 120.
- the proximal and distal guides each have a through hole in alignment with one another along an axis of intervention 132.
- the proximal guide 108 and distal guide 110 may be similar to the proximal and distal guides described above with respect to sensorized surgical guide 16a.
- the proximal and distal guides may each include ball bearings that help translate a surgical instrument through the proximal and distal guides along the axis of intervention 132.
- the ball bearings may be spring loaded to put pressure on any instrument being slid through the guides.
- the diameters of the through holes on the proximal and distal guides may have different sizes.
- the inner diameter of the through hole on distal guide 130 may be equal to the outer diameter of a surgical instrument such as a cannula.
- the through hole of the proximal guide may be equal to or slightly larger than the inner diameter of the cannula in order to accommodate surgical instruments that may be inserted through the cannula.
- proximal guide 128 may include a surface reader capable of measuring the translation of a surgical instrument. As discussed above, the surface reader also may be used to measure the rotation of the surgical instrument. The various types of surface readers described above with respect to surface reader 69 may also be used with sensorized surgical guide 16b.
- system 10 may constantly monitor the position of the body or at least the target area on the patient. This may be done by reading sensors attached to the body of the patient. Other technologies that monitor distance and location, such as cameras (e.g., Lidar), lasers, and the like, may be used.
- the surgical team enters the intervention point and angle using the user interface of the system computer.
- the navigation software running on the system computer supplies the intervention point, angle, and direction (axis) of intervention to robotic arm 14, which moves to place sensorized surgical guide 16c along the axis of intervention 132.
- the surgeon may insert a trocar and cannula 140 through window 126 and into holder arm 120, where the cannula is fed into and through the canal of distal guide 130 as shown in FIG. 15.
- the physician may then insert the trocar into the body of the patient as robotic arm 14 holds sensorized surgical guide 16c in position, which allows the surgeon to move the trocar in the insertion point direction only.
- the surgeon removes the cutting portion of the trocar, leaving in site the cannula as shown in FIG. 16.
- proximal guide 128 may be moved within holder arm 120 and secured into position near proximal end 122 as shown in FIG. 17. Proximal guide 128 may be secured within a cutout portion of the holder arm or, in other embodiments, proximal guide 128 may be moved into and out of the holder arm by using polished pins and rack- and-pinion gears.
- a surgical instrument 141 may then be slid through the canal of proximal guide 128 and into cannula 140 held within distal guide 130.
- the working end of the surgical instrument may exit the distal end of the cannula to perform the surgical procedure as shown in FIG. 18.
- the surgical procedure may be continually assessed to monitor the location of the surgical instrument with respect to the target area and other structures (veins, arteries, organs, etc.) in the body.
- the surface reader in proximal sensor 128 of sensorized surgical guide 16c reads the surgical instrument’s penetration depth and sends this information to the navigation software on the system computer.
- the navigation software may display the surgical instrument’s penetration depth on a display 160 using a color-coded bar 162 (whose different colors are indicated by different cross-hatch patterns) or other visual stimulus.
- the color-coded bar shows the distance to the target area, using green, yellow, and red to tell the surgeon to advance (green), slow down (yellow), and stop (red) progression.
- a pointer 166 may be shown on the display to indicate the current position of the distal end of the surgical instrument. Audio and tactile stimuli may also be used to provide feedback to the surgeon when advancing the surgical instrument. Also, a 2-D fluoroscopy image(s) 164 may be shown on the display to visually monitor the location of the surgical instrument as shown in FIG. 19. The surgeon may use and take a fluoroscopy image at any point during the surgical procedure, and, in other embodiments, the fluoroscopy image may continuously be taken during the surgical procedure so the entire procedure may be followed on the display. Other information useful to the surgeon may also be shown on the display. Once the surgical procedure is complete, the surgical instrument and cannula are removed from the patient, and robotic arm 14 may be removed from system 10 or placed in a non-working configuration that allows greater access to the patient and allows the patient to be removed from imaging system 12.
- the sensorized surgical guide may also control the use of surgical instruments during surgery. More specifically, the surface reader on the sensorized surgical guide that measures the translation and rotation of the inserted surgical instrument may also read markings or patterns on the surface of the surgical instrument itself. If the markings or patterns on the surgical instrument indicate that the instrument comes from an authorized source or is of an authorized type, a shutter assembly allows the surgical instrument to be used with the sensorized surgical guide.
- FIG. 20 is a schematic diagram of sensorized surgical guide 16b, according to an embodiment of the present invention.
- Sensorized surgical guide 16b includes surface reader 109, piston 6, spring 7, and solenoid 8.
- surface reader 109 may be a small video camera that detects the movement (e.g., translation and rotation) of a surface. This video camera may grab images of the surface at a certain frame rate, and, using software, the surface reader may process those images in order to understand the relative movement of the surface.
- the same image set may be also used to detect a pattern printed on the surface, and the software may generate a signal when the detected pattern matches a pre-loaded, authorized reference pattern.
- the software may generate a signal when the detected pattern matches a pre-loaded, authorized reference pattern.
- FIGS. 21 A and 21 B are exemplary pictures showing what the surface reader of sensorized surgical guide 16b may see, according to an embodiment of the present invention.
- FIG. 21 A shows a normal surface
- FIG. 21 B shows an example of a patterned surface.
- the generated signal when the pattern is detected may be used to command a shutter assembly made up of piston 6, spring 7, and solenoid 8.
- the shutter assembly may be an electro-mechanical device that is placed so as to obstruct, when commanded, surgical instrument path 4 (shown in FIG. 20).
- the obstruction may be partial or complete, depending on the embodiment of the shutter.
- the obstruction may be realized using solenoid 8 and a plunger 9 (shown in FIGS. 22, 23A, and 23B).
- FIG. 22 shows that when solenoid 8 is energized, plunger 9 may be pulled within the solenoid, opening surgical instrument path 4.
- plunger 9 may move piston 6, which, when solenoid 8 is de-energized, partially obstructs surgical instrument path 4. This position may be held using spring 7.
- solenoid 8 When solenoid 8 is energized, plunger 9 is pulled within solenoid 8 and places piston 6 in a position such that surgical instrument path 4 is free.
- the field produced by solenoid 8 on plunger 9 should be capable of overcoming the resistance of spring 7.
- FIGS. 23A and 23B are schematic diagrams showing the de-energized and energized states, respectively, for this embodiment of the shutter assembly of sensorized surgical guide 16b.
- shutter assemblies may be used in addition to or instead of the shutter assembly described above.
- the shutter may have an optional coating such as silicone to avoid potential instrument damage.
- One embodiment of a shutter may comprise an iris mechanism, e.g., a camera shutter that collapses circumferentially.
- Another embodiment of a shutter may comprise an inflatable or debatable donut that closes the opening of the surgical path.
- FIG. 24 shows a flowchart 500 of a process that controls the use of a surgical instrument during surgery, according to an embodiment of the present invention.
- sensorized surgical guide 16b is empty and the shutter is closed, i.e. , it blocks passage of a surgical instrument.
- a surgical instrument may be inserted into sensorized surgical guide 16b by a person or by a robot, or a combination of both.
- the surface of the surgical instrument is read.
- the process asks whether the surgical instrument is authorized, which occurs if there are pre authorized markings or a pre-authorized pattern on the surgical instrument.
- the shutter may be energized, thus unblocking the surgical instrument path. In operation 530, surgery may then be performed. On the other hand, if the surgical instrument is not authorized, in operation 535 the shutter remains de-energized, and the surgical instrument path remains obstructed, thus not allowing surgery using sensorized surgical guide 16b.
- a warning light or sound may be activated alerting the surgeon of the attempt to use an unauthorized instrument.
- a message may be displayed on a system monitor with such a warning or alert.
- each of the other sensorized surgical guides described above, 16, 16a, and 16c may include a surface reader capable of reading and identifying markings or patterns on a surgical instrument in addition to measuring translation and rotation of such instrument.
- the shutter assembly may be modified in order to fit within the confines of the specific surgical guide used.
- the authorizing pattern may be cross-hatch marks, surface roughening, arrangements of letters or numbers, or a one-dimensional or two-dimensional bar code or some other pattern that identifies the manufacturer of the surgical instrument, the manufacturer of the surgical guide, the manufacturer of the surgical system, including the robotics associated therein, or an authorized licensee of such manufacturers, depending on which entity desires to control surgical access.
- the pattern may also identify instrument type, so as to be able to allow or block certain types of surgical instruments.
- the pattern may be laser or chemical etched on the surface of the surgical instrument or otherwise printed thereon. The printing may be performed by a surgical instrument manufacturer before selling the instrument or by an authorized user of the surgical system before performing the surgical procedure (using an authorized printer and/or authorized printing software).
- the pattern may also include calibration marks so that the translation and rotation sensor may be synchronized with those marks in order to improve precision. It is preferable that the identifying pattern cannot be copied by an unauthorized entity.
- inductive and/or capacitive sensing could be used to identify an authorized instrument.
- the reader may read the inductive and/or capacitive identification.
- the system may use a radio-frequency identification (RFID) tag to identify authorized surgical instruments.
- RFID radio-frequency identification
- the surface reader may also include an RFID reader that may detect the RFID tag embedded in or on the surgical instrument.
- Unauthorized instruments may not have the same quality or precision as that of authorized instruments and thus may pose a danger to a patient during surgery, may not work as well as authorized instruments, or may not be able to take advantage of all the benefits of the surgical system. Unauthorized instruments may also not be calibrated, such that the surgical system cannot determine how far the instrument has traveled or whether the instrument has been rotated.
- sensorized surgical guides 16, 16a, 16b, and 16c are not limited to any specific procedure and may be used in a variety of surgical procedures.
- system 10 may be used for bone edema procedures.
- sensorized surgical guides 16, 16a, 16b, and 16c may be used with a variety of surgical instruments including, but not limited to, trocars, cannulas, scissors, probes, lasers, monopolar RF, bipolar RF or multipolar RF devices, graspers, forceps, electro-surgical knives, ultrasonic transducers, cameras, and the like.
- Surgical system 10 may also be used with other medical imaging systems such as MRI.
- FIG. 25 shows sensorized surgical guide 251 attached to robotic arm 252, surgical instrument 253, and cannula 254.
- Sensorized surgical guide 251 measures the translation of surgical instrument 253 along one axis of intervention and the rotation about the same axis.
- Sensorized surgical guide 251 has applications in minimally invasive surgery (MIS), where a surgical instrument (e.g., trocar, laparoscope, pliers, laser, etc.) is inserted in the human body through a small incision made in the skin. The surgeon has a limited sight of the instrument once inserted in the body.
- Sensorized surgical guide 251 helps the surgeon detect the position and rotation of the instrument head.
- MIS minimally invasive surgery
- Sensorized surgical guide 251 can also read the manufacturer’s markings and/or certification on a surgical instrument, allowing a surgical instrument to be bought from many producers without needing to modify it.
- FIG. 26A is a schematic diagram of sensorized surgical guide 251.
- FIG. 26B is a side view of the sensorized surgical guide showing exemplary dimensions in mm.
- FIG. 27 shows the main components of sensorized surgical guide 251 , including fixed section 272 (similar to distal or fixed section 102 in FIG. 7), movable section 271 (similar to proximal section 100 in FIG. 7) that contains the main sensor and electronics, pin 274 and spring 276 about which movable part 271 rotates, connection 273 to the robot, and related screws 275.
- FIG. 28 shows an exploded view of sensorized surgical guide 251 including movable section 271 , fixed part 272, and connection 273 to the robot.
- FIG. 28 also shows shutter 277 (similar to that in FIG.
- FIG. 29 shows how the sensorized surgical guide 251 device may be opened. First, movable section 271 is rotated, then cannula 254 is inserted, the guide is closed, and then surgical instrument 253 is inserted.
- Sensorized surgical guide 251 may use an optical sensor such as a high speed camera to analyze the surface of surgical instrument 253.
- the optical sensor may be a low-cost surface reader in a two-dimensional optical position measurement system.
- the working principle is based on detecting and correlating microscopic, inherent features of the surface over which the optical sensor travels.
- optical sensor chip PMW3360 from PixArt Imaging Inc. (TW) may be used as the optical device.
- FIG. 30 is a block diagram of the PMW3360 integrated circuit that includes an optical (camera) sensor and an LED. This device allows access to relative XY distance in counts as well as raw image data.
- the PMW3360 sensor includes an LED and an infrared (monochrome) image camera of 36x36 pixels running at a frame rate of up to 12,000 frames/sec. Such a high acquisition and processing speed guarantees accuracy of even high speed movements.
- the inspection area can be concentrated within a 1x1 mm square.
- the internal digital signal processor (DSP) acquires an image and compares it with the next image, isolating artifacts due to surface imperfections. The movement of artifacts in the evolution of the frame acquisitions provides an estimation of the counts of two-dimensional translations.
- the optical sensor is used with one or more optical lenses, such as is shown in FIG. 31 , which is a cross-section of the PMW3360 integrated circuit as assembled. That figure shows two optical lenses, the first of which is used to align the light emitted from the infrared LED on the PMW3360 chip, and the second of which focuses the surface image on the optical sensor, which may be a picture element array.
- Sensorized surgical guide 251 also includes a pairing slider, such as that shown in FIG. 32.
- This is a mechanical device that holds the optical lens and couples the optical sensor close to the sliding instrument.
- the pairing slider can be designed to connect two flat springs that connect the side of the slider (on the left in FIG. 32) with the mechanical housing and push down the slider.
- the trapezoid format of the physical arrangement allows the assembly to move, maximizing the stiffness against the rotation of the holder around the rod.
- Sensorized surgical guide 251 also includes a detector processing unit.
- the microcontroller application software reads information from the optical sensor, processes such information, and generates displacement and rotation measurements.
- the application software transmits such information to the application host via a USB interface, for example.
- Two types of information may be read from the optical sensor: (1) relative movements in arbitrary units (counts of movements, not mm or degrees); or (2) raster raw image information, which permits a better analysis of the data but may require more intensive calculation algorithms. All of these components can be assembled in a mechanical housing that holds them in a minimal space (see FIG.
- FIG. 33 shows relatively low background noise of the PMW3360 optical sensor, even though it is exposed to varying levels of ambient light.
- Optimum performance (linear and rotational movement repeatability) of this sensor is obtained with surfaces having average roughness (right photo in FIG. 33). Flaving a glossy surface, as may occur with a mirror or polished metal (center photo in FIG. 33), sometimes results in inaccurate measurements and repeatability.
- another optical sensor and/or illuminator may be used in sensorized surgical guide 251 instead of the PMW3360.
- a coherent laser emitter e.g., a vertical cavity surface emitting laser (VCSEL)
- VCSEL vertical cavity surface emitting laser
- the major advantages of this approach are less interference from backscattered light, no need for an optical lens (because the laser beam is focused within the package), less sensitivity to distance variations (no sensitivity at all for short vibrations ⁇ 0.5 mm), and lower power consumption.
- this improved sensor Because the dimensions of this improved sensor are small (e.g., 3.4 x 3.2 mm), multiple devices can be installed in one sensorized surgical guide. This option enables multiple material detection crossing, multi-point detection for better accuracy, and increases the types of surgical instruments that can be sensed by the sensorized surgical guide.
- the sensorized surgical guide has one set of bushings 280, 281 (FIG. 28).
- bushing 280 may have a cavity of 6 mm diameter in order to host a cannula of 6 mm outer diameter (OD), 5 mm inner diameter (ID).
- Bushing 281 then has a cavity of 5 mm diameter, which is compatible with an instrument having a 5 mm OD.
- Other embodiments may include an interchangeable set of bushings to accommodate instruments having 1.9 mm to 15 mm OD.
- some parts of the sensorized surgical guide may be detachable for a number of reasons. First, they may be detachable to increase sterility. These detachable parts can be manufactured sterile and be used as disposable parts 341.
- FIG. 34 shows disposable parts 341 , 342 that can be sterile (in dashed line) and the parts that can be covered by sterile drapes (in solid line).
- the detachable parts may be used in a threshold release mechanism that allows the surgical instrument to be disconnected from the robot when the patient moves.
- This mechanism can be built using a magnetic threshold device, which disconnects the disposable parts (in contact with the surgical instrument) when the force on the threshold device exceeds a predefined level. In this way, if the patient moves as the surgical instrument is inserted into the body, the robot can hold its position and the surgical instrument can follow the patient’s body, increasing safety.
- FIG. 35 shows yet another embodiment of a sensorized surgical guide 351 attached to robotic arm 352, which can measure the translation of a surgical instrument 353 along one axis of intervention and the rotation about the same axis.
- This embodiment includes a motion detector that differs from that of the previous embodiment - it has two parts and its sensing mechanism may be optical, magnetic, or mechanical.
- FIG. 36 is a detailed view of sensorized surgical guide 351, including support structure 361, which may include control electronics, connection 361b to the robot, interchangeable bushing 362, and handle 362b that fixes bushing 362 in position. Changing bushing 362 allows use of surgical instruments 353 having various diameters.
- the two parts of the motion detector are fixed part 363, which includes one or more optical, magnetic, and/or mechanical sensors and associated electronics, and removable part 364, which is in contact with surgical instrument 353.
- FIG. 37 shows several embodiments of fixed part 363 of the motion sensor along with how that part can be integrated in the main body or housing of sensorized surgical guide 351.
- Fixed part 363 includes one or more sensors that can be processed by electronics that could be entirely or partially integrated in the surgical guide body. There may be a sensor for each sphere, which arrangement is described below. If there is one sensor, it will correspond with one of the spheres. If two or three sensors are used, they are placed 120 degrees apart, to correspond with two or all three of the spheres.
- FIG. 37 shows a one-sensor embodiment, with sensor 371 , and a three-sensor embodiment, with sensors 372, 373, 374.
- FIGS. 38A and 38B show several views of an embodiment of removable part 364.
- Removable part 364 includes three spheres 381 placed 120 degrees apart. Each sphere is held in contact with surgical instrument 353 using low-friction sphere holder 382 and springs 383. Using three spheres, surgical instrument 353 can slide in the middle, while keeping contact with the instrument and ensuring smooth travel. The three spheres keep the instrument centered and co-linear with the cylinder identified by bushing 362. Having three spheres held in place by springs 383 allows the diameter of the surgical instrument to vary within a certain range. Another advantage of having a removable part, which is in contact with surgical instrument 353, is that it can be disposable and sterile, with the benefits as discussed above with respect to FIG. 34.
- the mechanisms sense both translation and rotation of the instrument.
- the optical sensing of this embodiment differs from the other disclosed embodiments, the optical sensing mechanism operates similarly in that it is still based on the recognition of structured patterns or surface roughness. But instead of sensing the patterns or roughness on the instrument, this embodiment senses the patterns or roughness of the spheres.
- the spheres may be covered with a matte surface or printed with a structured pattern.
- Sensors 371-374 may be of the same family as that used in previous embodiments (e.g., PMW3360 or PAT9125SEL or similar sensors), placed in order to see the bottom of the sphere.
- the magnetic sensing mechanism for this embodiment is based on magnetic field detection.
- a 3D, linear Hall-effect sensor integrated circuit provides a digital value corresponding to the magnetic field measured in each of the x- y-, and z-axes. This type of sensor is often used in 3D sensing applications for head-on linear motion, slide-by position sensing, and rotation angle measurements.
- each sphere of removable part 364 of the sensor mechanism may be magnetic, and when the instrument travels or rotates in the center of the spheres, it causes the spheres to move. If the spheres are magnetic, a rotating field is created and sensed by the Hall-effect sensors. Changes in the magnetic field can be processed to obtain linear and rotational movements as outputs.
- a mechanical sensor may be used instead of using an optical or magnetic sensor to determine translation and/or rotation of the surgical instrument.
- a surface reader may comprise a profilometer to read the etching or embossing or engraving.
- a wheel such as that used in an opisometer or curvimeter, may be used to track the movement of the surgical instrument. The wheel may be connected to an electronic encoder to calculate distance. Two wheels, at 90 degrees to one another, may be used to track both translation and rotation of the instrument. In another embodiment, three linear wheels and three rotational wheels may be used for greater accuracy.
- a trackball such as that found in a computer mouse, may be used to track translation and rotation.
- the senor may be moved to the surgical instrument so that the instrument itself does not need to be read.
- the instrument is surrounded by a clamping component made up of two pieces - a metal top and a magnetic bottom.
- This clamping component fits inside of the surgical guide tube.
- the top may contain a light source such as an LED or a laser, as well as an optical sensor; the bottom may contain a battery to power the light source. Alternatively, the top may contain the battery and connecting it to the bottom half completes a power circuit.
- the clamping component is preferably locked, for example by actuating solenoids to keep the clamping component together.
- the LED/laser on the clamping component illuminates the inside surface of the guide tube, and the optical sensor reads the surface of the guide tube.
- the guide tube may be lined with one or more magnetic strips that can read the relative location and rotation of the clamping component via magnetic sensing.
- the clamping component expands to an integral guide tube that clamps onto the surgical instrument.
- the surgical instrument is inserted into the guide tube, and the guide tube, using, for example, a rack-and- pinion mechanism, tightens an O-ring or a grommet clamp on the instrument.
- the guide tube may be marked with gradations or etchings or patterns as described above with respect to the instrument itself, so these markings may be read using an LED/laser/optical sensor combination also as described above. Thus, the surgical instrument would not need to be itself marked.
Landscapes
- Health & Medical Sciences (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Pathology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Robotics (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
A surgical guide includes a fixed portion and a movable portion. The movable portion includes a sensor, and the surgical guide measures translation of a surgical instrument along an axis of intervention and rotation about the axis. Another embodiment of the surgical guide includes a fixed portion having a motion sensor and a removable portion having at least three spheres. The removable portion fits inside of the fixed portion. The surgical instrument contacts the spheres, and the motion sensor senses the movement caused by the instrument of the corresponding sphere.
Description
ROBOT-ASSISTED SURGICAL GUIDE SYSTEM FOR PERFORMING SURGERY
CLAIM OF PRIORITY
[0001] The present application claims priority from U.S. Application No. 17/320,195, filed on May 13, 2021 , which is a continuation in part of U.S. Application No. 16/160,575, filed on October 15, 2018, which claims priority from U.S. Provisional Application No. 62/572,986, filed on October 16, 2017, and from U.S. Provisional Application No. 62/627,565, filed on February 7, 2018, all of which are incorporated by reference in their entireties.
FIELD
[0002] The present disclosure relates generally to the field of medical systems and, in particular, to a robot-assisted sensorized surgical guide that may be used in combination with an imaging device or system.
BACKGROUND
[0003] With any type of surgery there is a health risk to the patient. During a surgical procedure, gaining access to a target area within the body of a patient may be difficult and may require precise navigation around vital arteries and organs.
What is needed is a universal assistant for a surgeon to perform safer and more efficient surgeries.
SUMMARY
[0004] Briefly, and in general terms, the present disclosure is directed to various embodiments of a system and method for performing robot-assisted surgery. The system may include a radiological imaging device or system, a bed to support a patient, a robotic arm disposed adjacent to the radiological imaging system, and a sensorized surgical guide attached to the robotic arm and that holds a surgical instrument and measures the translation of a surgical instrument along an axis of intervention and the rotation of the surgical instrument about the axis of intervention. In use, the axis of intervention point is determined, and the robotic arm positions the sensorized surgical guide in line with the axis of intervention point so that the
surgical instrument may be guided to the target area of the patient. Several embodiments of the surgical guide are included.
[0005] Other features and advantages will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, which illustrate by way of example the features of the various embodiments.
BRIEF DESCRIPTION OF THE DRAWINGS
[0006] FIG. 1 shows an exemplary surgical system including a radiological imaging system and a sensorized surgical guide attached to a robotic arm, according to an embodiment of the present invention;
[0007] FIG. 2 shows another exemplary surgical system including a radiological imaging system and a sensorized surgical guide attached to a robotic arm, according to an embodiment of the present invention;
[0008] FIG. 3 shows an exemplary sensorized surgical guide having a hinged structure, according to an embodiment of the present invention;
[0009] FIG. 4 shows the sensorized surgical guide of FIG. 3 in use with a cannula positioned in a distal guide and a surgical instrument positioned in a proximal guide and the cannula, according to an embodiment of the present invention;
[0010] FIG. 5 shows an exemplary sensorized surgical guide including distance sensors disposed on the distal end of the sensor guide, according to an embodiment of the present invention;
[0011 ] FIG. 6 shows another exemplary sensorized surgical guide including a depth indicator to alert a surgeon to the depth of a surgical instrument inside a patient, according to an embodiment of the present invention;
[0012] FIG. 7 shows another exemplary sensorized surgical guide having a generally U-shape attached to a robotic arm, according to an embodiment of the present invention;
[0013] FIGS. 8-12 show exemplary steps to perform a surgical procedure using a surgical system including a radiological imaging system and a sensorized surgical guide attached to a robotic arm, according to an embodiment of the present invention.
[0014] FIGS. 13A and 13B are exemplary screen shots from a display of a surgical system showing fluoroscopic images and indicators used by a surgeon during surgery, according to an embodiment of the present invention;
[0015] FIG. 14 shows another exemplary embodiment of a sensorized surgical guide attached to a robotic arm;
[0016] FIGS. 15-18 show exemplary steps to perform a surgical procedure using a surgical system including the sensorized surgical guide shown in FIG. 14, according to an embodiment of the present invention;
[0017] FIG. 19 is an exemplary screen shot from a display of a surgical system showing a fluoroscopic image and a colored bar code indicating the distance between the surgical instrument and the target area, according to an embodiment of the present invention;
[0018] FIG. 20 is a schematic diagram of the sensorized surgical guide depicted in FIG. 7, according to an embodiment of the present invention;
[0019] FIGS. 21 A and 21 B are exemplary pictures showing what the surface reader of a sensorized surgical guide sees, according to an embodiment of the present invention;
[0020] FIG. 22 is a schematic diagram showing the energizing of a shutter for a sensorized surgical guide, according to an embodiment of the present invention; [0021] FIGS. 23A and 23B are schematic diagrams showing the shutter assembly of a sensorized surgical guide, according to an embodiment of the present invention; [0022] FIG. 24 is a flowchart of a process that controls the use of a surgical instrument during surgery, according to an embodiment of the present invention; [0023] FIG. 25 is another view of the sensorized surgical guide depicted in FIG. 7 and attached to a robotic arm, according to an embodiment of the present invention; [0024] FIG. 26A is a schematic diagram of the sensorized surgical guide of FIG. 25;
[0025] FIG. 26B is a side view of the sensorized surgical guide of FIG. 25;
[0026] FIG. 27 shows the main components of the sensorized surgical guide of
FIG. 25;
[0027] FIG. 28 shows a reverse exploded view of the sensorized surgical guide of FIG. 25;
[0028] FIG. 29 shows how the sensorized surgical guide of FIG. 25 may be opened to insert a cannula and a surgical instrument;
[0029] FIG. 30 is a block diagram of an integrated circuit that includes a camera sensor and an LED;
[0030] FIG. 31 is a cross-section of the integrated circuit whose block diagram is shown in FIG. 30;
[0031] FIG. 32 shows a pairing slider;
[0032] FIG. 33 shows background noise of the sensor and surface readings; [0033] FIG. 34 shows an embodiment of the sensorized guide having sterile and/or disposable parts;
[0034] FIG. 35 shows another exemplary sensorized surgical guide attached to a robotic arm;
[0035] FIG. 36 is a detailed view of parts of the sensorized surgical guide of FIG. 35, including a motion detector;
[0036] FIG. 37 shows several embodiments of the fixed part of the motion detector of FIG. 36; and
[0037] FIGS. 38A and 38B show several views of the removable part of the motion detector of FIG. 36.
[0038] Where considered appropriate, reference numerals may be repeated among the drawings to indicate corresponding or analogous elements. Moreover, some of the blocks depicted in the drawings may be combined into a single function.
DETAILED DESCRIPTION
[0039] In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the invention. However, it will be understood by those of ordinary skill in the art that the embodiments of the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to obscure the present invention.
[0040] Each of the features and teachings disclosed herein can be used separately or in conjunction with other features and teachings to provide a surgical system including a radiological imaging system with a bed. Representative examples using many of these additional features and teachings, both separately and in combination, are described in further detail with reference to the attached figures.
[0041] With reference to FIG. 1, surgical system 10 includes radiological imaging system 12, robotic arm 14, sensorized surgical guide 16, and bed 18. System 10 may be useful in both medical and veterinary applications for performing radiological imaging and robotic assisted surgeries. Radiological imaging system 12 is used to view at least a portion of a patient surrounding a target area for surgery. In various embodiments, sensorized surgical guide 16 may be used with a variety of surgical instruments relating to dissection, occlusion, retraction, grasping, energy (e.g., laser), ultrasound, cameras, and the like. The surgical instrument may be radio opaque marked such that it is more visible using the radiological imaging system. In addition, the surgical instrument may include additional markers internally or externally indicating the length of the surgical instrument. In one embodiment, robotic arm 14 positions sensorized surgical guide 16 at a determined location and angle relative to the patient in order to allow a surgeon to use the sensorized surgical guide for a set of surgical instruments during an intervention. Sensorized surgical guide 16 may include at least one sensor to measure the translation of the inserted surgical instrument along an axis of intervention or rotation about the axis of intervention that can be used to continuously monitor the insertion depth of the inserted surgical instrument. Thus, the radiological imaging system and sensorized surgical guide can provide constant feedback to the surgeon about the position of the inserted surgical instrument in the patient. The system may also include a display having a graphical user interface and navigation software capable of acquiring images from the radiological imaging system and referencing the position and orientation of a surgical instrument fed through the sensorized surgical guide. In another embodiment, the system may not include the radiological imaging system.
[0042] In particular, radiological imaging system 12 is suitable for performing radiological imaging examinations including, but not limited to, X-rays, CT scans, and fluoroscopy. In one embodiment, the imaging system includes a control unit suitable to control the radiological imaging system. Bed 18 extends along main direction 20 (shown in FIG. 2) and has a support surface for the patient. In one embodiment, radiological imaging system 12 includes a gantry 22 suitable to perform the radiological imaging of at least one portion of the patient and defining an analysis zone 24 suitable to house at least a portion of bed 18. For example, the gantry may have a circular shape as shown in FIGS. 1 and 2, which is suitable to house at least one portion of bed 18 and the patient. Further, the radiological imaging system shown in the embodiment of FIG. 2 includes a load-bearing structure 26 suitable to support gantry 22.
[0043] As shown in FIG. 2, which is a partial cut-away, gantry 22 contains various components for performing a radiological scan. Examples of the components contained in gantry 22 include, but are not limited to, the following. A source 28 suitable to emit radiation, for example X-rays. The gantry may also include at least one detector 30 suitable to receive the radiation emitted by source 28 and suitable to be positioned substantially on the opposite side of bed 18 from the source. Further, gantry 22 may include housing 32 suitable to contain at least partially the aforementioned components, and the housing may contain additional components as needed. In particular, detector 30 is suitable to detect the radiation (e.g., X-ray) that has traversed the patient’s body during a scan. In one embodiment, detector 30 may include a sensing element such as a flat panel and/or a linear sensor. In further embodiments, the system may not include a gantry, and the locations of the source and detector may define the analysis zone.
[0044] As shown in the example of FIG. 2, load-bearing structure 26 includes base 34 suitable to support gantry 22. In one embodiment, the structure includes translating component 36 suitable to move gantry 22 in a sliding direction substantially parallel to main direction 20. In addition, the structure may include wheels 38, which may be pivoting wheels, suitable to roll on the floor when moving system 10.
[0045] In one embodiment, translating component 36 includes a linear guide 40 suitable to control the translational motion along the sliding direction that is substantially parallel to main direction 20. Translating component 36 may include a carriage 42 suitable to slide along linear guide 40. In one embodiment, the carriage moves along the linear guide with the assistance of a motor. Any suitable mechanism may be used to move the gantry 22, either manually or mechanically/automatically.
[0046] In one embodiment, the radiological imaging system includes a rotation device (not shown) suitable to rotate gantry 22 about an axis of rotation that is substantially perpendicular to main direction 20 and, specifically, substantially perpendicular to the floor. The rotation device may include a first plate that is integrally attached to carriage 42. The rotation device may also include a second plate integrally attached to gantry 22. In addition, the rotation device may include a rotation component (not shown) that has pins, bearings, or other known mechanical elements suitable to permit the second plate, and thereby gantry 22, to rotate about the axis of rotation, in relation to the first plate, and therefore to the rest of radiological imaging system 12. The rotation device may also have a control lever or other mechanism, suitable to be held by an operator, to control the rotation of gantry 22 about the axis. A handle or any other type of grip may be used to control the rotation of gantry 22 about the axis.
[0047] In one embodiment, the rotation device and the control lever permit gantry 22 to be disposed in at least two configurations. One possible configuration is a working configuration in which gantry 22 is substantially perpendicular to main direction 20. Another possible configuration is a rest configuration in which gantry 22 is substantially parallel to main direction 20. In the rest configuration the bed may no longer be attached to the imaging system. The rotation device and control lever may also permit the gantry to be in a variety of other positions and angles relative to main direction 20. The robotic arm may also be put into a rest configuration in which the robot arm is not extended and allows the entire system to be transported more easily.
[0048] One example of an imaging system is disclosed in U.S. Pat. No. 10,016,171, the entirety of which is incorporated herein by reference, as if set forth fully herein. In one embodiment, detector 30 detects radiation when performing at least one of tomography, fluoroscopy, radiography, and multimodality and generates data signals based on the radiation received. Furthermore, in one embodiment, at least one detector includes at least one flat panel sensor and/or at least one linear sensor. In an example embodiment in which the at least one detector is a flat panel sensor, the flat panel sensor is selectably operable in at least a flat panel mode and a linear sensor mode obtained, for example, by activating one or more pixel rows that are, preferably, substantially perpendicular to the axis of the bore. In a further example embodiment herein, in the flat panel mode, the sensor performs at least one of fluoroscopy and tomography and, in the linear sensor mode, performs at least one of radiography and tomography. Other examples of an imaging system are disclosed in U.S. Pat. Nos. 9,510,793, 10,136,867, 10,154,824, and 10,265,042, each of which is incorporated herein by reference in its entirety, as if set forth fully herein. The system disclosed in this application may incorporate any of the imaging systems disclosed in these referenced applications, as robotic arm 14 and sensorized surgical guide 16 may be attached to a portion of any of these referenced imaging systems.
[0049] Robotic arm 14 and sensorized surgical guide 16 may be used with various other imaging devices or systems such as MRI devices. Robotic arm 14 and sensorized surgical guide 16 may be designed such that the robotic arm attaches to bed 18 or the imaging system for examination, and then may be detached from the bed or imaging system after the examination.
[0050] As shown in FIG. 1 , robotic arm 14 includes base 50 and several arm segments 52 connected to one another. Arm segments 52 are able to rotate and move in relation to each other by way of a motor or individual motors and gears located at the junction between each arm segment. The base may be attached to radiological imaging system 12 or bed 18. The base of the robotic arm may be moved in any direction, both parallel and perpendicular to the main axis. In other embodiments, base 50 may be positioned independent of the radiological imaging
system or the bed and be independently positioned near the area of interest. In this embodiment, the robotic arm may include wheels that allow movement in any direction to be in proper position adjacent to the patient. The wheels of the robotic arm in this embodiment may lock in place. The robotic arm may be positioned independently on the floor and not be connected to the imaging system or the bed.
In yet another embodiment, base 50 of the robotic arm may be removably attached to the imaging system, the bed, or other object in the surgery room. The base may house a motor capable of moving one or more of the arm segments. The last arm segment holds sensorized surgical guide 16, which may be removably or permanently attached to the arm segment of robotic arm 14.
[0051] In one embodiment, robotic arm base 50 may be mounted on base 34 of the radiological imaging system. In this embodiment, the robotic arm base moves in the same translational direction of the gantry over the target and/or bed. The robotic arm may be a modular arm that may be removed from the gantry track or any other mounting point of the radiological imaging system, for ease of use, and mount and dismount from the radiological imaging system. According to one embodiment, the modular robotic arm may be mounted upon a mobile cart that is motorized (on treads, wheels, etc.) or manually driven by a user from one location to another location. According to another embodiment, the modular robotic arm is mounted directly to the gantry, at a fixed point or on an internal or external track that is separate from the gantry track, or to either end of the base platform of the radiological imaging system. In yet another embodiment, more than one modular robotic arm is mounted to the radiological imaging system. Each of the modular robotic arms may be equipped with a unique tool to perform a specific task.
[0052] In one embodiment, the robotic arm may incorporate six-degree-of- freedom force sensors, to be used to obtain controlled compliance in case of contact (voluntary or not) with the surgeon. This compliance may be obtained just along the intervention axis or along any other axis, depending on a pre-setting in control software. These compliances may be used to adapt the robotic arm position with respect to a cannula and the patient.
[0053] System 10 may also include a system computer or server that is in communication with radiological imaging system 12, robotic arm 14, and sensorized surgical guide 16. The system computer or server also may be in communication with a display and graphical user interface. In one embodiment, the system computer includes navigation software capable of referencing a position and orientation of an axis of intervention point and instructing robotic arm 14 to move sensorized surgical guide 16 to align with the axis of intervention point. Data from the sensorized surgical guide related to the translation and rotational movement of a surgical instrument positioned through the sensorized surgical guide may be sent to the system computer in order to monitor the movement of the surgical instrument within the body of the patient. Images from the radiological imaging system 12 may also be sent to the system computer and displayed, which may allow the surgeon to view the target area to be treated. Using the images from the radiological imaging system, the navigation software may allow the surgeon to find the best axis of intervention point. Any data from a patient monitoring or tracking device may also be sent to the system computer. The surgical instrument may also be marked or coated such that it is more visible using the radiological imaging system. In one embodiment, the surgical instrument is radio-opaque. In some embodiments, only certain instruments, with special markings or the like, may be recognized by sensorized surgical guide 16. In this way, the system may more precisely be calibrated to provide more accurate translation and rotation measurements, because the software that handles the measurements may recognize the particular instrument and load the related calibration table. This result may be obtained by using a coated texture (that the sensor on the surgical guide could recognize) or by an RFID or other embedded identification system.
[0054] Embodiments of a display 200 associated with the system computer and navigation software are shown in FIGS. 13A and 13B. As shown in FIG. 13A, the system computer may show images 204 from radiological imaging system 12. Furthermore, the navigation software on the system computer may show the axis of intervention point and even determine or assist in determining the safest and most efficient axis of intervention point. As shown in FIG. 13B, the system computer also
may show on display 200 a color-coded bar 202 (whose different colors are indicated by different cross-hatch patterns) indicating the depth of the surgical instrument in the body of the patient. Other indicia indicating the depth of the surgical instrument also may be shown on the display. The surgical team may select the images, information, or color-coded bars to show on the display.
[0055] One embodiment 16a of sensorized surgical guide 16 is shown in FIG. 3.
In this embodiment, the sensorized surgical guide includes a proximal or rotational section 60 attached to a distal or fixed section 62. Hinges 64 may attach the proximal section to the distal section. The hinges allow proximal section 60 to rotate up to 180 degrees with respect to the plane defined by distal section 62. In one embodiment, distal section 62 may be fixed or rigidly connected to the last arm segment of robotic arm 14. A proximal guide 66 is disposed on proximal section 60 and a distal guide 68 is disposed on distal section 62. The proximal and distal guides have through holes 70, 72 in alignment with one another. In one embodiment, the proximal and distal guides each include ball bearings 74, 76. The ball bearings help translate a surgical instrument through the proximal and distal guides. Moreover, the ball bearings may be spring loaded to put pressure on any instrument being slid through the guides. In other embodiments, through holes 70,
72 may be coated with a low-friction material (like PET + PTFE, for pharma and alimentary uses) instead of using ball bearings. The diameters of through holes 70, 72 may have different sizes. For instance, the inner diameter of distal through hole 72 may be equal to the outer diameter of a surgical instrument such as a cannula. The diameter of proximal through hole 70 may be equal to or slightly larger than the inner diameter of the cannula in order to accommodate surgical instruments that may be inserted through the cannula. In one embodiment, the diameter of through hole 70 may range from about 1.9 mm to about 15 mm.
[0056] As shown in FIG. 3, proximal guide 66 may include a surface reader 69 capable of measuring the translation of a surgical instrument. Surface reader 69 may also be used to measure the rotation of the surgical instrument. In one embodiment, the surface reader may be an Optical Navigation Chip. The surface reader may be similar to a sensor in a PC mouse. In other embodiments, surface
reader 69 may include a camera that is disposed over a movable opaque surface and illuminated. In this embodiment, the surface movements of the surgical instrument are detected by surface reader 69, and X, Y quadrature digital signals may be outputted by the surface reader as a result of the movement. In certain embodiments, the Optical Navigation Chip may provide X, Y displacements on a serial line, and each time the Optical navigation Chip is read, the X, Y registers are reset. The reader is then able to accumulate the X, Y displacements and rescale them in order to make the expected translation/rotation measurement. As an example, the quadrature signals may be used as the equivalent of two incremental encoders and sent, with a specific interface between, to a computer operating navigation software, where those signals may be used for monitoring in real time the penetration of the surgical instrument in the body.
[0057] By way of example only, and not by way of limitation, FIG. 4 shows one embodiment for using sensorized surgical guide 16a. In this example, the proximal section is rotated (not shown) in order to place a cannula 80 through the hole of distal guide 68. As stated above, the inner diameter of the distal guide should be sized such that the cannula is able to translate along the distal guide in a straight line without allowing the cannula to wobble or move in an angle that is not parallel to through hole 72. Once the cannula is in position, the proximal section is rotated and locked such that guides 66 and 68 are aligned with one another. An instrument, such as a gripper 82, may be slid through proximal guide 66 and into cannula 80.
The working end of the gripper may exit the distal end of the cannula as shown in FIG. 4.
[0058] In another embodiment, sensorized surgical guide 16a may include at least one, and preferably two, distance sensors 90 on the distal end of distal section 62 as shown in FIG. 5. The distance sensors are capable of sensing in real-time the distance between the sensorized surgical guide and the skin of the patient. In one embodiment, the distance sensors may be time-of-flight laser ranging sensors.
When the distance between the sensors and the patient is less than a predetermined threshold, an alarm signal could be produced and sent to a controller of robotic arm 14 to activate a safety function. Although the threshold range may be set to any
distance, in one embodiment, the threshold range may be from about 3 mm to about 100 cm. If the threshold distance between the sensors and the patient is breached, the robotic arm may be programed to move away from the patient along the intervention axis, the surgical instruments may be released from the sensorized surgical guide, or the robotic arm could disengage along the insertion point. These safety features could prevent a collision between the sensorized surgical guide 16a and the patient body in case the patient body is moved during the intervention.
[0059] In another embodiment, the sensorized surgical guide 16a may include a bar display 92 as shown in FIG. 6. The bar display may include LED lights or other illuminators that indicate distance between the guide and the patient body or the depth of the surgical instrument inside the patient body based on color or a distance reader (e.g., a bar graph). In another embodiment, the bar display 92 may include a display indicating the distance and depth information as a numeric value. The same information indicated by the bar display may be shown on a monitor, but the display may not be in the surgeon’s view. For this reason, it may be beneficial to include the bar display on the sensorized surgical guide so that the information concerning the depth of the surgical instrument is in the surgeon’s view when performing the operation. The depth indicator on the bar display may be driven by the system computer running the navigation software.
[0060] Another embodiment 16b of sensorized surgical guide 16 is shown in FIG. 7. In this embodiment, sensorized surgical guide 16b is generally U-shaped and includes a proximal or rotational section 100 attached to a distal or fixed section 102. A pivot 104, such as a pin or a bolt, may attach proximal section 100 to distal section 102. The pivot allows proximal section 100 to rotate up to 360 degrees or 90 degrees in any direction around the axis of the pivot. As shown in FIG. 7, distal section 102 may be connected to end portion 106 on the last arm segment of robotic arm 14. End portion 106 or the last segment of the robotic arm may be able to rotate up to 360 degrees around the axis formed by the last arm segment of the robotic arm, and the end portion may be able to tilt in any direction to adjust the location of the sensorized surgical guide. A proximal guide 108 is disposed on proximal section 100 and a distal guide 110 is disposed on distal section 102. The proximal and distal
guides each have a through hole in alignment with one another along an axis of intervention 112. Proximal guide 108 and distal guide 110 may be the same as the proximal and distal guides described above with respect to sensorized surgical guide 16a. In this way, the proximal and distal guides may each include ball bearings that help translate a surgical instrument through the proximal and distal guides along the axis of intervention 112. Moreover, the ball bearings may be spring loaded to put pressure on any instrument being slid through the guides. The diameters of the through holes on the proximal and distal guides may have different sizes. For instance, the inner diameter of the through hole on the distal section may be equal to the outer diameter of a surgical instrument such as a cannula. The through hole of the proximal section may be equal to or slightly larger than the inner diameter of the cannula in order to accommodate surgical instruments that may be inserted through the cannula. In one embodiment, the diameter of the through hole may range from about 1.9 mm to about 15 mm.
[0061] Furthermore, proximal guide 108 may include a surface reader or a displacement sensor 109 capable of measuring the translation of a surgical instrument. As discussed above, the surface reader or displacement sensor also may be used to measure the rotation of the surgical instrument. The various types of surface readers described above with respect to surface reader 69 may also be used with sensorized surgical guide 16b.
[0062] In one embodiment, the connection between distal section 102 and end portion 106 of the robotic arm may be a releasable connection, such as an electro magnetic connection. This connection may also be pneumatic, hydraulic, or the like. In this embodiment, the connection may be controlled by the system computer or may manually be released. In use, if there were an issue, the system computer or surgeon could release the connection between distal section 102 and end portion 106 of the robotic arm to abort the robot-assisted holding of the cannula or other surgical instrument. In other embodiments, there may be a releasable connection located anywhere under proximal guide 108 and a separate releasable connection located anywhere under distal guide 110. As above, the releasable connection may be an electro-magnetic connection, pneumatic, hydraulic, or the like. Similarly, the
releasable connection(s) in this embodiment may be controlled by the system computer or manually released by the surgeon in case aborting the robot-assisted holding of the cannula or other surgical instrument is necessary.
[0063] In yet another embodiment, proximal guide 108 and/or distal guide 110 may include a locking mechanism to prevent the movement of a surgical instrument or cannula, respectively. The locking mechanism may be controlled by the system computer or may be manually activated by the surgeon. In certain embodiments, the locking mechanism may be a mechanical spring-based device or an electro magnetic coil-based device. In use, if sensors determine that the patient body has moved or the sensorized surgical guide or robotic arm breaches a threshold distance to the patient body, the system computer may activate the locking mechanism and prevent further translation of the cannula or surgical instrument.
[0064] By way of example only, in use, proximal section 100 is rotated approximately 90 degrees in order to place a cannula through the hole of distal guide 110. As stated above, the inner diameter of the distal guide should be sized such that the cannula is able to translate along the distal guide in a straight line without allowing the cannula to wobble or move in an angle that is not parallel to the axis of intervention 112. Once the cannula is in position, proximal section 100 is rotated back into its original working configuration and locked such that guides 108 and 110 are aligned with one another. An instrument may be slid through proximal guide 108 and into cannula 80 held within distal guide 110. The working end of the surgical instrument may exit the distal end of the cannula.
[0065] By way of example only, and not by way of limitation, a method of using system 10 will be described using sensorized surgical guide 16b. The sensorized surgical guide 16a, however, could be used in place of sensorized surgical guide 16b. In one embodiment, a surgical team diagnoses a patient and identifies a defect or target area, such as a tumor, that needs to be removed from the body. The surgical team plans the needed surgery including the point and angle of intervention into the body of the patient. Radiological imaging system 12 may be used to visualize a portion of the patient’s body in order to plan the surgery and determine
the intervention point and angle. In this example, the surgical team plans to remove a tumor from the patient.
[0066] As one of the initial steps, the patient is placed on bed 18 and the position of the body is scanned or otherwise determined and stored in the system computer. The body of the patient may be strapped down or otherwise held in place to prevent movement on bed 18. In one embodiment, system 10 may constantly monitor the position of the body or at least the target area on the patient. This may be done by reading sensors attached to the body of the patient, such as infrared (IR) sensors or other sensors that may be monitored by the navigation software system. Other technologies that monitor distance and location, such as a stereo IR camera and the like may be used. In addition to knowing the position of the body or at least the target area, the surgical team enters the intervention point and angle through the user interface of the system computer. In one embodiment, the system computer and navigation software may determine the axis of intervention point. The navigation software running on the system computer supplies the intervention point, angle, and direction (axis) of intervention to robotic arm 14, which moves to place sensorized surgical guide 16b (or 16a) along the axis of intervention and at a certain distance from the patient body as shown in FIGS. 7 and 8.
[0067] With sensorized surgical guide 16b in proper alignment with respect to the target area of the patient, the surgeon may open proximal section 100 of the sensorized surgical guide as shown in FIG. 9. Next the surgeon may insert a trocar and cannula 114, in one example, through distal guide 110 as shown in FIG. 10.
The physician may then insert the trocar into the body of the patient as robotic arm 14 holds sensorized surgical guide 16b in position, which allows the surgeon to move the trocar in the insertion point direction only. Once the trocar has pierced the body and the cannula is sufficiently positioned within the body, the surgeon removes the cutting portion of the trocar, leaving in site the cannula. The surgeon may then close proximal section 100 of sensorized surgical guide 16b as shown in FIG. 11. With proximal guide 108 in line with axis of intervention 112, the surgeon may insert a surgical instrument 116 through proximal guide 108 and into cannula 114 as shown in FIG. 12 to perform the surgical procedure.
[0068] The surgical procedure may be continually assessed to monitor the location of the surgical instrument with respect to the target area and other structures (veins, arteries, organs, etc.) in the body. In one embodiment, displacement sensor 109 of sensorized surgical guide 16b reads the surgical instrument’s penetration depth and sends this information to the navigation software on the system computer. The navigation software may display the surgical instrument’s penetration depth on display 200 using a color-coded bar 202 or other visual stimulus. In one embodiment, a 2-D fluoroscopy image(s) 204 may be shown on the display to visually monitor the location of the surgical image as shown in FIGS. 13A and 13B. The surgeon may use and take a fluoroscopy image at any point during the surgical procedure, and, in other embodiments, the fluoroscopy image may continuously be taken during the surgical procedure so the entire procedure may be followed on the display. Other information useful to the surgeon may also be shown on the display. Once the surgical procedure is complete, the surgical instrument and cannula are removed from the patient, and robotic arm 14 may be removed from system 10 or placed in a non-working configuration that allows greater access to the patient and allows the patient to be removed from imaging system 12.
[0069] Yet another embodiment 16c of sensorized surgical guide 16 is shown in FIG. 14. In this embodiment, sensorized surgical guide 16c includes a holder arm 120 having a proximal end 122 and a distal end 124, with proximal end 122 attached to the last arm segment of the robotic arm. As shown in FIG. 14, holder arm 120 is generally tubular shaped and includes a window 126. A proximal guide 128 is disposed near proximal end 122 and may be movable from within holder arm 120. There also is a distal guide 130 disposed near distal end 124. The proximal and distal guides each have a through hole in alignment with one another along an axis of intervention 132. The proximal guide 108 and distal guide 110 may be similar to the proximal and distal guides described above with respect to sensorized surgical guide 16a. In this way, the proximal and distal guides may each include ball bearings that help translate a surgical instrument through the proximal and distal guides along the axis of intervention 132. Moreover, the ball bearings may be spring loaded to put pressure on any instrument being slid through the guides. The
diameters of the through holes on the proximal and distal guides may have different sizes. For instance, the inner diameter of the through hole on distal guide 130 may be equal to the outer diameter of a surgical instrument such as a cannula. The through hole of the proximal guide may be equal to or slightly larger than the inner diameter of the cannula in order to accommodate surgical instruments that may be inserted through the cannula.
[0070] Furthermore, proximal guide 128 may include a surface reader capable of measuring the translation of a surgical instrument. As discussed above, the surface reader also may be used to measure the rotation of the surgical instrument. The various types of surface readers described above with respect to surface reader 69 may also be used with sensorized surgical guide 16b.
[0071] By way of example only, a method using system 10 including sensorized surgical guide 16c will now be described. As one of the initial steps, the patient is placed on bed 18 and the position of the body is scanned or otherwise determined and stored in the system computer. The body of the patient may be strapped down or otherwise held in place to prevent movement on bed 18. In one embodiment, system 10 may constantly monitor the position of the body or at least the target area on the patient. This may be done by reading sensors attached to the body of the patient. Other technologies that monitor distance and location, such as cameras (e.g., Lidar), lasers, and the like, may be used. In addition to knowing the position of the body or at least the target area, the surgical team enters the intervention point and angle using the user interface of the system computer. The navigation software running on the system computer supplies the intervention point, angle, and direction (axis) of intervention to robotic arm 14, which moves to place sensorized surgical guide 16c along the axis of intervention 132.
[0072] With sensorized surgical guide 16c in proper alignment with respect to the target area of the patient, the surgeon may insert a trocar and cannula 140 through window 126 and into holder arm 120, where the cannula is fed into and through the canal of distal guide 130 as shown in FIG. 15. The physician may then insert the trocar into the body of the patient as robotic arm 14 holds sensorized surgical guide 16c in position, which allows the surgeon to move the trocar in the insertion point
direction only. Once the trocar has pierced the body and the cannula is sufficiently positioned within the body, the surgeon removes the cutting portion of the trocar, leaving in site the cannula as shown in FIG. 16. Once the cannula is in position, proximal guide 128 may be moved within holder arm 120 and secured into position near proximal end 122 as shown in FIG. 17. Proximal guide 128 may be secured within a cutout portion of the holder arm or, in other embodiments, proximal guide 128 may be moved into and out of the holder arm by using polished pins and rack- and-pinion gears.
[0073] A surgical instrument 141 may then be slid through the canal of proximal guide 128 and into cannula 140 held within distal guide 130. The working end of the surgical instrument may exit the distal end of the cannula to perform the surgical procedure as shown in FIG. 18.
[0074] The surgical procedure may be continually assessed to monitor the location of the surgical instrument with respect to the target area and other structures (veins, arteries, organs, etc.) in the body. In one embodiment, the surface reader in proximal sensor 128 of sensorized surgical guide 16c reads the surgical instrument’s penetration depth and sends this information to the navigation software on the system computer. The navigation software may display the surgical instrument’s penetration depth on a display 160 using a color-coded bar 162 (whose different colors are indicated by different cross-hatch patterns) or other visual stimulus. In this embodiment, the color-coded bar shows the distance to the target area, using green, yellow, and red to tell the surgeon to advance (green), slow down (yellow), and stop (red) progression. A pointer 166 may be shown on the display to indicate the current position of the distal end of the surgical instrument. Audio and tactile stimuli may also be used to provide feedback to the surgeon when advancing the surgical instrument. Also, a 2-D fluoroscopy image(s) 164 may be shown on the display to visually monitor the location of the surgical instrument as shown in FIG. 19. The surgeon may use and take a fluoroscopy image at any point during the surgical procedure, and, in other embodiments, the fluoroscopy image may continuously be taken during the surgical procedure so the entire procedure may be followed on the display. Other information useful to the surgeon may also be shown on the display.
Once the surgical procedure is complete, the surgical instrument and cannula are removed from the patient, and robotic arm 14 may be removed from system 10 or placed in a non-working configuration that allows greater access to the patient and allows the patient to be removed from imaging system 12.
[0075] The sensorized surgical guide may also control the use of surgical instruments during surgery. More specifically, the surface reader on the sensorized surgical guide that measures the translation and rotation of the inserted surgical instrument may also read markings or patterns on the surface of the surgical instrument itself. If the markings or patterns on the surgical instrument indicate that the instrument comes from an authorized source or is of an authorized type, a shutter assembly allows the surgical instrument to be used with the sensorized surgical guide.
[0076] Reference is now made to FIG. 20, which is a schematic diagram of sensorized surgical guide 16b, according to an embodiment of the present invention. Sensorized surgical guide 16b includes surface reader 109, piston 6, spring 7, and solenoid 8. In addition to surface reader 109 including a technology similar to that used in a PC mouse sensor, as described above, surface reader 109 may be a small video camera that detects the movement (e.g., translation and rotation) of a surface. This video camera may grab images of the surface at a certain frame rate, and, using software, the surface reader may process those images in order to understand the relative movement of the surface. The same image set may be also used to detect a pattern printed on the surface, and the software may generate a signal when the detected pattern matches a pre-loaded, authorized reference pattern. (It is also possible to mix the two features (pattern recognition + translation & rotation) or have more than one reader or camera (one for pattern recognition + one for translation & rotation.)
[0077] FIGS. 21 A and 21 B are exemplary pictures showing what the surface reader of sensorized surgical guide 16b may see, according to an embodiment of the present invention. FIG. 21 A shows a normal surface; FIG. 21 B shows an example of a patterned surface.
[0078] The generated signal when the pattern is detected may be used to command a shutter assembly made up of piston 6, spring 7, and solenoid 8. The
shutter assembly may be an electro-mechanical device that is placed so as to obstruct, when commanded, surgical instrument path 4 (shown in FIG. 20). The obstruction may be partial or complete, depending on the embodiment of the shutter. In one embodiment, the obstruction may be realized using solenoid 8 and a plunger 9 (shown in FIGS. 22, 23A, and 23B). FIG. 22 shows that when solenoid 8 is energized, plunger 9 may be pulled within the solenoid, opening surgical instrument path 4.
[0079] The linear movement of plunger 9 may move piston 6, which, when solenoid 8 is de-energized, partially obstructs surgical instrument path 4. This position may be held using spring 7. When solenoid 8 is energized, plunger 9 is pulled within solenoid 8 and places piston 6 in a position such that surgical instrument path 4 is free. The field produced by solenoid 8 on plunger 9 should be capable of overcoming the resistance of spring 7. FIGS. 23A and 23B are schematic diagrams showing the de-energized and energized states, respectively, for this embodiment of the shutter assembly of sensorized surgical guide 16b.
[0080] Other shutter assemblies may be used in addition to or instead of the shutter assembly described above. The shutter may have an optional coating such as silicone to avoid potential instrument damage. One embodiment of a shutter may comprise an iris mechanism, e.g., a camera shutter that collapses circumferentially. Another embodiment of a shutter may comprise an inflatable or debatable donut that closes the opening of the surgical path.
[0081] Reference is now made to FIG. 24, which shows a flowchart 500 of a process that controls the use of a surgical instrument during surgery, according to an embodiment of the present invention. In operation 505, sensorized surgical guide 16b is empty and the shutter is closed, i.e. , it blocks passage of a surgical instrument. In operation 510, a surgical instrument may be inserted into sensorized surgical guide 16b by a person or by a robot, or a combination of both. In operation 515, the surface of the surgical instrument is read. In operation 520, the process asks whether the surgical instrument is authorized, which occurs if there are pre authorized markings or a pre-authorized pattern on the surgical instrument. If the surgical instrument is authorized, in operation 525 the shutter may be energized,
thus unblocking the surgical instrument path. In operation 530, surgery may then be performed. On the other hand, if the surgical instrument is not authorized, in operation 535 the shutter remains de-energized, and the surgical instrument path remains obstructed, thus not allowing surgery using sensorized surgical guide 16b.
In another embodiment, a warning light or sound may be activated alerting the surgeon of the attempt to use an unauthorized instrument. Or a message may be displayed on a system monitor with such a warning or alert.
[0082] Besides the operations shown in FIG. 24 and their description in the other figures, other operations or series of operations are contemplated to control the use of surgical instruments during surgery. For example, each of the other sensorized surgical guides described above, 16, 16a, and 16c may include a surface reader capable of reading and identifying markings or patterns on a surgical instrument in addition to measuring translation and rotation of such instrument. The shutter assembly may be modified in order to fit within the confines of the specific surgical guide used. [0083] The authorizing pattern may be cross-hatch marks, surface roughening, arrangements of letters or numbers, or a one-dimensional or two-dimensional bar code or some other pattern that identifies the manufacturer of the surgical instrument, the manufacturer of the surgical guide, the manufacturer of the surgical system, including the robotics associated therein, or an authorized licensee of such manufacturers, depending on which entity desires to control surgical access. The pattern may also identify instrument type, so as to be able to allow or block certain types of surgical instruments. The pattern may be laser or chemical etched on the surface of the surgical instrument or otherwise printed thereon. The printing may be performed by a surgical instrument manufacturer before selling the instrument or by an authorized user of the surgical system before performing the surgical procedure (using an authorized printer and/or authorized printing software). The pattern may also include calibration marks so that the translation and rotation sensor may be synchronized with those marks in order to improve precision. It is preferable that the identifying pattern cannot be copied by an unauthorized entity.
[0084] Instead of or in addition to using a pattern or marking on the surface of the surgical instrument, inductive and/or capacitive sensing could be used to identify an
authorized instrument. In this embodiment, the reader may read the inductive and/or capacitive identification.
[0085] Instead of or in addition to using a pattern or marking on the surface of the surgical instrument, the system may use a radio-frequency identification (RFID) tag to identify authorized surgical instruments. In this embodiment, the surface reader may also include an RFID reader that may detect the RFID tag embedded in or on the surgical instrument.
[0086] The benefit of this function of the surface reader is to prevent the use of unauthorized surgical instruments with a surgical system or surgical guide. Unauthorized instruments may not have the same quality or precision as that of authorized instruments and thus may pose a danger to a patient during surgery, may not work as well as authorized instruments, or may not be able to take advantage of all the benefits of the surgical system. Unauthorized instruments may also not be calibrated, such that the surgical system cannot determine how far the instrument has traveled or whether the instrument has been rotated.
[0087] The various embodiments of system 10 described above using sensorized surgical guides 16, 16a, 16b, and 16c are not limited to any specific procedure and may be used in a variety of surgical procedures. For example, system 10 may be used for bone edema procedures. Depending on the procedure, sensorized surgical guides 16, 16a, 16b, and 16c may be used with a variety of surgical instruments including, but not limited to, trocars, cannulas, scissors, probes, lasers, monopolar RF, bipolar RF or multipolar RF devices, graspers, forceps, electro-surgical knives, ultrasonic transducers, cameras, and the like. Surgical system 10 may also be used with other medical imaging systems such as MRI.
[0088] Reference is now made to FIG. 25, which shows sensorized surgical guide 251 attached to robotic arm 252, surgical instrument 253, and cannula 254. Sensorized surgical guide 251 measures the translation of surgical instrument 253 along one axis of intervention and the rotation about the same axis. Sensorized surgical guide 251 has applications in minimally invasive surgery (MIS), where a surgical instrument (e.g., trocar, laparoscope, pliers, laser, etc.) is inserted in the human body through a small incision made in the skin. The surgeon has a limited
sight of the instrument once inserted in the body. Sensorized surgical guide 251 helps the surgeon detect the position and rotation of the instrument head.
Sensorized surgical guide 251 can also read the manufacturer’s markings and/or certification on a surgical instrument, allowing a surgical instrument to be bought from many producers without needing to modify it.
[0089] FIG. 26A is a schematic diagram of sensorized surgical guide 251. FIG. 26B is a side view of the sensorized surgical guide showing exemplary dimensions in mm. FIG. 27 shows the main components of sensorized surgical guide 251 , including fixed section 272 (similar to distal or fixed section 102 in FIG. 7), movable section 271 (similar to proximal section 100 in FIG. 7) that contains the main sensor and electronics, pin 274 and spring 276 about which movable part 271 rotates, connection 273 to the robot, and related screws 275. FIG. 28 shows an exploded view of sensorized surgical guide 251 including movable section 271 , fixed part 272, and connection 273 to the robot. FIG. 28 also shows shutter 277 (similar to that in FIG. 20), pairing slider 278, sensor 279, bushing 280, and tool bushing 281. FIG. 29 shows how the sensorized surgical guide 251 device may be opened. First, movable section 271 is rotated, then cannula 254 is inserted, the guide is closed, and then surgical instrument 253 is inserted.
[0090] Sensorized surgical guide 251 may use an optical sensor such as a high speed camera to analyze the surface of surgical instrument 253. The optical sensor may be a low-cost surface reader in a two-dimensional optical position measurement system. The working principle is based on detecting and correlating microscopic, inherent features of the surface over which the optical sensor travels. For example, optical sensor chip PMW3360 from PixArt Imaging Inc. (TW) may be used as the optical device. FIG. 30 is a block diagram of the PMW3360 integrated circuit that includes an optical (camera) sensor and an LED. This device allows access to relative XY distance in counts as well as raw image data.
[0091] The PMW3360 sensor includes an LED and an infrared (monochrome) image camera of 36x36 pixels running at a frame rate of up to 12,000 frames/sec. Such a high acquisition and processing speed guarantees accuracy of even high speed movements. The inspection area can be concentrated within a 1x1 mm
square. The internal digital signal processor (DSP) acquires an image and compares it with the next image, isolating artifacts due to surface imperfections. The movement of artifacts in the evolution of the frame acquisitions provides an estimation of the counts of two-dimensional translations.
[0092] The optical sensor is used with one or more optical lenses, such as is shown in FIG. 31 , which is a cross-section of the PMW3360 integrated circuit as assembled. That figure shows two optical lenses, the first of which is used to align the light emitted from the infrared LED on the PMW3360 chip, and the second of which focuses the surface image on the optical sensor, which may be a picture element array.
[0093] Sensorized surgical guide 251 also includes a pairing slider, such as that shown in FIG. 32. This is a mechanical device that holds the optical lens and couples the optical sensor close to the sliding instrument. In order to maintain the optimal focal distance of 2.4 mm between the lens and the surface of the instrument, the pairing slider can be designed to connect two flat springs that connect the side of the slider (on the left in FIG. 32) with the mechanical housing and push down the slider. The trapezoid format of the physical arrangement allows the assembly to move, maximizing the stiffness against the rotation of the holder around the rod. [0094] Sensorized surgical guide 251 also includes a detector processing unit. This is a microcontroller unit that includes a communication link with a host (e.g., a PC) and an interface with the optical sensor. The microcontroller application software reads information from the optical sensor, processes such information, and generates displacement and rotation measurements. The application software transmits such information to the application host via a USB interface, for example. Two types of information may be read from the optical sensor: (1) relative movements in arbitrary units (counts of movements, not mm or degrees); or (2) raster raw image information, which permits a better analysis of the data but may require more intensive calculation algorithms. All of these components can be assembled in a mechanical housing that holds them in a minimal space (see FIG.
28).
[0095] The left side of FIG. 33 shows relatively low background noise of the PMW3360 optical sensor, even though it is exposed to varying levels of ambient light. Optimum performance (linear and rotational movement repeatability) of this sensor is obtained with surfaces having average roughness (right photo in FIG. 33). Flaving a glossy surface, as may occur with a mirror or polished metal (center photo in FIG. 33), sometimes results in inaccurate measurements and repeatability.
[0096] In that case, another optical sensor and/or illuminator may be used in sensorized surgical guide 251 instead of the PMW3360. A coherent laser emitter (e.g., a vertical cavity surface emitting laser (VCSEL)) can be added externally to the PMW3360 sensor or integrated with a different family of sensor devices, like the PAT9125SEL optical navigation chip from PixArt. The major advantages of this approach are less interference from backscattered light, no need for an optical lens (because the laser beam is focused within the package), less sensitivity to distance variations (no sensitivity at all for short vibrations < 0.5 mm), and lower power consumption. Because the dimensions of this improved sensor are small (e.g., 3.4 x 3.2 mm), multiple devices can be installed in one sensorized surgical guide. This option enables multiple material detection crossing, multi-point detection for better accuracy, and increases the types of surgical instruments that can be sensed by the sensorized surgical guide.
[0097] In one embodiment, the sensorized surgical guide has one set of bushings 280, 281 (FIG. 28). For example, bushing 280 may have a cavity of 6 mm diameter in order to host a cannula of 6 mm outer diameter (OD), 5 mm inner diameter (ID). Bushing 281 then has a cavity of 5 mm diameter, which is compatible with an instrument having a 5 mm OD. Other embodiments may include an interchangeable set of bushings to accommodate instruments having 1.9 mm to 15 mm OD.
[0098] In certain embodiments, some parts of the sensorized surgical guide may be detachable for a number of reasons. First, they may be detachable to increase sterility. These detachable parts can be manufactured sterile and be used as disposable parts 341. FIG. 34 shows disposable parts 341 , 342 that can be sterile (in dashed line) and the parts that can be covered by sterile drapes (in solid line).
The sterile parts can be disposed of after a single use.
[0099] Second, the detachable parts may be used in a threshold release mechanism that allows the surgical instrument to be disconnected from the robot when the patient moves. This mechanism can be built using a magnetic threshold device, which disconnects the disposable parts (in contact with the surgical instrument) when the force on the threshold device exceeds a predefined level. In this way, if the patient moves as the surgical instrument is inserted into the body, the robot can hold its position and the surgical instrument can follow the patient’s body, increasing safety.
[0100] Reference is now made to FIG. 35, which shows yet another embodiment of a sensorized surgical guide 351 attached to robotic arm 352, which can measure the translation of a surgical instrument 353 along one axis of intervention and the rotation about the same axis. This embodiment includes a motion detector that differs from that of the previous embodiment - it has two parts and its sensing mechanism may be optical, magnetic, or mechanical. FIG. 36 is a detailed view of sensorized surgical guide 351, including support structure 361, which may include control electronics, connection 361b to the robot, interchangeable bushing 362, and handle 362b that fixes bushing 362 in position. Changing bushing 362 allows use of surgical instruments 353 having various diameters. The two parts of the motion detector are fixed part 363, which includes one or more optical, magnetic, and/or mechanical sensors and associated electronics, and removable part 364, which is in contact with surgical instrument 353.
[0101 ] FIG. 37 shows several embodiments of fixed part 363 of the motion sensor along with how that part can be integrated in the main body or housing of sensorized surgical guide 351. Fixed part 363 includes one or more sensors that can be processed by electronics that could be entirely or partially integrated in the surgical guide body. There may be a sensor for each sphere, which arrangement is described below. If there is one sensor, it will correspond with one of the spheres. If two or three sensors are used, they are placed 120 degrees apart, to correspond with two or all three of the spheres. FIG. 37 shows a one-sensor embodiment, with sensor 371 , and a three-sensor embodiment, with sensors 372, 373, 374.
[0102] FIGS. 38A and 38B show several views of an embodiment of removable part 364. Removable part 364 includes three spheres 381 placed 120 degrees apart. Each sphere is held in contact with surgical instrument 353 using low-friction sphere holder 382 and springs 383. Using three spheres, surgical instrument 353 can slide in the middle, while keeping contact with the instrument and ensuring smooth travel. The three spheres keep the instrument centered and co-linear with the cylinder identified by bushing 362. Having three spheres held in place by springs 383 allows the diameter of the surgical instrument to vary within a certain range. Another advantage of having a removable part, which is in contact with surgical instrument 353, is that it can be disposable and sterile, with the benefits as discussed above with respect to FIG. 34.
[0103] When the surgical instrument slides in the middle of the spheres, the spheres rotate, similar to the way a trackball within a mouse moves. Two sensing mechanisms are described below - optical and magnetic - although others (including mechanical and a combination of optical and magnetic) may be used. These mechanisms sense the movement of the spheres, not the instrument directly, which is how the sensing mechanism of other disclosed embodiments operated.
The mechanisms sense both translation and rotation of the instrument.
[0104] Although the optical sensing of this embodiment differs from the other disclosed embodiments, the optical sensing mechanism operates similarly in that it is still based on the recognition of structured patterns or surface roughness. But instead of sensing the patterns or roughness on the instrument, this embodiment senses the patterns or roughness of the spheres. The spheres may be covered with a matte surface or printed with a structured pattern. Sensors 371-374 may be of the same family as that used in previous embodiments (e.g., PMW3360 or PAT9125SEL or similar sensors), placed in order to see the bottom of the sphere. Although three spheres are included for stability, if there are fewer than three sensors, then only the sphere or spheres having a sensor need to be patterned - the other sphere or spheres can be unpatterned. But adding sensors can be useful for redundancy.
[0105] The magnetic sensing mechanism for this embodiment is based on magnetic field detection. A 3D, linear Hall-effect sensor integrated circuit provides a
digital value corresponding to the magnetic field measured in each of the x- y-, and z-axes. This type of sensor is often used in 3D sensing applications for head-on linear motion, slide-by position sensing, and rotation angle measurements.
[0106] For the sensorized surgical guide of the present invention, each sphere of removable part 364 of the sensor mechanism may be magnetic, and when the instrument travels or rotates in the center of the spheres, it causes the spheres to move. If the spheres are magnetic, a rotating field is created and sensed by the Hall-effect sensors. Changes in the magnetic field can be processed to obtain linear and rotational movements as outputs.
[0107] As with the optical arrangement, if there are fewer than three sensors, then only the sphere or spheres having a sensor need to be magnetic - the other sphere or spheres can be non-magnetic. But having three sensors and magnetic spheres yields a redundancy that can improve sensitivity and accuracy and reduce the distortion effect resulting when a metallic tool is used or when the sensorized surgical guide is in proximity to large metal masses.
[0108] Other embodiments are contemplated. Instead of using an optical or magnetic sensor to determine translation and/or rotation of the surgical instrument, a mechanical sensor may be used. In the event a pattern is laser or chemical etched or embossed or engraved on the surface of a surgical instrument, a surface reader may comprise a profilometer to read the etching or embossing or engraving. A wheel, such as that used in an opisometer or curvimeter, may be used to track the movement of the surgical instrument. The wheel may be connected to an electronic encoder to calculate distance. Two wheels, at 90 degrees to one another, may be used to track both translation and rotation of the instrument. In another embodiment, three linear wheels and three rotational wheels may be used for greater accuracy. In another embodiment, a trackball, such as that found in a computer mouse, may be used to track translation and rotation.
[0109] In another embodiment, the sensor may be moved to the surgical instrument so that the instrument itself does not need to be read. In this embodiment, the instrument is surrounded by a clamping component made up of two pieces - a metal top and a magnetic bottom. This clamping component fits inside of
the surgical guide tube. The top may contain a light source such as an LED or a laser, as well as an optical sensor; the bottom may contain a battery to power the light source. Alternatively, the top may contain the battery and connecting it to the bottom half completes a power circuit. Once the clamping component surrounds the instrument and the pair is inserted into the guide tube, the clamping component is preferably locked, for example by actuating solenoids to keep the clamping component together. As the instrument moves down the guide, the LED/laser on the clamping component illuminates the inside surface of the guide tube, and the optical sensor reads the surface of the guide tube. Alternatively, the guide tube may be lined with one or more magnetic strips that can read the relative location and rotation of the clamping component via magnetic sensing.
[0110] In another embodiment, the clamping component expands to an integral guide tube that clamps onto the surgical instrument. The surgical instrument is inserted into the guide tube, and the guide tube, using, for example, a rack-and- pinion mechanism, tightens an O-ring or a grommet clamp on the instrument. The guide tube may be marked with gradations or etchings or patterns as described above with respect to the instrument itself, so these markings may be read using an LED/laser/optical sensor combination also as described above. Thus, the surgical instrument would not need to be itself marked.
[0111] The above discussion is meant to illustrate the principles and various embodiments of the present invention. Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications.
Claims
1. A surgical guide comprising: a fixed portion; and a movable portion including a sensor, wherein the surgical guide measures translation of a surgical instrument along an axis of intervention and rotation about the axis.
2. The surgical guide of claim 1 , wherein the sensor is an optical sensor.
3. The surgical guide of claim 2, wherein the optical sensor comprises a picture element array.
4. The surgical guide of claim 3, further comprising an infrared LED and a first lens to align light emitted from the LED and a second lens to focus a surface image on the picture element array.
5. The surgical guide of claim 1 , wherein the sensor is a magnetic sensor.
6. The surgical guide of claim 1 , further comprising a cannula and a bushing.
7. The surgical guide of claim 6, wherein the bushing is interchangeable based on a diameter of the surgical instrument.
8. The surgical guide of claim 1 , wherein a part of the fixed portion is disposable.
9. The surgical guide of claim 1 , wherein a part of the movable portion is disposable.
10. The surgical guide of claim 1 , further comprising a threshold release mechanism to disconnect the surgical instrument from a robot when a patient moves.
11. A surgical guide for holding a surgical instrument, the surgical guide comprising: a fixed portion comprising a motion sensor; and a removable portion comprising at least three spheres; wherein: the removable portion fits inside the fixed portion; the surgical instrument contacts the spheres; and the motion sensor senses the movement caused by the instrument of a corresponding sphere.
12. The surgical guide of claim 11 , wherein the surgical guide is attached to a robotic arm.
13. The surgical guide of claim 11 , further comprising a cannula and a bushing.
14. The surgical guide of claim 13, wherein the bushing is interchangeable based on a diameter of the surgical instrument.
15. The surgical guide of claim 11 , wherein the fixed portion comprises two motion sensors, each sensor corresponding with a sphere.
16. The surgical guide of claim 11 , wherein the fixed portion comprises three motion sensors, each sensor corresponding with a sphere.
17. The surgical guide of claim 11 , wherein the motion sensor is an optical sensor.
18. The surgical guide of claim 17, wherein the optical sensor senses structured patterns or surface roughness on the corresponding sphere.
19. The surgical guide of claim 11 , wherein the motion sensor is a magnetic sensor.
20. The surgical guide of claim 19, wherein the magnetic sensor senses magnetic movement of the corresponding sphere.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22825505.5A EP4337126A1 (en) | 2021-05-13 | 2022-05-12 | Robot-assisted surgical guide system for performing surgery |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/320,195 | 2021-05-13 | ||
US17/320,195 US20210275263A1 (en) | 2017-10-16 | 2021-05-13 | Robot-assisted surgical guide system for performing surgery |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022265772A1 true WO2022265772A1 (en) | 2022-12-22 |
Family
ID=84526426
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2022/029066 WO2022265772A1 (en) | 2021-05-13 | 2022-05-12 | Robot-assisted surgical guide system for performing surgery |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP4337126A1 (en) |
WO (1) | WO2022265772A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150150633A1 (en) * | 2012-06-07 | 2015-06-04 | Medrobotics Corporation | Articulating surgical instruments and methods of deploying the same |
US20160029997A1 (en) * | 2004-03-11 | 2016-02-04 | Stryker Leibinger Gmbh & Co. Kg | System and Method for Determining a Position of an Object |
US20180064497A1 (en) * | 2012-06-21 | 2018-03-08 | Globus Medical, Inc. | Surgical robotic automation with tracking markers |
WO2019079212A1 (en) * | 2017-10-16 | 2019-04-25 | Epica International, Inc. | Robot-assisted surgical guide system for performing surgery |
US20190321108A1 (en) * | 2018-04-19 | 2019-10-24 | Stryker European Holdings I, Llc | Tracker for a surgical navigation system |
US20200170724A1 (en) * | 2018-12-04 | 2020-06-04 | Mako Surgical Corp. | Mounting System With Sterile Barrier Assembly For Use In Coupling Surgical Components |
-
2022
- 2022-05-12 WO PCT/US2022/029066 patent/WO2022265772A1/en active Application Filing
- 2022-05-12 EP EP22825505.5A patent/EP4337126A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160029997A1 (en) * | 2004-03-11 | 2016-02-04 | Stryker Leibinger Gmbh & Co. Kg | System and Method for Determining a Position of an Object |
US20150150633A1 (en) * | 2012-06-07 | 2015-06-04 | Medrobotics Corporation | Articulating surgical instruments and methods of deploying the same |
US20180064497A1 (en) * | 2012-06-21 | 2018-03-08 | Globus Medical, Inc. | Surgical robotic automation with tracking markers |
WO2019079212A1 (en) * | 2017-10-16 | 2019-04-25 | Epica International, Inc. | Robot-assisted surgical guide system for performing surgery |
US20190321108A1 (en) * | 2018-04-19 | 2019-10-24 | Stryker European Holdings I, Llc | Tracker for a surgical navigation system |
US20200170724A1 (en) * | 2018-12-04 | 2020-06-04 | Mako Surgical Corp. | Mounting System With Sterile Barrier Assembly For Use In Coupling Surgical Components |
Also Published As
Publication number | Publication date |
---|---|
EP4337126A1 (en) | 2024-03-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11058500B2 (en) | Robot-assisted surgical guide system for performing surgery | |
KR101861176B1 (en) | Surgical robot for stereotactic surgery and method for controlling a stereotactic surgery robot | |
KR101848027B1 (en) | Surgical robot system for stereotactic surgery and method for controlling a stereotactic surgery robot | |
US20210153956A1 (en) | Patient introducer alignment | |
US20220192757A1 (en) | Automatic registration method and device for surgical robot | |
US10966636B2 (en) | Determination of the coordinate transformation between an optical motion tracking system and a magnetic resonance imaging scanner | |
EP0700269B1 (en) | System for locating relative positions of objects | |
US20150117601A1 (en) | X-ray source with module and detector for optical radiation | |
RU2434600C2 (en) | Surgical system controlled by images | |
US20210275263A1 (en) | Robot-assisted surgical guide system for performing surgery | |
US20100137880A1 (en) | Multi-application robotized platform for neurosurgery and resetting method | |
JP2017000772A (en) | Device and method for robot-supported surgical operation | |
JPH11276502A (en) | Frameless stereotaxic operation apparatus | |
KR20160069180A (en) | CT-Robot Registration System for Interventional Robot | |
JP2018108344A (en) | System and method for measuring depth of instruments | |
KR101895369B1 (en) | Surgical robot system for stereotactic surgery | |
WO2022265772A1 (en) | Robot-assisted surgical guide system for performing surgery | |
KR20180100514A (en) | Surgical robot system for stereotactic surgery | |
EP4355254A1 (en) | Systems and methods for detecting and monitoring a drape configuration | |
KR20200039389A (en) | Surgical robot system for stereotactic surgery and method for controlling a stereotactic surgery robot | |
Bax et al. | Calibration and accuracy testing for image-enhanced endoscopy | |
Bax et al. | 52 Medicine Meets Virtual Reality 02/10 JD Westwood et al.(Eds.) IOS Press, 2002 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22825505 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022825505 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2022825505 Country of ref document: EP Effective date: 20231213 |