US8886286B2 - Determining and verifying the coordinate transformation between an X-ray system and a surgery navigation system - Google Patents

Determining and verifying the coordinate transformation between an X-ray system and a surgery navigation system Download PDF

Info

Publication number
US8886286B2
US8886286B2 US13/698,772 US201113698772A US8886286B2 US 8886286 B2 US8886286 B2 US 8886286B2 US 201113698772 A US201113698772 A US 201113698772A US 8886286 B2 US8886286 B2 US 8886286B2
Authority
US
United States
Prior art keywords
surgical operation
navigation system
operation navigation
arm
coordinate transformation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US13/698,772
Other languages
English (en)
Other versions
US20130066196A1 (en
Inventor
Rainer Graumann
Gerhard Kleinszig
Martin Ringholz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens Healthineers AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Assigned to SIEMENS AKTIENGESELLSCHAFT reassignment SIEMENS AKTIENGESELLSCHAFT ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: Ringholz, Martin, GRAUMANN, RAINER, KLEINSZIG, GERHARD
Publication of US20130066196A1 publication Critical patent/US20130066196A1/en
Application granted granted Critical
Publication of US8886286B2 publication Critical patent/US8886286B2/en
Assigned to SIEMENS HEALTHCARE GMBH reassignment SIEMENS HEALTHCARE GMBH ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SIEMENS AKTIENGESELLSCHAFT
Assigned to Siemens Healthineers Ag reassignment Siemens Healthineers Ag ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SIEMENS HEALTHCARE GMBH
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/12—Arrangements for detecting or locating foreign bodies
    • A61B19/5244—
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/54—Control of apparatus or devices for radiation diagnosis
    • A61B6/547—Control of apparatus or devices for radiation diagnosis involving tracking of position of the device or parts of the device
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/58—Testing, adjusting or calibrating thereof
    • A61B6/582—Calibration
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B15/00—Measuring arrangements characterised by the use of electromagnetic waves or particle radiation, e.g. by the use of microwaves, X-rays, gamma rays or electrons
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B21/00—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
    • G01B21/02—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness
    • G01B21/04—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness by measuring coordinates of points
    • G01B21/042—Calibration or calibration artifacts
    • A61B19/54—
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods, e.g. tourniquets
    • A61B2017/00681—Aspects not otherwise provided for
    • A61B2017/00725—Calibration or performance testing
    • A61B2019/4894—
    • A61B2019/5255—
    • A61B2019/527—
    • A61B2019/5295—
    • A61B2019/5495—
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2068—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
    • A61B2034/207—Divots for calibration
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/08—Accessories or related features not otherwise provided for
    • A61B2090/0818—Redundant systems, e.g. using two independent measuring systems and comparing the signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/367—Correlation of different images or relation of image positions in respect to the body creating a 3D dataset from 2D images using position information
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39—Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/3995—Multi-modality markers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4429—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units
    • A61B6/4435—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure
    • A61B6/4441—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure the rigid structure being a C-arm or U-arm
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39—Markers, e.g. radio-opaque or breast lesions markers

Definitions

  • the invention relates to the improved determination and verification of a coordinate transformation between an X-ray system and a surgical operation navigation system and a method and an apparatus therefor.
  • a surgical operation navigation system usually has a stereoscopic tracking camera.
  • So-called navigation stars having at least three marking elements, for example balls, are attached to a body part of a patient.
  • the marking elements are made of a material, or provided with a coating, which reflects infrared radiation.
  • Surgical instruments can also be provided with a navigation star with said three marking elements. Since the spatial relationship between the navigation star and the tip of the surgical tool used to perform the actual operation on the body is known, the surgical operation navigation system is able to determine the position of the surgical instrument or its tip in the human body. To this end, the surgical operation navigation system emits infrared radiation, for example, and the radiation reflected by the marking elements of the navigation star is detected by means of the stereoscopic camera.
  • the data detected by the stereoscopic camera can be used for the continuous determination of the position of the navigation star on the surgical instrument in space and hence for the determination of the position of the tip of the surgical instrument in the body.
  • the surgeon wishes to obtain image data on the interior of the site of the operation.
  • X-ray systems with a so-called C-arm are used, for example.
  • the C-arm is pivoted into different positions and, after the pivoting, a projection image in this position is created by X-raying.
  • the image data obtained thereby represents the attenuation of an X-ray beam on passing through tissue with the respective projection.
  • the imaging process can be used to reconstruct tomographic images which provide the surgeon with three-dimensional image data on individual slices of the interior of the patient or the site of the operation.
  • surgical navigation is a combination of image data of an object's volume and the localization of surgical instruments.
  • Conventional surgical navigation substantially uses three methods for this.
  • preoperative 3D image sets taken with a computed tomography scanner or a magnetic resonance imaging scanner are used for example.
  • To achieve conformity between the preoperative data set and the position of the patient in the operating theatre it is necessary to detect anatomical markings or previously implanted reference points on the patient and then adapt the coordinates between the surgical instruments and the image data set.
  • This method has the drawback that the image data are not recorded in the position during the operation and any anatomical changes that may occur in the region of the operation during the surgical intervention may not be taken into account.
  • the second method uses a marker ring with a calibration template, said marker ring being attached to the image intensifier on a mobile C-arm of an X-ray system in 2D mode.
  • Manual comparison between the anatomy and the image data is not necessary, but the representation is exclusively a two-dimensional projection image. This provides less information when compared with a representation of individual slices with a three-dimensional method and is therefore not preferred.
  • the X-ray system with the C-arm enables comparatively simply and quickly updated image data on the interior of the site of the operation to be obtained during the operation.
  • the X-ray system with the C-arm is comparatively compact and can be moved during the operation in the operating theatre so that the site of the operation can be X-rayed once again.
  • a marking ring is arranged on the image intensifier of the C-arm of the X-ray system.
  • a reference star is arranged on the patient.
  • the navigation system camera system is set up in order to detect both the marking ring and the reference star on the patient.
  • the X-ray system is moved in its working position to take X-rays of the patient.
  • the coordinates of the marking ring are detected by the surgical operation navigation system.
  • the C-arm is pivoted stepwise and an X-ray is taken after each pivoting process.
  • Three-dimensional image data is generated from the X-ray measurements.
  • the image data and the coordinates are transferred to the surgical operation navigation system.
  • the mobile X-ray system can now be removed from the site of the operation. The surgeon can now start the operation when the accuracy of the coordinate transformation has been verified.
  • the accuracy of the coordinate transformation can be verified by a pointer instrument tracked by the surgical operation navigation system, which can make contact with defined structures for example the anatomy, the reference star etc., wherein it has to make contact with at least three points.
  • the position of the pointer instrument is displayed in the previously determined tomographic images. The surgeon verifies visually that the pointer instrument is depicted in such a way that it makes contact with the corresponding structure in the image data set with sufficient accuracy. If this visual check identifies only a small deviation, the coordinate transformation is considered to be sufficiently accurate for the navigation-guided intervention.
  • the accuracy achieved is about +/ ⁇ 2 mm.
  • One aspect of the invention is to check the previous recording (i.e. coordinate transformation) of the navigation system by performing a reference recording which is then compared with the previous recording.
  • a threshold value for a maximum permissible deviation can be predetermined. If the threshold value is exceeded, an alarm signal is emitted and/or the previous recording can be automatically or semi-automatically updated (following a confirmation signal from a user).
  • the reference recording can be made using a 3D C-arm scan or using a plurality of 2D C-arm images.
  • One aspect of the invention relates to a method for determining a reference object coordinate transformation between a surgical operation navigation system and an X-ray system having a pivotable C-arm for detecting the interior of an object.
  • the marking elements of a reference object are arranged in a region which is detected by the surgical operation navigation system and the X-ray system in at least two pivoting positions of the C-arm.
  • the position of the marking elements of the reference object is detected with the surgical operation navigation system.
  • the marking elements of the reference object are detected with the X-ray system from at least two projections.
  • the position of the reference object is determined from at least two two-dimensional projection images.
  • the reference object coordinate transformation is determined from the position of the marking elements of the reference object detected by the surgical operation navigation system and from the position of the marking elements of the reference object determined by the X-ray system.
  • the term “reference object coordinate transformation” can also be understood to mean a reference coordinate transformation for the same object.
  • the reference object can be a reference star having at least three, preferably four, marking elements which is tracked by a camera of a surgical operation navigation system.
  • the invention provides an exact calibration and/or recording method and verification method for a recording that has already been made without reducing the reconstructed volume which can be evaluated by the imaging process and is available for both for the treatment and the navigation.
  • the invention can also be used to verify the accuracy of the navigation system used to date or its recording. This is performed with a reference recording or with a reference coordinate transformation, as mentioned above. The verification is performed automatically by comparing the previous recording/coordinate transformation with the reference recording/coordinate transformation. Hence the comparison relates to the automatic recording of the navigation system and the calculated coordinate transformation.
  • the result of the comparison can be provided as a quality criterion or quality standard. In an advantageous embodiment, the result can also be used to adapt or improve the recording of the navigation system.
  • coordinate system of the X-ray system should be interpreted as meaning that it includes the coordinate systems of the individual tomographic images since the tomographic images are determined from projections obtained with the X-ray system.
  • the surgical operation navigation system can have a stereoscopic camera. However, it is also conceivable for the position of reference markings to be determined by the surgical operation navigation system by means of inductive methods. The surgical operation navigation system determines the position of the reference star in the coordinate system of the surgical operation navigation system.
  • the reference object can be attached to a patient, for example to a bone of the patient.
  • the reference object can also only be fixed to the patient's skin.
  • the method also includes the step of the detection of data representing the interior of an object by means of X-radiation during the detection of the position of the marking elements of the reference object with the X-ray system from at least two projections.
  • Tomographic images representing the interior of the object are generated from the data. Obviously, more than two projections are necessary to generate the three-dimensional data set for the tomographic images.
  • These data can be sent to the surgical operation navigation system. Navigation information can be displayed in the tomographic images, for example the position of a surgical instrument or the position of the tip of a surgical instrument.
  • the invention also discloses a method for the determination and/or verification of a C-arm coordinate transformation between a surgical operation navigation system and an X-ray system with a C-arm.
  • the surgical operation navigation system detects the position of a reference object arranged on the patient's body.
  • the C-arm is pivoted into at least two positions.
  • the position of the C-arm is determined with the surgical operation navigation system after each pivoting.
  • Data representing the interior of the object is determined by means of X-radiation after each pivoting in this position. This data, which is determined in a plurality of projections, can be used to create tomographic images.
  • the C-arm coordinate transformation between the surgical operation navigation system and the X-ray system is determined on the basis of the at least two detected positions of the C-arm.
  • the C-arm coordinate transformation can be compared with the previously described reference object coordinate transformation.
  • C-arm coordinate transformation also includes a coordinate transformation into the coordinate system of the individual tomographic images producing three-dimensional image data, since these were determined from the projection images detected by the X-ray system with the C-arm.
  • the coordinate transformation between the X-ray system or the tomographic images and the surgical operation navigation system is determined by means of two different methods. This redundancy enables the quality of the respective coordinate transformation to be determined and, if the deviation is too high, a warning can be issued. In this case, the operator can perform a manual re-adjustment. It is also possible to change evaluation parameters and/or determine one of the coordinate transformations for use. These further steps can be triggered and/or performed automatically without user interaction.
  • the method also includes the step of the generation of tomographic images from data representing the interior of the object.
  • Image data having a plurality of tomographic images can be sent to the surgical operation navigation system.
  • Navigation information can be displayed in the tomographic images.
  • the method can be implemented by the surgical operation navigation system.
  • the surgical operation navigation system can give instructions to the X-ray system.
  • the method it is also conceivable for the method to be implemented in a separate control unit which issues instructions to both the surgical operation navigation system and the X-ray system.
  • the control device or the surgical operation navigation system can be a programmable computer with a CPU and a memory which carry out the method.
  • the invention also discloses a computer program product with program code means which carry out the steps of the above-mentioned method when they are loaded in a computer and executed by the computer.
  • the object of the invention is also achieved by a coordinate transformation apparatus designed to determine a reference object coordinate system between a surgical operation navigation system and an X-ray system with a C-arm.
  • the coordinate transformation apparatus can be implemented in the surgical operation navigation system or be a separate apparatus, for example the above-mentioned programmable computer.
  • the coordinate transformation apparatus can also be made of discrete logic elements.
  • the coordinate transformation apparatus has an X-ray system instruction mechanism which issues an instruction to an X-ray system.
  • the X-ray system instruction mechanism can, for example, have an interface implemented by means of a plug-in connection, for example a network interface.
  • the X-ray system instruction apparatus can also be an inter-program communication interface.
  • the coordinate transformation apparatus has a surgical operation navigation instruction mechanism which issues an instruction to a surgical operation navigation system.
  • the surgical operation navigation system instruction mechanism can have an interface implemented by means of a plug-in connection or can be an inter-program communication interface.
  • the coordinate transformation apparatus has a control device which is designed to instruct the surgical operation navigation system to detect the position of marking elements of a reference object by means of the surgical operation navigation system instruction mechanism.
  • the reference object can be the above-described reference star with at least three marking elements.
  • the control device is designed to instruct the X-ray system by means of the X-ray system instruction mechanism to detect the marking elements of the reference object by taking X-rays from at least two projections.
  • the control device is designed to instruct the X-ray system, by means of the X-ray system instruction mechanism, to determine the position of the marking elements from at least two two-dimensional projection images.
  • the control device is also designed to determine the reference object coordinate transformation from the position of the reference object detected by the surgical operation navigation system and the position of the reference object detected by the X-ray system.
  • the control device can be designed to instruct the X-ray system, by means of the X-ray system instruction mechanism, to detect data representing the interior of the object, by means of X-radiation on the detection of the position of the reference object with the X-ray system from at least two projections.
  • the control device can be designed to instruct the X-ray system, by means of the X-ray system instruction mechanism, to generate tomographic images from the data representing the interior of the object.
  • the tomographic images can be sent to the surgical operation navigation system.
  • the control device can instruct the surgical operation navigation system, by means of the surgical operation navigation system instruction mechanism, to display navigation information in the tomographic images. This enables the surgeon to carry out the navigation-guided operation.
  • All marking elements have to be contained in at least two, preferably in exactly two, projection images. Preferably, the two images should be virtually orthogonal to each other.
  • the coordinate transformation apparatus will not detect all marking elements by taking X-rays with the X-ray system arranged on the C-arm because the X-ray beam detects the interior of the object and/or the volume to be reconstructed in an angle such that the X-ray beam does not pass through all marking elements. Although not all marking elements are detected by the X-ray beam, the volume to be reconstructed is completely detected.
  • the coordinate transformation apparatus can have a verification device.
  • the control device can also be designed to instruct the surgical operation navigation system, by means of the surgical operation navigation system instruction mechanism, to detect the position of a reference object.
  • the control device can be designed to instruct the X-ray system, by means of the X-ray system instruction mechanism, to pivot the C-arm into at least two positions, and to instruct the surgical operation navigation system, by means of the surgical operation navigation system instruction mechanism, to detect the position of the C-arm, for example by means of a tracking camera, after the pivoting.
  • the control device can also be designed to instruct the X-ray system, by means of the X-ray system instruction mechanism, to detect data representing the interior of the object by means of X-radiation after the pivoting.
  • the control device can be designed to determine a C-arm coordinate transformation from the positions of the C-arm detected by the surgical operation navigation system and the position of the reference object detected by the surgical operation navigation system.
  • the control device instructs the verification device to compare the C-arm coordinate transformation with the reference object coordinate transformation. This enables the accuracy of the coordinate transformations to be determined. If the values of the coordinate transformations deviate from each other by more than a predetermined threshold value, the user can be alerted to this by a warning and the user can react to the error.
  • a re-adjustment for example a virtual displacement of the data with respect to each other can be performed user-controlled or automatically. These inputs can be used to repeat the recording. There is no need to re-X-ray the patient.
  • the new calculation and the result of the method according to the invention can be checked for plausibility. This can be performed in an optional additional method step following the other steps.
  • the data is displayed by one or both coordinate transformations on a display device. It is also possible for the overshooting of permissible minimum values, maximum values and/or other parameters to be verified automatically. It is also possible to use a menu-driven control to make further corrections here (in particular to the recorded data) including when in operation (also manually).
  • the control device can be designed to instruct the X-ray system, by means of the X-ray system instruction mechanism, to generate tomographic images from data representing the interior of the object.
  • the tomographic images can be sent to the surgical operation navigation system.
  • the control device can be designed to instruct the surgical operation navigation system, by means of the surgical operation navigation system instruction mechanism, to display navigation information in the tomographic images.
  • the invention also relates to a surgical operation system having an X-ray system with a C-arm, a surgical operation navigation system and the above-described coordinate transformation apparatus.
  • FIG. 1 shows a surgical environment in which a C-arm of an X-ray system is located in a first pivoting position
  • FIG. 2 shows a surgical environment in which the C-arm of the X-ray system is located in a second pivoting position
  • FIG. 3 is a flow diagram of the method according to the invention.
  • FIG. 4 is a schematic diagram of the interaction of a coordinate transformation apparatus with the X-ray system and a surgical operation navigation system.
  • FIG. 1 shows an operating table 2 , which is preferably made of X-ray permeable carbon.
  • a reference star 8 is arranged on a spine 6 .
  • the reference star 8 has three marking elements 8 a , 8 b , 8 c , which reflect light in the infrared range.
  • a stereoscopic camera 16 emits infrared radiation and detects the marking elements 8 a , 8 b , 8 c of the reference star 8 by means of two cameras. The data detected by the stereoscopic camera 16 is forwarded to a surgical operation navigation system.
  • the surgical environment includes an X-ray system with a C-arm 10 on which an X-ray source 12 and an X-ray detector or X-ray intensifier 14 are arranged.
  • the C-arm can be pivoted in order to take X-rays of the volume of the object 4 from different pivoting angles or projections. Three-dimensional tomographic images are generated from the projection images created in different projection angles.
  • a reference marking 18 which also reflects infrared radiation is attached to the X-ray detector or X-ray intensifier 14 .
  • the reference marking 18 can be detected by the stereoscopic camera 16 of the surgical operation navigation system.
  • the X-ray system with the C-arm 10 is displaceable so that it can be pushed toward the operating table 2 before and/or during an operation in order to X-ray an object 4 corresponding to the site of the operation.
  • the X-ray system with the C-arm 10 can be pushed away again to give the surgeon free access to the site of the operation.
  • FIG. 2 substantially corresponds to FIG. 1 , wherein the C-arm 10 has adopted another pivoting position and the object 4 is analyzed with X-radiation from another projection.
  • the C-arm is for example brought into initial position shown in FIG. 1 S 2 .
  • the stereoscopic camera 16 detects the position of the reference star 8 by means of infrared light reflected by the marking elements 8 a , 8 b , 8 c emitted by the surgical operation navigation system S 4 .
  • the expression “position” also includes the orientation.
  • the X-ray system creates a projection image of the object 4 S 6 .
  • the position of the X-ray detector or X-ray intensifier 14 is also detected with the aid of the reference marking 18 by the stereoscopic camera 16 S 8 .
  • the C-arm 10 is pivoted stepwise S 12 , as shown in FIG. 2 , and after each pivoting, a further projection image is generated S 6 and the position of the reference marking 18 is detected by the surgical operation navigation system S 8 until sufficient projections have been detected S 10 .
  • the positions of the X-ray detector or X-ray intensifier 14 detected by the stereoscopic camera 16 and the position of the reference star 8 detected by the stereoscopic camera 16 are used to determine the C-arm coordinate transformation between the coordinate system of the surgical operation navigation system and the coordinate system of the X-ray system S 14 .
  • the expression “coordinate system of the X-ray system” also includes the coordinate system of the images, since the images are generated from the projection images created by the X-ray system.
  • the quality of the C-arm coordinate transformation is now checked by means of a reference object coordinate transformation or a reference coordinate transformation of the object.
  • the C-arm 10 is pivoted into a first position as shown, for example, in FIG. 1 S 16 .
  • the stereoscopic camera 16 of the surgical operation navigation system determines the position of the marking elements 8 a , 8 b , 8 c of the reference star 8 S 18 .
  • the system uses the X-ray source 12 and the X-radiation detector or X-radiation intensifier 14 to take a projection image S 20 .
  • the X-ray beams also pass through the marking elements 8 a , 8 b , 8 c of the reference star 8 .
  • the C-arm 10 is pivoted S 24 and a further projection image is created S 20 with which the X-radiation passes through the marking elements 8 a , 8 b , 8 c of the reference star.
  • a further projection image is created S 20 with which the X-radiation passes through the marking elements 8 a , 8 b , 8 c of the reference star.
  • the reference object coordinate transformation between the navigation system coordinate system and X-ray system coordinate system can now be determined from the position of the marking elements 8 a , 8 b , 8 c of the navigation star 8 in the surgical operation navigation coordinate system determined by the surgical operation navigation system and the position of the marking elements 8 a , 8 b , 8 c , 8 b of the reference star 8 determined by the X-ray system in the X-ray system coordinate system S 26 .
  • the marking elements do not have to be detected in all projections and pivoting positions of the C-arm since the volume of the object 4 which can be detected by means of the X-ray system with the C-arm 10 is relatively small.
  • the edge length of the volume 4 which can be detected with the C-arm 10 on which the X-ray source 12 and the X-ray detector 14 are arranged is typically the half the dimension of the X-ray detector or X-ray intensifier 14 . If the length of the X-ray detector 14 is 24 cm in one direction, the X-ray system is able to detect a cube with an edge length of 12 cm. From this volume 4 , imaging methods are able to generate a three-dimensional reconstruction as a data set and tomographic images.
  • the marking elements 8 a , 8 b , 8 c of the reference star 8 are located outside of the region from which the imaging process makes a three-dimensional reconstruction of an image data set for tomographic images. Therefore, the position of the marking elements 8 a , 8 b , 8 c of the reference star 8 is determined from two-dimensional projections. Therefore, the marking elements 8 a , 8 b , 8 c of the reference star 8 only have to be identifiable in a few projection images and not in all projection images.
  • the expression “marking elements” should be interpreted as meaning that it includes all marking elements required for the navigation arranged on the reference star. All the marking elements 8 a , 8 b , 8 c of the reference star 8 only have to be detected in a few projection images.
  • All marking elements have to be contained in at least two, preferably in exactly two, projection images. Preferably, the two images should be virtually orthogonal to each other.
  • at least one projection image not all marking elements are detected by taking X-rays because the X-ray beam detects the interior of the object and/or the volume to be reconstructed in a such an angle that the X-ray beam from the X-ray source 12 to the X-ray detector or X-ray intensifier 14 does not pass through all marking elements.
  • the volume to be reconstructed is completely detected.
  • the rotation matrix A and the displacement vector b contain 12 unknowns which can be determined by the three-dimensional positions of the three marking elements of the reference star.
  • the reference object coordinate transformation When the reference object coordinate transformation has been determined by this procedure, it can be compared with the C-arm coordinate transformation S 28 . If the deviation between the two coordinate transformations is higher than a predetermined threshold value, a warning can be issued. In this case, the operator can perform a manual re-adjustment, change evaluation parameters, choose one of the coordinate transformations etc.
  • the X-ray system can use the method mentioned in the introduction to determine tomographic images from the detected projection images.
  • the tomographic images can be sent as an image data set to the surgical operation navigation system so that the image data can be displayed there together with the position of the surgical instrument during the operation.
  • the screen of the surgical operation navigation system displays the tomographic image data determined by the X-ray system and the position of a surgical instrument, in particular its tip. Hence, the surgeon knows during the operation where the tip of the surgical instrument is located on the object 4 .
  • This embodiment was described such that first the C-arm coordinate transformation is determined and the C-arm coordinate transformation is verified by the reference object coordinate transformation.
  • the reference object coordinate transformation can be determined first and then verified with the subsequently determined C-arm coordinate transformation. It is also possible to determine only the reference object coordinate transformation and then start the navigation-guided operation.
  • the C-arm coordinate transformation is determined first and then the reference object coordinate transformation. It should be understood that the C-arm can only be successively pivoted once and hereby projection images created, wherein both the interior of the object 4 to be analyzed, from which the three-dimensional image data is to be created, and the marking elements 8 a , 8 b , 8 c of the reference star 8 are detected by at least a few projection images, wherein the marking elements 8 a , 8 b , 8 c are located outside of the region from which three-dimensional image data is to be created.
  • step S 6 and step S 20 are performed simultaneously in that it is ensured that the projection image includes both the interior of the object 4 and the marking elements 8 a , 8 b , 8 c of the reference star 8 .
  • the result is that the method steps named in the claims can be performed in any sequence.
  • FIG. 4 shows the schematic structure of the coordinate transformation apparatus 20 and the interfaces to the X-ray system 30 and the surgical operation navigation system 32 .
  • the coordinate transformation apparatus 20 has a control apparatus 22 , a verification device 24 , an X-ray system instruction mechanism 26 and a surgical operation navigation system instruction mechanism 28 .
  • the control device 22 issues instructions to the X-ray system 30 via the X-ray system instruction mechanism 26 .
  • the control device 22 also issues instructions to the surgical operation navigation system 32 via the surgical operation navigation system instruction mechanism 28 .
  • the X-ray system instruction mechanism 26 and the surgical operation navigation system instruction mechanism 28 can be implemented by interfaces with a plug-in connection. However, it is also possible to embody the X-ray system instruction mechanism 26 and the surgical operation navigation system instruction mechanism 28 by interprogram communication interfaces.
  • the control device 22 instructs the surgical operation navigation system 32 via the surgical operation navigation system instruction mechanism 28 to detect the position of the marking elements 8 a , 8 b , 8 c of the reference star 8 .
  • the control device 22 instructs the X-ray system 30 via the X-ray system instruction apparatus 26 to create a projection image which also includes the marking elements 8 a , 8 b , 8 c of the reference star 8 .
  • the control device 22 instructs the X-ray system 30 via the X-ray system instruction mechanism 26 to pivot the C-arm 10 into another position.
  • the control device 22 instructs the X-ray system 30 to create a further projection image which is detected by the marking elements 8 a , 8 b , 8 c , 8 d of the reference star 8 .
  • the control device 22 instructs the X-ray system 33 via the X-ray system instruction mechanism 26 to calculate the position of the marking elements 8 a , 8 b , 8 c of the reference star 8 from two-dimensional projections and output them in the coordinate system of the X-ray system to the control device 22 .
  • the control device 22 then instructs the surgical operation navigation system 32 via the surgical operation navigation system instruction mechanism 28 to output the position of the marking elements 8 a , 8 b , 8 c of the reference star 8 in the coordinate system of the surgical operation navigation system to the control device 22 .
  • the control device can therefore determine the reference object coordinate transformation.
  • the control device 22 sends the reference object coordinate transformation to the verification device 24 .
  • the control device 22 also sends the C-arm coordinate transformation, which was determined as described earlier with reference to FIG. 3 , to the verification mechanism 24 .
  • the verification device 24 compares the reference object coordinate transformation with the C-arm coordinate transformation. If the deviation is equal to or lower than a predetermined threshold value, the determination of the coordinate transformation between the surgical operation navigation system and the X-ray system and hence the tomographic images of the three-dimensional image data set are sufficiently accurate. Therefore, the surgeon can start the operation. If the deviation is greater than a predetermined threshold value, a warning can be output resulting in the above-described intervention by the operator.
  • the invention discloses that by means of at least two projection images, the X-ray system detects the position of the navigation marking elements on the reference star at different pivoting angles of the C-arm.
  • the position of the navigation marking elements on the reference star is also calculated by the tracking camera of the navigation system.
  • the transformation of the coordinate system of the navigation system into the coordinate system of the X-ray system is calculated from the position of the reference star detected by the X-ray system and the position of the reference star detected by the navigation camera.
  • the navigation marking elements are located outside of the volume which is reconstructed by means of imaging processes in order to prepare tomographic images.
  • the position of the navigation marking elements is determined from two-dimensional projections. All the navigation marking elements need only be detected by at least two projection images.
  • the method according to the invention has the advantage that that it is able to verify the accuracy of a previously determined coordinate transformation.
  • the method according to the invention also has the advantage that only one reference star is required. This enables preoperative image data sets to be sent to the surgical operation navigation system in a quick and simple way.
  • the invention also has the advantage that, during an operation, the interior of the object changed by the operation can be determined and three-dimensional image data sets of the changed object can be created comparatively quickly and with comparatively simple means in order to be used for a navigation-guided operation.
  • the invention is not restricted to medical operations.
  • the invention can also be used in the examination of other objects, for example the examination of an industrial, physical or archeological item.
  • the invention can also be embodied as a distributed system so that individual modules of the coordinate transformation apparatus 20 can also be distributed or provided on different entities, for example in the navigation system 16 , 32 and/or in the X-ray system 12 , 14 or in separate entities in a data exchange network.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Optics & Photonics (AREA)
  • Biophysics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Robotics (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
US13/698,772 2010-05-18 2011-04-20 Determining and verifying the coordinate transformation between an X-ray system and a surgery navigation system Active US8886286B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE102010020781.0A DE102010020781B4 (de) 2010-05-18 2010-05-18 Bestimmung und Überprüfung der Koordinatentransformation zwischen einem Röntgensystem und einem Operationsnavigationssystem
DE102010020781 2010-05-18
DE102010020781.0 2010-05-18
PCT/EP2011/056372 WO2011144412A1 (de) 2010-05-18 2011-04-20 Bestimmung und überprüfung der koordinatentransformation zwischen einem röntgensystem und einem operationsnavigationssystem

Publications (2)

Publication Number Publication Date
US20130066196A1 US20130066196A1 (en) 2013-03-14
US8886286B2 true US8886286B2 (en) 2014-11-11

Family

ID=44275899

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/698,772 Active US8886286B2 (en) 2010-05-18 2011-04-20 Determining and verifying the coordinate transformation between an X-ray system and a surgery navigation system

Country Status (3)

Country Link
US (1) US8886286B2 (de)
DE (1) DE102010020781B4 (de)
WO (1) WO2011144412A1 (de)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160074000A1 (en) * 2013-05-31 2016-03-17 Kabushiki Kaisha Toshiba X-ray diagnostic apparatus
RU179261U1 (ru) * 2018-02-14 2018-05-07 Общество с ограниченной ответственностью Совместное русско-французское предприятие "СпектрАп" Координатная метка
US10404976B2 (en) 2011-12-27 2019-09-03 Koninklijke Philips N.V. Intra-operative quality monitoring of tracking systems
US11350995B2 (en) 2016-10-05 2022-06-07 Nuvasive, Inc. Surgical navigation systems and methods

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2584965B1 (de) * 2010-06-28 2016-04-13 Koninklijke Philips N.V. Echtzeit-qualitätskontrolle einer em-kalibrierung
US9510771B1 (en) 2011-10-28 2016-12-06 Nuvasive, Inc. Systems and methods for performing spine surgery
RU2638445C2 (ru) * 2012-10-01 2017-12-13 Конинклейке Филипс Н.В. Трехмерное полилинейное совмещение с использованием ограничений формы
US10531814B2 (en) 2013-07-25 2020-01-14 Medtronic Navigation, Inc. Method and apparatus for moving a reference device
US9848922B2 (en) 2013-10-09 2017-12-26 Nuvasive, Inc. Systems and methods for performing spine surgery
US11103313B2 (en) * 2015-03-05 2021-08-31 Atracsys Sarl Redundant reciprocal surgical tracking system with three optical trackers
CN107320118B (zh) * 2017-06-26 2020-05-12 南京普爱医疗设备股份有限公司 一种计算碳纳米c形臂三维图像空间信息的方法及***
EP3687405A4 (de) * 2017-09-25 2020-11-04 Shanghai United Imaging Healthcare Co., Ltd. System und verfahren zur ortung einer zielperson
EP3694438B1 (de) * 2019-01-03 2021-03-17 Brainlab AG Bestimmung einer zielposition eines röntgengeräts
KR102203544B1 (ko) * 2019-03-13 2021-01-18 큐렉소 주식회사 C-arm 기반의 의료영상 시스템 및 2D 이미지와 3D 공간의 정합방법
DE102019214302B4 (de) * 2019-09-19 2021-05-20 Siemens Healthcare Gmbh Verfahren zum Registrieren eines Röntgenbilddatensatzes mit einem Navigationssystem, Computerprogrammprodukt und System
EP3896653A1 (de) * 2020-04-15 2021-10-20 Stryker European Operations Limited Verfahren zur bestimmung einer position von einem oder mehreren abgebildeten markern in einem bildkoordinatensystem
TWI749922B (zh) * 2020-11-30 2021-12-11 財團法人金屬工業研究發展中心 手術影像註冊系統與方法
CN117017487B (zh) * 2023-10-09 2024-01-05 杭州键嘉医疗科技股份有限公司 一种脊柱配准方法、装置、设备及存储介质
CN117582243A (zh) * 2024-01-19 2024-02-23 苏州铸正机器人有限公司 一种c形臂x光机的标定***及空间定位方法

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020044631A1 (en) * 2000-08-31 2002-04-18 Rainer Graumann Method for determining a coordinate transformation for use in navigating an object
DE10202091A1 (de) 2002-01-21 2003-08-14 Siemens Ag Vorrichtung und Verfahren zur Ermittlung einer Koordinatentransformation
DE10215808A1 (de) 2002-04-10 2003-11-06 Siemens Ag Verfahren zur Registrierung für navigationsgeführte Eingriffe
FR2841118A1 (fr) 2002-06-20 2003-12-26 Perception Raisonnement Action Determination de la position d'un appareil de radiographie ou de radioscopie
WO2004075768A2 (en) 2003-02-25 2004-09-10 Image-Guided Neurologics, Inc. Fiducial marker devices, tools, and methods
US20050054915A1 (en) * 2003-08-07 2005-03-10 Predrag Sukovic Intraoperative imaging system
US20050163279A1 (en) * 2003-12-19 2005-07-28 Matthias Mitschke Method and apparatus for image support of an operative procedure implemented with a medical instrument
DE102006024425A1 (de) 2006-05-24 2007-11-29 Siemens Ag Verfahren zur Lokalisierung eines medizinischen Instruments während eines Eingriffs im menschlichen Körper
WO2009109552A1 (de) 2008-03-06 2009-09-11 Siemens Aktiengesellschaft Medizinsystem und verfahren zur ortsrichtigen zuordnung eines bilddatensatzes zu einem elektromagnetischen navigationssystem
US7643867B2 (en) 2003-02-25 2010-01-05 Medtronic, Inc. Fiducial marker devices, tools, and methods
DE102009034671A1 (de) 2009-07-24 2011-01-27 Siemens Aktiengesellschaft Vorrichtung und Verfahren zur rechnergestützten Navigation

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6533455B2 (en) * 2000-08-31 2003-03-18 Siemens Aktiengesellschaft Method for determining a coordinate transformation for use in navigating an object
US20020044631A1 (en) * 2000-08-31 2002-04-18 Rainer Graumann Method for determining a coordinate transformation for use in navigating an object
DE10202091A1 (de) 2002-01-21 2003-08-14 Siemens Ag Vorrichtung und Verfahren zur Ermittlung einer Koordinatentransformation
US20030179856A1 (en) * 2002-01-21 2003-09-25 Matthias Mitschke Apparatus for determining a coordinate transformation
DE10215808A1 (de) 2002-04-10 2003-11-06 Siemens Ag Verfahren zur Registrierung für navigationsgeführte Eingriffe
US6851855B2 (en) 2002-04-10 2005-02-08 Siemens Aktiengesellschaft Registration method for navigation-guided medical interventions
FR2841118A1 (fr) 2002-06-20 2003-12-26 Perception Raisonnement Action Determination de la position d'un appareil de radiographie ou de radioscopie
US7672709B2 (en) 2002-06-20 2010-03-02 Perception Raisonnement Action En Medecine Determination of the position of a radiographic or radioscopic unit
US7643867B2 (en) 2003-02-25 2010-01-05 Medtronic, Inc. Fiducial marker devices, tools, and methods
WO2004075768A2 (en) 2003-02-25 2004-09-10 Image-Guided Neurologics, Inc. Fiducial marker devices, tools, and methods
US20050054915A1 (en) * 2003-08-07 2005-03-10 Predrag Sukovic Intraoperative imaging system
US7519415B2 (en) * 2003-12-19 2009-04-14 Siemens Aktiengesellschaft Method and apparatus for image support of an operative procedure implemented with a medical instrument
US20050163279A1 (en) * 2003-12-19 2005-07-28 Matthias Mitschke Method and apparatus for image support of an operative procedure implemented with a medical instrument
DE102006024425A1 (de) 2006-05-24 2007-11-29 Siemens Ag Verfahren zur Lokalisierung eines medizinischen Instruments während eines Eingriffs im menschlichen Körper
US7778690B2 (en) 2006-05-24 2010-08-17 Siemens Aktiengesellschaft Method for locating a medical instrument during an intervention performed on the human body
WO2009109552A1 (de) 2008-03-06 2009-09-11 Siemens Aktiengesellschaft Medizinsystem und verfahren zur ortsrichtigen zuordnung eines bilddatensatzes zu einem elektromagnetischen navigationssystem
US20110015519A1 (en) 2008-03-06 2011-01-20 Rainer Graumann Medical system and method for the positionally correct association of an image data set with an electromagnetic navigation system
DE102009034671A1 (de) 2009-07-24 2011-01-27 Siemens Aktiengesellschaft Vorrichtung und Verfahren zur rechnergestützten Navigation

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10404976B2 (en) 2011-12-27 2019-09-03 Koninklijke Philips N.V. Intra-operative quality monitoring of tracking systems
US20160074000A1 (en) * 2013-05-31 2016-03-17 Kabushiki Kaisha Toshiba X-ray diagnostic apparatus
US10687771B2 (en) * 2013-05-31 2020-06-23 Canon Medical Systems Corporation X-ray diagnostic apparatus comprising a position specifying unit and a control unit
US11350995B2 (en) 2016-10-05 2022-06-07 Nuvasive, Inc. Surgical navigation systems and methods
RU179261U1 (ru) * 2018-02-14 2018-05-07 Общество с ограниченной ответственностью Совместное русско-французское предприятие "СпектрАп" Координатная метка

Also Published As

Publication number Publication date
DE102010020781B4 (de) 2019-03-28
WO2011144412A1 (de) 2011-11-24
DE102010020781A1 (de) 2011-11-24
US20130066196A1 (en) 2013-03-14

Similar Documents

Publication Publication Date Title
US8886286B2 (en) Determining and verifying the coordinate transformation between an X-ray system and a surgery navigation system
JP7204663B2 (ja) 慣性計測装置を使用して手術の正確度を向上させるためのシステム、装置、及び方法
US9724049B2 (en) Radiotherapy system
US8503745B2 (en) System and method for automatic registration between an image and a subject
US8165660B2 (en) System and method for selecting a guidance mode for performing a percutaneous procedure
US11759272B2 (en) System and method for registration between coordinate systems and navigation
JP7399982B2 (ja) 手術中の３次元可視化
CN114846517A (zh) 确定2d医学图像中的对象之间的相对3d位置和取向
KR20190078853A (ko) 레이저 표적 투영장치 및 그 제어방법, 레이저 표적 투영장치를 포함하는 레이저 수술 유도 시스템
JP2008126075A (ja) Ｃｔレジストレーション及びフィードバックの視覚的検証のためのシステム及び方法
KR101954868B1 (ko) 혈관 중재 시술을 위한 내비게이션 시스템 및 가상의 엑스선 이미지 생성 방법
JP2001245880A (ja) 医療器具の位置判定方法
KR20100098055A (ko) 영상유도수술시스템 및 그 제어방법
JP2009022754A (ja) 放射線画像の位置揃えを補正する方法
US20240164848A1 (en) System and Method for Registration Between Coordinate Systems and Navigation
EP4274502B1 (de) Navigationsunterstützung
EP3370616B1 (de) Vorrichtung zur abbildung eines objekts
KR102619994B1 (ko) 의용 화상 처리 장치, 기억 매체, 의용 장치, 및 치료 시스템
CN110267594B (zh) C型臂计算机断层摄影中的等中心
US20080285707A1 (en) System and Method for Medical Navigation
JP2013240630A (ja) 画像表示装置及び画像表示方法
KR102042762B1 (ko) 영상정합방법 및 영상정합장치
JP7513980B2 (ja) 医用画像処理装置、治療システム、医用画像処理方法、およびプログラム
US20230190377A1 (en) Technique Of Determining A Scan Region To Be Imaged By A Medical Image Acquisition Device
US20210378749A1 (en) Method and device for monitoring images by means of an x-ray device during a surgical procedure

Legal Events

Date Code Title Description
AS Assignment

Owner name: SIEMENS AKTIENGESELLSCHAFT, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GRAUMANN, RAINER;KLEINSZIG, GERHARD;RINGHOLZ, MARTIN;SIGNING DATES FROM 20120912 TO 20120914;REEL/FRAME:029355/0313

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: SIEMENS HEALTHCARE GMBH, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SIEMENS AKTIENGESELLSCHAFT;REEL/FRAME:039271/0561

Effective date: 20160610

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

AS Assignment

Owner name: SIEMENS HEALTHINEERS AG, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SIEMENS HEALTHCARE GMBH;REEL/FRAME:066088/0256

Effective date: 20231219