AU2017348161B2 - System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map - Google Patents
System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map Download PDFInfo
- Publication number
- AU2017348161B2 AU2017348161B2 AU2017348161A AU2017348161A AU2017348161B2 AU 2017348161 B2 AU2017348161 B2 AU 2017348161B2 AU 2017348161 A AU2017348161 A AU 2017348161A AU 2017348161 A AU2017348161 A AU 2017348161A AU 2017348161 B2 AU2017348161 B2 AU 2017348161B2
- Authority
- AU
- Australia
- Prior art keywords
- gridpoint
- gridpoints
- field strength
- calculated
- map
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000000034 method Methods 0.000 title claims abstract description 70
- 238000005259 measurement Methods 0.000 claims description 36
- 239000013598 vector Substances 0.000 claims description 21
- 230000006870 function Effects 0.000 description 17
- 239000011159 matrix material Substances 0.000 description 12
- 238000011282 treatment Methods 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 7
- 210000004072 lung Anatomy 0.000 description 7
- 238000013507 mapping Methods 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 229930091051 Arenine Natural products 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 238000005070 sampling Methods 0.000 description 3
- 238000001356 surgical procedure Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 239000000523 sample Substances 0.000 description 2
- 238000012897 Levenberg–Marquardt algorithm Methods 0.000 description 1
- 208000019693 Lung disease Diseases 0.000 description 1
- 238000002679 ablation Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000001739 density measurement Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035699 permeability Effects 0.000 description 1
- 238000004393 prognosis Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/06—Devices, other than using radiation, for detecting or locating foreign bodies ; determining position of probes within or on the body of the patient
- A61B5/061—Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body
- A61B5/062—Determining position of a probe within the body employing means separate from the probe, e.g. sensing internal probe position employing impedance electrodes on the surface of the body using magnetic field
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2051—Electromagnetic tracking systems
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- Heart & Thoracic Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Robotics (AREA)
- Position Fixing By Use Of Radio Waves (AREA)
Abstract
Systems and methods for identifying a location and/or an orientation of an electromagnetic (EM) sensor navigated within an EM volume are provided. Calculated EM field strengths at each gridpoint of a second set of gridpoints of the EM volume are retrieved from a memory. An EM field is generated by way of an antenna assembly. A measured EM field strength is received from the EM sensor. A first gridpoint among a first set of gridpoints of the EM volume is identified based on the measured EM field strength and a high density (HD) map. The location and/or the orientation of the EM sensor is identified based on the HD map, using the first gridpoint as an initial condition, with the second set of gridpoints also including the first set of gridpoints.
Description
SYSTEM AND METHOD FOR IDENTIFYING A LOCATION AND/OR AN ORIENTATION OF AN ELECTROMAGNETIC SENSOR BASED ON A MAP
BACKGROUND
Technical Field
[0001] The present disclosure generally relates to electromagnetic navigation, and more particularly to systems and methods for generating a map for electromagnetic navigation and identifying a location and/or an orientation of a sensor based on the map. Discussion of Related Art
[0002] Electromagnetic navigation (EMN) has helped expand medical imaging, diagnosis, prognosis, and treatment capabilities by enabling a location and/or an orientation of a medical device and/or of a target of interest to be accurately determined within a patient's body. Generally, an antenna generates an electromagnetic (EM) field in an EM volume, a sensor incorporated onto a medical device senses an EM signal or strength based on the field, and the EMN system identifies a sensor location based on the sensed EM strength. The EM strength at each location in the EM volume is previously measured or mapped to enable the sensor location to be identified in the EM volume by comparing the sensed EM strength and the previously measured EM strength.
[0003] In some cases, it may be desirable for the sensor to be a small-sized sensor, such as a single-coil sensor, because, for instance, a small sized sensor may be navigable to additional locations (e.g., narrower portions of a luminal network) within the patient, to which a larger-sized sensor may not be navigable. Additionally, in contrast to large-size sensors which sometimes must be removed from the patient during a procedure to make room in a working channel for other tools, the small-sized sensor may remain within the patient throughout the procedure without interfering with the other tools, thereby facilitating EMN functionality throughout the procedure.
[0004] To enable a small-sized sensor such as a single-coil sensor to be accurately located within an EM volume, it may be necessary to generate multiple (for instance, 6 or more) geometrically diverse EM fields within the EM volume. However, because each of the EM fields would require generation of a measured mapping of the corresponding EM strength at each location in the EM volume, increasing the number of EM fields would increase the number of mappings, which can be time consuming and laborious. Additionally, to improve the accuracy with which the sensor location can be determined, precise measurements at many (for example, thousands) of gridpoints within the EM volume may be needed, which could make the generating of the mapping even more time consuming. Also, because of the potential variability during the manufacturing processes and tolerances of electrical equipment, the mapping process may need to be completed for each new antenna that is produced and for each electromagnetic navigation system installation.
[0005] Given the foregoing, a need exists for improved systems and methods for generating a map for electromagnetic navigation and identifying a location and/or an orientation of a sensor based on the map.
SUMMARY
[0006] The present disclosure is related to systems and methods for generating a map of EM field strength, for example, a high density (HD) map, for electromagnetic navigation and identifying a sensor location and/or orientation based on the map. In one example, the HD map has a greater (e.g., finer) gridpoint resolution (that is, more gridpoints) in the EM volume man that of a low density (LD) grid in the EM volume according to which EM field strength measurements are taken and stored in a LD map. The HD map, in some aspects, is generated based on the previously generated LP map of measured EM field strength and also based on EM field strength calculations based, for
instance on geometric configurations of antennas in an antenna assembly. In this manner, the location and/or the orientation of the sensor navigated within the patient's body can be accurately identified without the need to take EM field strength measurements at each of the many gridpoints of the HD map within the EM volume. This can enable the use of a small-sized sensor in EMN procedures while minimizing any increased burden of map generation.
[0007] In accordance with one aspect of the present disclosure, a method is provided for generating a high density (HD) map for identifying a location and/or an orientation of an electromagnetic (EM) sensor within an EM volume in which an EM field is generated by way of an antenna assembly. The method includes receiving a measured EM field strength at each gridpoint of a first set of gridpoints of the EM volume from a measurement device. An EM field strength at each gridpoint of a second set of gridpoints of the EM volume is calculated based on a geometric configuration of an antenna of the antenna assembly. The HD map is generated based on the measured EM field strength at each gridpoint of the first set of gridpoints and the calculated EM field strength at each gridpoint of the second set of gridpoints.
[0008] In another aspect of the present disclosure, the antenna assembly generates at least six EM waveforms as components of the EM field.
[0009] In a further aspect of the present disclosure, the EM field strength is calculated along a three axes coordinate system for each of the at least six EM waveforms.
[0010] In yet another aspect of the present disclosure, the EM field strength is measured by way of a sensor having three coils corresponding to the three axes, respectively.
[0011] In still another aspect of the present disclosure, the second set of gridpoints includes each gridpoint of the first set of gridpoints.
[0012] In another aspect of the present disclosure, the generating the HD map includes calculating an error between the measured EM field strength and the calculated EM field strength, at each gridpoint of the first set of gridpoints. An error for each gridpoint of the second set of gridpoints is interpolated based on the calculated error at each gridpoint of the first set of gridpoints. The interpolated error and the calculated EM field strength at each gridpoint of the second set of gridpoints are added to generate the HD map
[0013] In a further aspect of the present disclosure, the error is calculated based on a difference between the measured EM field strength and the calculated EM field strength at each gridpoint of the first set of gridpoints.
[0014] In yet another aspect of the present disclosure, the error is based on at least one of an LI or L2 norm of differences between the measured EM field strength and the calculated EM field strength along the three axes.
[0015] In still another aspect of the present disclosure, the method further includes calculating a pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
[0016] In another aspect of the present disclosure, the HD map further includes the pseudo-inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
[0017] In accordance with another aspect of the present disclosure an apparatus is provided for generating an HD map for identifying a location and/or an orientation of an EM sensor within an EM volume in which an EM field is generated by way of an antenna assembly. The apparatus includes a processor and a memory storing processor-executable instructions that, when executed by the processor, cause the processor to receive, from a measurement device, a measured EM field strength at each gridpoint of a first set of
gridpoints of the EM vohime. An EM field strength at each gridpoint of a second set of gridpoints of the EM volume is calculated based on a geometric configuration of at least one antenna of the antenna assembly. The HD map is generated based on the measured EM field strength at each gridpoint of the first set of gridpoints and the calculated EM field strength at each gridpoint of the second set of gridpoints.
[0018] In another aspect of the present disclosure, the antenna assembly generates at least six EM waveforms as components of the EM field.
[0019] In still another aspect of the present disclosure, the EM field strength is calculated along a three axes coordinate system for each of the at least six EM waveforms.
[0020] In a further aspect of the present disclosure, the EM field strength is measured with a sensor having three coils corresponding to the three axes, respectively.
[0021] In yet another aspect of the present disclosure, the second set of gridpoints includes each gridpoint of the first set of gridpoints.
[0022] In another aspect of the present disclosure, the generating of the HD map includes calculating an error between the measured EM field strength and the calculated EM field strength, at each gridpoint of the first set of gridpoints. An error for each gridpoint of the second plurality of gridpoints is interpolated based on the calculated error at each gridpoint of the first plurality of gridpoint. The interpolated error and the calculated EM field strength at each gridpoint of the second plurality of gridpoints are added to generate the HD map.
[0023] In yet another aspect of the present disclosure, the error is calculated based on a difference between the measured EM field strength and the calculated EM field strength at each gridpoint of the first set of gridpoints.
[0024] In a further aspect of the present disclosure, the error is based on an LI and/or L2 norm of differences between the measured EM field strength and the calculated EM field strength along the three axes.
[0025] In still another aspect of the present disclosure, the memory further stores instructions that, when executed by the processor, cause the processor to calculate a pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
[0026] In another aspect of the present disclosure, the HD map further includes the pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
[0027] In accordance with another aspect of the present disclosure, a method is provided for identifying a location and/or an orientation of an EM sensor navigated within an EM volume. The method includes retrieving, from a memory, a calculated EM field strength at each gridpoint of a second set of gridpoints of the EM volume. An EM field is generated by way of an antenna assembly. A measured EM field strength is received from the EM sensor. A first gridpoint among a first set of gridpoints of the EM volume is identified based on the measured EM field strength and a HD map. The location and/or the orientation of the EM sensor are identified based on the HD map, using the first gridpoint as an initial condition. The second set of gridpoints includes the first plurality of gridpoints.
[0028] In another aspect of the present disclosure, the antenna assembly includes at least six antennas, each of the antennas including multiple loops.
[0029] In yet another aspect of the present disclosure, the multiple loops have a geometric configuration.
[0030] In a further aspect of the present disclosure, the HD map includes a calculated EM field strength for each gridpoint of the second set of gridpoints in the EM volume.
[0031] In still another aspect of the present disclosure, the calculated EM field strength is based on the respective geometric configurations of the at least six antennas.
[0032] In another aspect of the present disclosure, the HD map further includes a pseudo-inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
[0033] In yet another aspect of the present disclosure, the identifying the first gridpoint includes identifying an orientation vector where (a,b,c) is a gridpoint in
the first set of gridpoints, satisfying the following condition: where
is a pseudo-inverse of which is a calculated EM field strength at gridpoint
(a,b,c) in the HD map. A difference between and V is calculating- A
gridpoint (A,B,C), from among the first set of gridpoints, where a difference between and V is the smallest, is selected, as the first gridpoint.
[0034] In a further aspect of the present disclosure, the identifying the location and/or the orientation includes identifying an orientation vector where is a
gridpoint in the second set of gridpoints and is located nearby (e.g. within a predetermined distance) from the first gridpoint (A,B,C), satisfying the following condition: where is a pseudo-inverse of which is a
calculated EM field strength at gridpoint (d,e,f) in the HD map. A difference between and V is calculated. A second gridpoint (D,E,F) from among the second set
of gridpoints, where a difference between and V is the smallest, is selected.
[0035] In still another aspect of the present disclosure, np ¾p) is related to the orientation of the EM sensor.
[0036] In another aspect of the present disclosure, the second gridpoint (D,E,F) is the location of the EM sensor.
[0037] In accordance with another aspect of the present disclosure, a system is provided for identifying a location and/or an orientation of an EM sensor navigated within an EM volume. The system includes an antenna assembly, the EM sensor, a processor, and a memory. The antenna assembly is configured to radiate an EM field within the EM volume. The EM sensor is configured to measure an EM field strength based on the radiated EM field. The memory stores a calculated EM field strength at each gridpoint of a second set of gridpoints of the EM volume. The memory also stores processor-executable instructions that, when executed by the processor, cause the processor to retrieve, from the memory, the calculated EM field strength at each gridpoint of the second set of gridpoints. A first gridpoint among a first set of gridpoints of the EM volume is identified based on the measured EM field strength and the HD map. The location and/or the orientation of the EM sensor are identified based on the HD map, using the first gridpoint as an initial condition. The second set of gridpoints includes the first set of gridpoints.
[0038] In a further aspect of the present disclosure, the antenna assembly includes at least six antennas, each of the antennas including a plurality of loops.
[0039] In still another aspect of the present disclosure, the plurality of loops has a geometric configuration.
[0040] In another aspect of the present disclosure, the HD map includes a calculated EM field strength at each gridpoint of the second set of gridpoints in the EM volume.
[0041] In yet another aspect of the present disclosure, the calculated EM field strength is based on the respective geometric configurations of the at least six antennas.
[0042] In another aspect of the present disclosure, the HD map further includes a pseudo-inverse of the calculated EM field strength at each gridpoint of the second set of gridpoints.
[0043] In another aspect of the present disclosure, the identifying the first gridpoint includes identifying an orientation vector where (a,b,c) is a gridpoint in
the first set of gridpoints, satisfying the following condition: where
is a pseudo-inverse of which is a calculated EM field strength at gridpoint
(a,b,c) in the HD map. A difference between B and V is calculated. A
gridpoint (A,B,C) from among the first plurality of gridpoints, where a difference between and V is the smallest, is selected as the first gridpoint.
[0044] In yet another aspect of the present disclosure, the identifying the location and/or the orientation includes identifying an orientation vector , where (d,e,f) is a
gridpoint in the second set of gridpoints and is located nearby (e.g., within a predetermined distance from) the first gridpoint (A,B,C), satisfying the following condition: where B is a pseudo-inverse of which is a
calculated EM field strength at gridpoint (d,e,f) in the HD map. A difference between and V is calculated. A second gridpoint (D,E,F) from among the second
plurality of gridpoints, where a difference between and V is the smallest is
selected.
[0045] In another aspect of the present disclosure, is related to the
orientation of the EM sensor.
[0046] In a further aspect of the present disclosure, the second gridpoint (D,E,F) is the location of the EM sensor.
[0047] Any of the aspects and embodiments of the present disclosure may be combined without departing from the scope of the present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Objects and features of the presently disclosed systems and methods will become apparent to those of ordinary skill in the art when descriptions of various embodiments are read with reference to the accompanying drawings, of which:
[0049] FIG. 1 shows an example electromagnetic navigation (EMN) system, in accordance with the present disclosure;
[0050] FIG. 2 is a block diagram of a portion of the EMN system of FIG. 1, in accordance with the present disclosure;
[0051] FIG. 3 is a graphical illustration of example low density measurements and related curves, in accordance with the present disclosure;
[0052] FIG. 4 is a flowchart illustrating an example method for generating a high density map, in accordance with the present disclosure;
[0053] FIG. 5 is a flowchart illustrating an example method for identifying a location and/or an orientation of a sensor, in accordance with the present disclosure;
[0054] FIG. 6 is a graphical illustration of an example error function, having multiple local minima, of a discrepancy between a measurement value and a calculated value, in accordance with the present disclosure; and
[0055] FIG. 7 is a block diagram of a computing device for use in various embodiments of the present disclosure.
DETAILED DESCRIPTION
[0056] The present disclosure is related to systems and methods for generating a high density (HD) map and identifying a location and/or an orientation of a sensor, which may include at least one coil, based on the HD map. In some aspects, the respective geometric configurations the antennas enable automated and highly repeatable processes for reproducing such antennas and/or for mathematically calculating the expected or theoretical EM strength at every HD gridpoint within an EM volume (for instance, where the antennas have geometric configurations based on linear portions of printed circuit board (PCB) traces, which facilitate use of the superposition principle in computing the total contribution of the fields generated by way of each antenna to the total combined EM field within the volume). These mathematical calculations may be combined with actual measurements made in a coarse coordinate system, which includes fewer gridpoints than the number of gridpoints used for the mathematically calculated EM strength. In this way, the time and/or cost related to making the measurements can be lowered and a HD map can be generated and used in a repeatable, efficient, and cost- effective manner.
[0057] Further, the present disclosure is related to systems and methods for identifying a location and/or an orientation of an EM sensor by using the HD map. In general, the EM sensor senses EM strengths, and an EMN system compares the sensed EM strengths with the expected EM strengths of the HD map and identifies the location and the orientation of the EM sensor.
[0058] In an aspect of the present disclosure, a fine coordinate system (e.g., a HD coordinate system or set of gridpoints) is used to describe a coordinate system of the EM volume, which includes more gridpoints than those in a coarse coordinate system (e.g., a LD coordinate system or set of gridpoints) of the EM volume. In some aspects, every
gridpoint of the coarse coordinate system may be included in the fine coordinate system. In general, the coarse coordinate system is utilized for actual EM field strength measurements and the fine coordinate system is utilized for mathematical calculations of EM field strength.
[0059] FIG. 1 illustrates an example electromagnetic navigation (EMN) system
100, which is configured to identify a location and/or an orientation of a medical device, or sensor thereof, navigating (e.g., to a target) within the patient's body by using an antenna assembly, which includes a plurality of antennas and generates EM fields. The EMN system 100 is further configured to augment CT, MRI, or fluoroscopic images in navigation through patient's body toward a target of interest, such as a deceased portion in a luminal network of a patient's lung.
[0060] The EMN system 100 includes a catheter guide assembly 110, a bronchoscope 1 IS, a computing device 120, a monitoring device 130, an EM board 140, a tracking device 160, and reference sensors 170. The bronchoscope 115 is operatively coupled to the computing device 120 and the monitoring device 130 via a wired connection (as shown in FIG. 1) or wireless connection (not shown).
[0061] The bronchoscope 115 is inserted into the mouth of a patient 150 and captures images of the luminal network of the lung. In the EMN system 100, inserted into the bronchoscope 115 is a catheter guide assembly 110 for achieving access to the periphery of the luminal network of the lung of the patient 150. The catheter guide assembly 110 may include an extended working channel (EWC) 111 with an EM sensor 112 at the distal portion of the EWC 111. A locatable guide catheter (LG) may be inserted into the EWC 111 with another EM sensor at the distal portion of the LG. The EM sensor 112 at the distal portion of the EWC 111 or the LG is used to identify a location and/or an orientation of the EWC 111 or the LG while navigating through the luminal network of
the lung. Due to the size restriction in the EWC 111 or the LG, in some embodiments, the EM sensor 112 may include only one single coil for detecting EM strength of an EM field over the patient ISO. However, the number of coils in the EM sensor is not limited to one but may be two or more.
[0062] The computing device 120, such as, a laptop, desktop, tablet, or other similar computing device, includes a display 122, one or more processors 124, memory 126, an AC current driver 127 for providing AC current signals to the antenna assembly 145, a network card 128, and an input device 129. The particular configuration of the computing device 120 illustrated in FIG. 1 is provided as an example, but other configurations of the components shown in FIG. 1 as being included in the computing device 120 are also contemplated. In particular, in some embodiments, one or more of the components (122, 124, 126, 127, 128, and/or 129) shown in FIG. 1 as being included in the computing device 120 may instead be separate from the computing device 120 and may be coupled to the computing device 120 and/or to any other components) of the system 100 by way of one or more respective wired or wireless path(s) to facilitate the transmission of power and/or data signals throughout the system 100. For example, although not shown in FIG. 1, the AC current driver 127 may, in some example aspects, be separate from the computing device 120 and may be coupled to the antenna assembly 145 and/or coupled to one or more components of the computing device 120, such as the processor 124 and the memory 126, by way of one or more corresponding paths.
[0063] In some aspects, the EMN system 100 may also include multiple computing devices, wherein the multiple computing devices are employed for planning, treatment, visualization, or helping clinicians in a manner suitable for medical operations. The display 122 may be touch-sensitive and/or voice-activated, enabling the display 122 to serve as both input and output devices. The display 122 may display two dimensional
(2D) images or three dimensional (3D) model of a lung to locate and identify a portion of the lung that displays symptoms of lung diseases.
[0064] The one or more processors 124 execute computer-executable instructions.
The processors 124 may perform image-processing functions so that the 3D model of the lung can be displayed on the display 122 or location algorithm to identify a location and an orientation of the EM sensor 112. In embodiments, the computing device 120 may further include a separate graphic accelerator (not shown) that performs only the image- processing functions so that the one or more processors 124 may be available for other programs. The memory 126 stores data and programs. For example, data may be mapping data for the EMN or any other related data such as a HD map, image data, patients' medical records, prescriptions and/or history of the patient's diseases.
[0065] The HD map may include a plurality of gridpoints in a fine coordinate system of the EM volume in which a medical device (e.g., the EWC 111, LG, treatment probe, or other surgical devices) is to be navigated, and expected EM strengths at each of the plurality of gridpoints. When the EM sensor 112 senses EM strength at a point, the one or more processors 124 may compare the sensed EM strength with the expected EM strengths in the HD map and identify the location of the EM sensor 112 within the EM volume. Further, an orientation of the medical device may be also calculated based on the sensed EM strength and the expected EM strengths in the HD map.
[0066] As shown in FIG. 1, the EM board 140 is configured to provide a flat surface for the patient ISO to lie upon and includes an antenna assembly 145. When the patient ISO lies upon on the EM board 140, the antenna assembly 14S generates an EM field sufficient to surround a portion of the patient ISO or the EM volume. The antenna assembly 14S includes a plurality of antennas, each of which may include a plurality of loops. In one aspect, each antenna is configured to generate an EM waveform having a
corresponding frequency. The number of antennas may be at least six. In an aspect, the number of antennas may be nine so that nine different EM waveforms can be generated.
[0067] In another aspect, a time multiplexing method is employed in generating the EM waveforms. For example, the antennas of the antenna assembly 14S may generate EM waveforms with the same frequency at different times during a period. In another aspect, frequency multiplexing method may be employed, where each antenna generates EM waveform having a frequency different from each other. In still another aspect, combination of the time multiplexing and frequency multiplexing methods may be employed. The antennas are grouped into more than one group. Antennas in the same group generate EM waveforms having the same frequency but at different times. Antennas in different groups may generate EM waveforms having different frequencies from each other. Corresponding de-multiplexing method is to be used to separate EM waveforms.
[0068] In an aspect, each antenna may have a geometric configuration (for instance, where the antennas each have geometric configurations based on linear portions of printed circuit board (PCB) traces or wires, which facilitate use of the superposition principle in computing the total contribution of the fields generated by way of each antenna to the total combined EM field within the volume) so that each portion of the plurality of loops can be expressed as mathematical relationship or equations, as described in further detail below. The magnetic field can thus be computed for each trace on the antenna and the contributions from all traces can be summed. Based on this geometric configuration, expected EM strength at each gridpoint in the HD map can be theoretically or mathematically calculated. Additional aspects of such example antennas and methods of manufacturing the antennas are disclosed in U.S. Patent Application No. 15/337,056 , entitled "Electromagnetic Navigation Antenna Assembly and
Electromagnetic Navigation System Including the Same," filed on October 28, 2016 and having attorney docket number 3S6S80.USU1 (1988-252 A), the entire contents of which are hereby incorporated by reference herein.
[0069] FIG. 2 shows a block diagram of a portion of the example electromagnetic navigation system 100 of FIG. 1, according to the present disclosure. In general, the computing device 120 of the EMN system 100 controls the antenna assembly 145 embedded in the EM board 140 to generate an EM field, receives sensed results from the EM sensor 112, and determines a location and an orientation of the EM sensor 112 in the EM volume.
[0070] The computing device 120 includes a clock 205, which generates a clock signal used for generating the EM field and sampling the sensed results. Since the same clock signal is used for generating the EM field and sampling the sensed EM field, synchronization between the magnetic field generation circuitry (e.g., a waveform generator 210) and the waveform acquisition circuitry (e.g., a digitizer 215) may be achieved. In other words, when the clock 205 provides a clock signal to the waveform generator 210 and the digitizer 215, the EM waveforms generated by the antenna assembly 145 are digitally sampled by digitizer 215 substantially at the same time. The digitizer 215 may include an analog-to-digital converter (ADC, which is not shown) to digitally sample the sensed results and an amplifier (which is not shown) to amplify the magnitude of the sensed result so that the magnitude of the sensed results is within the operable range of the ADC. In an aspect, the digitizer 215 may include a pre-amplifier and post-amplifier so that the magnitude of the sensed result is amplified to be within the operable range of the ADC by the pre-amplifier and digital samples are also amplified to the magnitude of the sensed result by the post-amplifier.
[0071] The demodulator 220 demodulates the digital samples to remove unwanted signals (e.g., noises) and to restore the EM waveforms, which have been generated by the antenna assembly 145. The demodulator 220 may use time de-multiplexing method, frequency de-multiplexing method, or combination of both to separate and identify the EM waveforms depending on the method used by the antennas of the antenna assembly 145 to generate the EM waveforms, and to determine EM strength affected by each of the antenna of the antenna assembly 145.
[0072] For example, when the antenna assembly 145 includes six antennas, the demodulator 220 is capable of identifying six EM strengths, which is sensed by the EM sensor 112, for the six antennas, respectively. In a case when the number of antennas is nine, the outputs of the demodulator 220 may be expressed in a form of a nine by one matrix. Based on the modulation method (e.g., time multiplexing, frequency multiplexing, or a combination thereof) utilized by the antennas, the demodulator 220 demodulates the sensed result.
[0073] For example, when the antennas of the antenna assembly 145 utilize frequency multiplexing, the demodulator 220 may use a set of finely tuned digital filters. Orthogonal frequency division multiplexing may also be utilized, in which the EM field and sampling frequencies are chosen in such a way that only the desired frequency from a specific antenna is allowed to pass while other frequencies are precisely stopped. In an aspect, the demodulator 220 may use a multiple tap orthogonal frequency matched filter, in which the digital filter for a specific frequency is tuned to the desired demodulation window.
[0074] The memory 126 may store data and programs related to identification of a location and an orientation. The data includes a high density (HD) map 225, which includes a plurality of gridpoints according to the fine coordinate system for the EM
volume and expected EM strengths at the gridpoints. The HD map 225 may be based on three-axis coordinate system, where each gridpoint has three coordinates corresponding to the three axes, respectively. In this case, the expected EM strength at each gridpoint may include one EM strength value along each axis for each EM waveform. For example, if there are nine antennas generating nine different EM waveforms, each of which having a separate frequency, and three axes are x, y, and z axes, the expected EM strength may include nine EM strength values along the x axis, nine EM strength values along the y axis, and nine EM strength values along the z axis, at each gridpoint. Such expected EM strength at each gridpoint may be expressed in a nine by three matrix form.
[0075] The HD map 22S may be made with computations 230, which includes theoretically calculated EM strengths at each axis at each gridpoint in the fine coordinate system, and measurement 235, which includes measurements at each axis at each gridpoint in the coarse coordinate system. The fine coordinate system includes all the gridpoints in the coarse coordinate system and the gridpoints of the fine coordinate system are more finely distributed than those of the coarse coordinate system. By using the geometric configuration of the antennas of the antenna assembly 145, measurement may not have to be made with the fine coordinate system Rather, the measurement may be made in the coarse coordinate system and theoretical computations may be made in the fine coordinate system. By combining the measurements 235 in the coarse coordinate system with the theoretical computations 230 in the fine coordinate system, the HD map 225 may be generated. Generation of the HD map 225 based on the measurement 235 and calculations 230 will be described in further detail with respect to FIG. 4 below.
[0076] After passage of time or due to foreign objects near the EMN system 100, measurements by the EM sensor 112 or other hardware may need to be calibrated. Such calibration data may be also stored in the memory 126 in a form of sensor calibration 240
and hardware calibration 245.
[0077] When the computing device 120 receives measurement data from the EM sensor 112 via the demodulator 220, the computing device 120 uses the location algorithm 2S0, which is also stored in the memory 126, with the HD map 225 to identify the location and the orientation of the EM sensor 112 in the fine coordinate system. Identification of the location and/or the orientation will be described in further detail with respect to FIG. 5 below.
[0078] The location algorithm 250 may utilize any error minimization algorithm in identifying the location and the orientation of the EM sensor 112. For example, Levenberg-Marquardt algorithm may be employed to minimize errors between the expected EM strengths of the HD density map and the sensed results. Other error minimization methods or algorithms, which a person having ordinary skill in the art can readily appreciate, may also be utilized without departing from the scope of this disclosure.
[0079] The memory 126 further includes applications 255, which can be utilized by the computing device 120 of the EMN system 100 and which uses information regarding the location and the orientation of the EM sensor 112. Such application 255 may be a displaying application, which displays a graphical representation of a medical device, on which the EM sensor 112 is mounted or installed, at the location of the EM sensor 112 and along the orientation of the EM sensor 112 in the EM volume, an application for treatment, which determines whether a medical device is near a target of interest, or any other applications, which use the location and the orientation of the EM sensor 112.
[0080] FIG. 3 is a graphical illustration of multiple curves 320, 325, 330, and 340, as well as discrete EM field strength measurements 315a-315i taken in the coarse
coordinate system. The horizontal axis may represent any axis among x, y, and z axes for the EM volume and the vertical axis represents a magnitude of EM field strengths. Gridpoints of the coarse coordinate system are shown separated by SO millimeters and measured EM strengths at the gridpoints of the coarse coordinate system are shown as black dots 31 Sa-31 Si.
[0081] In some aspects, measurements may be taken at a specific hospital rooms and beds, where the EMN system 100 will be used, by way of a measurement jig, which includes three coils sensing an EM field strength in each of three different directions (e.g., x, y, and z axes). Examples of such a measurement jig are disclosed by Provisional U.S. Patent Application No. 62/237,084, entitled "Systems And Methods For Automated Mapping And Accuracy-Testing," filed on October S, 2015, the entire contents of which are hereby incorporated herein by reference.
[0082] Based on the measurement values at LD gridpoints 31 Sa-31 Si, interpolation may be used to generate first and second interpolated curves, 320 and 32S. In one example, the first interpolated curve 320 is generated by a linear interpolation method and the second interpolated curve 32S is generated by B- spline interpolation. Calculated EM strengths at gridpoints in the HD map are also interpolated to generate a third interpolated curve 330.
[0083] As shown in box 33S, the first, second, and third interpolated curves 320,
32S, 330 are substantially different from each other between two gridpoints 31Sh and 31 Si. The first interpolated curve 320 is lower than the third interpolated curve 330, and the second interpolated curve 32S is much higher than the second and third interpolated curves 32S and 330. Due to these big differences, an error may be apparent if only one of the three interpolated curves is used.
[0084] In order to minimize such differences, a fourth interpolated curve 340 is used. The fourth curve 340 is generated by calculating discrepancies between theoretical calculations and measurements at the LD gridpoints, such as 315a-315i, and interpolating the discrepancies for the HD gridpoints. By adding the fourth interpolated curve 340 to the third interpolated curve 330 at the HD gridpoints, expected EM strength at each gridpoints in the HD map is obtained and higher accuracy may be obtained. Detailed descriptions regarding how to generate the HD map is described with respect to FIG. 4 below.
[0085] FIG. 4 is a flowchart illustrating an example method 400 for generating an
HD map based on theoretical calculations in the fine coordinate system and measurements in the coarse coordinate system. Measurements may be performed for the EM field generated by the antennas of the antenna assembly 14S of FIG. 1, each of which having a corresponding geometric configuration. At 410, EM field measurements at all gridpoints in the coarse coordinate system are received from a measurement jig. The measurements may include three different measurements along three axes in the coarse coordinate system for each EM waveform. Thus, when there are nine antennas, the measurements at one gridpoint may include three values for the three different axes and nine of three values for the nine different waveforms, respectively. In an aspect, these measurements may be in a form of nine by three matrix.
[0086] At 420, based on the geometric configuration of each antenna of the antenna assembly 145, EM field strength is theoretically or mathematically calculated. As described above, each antenna includes a plurality of loops, which have geometric configurations. In other words, each loop of the antenna can be expressed in a form of mathematical equations or is made of simply linear portions. Thus, EM strength at any gridpoints in the fine coordinate system may be calculated by using Biot-Savart-Laplace
law as follows:
where B(r) is the EM strength at the gridpoint r influenced by the linear portion C, μο is a magnetic constant of the vacuum permeability, is a symbol of
line integral on the linear portion C, I is the magnitude of the current passing through the linear portion C, dl is a vector whose magnitude is the length of the differential element of the linear portion C in the direction of current, r' is a displacement vector from the differential element dl of the linear portion C to the gridpoint r, and * is a vector symbol representing a cross product between two vectors. Since the linear portion C is a simple line and each loop of the antenna includes multiple linear portions, total EM strength at the gridpoint r can be a sum of the EM strengths influenced by all the linear portions of the antenna. Further, the EM strength at the gridpoint r by the plural antennas is calculated in the same way. In other words, the total EM strength at gridpoint r may include three calculated values for the three different axes (e.g., x, y, and z axes) for one antenna, and nine of three calculated values for the nine antennas, in a case when there are nine antennas. In an aspect, the calculated EM strength may be expressed in a nine by three matrix form.
[0087] At 430, a discrepancy is calculated between the measured EM field and the calculated EM field at each gridpoint in the coarse coordinate system. In an aspect, the discrepancy may be made smaller by calibrating parameters of the three coil sensor of the measurement jig, calibrating the antennas, or calibrating parameters (e.g., frequencies or phases for the waveform generator 210) of the computing device of the EMN system.
[0088] At 440, the calculated discrepancies at gridpoints in the coarse coordinate system are interpolated for gridpoints in the fine coordinate system. Any method of
interpolation including linear interpolation, b-spline interpolation, etc. may be used.
[0089] At 450, the interpolated discrepancies are added to the theoretical calculations of the EM field to from expected EM field strength at each gridpoint in the fine coordinate system. The expected EM field strength at each gridpoint may be in a form of a nine by three matrix in a case when there are nine separate EM waveforms. The HD map may further include a pseudo-inverse of the expected EM field strength at each gridpoint in the HD map. This pseudo-inverse may be used in identifying a location and an orientation of the EM sensor, which is described in further detail with respect to FIG. 5 below.
[0090] FIG. 5 is a flowchart illustrating an example method 500 for identifying a location and/or an orientation of an EM sensor, for example, mounted on a medical device, which is navigated within a patient's body, in accordance with the present disclosure. The method 500 may be used while a medical device navigates inside the patient's body. At 510, the HD map, which includes expected EM field strength at each gridpoint of the HD map, is retrieved from a memory. As described above, the expected EM field strengths are based on the theoretical computations in the fine coordinate system and measurements in the coarse coordinate system.
[0091] The EM sensor mounted on the medical device periodically transmits sensed EM field strength to an EMN computing device, which digitally samples the sensed EM field strength. The EMN computing device measures the EM field strength based on the digital samples in step 520.
[0092] At 530, it is determined whether an initial location is set as an initial condition. If it is determined that the initial location is not set, the EMN computing device compares all gridpoints in the coarse coordinate system with the measured EM field strength, simply pickups, to find an approximate gridpoint in the coarse coordinate system
near the location of the EM sensor, as an initial location, at 540.
[0093] In an embodiment, a following error function may be used at 540:
where E is the error value, a is a counter, N is the number of antennas, (a,b,c) is a gridpoint in the coarse coordinate system, Ba(a,b,c) is a vector, one by three matrix, including an expected EM field strength at (a,b,c) influenced by the a-th antenna, "· " is a symbol of dot product between two vectors, n(a,b,c) is an orientation of the EM sensor, and Va is a vector, one by one matrix, including a pickup influenced by the a-th antenna, b is a parameter to control a gain weight, and g is a gain of the EM sensor. In an aspect, the parameter b is used when the gain of the EM sensor is known and fixed. The value for the parameter b may be chosen so as not to dominate the error function E. In another aspect, when the gain of the EM sensor is not known, the parameter b may be set to zero or the gain squared, g2, is assumed to be equal to the squared norm of the orientation vector n .
[0094] In some examples, for convenience, the parameter b is assumed to be zero.
In this case, the error function E becomes:
This error function is useful in identifying a location in the coarse or fine coordinate system. In an aspect, the error function is not limited to the above equation (2) or (3) and can be any error function that a person of ordinary skill in the art would readily appreciate
without departing from the scope of this disclosure. For example, the error function E maybe:
where represents an LI or L2 norm of the vector inside of the symbol,
respectively.
[0095] Referring briefly to FIG. 6, a curve of an error function along one axis is shown to illustrate how selection of an initial location may impact the determination of a location that provides the global minimum of the error. The horizontal axis represents a location along one axis (e.g., x, y, or z axis) and the vertical axis represents a magnitude of the error function. If the initial location is set to be near ¾ or Xi, the location giving a local minimum will be between X0 and Xi. If the initial location is set to be Xs or ¾, the location giving a local minimum will be between Xs and X*. In contrast, if the initial location is set to be one of X2, X3, or X4, the location giving a local minimum will be between X3 and X4, which gives the accurate global minimum Thus, referring back to FIG. 5, in a case when there is no set initial location, the method 500 evaluates the error function at every gridpoint in the coarse coordinate system to find a first gridpoint, which provides the global minimum, in step 540.
[0096] The error function E includes a term, the orientation vector n, which* at
540, may also be identified as follows:
where is a pseudo-inverse of and V includes pickups. In one
example, if the total number of antennas in the antenna assembly is nine,
is a nine by three matrix,
is a three by nine matrix, and V is a nine by one matrix.
Thus, B(a,b,c)"' -V results in a three by one matrix, which is a column vector representing an orientation matrix, n(a,b,c) at gridpoint (a,b,c) in the coarse coordinate system.
[0097] Based on equation (3), the error function is evaluated. Errors of all gridpoints in the coarse coordinate system are compared with each other, and the gridpoint that provides the smallest error is selected as a first gridpoint and is set as the initial location at 540. After the initial location is set at 540, 550 follows. Also, at 530, when it is determined that the initial location is set, the step 550 is performed.
[0098] At 550, a predetermined number of gridpoints around the initial location are selected to calculate the error function in the same way as in equation (2) or (3). For example, if the predetermined number of gridpoints is three, three gridpoints from the initial location in both directions along x, y, and z axes form a cube, 7 by 7 by 7 gridpoints. Thus, 343 gridpoints are selected to calculate the error function, and one among the selected gridpoints, which provides the smallest error, is selected as a second gridpoint, i.e., the location of the EM sensor. The corresponding orientation vector is also set as the orientation of the EM sensor in step 550. The second gridpoint is set as the initial location in step 560.
[0099] According to one aspect, in step 540, the error may be compared with a predetermined threshold. If the error is less than the predetermined threshold, that gridpoint is selected as the second gridpoint or the location of the EM sensor and corresponding orientation vector is selected as the orientation of the EM sensor.
[00100] In step 570, it is determined whether the target has been reached. When it is determined that the target has not been reached, steps 520-570 are repeated until the target is reached. Otherwise, the method 500 ends.
[00101] Turning now to FIG. 7, there is shown a block diagram of a computing device 700, which can be used as the computing device 120 of the EMN system 100, the tracking device 160, or a computer performing the method 400 of FIG. 4 or the method 500 of FIG. S. The computing device 700 may include a memory 702, a processor 704, a display 706, network interface 708, an input device 710, and/or output module 712.
[00102] The memory 702 includes any non-transitory computer-readable storage media for storing data and/or software that is executable by the processor 704 and which controls the operation of the computing device 700. In an embodiment, the memory 702 may include one or more solid-state storage devices such as flash memory chips. Alternatively or in addition to the one or more solid-state storage devices, the memory 702 may include one or more mass storage devices connected to the processor 704 through a mass storage controller (not shown) and a communications bus (not shown). Although the description of computer-readable media contained herein refers to a solid- state storage, it should be appreciated by those skilled in the art that computer-readable storage media can be any available media that can be accessed by the processor 704. That is, computer readable storage media include non-transitory, volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD- ROM, DVD, Blu-Ray or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computing device 700.
[00103] The memory 702 may store application 716 and data 714. The application 716 may, when executed by the processor 704, cause the display 706 to present user interface 718 on its screen.
[00104] The processor 704 may be a general purpose processor, a specialized graphic processing unit (GPU) configured to perform specific graphics processing tasks while freeing up the general purpose processor to perform other tasks, and/or any number or combination of such processors.
[00105] The display 706 may be touch-sensitive and/or voice-activated, enabling the display 706 to serve as both an input and output device. Alternatively, a keyboard (not shown), mouse (not shown), or other data input devices may be employed.
[00106] The network interface 708 may be configured to connect to a network such as a local area network (LAN) consisting of a wired network and/or a wireless network, a wide area network (WAN), a wireless mobile network, a Bluetooth network, and/or the internet For example, the computing device 700 may receive measurement data and variables, and perform the method 400 of FIG. 4 to generate a HD map. The computing device 700 may receive updates to its software, for example, application 716, via network interface 708. The computing device 700 may also display notifications on the display 706 that a software update is available.
[00107] In another aspect, the computing device 700 may receive computed tomographic (CT) image data of a patient from a server, for example, a hospital server, internet server, or other similar servers, for use during surgical ablation planning. Patient CT image data may also be provided to the computing device 700 via a removable memory.
[00108] Input device 710 may be any device by means of which a user may interact with the computing device 700, such as, for example, a mouse, keyboard, foot pedal, touch screen, and/or voice interface.
[00109] Output module 712 may include any connectivity port or bus, such as, for example, parallel ports, serial ports, universal serial busses (USB), or any other similar connectivity port known to those skilled in the art
[00110] The application 716 may be one or more software programs stored in the memory 702 and executed by the processor 704 of the computing device 700. During generation of the HD map, one or more software programs in the application 716 may be loaded from the memory 702 and executed by the processor 704 to generate the HD map. In an embodiment, during a navigation phase, one or more programs in the application 716 may be loaded, identify the location and the orientation of an EM sensor mounted on a medical device, and display the medical device at the location along the orientation on a screen overlaid with other imaging data, such as CT data or a three dimensional model of a patient. In another embodiment, during a treatment phase, one or more programs in the application 716 may guide a clinician through a series of steps to identify a target, size the target, size a treatment zone, and/or determine an access route to the target for later use during the procedure phase. In some other embodiments, one or more programs in the application 716 may be loaded on computing devices in an operating room or other facility where surgical procedures are performed, and is used as a plan or map to guide a clinician performing a surgical procedure by using the information regarding the location and the orientation.
[00111] The application 716 may be installed directly on the computing device 700, or may be installed on another computer, for example a central server, and opened on the computing device 700 via the network interlace 708. The application 716 may run
natively on the computing device 700, as a web-based application, or any other format known to those skilled in the art. In some embodiments, the application 716 will be a single software program having all of the features and functionality described in the present disclosure. In other embodiments, the application 716 may be two or more distinct software programs providing various parts of these features and functionality. For example, the application 716 may include one software program for generating a HD map, another one for identifying a location and an orientation, and a third program for navigation and treatment program. In such instances, the various software programs forming part of the application 716 may be enabled to communicate with each other and/or import and export various data including settings and parameters.
[00112] The application 716 may communicate with a user interface 718 which generates a user interface for presenting visual interactive features to a user, for example, on the display 706 and for receiving input, for example, via a user input device. For example, user interface 718 may generate a graphical user interface (GUI) and output the GUI to the display 706 for viewing by a user.
[00113] In a case that the computing device 700 may be used as the EMN system 100, the control workstation 102, or the tracking device 160, the computing device 700 may be linked to the display 130, thus enabling the computing device 700 to control the output on the display 130 along with the output on the display 706. The computing device 700 may control the display 130 to display output which is the same as or similar to the output displayed on the display 706. For example, the output on the display 706 may be mirrored on the display 130. Alternatively, the computing device 700 may control the display 130 to display different output from that displayed on the display 706. For example, the display 130 may be controlled to display guidance images and information during the surgical procedure, while the display 706 is controlled to display other output,
such as configuration or status information of an electrosurgical generator 101 as shown in FIG. 1.
[00114] The application 716 may include one software program for use during the planning phase, and a second software program for use during the treatment phase. In such instances, the various software programs forming part of application 716 may be enabled to communicate with each other and/or import and export various settings and parameters relating to the navigation and treatment and/or the patient to share information. For example, a treatment plan and any of its components generated by one software program during the planning phase may be stored and exported to be used by a second software program during the procedure phase.
[00115] Although embodiments have been described in detail with reference to the accompanying drawings for the purpose of illustration and description, it is to be understood that the inventive processes and apparatus are not to be construed as limited. It will be apparent to those of ordinary skill in the art that various modifications to the foregoing embodiments may be made without departing from the scope of the disclosure. For example, various steps of the methods described herein may be implemented concurrently and/or in an order different from the example order(s) described herein.
Claims (40)
1. A method for identifying at least one of a location or an orientation of an electromagnetic (EM) sensor navigated within an EM volume, the method comprising: retrieving, from a memory, a calculated EM field strength at each gridpoint of a second plurality of gridpoints of the EM volume;
generating an EM field by way of an antenna assembly;
receiving a measured EM field strength from the EM sensor,
identifying a first gridpoint among a first plurality of gridpoints of the EM volume based on the measured EM field strength and a high density (HD) map; and
identifying at least one of the location or the orientation of the EM sensor based on the HD map, using the first gridpoint as an initial condition,
wherein the second plurality of gridpoints includes the first plurality of gridpoints.
2. The method according to claim 1, wherein the antenna assembly includes at least six antennas, each of the antennas including a plurality of loops.
3. The method according to claim 2, wherein the plurality of loops has a geometric configuration.
4. The method according to claim 3, wherein the HD map includes a calculated EM field strength for each gridpoint of the second plurality of gridpoints in the EM volume.
5. The method according to claim 4, wherein the calculated EM field strength is based on the respective geometric configurations of the at least six antennas.
6. The method according to claim 4, wherein the HD map further includes a pseudo- inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
7. The method according to claim 1, wherein the identifying the first gridpoint includes: identifying an orientation vector where (a,b,c) is a gridpoint in the first
plurality of gridpoints, satisfying the following condition:
WHERE
is a pseudo-inverse of which is
a calculated EM field strength at gridpoint (a,b,c) in the HD map;
calculating a difference between and V; and
selecting, as the first gridpoint, a gridpoint (A,B,C) of the first plurality of gridpoints where a difference between and V is the smallest
8. The method according to claim 1, wherein the identifying at least one of the location or the orientation includes:
identifying an orientation vector where (d,e,f) is a gridpoint in the second
plurality of gridpoints and is located within a predetermined distance from the first gridpoint (A,B,C), satisfying the following condition:
is a pseudo-inverse of which is a
calculated EM field strength at gridpoint (d,e,f) in the HD map;
calculating a difference between and V; and
selecting a second gridpoint (D,E,F) from among the second plurality of gridpoints, where a difference between and V is the smallest.
9. The method according to claim 8, wherein is related to the orientation of the
EM sensor.
10. The method according to claim 9, wherein the second gridpoint (D,E,F) is the location of the EM sensor.
11. A system for identifying at least one of a location or an orientation of an electromagnetic (EM) sensor navigated within an EM volume, the system comprising: an antenna assembly configured to radiate an EM field within the EM volume; the EM sensor configured to measure an EM field strength based on the EM field; a processor, and
a memory storing a calculated EM field strength at each gridpoint of a second plurality of gridpoints of the EM volume, and storing processor-executable instructions that, when executed by the processor, cause the processor to:
retrieve, from the memory, the calculated EM field strength at each gridpoint of the second plurality of gridpoints;
identify a first gridpoint among a first plurality of gridpoints of the EM volume based on the measured EM field strength and the HD map; and
identifying at least one of the location or the orientation of the EM sensor based on the HD map, using the first gridpoint as an initial condition,
wherein the second plurality of gridpoints includes the first plurality of gridpoints.
12. The system according to claim 11, wherein the antenna assembly includes at least six antennas, each of the antennas including a plurality of loops.
13. The system according to claim 12, wherein the plurality of loops has a geometric configuration.
14. The system according to claim 13, wherein the HD map includes a calculated EM field strength at each gridpoint of the second plurality of gridpoints in the EM volume.
15. The system according to claim 14, wherein the calculated EM field strength is based on the respective geometric configurations of the at least six antennas.
16. The system according to claim 14, wherein the HD map further includes a pseudo- inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
17. The system according to claim 11, wherein the identifying the first gridpoint includes: identifying an orientation vector where (a,b,c) is a gridpoint in the first
plurality of gridpoints, satisfying the following condition:
where is a pseudo-inverse of which is
a calculated EM field strength at gridpoint (a,b,c) in the HD map;
calculating a difference between and V; and
selecting, as the first gridpoint, a gridpoint (A,B,C) of the first plurality of gridpoints where a difference between
and V is the smallest
18. The system according to claim 11, wherein the identifying at least one of the location or the orientation includes:
identifying an orientation vector where (d,e,f) is a gridpoint in the second
plurality of gridpoints and is located within a predetermined distance from the first gridpoint (A,B,C), satisfying the following condition:
where
is a pseudo-inverse of
which is a calculated EM field strength at gridpoint (d,e,f) in the HD map;
calculating a difference between and V; and
selecting a second gridpoint (D,E,F) from among the second plurality of gridpoints, where a difference between and V is the smallest.
19. The system according to claim 18, wherein np EiF) is related to the orientation of the EM sensor.
20. The system according to claim 19, wherein the second gridpoint (D,E,F) is the location of the EM sensor.
21. A method for generating a high density (HD) map for identifying at least one of a location or an orientation of an electromagnetic (EM) sensor within an EM volume in which an EM field is generated by way of an antenna assembly, the method comprising: receiving a measured EM field strength at each gridpoint of a first plurality of gridpoints of the EM volume from a measurement device;
calculating an EM field strength at each gridpoint of a second plurality of gridpoints of the EM volume based on a geometric configuration of an antenna of the antenna assembly; and
generating the HD map based on the measured EM field strength at each gridpoint of the first plurality of gridpoints and the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
22. The method according to claim 21, wherein the antenna assembly generates at least six EM waveforms as components of the EM field.
23. The method according to claim 22, wherein the EM field strength is calculated along a three axes coordinate system for each of the at least six EM waveforms.
24. The method according to claim 23, wherein the EM field strength is measured by way of a sensor having three coils corresponding to the three axes, respectively.
25. The method according to claim 21, wherein the second plurality of gridpoints includes each gridpoint of the first plurality of gridpoints.
26. The method according to claim 25, wherein the generating the HD map includes:
calculating an error between the measured EM field strength and the calculated EM field strength, at each gridpoint of the first plurality of gridpoints;
interpolating an error for each gridpoint of the second plurality of gridpoints based on the calculated error at each gridpoint of the first plurality of gridpoints; and
adding the interpolated error and the calculated EM field strength at each gridpoint of the second plurality of gridpoints to generate the HD map.
27. The method according to claim 26, wherein the error is calculated based on a difference between the measured EM field strength and the calculated EM field strength at each gridpoint of the first plurality of gridpoints.
28. The method according to claim 26, wherein the error is based on at least one of an LI or L2 norm of differences between the measured EM field strength and the calculated EM field strength along the three axes.
29. The method according to claim 21, further comprising calculating a pseudo-inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
30. The method according to claim 29, wherein the HD map further includes the pseudo- inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
31. An apparatus for generating a high density (HD) map for identifying at least one of a location or an orientation of an electromagnetic (EM) sensor within an EM volume in which an EM field is generated by way of an antenna assembly, the apparatus comprising:
a processor, and
a memory storing processor-executable instructions that, when executed by the processor, cause the processor to:
receive a measured EM field strength at each gridpoint of a first plurality of gridpoints of the EM volume from a measurement device;
calculate an EM field strength at each gridpoint of a second plurality of gridpoints of the EM volume based on a geometric configuration of an antenna of the antenna assembly; and
generate the HD map based on the measured EM field strength at each gridpoint of the first plurality of gridpoints and the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
32. The apparatus according to claim 31, wherein the antenna assembly generates at least six EM waveforms as components of the EM field.
33. The apparatus according to claim 32, wherein the EM field strength is calculated along a three axes coordinate system for each of the at least six EM waveforms.
34. The apparatus according to claim 33, wherein the EM field strength is measured with a sensor having three coils corresponding to the three axes, respectively.
35. The apparatus according to claim 31, wherein the second plurality of gridpoints includes each gridpoint of the first plurality of gridpoints.
36. The apparatus according to claim 35, wherein generating the HD map includes:
calculating an error between the measured EM field strength and the calculated EM field strength, at each gridpoint of the first plurality of gridpoints;
interpolating an error for each gridpoint of the second plurality of gridpoints based on the calculated error at each gridpoint of the first plurality of gridpoint; and
adding the interpolated error and the calculated EM field strength at each gridpoint of the second plurality of gridpoints to generate the HD map.
37. The apparatus according to claim 36, wherein the error is calculated based on a difference between the measured EM field strength and the calculated EM field strength at each gridpoint of the first plurality of gridpoints.
38. The apparatus according to claim 36, wherein the error is at least one of an LI or L2 norm of differences between the measured EM field strength and the calculated EM field strength along the three axes.
39. The apparatus according to claim 31, wherein the memory further stores instructions that, when executed by the processor, cause the processor to calculate a pseudo-inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
40. The apparatus according to claim 39, wherein the HD map further includes the pseudo-inverse of the calculated EM field strength at each gridpoint of the second plurality of gridpoints.
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/337,129 US10751126B2 (en) | 2016-10-28 | 2016-10-28 | System and method for generating a map for electromagnetic navigation |
US15/337,129 | 2016-10-28 | ||
US15/337,166 US10722311B2 (en) | 2016-10-28 | 2016-10-28 | System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map |
US15/337,166 | 2016-10-28 | ||
PCT/US2017/058421 WO2018081356A1 (en) | 2016-10-28 | 2017-10-26 | System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map |
Publications (2)
Publication Number | Publication Date |
---|---|
AU2017348161A1 AU2017348161A1 (en) | 2019-05-02 |
AU2017348161B2 true AU2017348161B2 (en) | 2022-06-30 |
Family
ID=62025430
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
AU2017348161A Ceased AU2017348161B2 (en) | 2016-10-28 | 2017-10-26 | System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map |
Country Status (6)
Country | Link |
---|---|
EP (1) | EP3531950A4 (en) |
JP (1) | JP7035043B2 (en) |
CN (1) | CN109890312B (en) |
AU (1) | AU2017348161B2 (en) |
CA (1) | CA3040718A1 (en) |
WO (1) | WO2018081356A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11944388B2 (en) | 2018-09-28 | 2024-04-02 | Covidien Lp | Systems and methods for magnetic interference correction |
US20200100843A1 (en) * | 2018-09-28 | 2020-04-02 | Covidien Lp | Smart extended working channel localization |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5307072A (en) * | 1992-07-09 | 1994-04-26 | Polhemus Incorporated | Non-concentricity compensation in position and orientation measurement systems |
WO1997042517A1 (en) * | 1996-05-06 | 1997-11-13 | Biosense Inc. | Radiator calibration |
US20040102696A1 (en) * | 2002-11-22 | 2004-05-27 | Assaf Govari | Dynamic metal immunity |
US9675424B2 (en) * | 2001-06-04 | 2017-06-13 | Surgical Navigation Technologies, Inc. | Method for calibrating a navigation system |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3168495B2 (en) * | 1993-09-22 | 2001-05-21 | 株式会社日立製作所 | Vibration detection device and abnormality diagnosis system |
US6593884B1 (en) | 1998-08-02 | 2003-07-15 | Super Dimension Ltd. | Intrabody navigation system for medical applications |
US6233310B1 (en) * | 1999-07-12 | 2001-05-15 | General Electric Company | Exposure management and control system and method |
US6484118B1 (en) * | 2000-07-20 | 2002-11-19 | Biosense, Inc. | Electromagnetic position single axis system |
US6774624B2 (en) | 2002-03-27 | 2004-08-10 | Ge Medical Systems Global Technology Company, Llc | Magnetic tracking system |
CN100515332C (en) * | 2004-02-18 | 2009-07-22 | 皇家飞利浦电子股份有限公司 | Device and method for the determination of the position of a catheter in a vascular system |
JP4396508B2 (en) | 2004-12-15 | 2010-01-13 | 株式会社島津製作所 | Magnetic mapping evaluation system |
US7892165B2 (en) * | 2006-10-23 | 2011-02-22 | Hoya Corporation | Camera calibration for endoscope navigation system |
US20080183064A1 (en) | 2007-01-30 | 2008-07-31 | General Electric Company | Multi-sensor distortion detection method and system |
US20080249395A1 (en) * | 2007-04-06 | 2008-10-09 | Yehoshua Shachar | Method and apparatus for controlling catheter positioning and orientation |
JP5243750B2 (en) * | 2007-08-09 | 2013-07-24 | オリンパスメディカルシステムズ株式会社 | Medical device guidance system, operating method, and method for creating a lookup table for use in medical device guidance system |
WO2011110966A2 (en) * | 2010-03-11 | 2011-09-15 | Koninklijke Philips Electronics N.V. | Method and system for characterizing and visualizing electromagnetic tracking errors |
DK2939601T3 (en) * | 2011-09-06 | 2019-02-25 | Ezono Ag | Magnetic medical equipment |
US9649046B2 (en) | 2014-08-12 | 2017-05-16 | Biosense Webster (Israel) Ltd | Line of block detection |
US20160174873A1 (en) | 2014-12-22 | 2016-06-23 | Covidien Lp | Medical instrument with sensor for use in a system and method for electromagnetic navigation |
CN104983386B (en) * | 2015-05-21 | 2017-01-04 | 大连理工大学 | The linear polarization method for correcting phase of space universal rotary magnetic field azimuthal error |
-
2017
- 2017-10-26 AU AU2017348161A patent/AU2017348161B2/en not_active Ceased
- 2017-10-26 JP JP2019523099A patent/JP7035043B2/en active Active
- 2017-10-26 EP EP17863634.6A patent/EP3531950A4/en active Pending
- 2017-10-26 CN CN201780066962.9A patent/CN109890312B/en active Active
- 2017-10-26 WO PCT/US2017/058421 patent/WO2018081356A1/en unknown
- 2017-10-26 CA CA3040718A patent/CA3040718A1/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5307072A (en) * | 1992-07-09 | 1994-04-26 | Polhemus Incorporated | Non-concentricity compensation in position and orientation measurement systems |
WO1997042517A1 (en) * | 1996-05-06 | 1997-11-13 | Biosense Inc. | Radiator calibration |
US9675424B2 (en) * | 2001-06-04 | 2017-06-13 | Surgical Navigation Technologies, Inc. | Method for calibrating a navigation system |
US20040102696A1 (en) * | 2002-11-22 | 2004-05-27 | Assaf Govari | Dynamic metal immunity |
Also Published As
Publication number | Publication date |
---|---|
JP7035043B2 (en) | 2022-03-14 |
WO2018081356A1 (en) | 2018-05-03 |
CN109890312B (en) | 2022-04-01 |
AU2017348161A1 (en) | 2019-05-02 |
CN109890312A (en) | 2019-06-14 |
JP2020503082A (en) | 2020-01-30 |
CA3040718A1 (en) | 2018-05-03 |
EP3531950A1 (en) | 2019-09-04 |
EP3531950A4 (en) | 2020-05-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11672604B2 (en) | System and method for generating a map for electromagnetic navigation | |
US11759264B2 (en) | System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map | |
US11819285B2 (en) | Magnetic interference detection systems and methods | |
US11712171B2 (en) | Electromagnetic dynamic registration for device navigation | |
US11944389B2 (en) | Impedance shift and drift detection and correction | |
US10588541B2 (en) | Magnetic tracker system and method for use for surgical navigation | |
CN103189013A (en) | Error correction techniques in surgical navigation | |
US11918334B2 (en) | Impedance transformation model for estimating catheter locations | |
US11786314B2 (en) | System for calibrating an electromagnetic navigation system | |
AU2017348161B2 (en) | System and method for identifying a location and/or an orientation of an electromagnetic sensor based on a map | |
EP3673793A1 (en) | Generation of an ultra-high definition map of electromagnetic fields | |
US20240245470A1 (en) | Systems and methods for magnetic interference correction |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FGA | Letters patent sealed or granted (standard patent) | ||
MK14 | Patent ceased section 143(a) (annual fees not paid) or expired |