SYSTEMS, METHODS, AND DEVICES FOR REGISTERING AND TRACKING ORGANS DURING INTERVENTIONAL PROCEDURES

Abstract

Systems, methods, and devices are provided for assisting or performing guided interventional procedures using specialized catheters and inserts. A bend altering device is introduced into a conduit in an organ causing it to take on a tortuous path and to assist in its visualization. A scan is performed of a patient's anatomy to identify targets critical structures and the path of the conduit. A bend altering device containing position indicating elements is placed into the conduit in the same path as before the scan. During a procedure, the pre-procedure scans may be registered to the patient using the location of the position indicating elements in the conduit. This registration may be used in an intervention to guide instruments and templates to obtain diagnostic information or provide therapy to the targets identified in the scans.

Claims

1. A device comprising: a catheter, one or more elements visible to a position sensor modality, and one or more removable pre-shaped shafts, wherein the one or more pre-shaped shafts: contain an intrinsic deformation along its length that it is different than that of the catheter; are capable of at least partly imparting a deformation along the length of the catheter; and contain a hub that indicates the axial orientation of the one or more pre-shaped shafts; and wherein the catheter: contains a lumen to facilitate the removable insertion of the one or more pre-shaped shafts; contains an orientation feature to indicate the axial rotation of the catheter; and wherein the one or more pre-shaped shafts is inserted into the lumen of the catheter and fixed to the catheter to induce a bend therein.

2. The device of claim 1, wherein the catheter is a Foley catheter.

3. The device of claim 1, wherein the one or more pre-shaped shafts contains the one or more elements visible to a position sensor modality.

4. The device of claim 1, wherein the one or more elements visible to a position sensor modality include one or more of position indicating elements, fiducials, or a contrast agent that is visible to the position sensing modality.

5. The device of claim 1, wherein the one or more removable pre-shaped shafts contains a feature rendering its path or parts of its path visible under an imaging modality.

6. The device of claim 5, wherein the feature rendering the path visible is one of one or more fiducials, contrast filled regions, reflectors, or emitters.

7. The device of claim 4, wherein the one or more position indicating elements is an electromagnetic sensor.

8. The device of claim 1, wherein the catheter contains a depth feature that enables the insertion depth in the patient to be recorded.

9. The device of claim 1, wherein the catheter contains the one or more elements visible to a position sensor modality.

10. The device of claim 1 wherein the catheter contains a feature rendering its path or parts of its path visible under an imaging modality.

11. A method of performing a guided interventional medical procedure using a bend altering device, the method comprising: obtaining at least one medical image of a patient's anatomy; identifying a location of at least one target in the at least one medical image, wherein the at least one target comprises at least a portion of an organ identifiable in the at least one medical image that is involved in the guided interventional medical procedure; determining a path of at least one conduit in the patient on the at least one medical image in image space, wherein the path of the at least one conduit in image space is expressed in a coordinate system of the at least one medical image of the patient anatomy; inserting a bend altering device into the conduit; determining a path of the at least one conduit in the patient in patient space, wherein the path of the at least one conduit in patient space is expressed based on a coordinate system of a tracking device; registering the path of the conduit in image space to patient space by mapping the path of the conduit in image space to the path of the conduit in patent space; positioning a template near the organ involved in the guided interventional medical procedure; determining a position and orientation of the template in patient space; transforming the position and orientation of the template in patient space to a position and orientation of the template in image space based on the registration; adjusting the position and orientation of the template to ensure a path aligned with at least one channel of the template intersects the at least one target; and placing at least one instrument through the at least one channel in order to provide therapy to or receive diagnostic information related to the at least one target.

12. The method of claim 11, wherein the bend altering device is a catheter

13. The method of claim 12, wherein the catheter contains an intrinsic bend.

14. The method of claim 11, wherein the bend altering device is a bend-inducing structure, and the method further comprises: removably inserting the bend-inducing structure into the conduit.

15. The method of claim 12, further comprising: removably inserting the bend altering device into the catheter.

16. The method of claim 14, wherein the bend inducing structure contains position indicating elements.

17. The method of claim 12, wherein the catheter contains position indicating elements.

18. A method of performing a guided interventional medical procedure using a bend altering device, the method comprising: inserting a first bend altering device into at least one conduit of a patient; obtaining at least one medical image of a patient's anatomy with the bend altering device inserted into the at least one conduit of the patient; identifying a location of at least one target in the at least one medical image, wherein the at least one target comprises at least a portion of an organ identifiable in the at least one medical image that is involved in the guided interventional medical procedure; determining a path of the at least one conduit in the patient on the at least one medical image in image space, wherein the path of the at least one conduit in image space is expressed based on a coordinate system of imaged data, wherein the imaged data is obtained from the at least one medical image; inserting a second bend altering device into the at least one conduit; determining a path of the at least one conduit in the patient in patient space, wherein the path of the at least one conduit in patient space is expressed based on a coordinate system of a tracking device; registering the path of the at least one conduit in image space to patient space by mapping the path of the at least one conduit in image space to the path of the at least one conduit in patent space; positioning a template near the organ involved in the guided interventional medical procedure; determining a position and orientation of the template in patient space; transforming the position and orientation of the template in patient space to a position and orientation of the template in image space based on the registration; adjusting the position and orientation of the template to ensure a path aligned with at least one channel of the template intersects the at least one target; and placing at least one instrument through the at least one channel in order to provide therapy to or receive diagnostic information related to the at least one target.

19. The method of claim 18, wherein the first bend altering device contains fiducials, contrast filled regions, reflectors, or emitters.

20. The method of claim 18, wherein the second bend altering device contains position indicating elements.

21. The method of claim 18, wherein the first or second bend altering device is composed of a catheter and a bend inducing structure that is permanently contained within the catheter.

22. The method of claim 18, wherein the first or second bend altering device is composed of a catheter and a bend inducing structure that is removably inserted into the catheter.

23. The method of claim 18, further comprising: prior to obtaining the at least one medical image of the patient's anatomy, placing an imaging catheter into the at least one conduit.

24. The method of claim 18, wherein an axial position of the second bend inducing structure is the same as an axial position of the first bend inducing structure.

25. The method of claim 23, wherein the imaging catheter contains fiducials, contrast filled regions, reflectors, or emitters that render the imaging catheter visible under imaging.

26. The method of claim 20, further comprising: confirming the accuracy of the registration prior to performing any intervention.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0070] FIG. 1 depicts needles targeted toward a suspected lesion in an organ, including a needle that traverses a sensitive structure.

[0071] FIG. 2 illustrates a prior art system in which an ultrasound equipped with position indicating elements is used together with a needle containing a position indicating element to place a needle in a patient's anatomy.

[0072] FIG. 3 is a schematic view of an example system for assisting or performing guided interventional procedures, in accordance with one or more implementations of the invention.

[0073] FIG. 4 is an example schematic representation of a template, in accordance with one or more implementations of the invention.

[0074] FIG. 5 is an example schematic representation of a template composed of tubes, in accordance with one or more implementations of the invention.

[0075] FIG. 6 is a schematic representation of a template with a position indicating element and fiducials attached, in accordance with one or more implementations of the invention.

[0076] FIG. 7 is an example depiction of a template composed of a single tracked needle, in accordance with one or more implementations of the invention.

[0077] FIG. 8 is an example depiction of a guided interventional procedure, in accordance with one or more implementations of the invention.

[0078] FIG. 9 is an example depiction of a catheter including a position-indicating element that can be used to track motion of a tissue or organ, in accordance with one or more implementations of the invention.

[0079] FIG. 10 is an example depiction of a segmented lumen and skeletonized path of its centerline, in accordance with one or more implementations of the invention.

[0080] FIG. 11 depicts a urethra and position indicating elements inside a catheter placed in the urethra, in accordance with one or more implementations of the invention.

[0081] FIG. 12 depicts an example in which position indicating element locations are not known in an image space, in accordance with one or more implementations of the invention.

[0082] FIG. 13a and FIG. 13b depicts an example image of the potential location of a prostate gland, in accordance with one or more implementations of the invention.

[0083] FIG. 14 depicts an example flowchart of the operations required to correct the location of anatomy using live imaging or a check fiducial, in accordance with one or more implementations of the invention.

[0084] FIG. 15 depicts an example flowchart of the operations required to perform interventions such as therapeutic or diagnostic procedures using the techniques described herein, in accordance with one or more implementations of the invention.

[0085] FIG. 16 depicts an example of a pre-shaped shaft.

[0086] FIG. 17 illustrates the use of the pre-shaped shaft together with a Foley catheter.

[0087] FIG. 18 is a depiction of a pre-shaped shaft containing embedded position indicating elements.

[0088] FIG. 19 is an example flowchart of the operations required to perform interventions such as therapeutic or diagnostic procedures using the techniques described herein, in accordance with one or more implementations of the invention.

DETAILED DESCRIPTION OF THE INVENTION

[0089] Described herein are systems, methods, and devices for assisting or performing guided interventional procedures using templates for the purpose of, among other things, marking or annotating regions, providing therapy to a region, sampling an aspect of a region, or cutting or manipulating a region.

[0090] Examples of guided interventional procedures may include, but are not limited to, procedures such as surgical resections, biopsies, full or focal ablation of a tumor or tissue, injection of an agent such as a drug, placement of fiducials, placement of brachytherapy seeds, directing a radiation beam, marking or resection of the skin in preparation for a surgical procedure, marking or resection of an aspect of anatomy that is either a target or a critical location that must be avoided, placing monitoring sensors such as temperature sensors, placing stabilizing instruments, placement of devices such as stents or stent grafts, and placement of cardiac valves or other such devices. Guided interventional procedures may also include marking and manipulation of tissues or fragments thereof.

[0091] Guided interventional procedures may further make use of therapeutic devices such as, for example, needles, ablation needles, radiofrequency ablation needles, lasers and laser delivery systems, blades, cryoablation needles, microwave ablation needles, irreversible electroporation (IRE) probes, HIFU delivery systems, cutting devices such as scalpels or electrocautery devices, and radiation delivery devices, as well as various other therapeutic devices. Such procedures may also make use of monitoring probes for measuring temperature or dose. Such procedures may further make use of probes that perform a protective function such as cooling an area that is adjacent to a region that is being ablated using heat.

[0092] Example System Configuration

[0093] FIG. 3 is a schematic view of an example (and non-limiting) system 300 for assisting or performing guided interventional procedures using templates, in accordance with one or more implementations of the invention. System 300 may include a computer device 301, a tracking device 302, an imaging device 303, a template assembly 312, one or more surgical device or surgical device assemblies 314, a dynamic reference device 315, a registration device 316, and/or other components.

[0094] Computer Device 301

[0095] Computer device 301 may be or include one or more servers, personal computers, portable (e.g., laptop) computers, mobile computers, tablet computers, cell phones, smart phones, PDAs, or other computer devices. Computer device 301 may send, receive, store, or manipulate data necessary to perform any of the processes, calculations, image formatting, image display, or other processing operations described herein. Computer device 301 may also perform any processes, calculations, or processing operations necessary for the function of the devices, instruments, or other system components described herein.

[0096] Computer device 301 may include one or more processor(s) 304, one or more storage device(s) 305, a power source 306, a control application 307 comprising computer program instructions, one or more inputs/outputs 309a-309n, at least one display device 310, one or more user input devices 311, or other components.

[0097] Processor(s) 304 may include one or more physical processors that are programmed by computer program instructions that enable various features and functionality described herein. For example, processor(s) 304 may be programmed by control application 307 (described below) and/or other instructions.

[0098] Computer 301 may be connected to other computer devices and/or other system components via a network or one or more wired or wireless connections to connect to the Internet, an intranet, another computer, a server, a client, a host, a virtualization platform, a PAN (Personal Area Network), a LAN (Local Area Network), a WAN (Wide Area Network), a SAN (Storage Area Network), a MAN (Metropolitan Area Network), a data center, or other computer resources.

[0099] Storage device 305 may comprise random access memory (RAM), read only memory (ROM), and/or other memory. The storage device may store the computer program instructions to be executed by processor(s) 304 as well as data that may be manipulated by processor(s) 304. Storage device 305 may also comprise floppy disks, hard disks, USB drives, solid state drives (SSD), optical disks, tapes, or other storage media for storing computer-executable instructions and/or data. Storage devices may also include cloud storage or off-site storage on a remote server or database.

[0100] Display device 310 may comprise a computer monitor or other visual display device such as, for example, an LCD display, an LED LCD display, an OLED display, a plasma screen display, a cathode ray tube display, or other display device.

[0101] Input device 311 may comprise a mouse, a stylus, a keyboard, a touchscreen interface (which may be associated or integrated with display device 310), a voice-activated input device (e.g., including a microphone and/or associated voice processing software), or other device that enables a user (e.g., a physician performing a procedure, an assistant thereto, or other user) to provide input to computer device 301 and/or other components of system 300. One or more input devices 311 may be utilized. In one implementation, display device 310 and input device 311 may together be configured as a mobile computing platform such as a tablet computer that is connected wirelessly to computer 301. Other configurations may be implemented.

[0102] Inputs/outputs 309a-309n enable various system components such as tracking device 302, imaging device 303, template assembly 312, one or more surgical device or surgical device assemblies 314, dynamic reference device 315, a registration device 316, and/or other components to communicate with computer device 301 (e.g., in a wired or wireless manner) as known and understood by those having skill in the art.

[0103] Computer device 301 may further be operatively connected (e.g., via the aforementioned network) to one or more databases. A database may be, include, or interface to, for example, an Oracle™ relational database sold commercially by Oracle Corporation. Other databases, such as Informix™, DB2 (Database 2) or other data storage, including file-based, or query formats, platforms, or resources such as OLAP (On Line Analytical Processing), SQL (Structured Query Language), a SAN, Microsoft Access™ or others may also be used, incorporated, or accessed. The database may comprise one or more such databases that reside in one or more physical devices and in one or more physical locations. The database may store a plurality of types of data and/or files and associated data or file descriptions, administrative information, or any other data, as described herein.

[0104] Tracking Device 302

[0105] In some implementations, tracking device 302 may be used. Tracking device 302 may comprise, for example, an electromagnetic tracker, an optical tracker, a GPS tracker, an acoustic tracker, a fiber optic tracker, a capacitive, a mechanical tracking system, or other tracking device.

[0106] Imaging Device 303

[0107] Imaging device 303 may include X-ray equipment, computerized tomography equipment, positron emission tomography equipment, magnetic resonance imaging equipment, fluoroscopy equipment, ultrasound equipment, an isocentric fluoroscopic device, a rotational fluoroscopic reconstruction system (e.g., CBCT), a multi-slice computerized tomography device, an intravascular ultrasound imager, an optical coherence tomography (OCT) device, an optical imaging device, a single photon emission computed tomography device, a magnetic particle imaging device, or other imaging/scanning equipment.

[0108] In some implementations, imaging device 303 may include one or more devices so that its location and orientation may be tracked by tracking device 302. For example, an ultrasound device may include a position-indicating element enabling its scan plane to be known as shown in FIG. 2. Similarly, a fluoroscope may include a tracking target such as that described in U.S. Pat. No. 8,046,052 to Verard et al., and illustrated in U.S. Design Pat. No. D466,609 to Glossop, each of which is hereby incorporated herein by reference in their entirety.

[0109] Template Assembly 312

[0110] According to an aspect of the invention, template assembly 312 may comprise a template (also referred to as a targeting template or guide) and a position-indicating element or template tracker 313, which may be attached (permanently or removably) to the template or to a frame that surrounds (or encompasses) all or a portion of the template.

[0111] Template tracker 313 may comprise a mechanical encoder, or an optical, electromagnetic, optical fiber, and/or other tracker (described in greater detail below) that can be tracked by tracking device 302.

[0112] Further, although not illustrated in FIG. 3, the template assembly may further comprise a support mechanism or structure used to support and/or position the template assembly vis-à-vis a target (e.g., a patient's anatomy). The support mechanism may comprise dials or other controls to adjust and fine tune the position of the template. Examples of a support mechanism may include a Biojet (D&K Technologies GmbH, Barum Germany) or the Multi-purpose Workstation LP (Civco Inc., Coralville, Iowa) that may include motors and/or encoders. In one implementation, the template assembly may be supported and/or moved into position in an automated manner using a robotic mechanism attached to the support mechanism. In an implementation, the template assembly may be the gantry of an external beam radiotherapy (EBRT) machine or HIFU system.

[0113] Surgical Devices or Device Assemblies 314

[0114] In some implementations, system 300 may include one or more surgical devices or device assemblies 314, the position and orientation of which may be tracked by tracking device 302 or be untracked and used together with template 312. Examples of surgical devices may include therapeutic devices such as needles, ablation needles, radiofrequency ablation needles, lasers and laser delivery systems, blades, electrocautery devices, cryoablation needles, microwave ablation needles, HIFU delivery systems, radiation delivery devices, and/or other therapeutic devices. Monitoring probes for measuring temperature or dose, etc. may also be used along with probes that perform a protective function such as displacing, immobilizing, and/or cooling an area that is adjacent to a region that is being ablated using heat. In some implementations, needles may further serve as elements that also restrain the anatomy from motion.

[0115] Dynamic Reference Device 315

[0116] In one implementation, system 300 may include a dynamic reference device 315 capable of tracking a patient's anatomy. Examples of dynamic reference device 315 may include, but are not limited to, a tracked Foley catheter, a multi-function device (e.g., as described in U.S. Pat. No. 7,751,868 to Glossop, which is hereby incorporated by reference herein in its entirety), a tracked needle, a K-wire (e.g., as described in U.S. Pat. No. 7,840,254 to Glossop which is hereby incorporated by reference herein in its entirety), and/or other type of dynamic reference device.

[0117] Registration Device 316

[0118] In an implementation, system 300 may include a registration device 316, such as a probe, a catheter, fiducials, a tracked ultrasound, a multifunction device (such as described in U.S. Pat. No. 7,751,868), and/or other type of registration device.

[0119] Control Application 307

[0120] As previously noted, computer device 301 may host control application 307. Control application 307 may comprise a computer software application that includes instructions that program processor(s) 304 (and therefore computer device 301) to perform various processing operations.

[0121] In one implementation of the invention, control application 307 may cause computer device 301 to send, receive, and/or manipulate data regarding the anatomy of a patient, one or more objects, or other data. This data may be stored in memory device 305, or in another data storage location (e.g., the one or more databases described above). In some implementations, computer device 301 may receive live data (in real-time), or stored data. Computer device 301 may send, receive, and/or manipulate data regarding the location, position, orientation, or coordinate(s) of a position indicating element (e.g., sensor coils or other position indicating elements), or one or more other elements, received by tracking device 302. This data may also be stored in memory device 305 or in another data storage location (e.g., the one or more databases described above).

[0122] Control application 307 may further cause computer device 301 to produce, format, reformat, or otherwise manipulate one or more images, position/orientation/location data, or other data. Images may be displayed on display device 310. In some implementations, one or more live images may be displayed. Display device 310 may further display (or otherwise convey) audio data in addition to, or instead of, visual data. Such an audio display may produce tones or other indicators regarding the system.

[0123] Control application 307 may additionally cause computer device 301 to generate and display images of the anatomy of a patient along with the position or orientation of an instrument, fiducials, or both (or other information) superimposed thereon in real-time such that motion of the tracked instrument within the anatomy of the patient is indicated on the superimposed images for use in an image-guided procedure.

[0124] In some implementations, indicators (e.g., markings, lines, circles, spheres, letters, numbers or other indicators) may be produced on an image of the anatomy of a patient. These indicators may mark or identify features such as the boundaries of another image stored in memory device 305.

[0125] In some implementations, control application 307 may facilitate mapping of a target lesion (e.g., a cancerous region) or other portion of a patient's anatomy, or other operations related to a map of the target lesion or portion of the patient's anatomy. For example, control application 307 may generate and display (e.g., on display device 310) the position of a targeting template relative to a location in a target lesion, a projected path (of the target paths of the targeting template) including a path a needle or other instrument inserted into a hole of the targeting template will follow if the needle or instrument is extended past a distal end portion of the template. Control application 307 may additionally generate and display (e.g., on display device 310) a point at which a needle or other instrument placed in a hole of the template will intersect a target lesion if the projected path of the needle or instrument intersects the determined path of the target lesion, as well as an indicator of the closest approach from a needle or other instrument passing through a hole in the template to the target lesion if the projected path of the needle or instrument does not intersect tissue not intended to be treated or biopsied. Additional displays may be presented.

[0126] The foregoing system architecture is an example only, and should not be viewed as limiting. The invention described herein may work with various system configurations. Accordingly, more or less of the aforementioned system components may be used and/or combined in various implementations. For example, in FIG. 3, as well as in other drawing Figures, different numbers of entities than those depicted may be used.

[0127] Templates

[0128] FIG. 4 is an example depiction of a template 400 (which may also be referred to interchangeably herein as a “targeting template” or “guide”), in accordance with one or more implementations of the invention.

[0129] In one implementation, template 400 may comprise a solid block of biocompatible material such as, for example, glass, stainless steel, titanium, plastics such as polycarbonate, Delrin, polyethylene, polyetheretherketone (PEEK), ethylene vinyl acetate, polyphenylsulfone (PPSU), polysulfone (PSU), acrylonitrile butadiene styrene (ABS), or other material. In some implementations, template 401 need not comprise a biocompatible material if it is suitably draped (or otherwise covered) in a sterile barrier material. Although depicted as a square in FIG. 4, template 400 may have any shape. Template 400 may also comprise a curved or contoured structure. Template 400 may also be composed of two or more sheets separated by a spacer. For example, template 400 may be composed of two or more sheets separated by a spacer, as described in U.S. Pat. No. 10,265,137, which is hereby incorporated by reference in its entirety.

[0130] As shown in FIG. 4, template 400 may comprise one or more guide elements 402 that extend through the body of template 400. For ease of explanation, a guide element 402 may be referred to throughout this detailed description as a “hole.” It should be appreciated, however, that other similar descriptors may be used in lieu of “guide element” including, but not limited to, a trajectory, passage, lumen, or channel. Further, as used herein, a pair of holes (or openings) may be described as defining an instrument trajectory or channel. For example, a first channel that enables passage of a first medical device through a body of template 400 may be defined by a first channel opening (or entrance or hole) on a first side of the template body and a corresponding first channel opening (or exit or hole) on a second side of the body of template 400. Likewise, a second channel that enables passage of a second medical device through the body of template 400 may be defined by a second channel opening (or entrance or hole) on the first side of the template body and a corresponding second channel opening (or exit or hole) on the second side of the body of template 400, and so on. In some implementations, template 400 may have multiple channels for enabling passage of multiple medical devices through the template body.

[0131] In some implementations, a template may be custom made for each procedure or pre-formed. Pre-formed template holes may be arranged in a rectangular grid, a concentric series of circles, a single or group of tubes, and/or other configuration. Predrilled holes may be of different diameters. Holes in the template grid may also be labelled so that it is possible to uniquely address an individual hole using these labels to describe them. For example, in a rectangular grid, rows might be labelled by numbers and columns by letters so that the combination of a letter and number will correspond to a particular hole.

[0132] In some implementations, one or more of holes 402 may be used for different purposes. For example, some holes may comprise defined instrument trajectories, such that needle-like instruments passing through template 400 would follow the trajectory of the holes 402. Some holes may be used for therapy devices, such as thermal ablation instruments, while adjacent holes may be used for placing devices for monitoring temperature (such as thermocouples), or even warming or cooling devices to protect sensitive tissue from thermal damage. Still other holes may be used to inject therapeutic agents and/or other compounds or articles. Although described and illustrated as holes for ease of reference, trajectories (or passages or channels) 402 may have any cross-section (e.g., linear shapes such as 404 allowing passage of blades or other planar instruments).

[0133] One or more holes 402 may be placed into template 400 at various orientations. In one implementation, the holes 402 may be created using a Computer Numerical Control (CNC) drilling or milling machine. Alternatively, the holes may be made using electrical discharge machining or any other type of technology designed to bore or create holes. In one implementation, template 400 and holes 402 may be created using an additive technology such as a three-dimensional (3D) printing system of which multiple technologies exist.

[0134] In an implementation, template 400 may further comprise one or more locating features 403 such as channels, divots, holes, and/or other types of locating features. Locating features 403 may be used to position template 400, or assist in mounting items to template 400. Registration features such as fiducial features 405 may also be present.

[0135] Template 400 may also be constructed as indicated in FIG. 5 (i.e., as groups of tubes joined together 501) in which the holes are the lumens of the tubes together forming a template here depicted as item 500. In a simpler form, a template consisting of a single tube may be used to allow passage of instruments to the target.

[0136] FIG. 6 is a schematic representation of a template 600 with a position-indicating element 601 and one or more fiducial features 602 attached, in accordance with one or more implementations of the invention. Position-indicating element 601 may be permanently affixed to (or integrated into) template 600. Alternatively, position-indicating element 601 may be removable and replaceable in the same position on template 600. Further, position-indicating element 601 may be permanently affixed (or releasably coupled) to a frame assembly that surrounds (or encompasses) all or a portion of template 600. In various implementations, the location and orientation of instrument passages 603 are known relative to position indicating element 601, such that when position indicating element 601 is located using the position sensor, so too are instrument passages 603.

[0137] In an implementation shown in FIG. 7, a template in the form of one or more tubes may be equipped with an attached position indicating element such as an LED array, electromagnetic sensor or FBG sensor. This enables the position indicating element to help locate the entry point and orientation of the one or more tubes. FIG. 2 showed a position indicating element 202 embedded within a tube. FIG. 7 depicts a schematic representation of a template composed of a single tube with an integrated position indicating element exterior to the tube further illustrating the concept of tube tracking. Here, the tracker is a coil winding 701 around the outside of tube 702 capable of being tracked by an electromagnetic position sensing system. The coil winding 701 may be connected to plug 703 by lead-wires 704 and cable 705. Template 700 (a “tracked cannula”) may contain a hub 706 attached to tube 702. It may include a sharp tip 707 so that it may be introduced through tissue.

[0138] Tube 702 may contain one or more layers of insulation to prevent shorting and to ensure that surfaces touching the patient are biocompatible and to provide electrical resistance. Layers may include polymers such as polyimide, PTFE (polytetrafluoroethylene), polyester, FEP (Fluorinated Ethylene Propylene), silicone, poly (p-xylylene) polymers, PEEK (Polyetheretherketone), Acrylated Olefin, Tygon, and/or other polymers. Several types and layers of insulation materials may be used in a single device.

[0139] In addition, tube 702 itself may be manufactured from a grade of stainless steel, titanium, plastic, or other material that is compatible with the position indicating element, the precise application, and other aspects critical to it use and environment of use. If the tracked cannula contains a tracking attachment, it may be integrated or removable, reusable or single use.

[0140] In an implementation, tube templates may be positioned by removably placing a stylette needle containing a sensor (such as item 202 that was described with reference to FIG. 2) into one or more cannulas. While the tracked stylette is within the cannula it may assist in the placement of the cannula, after which it may be withdrawn to allow a separate instrument to be inserted through the cannula.

[0141] In an embodiment, tube 702 may contain multiple sensors such as coils or gratings along its length so that the shape of the tube may be determined.

[0142] Tube 702 may be rigid or flexible such as a catheter and contain multiple lumens for various purposes.

[0143] The one or more templates 700 may be placed using a robotic mechanism, a stereotactic mechanism, and/or other mechanism. In an implementation, the tubes may be held in place by a support mechanism (not pictured).

[0144] Use of Template in a Guided Interventional Procedure

[0145] FIG. 8 is an example depiction of a template 800 used in a guided interventional procedure (in this case, a needle procedure), in accordance with one or more implementations of the invention. In particular, FIG. 8 depicts a patient lying on an operating table 803 undergoing a procedure. The patient is shown in a lithotomy position with feet resting in stirrups 801 with the patient's perineum 802 positioned near the front of operating table 803. A position sensor 804 (such as, for example, an electromagnetic field generator or optical camera array) is positioned near the patient. A coordinate system 805 is associated with position sensor 804. In this example, and non-limiting implementation, a TRUS probe 806 is placed in the patient's rectum 807 to assist in visualizing the prostate. TRUS probe 806 may incorporate a removable or permanent position indicating element 808 so that the location and orientation of the probe's scan plane is known assuming a calibration as indicated previously has been performed. A transperineal ultrasound probe could be used as well.

[0146] In this example, a Foley catheter 809 may be inserted into the urethra 810. At the distal end of catheter 809, a balloon 811 may be inflated to secure the catheter at the neck of the bladder 812. On or in catheter 809, position indicating elements or fiducials denoted here as 813 may be positioned in the vicinity of the prostate gland 814. Wire(s) or fibers 815 from position indicating element 813 may be connected to the position sensor 804. Wire 815 may not be needed in the case where 813 are passive fiducials. The lumen 816 of catheter 809 may be used to drain urine from the bladder.

[0147] During a guided interventional procedure, a physician (depicted here by gloved hand 817) may use one or more instruments 818 that may optionally include a position indicating element to assist in positioning instrument 818 in a specific location in prostate 814 by directly piercing the perineum 802. In an implementation, instrument 818 may comprise a biopsy needle, hollow cannula, therapy needle such as a laser, or other device. In an implementation, instrument 818 may comprise a standard instrument that may or may not include a position indicating element. In one or more implementation, one or more “check fiducials” 819 may be applied to the patient. In some implementations, check fiducials 819 may include position indicating elements. In some embodiments, natural fiducials such as bones, calcifications, etc. may be designated as check fiducials.

[0148] According to an aspect of the invention, template 800 may be positioned at a predetermined distance and/or angle from perineum 802. A position indicating element 820 (similar to position-indicating element or tracker 602 of FIG. 6) may be fixed to template 800 such that it is able to track the location and orientation of template 800 with respect to frame of reference 805. In one implementation, if template 800 cannot be placed in the correct location due to interference with the patient and/or equipment, another template (if available) that was created for placement in a different assumed location may be utilized. One or more instruments 818 may be inserted through one or more holes of template 800 to a predetermined depth and into prostate 814, according to a pre-procedure plan.

[0149] In an implementation, TRUS probe 806 (or other ultrasound probe) may be affixed to a support mechanism 821. Support mechanism 821 may comprise device such as a Biojet (D&K Technologies GmbH, Barum Germany) or the Multi-purpose Workstation LP (Civco Inc., Coralville, Iowa) that may include motors and/or encoders to help position TRUS probe 806 in the patient. Ultrasound probe 806 may be held freehand and/or not otherwise attached to the support mechanism 821.

[0150] In an implementation, support mechanism 821 may also hold template 800 (or a frame assembly that surrounds (or encompasses) all or a portion of template 800. In an implementation, template 800 may be moved independently from TRUS probe 806. Encoders on support mechanism 821 may report the relative location of the template 800. The position and orientation of TRUS probe 806 may be tracked using encoders on support mechanism 821. In these instances, it may not be necessary to include position indicating elements (e.g., such as TRUS probe position indicating element 808 and template position indicating element 820). In such instances, position sensor 804 may be optional unless another position indicating element (e.g., such as catheter position indicating element 813) is used.

[0151] In one implementation, template 800 may be moved into position using dials or other controls on support mechanism 821. In an implementation, template 800 may be moved into position in an automated manner using a robotic mechanism (such as a gantry) attached to support mechanism 821. In an implementation, TRUS probe 806 may be moved in a similar way.

[0152] In an implementation, the template could be used to guide needles through a transrectal approach instead of transperineal as described here. The template in this case be attached to the ultrasound probe reducing the need for an additional template tracker.

[0153] Catheter

[0154] FIG. 9 is an example depiction of a catheter including a position-indicating element that can be used to track motion of a tissue or organ, in accordance with one or more implementations of the invention. Although described in terms of a prostate procedure, it is understood that the techniques described herein are equally applicable to many other procedure types.

[0155] In an implementation, a catheter 901 (e.g., a Foley catheter) may be positioned in a patient and the integrated balloon inflated as indicated in FIG. 9. The inflation balloon 905 normally used to retain the catheter may also serve to immobilize the catheter in the prostate. A dual balloon Foley catheter such as a Coleman or Lerman catheter (C. R. Bard, Inc., Murray Hill, N.J.) may also be used (not shown). One balloon may be inflated in the urethra to restrain it, while the second may be inflated at the bladder neck. In some non-urologic situations, a non-occlusive restraining mechanism may be employed such as those described in U.S. Pat. No. 6,785,571. In a variation, another restraint, balloon, collar, clip, locking device or clamp, etc. 906, may be applied externally at the exit point of the catheter to help immobilize catheter 901 from moving longitudinally. The flexible catheter 901 may also include an interior lumen that may receive an elongated medical instrument to perform a diagnostic or therapeutic function and may include biopsy devices, imaging devices, ablation devices, beams of light or radiation (e.g., laser or radiation delivered by a catheter), scalpels, needles, temperature sensors, electrodes, forceps, brushes, and/or other type of elongated medical instrument.

[0156] In an implementation designed to track the motion of the tissue or organ for gating, the Foley catheter above may be equipped with at least one position indicating element. This would enable the catheter to be used in order to track the repeated motion of the tissue during the procedure caused, for example, by respiration. In some instances the position indicating element may be designed to be tracked by a position sensor but in others, it may be a passive component such as a fiducial that is visible to an imaging modality such as x-ray.

[0157] In an implementation designed to track the motion of the tissue or organ for dynamic referencing or for gating, the Foley catheter above may be equipped with at least one six-degree-of-freedom position indicating element or two five-degree-of-freedom position indicating elements. This would enable the catheter to be used in order to track the location of the prostate during the procedure in cases where the catheter is parked so that the sensors are placed in the prostatic urethra. Here the term “parked” refers to a fixation of the catheter and thus the position indicating elements in a particular location of the anatomy during the data collection

[0158] In an implementation, designed to perform the triple function of gating, dynamic referencing, and registering the Foley catheter above may be equipped with at least two longitudinally displaced five, or six degree-of-freedom position indicating elements (or a combination of a five and a six degree-of-freedom elements). Again this may be accomplished by parking the catheter so that the sensors are within the prostate in the prostatic urethra.

[0159] In the implementation illustrated in FIG. 9, catheter 901 may include a position-indicating element 902. In an implementation shown in the inset of FIG. 9, a plurality of position indicating elements 902a, 902b, 902c, and 902d may, for example, be included within catheter 901. The position, and possibly orientation of position, indicating elements 902 (i.e., 902a-902d) may be located using a tracking device for purposes of gating, dynamic referencing, and registration as detailed above. In an implementation, the position-indicating elements may be attached within one of the existing lumens of the catheter, such as a balloon inflation lumen, the drainage lumen, or in an irrigation lumen of a three lumen catheter, or in a special dedicated lumen, here indicated as 903. In an implementation, the position indicating elements are disposed to be retained substantially within the tissue of interest during the procedure, here within the prostate 909, and therefore proximal to the fixation balloon. In an implementation, the position indicating elements are longitudinally displaced relative to one another and their location may be known in the catheter relative to either the tip (distal end) 910 or start (proximal end) of the catheter i.e. distances 907, 908a, 908b, and 908c are known which represent the distance from the start of each sensor to either the tip or start of the catheter. Alternatively, their locations relative to the balloon 905, tip or start of the catheter may be known.

[0160] In a similar manner, the position indicating elements along with electrical or optical cables 904 may be removably inserted into a lumen. The position-indicating elements may be inserted into lumens of catheter before or after the catheter has been placed rather than being integrated in the catheter. For example they may be contained within a tube that is removably inserted into the catheter. In doing so, the ultimate location of the position indicating elements within the catheter may be known.

[0161] In an embodiment, the catheter has distance markings on it so that the depth of insertion can be determined by reading the markings exterior to the patient. In this way, with knowledge of the catheter geometry, the location of the position indicating elements from the entry point of the catheter can be determined.

[0162] In an embodiment where the sensors are permanently fixed to the catheter, the fiber or cable connecting the position indicating elements to the position sensor within the catheter has some amount of slack to it so that if the catheter is stretched, the cable or fiber within does not break.

[0163] Methods of Use

[0164] In using these devices, the first step is to obtain the path of the registration conduit in image space. This may be done by manually segmenting the conduit from sequential images, or automatically using, for example, a machine learning method such as a convolutional neural network trained to identify the path of the conduit.

[0165] Such a segmentation is illustrated in FIG. 10 as item 1001. The segmentation typically forms a solid object and the centerline, 1002, may be obtained by skeletonization of the segmented images or by using tubular structure centerline algorithms that are known in the art (e.g. Tagliasacchi, A., Alhashim, I., Olson, M., and Zhang, H. 2012. Mean Curvature Skeletons. Comput. Graph. Forum 31, 5 (August 2012), 1735-1744. DOI: 10.1111/j.1467-8659.2012.03178.x). Paths are typically expressed as a set of (x, y, z) coordinates of the centerline of the conduit but other methods of expressing it are possible (e.g., piecewise splines and/or other methods of expressing paths). In this figure, a few of the points that comprise the path are depicted as the white circles indicated by numerals 1003, 1004, 1005, 1006, 1007, and 1008, each of which has its own (x,y,z) coordinates so as to comprise a list of coordinate sets. Many such points may exist to describe the centerline.

[0166] The imaging step may be further assisted to render the path of the registration conduit more visible by equipping it with one or more fiducials prior to imaging. Fiducials may take the form of points of material, such as small balls. They may also take the form as segments of material such as short wires or tubes. They may be position indicating elements such as electromagnetic sensors or shape sensing optical fibers that happen to be visible on the imaging modality. They may also be a continuous fiducial such as a length of wire, fiber, or filling material. These may be inserted either directly into the conduit at the time of imaging or into a lumen (permanently or removably) into another device such as a catheter or Foley catheter or may be incorporated directly into the structure of the catheter through the selection of specific materials that are intrinsically visible on the imaging method. The location each fiducial relative to the catheter (if used) may be known.

[0167] Calculating Initial Registration

[0168] Method 1: Sampling Sensors and Using ICP

[0169] Referring back to FIG. 9, in an implementation, a catheter 901 such as the one depicted in the inset of FIG. 9 that includes multiple position indicating elements (902a, 902b, 902c, 902d) may be used to perform a patient-to-image registration. This can be done if a pre-procedure image set (such as an MRI) of the path into which the catheter is inserted is available, and details of the construction and placement of each of the multiple position indicating elements is known, but the location of the catheter in the conduit is not. A position sensor is used to sample the patient space locations of the position indicating elements inside of the measurement device that follow the path of the conduit. All that is required is to use a generalized registration method such as ICP to calculate a registration transformation matrix between the patient space locations of the position indicating elements and the image space coordinates of the complete path, with a best fit solution for the registration resulting. This technique may lead to errors in the registration transformation if the path is not sufficiently tortuous (see section Improving Registration below).

[0170] Method 2: Parking Catheter at an Assumed Location

[0171] The positions in which each position-indicating element (902a, 902b, 902c and 902d) has been secured in catheter 901 is known relative to catheter tip 910 and balloon 905 of catheter 901 at the time of manufacture. When catheter 901 is inserted into the patient and balloon 905 is inflated, the approximate location of each position indicating element within the pre-procedure images of the prostate may be deduced because linear displacement of each position indicating element is known since balloon 905 is lodged against the bladder neck. As before, the path of the urethra and thus catheter 901 is known from an MRI, ultrasound, or other diagnostic scan since the path of the catheter is constrained to the lumen visible on the images. The locations of the position indicating elements are sampled and transformation is calculated assuming an initial parked positioning of the catheter.

[0172] Method 3: Measuring Catheter Outside Patient

[0173] This is illustrated in FIG. 11 which shows a conduit 1101 and position indicating elements 1102 inside a catheter 1103 placed in the conduit. The catheter exits the patient at point 1104. By measuring the length of the catheter outside of the patient (1105), and with the knowledge of the locations the position indicating elements were placed in at the time of manufacture (1106a, 1106b, and 1106c, for example), then the locations of the position indicating elements within the conduit in image space may be inferred based on the pre-procedure scan and the knowledge that the catheter is constrained to the urethra. The linear displacement of each position indicating element is known since it is possible to measure the length of the catheter external to the patient (using, for example, a ruler or any measurement marks on the catheter).

[0174] Method 4: Determining Catheter Location from Another Position

[0175] In an embodiment, if a position indicating element or fiducial is placed in a known location in image space, it is possible that the location of the catheter in image space may be determined relative to that device and the parked position of the catheter determined. For example, if a position indicating element or fiducial is placed at a known distance from say, the start of the prostatic urethra, then by measuring the distance of that position indicating element from one present inside the catheter in patient space, it is possible to determine where the catheter has been parked in the urethra in image space since the measuring device is constrained to the conduit. The position indicating element or fiducial may be placed for example on the skin surface as check fiducial 819 in FIG. 8, or may be interior to the patient. The distance of this fiducial or position indicating element may be known to the start of the prostatic urethra by imaging or other means. When one of the position indicating elements in the catheter is determined to be that same distance, then the catheter may be parked and the location of all the position indicating elements in the catheter will be inferred as they are constrained to the conduit.

[0176] In these cases (methods 2, 3 and 4), the precise location of the parked conduit in image space is inferred based on secondary information rather than being known so does not constitute a standard registration procedure as known in the art. Normally, the locations of the position indicating elements are known in image space from, for example, direct imaging of them.

[0177] Method 5: Using Imaging to Park Catheter or Determine Parked Position

[0178] Locations of position indicating elements relative to the images could of course also be established through the use of imaging devices such as X-ray or ultrasound to assist in parking the catheter at a known location or deriving its location based on adjacent visible features in the images that were present at the time of the scan (e.g. branch points of vessels, proximity to a bone, or proximity to an preplaced fiducial). The presence of cooperative imageable targets such as fiducials on the end of catheter or at the balloon could also assist in positioning the catheter correctly, but again this is an indirect measurement that does not identify the position indicating elements within the catheter directly. Indeed it may be difficult or impossible to image the position indicating elements directly in order to perform the registration, as they would normally be embedded within the catheter and may be invisible using ultrasound for example. Special identifying features may be added to the exterior of the catheter to indicate the locations of the position indicating elements in this case.

[0179] Optical imaging techniques can also help locate the catheter. For example, an imaging optical fiberscope or urethroscope inserted into the catheter may assist in locating landmarks in the conduit such as the internal or external urethral sphincters in the urethra, or the carina or various branch points in the bronchial passages, which would determine the location of the catheter in and therefore the position indicating elements. Indeed, it may often be possible to “feel” the sphincters with the catheter during insertion as the elements of the catheter are pushed through them. Ultrasound may devices may include externally placed transducers as well as internal transducers such as transrectal ultrasound (TRUS) and intra-catheter ultrasound devices such as endobronchial ultrasound (EBUS), intravascular ultrasound (IVUS) etc.

[0180] Method 6: Determining Catheter Path by Moving or Sliding Sensor

[0181] The path of the conduit could equally be determined using a “drag-back” technique using a single sensor that is slid through the conduit or catheter as explained in U.S. patent application Ser. No. 11/059,336 and U.S. patent application Ser. No. 15/281,137 both entitled, “METHOD AND APPARATUS FOR REGISTRATION, VERIFICATION, AND REFERENCING OF INTERNAL ORGANS” by Glossop, both of which are hereby incorporated by reference herein in their entirety. A version of this is also discussed by Donhowe et al. in U.S. patent application Ser. No. 15/752,166 and U.S. patent application Ser. No. 15/752,154, both of which are hereby incorporated by reference herein in their entirety. Again, it would be necessary to assume the location of the catheter in the patient and the extents of the dragging of the sensor in the conduit as this is not taught in the applications.

[0182] Therefore, if the path of the urethra or other registration conduit is determined in image space from scans taken prior to the operation, the position and orientation of the position indicating elements within the registration conduit (i.e., prostatic urethra) may be deduced in image space. The locations and orientations of the position indicating elements may be determined by the position sensor in patient space. This allows an “initial registration” to be calculated relating the position indicating elements positions (patient space) and orientations and the assumed positions from the pre-procedure scans (image space). This initial registration may then be used to target any device that contains a position indicating element or improved prior to doing so.

[0183] Improving Registration

[0184] For various reasons, the initial registration may not be accurate. In various implementations, one or more methods described below may be used to improve the initial path-based registration.

[0185] Unless a plurality of conduits are selected, it is preferred that individual conduits have a curvature or tortuosity to them and not be straight or form an arc of a circle. In this latter case, it may not be possible to calculate an accurate registration using ICP alone. This may be the case in the prostate, where the prostatic urethra may roughly follow an arc as indicated in FIG. 10, although not all prostatic urethras are curved in this manner. Likewise, some blood vessels or bronchial passages are virtually straight or form an arc of a circle and may not produce a unique or accurate registration. It may be possible to use a mostly straight or arc shaped conduit if additional registration information such as additional points or paths are used or adjustments are performed. In some embodiments, it may be preferred that multiple position indicating elements be used to better approximate the shape of the conduit.

[0186] Unless imaging means can be used to confirm its location, the catheter position may not be precisely known in image space. In this situation, it may not always be possible to obtain an accurate registration, as illustrated in FIG. 12. Here, the conduit or urethra 1201 is shaped as an arc (other shapes that lead to the same outcome are also possible) of constant radius of curvature R. If measurement device 1202 (and thus the position indicating elements 1203) is known to be in the correct location (for example to be placed at location 1204a), then it will be possible to uniquely and accurately register the patient. However, if the catheter is placed at some other location on the arc such so that it starts at 1204b, but assumed to be located at 1204a registration may still also be possible but will lead to incorrect results even though the numerical fit of the registration may indicate it to be accurate. Only if the urethra or conduit is sufficiently tortuous or the starting position is known will an ICP algorithm converge on a unique “correct” solution, otherwise it will result in one of the many possible incorrect solutions, sometimes known as a “local minimum.” It is important to be able to detect and correct for this type of error.

[0187] Method 1: Optimizing Overlay of Pre- and Intra-Procedural Images

[0188] In an embodiment, poor registration may be detectable and corrected by imaging. An imaging device (e.g. a calibrated ultrasound tracked with a position indicating element) may be used to obtain an image of the anatomy after the initial registration. In an embodiment, the preoperative images or segmentations are then transformed to the patient coordinate system using the initial transformation matrix calculated using the catheter registration and the position indicating element on the imaging device. If the two images do not coincide, adjustments are made either manually or using an automated method until a “stopping criterion” is met, which is to produce the maximum overlay of the image with the predicted position of the anatomy based on the position indicating element. These corrections are then applied to the transformation matrix to produce a revised, more accurate transformation matrix.

[0189] In an embodiment, this operation may also be performed in order to align check fiducials with the preoperative images of the check fiducials. In addition to directly imaging them in patient space, their location may also be established with a probe or by using “active fiducials.” Active fiducials contain position indicating elements that are laid on top of, or are used to replace the check fiducials that were used at the time of imaging. The fiducials incorporating position indicating elements may be replaced at the time of the intervention in the same location as the fiducials imaged prior to the procedure, so there is no need to touch the fiducial with a probe.

[0190] The corrections are made in all six degrees of freedom (three rotations and three translations) to align the aforementioned aspects of the images. Note that in this case, the live images (or check fiducial locations) are not used as part of the initial registration calculation, but are used after registration to verify and adjust the registration. The initial registration is modified based on the corrections needed to bring the pre- and intra-procedural images (or segmentations or check fiducials) into concordance. Simultaneous matching in six degrees of freedom can sometimes be time consuming and tedious.

[0191] Method 2: Imaging Position Indicating Element Locations

[0192] As mentioned, in an embodiment, imaging may indicate the precise positioning of the position indicating elements within the conduit. For example, fiducials visible on the imaging modality may be placed at the location of one or more of the position indicating elements that may be visible using the imager. By locating these relative to the conduit, it may be possible to improve the registration by indicating the actual location of the position indicating elements in the catheter.

[0193] Method 3: Adding Points

[0194] Additional points not related to the catheter may be obtained from other sources such as surface points or internal points on the patient or organ that may be obtained, for example, by imaging the surface of the prostate with tracked ultrasound, sampling individual points with a tracked probe (e.g., surface points, fiducials), locating them with a fiberscope, and/or by one or more other techniques. These may be used to improve the registration.

[0195] Method 4: Minimizing FRE

[0196] In an embodiment, incorrect matching may be corrected by adjusting a single parameter (i.e., “s”, the initial location of the starting point of the catheter). Since it may be known that the catheter will be constrained to the conduit (e.g., the urethra), adjusting this one parameter may modify the registration in an intuitive manner.

[0197] In an embodiment, incorrect matching may be detectable and corrected by calculating the “fiducial registration error” (or FRE), which equals the root-mean-square error in fiducial alignment between image space and physical space. Minimization of the FRE may be possible by systematically and incrementally adjusting the assumed position of the measurement device within the conduit to achieve the best registration. For example, FRE may first be calculated assuming the catheter is at location 1204a and calculating a registration. This position might be obtained by using one of the registration methods above for example. This transformation may be used to calculate FRE. The catheter start location may then be incrementally moved (by a small amount, say “δ”) along the path of the urethra (to which it is constrained) to s=position 1204a+δ and FRE calculated again. In an embodiment, δ may be in the range of 0.01 mm to 5.0 mm. This may be repeated several times as the start position s is moved along the path along the conduit, and when FRE is minimized, this may be assumed to be the correct position of the catheter. The calculation of each new s can be done using a variety of techniques besides simply incrementing δ over a range. In some implementations, gradient search techniques or other methods may be used to select an s that minimizes FRE.

[0198] Method 5: Minimizing TRE

[0199] A similar approach may be carried out by calculating target registration error (or TRE) in evaluating the error of a check fiducial if one is available. TRE may be defined as the distance after registration between corresponding points not used in calculating the registration transform. For full descriptions of FRE and TRE, see Fitzpatrick J M, West J B., The distribution of target registration error in rigid-body point-based registration., IEEE Trans Med Imaging. 2001 September; 20(9):917-27 DOI: 10.1109/42.952729.

[0200] In an embodiment, incorrect matching may be detectable and corrected using check fiducials to calculate TRE. A probe, imaging device, or integrated position indicating element may be used to sample one or more check fiducials on the patient and the initial registration applied. In cases where the transformed pre-procedure image of the fiducial and measured patient space (x, y, z) of the fiducial do not coincide, adjustments may be made (e.g., using the incremental method described in Method 4 above or manually or using some other automated method to adjust the assumed starting location (s) of catheter) to produce the maximum overlay of the coordinates of the fiducial in patient space with the transformed position of the fiducial based on the initial image of the fiducial in image space.

[0201] Note that, in this case, the check fiducials used to calculate TRE may not be part of the registration calculation, but may be used post registration as an accuracy verification and optimization feature. The registration may be modified based on the check fiducials in order to optimize the overlap of the transformed pre-procedure fiducial position (or segmentation of the fiducial) and live (x, y, z) location of fiducial obtained from the probe or position sensor (i.e., to minimize TRE).

[0202] Method 6: Maximizing Overlap

[0203] The effect of altering the starting point may be similar to sliding a block along a wire in a manner similar to a “bead maze” toy (see U.S. Pat. No. 5,112,268, which is hereby incorporated by reference herein in its entirety), in which the wire may represent the urethra and the bead may represent the transformed image of the prostate.

[0204] In this case, and with reference to FIG. 13a, the preoperative image or segmentation of the prostate 1301 may be thought of as a solid “bead” that may slide down the urethra 1302 that can be thought of as a “wire.” This may be representative of the type of error described earlier in reference to FIG. 12, in which a malpositioned catheter may cause an error in registration.

[0205] In FIG. 13b, it is shown that by adjusting a single parameter (“s”—the assumed starting point of the catheter in the conduit based on the initial registration), a transformation may be calculated that moves the preoperative images or segmentation of the prostate along the urethral path so that it can be brought into concordance with the live ultrasound image 1303. Likewise, sampled check fiducials can be brought in concordance with the location that was imaged preoperatively. As before, the initial registration may be used and the correction of the registration may be performed afterwards.

Example Implementation

[0206] By way of illustration of methods 4-6, the segmented urethra or conduit (such as line 1002 of FIG. 10) may be expressed as a list of coordinates (i.e., x, y, z coordinates) representing the path of the centerline of the conduit. In one or more implementations, the list of coordinates may number roughly 100 points, although any number greater than roughly five may be used. An initial registration using three position indicating elements may be performed with the assumption that the first position indicating element in the measuring device is located at for example point 1003, the second is at 1004 and the third at 1005 (the actual points used will depend on the spacing of the position indicating elements and spacing of the coordinates of the path). The object of the adjustment is to determine if by instead assuming the first position indicating element is located at 1004, the second at 1005 and the third at 1006 the overlap of check fiducials or objects is better. The change in start position is the “δ” of method 4, and the new position is “s”. The location is then adjusted to 1005, 1006 and 1007 and again checked. When the overlap produced the smallest error, that may be accepted as the best location for the catheter, and the registration from that location may be used.

[0207] Example Flowchart for Registration Correction

[0208] A sample workflow to correct the registration transformation matrix using methods 4-6 may consist of the following steps that are illustrated in the flowchart of FIG. 14. A similar process applies to registration correction using the other methods.

[0209] In step 1401, the catheter or measurement device with position indicating elements may be inserted into the conduit and secured in position.

[0210] In step 1402, the initial registration transformation may be calculated using one of the methods described in the section above—“Calculating Initial Registration” (e.g., with the assumption of the catheter's location along the conduit (Method 2) or by measuring the length of the catheter outside of the patient (Method 3)).

[0211] If using intra-procedural imaging such as ultrasound with position indicating elements attached to the transducer, decision box 1403 may lead to step 1404. Otherwise, if a probe and check fiducials are used on the patient, step 1405 may be performed.

[0212] In step 1404, the anatomy may be imaged with the imaging modality and its location and orientation may be determined from the position indicating elements on the imaging modality (e.g., the transducer handle of an ultrasound).

[0213] In the case where one or more check fiducials are used, the location and orientation of a probe containing position indicating elements may be sampled (step 1405) in patient space as it is made to touch a check fiducial on the patient. Alternatively, if the check fiducials have been replaced with fiducials containing position indicating elements, their locations may be sampled in patient space.

[0214] In step 1406, the initial registration may be used to transform the preoperative images or segmented regions such as the outline of the prostate or images of the check fiducial determined in image space into the patient space displayed on the live imaging modality. The inverse may also be possible (i.e., transforming the live data into the pre-procedure images).

[0215] In step 1407, the intraoperative representation of the anatomy or fiducial may be compared with the transformed preoperative images of the anatomy (or segmented representations of the anatomy) by, for example, overlaying the two image sets (or the live image set with the transformed segmentation), or in the case of fiducials, displaying graphic icons of where the system calculates the fiducials to be located. The comparison may be done visually or an algorithm (e.g., the Dice Similarity Coefficient (DSC) or Hausdorff distance) may be used to score how well the two overlap.

[0216] In step 1408, the locations or images may be compared. If the overlays do not match sufficiently, the workflow may proceed box 1410. In the case that they do not overlap well, in step 1409. a correction such as methods 1-6 in the “improving registration” section above may be applied. A user supplied adjustment or automatic adjustment may be applied to the starting location of the catheter “s” in the anatomy, the position indicating elements may be moved along the segmented conduit by this amount, and a new registration matrix may be calculated before returning to step 1407. Once the two images are sufficiently close, the corrected registration matrix may be deemed to have been determined and may be saved as the new registration, as indicated in step 1410.

[0217] Although described in terms of position indicating elements, this technique may also be employed when using a measurement device that uses imageable fiducials as well as continuous measuring devices, such as fiber optic shape sensors. In some implementations, this registration method may be used to register anatomy with lumens such as the lungs, and vascularized organs, for example.

[0218] Example Flowchart of Complete Procedure

[0219] FIG. 15 depicts an example flowchart of the operations required to perform interventions such as therapeutic or diagnostic procedures using the techniques described herein, in accordance with one or more implementations of the invention. Although the procedure is explained using the prostate and urethra, it is understood that the procedure is general and other organs and lumens (both natural such as blood vessels, and those that may be created by the physician) may be used in an analogous manner. In various implementations, steps 1501-1504 may be performed during the preoperative portion of the procedure. Ordinarily a combination of the methods of registration and improvements outlined above may be used together to obtain a sufficiently accurate registration.

[0220] In step 1501, an imaging modality such as an X-ray, MRI, CT, ultrasound, CBCT, tomosynthesis, PET, or other imaging modality may be used to obtain one or more two-dimensional (2D) or volumetric images of a patient's anatomy. In some implementations, this may take the form of contrast-enhanced, multi-parametric, or other variation of the scan or scans. The images may be formed into a three-dimensional (3D) image stack which shows details of the anatomy from many slices. Internal or external fiducials, special imageable catheters, etc. if used, should be applied prior to the scan, and the scan should encompass both the fiducials and the anatomy. The imaging modality or at least parts of it (e.g., DWI and/or DCE images in a multiparametric MRI) may render cancerous or other target lesions visible as well as any imaging fiducials. The imaging method may be selected depending on the tissue type, availability, standard of care, and/or one or more other factors. The imagine method may encompass the length of the conduit of interest from entry to target.

[0221] In step 1502, the scan(s) may be reviewed by a radiologist or other specialist, or processed by a Computer Aided Diagnosis (CAD) program, or other software (e.g., control application 307). One or more targets may be annotated along with critical structures (e.g., the conduit such as the urethra, nerves, vessels, bones such as ribs, pelvis, etc.). In some implementations, this information (target(s) and structure(s) and/or other information) may be annotated on the images, as a separate list of points and volumes, or stored in a database (or memory) along with other information. Targets may also include a selection of targets designed to represent an orderly and representative sampling through an organ as might be desired during a sextant-style or saturation-style biopsy of the prostate, which aims to sample from throughout the gland. Other targets may cluster more densely around certain structures deemed to be important for either therapy or biopsy such as, for example, local dose boosting around a suspected tumor whilst placing radioactive brachytherapy seeds. Yet another non-limiting example may be an optimized treatment pattern for a large tumor to be treated by multiple successive or simultaneous thermal or cryoablations.

[0222] Examples of targets may include locations where biopsies or therapy is desirable. Other examples include locations where critical structures must be monitored (e.g., for temperature, radiation dose, etc.). Other target locations may be used to monitor patient motion such as skin fiducials or localization marks or tattoos. Other targets such as nerves may be locations that must be completely avoided. Other regions of interest are also possible. Regions of interest may be designated at individual points as two dimensional areas, or three dimensional volumes.

[0223] In optional step 1503, the scan(s) may be segmented to outline the organ of interest and/or regions of interest (ROI). In some implementations, this information may be annotated on the images, as a separate list of points and volumes, or stored in a computer database (or memory) along with other information. In some implementations, step 1503 may be combined with step 1502. Both the organ and lesions may be segmented to obtain their geometric distribution that may aid in sampling or treating the disease. This may appear as a set of coordinates that may define the outline of the prostate and lesions for example and may aid in visualizing, displaying, planning, and/or performing one or more other operations. This may be done manually or automatically.

[0224] In step 1504, the path of a registration “conduit” is obtained in the image space coordinate system from the MRI or other pre-procedure images taken in step 1501. The path of the conduit may also be obtained during the intervention using a real time imaging method such as US, CBCT, or X-ray. Examples of conduits include naturally occurring lumens such as the urethra, bronchial passages, arteries, veins, lymphatic vessels, ureters, biliary ducts, intramedullary canals, the colon, or the small intestine. Artificially created conduits include those that might be created by a physician, such as through the use of inserted or applied needles or catheters. This step may involve determining a centerline from segmented volumes or surface model of the conduit.

[0225] The next steps may generally take place at the time of the intervention and may be dependent on the preceding steps being completed.

[0226] In step 1505, during the intervention, a measurement device such as a specialized catheter may be inserted into the patient conduit, adjusted, and fixated in place. Examples of measurement devices may include catheters containing one or more position indicating elements (e.g. fiber optic sensors, electromagnetic sensor coils, and/or other types of position indicating elements), catheters containing fiducials (e.g. small balls, wires, or tubes), reflective objects such as ultrasound emitters or reflectors that may be highly visible under ultrasound, radioactive emitters, or other devices whose position and/or orientation may be determined is introduced into the conduit such as the urethra. The balloon or distal restraint if any (e.g. item 905 of FIG. 9) is activated to lock the catheter in position. The proximal restraint device (e.g. item 906 of FIG. 9) if any is activated to prevent the catheter from sliding.

[0227] In an embodiment, the measurement device may be adjusted to a known position (or a position that can be deduced or measured) within the conduit, so that the locations of the position indicating elements within the measurement device in image space may be inferred. Because the location of each position indicating element within the measurement device is known at the time of manufacture, if at least one position along the measurement device is known in the image space, the positions of the rest of the position indicating elements in image space may be calculated since the measurement device may be assumed to be constrained to the conduit.

[0228] In an embodiment, the catheter described in step 1505 may contain fiducials that are registered to the patient and may be imaged during the intervention using an ultrasound, X-ray, CBCT, CT, MRI, and/or using one or more other imaging techniques. These fiducials may be present instead of or in addition to position indicating elements, and may be the same as position indicating elements.

[0229] In another embodiment, the fiducials or position sensing elements may be removably inserted into a known location in the catheter by temporarily inserting a tube, fiber, bundle, or wire containing the position sensing elements or fiducials into the catheter. In this case, the location of the inserted position indicating elements must be repeatable and known from manufacturing specifications.

[0230] In step 1506, the position indicating elements or fiducials in the catheter is used to determine points along the path of conduit in the patient space. Both the position and orientation of the sensors or fiducials may be used if available to approximate the path of the conduit. For example, known methods such as Hermite splines may be constructed to approximate the shape of the catheter from the position and orientation information. In an embodiment, the orientation of the position indicating elements may be taken into account by determining two or more points along the position indicating element (e.g., the beginning and end of the element) based on its position and orientation and assuming the position indicating element (e.g. an electromagnetic sensing coil) is a line. If only position information is available, these points may be used as positions along the path of the conduit.

[0231] In an embodiment, the path of the conduit may be obtained by imaging means alone, such as through the use of a tracked ultrasound in which the coordinates of the conduit are able to be determined in the patient space. This may be done with or without the use of the catheter from step 1505 and may be combined with use of position indicating elements as indicated above. In this case, the imaging modality must be calibrated to enable the determination of imaged points in the patient space using a method like Gee et al. previously referenced.

[0232] In step 1507, a registration is performed by correlating the conduit or its centerline obtained from the pre-procedure images of the path in image space with path obtained in step 2606 in patient space. One of the methods previously described for obtaining an initial registration may be used.

[0233] It may be required that the conduit maintain its path from the time of imaging until the time of intervention. If the conduit changes path after imaging, it may not be possible to use it for registration unless additional registration information such as additional points or paths are used or more advanced non-rigid registration methods are employed. For example, the prostatic urethra may be constrained to a fixed path by the prostate matrix so while the prostate itself may move, the urethral path is mostly unchanged except for a slight straightening if a stiff catheter is used. In some embodiments, a low durometer (e.g., Shore 20A-35A), thin walled (e.g., <1.0 mm), and/or smaller diameter (e.g., <5.0 mm) catheter may be used to minimize urethral straightening. Paths that change periodically, such as those in the lungs, may be used provided gating or motion tracking of some kind is used.

[0234] As mentioned, the transformation matrix obtained using the conduit registration may be augmented and improved through the use of the methods 1-6 above. Other methods of improving accuracy are possible.

[0235] In step 1508, the registration may be tested for accuracy. This may be done by imaging the prostate or region of interest (e.g., with tracked ultrasound) and ensuring that the transformed MRI outline of the objects overlay. It can also be done by touching check fiducials using a tracked probe and ensuring that the transformed location of the probe tip conforms to the images of the fiducials. Other methods of verification are also possible (e.g., a redundant “check sensor” in the catheter, direct visualization of structures, etc.). If it is found that the registration is inaccurate, steps may be taken at this point to correct the registration to an acceptable level before proceeding using, for example, the steps for “Improving Registration” listed above or the algorithm described herein with respect to FIG. 14.

[0236] In step 1509, a tracked template, or a part thereof, may be placed in the vicinity of the target of interest. In an embodiment, the template may consist of a single channel such as tracked cannula 700 in FIG. 7, an aperture including a multileaf collimator, a laser, a photon or particle beam, a predrilled grid, a custom grid, or a partial grid such as a single line of holes. In some embodiments, the template may be placed internal to the patient. Templates may be of any convenient size or shape and multiple templates may be used at one time.

[0237] In some implementations, tracked instruments may similarly be used to accomplish the same task as the tracked templates. In this context, instruments may include needles, biopsy devices, drills, electrodes, lasers, radiation therapy devices (and/or other beams), temperature sensors, forceps, laser fibers, brushes, cryotherapy devices, applicators, catheters, pointers, scalpels, stents, saws, and/or any other medical devices so long as tracking devices (i.e., position indicating elements or fiducials) have been attached rendering them able to be tracked by a position sensor. Although referred to as “templates”, it is understood that instruments may also be used in the manner described herein. Instruments (such as those listed above) without any integrated tracking may of course be used together with templates that do contains integrated tracking to accomplish the same task (e.g. inserting a biopsy device through a tracked cannula template).

[0238] The location and orientation of the template (or instrument) may be obtained as indicated in step 1510. In some implementations, this may be done using the same position sensor as used to determine the conduit path of step 1506 (if the template is equipped with position indicating elements), or fiducials placed on the template may be used in conjunction with the imaging method used if an imaging method is used to determine the position and orientation of fiducials that may be present in the catheter.

[0239] Using the transformation matrix calculated in step 1507, the location and orientation of the lesions determined in image space may be obtained in patient space so that all targets are known in the coordinate system of the template as indicated in step 1511. Conversely, using the inverse transformation matrix, the template location and orientation in patient space may be expressed in image space if desired.

[0240] In step 1512, the template may be adjusted to ensure at least one of the existing template paths or possible template paths (in the case of a custom template) intersects or passes close to a target selected in step 1502.

[0241] In step 1513, paths for instruments, beams, etc. are selected through the template to intersect the lesions. In embodiments where the template contains predrilled paths, a path is selected from the available paths that causes the instrument to approach as closely as possible one or more of the targets identified in step 1502. In situations where a custom template is desired, paths may be specified by a manual or automatic method and manufactured as described previously. The insertion depth of the instruments are calculated at this step. Additional holes may be selected for the purpose of monitoring or augmenting the initial therapy hole. For example, adjacent holes may be selected for inserting temperature or impedance sensing devices to measure the progress of the therapy or for inserting additional therapy needles through to increase the dimensions of the applied therapy.

[0242] In step 1514, the template location or the selected path may be modified based on continuously monitoring of the location of the conduit. If the conduit position or shape changes and is detected by imaging or position sensor means, then the user may be alerted and given instructions to adjust the location of the patient, template or selected instrument path to account for the change in position and to maintain accuracy. Dynamic referencing or gating may also be activated by using position indicating elements in the conduit or by imaging means (in which an imaging device such as ultrasound, MRI, X-ray, or other imaging device is used to examine the location of the conduit, and or monitor the progress of the intervention). Dynamic referencing or gating is generally a straightforward process once registration has been achieved using this technique as the same catheter can perform both functions. As described previously, dynamic referencing and can compensate for rigid motion of the object (i.e. translation and rotation of the organ) and can extend to modification of the image space shape of the organ. As such, it is possible to reassign the location of the target based on the position of the path obtained in image space. In this case, methods such as finite element modeling may be used in which the changed position and orientation of the conduit is propagated through the organ and used together with the material properties of the organ to derive new locations of the targets without directly visualizing their changed positions, but only that of the conduit.

[0243] In step 1515, instruments for therapy, diagnostics or monitoring may be inserted through the selected paths in the templates to the targets, or in the case of tracked instruments, may be inserted or applied directly.

[0244] Other Features

[0245] In one or more embodiments, a catheter and “proxy” position indicating elements may be introduced during the scan so as to reproduce the conditions that will be seen at the time of the intervention (e.g., in changing the path of the conduit due to the rigidity of the catheter). Likewise, a proxy TRUS probe may be introduced at the time of the scan to occupy the space and effect the deformations that may be apparent at the time of the intervention.

[0246] In one or more embodiments, it is possible to determine the image space location by imaging. For example, to register a vessel, contrast may be injected into the vessel, and the catheter may be moved until it reaches a preselected location. It may be possible to also place or tattoo a fiducial onto the skin so that it may be localized by X-ray, and the catheter may be moved to that location. Other sensors may be present in a catheter for blood pressure, temperature, pressure, radiation, and/or other measurements.

[0247] The foregoing has been illustrated substantially in terms of a Foley catheter, but could be any type of catheter, including vascular catheters, biliary catheters, or ventricular catheters. It could also be performed using guidewires, needles, and/or other similar instruments, and could be in any organ, not just prostate (e.g., the heart, liver, lung, brain, pancreas, and/or other organ).

[0248] In one or more embodiments, the physician may also add random or non-random surface points or an ultrasound sweep with a tracked ultrasound on the prostate. This may augment any registration obtained by the Foley registration. In some embodiments, a deformable registration may be added to better align the prostate imaged using ultrasound with the segmented MRI. The location of a band or area on the catheter may also be imaged to obtain a known point (e.g., take an X-ray or ultrasound to determine the location of the tip in the vessel).

[0249] Following registration, position indicating elements or fiducials in the immobilized catheter may be used to dynamically reference the tissue and, by looking for repeated patterns, can be used to gate the intervention.

[0250] In an embodiment the catheter may be used to locate critical structures such as the neurovascular bundle and assist in locating it during radical prostatectomy in order to preserve it during the procedure.

[0251] Special Catheter

[0252] A problem may occur if the conduit is not directly imageable. In these case, it may be difficult or impossible to determine its precise path using an imaging modality alone. This can make registration extremely challenging. This is sometimes the case in determining the path of the urethra using standard MRI or CT scans, in which portions of the urethra may not be visible on the images. Similar situations may arise with blood vessels, bronchial airways and other situations.

[0253] According to some embodiments, to solve this type of problem (e.g., where the conduit is not directly imageable), a catheter or other object, device or contrast injection may be used to increase the visibility of the conduit.

[0254] In an embodiment, a form of the catheter referred to herein as the “imaging catheter” may be introduced into the conduit prior to imaging. The imaging catheter enhances the visibility of the catheter's path on images that contain the catheter. In one embodiment, the catheter or a lumen within the imaging catheter may include a material (such as a contrast material) or void to facilitate its localization under imaging. Alternative approaches may be used to accomplish this depending on the imaging modality.

[0255] As one example, echogenic coatings may be used to enhance the visibility of objects such as needles or catheters viewed by ultrasound. Echogenic devices in general are known as shown, for example, in U.S. Pat. No. 5,081,997. For example a device may include an elongated member including a material having an acoustic impedance different from that of the surrounding medium. The medium includes surrounding biological tissue or fluids surrounding the member when inserted into a passageway of the patient. The acoustic impedance of the elongated member is sufficiently different from the surrounding medium for enhancing an image produced in response to a sonic beam produced from imaging equipment.

[0256] Reflective echogenic coatings may also be used to enhance the visibility of objects such as needles or catheters viewed by ultrasound., Also, devices can be rendered visible under imaging e.g., by injecting a contrast agent or by using a non-catheter form of contrast object (e.g. a rod or wire). These types of devices will all be referred to as an “imaging catheter”, with the understanding that it could be another form of object that performs a similar function of enhancing the visibility of the conduit's path under the imaging modality used.

[0257] Any changes induced to the path of conduit by the catheter that resides in the conduit will therefore be visible on the images. If, for example, the catheter causes a straightening or bending of the conduit, the altered conduit path will be visible in the images that have the imaging catheter in the conduit.

[0258] A “registration catheter” containing position indicating elements (such as electromagnetic sensors) may be used at the time of intervention to determine the path of the catheter in patient space.

[0259] Another problem that may arise when registering with conduits occurs because some conduits may lack an intrinsic tortuosity and may be too straight to perform a high quality registration. This problem can become worse when no imaging catheter is used but a registration catheter is inserted into the conduit after imaging, as it may cause straightening or distortion of the path of the conduit due to the catheter's bending stiffness. This may lead to an inaccurate registration, since the conduit as measured with the registration catheter may not correspond well to the imaged conduit (that does not contain a catheter) thereby causing an error in registration.

[0260] In an embodiment, it is possible to place an imaging catheter during the image acquisition and then place a registration catheter with almost identical material properties at the time of registration. This ensures that the path determined by the imaging means matches the path at the time of the intervention, however it does not help if the paths are predominantly straight.

[0261] In at least some embodiments, it may be possible to either recover the intrinsic tortuosity or to induce a tortuosity or curvature into the conduit by including a “bend altering device” (BAD) with the conduit or catheter.

[0262] A bend altering device can include active devices such as those actuated by using steering wires, as used to direct the tip of a steerable catheter. Typically they use two or more push-pull wires to actuate the steerable segment of the catheter but multiple mechanical techniques are possible (e.g. Xiaohua Hu, Ang Chen, Yigang Luo, Chris Zhang & Edwin Zhang (2018) Steerable catheters for minimally invasive surgery: a review and future directions, Computer Assisted Surgery, 23:1, 21-41, DOI: 10.1080/24699322.2018.1526972). Active bend altering devices may also be created from piezoelectric devices and fluidically actuated devices. There are many other ways to create bend altering devices some of which may be temporarily or reversibly actuated. Bend altering devices may also be passive devices. In an embodiment curvatures may be induced in the conduit by using a “pre-shaped catheter” as the bend altering device. The pre-shaped catheter may also be a wire, tube, rod or other object but will be referred to as a catheter. The pre-shaped catheter may also be an imaging catheter or a registration catheter. The pre-shaped catheter may contain an intrinsic shape along its length. When it is introduced into the conduit, it will cause the conduit to take at least part of the shape of the pre-shaped catheter. Resistance of the tissue of the conduit and its surrounding matrix may cause the shape of the catheter to differ somewhat from its pre-inserted shape. Being entirely contained within the conduit however, the resultant paths of the catheter and conduit will be the same. Intrinsic shapes of the pre-shaped catheter could include for example, a simple bend, a helix, an S-bend, a straight shape, or a variety of other planar and three dimensional shapes. Three dimensional shapes such as helices may produce better registrations, as may shapes that are contain smooth undulating waves as long as the waveforms can be adequately sampled (e.g. by using position indicating elements) according to, for example, the Nyquist sampling theorem or some other criterion. It is therefore important that the path of the pre-shaped catheter not be too tortuous or it will not be possible to adequately determine its shape using a limited number of position indicating elements. The pre-shaped catheter may also be straight.

[0263] The axial orientation and insertion depth of these catheters is important since it may be necessary to align bends in a particular anatomical direction. Likewise, the location in the conduit that the bend occurs will depend on its insertion depth. In an embodiment, the catheter may have a feature that indicates its axial orientation (i.e. its “roll” angle along the shaft of the device) in an obvious way, such as a hub with some kind of indicator on it. Such an indicator could for example molded or marked on the hub or even marked along the shaft of the catheter, as a line, say. Depth markings or a proximal “stop” (such as item 906 in FIG. 9) may be present on the shaft of the catheter so that it's insertion depth can be measured and maintained. Methods described above may also be employed to ensure the catheter is in the correct position or to optimize or correct for the registration.

[0264] There are a number of ways that exist in the art to pre-shape a catheter. The catheter may be pre-shaped through for example, a molding process in which uncured or melted material is cured or solidified in a particular shape. Pre-shaping the catheter may also be accomplished by embedding “bend-inducing structures” within the catheter (so as to form part of the catheter) which themselves have intrinsic shapes.

[0265] In an embodiment, a bend-inducing structure may also be used to temporarily alter the shape of a standard (not pre-shaped) or pre-shaped catheter. This structure may be removably inserted into, onto, or over the catheter by a user at a convenient time so that when it is applied, it will cause the catheter to bend toward the shape of the bend-inducing structure. If the catheter is in a conduit, it may similarly cause the conduit to alter its shape in the way described by Morris et al. [Morris, K., Lubarda, V., and Talke, E., Design of an esophageal deflection device for use during atrial ablation procedures. J. Materials Research and Technology Volume 9, Issue 6, November-December 2020, p. 13801-13812, DOI: 10.1016/j.jmrt.2020.09.123].

[0266] Bend-inducing structures may be manufactured to have an intrinsic shape and may include strips, wires (including longitudinal tensioning wires), tubes, rods, beams, prisms and other shapes and may be manufactured from metals such as stainless steel or titanium, plastics, composite materials such as carbon fiber-epoxy composites, Kevlar-epoxy, fiberglass, glass, fiber reinforced plastic, wood, and other materials. A combination of materials may also be used, for example a plastic rod combined with a graphite epoxy shell to provide the required material and other properties. Coatings may be applied to the bend-inducing structure to render it biocompatible or impart other properties. Bend-inducing structures may also be created from attaching materials to each other.

[0267] The bend-inducing structure may also include elements constructed from shaped memory alloys (e.g. Nitinol or other shaped memory alloys) which are introduced into the conduit. Once warmed to the transition temperature the element transitions to the tortuous state. They may also be annealed to a super-elastic state in the tortuous path.

[0268] An embodiment is illustrated in FIG. 16 in which the bend-inducing structure is a “pre-shaped” shaft shown as item 1600.

[0269] In an embodiment, the pre-shaped shaft may be permanently incorporated into the catheter e.g. by molding it into the catheter or by attaching it to or into the catheter using an adhesive.

[0270] In an embodiment, the bent portion 1601 of pre-shaped shaft 1600 may be attached to a hub 1602, and may be removably slid onto or inserted into a catheter lumen by a user. Hub 1602 may be made to align the end of the pre-shaped shaft with end of the catheter. The hub may act as a handle for the user to twist or manipulate the pre-shaped shaft and may include an indicator 1603 such as an arrow or line that may be used to assist in adjusting the axial orientation of the pre-shaped shaft. It may also have a mating feature 1604 to engage with a corresponding feature on a catheter. In addition to providing alignment, this feature may at least temporarily fix the catheter to the pre-shaped shaft so that it does not move relative to the catheter once inserted. The tip 1605 may be rounded so it does not catch on the interior of the catheter during insertion.

[0271] The pre-shaped shaft may also be designed to “bottom out” after being placed to a particular depth in or on the catheter that blocks the pre-shaped shaft at particular position in the catheter, and prevents it from extending outside of it. For example, if the distal end of the catheter was sealed, it would prevent the pre-shaped shaft from extending beyond it, and forcing it to a predetermined longitudinal position in the catheter. The pre-shaped shaft may also have a “stop” incorporated to limit its insertion depth or markings along its length (not illustrated) so a user can manually limit it to a preset limit during insertion.

[0272] Note that the action of the pre-shaped shaft differs substantially from that of a conventional guidewire, which is used to direct a catheter to a location by first advancing the guidewire to a location and then pushing the catheter forward over the wire to that location and repeating this process until the catheter is at the desired location. The guidewire is not fixed to the catheter during use.

[0273] The pre-shaped shaft may be made or coated with a lubricious material such as Polytetrafluoroethylene (PTFE) or other lubricious material along its length, and/or coated with a lubricant (for example a fluorosilicone based lubricant or water-soluble lubricant such as MUKO™ (Cardinal Health Canada, Mississauga ON) or other material to facilitate easy insertion and removal from a catheter. The catheter lumen may also be formed from a low coefficient of friction material, coating or treatment. A venting channel may also be present in the pre-shaped shaft to facilitate easy insertion into a closed fluid-filled lumen, or it may be made of smaller diameter than the lumen allowing fluids or lubricant to pass around it.

[0274] The use of the pre-shaped shaft can be illustrated with reference to FIG. 17. Foley Catheter 1700 is illustrated with the retaining balloon 1701 inflated. It contains a central drainage lumen, 1702. As shown catheter 1700 takes a roughly straight shape. This catheter also contains markings 1703 indicating the insertion depth, and the plane and format of the hub 1704 may be used to indicate its axial orientation.

[0275] Once pre-shaped shaft 1705 is inserted down a lumen in the catheter, the catheter and pre-shaped shaft take on a revised shape as indicated in 1706.

[0276] The catheter 1700 may contain multiple lumens. The different lumens may perform different functions. For example a four lumen catheter may have one lumen for inflation, one for drainage, one for position indicating elements or fiducials, and one for the pre-shaped shaft. It may not be necessary to facilitate drainage with this catheter so only three lumens may be required and so the central drainage lumen 1702 may have its vent holes 1707 blocked at the tip to facilitate the insertion of the pre-shaped shaft without having to encounter any urine that otherwise may flow therethrough. It may also be possible to accommodate sensors or position indicating elements in pre-shaped shaft, requiring only a two lumen catheter. Other permutations of lumen configurations and functions may also be used.

[0277] The pre-shaped shaft's hub, 1708, may be aligned to a predetermined orientation, so that for example the indicator arrow 1709 lines up with an alignment feature on the catheter such as the plane formed by the tube exits of three-way connector 1704, marks on the lumen tubing, or a feature molded into the hub of the catheter. The hub may also engage a mating feature on the catheter to ensure it is oriented in a particular direction relative to the catheter. This may be helpful to determine of the orientation of the induced bends once the bend inducing structure is introduced into a catheter or patient where its orientation cannot otherwise be deduced from external observation.

[0278] In an embodiment, a pre-shaped shaft may be introduced into the imaging catheter prior to imaging, inducing all or part of that shape into the conduit and therefore the images.

[0279] In an embodiment, the same or a similar catheter is introduced into the conduit at the time of intervention, recreating the same tortuosity induced at the time of imaging. This may lead to improved accuracy in registration, since the bends of the conduit will be the same as at the time of imaging.

[0280] In an embodiment, if the imaging modality is MRI, the pre-shaped shaft(s) may be made from a plastic, composite material or other non-ferrous material to reduce artifacts.

[0281] In an embodiment, the pre-shaped shaft may include a material that enhances its visibility under an imaging modality. For example, if used with CT or x-ray imaging it may include one or more metal or radio-dense components along its length that provide contrast on these imaging modalities. If the pre-shaped shaft is used together with MRI, it may use MRI visible plastic elements, or contain one or more hollow tube or elements filled with an MRI contrast agent such as water, gadolinium solution (e.g, Omniscan GE Healthcare Marlborough, Mass.), vitamin D or fish oil etc. The pre-shaped shaft may include several spaced encapsulated contrast filled regions along its length. In this way, when the pre-shaped shaft is introduced into the catheter, in addition to altering the shape of the catheter, it makes the catheter act as an imaging catheter. Note that if the catheter contains features such as position indicating elements, it may not be necessary to include them in the pre-shaped shaft.

[0282] In an embodiment, the pre-shaped shaft may include position indicating elements along its length at specific locations. In an embodiment the pre-shaped shaft may be cleaned, sterilized and reused in subsequent procedures. It may also be manufactured as a single use device. These elements may be used for registration or dynamically referencing the conduit for example.

[0283] Such a pre-shaped shaft is depicted in FIG. 18. Item 1800 is an example of a pre-shaped shaft 1801, into which one or more position indicating elements 1802 have been embedded or attached to. The position indicating elements 1802 are connected by wires to a hub, 1803 and to an electric or optical cable 1804 that is in turn connected to a position sensor. Although the position indicating elements are shown as discrete devices, they could also be capable of providing the position and/or orientation continuously along the length of the pre-shaped shaft 1801, such as a fiber Bragg grating sensor system.

[0284] The pre-shaped shaft used at the time of imaging (if used) may have different characteristics, properties, sensors, coatings, materials, fiducials etc. from the pre-shaped shaft used at the time of the interventional procedure. For example, the pre-shaped shaft used during imaging may contain active or passive fiducials while the one used at the time of intervention may include position indicating elements. The two shafts, containing different components, may have different elastic properties so that the assemblage of components ultimately recreates the same catheter path once the pre-shaped shaft is inserted.

[0285] In an embodiment, the catheter or one or more pre-shaped shaft may contain thermal sensors along its lengths enabling it to provide real-time feedback on the temperature of the conduit surrounding the catheter placement. Similarly other sensors, transducers, emitters etc. may be incorporated along the length of the pre-shaped shaft or catheter including pressure sensors, chemical sensors, optical fibers, LEDs, shape sensors, receiver coils for use during MRI imaging, ultrasound transducers etc.

[0286] In an embodiment, the catheter used may be an off-the-shelf Foley catheter (or other catheter) into which the pre-shaped shaft or a pre-shaped shaft together with the embellishments described above is introduced.

[0287] In an embodiment the pre-shaped shaft may contain features that increase the torsional stiffness of the pre-shaped shaft. This may be necessary to ensure that the bending curve imparted by the pre-shaped shaft is known throughout its length once the proximal axial orientation relative to the catheter's proximal end is set. In an embodiment, this may be accomplished by selecting materials with a high torsional stiffness, adding reinforcing fibers or fillers, adjusting the profile of the pre-shaped shaft etc.

[0288] In an embodiment, the lumen in the catheter into which the pre-shaped shaft may be introduced is non-cylindrical matching the same non-cylindrical profile as the pre-shaped shaft used (e.g. both are square in cross section) so that the axial orientation of the pre-shaped shaft is constrained to a particular orientation relative to the catheter.

[0289] In an embodiment, the pre-shaped shaft may serve to temporarily straighten a pre-shaped catheter and then later removed to induce the tortuosity from the pre-shaped catheter. This may facilitate easier insertion and removal of the pre-shaped catheter for example.

[0290] In an embodiment, the entire procedure may be conducted in a single session using for example an interventional MRI, in which the imaging catheter is inserted followed by identification of the catheter path and lesions, followed by registration and intervention according to the methods described above.

[0291] In an embodiment, the pre-shaped shaft may be introduced externally, over a catheter, rather than through a lumen.

[0292] One method of use of the devices described is summarized in FIG. 19. Item 1900 is a flowchart that describes a series of steps for using the catheter. Other methods of use may be used. Steps 1901-1906 may occur prior to the procedure (which is carried out in steps 1907-1918) or they may be carried out in a single combined procedure in an interventional MRI, CT or ultrasound suite for example.

[0293] In step 1901, the imaging catheter is placed into the conduit, such as a urethra, blood vessel, bronchus etc.

[0294] If the conduit lacks tortuosity or it is desirable to recover or alter the tortuosity of the conduit following insertion of the catheter in optional step 1902 a bend inducing structure is introduced into the catheter. In an embodiment, the axial orientation of both the catheter relative to the anatomy and the bend inducing structure relative to the catheter is noted. If the catheter has an intrinsic bend, or the catheter does not significantly alter the tortuosity and the conduit is tortuous enough, this step may not be required. In some cases, the bend inducing structure may include contrast components to make the imaging catheter more visible.

[0295] In step 1903, the tissue with the catheter fixed in place is imaged using the modality of interest. This may include multiparametric MRI (MP-MRI), CT, ultrasound, SPECT, x-ray etc.

[0296] In step 1904, the images are reviewed by a physician or computer algorithm and targets, regions of interest etc. are annotated.

[0297] The organ of interest and surrounding structures of interest are optionally segmented in step 1905. Regions of interest may include targets, organs at risk etc.

[0298] In step 1906, the path of the conduit is determined in image space using for example the images of the catheter or regions of increased/decreased contrast within the catheter.

[0299] At the time of the intervention, at step 1907, the registration catheter is be introduced. It may include position indicating elements, fiducials etc. that render its path visible to the position sensor at the time of the intervention. As before, the position sensor may be another imaging method.

[0300] A bend inducing structure may be introduced in step 1908 with the aim of replicating the anatomy imaged in step 1903. In an embodiment, the axial orientation of both the catheter relative to the anatomy and the bend inducing structure relative to the catheter is made to replicate that of step 1902.

[0301] The positions of the position indicating elements is determined in step 1909 and the path of the conduit is determined in patient space.

[0302] In step 1910, the two paths are registered to obtain a transformation between the two spaces.

[0303] Step 1911 optionally tests the registration, using for example a check fiducial, ultrasound overlay or other methods described previously.

[0304] In step 1912 the template such as a tracked needle is placed in the vicinity of the target.

[0305] In step 1913, the location and orientation of the template are obtained in patient space.

[0306] In step 1914, this information is transformed to image space using the registration transformation calculated in step 1910. As before, the inverse transformation may also be applied to transform the targets in image space to patient space. Information regarding the template's location relative to the target and other structures is shown on the display.

[0307] The physician or user may then adjust the orientation and location of the template to ensure it correlates with the images of the target as indicated in step 1915.

[0308] In step 1916, the depths of insertion etc. are calculated.

[0309] In step 1917 (which may occur throughout the targeting procedure) the position indicating elements may be used to correct for any organ motion.

[0310] Finally in step 1918, the therapy or treatment is performed through or with the template.

[0311] In an embodiment, bend inducing structures may also be used to improve the dynamic referencing of organs or regions of interest. As mentioned above, one use of a catheter containing position indicating elements may be to monitor the location of an organ during a procedure such as a radiation treatment. In situations where the path of the catheter is substantially straight due either to the natural shape of the anatomy or due to the placement of the catheter (which may serve to mask any tortuosity in the conduit), it may not be possible to accurately measure the axial rotation of the organ. By distorting it to include some kind of curvature, accuracy of this degree of freedom can be restored. Thus, introduction of a bend inducing structure such as a pre-shaped shaft into the catheter may increase the accuracy of dynamically referencing the organ of interest.

[0312] Furthermore, if the position indicating elements are contained within the pre-shaped shaft rather than the catheter, there may be advantages in manufacturing the devices. For example, an off-the-shelf catheter may be employed instead of requiring development of a custom version.

[0313] Other implementations, uses and advantages of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The specification should be considered example only.