A method for implementing a dynamic three-dimensional lung map view for navigating a probe inside a patient's lungs includes loading a navigation plan into a navigation system, the navigation plan including a planned pathway shown in a 3D model generated from a plurality of CT images, inserting the probe into a patient's airways, registering a sensed location of the probe with the planned pathway, selecting a target in the navigation plan, presenting a view of the 3D model showing the planned pathway and indicating the sensed location of the probe, navigating the probe through the airways of the patient's lungs toward the target, iteratively adjusting the presented view of the 3D model showing the planned pathway based on the sensed location of the probe, and updating the presented view by removing at least a part of an object forming part of the 3D model.

A method of detecting and diagnosing cancers characterized by the presence of at least one nodule/neoplasm from an imaging scan is presented. To detect nodules in an imaging scan, a 3D CNN using a single feed forward pass of a single network is used. After detection, risk stratification is performed using a supervised or an unsupervised deep learning method to assist in characterizing the detected nodule/neoplasm as benign or malignant. The supervised learning method relies on a 3D CNN used with transfer learning and a graph regularized sparse MTL to determine malignancy. The unsupervised learning method uses clustering to generate labels after which label proportions are used with a novel algorithm to classify malignancy. The method assists radiologists in improving detection rates of lung nodules to facilitate early detection and minimizing errors in diagnosis.

A method includes manipulating segmented structure of interest, which is segmented from first reconstructed image data at a reference motion phase of interest, that is registered to second reconstructed image data at one or more other motion phases. The method further includes updating initial motion vector fields corresponding to the registration of the segmented structure of interest to the second reconstructed image data based on the manipulation. The method further includes reconstructing the projection data with a motion compensated reconstruction algorithm employing the updated motion vector fields.

A method for implementing a dynamic three-dimensional lung map view for navigating a probe inside a patient's lungs includes loading a navigation plan into a navigation system, the navigation plan including a planned pathway shown in a 3D model generated from a plurality of CT images, inserting the probe into a patient's airways, registering a sensed location of the probe with the planned pathway, selecting a target in the navigation plan, presenting a view of the 3D model showing the planned pathway and indicating the sensed location of the probe, navigating the probe through the airways of the patient's lungs toward the target, iteratively adjusting the presented view of the 3D model showing the planned pathway based on the sensed location of the probe, and updating the presented view by removing at least a part of an object forming part of the 3D model.

A method for analyzing an anatomical structure of a patient may include the steps of receiving volumetric scan data representative of one or more features of an anatomical structure; mapping the features to a node tree diagram; and displaying the node tree diagram. The features can comprise branching points, pathways connecting the branching points, and location data of the branching points and pathways. The node tree diagram may comprise a plurality of nodes and branches representing the branching points and pathways in the anatomical structure, respectively. The plurality of nodes may comprise a root node representing a root branching point as well as additional nodes representing additional branching points. Additionally, the node tree diagram may comprise a first set of one or more regions, wherein each region encompasses a respective portion of the node tree diagram and is representative of a defined portion of the anatomical structure.

A processor acquires a three-dimensional image of a subject, acquires a radiation image of the subject having a lumen structure into which an endoscope is inserted, acquires a first real endoscopic image in the lumen structure of the subject captured at a first time point by the endoscope, derives a provisional virtual viewpoint in the three-dimensional image of the endoscope using the radiation image and the three-dimensional image, derives a virtual viewpoint at the first time point in the three-dimensional image of the endoscope using the provisional virtual viewpoint, the first real endoscopic image, and the three-dimensional image, and derives a virtual viewpoint at a second time point after the first time point in the three-dimensional image of the endoscope using the first real endoscopic image and a second real endoscopic image captured by the endoscope at the second time point.

A method for implementing a dynamic three-dimensional lung map view for navigating a probe inside a patient's lungs includes loading a navigation plan into a navigation system, the navigation plan including a planned pathway shown in a 3D model generated from a plurality of CT images, inserting the probe into a patient's airways, registering a sensed location of the probe with the planned pathway, selecting a target in the navigation plan, presenting a view of the 3D model showing the planned pathway and indicating the sensed location of the probe, navigating the probe through the airways of the patient's lungs toward the target, iteratively adjusting the presented view of the 3D model showing the planned pathway based on the sensed location of the probe, and updating the presented view by removing at least a part of an object forming part of the 3D model.

Systems and method are described for determining a malignancy of a nodule. A medical image of a nodule of a patient is received. A patch surrounding the nodule is identified in the medical image. A malignancy of the nodule in the patch is predicted using a trained deep image-to-image network.

A local extension method for segmentation of anatomical treelike structures includes receiving an initial segmentation of 3D image data including an initial treelike structure. A target point in the 3D image data is defined, and a region of interest based on the target point is extracted to create a sub-image. Highly tubular voxels are detected in the sub-image, and a spillage-constrained region growing is performed using the highly tubular voxels as seed points. Connected components are extracted from the results of the region growing. The extracted components are pruned to discard components not likely to be connected to the initial treelike structure, keeping only candidate components likely to be a valid sub-tree of the initial treelike structure. The candidate components are connected to the initial treelike structure, thereby extending the initial segmentation in the region of interest.

Evaluation of segmentation of medical imagery is provided. In various embodiments, a candidate segmentation of a medical image of an anatomical feature is received. The candidate segmentation is provided to a first trained classifier. An indication is received from the first trained classifier of the accuracy of the candidate segmentation based on one or more feature of the candidate segmentation. One or more prior segmentation of a prior medical image of the anatomical feature is received. The candidate segmentation and the one or more prior segmentation are provided to a second trained classifier. An indication is received from the second trained classifier of the accuracy of the candidate segmentation based on one or more feature of the one or more prior segmentation.