Methods and systems are provided for processing different-modality digital images of tissue. The method includes, for each image, detecting biological entities in the image and generating an entity graph comprising entity nodes, representing respective biological entities, interconnected by edges representing interactions between entities represented by the entity nodes. The method also includes selecting, from each image, anchor elements comprising elements corresponding to anchor elements of at least one other image, and generating an anchor graph in which anchor nodes, representing respective anchor elements, are interconnected with entity nodes of the entity graph for the image by edges indicating relations between entity nodes and anchor nodes. The method further includes generating a multimodal graph by interconnecting anchor nodes of the anchor graphs for different images via correspondence edges indicating correspondence between anchor nodes, and processing the multimodal graph to output multimodal data, derived from the plurality of images, for medical evaluation.

A method for automated analysis of data obtained from biologic, or non-biologic, material is provided. The method includes extracting, in a visualization of the material, first shapes that combine to form a target shape. The method also includes registering the first shape of the target shape to second shapes of a generic shape, and identifying variations between the first shapes and the second shapes. A system for analyzing biologic material is provided that includes an extraction engine a registration engine an identification engine a display an atlas adapted to provide the generic shape and a database for storing the visualization of the target shape. A non-transitory computer-readable medium storing a program for analyzing biologic material is provided. The program includes instructions that, when executed by a processor, causes a processor to execute the method.

The invention describes a generic framework for hand-eye calibration of camera-guided apparatuses, wherein the rigid 3D transformation between the apparatus and the camera must be determined. An example of such an apparatus is a camera-guided robot.

A processor acquires a plurality of first projection images acquired by imaging an object at a plurality of radiation source positions and acquires a lesion image indicating a lesion. The processor combines the lesion image with the plurality of first projection images on the basis of a geometrical relationship between the plurality of radiation source positions and a position of the lesion virtually disposed in the object to derive a plurality of second projection images. The processor reconstructs the plurality of second projection images to generate a tomographic image including the lesion.

A method is for providing a medical image of a patient, acquired via a computed tomography apparatus. An embodiment of the method includes acquiring first projection data of a first measurement region; acquiring second projection data of a second measurement region; registering a reference image to the at least one respiration-correlated image of the patient, wherein the reference image corresponds to the at least one functional image of the patient or is reconstructed under a second reconstruction rule from the second projection data, to produce a deformation model; applying the deformation model to the at least one functional image of the patient; combining the at least one functional image of the patient, deformed by the applying of the deformation model, with the at least one respiration-correlated image of the patient, to produce the medical image of the patient; and providing the medical image of the patient.

A method of providing user guidance. First patient image data of a patient's body is obtained. A registration instruction indicative of where to acquire a registration point relative to a surface of the body is determined. Second patient image data of the body, having been acquired by an augmented reality device, is obtained. A transformation between coordinate systems of the first and the second patient image data is determined. Based on the transformation, display of the registration instruction on a display of the AR device is triggered such that a user of the AR device is presented an augmented view with the registration instruction being overlaid onto the patient's body. The augmented view guides the user where to acquire the registration point. Also disclosed are a computing system, a surgical navigation system, and a computer program product.

A system for patient cardiac imaging and tissue modeling. The system includes a patient imaging device that can acquire patient cardiac imaging data. A processor is configured to receive the cardiac imaging data. A user interface and display allow a user to interact with the cardiac imaging data. The processor includes fat identification software conducting operations to interact with a trained learning network to identify fat tissue in the cardiac imaging data and to map fat tissue onto a three-dimensional model of the heart. A preferred system uses an ultrasound imaging device as the patient imaging device. Another preferred system uses an MRI or CT image device as the patient imaging device.

In one aspect, a vehicle localization system implements the following steps: receiving a predetermined road map; receiving at least one captured image from an image capture device of a vehicle; processing, by a road detection component, the at least one captured image, to identify therein road structure for matching with corresponding structure of the predetermined road map, and determine a location of the vehicle relative to the identified road structure; and using the determined location of the vehicle relative to the identified road structure to determine a location of the vehicle on the road map, by matching the road structure identified in the at least one captured image with the corresponding road structure of the predetermined road map.

A method of continuously registering a model of anatomic passageways to a patient space includes: collecting a set of measured points along a flexible catheter as the catheter is inserted into the passageways, the measured points based on a shape of the catheter; assigning each measured point to a respective subset of a plurality of subsets based upon a depth of each measured point within the passageways; comparing the plurality of subsets to identify a first optimal subset; registering the model to the patient space based on a set of model points and the first optimal subset; collecting additional measured points; updating the plurality of subsets by assigning each additional measured point to a respective subset; comparing, after the updating, the plurality of subsets to identify a second optimal subset; and registering the model to the patient space based on the set of model points and the second optimal subset.

Disclosed are systems and methods of lymphatic specimen tracking, visualization, and lymph node drainage pathway determination. An exemplary method includes receiving computed tomographic (CT) image data corresponding to a CT scan, generating a three-dimensional (3D) model of at least a portion of a patient's body based on the CT image data, identifying one or more lymph nodes in the 3D model, performing a registration of the 3D model with one or more physical locations in the patient's body, determining an expected lymph node drainage pathway away from a region of interest through one or more lymph nodes, and displaying the 3D model and the expected lymph node drainage pathway.