A method and an apparatus for generating an initial superpixel label map for a current image from an image sequence are described. The apparatus includes a feature detector that determines features in the current image. A feature tracker then tracks the determined features back into a previous image. Based on the tracked features a transformer transforms a superpixel label map associated to the previous image into an initial superpixel label map for the current image.

Embodiments of the present application relate to a method, apparatus, and system for detecting a specified image identifier. The method includes retrieving a target image to be detected from a predetermined area, binarizing the target image to be detected to obtain a target binary image to be detected, calibrating connected domains of the target binary image to be detected, successively retrieving image features of candidate connected domains, and comparing the image features corresponding to the candidate connected domains to image features of a standard specified identifier image, wherein the candidate connected domains are determined based at least in part on the calibration of the connected domains, and determining a candidate connected domain as the location of the specified identifier image based at least in part on the comparison of the image features corresponding to the candidate connected domains to image features of the standard specified identifier image.

Embodiments of the present application relate to a method, apparatus, and system for detecting a specified image identifier. The method includes retrieving a target image to be detected from a predetermined area, binarizing the target image to be detected to obtain a target binary image to be detected, calibrating connected domains of the target binary image to be detected, successively retrieving image features of candidate connected domains, and comparing the image features corresponding to the candidate connected domains to image features of a standard specified identifier image, wherein the candidate connected domains are determined based at least in part on the calibration of the connected domains, and determining a candidate connected domain as the location of the specified identifier image based at least in part on the comparison of the image features corresponding to the candidate connected domains to image features of the standard specified identifier image.

There is provided a method for registration of intravital anatomical imaging modality image data and nuclear medicine image data of a patient's heart comprising: obtaining anatomical image data including a heart of a patient outputted by an anatomical intravital imaging modality; obtaining at least one nuclear medicine image data outputted by a nuclear medicine imaging modality, the nuclear medicine image data including the heart of the patient; identifying a segmentation of a network of vessels of the heart in the anatomical image data; identifying a contour of at least part of the heart in the nuclear medicine image data, the contour including at least one muscle wall border of the heart; correlating between the segmentation and the contour; registering the correlated segmentation and the correlated contour to form a registered image of the anatomical image data and the nuclear medicine image data; and providing the registered image for display.

There is provided a method for registration of intravital anatomical imaging modality image data and nuclear medicine image data of a patient's heart comprising: obtaining anatomical image data including a heart of a patient outputted by an anatomical intravital imaging modality; obtaining at least one nuclear medicine image data outputted by a nuclear medicine imaging modality, the nuclear medicine image data including the heart of the patient; identifying a segmentation of a network of vessels of the heart in the anatomical image data; identifying a contour of at least part of the heart in the nuclear medicine image data, the contour including at least one muscle wall border of the heart; correlating between the segmentation and the contour; registering the correlated segmentation and the correlated contour to form a registered image of the anatomical image data and the nuclear medicine image data; and providing the registered image for display.

A system and method of detecting damage to a component may include a first sensor and a processor. The method may include the steps of receiving, by the processor, a first data for the component from a first sensor, aligning, by the processor, the first data with a reference model, determining, by the processor, a feature dissimilarity between the first data and the reference model, classifying, by the processor, the feature dissimilarity, and determining, by the processor, a probability that the feature dissimilarity indicates damage to the component.

Embodiments allow live action images from an image capture device to be composited with computer generated images in real-time or near real-time. The two types of images (live action and computer generated) are composited accurately by using a depth map. In an embodiment, the depth map includes a “depth value” for each pixel in the live action image. In an embodiment, steps of one or more of feature extraction, matching, filtering or refinement can be implemented, at least in part, with an artificial intelligence (AI) computing approach using a deep neural network with training. A combination of computer-generated (“synthetic”) and live-action (“recorded”) training data is created and used to train the network so that it can improve the accuracy or usefulness of a depth map so that compositing can be improved.

A method comprising: obtaining a three-dimensional (3D) point cloud about an object; obtaining binary feature descriptors for feature points in a 2D image about the object; assigning a plurality of index values for each feature point as multiple bits of the corresponding binary feature descriptor; storing the binary feature descriptor in a table entry of a plurality of hash key tables of a database image; obtaining query binary feature descriptors for feature points in a query image; matching the query binary feature descriptors to the binary feature descriptors of the database image; reselecting one bit of the hash key of the matched database image; and re-indexing the feature points in the table entries of the hash key table of the database image.

Provided is an image processing device including a matching unit that performs matching processing between a predetermined pattern on a surface of a 3D model of a biological tissue including an operating site generated on the basis of a preoperative diagnosis image and a predetermined pattern on a surface of the biological tissue included in a captured image during surgery, a shift amount estimation unit that estimates an amount of deformation from a preoperative state of the biological tissue on the basis of a result of the matching processing and information regarding a three-dimensional position of a photographing region which is a region photographed during surgery on the surface of the biological tissue, and a 3D model update unit that updates the 3D model generated before surgery on the basis of the estimated amount of deformation of the biological tissue.

Implementations relate to detecting/replacing transient obstructions from high-elevation digital images. A digital image of a geographic area includes pixels that align spatially with respective geographic units of the geographic area. Analysis of the digital image may uncover obscured pixel(s) that align spatially with geographic unit(s) of the geographic area that are obscured by transient obstruction(s). Domain fingerprint(s) of the obscured geographic unit(s) may be determined across pixels of a corpus of digital images that align spatially with the one or more obscured geographic units. Unobscured pixel(s) of the same/different digital image may be identified that align spatially with unobscured geographic unit(s) of the geographic area. The unobscured geographic unit(s) also may have domain fingerprint(s) that match the domain fingerprint(s) of the obscured geographic unit(s). Replacement pixel data may be calculated based on the unobscured pixels and used to generate a transient-obstruction-free version of the digital image.