Disclosed is an apparatus and method of generating a stitched image. A method of generating a stitched image according to the present disclosure includes: obtaining a plurality of input images; determining whether or not a parallax problem occurs between overlapping areas of the obtained input images; updating a predetermined look-up table according to the determination; and generating a stitched image by applying the updated look-up table to the input images.

A medical registration training component executing within a medical registration system performs a training medical registration operation on a pair of medical studies. Responsive to the medical registration training system determining that the training medical registration operation succeeds, the medical registration training system records a medical registration instance for the pair of medical studies in a medical registration history and marks the medical registration instance as a positive instance in the medical registration history. Responsive to the medical registration training system determining that the training medical registration operation requires correction, the medical registration training system records a medical registration instance for the pair of medical studies in the medical registration history and marks the medical registration instance as a negative instance in the medical registration history. The medical registration training system trains a failure prediction machine learning model based on the medical registration history using machine learning such that the failure prediction machine learning model predicts whether a new medical registration operation will require correction. Responsive to the failure prediction machine learning model predicting that the new medical registration operation will require correction, the mechanism takes steps to automatically correct the new medical registration operation.

A medical registration training component executing within a medical registration system performs a training medical registration operation on a pair of medical studies. Responsive to the medical registration training system determining that the training medical registration operation succeeds, the medical registration training system records a medical registration instance for the pair of medical studies in a medical registration history and marks the medical registration instance as a positive instance in the medical registration history. Responsive to the medical registration training system determining that the training medical registration operation requires correction, the medical registration training system records a medical registration instance for the pair of medical studies in the medical registration history and marks the medical registration instance as a negative instance in the medical registration history. The medical registration training system trains a failure prediction machine learning model based on the medical registration history using machine learning such that the failure prediction machine learning model predicts whether a new medical registration operation will require correction. Responsive to the failure prediction machine learning model predicting that the new medical registration operation will require correction, the mechanism takes steps to automatically correct the new medical registration operation.

An electronic device and associated method place a sticker near a facial region in a digital image. The method detects 2D positions of facial features from a 2D digital image, and calculates a projection matrix from a predetermined 3D reference model having predefined facial feature points that correspond to the 2D detected facial features. The method then selects a digital sticker, and for each corner of the selected digital sticker, uses the projection matrix to transform 3D positions of the corner to corresponding positions on the 2D digital image. The method calculates a refinement matrix defining a correlation of each corner of the selected digital sticker to anchor points in the 2D digital image. Using the refinement matrix, the method calculates updated projected 2D positions and displays the selected sticker on the 2D digital image based on the updated projected 2D positions for each corner point.

Disclosed herein are adapters configured to be optically coupled to a plurality of microscopes, said adapter comprising: a) a first microscope interface configured to optically couple a first microscope to an optical element in optical communication with an optical probe; b) a second microscope interface configured to optically couple a second microscope to the optical element in optical communication with the optical probe; and c) an optical arrangement configured to direct light collected from a sample with aid of the optical probe to (1) the first microscope and second microscope simultaneously, or (2) the first microscope or second microscope selectively.

Disclosed is an image fusion method and apparatus. The fusion method includes detecting first feature points of an object in a first image frame from the first image frame; transforming the first image frame based on the detected first feature points and predefined reference points to generate a transformed first image frame; detecting second feature points of the object in a second image frame from the second image frame; transforming the second image frame based on the detected second feature points and the predefined reference points to generate a transformed second image frame; and generating a combined image by combining the transformed first image frame and the transformed second image frame.

The invention relates to an image processing method and a medical observation device (1) such as a microscope (2) or endoscope. The device and method are used for displaying output image data (54) of soft biological tissue (12). In image-guided surgery, pre-operative three-dimensional image data (6) of the soft biological tissue (12) are elastically matched to interoperative image data (14) which are acquired during surgery. By displaying the elastically matched pre-operative three-dimensional image data (6) together with the interoperative image data (14), the surgeon may be made aware of the consistence of the soft biological tissue (12) below the visible surface layer. Existing systems for image-guided surgery need to be manually readjusted if surgery is done on soft biological tissue (12), which may deform and shift. To avoid this, the device and method according to the invention perform an elastic matching of the pre-operative three-dimensional image data (6) based on the interoperative image data (14) of the soft biological tissue (12). At least one vascular plexus structure (48) is first identified in the interoperative image data (14) and then the same vascular plexus structure (48) is identified in the pre-operative three-dimensional image data (6). The vascular plexus structure (48) in the pre-operative three-dimensional image data (6) is then elastically matched to the vascular plexus structure (48) in the interoperative image data (14). Output image data (54) are generated combining the elastically matched pre-operative three-dimensional image data (6) to the interoperative image data (14). Preferably, the at least one vascular plexus structure (48) is identified using fluorescent light from a fluorophore (22) which has been injected into the soft biological tissue (12).

Systems, computer-implemented methods, apparatus and/or computer program products are provided that facilitate improving the accuracy of global positioning system (GPS) coordinates of indoor photos. The disclosed subject matter further provides systems, computer-implemented methods, apparatus and/or computer program products that facilitate generating exterior photos of structures based on GPS coordinates of indoor photos.

Systems, computer-implemented methods, apparatus and/or computer program products are provided that facilitate improving the accuracy of global positioning system (GPS) coordinates of indoor photos. The disclosed subject matter further provides systems, computer-implemented methods, apparatus and/or computer program products that facilitate generating exterior photos of structures based on GPS coordinates of indoor photos.

A method for stitching images by an electronic device is described. The method includes obtaining at least two images. The method also includes selecting a stitching scheme from a set of stitching schemes based on one or more content measures of the at least two images. The set of stitching schemes includes a first stitching scheme, a second stitching scheme, and a third stitching scheme. The method further includes stitching the at least two images based on a selected stitching scheme.