A method comprises obtaining an endoscopic image dataset of a patient anatomy from an endoscopic imaging system and retrieving an anatomic model dataset of the patient anatomy obtained by an anatomic imaging system. The method also comprises mapping the endoscopic image dataset to the anatomic model dataset and displaying a first vantage point image using the mapped endoscopic image dataset. The first vantage point image is presented from a first vantage point at a distal end of the endoscopic imaging system. The method also comprises displaying a second vantage point image using at least a portion of the mapped endoscopic image dataset. The second vantage point image is presented from a second vantage point, different from the first vantage point.

A system and method for capturing a location based experience at an event including a plurality of mobile devices having a camera employed near a point of interest to capture random, crowdsourced images and associated metadata near said point of interest. In a preferred form, the images include depth camera information from prepositioned devices around the point of interest during the event. A network communicates images, depth information, and metadata to build a 3D model of the region, preferably with the location of contributors known. Users connect to this experience platform to view the 3D model from a user selected location and orientation and to participate in experiences with, for example, a social network.

An image display method executed by a processor comprises displaying a screen including a two-dimensional fundus image of an examined eye and a three-dimensional eyeball image of the examined eye, finding a second region in the three-dimensional eyeball image that corresponds to a first region specified in the two-dimensional fundus image, and displaying a mark indicating the second region in the three-dimensional eyeball image.

A method, device, and computer readable medium for displaying a two-dimensional image of a viewed object simultaneously with an image depicting a three-dimensional geometry of the viewed object using a video inspection device is disclosed. The video inspection device displays a two-dimensional image of the object surface of a viewed object, and determines the three-dimensional coordinates of a plurality of surface points. At least one rendered image of the three-dimensional geometry of the viewed object is displayed simultaneously with the two-dimensional image. As measurement cursors are placed and moved on the two-dimensional image, the rendered image of the three-dimensional geometry of the viewed object is automatically updated.

A system, method or compute program product for generating composite images. One of the systems includes a capture device to capture an image of a physical environment; and one or more storage devices storing instructions that are operable, when executed by one or more processors of the system, to cause the one or more processors to: obtain an image of the physical environment as captured by the capture device, identify a visually-demarked region on a surface in the physical environment as depicted in the image, process the image to generate a composite image of the physical environment that includes a depiction of a virtual object, wherein a location of the depiction of the virtual object in the composite image is based on a location of the depiction of the visually-demarked region in the image, and cause the composite image to be displayed for a user.

A method comprises obtaining an endoscopic image dataset of a patient anatomy from an endoscopic imaging system and retrieving an anatomic model dataset of the patient anatomy obtained by an anatomic imaging system. The method also comprises mapping the endoscopic image dataset to the anatomic model dataset and displaying a first vantage point image using the mapped endoscopic image dataset. The first vantage point image is presented from a first vantage point at a distal end of the endoscopic imaging system. The method also comprises displaying a second vantage point image using at least a portion of the mapped endoscopic image dataset. The second vantage point image is presented from a second vantage point, different from the first vantage point.

The embodiments of the present disclosure disclose an augmented reality system that supports customized multi-channel interaction. One embodiment of the augmented reality system comprises: a head-mounted sensor assembly, a computing device, and a display module; the head-mounted sensor assembly is used to capture the user's multi-channel interactive input information and transmit the interactive input information to the computing device; the computing device is used to generate or modify the display content of the augmented reality according to the interactive input information; the display module is used to overlay display the background content with the display content of the augmented reality. The augmented reality system, by arranging the display module to the far end of the head-mounted sensor assembly, can simplify the structure of the head-mounted sensor assembly, and reduce the weight of the head-mounted sensor assembly, providing convenience for installing other sensors.

A computer-implemented method for performing at least one measurement in an anatomical vessel structure in an imaging region, the vessel structure comprising multiple vessels of interest for the measurement, the method comprises receiving a three-dimensional image data set of the imaging region; determining a two-dimensional unfolded image of the vessel structure from the image data set; displaying the unfolded image to the user; determining at least one landmark in the vessel structure and visualizing the at least one landmark at a corresponding landmark position in the unfolded image; performing the at least one measurement based on the at least one landmark and the three-dimensional image data set; and displaying the result of the at least one measurement in the unfolded image in a user presentation or together with the unfolded image in the user presentation.

A volumetric content is encoded as a set of clusters by an encoder and transmitted to a decoder which retrieves the volumetric content. Clusters common to different viewpoints are obtained and mutualized. Clusters are projected onto 2D images and encoded as independent video streams. Reduction in visual artefacts and reduction of data for storage and streaming are achieved.

A medical system comprises a display system, a user input device, and a control system communicatively coupled to the display system and the user input device. The control system is configured to display image data of an anatomical region via the display system, determine a target location in the anatomical region, and determine an anatomical boundary based on the target location. The anatomical boundary indicates a surface of an anatomical structure in the anatomical region. The control system is further configured to determine a trajectory zone around a path between an exit point and the target location. The control system is further configured to determine a zone boundary based on an intersection of the trajectory zone with the anatomical boundary.