Methods to solve the problem of performing fusion of images acquired with two cameras with different type sensors, for example a visible (VIS) digital camera and an short wave infrared (SWIR) camera, include performing image space equalization on images acquired with the different type sensors before performing rectification and registration of such images in a fusion process.

The present disclosure provides a method for modifying pairs of images for improved three-dimensional displaying. The method comprises analyzing the images for detecting the angle of incidence of the illuminating light in the images, and modifying the luminance values of at least a section of at least one of the images of each pair based on the angle of incidence and anatomical details of a human face. Further, the present invention provides a respective apparatus.

The present disclosure provides a method for modifying pairs of images for improved three-dimensional displaying. The method comprises analyzing the images for detecting the angle of incidence of the illuminating light in the images, and modifying the luminance values of at least a section of at least one of the images of each pair based on the angle of incidence and anatomical details of a human face. Further, the present invention provides a respective apparatus.

A medical/surgical microscope with two cameras configured to capture two dimensional images of specimens being observed. The medical/surgical microscope is secured to a control apparatus configured to adjust toe-in of the two cameras to insure the convergence of the images. The medical/surgical microscope includes a computer system with a non-transitory memory apparatus for storing computer program code configured for digitally rendering real-world medical/surgical images. The medical/surgical microscope has an illumination system with controls for focusing and regulating the lighting of a specimen. The medical/surgical microscope is configured for real-time video display with the function of recording and broadcasting simultaneously during surgery.

A medical/surgical microscope with two cameras configured to capture two dimensional images of specimens being observed. The medical/surgical microscope is secured to a control apparatus configured to adjust toe-in of the two cameras to insure the convergence of the images. The medical/surgical microscope includes a computer system with a non-transitory memory apparatus for storing computer program code configured for digitally rendering real-world medical/surgical images. The medical/surgical microscope has an illumination system with controls for focusing and regulating the lighting of a specimen. The medical/surgical microscope is configured for real-time video display with the function of recording and broadcasting simultaneously during surgery.

A multi-camera zoom control method and apparatus, and an electronic system and a storage medium. The method includes: in the process of a first camera collecting an image, if the current set magnification input by a user is in a magnification transition zone, starting a second camera; acquiring a corresponding stereo correction matrix on the basis of calibration parameters of the first camera and the second camera; calculating a translation matrix on the basis of an acquired pixel position corresponding relationship between the same content regions of interest that correspond to a first zoomed image and a second zoomed image and in combination with the current set magnification, and then calculating a smooth transition transformation matrix in combination with the stereo correction matrix; and performing, by applying the smooth transition transformation matrix, affine transformation on an image output by the first camera, to obtain a display image of a device.

Implementations of a compressive light field projection system are disclosed herein. In one embodiment, the compressive light field projection system utilizes a pair of light modulators, such as digital micromirror devices (DMDs), that interact to produce a light field. The light field is then projected via a projection lens onto a screen, which may be an angle expanding projection screen that includes a Fresnel lens for straightening the views of the light field and either a double lenticular array of Keplerian lens pairs or a single lenticular, for increasing the field of view. In addition, compression techniques are disclosed for generating patterns to place on the pair of light modulators so as to reduce the number of frames needed to recreate a light field.

Implementations of a compressive light field projection system are disclosed herein. In one embodiment, the compressive light field projection system utilizes a pair of light modulators, such as digital micromirror devices (DMDs), that interact to produce a light field. The light field is then projected via a projection lens onto a screen, which may be an angle expanding projection screen that includes a Fresnel lens for straightening the views of the light field and either a double lenticular array of Keplerian lens pairs or a single lenticular, for increasing the field of view. In addition, compression techniques are disclosed for generating patterns to place on the pair of light modulators so as to reduce the number of frames needed to recreate a light field.

A method includes receiving video data of a user, the video data comprising a first captured image and a second captured image, generating a two-dimensional planar proxy of the user, determining a pose comprising a location and orientation of the two-dimensional planar proxy within a three-dimensional virtual environment, rendering one or more display images for one or more displays of an artificial-reality device based on the two-dimensional planar proxy having the determined pose and at least one of the first and second captured images, displaying the rendered one or more display images using the one or more displays, respectively, determining that a viewing angle of the artificial-reality device relative to the two-dimensional planar proxy exceeds a predetermined maximum threshold, and based on the determination that the viewing angle exceeds the predetermined maximum threshold, ceasing to display the one or more display images.

A method for automatic selection of viewpoint characteristics and trajectories in volumetric video presentations includes receiving a plurality of video streams depicting a scene, wherein the plurality of video streams provides images of the scene from a plurality of different viewpoints, identifying a set of desired viewpoint characteristics for a volumetric video traversal of the scene, determining a trajectory through the plurality of video streams that is consistent with the set of desired viewpoint characteristics, rendering a volumetric video traversal that follows the trajectory, wherein the rendering comprises compositing the plurality of video streams, and publishing the volumetric video traversal for viewing on a user endpoint device.