Patent classifications
G06T7/80
MODEL GENERATION METHOD AND APPARATUS BASED ON MULTI-VIEW PANORAMIC IMAGE
The disclosure provides a model generation method based on a multi-view panoramic image, including: calculating an image rectification rotation matrix of source images and a reference image; extracting a reference image feature of the reference image and source image features of the source images; performing a fusion operation on rectified cost volumes of the plurality of source images corresponding to the reference image to obtain a final cost volume; calculating an estimated phase difference under a set resolution; obtaining a final phase difference of the reference image; and generating a depth map of the reference image, and constructing a corresponding stereo vision model.
MODEL GENERATION METHOD AND APPARATUS BASED ON MULTI-VIEW PANORAMIC IMAGE
The disclosure provides a model generation method based on a multi-view panoramic image, including: calculating an image rectification rotation matrix of source images and a reference image; extracting a reference image feature of the reference image and source image features of the source images; performing a fusion operation on rectified cost volumes of the plurality of source images corresponding to the reference image to obtain a final cost volume; calculating an estimated phase difference under a set resolution; obtaining a final phase difference of the reference image; and generating a depth map of the reference image, and constructing a corresponding stereo vision model.
APPARATUS, METHOD AND COMPUTER PROGRAM FOR MONITORING A SUBJECT DURING A MEDICAL IMAGING PROCEDURE
The invention refers to an apparatus for monitoring a subject (121) during an imaging procedure, e.g. CT-imaging The apparatus (110) comprises a monitoring image providing unit (111) providing a first monitoring image and a second monitoring image acquired at different support positions, a monitoring position providing unit (112) providing a first monitoring position of a region of interest in the first monitoring image, a support position providing unit (113) providing support position data of the support positions, a position map providing unit (114) providing a position map mapping calibration support positions to calibration monitoring positions, and a region of interest position determination unit (115) determining a position of the region of interest in the second monitoring image based on the first monitoring position, the support position data, and the position map. This allows to determine the position of the region of interest accurately and with low computational effort.
APPARATUS, METHOD AND COMPUTER PROGRAM FOR MONITORING A SUBJECT DURING A MEDICAL IMAGING PROCEDURE
The invention refers to an apparatus for monitoring a subject (121) during an imaging procedure, e.g. CT-imaging The apparatus (110) comprises a monitoring image providing unit (111) providing a first monitoring image and a second monitoring image acquired at different support positions, a monitoring position providing unit (112) providing a first monitoring position of a region of interest in the first monitoring image, a support position providing unit (113) providing support position data of the support positions, a position map providing unit (114) providing a position map mapping calibration support positions to calibration monitoring positions, and a region of interest position determination unit (115) determining a position of the region of interest in the second monitoring image based on the first monitoring position, the support position data, and the position map. This allows to determine the position of the region of interest accurately and with low computational effort.
ACTIVE ALIGNMENT OF AN OPTICAL ASSEMBLY WITH INTRINSIC CALIBRATION
Provided are methods for active alignment of an optical assembly with intrinsic calibration. Some methods described include performing a first active alignment using a multi-collimator assembly, determining a principal point of the camera assembly using a diffractive optical element (DOE) intrinsic calibration module, and adjusting the relative position of one or more of the lens and the image sensor to align the principal point of the camera assembly with an image center of the image sensor and to perform a second active alignment. Systems and computer program products are also provided.
ACTIVE ALIGNMENT OF AN OPTICAL ASSEMBLY WITH INTRINSIC CALIBRATION
Provided are methods for active alignment of an optical assembly with intrinsic calibration. Some methods described include performing a first active alignment using a multi-collimator assembly, determining a principal point of the camera assembly using a diffractive optical element (DOE) intrinsic calibration module, and adjusting the relative position of one or more of the lens and the image sensor to align the principal point of the camera assembly with an image center of the image sensor and to perform a second active alignment. Systems and computer program products are also provided.
USING 6DOF POSE INFORMATION TO ALIGN IMAGES FROM SEPARATED CAMERAS
Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.
VISUAL INERTIAL ODOMETRY WITH MACHINE LEARNING DEPTH
Disclosed is a method including receiving a depth map estimated using data based on image and data received from a movement sensor as input, generating an alignment parameter based on the depth map, adding the alignment parameter to a pre-calibration state to define a user operational calibration state, generating scale parameters and shift parameters based on features associated with the data received from the image and movement sensor, and calibrating the image and movement sensor based on the user operational calibration state, the scale parameters and the shift parameters.
VISUAL INERTIAL ODOMETRY WITH MACHINE LEARNING DEPTH
Disclosed is a method including receiving a depth map estimated using data based on image and data received from a movement sensor as input, generating an alignment parameter based on the depth map, adding the alignment parameter to a pre-calibration state to define a user operational calibration state, generating scale parameters and shift parameters based on features associated with the data received from the image and movement sensor, and calibrating the image and movement sensor based on the user operational calibration state, the scale parameters and the shift parameters.
NON-RIGID STEREO VISION CAMERA SYSTEM
A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.