G06T7/85

System and method for assisting collaborative sensor calibration
11579632 · 2023-02-14 · ·

Embodiments described herein include a method of receiving, by a moving assisting vehicle, a calibration assistance request related to a moving ego vehicle that requested assistance in collaborative calibration of a sensor deployed on the moving ego vehicle. The method further includes analyzing the calibration assistance request to extract at least one of a schedule or an assistance route associated with the requested assistance. The method includes communicating with the moving ego vehicle about a desired location relative to the position of the moving ego vehicle for the moving assisting vehicle to be in order to assist the sensor to acquire information of a target present on the moving assisting vehicle. The method includes facilitating to drive the moving assisting vehicle to reach the desired location to achieve the collaborative calibration of the sensor on the moving ego vehicle.

Image processing device
11582402 · 2023-02-14 · ·

An image processing device includes a rotation processor and an image processor. The rotation processor receives an input image and generates a temporary image according to the input image. The image processor is coupled to the rotation processor and outputs a processed image according to the temporary image, wherein the image processor has a predetermined image processing width, a width of the input image is larger than the predetermined image processing width, and a width of the temporary image is less than the predetermined image processing width.

Image processing system and method thereof for generating projection images based on inward or outward multiple-lens camera
11595574 · 2023-02-28 · ·

An image processing system is disclosed, comprising: an M-lens camera, a compensation device and a correspondence generator. The M-lens camera generates M lens images. The compensation device generates a projection image according to a first vertex list and the M lens images. The correspondence generator is configured to conduct calibration for vertices to define vertex mappings, horizontally and vertically scan each lens image to determine texture coordinates of its image center, determine texture coordinates of control points according to the vertex mappings, and P1 control points in each overlap region in the projection image; and, determine two adjacent control points and a coefficient blending weight for each vertex in each lens image according to the texture coordinates of the control points and the image center in each lens image to generate the first vertex list, where M>=2.

SELF-RECTIFICATION OF STEREO CAMERA
20180007345 · 2018-01-04 ·

Embodiments include a method for self-rectification of a stereo camera, wherein the stereo camera comprises a first camera and a second camera, the method comprises creating image pairs from a first images taken by the first camera and second images taken by the second camera, respectively, such that each image pair comprises two images taken at essentially the same time by the first camera and the second camera, respectively. The method comprises creating, for each image pair, matching point pairs from corresponding points in the two images of each image pair, such that each matching point pair comprises one point from each of the first and second image of the respective image pair. For each matching point pair, a disparity is calculated and a plurality of disparities is created for each image pair, and the resulting plurality of disparities is taken into account for the self-rectification.

Multifunctional Sky Camera System for Total Sky Imaging and Spectral Radiance Measurement
20180013968 · 2018-01-11 ·

A multifunctional sky camera system and techniques for the use thereof for total sky imaging and spectral irradiance/radiance measurement are provided. In one aspect, a sky camera system is provided. The sky camera system includes an objective lens having a field of view of greater than about 170 degrees; a spatial light modulator at an image plane of the objective lens, wherein the spatial light modulator is configured to attenuate light from objects in images captured by the objective lens; a semiconductor image sensor; and one or more relay lens configured to project the images from the spatial light modulator to the semiconductor image sensor. Techniques for use of the one or more of the sky camera systems for optical flow based cloud tracking and three-dimensional cloud analysis are also provided.

USING 6DOF POSE INFORMATION TO ALIGN IMAGES FROM SEPARATED CAMERAS

Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.

NON-RIGID STEREO VISION CAMERA SYSTEM

A long-baseline and long depth-range stereo vision system is provided that is suitable for use in non-rigid assemblies where relative motion between two or more cameras of the system does not degrade estimates of a depth map. The stereo vision system may include a processor that tracks camera parameters as a function of time to rectify images from the cameras even during fast and slow perturbations to camera positions. Factory calibration of the system is not needed, and manual calibration during regular operation is not needed, thus simplifying manufacturing of the system.

METHOD FOR OPERATING A STEREOSCOPIC MEDICAL MICROSCOPE, AND MEDICAL MICROSCOPE

The invention relates to a method for operating a stereoscopic medical microscope, wherein deteriorated and/or invalid calibration data are recognized, wherein for this purpose mutually corresponding image representations of at least one feature arranged in capture regions of cameras of a stereo camera system of the medical microscope are captured by means of the cameras, the captured image representations are evaluated by means of feature-based image processing, wherein the at least one feature is recognized in this case in the captured image representations and a misalignment and/or a decalibration of the cameras of the stereo camera system are/is recognized on the basis of the at least one feature recognized; and wherein at least one measure is carried out depending on an evaluation result. Furthermore, the invention relates to a medical microscope.

Vanishing point stereoscopic image correction
11570425 · 2023-01-31 · ·

Three-dimensional image calibration and presentation for stereoscopic imaging systems such as eyewear including a first camera and a second camera is described. The calibration and presentation includes obtaining a calibration offset using vanishing points obtained from images captured by a first camera and a second camera to accommodate rotation of the first and second cameras with respect to one another, adjusting a three-dimensional rendering offset by the obtained calibration offset, and presenting the stereoscopic images using the three dimension rendering offset.

Image projection method, apparatus, device and storage medium

The present application discloses an image projection method, apparatus, device and storage medium and relates to the field of intelligent transportation, and the specific implementation thereof is: acquiring a first camera coordinate of an area to be calibrated in a camera coordinate system of an AR camera on a vehicle, where the area to be calibrated is located within a photographing range of the AR camera; acquiring a relative conversion relationship between a first extrinsic parameter matrix of the AR camera and a second extrinsic parameter matrix of a head-up display on the vehicle; determining, according to the first camera coordinate and the relative conversion relationship, a second camera coordinate of a projection symbol corresponding to the area to be calibrated in a coordinate system of the head-up display; and controlling, according to the second camera coordinate, the head-up display to project an image including the projection symbol.