Patent classifications
H04N13/25
Hybrid sensor system and method for providing 3D imaging
Provided is a 3D depth sensing system and method of providing an image based on a hybrid sensing array. The 3D sensing system including a light source configured to emit light, a hybrid sensing array comprising a 2D sensing region configured to detect ambient light reflected from an object and a 3D depth sensing region configured to detect the light emitted by the light source and reflected from the object, a metalens on the hybrid sensing array, the metalens being configured to direct the ambient light reflected from the object towards the 2D sensing region, and to direct the light emitted by the light source and reflected from the object towards the 3D depth sensing region, and a processing circuit configured to combine 2D image information provided by the 2D sensing region and 3D information provided by the 3D depth sensing region to generate a combined 3D image.
Hybrid sensor system and method for providing 3D imaging
Provided is a 3D depth sensing system and method of providing an image based on a hybrid sensing array. The 3D sensing system including a light source configured to emit light, a hybrid sensing array comprising a 2D sensing region configured to detect ambient light reflected from an object and a 3D depth sensing region configured to detect the light emitted by the light source and reflected from the object, a metalens on the hybrid sensing array, the metalens being configured to direct the ambient light reflected from the object towards the 2D sensing region, and to direct the light emitted by the light source and reflected from the object towards the 3D depth sensing region, and a processing circuit configured to combine 2D image information provided by the 2D sensing region and 3D information provided by the 3D depth sensing region to generate a combined 3D image.
Multi-camera image capture system
A dual-camera image capture system may include a first light source, disposed above a target area, a first mobile unit, configured to rotate around the target area, and a second mobile unit, operatively coupled to the first mobile unit, configured to move vertically along the first mobile unit. The dual-camera image capture system may further include a second light source, operatively coupled to the second mobile unit and a dual-camera unit, operatively coupled to the second mobile unit. The dual-camera image capture system may include a first camera configured to capture structural data and a second camera configured to capture color data. The first mobile unit and the second mobile unit may be configured to move the first camera and the second camera to face the target area in a variety of positions around the target area.
Multi-camera image capture system
A dual-camera image capture system may include a first light source, disposed above a target area, a first mobile unit, configured to rotate around the target area, and a second mobile unit, operatively coupled to the first mobile unit, configured to move vertically along the first mobile unit. The dual-camera image capture system may further include a second light source, operatively coupled to the second mobile unit and a dual-camera unit, operatively coupled to the second mobile unit. The dual-camera image capture system may include a first camera configured to capture structural data and a second camera configured to capture color data. The first mobile unit and the second mobile unit may be configured to move the first camera and the second camera to face the target area in a variety of positions around the target area.
HETEROGENEOUS VEHICLE CAMERA STEREO PAIR SYSTEM AND METHOD FOR DEPTH ESTIMATION
A stereo pair camera system for depth estimation, including: a first camera disposed in a first position along a longitudinal axis, a lateral axis, and a vertical axis and having a first field of view; and a second camera disposed in a second position along the longitudinal axis, the lateral axis, and the vertical axis and having a second field of view; wherein the first camera is a of a first type and the second camera is of a second type that is different from the first type; and wherein the first field of view overlaps with the second field of view. Optionally, the first position is spaced apart from the second position along one or more of the longitudinal axis and the vertical axis. The depth estimation is used by one or more of a driver assist system and an autonomous driving system of a vehicle.
HETEROGENEOUS VEHICLE CAMERA STEREO PAIR SYSTEM AND METHOD FOR DEPTH ESTIMATION
A stereo pair camera system for depth estimation, including: a first camera disposed in a first position along a longitudinal axis, a lateral axis, and a vertical axis and having a first field of view; and a second camera disposed in a second position along the longitudinal axis, the lateral axis, and the vertical axis and having a second field of view; wherein the first camera is a of a first type and the second camera is of a second type that is different from the first type; and wherein the first field of view overlaps with the second field of view. Optionally, the first position is spaced apart from the second position along one or more of the longitudinal axis and the vertical axis. The depth estimation is used by one or more of a driver assist system and an autonomous driving system of a vehicle.
Stereoscopic image capturing systems
A stereoscopic imager system, comprising: a sensor array comprising a first plurality of photosensors and a second plurality of photosensors spaced apart from the first plurality of photosensors by a gap, the first plurality of photosensors and the second plurality of photosensors being configured to detect ambient light in a scene; a moving component coupled to the sensor array and operable to move the sensor array between a first position and a second position within a full rotational image capturing cycle; and a system controller coupled to the sensor array and the moving component. The system controller can be configured to: move a field of view of a sensor array by instructing the moving component to capture a first image of an object in the scene with the first plurality of photosensors from a first perspective at the first position, and to capture a second image of the scene of the object in the scene with the second plurality of photosensors from a second perspective at the second position; and calculate, based on the first image and the second image, a distance to the object using an optical baseline defined by the gap.
Stereoscopic image capturing systems
A stereoscopic imager system, comprising: a sensor array comprising a first plurality of photosensors and a second plurality of photosensors spaced apart from the first plurality of photosensors by a gap, the first plurality of photosensors and the second plurality of photosensors being configured to detect ambient light in a scene; a moving component coupled to the sensor array and operable to move the sensor array between a first position and a second position within a full rotational image capturing cycle; and a system controller coupled to the sensor array and the moving component. The system controller can be configured to: move a field of view of a sensor array by instructing the moving component to capture a first image of an object in the scene with the first plurality of photosensors from a first perspective at the first position, and to capture a second image of the scene of the object in the scene with the second plurality of photosensors from a second perspective at the second position; and calculate, based on the first image and the second image, a distance to the object using an optical baseline defined by the gap.
System and methods for correcting image data of distinct images and generating and stereoscopic three-dimensional images
An optical imaging system for imaging a target during a medical procedure, the optical imaging system involving a first camera for capturing a first image of the target, a second wide-field camera for capturing a second image of the target, at least one optional path folding mirror disposed in an optical path between the target and a lens of the second camera, and a processor for receiving the first image and the second image, the processor configured to apply an image transform to one of the first image and the second wide-field image and combine the transformed image with the other one of the images to produce a stereoscopic image of the target.
IMAGE CROPPING USING DEPTH INFORMATION
A device configured to capture a first image of an item on a platform using a camera and to determine a first number of pixels in the first image that corresponds with the item. The device is further configured to capture a first depth image of an item on the platform using a three-dimensional (3D) sensor and to determine a second number of pixels within the first depth image that corresponds with the item. The device is further configured to determine that the difference between the first number of pixels in the first image and the second number of pixels in the first depth image is less than the difference threshold value, to extract the plurality of pixels corresponding with the item in the first image from the first image to generate a second image, and to output the second image.