Methods and apparatus provide for: capturing an image of a subject from a position; capturing a plurality of images of the subject from a plurality of further positions around the position such that the plurality of captured images of the subject are different in image quality or view angles than the image of the subject from the position; and generating data to be output on a basis of the image captured from the position and the plurality of images captured from the plurality of further positions, where at least one of: the capturing the image or the plurality of images includes pixels capable of detecting light in an infrared wavelength band, and the generating includes synthesizing the image from the position and the images captured from the further positions and changing a synthesis ratio according to an image synthesis position.

Certain aspects relate to systems and techniques for folded optic stereoscopic imaging, wherein a number of folded optic paths each direct a different one of a corresponding number of stereoscopic images toward a portion of a single image sensor. Each folded optic path can include a set of optics including a first light folding surface positioned to receive light propagating from a scene along a first optical axis and redirect the light along a second optical axis, a second light folding surface positioned to redirect the light from the second optical axis to a third optical axis, and lens elements positioned along at least the first and second optical axes and including a first subset having telescopic optical characteristics and a second subset lengthening the optical path length. The sensor can be a three-dimensionally stacked backside illuminated sensor wafer and reconfigurable instruction cell array processing wafer that performs depth processing.

Certain aspects relate to systems and techniques for folded optic stereoscopic imaging, wherein a number of folded optic paths each direct a different one of a corresponding number of stereoscopic images toward a portion of a single image sensor. Each folded optic path can include a set of optics including a first light folding surface positioned to receive light propagating from a scene along a first optical axis and redirect the light along a second optical axis, a second light folding surface positioned to redirect the light from the second optical axis to a third optical axis, and lens elements positioned along at least the first and second optical axes and including a first subset having telescopic optical characteristics and a second subset lengthening the optical path length. The sensor can be a three-dimensionally stacked backside illuminated sensor wafer and reconfigurable instruction cell array processing wafer that performs depth processing.

A system for generating high-resolution de-warped omni-directional stereo image from captured omni-directional stereo image by correcting optical distortions using projection patterns is provided. The system includes a projection pattern capturing arrangement, a projector or a display, and a de-warping server. The projection pattern capturing arrangement includes one or more omnidirectional cameras to capture projection patterns from the captured omni-directional stereo image from each omni-directional stereo camera. The projector or the display displays the projection patterns. The de-warping server obtain the projection patterns and processes the projection patterns to generate high resolution de-warped omni-directional stereo image by correcting optical distortions in the captured omni-directional stereo image and mapping the captured omni-directional stereo image and the high resolution de-warped omni-directional stereo image.

A system for establishing a baseline of a stereoscopic imaging device having a microlens array and methods for making and using the same. The system acquires an object distance between the microlens array and an object of interest and selects first and second lenses from the microlens array based upon the acquired object distance. The system likewise can perform simultaneous localization and mapping (SLAM) with the imaging device. In one embodiment, the system can acquire first and second stereoscopic frames with the microlens array. The system thereby can measure rotations of the second stereoscopic frame with an Inertial Measurement Unit (IMU) and match the first and second stereoscopic frames by combining the rotation data with the first and second stereoscopic frames. The system thereby can enable SLAM systems to perform more accurately and more practically in various indoor and/or outdoor environments.

A system for establishing a baseline of a stereoscopic imaging device having a microlens array and methods for making and using the same. The system acquires an object distance between the microlens array and an object of interest and selects first and second lenses from the microlens array based upon the acquired object distance. The system likewise can perform simultaneous localization and mapping (SLAM) with the imaging device. In one embodiment, the system can acquire first and second stereoscopic frames with the microlens array. The system thereby can measure rotations of the second stereoscopic frame with an Inertial Measurement Unit (IMU) and match the first and second stereoscopic frames by combining the rotation data with the first and second stereoscopic frames. The system thereby can enable SLAM systems to perform more accurately and more practically in various indoor and/or outdoor environments.

A stereo camera, including an imaging sensor, and an optical apparatus comprising first and second apertures separated by an interocular distance and configured to focus first and second images on the imaging sensor in a side by side arrangement. An imaging system including the stereo camera, and at least one image processor, configured to receive first and second frames of image data from a stereo camera, and construct volumetric image data based on binocular disparity between the first and second frames.

There is provided an imaging apparatus including a first polarizing unit that polarizes light from an object, a lens system that condenses light from the first polarizing unit, and an imaging element array that has imaging elements arranged in a matrix of a first direction and a second direction orthogonal to the first direction, has a second polarizing unit arranged on a light incident side, and converts the light condensed by the lens system into an electric signal.

There is provided an imaging apparatus including a first polarizing unit that polarizes light from an object, a lens system that condenses light from the first polarizing unit, and an imaging element array that has imaging elements arranged in a matrix of a first direction and a second direction orthogonal to the first direction, has a second polarizing unit arranged on a light incident side, and converts the light condensed by the lens system into an electric signal.

Technologies are generally described for optical image diversion to provide image capture and display from one or more directions using an image sensor. In some examples, an optical assembly may be used to receive light or other electromagnetic radiation from multiple (including opposing) directions and to provide light or other electromagnetic radiation to an image sensor or detector to capture images. The optical assembly may be centrally-aligned or offset. The optical assembly may be configured to allow collection of light or other electromagnetic radiation from two or more locations. An auto focus or stabilization element may be integrated into one or more optical paths inside an optical switching device. In other examples, a conical or spherical element may be employed to allow capture of panoramic/360 degree images or video. Elements may also be stacked. Furthermore, the optical assembly may be configured to split an optical beam to allow tiling or superimposition of images from different directions at the image sensor.