An information processing apparatus includes: a processor; and a memory storing a program which, when executed by the processor, causes the information processing apparatus to obtain an image and correction information on a first optical system and a second optical system, the image including a first area corresponding to a first image inputted via the first optical system and a second area corresponding to a second image inputted via the second optical system having a predetermined parallax with respect to the first optical system; execute correcting processing of correcting, based on the correction information, positions of a pixel included in the first area and a pixel included in the second area in the image, and generate a processed image by executing processing of transforming the corrected first area and the corrected second area.

An information processing apparatus includes: a processor; and a memory storing a program which, when executed by the processor, causes the information processing apparatus to obtain an image and correction information on a first optical system and a second optical system, the image including a first area corresponding to a first image inputted via the first optical system and a second area corresponding to a second image inputted via the second optical system having a predetermined parallax with respect to the first optical system; execute correcting processing of correcting, based on the correction information, positions of a pixel included in the first area and a pixel included in the second area in the image, and generate a processed image by executing processing of transforming the corrected first area and the corrected second area.

Electronic equipment includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic equipment to acquire a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side, apply predetermined processing to a target range included in the third image, and, wherein each of the first image and the second image is a circular region, set a rectangular region circumscribed around a circular region of the first image or a circular region of the second image as a movable region in which the target range included in the third image is movable.

Electronic equipment includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic equipment to acquire a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side, apply predetermined processing to a target range included in the third image, and, wherein each of the first image and the second image is a circular region, set a rectangular region circumscribed around a circular region of the first image or a circular region of the second image as a movable region in which the target range included in the third image is movable.

Embodiments of systems and methods for multi-aperture ranging are disclosed. An embodiment of an image processing system includes at least one processor and memory configured to receive a multi-aperture image set that includes a high-resolution subaperture image and a low-resolution subaperture image, wherein the high-resolution subaperture image and the low-resolution subaperture image were captured simultaneously from a camera using dissimilar focal lengths, predict a high-resolution predicted disparity map from the high-resolution subaperture image using a neural network, predict a low-resolution predicted disparity map from the low-resolution subaperture image using the neural network, and generate an integrated range map from the high-resolution and low-resolution predicted disparity maps, wherein the integrated range map includes an array of range information that corresponds to the multi-aperture image set and that is generated by overlaying common points in both the high-resolution predicted disparity map and the low-resolution predicted disparity map.

An image capturing element according to the present disclosure includes a pixel array formed by a plurality of pixels arranged in an array on a substrate, each of the plurality of pixels including a photoelectric conversion element, a transparent layer formed on the pixel array, and a spectroscopic element array formed by a plurality of spectroscopic elements arranged in an array, and each of the plurality of spectroscopic elements is at a position corresponding to one of the plurality of spectroscopic elements inside or on the transparent layer. Each of the plurality of spectroscopic elements includes a plurality of microstructures formed from a material having a refractive index higher than a refractive index of the transparent layer. The plurality of microstructures have a microstructure pattern. Each of the plurality of spectroscopic elements separates incident light into deflected light beams having different propagation directions according to the wavelength and emits the deflected light beams.

An image capturing element according to the present disclosure includes a pixel array formed by a plurality of pixels arranged in an array on a substrate, each of the plurality of pixels including a photoelectric conversion element, a transparent layer formed on the pixel array, and a spectroscopic element array formed by a plurality of spectroscopic elements arranged in an array, and each of the plurality of spectroscopic elements is at a position corresponding to one of the plurality of spectroscopic elements inside or on the transparent layer. Each of the plurality of spectroscopic elements includes a plurality of microstructures formed from a material having a refractive index higher than a refractive index of the transparent layer. The plurality of microstructures have a microstructure pattern. Each of the plurality of spectroscopic elements separates incident light into deflected light beams having different propagation directions according to the wavelength and emits the deflected light beams.

Generating a representation of a scene includes detecting an indication to capture sensor data to generate a virtual representation of a scene in a physical environment at a first time, in response to the indication obtaining first sensor data from a first capture device at the first time, obtaining second sensor data from a second capture device at the first time, and combining the first sensor data and the second sensor data to generate the virtual representation of the scene.

Systems and methods are provided for ultrafast light field tomography (LIFT), a transient imaging strategy that offers a temporal sequence of over 1000 and enables highly efficient light field acquisition, allowing snapshot acquisition of the complete two, three or four-dimensional space and time. The apparatus transforms targets in object space into parallel lines in the image plane with a cylindrical lens. Beam projections are optionally directed through a Dove prism and an array of cylindrical lenslets to an imaging device such as a SPAD camera, streak camera and CCD camera. By using an array of cylindrical lenslets oriented at distinct angles, enough projections are obtained simultaneously to recover the image with a single snapshot. The time-resolved system and methods were adapted to LIDAR, hyperspectral, non-line-of-sight, and three-dimensional transient imaging.

Systems and methods are provided for ultrafast light field tomography (LIFT), a transient imaging strategy that offers a temporal sequence of over 1000 and enables highly efficient light field acquisition, allowing snapshot acquisition of the complete two, three or four-dimensional space and time. The apparatus transforms targets in object space into parallel lines in the image plane with a cylindrical lens. Beam projections are optionally directed through a Dove prism and an array of cylindrical lenslets to an imaging device such as a SPAD camera, streak camera and CCD camera. By using an array of cylindrical lenslets oriented at distinct angles, enough projections are obtained simultaneously to recover the image with a single snapshot. The time-resolved system and methods were adapted to LIDAR, hyperspectral, non-line-of-sight, and three-dimensional transient imaging.