Some embodiments provide a novel compressive-sensing image capture device and a method of using data captured by the compressive-sensing image capture device. The novel compressive-sensing image capture device includes an array of sensors for detecting electromagnetic radiation. Each sensor in the sensor array has an associated mask that blocks electromagnetic radiation from portions of the sensor. In some embodiments, an array of passive masks is used to block a particular set of areas of each sensor in the sensor array. In some embodiments, the image capture device also includes an array of lenses corresponding to the sensors of the sensor array such that each sensor receives light that passes through a different lens. Some embodiments of the invention provide a dynamic mask array. In some embodiments, a novel machine trained network is provided that processes image capture data captured by the compressive-sensing image capture device to predict solutions to problems.

Methods, systems, and articles of manufacture for generating a panoramic image of a long scene, are disclosed. These include, fitting a plurality of planes to 3D points associated with input images of portions of the long scene, where one or more respective planes are fitted to each of a ground surface, a dominant surface, and at least one of one or more foreground objects and one or more background objects in the long scene, and where distances from the 3D points to the fitted planes are substantially minimized. These also include, selecting, for respective one or more pixels in the panoramic image of the long scene, one of the input images and one of the fitted planes such that a distance is substantially minimized from the selected one of the fitted planes to a surface corresponding to the respective one or more pixels and occlusion of the respective one or more pixels is reduced in the selected one of the input images; and stitching the panoramic image of the long scene by projecting, for the respective one or more pixels in the panoramic image of the long scene, the selected one of the input images using the selected one of the fitted planes into the virtual camera.

The present disclosure relates to an imaging device and a signal processing device capable of expanding an application range of the imaging device. An imaging device includes an imaging element that includes one or more pixel output units that receive incident light from a subject incident without an intervention of an imaging lens or a pinhole and output one detection signal indicating an output pixel value modulated by an incident angle of the incident light, and outputs a detection signal set including one or more detection signals, and a communication unit that transmits imaging data including the detection signal set and position attitude data indicating at least one of a position or an attitude to a communication device by wireless communication. The present disclosure is applicable to, for example, a monitoring system and the like.

A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

The invention relates to a camera system, and to a method for controlling the camera system, for capturing images of the surroundings of a vehicle for a driver assistance system of the vehicle. The camera system comprises a first rolling shutter camera (1) having a first aperture angle α, a second rolling shutter camera (2) having a second aperture angle β, and control electronics. The first camera (1) is suitable for generating a wide-angle camera image, that is, the first aperture angle α is greater than the second aperture angle β of the second camera (2) which is suitable for generating a tele camera image. The two cameras (1, 2) are designed in such a way that both camera images have an overlap region.

The control electronics is configured to synchronize the two cameras (1, 2).

The geometric arrangement of the two cameras (1, 2) with respect to one another, and the position of the overlap region (10) in the wide-angle image and in the tele camera image, are determined by means of continuous estimation.

The stored geometric arrangement and position are taken into consideration during synchronization of the first camera (1) and the second camera (2) of the camera system.

The invention relates to a method of 3D reconstruction of a scene by means of 2D panoramic images of the scene, which comprises a step of processing these images. These images arise from a panoramic system moving in displacement along a determined trajectory, such that the image of at least one point of the scene is in at least 3 successive images obtained according to various directions; the step of processing these 2D successive images comprises the sub-steps: a) determining reconstruction planes in the scene to be reconstructed, b) determining, on the basis of pairs of panoramic images and for each pair, rectification planes corresponding to the reconstruction planes and projecting onto each of them a sector of each image of the pair, in a direct manner, so as to obtain two 2D rectified images, c) matching the two 2D rectified images so as to obtain an intermediate 3D reconstruction, d) transforming each intermediate 3D reconstruction into a 3D frame including the reconstruction planes so as to obtain a transformed intermediate 3D reconstruction, e) repeating steps b) to d) on the basis of a new pair of 2D panoramic images and of at least one other rectification plane, so as to obtain at least one other transformed intermediate 3D reconstruction, f) temporally fusing at least two transformed intermediate 3D reconstructions so as to obtain a 3D reconstruction of the scene.

Methods and systems described herein address the issue of how to efficiently capture an image circle within an image sensor associated with a wide field of view camera. In one embodiment, a processor obtains several criteria, such as a plurality of sizes of a plurality of image circles, a minimal portion of the image circle to be recorded by the image sensors, and a minimal portion of the image sensors engaged in recording the image. Based on these criteria, the processor determines a number of image sensors, a number of image sensor sizes, and a number of image sensor shapes. In another embodiment, the processor receives additional criteria, such as the desired aspect ratio and the desired shape associated with the image sensor. Based on these criteria, the processor determines a number of image sensors and a number of image sensor sizes.

An image pickup apparatus includes: an image sensor; a first detection unit configured to detect movement of the image sensor; a second detection unit configured to compare images to detect a positional deviation thereof; a combining unit configured to combine the images on a basis of the detected positional deviation and to generate a panoramic image; and a display control unit, in which in a case where combining of images up to an Nth frame is completed by the combining unit, on a basis of information about a size of the panoramic image generated by combining the images up to the Nth frame and the movement of the image sensor, which is detected by the first detection unit and corresponds to frames from an (N+1)th frame to an (N+M)th frame, the display control unit generates information indicating progress of combining of the panoramic image.

Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.

Devices and methods for reducing parallax in graphic content captured by a camera array include identifying color fringes that correspond to the parallax in the captured graphic content, determining an amount of displacement of the color fringes and adjusting the parallax in the captured graphic content based on the amount of displacement. The camera array may comprise a two-dimensional array of cameras.