A system for generating depth information from low-resolution images is configured to access a plurality of image frames capturing an environment, identify a first group of image frames from the plurality of image frames, and generate a first image comprising a first composite image of the environment using the first group of image frames as input. The first composite image has an image resolution that is higher than an image resolution of the image frames of the first group of image frames. The system is also configured to obtain a second image of the environment, where parallax exists between a capture perspective associated with the first image and a capture perspective associated with the second image. The system is also configured to generate depth information for the environment based on the first image and the second image.

A system for generating high-resolution video from low-resolution images is configured to access a first video stream and a second video stream capturing an environment. The first video stream is captured by a first video capture device. The second video stream is captured by a second video capture device. Image frames of the first video stream are temporally synchronized with corresponding image frames of the second video stream. The system is also configured to generate a composite video stream with a higher resolution than the first or second video streams. Each composite image frame of the composite video stream is generated using a respective image frame of the first video stream and a temporally synchronized corresponding image frame of the second video stream as input.

Disclosed are a system, apparatus, and method for rolling shutter compensation. An image having a plurality of scanlines captured at different times may be received from a rolling shutter camera where each scanline includes a plurality of 2D pixels, and where each scanline has an associated camera pose. One or more 2D pixels in a first scanline of the received image to 3D coordinates may be unprojected and the 3D coordinates may be transformed from the first scanline to a reference pose. The transformed 3D coordinates may be reprojected, and in response to the reprojecting, reference timeframe corrected 2D coordinates for the one or more 2D pixels in the first scanline may be provided.

A vehicle occupant monitoring system, OMS, comprises an image acquisition device with a rolling shutter image sensor configured to selectively operate in either: a full-resolution image mode where an image frame corresponding to the full image sensor is provided; or a region of interest, ROI, mode, where an image frame corresponding to a limited portion of the image sensor is provided. An object detector is configured to receive a full-resolution image from the image sensor and to identify a ROI corresponding to an object of interest within the image. A controller is configured to obtain an image corresponding to the ROI from the image sensor operating in ROI mode, the image having an exposure time long enough for all rows of the ROI to be illuminated by a common pulse of light from at least one infra-red light source and short enough to limit motion blur within the image.

An imaging system having a plurality of imaging sensors, each imaging sensor comprising a plurality of pixels or sensing elements configured to detect incident radiation and output a signal representative thereof. Each imaging sensor is operable to sample different subsets of pixels or sensing elements at different times to collect output signals representative of radiation incident thereon. The imaging system is configured to sample one or more of the subsets of pixels or sensing elements of one or more or each imaging sensor that are towards and/or closest to at least one or each neighbouring or adjacent sensor whilst collecting output signals from one or more subsets of pixels or sensing elements of the at least one or each neighbouring or adjacent imaging sensor that are towards and/or closest to the imaging sensor. Optionally, the imaging system is configured such that the subsets of pixels or sensing elements of at least one or each imaging sensor are sampled or swept in a pattern that is a mirror image or inverse to that of at least one or each imaging sensor that neighbours or is adjacent to it. For example, at least one or each of the imaging sensors and at least one or each of its neighbouring imaging sensors are scanned or swept in directions that are mutually towards and/or away from each other.

The apparatus comprises a camera (10) with a digital sensor read by a mechanism of the rolling shutter type delivering video data (S.sub.cam) line by line. An exposure control circuit (22) adjusts dynamically the exposure time (t.sub.exp) as a function of the level of illumination of the scene that is captured. A gyrometer unit (12) delivers a gyrometer signal (S.sub.gyro) representative of the instantaneous variations of attitude (φ, θ, ψ) of the camera, and a processing circuit (18) that receives the video data (S.sub.cam) and the gyrometer signal (S.sub.gyro) delivers as an output video data processed and corrected for artefacts introduced by vibrations specific to the apparatus. An anti-wobble filter (24) dynamically modifies the gain of the gyrometer signal as a function of the exposure time (t.sub.exp), so as to reduce the gain of the filter when the exposure time increases, and vice versa.

Methods and apparatus for implementing a camera having a depth which is less than the maximum length of the outer lens of at least one optical chain of the camera are described. In some embodiments a light redirection device, e.g., a mirror, is used to allow a relatively long optical chain with a relatively large non-circular outer lens. In some embodiments the light redirection device has a depth, e.g., front of camera to back of camera dimension, which is less than the maximum length of the aperture of the outer lens in the aperture's direction of maximum extent. Multiple optical chains with non-circular outer lenses arranged in different directions may and in some embodiments are used to capture images with the captured images being combined to generate a composite image.

Real-time video stabilization for mobile devices based on on-board motion sensing. In accordance with a method embodiment of the present invention, a first image frame from a camera at a first time is accessed. A second image frame from the camera at a subsequent time is accessed. A crop polygon around scene content common to the first image frame and the second image frame is identified. Movement information describing movement of the camera in an interval between the first time and the second time is accessed. The crop polygon is warped to remove motion distortions of the second image frame is warped using the movement information. The warping may include defining a virtual camera that remains static when the movement of the camera is below a movement threshold. The movement information may describe the movement of the camera at each scan line of the second image frame.

According to various, but not necessarily all, embodiments there is provided an apparatus comprising means for: capturing or causing capture of an image of an object using a rolling shutter having an aperture width and shutter scan speed; during the image capture, projecting or causing projection of electromagnetic radiation with a fixed-spatial, time-variable distribution onto the object, wherein the time-variable distribution of the projected electromagnetic radiation, the aperture width of the rolling shutter, and the shutter scan speed of the rolling shutter, are such that adjustment of one or more of these would not decrease a proportion of projected electromagnetic radiation captured which is directly reflected from a surface of the object.

The method includes in order to generate a composite image: identifying, in the frame of a video stream captured by a camera, a motion characteristic associated with moving objects in a scene while the camera captured a sliding window of the video stream. The method includes for a plurality of frames in the sliding window: controlling, by the processing circuitry, a weight of blending of the frame based on the identified motion characteristic to enable the composite image to be generated according to the controlled weights of blending of the plurality of frames in the sliding window.