An imaging device includes an image sensor including a rolling shutter functionality, one or more lighting elements capable of generating light at a predetermined time and duration, a light control component configured to control amount of light generated by the one or more lighting elements entering the image sensor, where the light control component is disposed between the image sensor and a lens of the imaging device; and a processing unit enabling the image sensor to function as a global shutter image sensor using the light control component, to capture at least one image of a moving object by synchronizing the light control component with light generated from the one or more lighting elements.

According to various, but not necessarily all, embodiments there is provided an apparatus comprising means for: capturing or causing capture of an image of an object using a rolling shutter having an aperture width and shutter scan speed; during the image capture, projecting or causing projection of electromagnetic radiation with a fixed-spatial, time-variable distribution onto the object, wherein the time-variable distribution of the projected electromagnetic radiation, the aperture width of the rolling shutter, and the shutter scan speed of the rolling shutter, are such that adjustment of one or more of these would not decrease a proportion of projected electromagnetic radiation captured which is directly reflected from a surface of the object.

Techniques described herein can address these and other issues by synchronizing the positioning of an adjustable lens in a camera assembly with the capture of an image frame by the image sensor and optimizing the position of the adjustable lens to reduce the amount of blur caused by translation of the camera assembly along a direction along the optical axis over the course of a frame. More specifically, techniques provide for moving the lens to a plurality of optimized positions, relative to the image sensor, over the course of a frame, to reduce motion blur in an image due to translation of the camera assembly in a direction of along the optical axis during the frame. Some embodiments may provide for “tight” synchronization in cases where the plurality of optimized positions are based on a time-dependent function that takes into account when each row of the image sensor is being exposed over the course of the frame.

A method and apparatus of tracking poses of a rolling-shutter camera in an augmented reality (AR) system is provided. The method and apparatus use camera information and inertial sensor readings from Inertial Measurement Unit (IMU) to estimate the pose of the camera at a reference line. Thereafter, relative pose changes at scanlines may be calculated using the inertial sensor data. The estimated reference pose of the camera is then further refined based on the visual information from the camera, the relative pose changes and the optimized reference line pose of a previous image. Thereafter, the estimate of the scanline poses may be updated using the relative pose changes obtained in the earlier steps.

A method to stabilize image capture for a camera device (110). The method includes capturing, at an auxiliary frame rate and using an auxiliary imaging element (112) rigidly coupled with the camera device (110), auxiliary images of a light source (143) attached to an object (142), where the auxiliary frame rate exceeds a camera frame rate of the image capture (1211); detecting each of a plurality of locations of the light source (143) in a corresponding one of the auxiliary images (1212); analyzing the plurality of locations to generate a measure of uncontrolled movement (1213); and adjusting, based at least on the measure of uncontrolled movement, the camera device (110) during the image capture of the object by the camera device (110) at the camera frame rate (1214).

A system and method for electronic image stabilization for a high dynamic range image captured by a rolling shutter image sensor and more specifically to an algorithm configured to perform electronic image stabilization on the high dynamic range image, by, for each specific block of pixels among the blocks of pixels in the high dynamic range image, the specific block of pixels spatially corresponding to a pixel region of the rolling shutter image sensor, determining whether the specific block of pixels is copied from pixel data of the first image or the second image, or is a blend of pixel data from both the first image and the second image, and use motion data measured when capturing the first and second images for performing electronic image stabilization based on the origin of the specific block of pixels.

An apparatus includes a calculation unit configured to calculate a target correction amount based on a shake, a stabilization control unit configured to provide control on driving of a sensor in a direction intersecting an optical axis of a pickup optical system, based on the target correction amount, an autofocusing control unit configured to provide control on focusing based on an image signal output from the sensor, and a setting unit configured to set a limit value for the target correction amount based on a characteristic of the pickup optical system and focusing accuracy of the autofocusing unit. The setting unit is configured to change the limit value depending on the pickup condition, and is capable of setting a first limit value based on the characteristic and a second limit value based on the focusing accuracy.

A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

The accuracy of rolling shutter distortion correction for captured images is improved. Posture information corresponding to a line of an input image is calculated. Then, a first virtual line, which is a line in a line direction of the input image for which the posture information calculated is common, is rotated according to the posture information to obtain a second virtual line on the output image. For each pixel of the output image, a corresponding second virtual line is calculated, and posture information is obtained on the basis of the corresponding second virtual line. Then, for coordinates of each pixel of the output image, the reference coordinates on the input image corresponding to the pixel coordinates is calculated using the associated posture information. By cutting out the output image from the input image on the basis of the reference pixel, highly accurate distortion correction can be realized even in a case where the camera posture differs depending on the line.

A method for stabilizing a video sequence comprises: obtaining an indication of camera movement from acquisition of a previous camera frame to acquisition of a current camera frame; determining an orientation for the camera at a time of acquiring the current camera frame; and determining a candidate orientation for a crop frame for the current camera frame by adjusting an orientation of a crop frame associated with the previous camera frame according to the determined orientation. A boundary of one of the camera frame or crop frame is traversed to determine if a specific point on the boundary of the crop frame exceeds a boundary of the camera frame. If so, a rotation of the specific point location which would bring the specific point location onto the boundary of the crop frame is determined and the candidate crop frame orientation updated accordingly before the crop frame is displayed.