An electronic device comprises a camera module and an image signal processor. The camera module generates and outputs gyro data and frame data for an input image. The image signal processor comprises a motion vector module which calculates motion vector information, a gyro-based motion estimator which extracts camera rotation information of the camera module from the gyro data, a motion vector-based motion estimator which extracts frame rotation information from the frame data, an optical image stabilization (OIS) two-dimensional (2D) translation information estimator which estimates OIS 2D translation information based on the motion vector information, the camera rotation information, and the frame rotation information, and a camera path optimizer which filters out a low-frequency component from the OIS 2D translation information and calculates stabilized camera motion information of the camera module using the filtered OIS 2D translation information and the camera rotation information.

An imaging device acquires an image and relevant information of a subject related to the image in a depth direction and performs image processing. A distance information generation unit generates a distribution of additional information (a defocus map, a distance map, etc.) related to the image. A distortion/blur correction unit performs deformation processing on the acquired image and performs deformation processing on the distribution of the additional information according to the deformation of the image. A color information conversion processing unit performs processing of converting the distribution of the additional information into color information. A superimposition processing unit outputs an image obtained by superimposing image information, which has been obtained by converting the distribution of the additional information into the color information, on the deformation-processed captured image to a display unit.

A method of forming a visual representation of an object from a plurality of image frames acquired using a portable electronic device, the method comprising the steps of determining at least one parameter of motion of the portable electronic device; determining at least one capture condition for at least one first image frame of the plurality of image frames; computing, based on the at least one parameter of motion and the at least one capture condition, an indication of blur in the image frame; based on the indication of blur, conditionally taking a corrective action.

The present disclosure relates to systems, methods, and computer-readable media for selectively identifying pixel data to provide as an input to an image processing model based on motion data associated with the content of a digital video. For example, systems disclosed herein include receiving a compressed digital video and decompressing the compressed digital video to generate a decompressed digital video. The systems disclosed herein further include extracting or otherwise identifying motion data while decompressing the compressed digital video. The systems disclosed herein also include analyzing the motion data to determine a subset of pixel data from the decompressed digital video to provide as input to an image processing model trained to generate an output based on input pixel data.

An electronic apparatus is provided. The electronic apparatus includes a display device, a sensor, and a processor. The display device receives an image data. The display device includes a display panel and displays an image related to the image data on the display panel. A reference image point of the image is displayed on a first location on the display panel. The sensor detects a movement status of the electronic apparatus when the electronic apparatus shakes to generate at least one movement parameter. The processor calculates compensation data according to the at least one movement parameter and size information of the display panel. When the display device receives the compensation data, the display device displays the image by shifting the reference image point of the image from the first location to a second location on the display panel to display according to the compensation data.

A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.

A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.

A vehicular driver monitoring system includes a camera disposed at an interior rearview mirror assembly of a vehicle equipped with the vehicular driver monitoring system, an electronic control unit (ECU) with an image processor for processing image data captured by the camera. The camera includes an imaging array sensor and a lens and the camera is adjustable by at least one of (i) adjusting a position of the imaging array sensor relative to the lens and (ii) adjusting a position of the lens relative to the imaging array sensor. The system, responsive to processing at the ECU of image data captured by the camera, monitors a body portion of a driver of the vehicle and adjusts the camera to adjust the position of where the monitored body portion of the driver is imaged at the imaging array sensor.

The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.

A vibration reliability calculation apparatus 10 is provided with an image acquisition unit 11 that acquires time-series images of an object that are output by an image capturing apparatus that shoots the object, and a reliability calculation unit 12 that calculates, for a vibration waveform of the object that is derived from a result of comparing one image and another image that constitute the acquired time-series images, a reliability level indicating a reliability of the vibration waveform.