An encoding method, playing method and apparatus for image stabilization of panoramic video, and a method for evaluating image stabilization algorithm are provided. The image stabilization method for the panoramic video is applicable to an electronic apparatus including a processor. In the method, a plurality of image frames of a panoramic video is captured, and each image frame is transformed into a plurality of projection frames on a plurality of faces of a cubemap. Then, variations of triaxial displacements and attitude angles between the projection frames transformed onto each of the faces and adjacent in time are calculated. The variations of triaxial displacements and attitude angles are smoothed and recorded as movement information. While playing the panoramic video, the panoramic video is corrected by the movement information and played. Thus, it is possible to reduce the amount of calculation required for the stabilization calculations on the captured video.

An apparatus includes a video capture device, an audio capture device and a processor. The video capture device may be configured to generate a plurality of video frames. The audio capture device may be configured to capture audio. The processor may be configured to analyze the audio to determine a direction of a source of the audio, select a window of interest for the video frames corresponding to the direction of the source of the audio, perform video operations to generate high resolution images of the window of interest, perform facial recognition operations on the high resolution images and determine an identity of the source of the audio in response to the facial recognition operations. The window of interest may have an area less than a total area of the video frames. The identity of the source of the audio may determine permissions for accessing features of the apparatus.

The present invention relates to a camera module actuator movement sensing element required for camera shake correction, and a camera module flexible circuit board including the same. On the camera module flexible circuit board, there are mounted: a plurality of actuator movement sensing elements for sensing each of the movement distances of an actuator in the x-axis and y-axis directions perpendicular to the optical-axis (z-axis) direction of the actuator to which a lens assembly is coupled, and transmitting the same by a method using a two-wire interface; and an OIS controller IC for performing camera shake correction by receiving, from the plurality of actuator movement sensing elements, a feedback of the movement distances of the actuator by the method using a two-wire interface, wherein: the plurality of actuator movement sensing elements share a common serial data pin and a common serial clock pin with each other, and the common serial data pine and the common serial clock pin are connected to a serial data pin and a serial clock pin of the OIS controller IC, respectively; and the plurality of actuator movement sensing elements share a common power pin and a common ground pin with each other, or share only a common power pin or a common ground pin with each other.

An image capturing apparatus includes a first image sensor configured to output a first image signal based on light from a first image capturing optical system, a second image sensor configured to output a second image signal based on light from a second image capturing optical system, a determination unit configured to determine visibility of a region corresponding to a first image based on the first image signal in a second image based on the second image signal, a control unit configured to control the first image sensor to execute an image capturing operation in a case where the visibility of the region is low, an image processing unit configured to generate a third image signal by combining the first image signal with the second image signal, and a display control unit configured to control to display an image based on the third image signal on a display unit.

According to one aspect of the invention, a method of estimating optical jitter, the methods comprising the steps of: capturing an image in a series of consecutive frames; iteratively characterizing one or more optical parameters of the captured image over the consecutive frames; and based on the one or more optical parameters, executing time domain analysis to decompose optical disturbance into drift and jitter.

The camera is used in a camera system including the camera that includes an image sensor movable for image blur correction, and a lens apparatus that is detachably attachable to the camera and includes an optical element movable for the image blur correction. The camera includes a setting unit configured to set a ratio of image blur correction amounts provided respectively by movements of the optical element and the image sensor in each of their moving directions, using information on an image circle formed by the lens apparatus, information on a mechanical movable amount of the image sensor, and information on a size of a signal readout area of the image sensor.

It is possible to easily reproduce and edit image data that is a moving image obtained by capturing an image of a non-central projection method, in which distortion correction and blur correction are reflected. For this purpose, an information processing apparatus includes: a distortion correction processing unit that performs distortion correction processing for converting image data as a moving image acquired by capturing an image of a non-central projection method into an image of a central projection method; and a blur correction processing unit that performs blur correction processing of reducing the image blur generated in the image data using posture data of an imaging apparatus for image data that has been subjected to the distortion correction processing. In other words, the blur correction is performed after the distortion correction.

An electric camera includes an image sensing device with a light receiving surface having N vertically arranged pixels and an arbitrary number of pixels arranged horizontally, N being equal to or more than three times the number of effective scanning lines M of a display screen of a television system, a driver to drive the image sensing device to vertically mix or cull signal charges accumulated in individual pixels of K pixels to produce, during a vertical effective scanning period of the television system, a number of lines of output signals which corresponds to 1/K the number of vertically arranged pixels N of the image sensing device, K being an integer equal to or less than an integral part of a quotient of N divided by M, and a signal processing unit having a function of generating image signals by using the output signals of the image sensing device.

A processor of an imaging apparatus including an imaging element that images a subject through an imaging optical system is configured to: perform a recording control of performing one of: first processing as defined herein; and second processing as defined herein; perform an image shake correction control of correcting an image shake of a captured image output from the imaging element by moving one or both of the imaging element and a lens included in the imaging optical system; perform image processing of generating a live view image for displaying a subject image formed in the second region on a display unit; and perform a control of setting, in a case of performing the first processing, a movable range of at least one of the imaging element and the lens in the image shake correction control to be larger than in a case of performing the second processing.

An image capturing device is used which includes: an image capturing unit; and a control unit for performing control such that an image captured by the image capturing unit is displayed in a display unit, wherein the control unit is able to perform first angle-of-view display displaying the image with a first angle-of-view on the display unit and second angle-of-view display displaying the image with a second angle-of-view narrower than the first angle-of-view on the display unit by performing camera shake correction on the image and, in a case in which the image capturing device comes into a specific state when the second angle-of-view display is performed, the control unit displays an item for changing from the second angle-of-view display to the first angle-of-view on the display unit.