Disclosed herein are an apparatus and a method of video pre-processing for motion estimation, the apparatus comprising a similarity description module, a storage module, a verdict module, and a motion estimation module. The similarity description module receives a first image in a video, the first image consisting of first blocks, and calculates the similarity descriptors of every first block and a second block of a second image in the video. The second block corresponds to a reference block among the first blocks. The similarity descriptor of each block, which corresponds to a pixel matrix, indicates whether the pixel values of at least one pair of adjacent pixels in the pixel matrix are identical. The verdict module determines whether the similarity descriptors of the second and reference blocks are identical and reaches a verdict, whereby motion estimation is selectively performed on the second block.

Various aspects of a system and a method are provided for detection of objects in motion are disclosed herein. In accordance with an embodiment, the system includes an electronic device, which computes a first motion vector based on a difference of pixel values of one or more pixels in a current frame with respect to a previous frame. The current frame and the previous frame comprises at least an object in motion. The system further computes a second motion vector by use of motion-based information obtained from a sensor in the electronic device. The system determines validation of the first motion vector based on the second motion vector and one or more criteria and extracts the object in motion from the current frame based on the determined validation of the first motion vector.

A system and process for video characterization that facilitates video classification and retrieval, as well as motion detection, applications. This involves characterizing a video sequence with a gray scale image having pixel levels that reflect the intensity of motion associated with a corresponding region in the sequence of video frames. The intensity of motion is defined using any of three characterizing processes. Namely, a perceived motion energy spectrum (PMES) characterizing process that represents object-based motion intensity over the sequence of frames, a spatio-temporal entropy (STE) characterizing process that represents the intensity of motion based on color variation at each pixel location, a motion vector angle entropy (MVAE) characterizing process which represents the intensity of motion based on the variation of motion vector angles.

A method and an apparatus for determining a small-object region in a video frame. The method includes dividing a current video frame into at least two regions, and determining a global motion vector corresponding to each region; determining an interframe motion vector of each group of adjacent frames in multiple video frames that include the current video frame and a reference frame of the current video frame; determining a candidate small-object region in the current video frame according to the interframe motion vector of the each group of adjacent frames and the determined global motion vector corresponding to each region; and performing filtering on the candidate small-object region in the current video frame, and determining a region obtained after the filtering as a small-object region in the current video frame.

A system, article, and method to provide lens shading color correction using block matching.

The position of a next object is estimated efficiently according to the observed value of physical quantity related to the object in an actual environment. An image processing apparatus extracts a first object image of state prediction from a first image and identifies the type of the first object. A model appropriate to the type of the object of state prediction is merged with the first object image and a feature point of the first object image is associated with the model. A plurality of motion sequences are selected from a finite state sequence corresponding to the type of the first object according to the position of the first object and the initial observed state.

An image processing apparatus is capable of appropriately extracting a frame of an output target from a moving image. The image processing apparatus includes an analysis unit configured to analyze a plurality of analysis regions in each of a plurality of frames included in the moving image, an extraction unit configured to extract the frame of the output target from among the plurality of frames by comparing analysis results of the plurality of analysis regions in each of the plurality of frames analyzed by the analysis unit for each analysis regions corresponding to each other between the plurality of frames, and an output unit configured to output the frame of the output target extracted by the extraction unit.

Computer processor hardware receives settings information for a first image. The first image includes a set of multiple display elements. The computer processor hardware receives motion compensation information for a given display element in a second image to be created based at least in part on the first image. The motion compensation information indicates a coordinate location within a particular display element in the first image to which the given display element pertains. The computer processor hardware utilizes the coordinate location as a basis from which to select a grouping of multiple display elements in the first image. The computer processor hardware then generates a setting for the given display element in the second image based on settings of the multiple display elements in the grouping.

The present invention is applied to an image pickup apparatus for which, for example, a CMOS solid-state image pickup element is used. One screen image is divided into a plurality of blocks, and a motion is detected for each of the blocks to control the exposure time of the block.

An example embodiment discloses a method of determining an estimated depth of an object in an image. The method includes determining an estimated shear due to a rolling shutter image sensor in a plurality of regions of a current frame of the image and determining the estimated depth based on the estimated shear.