The present invention relates to an image pre-processing method, apparatus, and computer program. The present invention relates to a method for processing an arbitrary image, comprising the steps of: dividing the image into scene units including one or more frames; selecting a frame to be searched according to a preset criterion from the scene; identifying an object associated with a preset subject from the frame to be searched; and searching for image corresponding to the object and/or object information and mapping the search result to the object. According to the present invention, the efficiency of an object-based image search can be maximized and resources to be used for image processing can be minimized.

Systems, methods, and non-transitory computer-readable media can store fingerprint data corresponding to one or more content items in an index data structure, the index data structure comprising a set of bins, wherein at least one first bin references a list of fingerprinted frames, and wherein at least one fingerprinted frame in the list corresponds to a first content item. A determination is made that one or more fingerprinted frames corresponding to a second content item are to be added to the index data structure. At least one of the fingerprinted frames corresponding to the second content item are added to the list of fingerprinted frames that is referenced by the first bin.

Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.

Systems, methods, and software described herein to manage preferences for video search. In one implementation, a video processing service may receive a request for video data that satisfies one or more criteria, wherein the one or more criteria includes at least one color for an object. In response to the request, the video processing service may identify one or more secondary colors associated with the at least one color and update the one or more criteria to include the one or more secondary colors. The video processing service may then select the video data from a video source that satisfies the updated one or more criteria.

Methods, systems, and media for detecting a presentation of media content on a display device are provided. In accordance with some implementations, methods for detecting a presentation of media content on a display device are provided, the methods comprising: detecting, using a light sensor, light levels in the light sensor's surroundings; generating a signal representing the light levels; detecting, using a hardware processor, at least one variation in light levels indicative of a presentation of a video scene based on the signal; detecting at least one variation in light levels indicative of a scene change subsequent to the video scene based on the signal; and determining that media content is being presented on a display device in response to detecting the variation in light levels indicative of the presentation of the video scene and the variation in light levels indicative of the scene change.

To generate a hash in video, a sample series of temporal difference samples is forming image order. A temporal averaging is performed and a rate of change detected to identify as distinctive events regions of high rate of change. Images having a distinctive event are labelled as distinctive images. For each image, the temporal spacing in images is calculated between that image other distinctive images to provide a set of temporal spacings for that image; and a hash is derived for that image from that set of temporal spacings.

A video abstract generation method is provided. The method includes obtaining a target searching condition; searching a video database for structured image data meeting the target searching condition, the structured image data being stored in the video database in a structured data format; and performing video synthesis on the structured image data meeting the target searching condition, to generate a video abstract.

The disclosure includes a system and method for decomposing a video to salient fragments and synthesizing a video composition based on the salient fragments. A computer-implemented method receives a first set of salient fragments and a first set of clusters extracted from a video, where each cluster includes related salient fragments connected by a connectivity graph. The method determines a weight associated with each of the salient fragments and each of the clusters based on an activity level associated with the respective salient fragment or cluster and determine a permissible zone of activity. The method determines a spatial-temporal distortion to be applied to each salient fragment and cluster and synthesizes a video composition based on the first set of salient fragments, the first set of clusters and non-salient portions of the video using weighted editing.

An apparatus and method are providing for generating a hash in video in which a sample series of temporal difference are sampled in an image order. A temporal averaging is performed and a rate of change is detected to identify as distinctive events regions of high rate of change. Images having a distinctive event are labelled as distinctive images. For each image, the temporal spacing in images is calculated between that image and other distinctive images to provide a set of temporal spacings for that image; and a hash is derived for that image from that set of temporal spacings.

Methods, systems, and media for detecting a presentation of media content on a display device are provided. In accordance with some implementations, methods for detecting a presentation of media content on a display device are provided, the methods comprising: detecting, using a light sensor, light levels in the light sensor's surroundings; generating a signal representing the light levels; detecting, using a hardware processor, at least one variation in light levels indicative of a presentation of a video scene based on the signal; detecting at least one variation in light levels indicative of a scene change subsequent to the video scene based on the signal; and determining that media content is being presented on a display device in response to detecting the variation in light levels indicative of the presentation of the video scene and the variation in light levels indicative of the scene change.