Cameras capture time-stamped images of predefined areas. Occluded images that represent obstructed views of items are processed using a combination of machine-learning and a probabilistic approach based on a planogram for the items and the items' location within a store. Output from the machine-learning and probabilistic approach are item identifiers that identify the items as known items to the store.

A system for using metadata from a video signal to associate advertisements therewith, comprising (i) a segmentation system to divide the video signal into video clips, (ii) a digitizing system for digitizing the video clips, (iii) a feature extraction system for extracting audio and video features from each video clip, associating each audio feature with respective video clips, associating each video feature with respective video clips, and saving the audio and video features into an associated metadata file, (iv) a web interface to the feature extraction system for receiving the video clips, and (v) a database, wherein video signals and associated metadata files are stored and indexed, wherein the associated metadata file is provided when a video player requests the corresponding video signal, enabling selection of a relevant advertisement for presentment in conjunction with respective video clips based on the associated audio and video features of the respective video clip.

A system for using metadata from a video signal to associate advertisements therewith, comprising (i) a segmentation system to divide the video signal into video clips, (ii) a digitizing system for digitizing the video clips, (iii) a feature extraction system for extracting audio and video features from each video clip, associating each audio feature with respective video clips, associating each video feature with respective video clips, and saving the audio and video features into an associated metadata file, (iv) a web interface to the feature extraction system for receiving the video clips, and (v) a database, wherein video signals and associated metadata files are stored and indexed, wherein the associated metadata file is provided when a video player requests the corresponding video signal, enabling selection of a relevant advertisement for presentment in conjunction with respective video clips based on the associated audio and video features of the respective video clip.

In an image processing device, an image processing method, a program, and a recording medium, a searching condition is a condition for searching for an image from an image group according to a condition other than an imaging timing, an image designating unit designates, as a designation search image, one search image selected from search images displayed on a display unit according to a command from the user, and an image display unit displays, as time-series images, the designation search image and at least a part of images which are included in the image group and captured earlier and later than an imaging timing of the designation search image in a sequence of time on the display unit according to a command from the user after only the designation search image is displayed on the display unit in a case where the designation search image is designated.

Described herein are methods and systems allowing a company to market and advertise its brands, products and/or services in a mobile platform by use of an application converting a user input into a corresponding branded icon, logo or image and displaying the same. The user input is in the form of a text entry from the device keyboard, e.g., a brand name or a generic search word, a voice or sound input or audio demand from the device speaker, or an image containing a brand and/or logo. By providing various menu functions associated with the displayed icons, logos or images, the application combines mobile texting with online search or browsing to provide for a much simpler and more convenient mobile experience.

A method for proactively creating an image product includes capturing an image of an object in a first environment by a device, storing a library of personalized products each characterized by a product type, automatically recognizing the object in the image as having a product type associated with the library of personalized products, automatically creating a design for the personalized product of the product type using personalized content, automatically displaying the design of the personalized product of the product type incorporating the selected photo in the first environment on the device, and manufacturing a physical product based on the design of the personalized product.

Methods, systems and media for presenting information related to an event based on metadata are provided. In some implementations, the method comprises: detecting that a user-initiated event has been performed on a user device; detecting a plurality of sensors connected to the user device; causing a plurality of content items related to the user-initiated event to be obtained using the plurality of sensors connected to the user device; determining whether each of the plurality of content items is to be associated with the user-initiated event based on user device information from a plurality of data sources; associating a portion of the plurality of content items with the user-initiated event based on the determination; retrieving information related to the portion of the plurality of content items; detecting, using the plurality of sensors connected to the user device, a second plurality of content items; determining that at least one of the second plurality of content items is related to at least one of the first plurality of content items; and causing information related to the user-initiated event to be presented by the user device based at least in part on the determination.

Methods, systems and media for presenting information related to an event based on metadata are provided. In some implementations, the method comprises: detecting that a user-initiated event has been performed on a user device; detecting a plurality of sensors connected to the user device; causing a plurality of content items related to the user-initiated event to be obtained using the plurality of sensors connected to the user device; determining whether each of the plurality of content items is to be associated with the user-initiated event based on user device information from a plurality of data sources; associating a portion of the plurality of content items with the user-initiated event based on the determination; retrieving information related to the portion of the plurality of content items; detecting, using the plurality of sensors connected to the user device, a second plurality of content items; determining that at least one of the second plurality of content items is related to at least one of the first plurality of content items; and causing information related to the user-initiated event to be presented by the user device based at least in part on the determination.

Media unit retrieval methods, systems and computer program products are provided that allow a user to search for an item by iteratively presenting media units such as images representing items to the user and receiving user input consisting of selections of the presented media units (including possibly the empty selection). Features, or attributes, a user is interested in, for example semantic features, are inferred from the interaction and media units are retrieved for presentation based on similarity with user-selected media units, through sampling of a probability distribution describing the intent or interests, or combinations of approaches. Accordingly, the user-experience is akin to a conversation about what the user is looking for. Retrieval may be based on both selected and unselected media units and the selection may comprise making a selection with a single action. Further, a database of media units can capture similarity relationships for efficient media unit retrieval.

Media unit retrieval methods, systems and computer program products are provided that allow a user to search for an item by iteratively presenting media units such as images representing items to the user and receiving user input consisting of selections of the presented media units (including possibly the empty selection). Features, or attributes, a user is interested in, for example semantic features, are inferred from the interaction and media units are retrieved for presentation based on similarity with user-selected media units, through sampling of a probability distribution describing the intent or interests, or combinations of approaches. Accordingly, the user-experience is akin to a conversation about what the user is looking for. Retrieval may be based on both selected and unselected media units and the selection may comprise making a selection with a single action. Further, a database of media units can capture similarity relationships for efficient media unit retrieval.