An interactive video/multimedia application (IVM application) may specify one or more media assets for playback. The IVM application may define the rendering, composition, and interactivity of one or more the assets, such as video. Video multimedia application data (IVMA data may) be used to define the behavior of the IVM application. The IVMA data may be embodied as a standalone file in a text or binary, compressed format. Alternatively, the IVMA data may be embedded within other media content. A video asset used in the IVM application may include embedded, content-aware metadata that is tightly coupled to the asset. The IVM application may reference the content-aware metadata embedded within the asset to define the rendering and composition of application display elements and user-interactivity features. The interactive video/multimedia application (defined by the video and multimedia application data) may be presented to a viewer in a player application.

In various examples, cloud computing systems may store frames of video streams and metadata generated from the frames in separate data stores, with each type of data being indexed using shared timestamps. Thus, the frames of a video stream may be stored and/or processed and corresponding metadata of the frames may be stored and/or generated across any number of devices of the cloud computing system (e.g., edge and/or core devices) while being linked by the timestamps. A client device may provide a request or query to dynamically annotate the video stream using a particular subset of the metadata. In processing the request or query, the timestamps may be used to retrieve video data representing frames of the video stream and metadata extracted from those frames across the data stores. The retrieved metadata and video data may be used to annotate the frames for display on the client device.

A system, method and computer-readable medium are presented for providing real-time content-based navigation of live video programming. The video programming is received and a searchable database is generated. The method aspect of the invention comprises receiving a live video program, generating an index to the received live video program by extracting images and/or text from the video program, recording the live video program, presenting at least a portion of data associated with the generated index to a user, receiving user input regarding a search to a portion of the recorded video program to which the user desires to navigate and playing back the recorded video program starting at the searched portion identified by the user input. The search may be of an image and/or text portion of the presentation.

One variation of a method for serving interactive advertisement content includes, at a visual element rendered within a window of a computing device: loading an interactive advertisement, including a digital advertisement and a mask overlaid the digital advertisement, into the visual element, the mask including a base layer and an aperture defining a second opacity less than a first opacity of the base layer; in response to a scroll event that moves the visual element a first position within the window, rendering the interactive advertisement within the visual element; and, in response to a scroll event that moves the visual element to a second position within the window, transforming the mask according to a sequence of transformations at a rate proportional to a scroll rate of the scroll event, the sequence of transformations corresponding to a sequence of vertical positions of the visual element within the window.

The present invention generates a compression invariant motion timeline for a video. For each second in the video, the method uses an identification procedure to determine a stored key frame size, a frame counter, and an accumulated size of frames. The method then calculates and stores a motion value for the second using the stored key frame size, the frame counter, and the accumulated size of frames. The motion values for each second may be used to construct a timeline for the video.

A video identifier uniquely identifying a video captured by a camera is generated. The video includes video frames and optionally concurrently captured audio as well as video metadata describing the video. Video data is extracted from at least two of the video's frames. By combining the extracted video data in an order specified by an identifier generation protocol, an extracted data object is generated. The extracted data object is hashed to generate the unique media identifier, which is stored in association with the video. The identifier generation protocol may indicate the portions of the video data to extract, such as video data corresponding to particular video frames and audio data corresponding to particular audio samples. The extracted data object may include a size of particular video frames, a number of audio samples in the video, or the duration of the video, for example.

Techniques for intelligently biasing video thumbnail selection to popular segments of the video file are provided. In one aspect, a method of selecting video thumbnails used to represent a video file is provided. The method includes the steps of: (a) acquiring trending data from viewers related to the video file; (b) using the trending data to identify one or more segments of the video file that are popular among the viewers; and (c) adapting a selection of the video thumbnails used to represent the video file to the segments identified in step (b).

A system and method for selecting portions of video data from preview video data is provided. The system may extract image features from the preview video data and discard video frames associated with poor image quality based on the image features. The system may determine similarity scores between individual video frames and corresponding transition costs and may identify transition points in the preview video data based on the similarity scores and/or transition costs. The system may select portions of the video data for further processing based on the transition points and the image features. By selecting portions of the video data, the system may reduce a bandwidth consumption, processing burden and/or latency associated with uploading the video data or performing further processing.

The present invention provides a biometric notification system for selectively sending messages to interested recipients. In various embodiments, message trigger criteria, interested recipients, and message content may vary depending upon, among other things, the service being provided.

Aspects relate to transmission of metadata from a source to a sink device, and optionally through one or more intermediaries. A source device encodes metadata into what would have been a blanking area of a field to be transmitted, according to a current video format. The source device encodes a timing for an active video data signal that is modified from a timing that would be used only for transmission of video data at a current resolution. A separate indicator from the source, or a negotiation between source and sink allows the sink to determine what part of the data indicated as being active video data is metadata, and to use that metadata for controlling aspects of the video display, and to use other parts of the received video data as video data for display. A sink can signal supported capabilities to a source.