Mechanisms are provided for character-based and image-based media content search and discovery. Character images or entity images are mapped to corresponding media content. Selection of an image or a portion of an image may trigger or search for corresponding media content or begin playback of relevant media content. Character images or entity images need not correspond to a primary program character or object but may correspond to minor characters or tangential entities depicted periodically on particular programs.

A method comprising: causing provision of a visual access menu to enable a user to access video segments of a scene comprising: causing display of at least a portion an image of the scene; causing display, at a first location in the scene, of a first user-selectable menu option that when selected causes access to one or more first video segments of activity at the first location in the scene; and causing display, at a second location in the scene, of a second user-selectable menu option that when selected causes access to one or more second video segments of activity at the second location in the scene.

A method comprising: causing provision of a visual access menu to enable a user to access video segments of a scene comprising: causing display of at least a portion an image of the scene; causing display, at a first location in the scene, of a first user-selectable menu option that when selected causes access to one or more first video segments of activity at the first location in the scene; and causing display, at a second location in the scene, of a second user-selectable menu option that when selected causes access to one or more second video segments of activity at the second location in the scene.

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

A video annotation interface includes a video pane configured to display a video, a video timeline bar including a video play-head indicating a current point of the video which is being played, a segment timeline bar including initial and final handles configured to define a segment of the video for playing, and a plurality of color-coded comment markers displayed in connection with the video timeline bar. Each of the comment markers is associated with a frame or segment of the video and corresponds to one or more annotations for that frame or segment made by one of a plurality of users. Each of the users can make annotations and view annotations made by other users. The annotations can include annotations corresponding to a plurality of modalities, including text, drawing, video, and audio modalities.

A video annotation interface includes a video pane configured to display a video, a video timeline bar including a video play-head indicating a current point of the video which is being played, a segment timeline bar including initial and final handles configured to define a segment of the video for playing, and a plurality of color-coded comment markers displayed in connection with the video timeline bar. Each of the comment markers is associated with a frame or segment of the video and corresponds to one or more annotations for that frame or segment made by one of a plurality of users. Each of the users can make annotations and view annotations made by other users. The annotations can include annotations corresponding to a plurality of modalities, including text, drawing, video, and audio modalities.

A method stored in a computer readable medium, including identifying a predetermined object having viewable information from a plurality of frames, identifying a movement of the predetermined object from a video stream of the plurality of frames, identifying a current state of the predetermined object based on a movement of another object or region from the plurality of frames having an occlusion region of a current frame, determining an information change of the viewable information in the plurality of frames, marking a frame with maximum information of the viewable information in the predetermined object as a key frame; and serializing the key frame according to time stamps.

A method stored in a computer readable medium, including identifying a predetermined object having viewable information from a plurality of frames, identifying a movement of the predetermined object from a video stream of the plurality of frames, identifying a current state of the predetermined object based on a movement of another object or region from the plurality of frames having an occlusion region of a current frame, determining an information change of the viewable information in the plurality of frames, marking a frame with maximum information of the viewable information in the predetermined object as a key frame; and serializing the key frame according to time stamps.

Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common watch together experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.