In various examples, cloud computing systems may store frames of video streams and metadata generated from the frames in separate data stores, with each type of data being indexed using shared timestamps. Thus, the frames of a video stream may be stored and/or processed and corresponding metadata of the frames may be stored and/or generated across any number of devices of the cloud computing system (e.g., edge and/or core devices) while being linked by the timestamps. A client device may provide a request or query to dynamically annotate the video stream using a particular subset of the metadata. In processing the request or query, the timestamps may be used to retrieve video data representing frames of the video stream and metadata extracted from those frames across the data stores. The retrieved metadata and video data may be used to annotate the frames for display on the client device.

A method, system and computer program product for interactively identifying same individuals or objects present in video recordings is disclosed. When a thumbnail in a set of thumbnails is selected, new information is obtained. The new information may be that an individual or object is present in the portion of the video recording associated with the thumbnail. A search can be carried out for the individual or object based on the new information. The search generates new match likelihoods for each of displayed thumbnails within a user interface page. The displayed thumbnails are re-ordered based on the new match likelihoods.

One variation of a method for serving interactive content to a user includes, at a visual element inserted into a document accessed by a computing device: loading a first frame from a digital video; in response to a scroll-down event that moves the visual element upward from a bottom of a window rendered on the computing device toward a top of the window, seeking from the first frame through a subset of frames in the digital video in a first direction at a rate corresponding to a scroll rate of the scroll-down event, the subset of frames spanning a duration of the digital video corresponding to a length of the scroll-down event; and, in response to termination of the scroll-down event with the visual element remaining in view within the window, playing the digital video forward from a last frame in the subset of frames in the digital video.

A method and an apparatus for playing back recorded video from a temporal position within a temporal range of the recorded video is disclosed. The recorded video including intra frames and inter frames and the recorded video including video sequences having different frame rates. The method comprises receiving a request for playing back the recorded video from a specific temporal position recorded in the recorded video, identifying an intra frame at an earlier temporal position in the recorded video than the specific temporal position received in the request, playing back the recorded video in a first mode from the identified intra frame, and playing back the recorded video in a second mode from the specific temporal position in the recorded video when the playing back of the recorded video in the first mode have arrived at the specific temporal position of in the recorded video.

This disclosure relates to system and methods for segmenting a video in a higher order dimensional space. A video may be segmented by obtaining visual information defining an image of the video. The visual information may include pixels of the image and may be represented in a display space having a first dimensionality. A designation of a subset of the visual information represented in the display space as a part of an object portrayed in the image may be obtained. The visual information and the designation may be represented in the higher order dimensional space having a second dimensionality greater than the first dimensionality. An association of the visual information represented in the higher order dimensional space with the object may be obtained. The association may be correlated with the visual information represented in the display space. The correlation may define a location of the object in the image.

Devices, systems and methods are disclosed for improving a display of panoramic video data by including a first angle indicator, as a visual representation of a direction of a displayed portion of the panoramic video data relative to a reference location, along with a second angle indicator indicating an object of interest. The second angle indicator may display a fixed angle or a recommended angle to improve navigation within the panoramic video data. The fixed angle may be determined by the user or the device and may remain stationary during playback of the panoramic video data, allowing the user to switch between directional views without panning. The recommended angle may be determined based on a location of a tracked object, allowing the user to display the tracked object without panning. The second angle indicator may be represented by an icon illustrating the object of interest.

Aspects of the subject disclosure may include, for example, observing a plurality of objects viewed through a smart lens, wherein the plurality of objects are in a frame of an image viewed by the smart lens, determining an identification for an object of the plurality of objects, assigning tag information for the object based on the identification, storing the tag information for the object and the frame in which the object was observed, receiving a recall request for the object, retrieving the tag information for the object and the frame responsive to the receiving the recall request, and displaying the tag information and the frame. Other embodiments are disclosed.

With the widespread availability of video cameras, we are facing an ever-growing enormous collection of unedited and unstructured video data. Due to lack of an automatic way to generate highlights from this large collection of video streams, these videos can be tedious and time consuming to index or search. The present invention is a novel method of online video highlighting, a principled way of generating a short video highlight summarizing the most important and interesting contents of a potentially very long video, which is costly both time-wise and financially for manual processing. Specifically, the method learns a dictionary from given video using group sparse coding, and updates atoms in the dictionary on-the-fly. A highlight of the given video is then generated by combining segments that cannot be sparsely reconstructed using the learned dictionary. The online fashion of the method enables it to process arbitrarily long videos and starts generating highlights before seeing the end of the video, both attractive characteristics for practical applications.

A method for video browsing includes comparing a current image frame with a previous image frame prior to the current image frame in a video to obtain target block information, identifying the current image frame as a keyframe if the target block information satisfies a predetermined condition, and playing the keyframe.

Content proxy may be obtained. Content may include video captured by an action camera. Content proxy may include metadata information obtained contemporaneous with the content and stored in a session container. Content proxy may include lower data rate version of the content (thumbnails). Content proxy information may be viewed and/or analyzed in order to obtain one or more highlights. Content portion corresponding to the highlight may be obtained. Multiple versions of content proxy obtained by multiple cameras may be used to identify, display, and/or share content portions in a multi-camera/multiuser applications.