A method for generating a summary video sequence from a source video sequence is disclosed. The method comprises: identifying, in the source video sequence, event video sequences, wherein each event video sequence comprises consecutive video frames in which one or more objects of interest are present; extracting, from video frames of one or more event video sequences of the event video sequences, pixels depicting the respective one or more objects of interest; while keeping spatial and temporal relations of the extracted pixels as in the source video sequence, overlaying the extracted pixels of the video frames of the one or more event video sequences onto video frames of a main event video sequence of the event video sequences, thereby generating the summary video sequence. A video processing device configured to generate the summary video sequence is also disclosed.

A method for generating a summary video sequence from a source video sequence is disclosed. The method comprises: identifying, in the source video sequence, event video sequences, wherein each event video sequence comprises consecutive video frames in which one or more objects of interest are present; extracting, from video frames of one or more event video sequences of the event video sequences, pixels depicting the respective one or more objects of interest; while keeping spatial and temporal relations of the extracted pixels as in the source video sequence, overlaying the extracted pixels of the video frames of the one or more event video sequences onto video frames of a main event video sequence of the event video sequences, thereby generating the summary video sequence. A video processing device configured to generate the summary video sequence is also disclosed.

In an embodiment, a data processing method comprises a first computer obtaining access to a digitally stored video program and causing playing the video program in a player window of a second computer, wherein the player window includes a linear graphical timeline representing the video program; the first computer receiving from the second computer location input data specifying a point in the video program and determining a time value of the point in the video program; receiving comment type input data indicating a particular comment type among a plurality of available comment types; receiving comment input data; creating and storing, in electronic digital storage coupled to the first computer, a record that associates an identifier of the video program, the time value, the comment type input data, and the comment input data; causing displaying, in the timeline at a position that is proportional to the point, a marker having a particular distinctive appearance from among a plurality of distinctive appearances that correspond respectively to the plurality of available comment types.

With the widespread availability of video cameras, we are facing an ever-growing enormous collection of unedited and unstructured video data. Due to lack of an automatic way to generate highlights from this large collection of video streams, these videos can be tedious and time consuming to index or search. The present invention is a novel method of online video highlighting, a principled way of generating a short video highlight summarizing the most important and interesting contents of a potentially very long video, which is costly both time-wise and financially for manual processing. Specifically, the method learns a dictionary from given video using group sparse coding, and updates atoms in the dictionary on-the-fly. A highlight of the given video is then generated by combining segments that cannot be sparsely reconstructed using the learned dictionary. The online fashion of the method enables it to process arbitrarily long videos and starts generating highlights before seeing the end of the video, both attractive characteristics for practical applications.

With the widespread availability of video cameras, we are facing an ever-growing enormous collection of unedited and unstructured video data. Due to lack of an automatic way to generate highlights from this large collection of video streams, these videos can be tedious and time consuming to index or search. The present invention is a novel method of online video highlighting, a principled way of generating a short video highlight summarizing the most important and interesting contents of a potentially very long video, which is costly both time-wise and financially for manual processing. Specifically, the method learns a dictionary from given video using group sparse coding, and updates atoms in the dictionary on-the-fly. A highlight of the given video is then generated by combining segments that cannot be sparsely reconstructed using the learned dictionary. The online fashion of the method enables it to process arbitrarily long videos and starts generating highlights before seeing the end of the video, both attractive characteristics for practical applications.

A video display hub is mounted in a common household area such as a kitchen or family room. During times that have been designated as being available for communications, devices in first and second households exchange and display blurred video, allowing users in each household to see vague shapes and movements of the other household. Upon noticing activity, a user in the first household may initiate a video conversation, causing the video from the first household to be unblurred and causing unobscured voice to be transmitted to the second household. A user in the second household may respond by allowing the video conversation to be fully enabled, allowing the video from the second household to be unblurred and unobscured voice to be transmitted back to the first household.

In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided. In some embodiments, a method for transitioning between audio items in playlists is provided, comprising: identifying a sequence of audio items in a playlist of audio items, wherein the sequence of audio items includes a first audio item and a second audio item that is to be played subsequent to the first audio item; and modifying an end portion of the first audio item and a beginning portion of the second audio item, where the end portion of the first audio item and the beginning portion of the second audio item are to be played concurrently to transition between the first audio item and the second audio item, wherein the end portion of the first audio item and the beginning portion of the second audio item have an overlap duration, and wherein modifying the end portion of the first audio item and the beginning portion of the second audio item comprises: generating a first spectrogram corresponding to the end portion of the first audio item and a second spectrogram corresponding to the beginning portion of the second audio item; identifying, for each frequency band in a series of frequency bands, a window over which the first spectrogram within the end portion of the first audio item and the second spectrogram within the beginning portion of the second audio item have a particular cross-correlation; modifying, for each frequency band in the series of frequency bands, the end portion of the first spectrogram and the beginning portion of the second spectrogram such that amplitudes of frequencies within the frequency band decrease within the first spectrogram over the end portion of the first spectrogram and that amplitudes of frequencies within the frequency band increase within the second spectrogram over the beginning portion of the second spectrogram; and generating a modified version of the first audio item the includes the modified end portion of the first audio item based on the modified end portion of the first spectrogram and generating a modified version of the second audio item that includes the modified beginning portion of the second audio item based on the modified beginning portion of the second spectrogram.

In accordance with some embodiments of the disclosed subject matter, mechanisms for seamless audio melding between audio items in a playlist are provided. In some embodiments, a method for transitioning between audio items in playlists is provided, comprising: identifying a sequence of audio items in a playlist of audio items, wherein the sequence of audio items includes a first audio item and a second audio item that is to be played subsequent to the first audio item; and modifying an end portion of the first audio item and a beginning portion of the second audio item, where the end portion of the first audio item and the beginning portion of the second audio item are to be played concurrently to transition between the first audio item and the second audio item, wherein the end portion of the first audio item and the beginning portion of the second audio item have an overlap duration, and wherein modifying the end portion of the first audio item and the beginning portion of the second audio item comprises: generating a first spectrogram corresponding to the end portion of the first audio item and a second spectrogram corresponding to the beginning portion of the second audio item; identifying, for each frequency band in a series of frequency bands, a window over which the first spectrogram within the end portion of the first audio item and the second spectrogram within the beginning portion of the second audio item have a particular cross-correlation; modifying, for each frequency band in the series of frequency bands, the end portion of the first spectrogram and the beginning portion of the second spectrogram such that amplitudes of frequencies within the frequency band decrease within the first spectrogram over the end portion of the first spectrogram and that amplitudes of frequencies within the frequency band increase within the second spectrogram over the beginning portion of the second spectrogram; and generating a modified version of the first audio item the includes the modified end portion of the first audio item based on the modified end portion of the first spectrogram and generating a modified version of the second audio item that includes the modified beginning portion of the second audio item based on the modified beginning portion of the second spectrogram.

Feature information characterize features of video clips may be obtained. A given video clip may be selected as a segment of a video edit. Other video clips may be iteratively selected as other segments of the video edit based on the feature information of the video clips and recommended feature information of the segments. Recommended feature information of a particular segment may be obtained by processing feature information of a previously selected video clip through a trained recurrent neural network. Video edit information defining the video edit may be generated. The video edit may include the selected video clips as the segments of the video edit.

Feature information characterize features of video clips may be obtained. A given video clip may be selected as a segment of a video edit. Other video clips may be iteratively selected as other segments of the video edit based on the feature information of the video clips and recommended feature information of the segments. Recommended feature information of a particular segment may be obtained by processing feature information of a previously selected video clip through a trained recurrent neural network. Video edit information defining the video edit may be generated. The video edit may include the selected video clips as the segments of the video edit.