A metadata server that includes circuitry is provided. The circuitry receives a first segment from a plurality of segments of first media content and determines context information associated with the first segment based on a characteristic of at least one frame of a plurality of frames included in the first segment. The circuitry generates first metadata associated with the first segment based on the context information. The first metadata includes timing information corresponding to the determined context information to control a first set of electrical devices. The circuitry further transmits the received first segment and the generated first metadata to a media device associated with the first set of electrical devices.

Analyzing the complexity of an object of a scene in a media steam (or media data) performed by at least one processor, is provided, including receiving immersive media data comprising a plurality of scenes from a content source; obtaining a respective object of a respective scene in the plurality of scenes, from the immersive media data; analyzing the respective scene to generate complexity information associated with the respective object of the respective scene; generating metadata associated with the respective object of the respective scene, the metadata comprising the complexity information; and determining whether to distribute the respective scene to a client for processing based on the generated metadata.

The present disclosure provides a video timing labeling method. The method includes: acquiring a video file to be labeled and text information to be inquired; acquiring a video segment matching the text information to be inquired based on a timing labeling network of a timing labeling model; acquiring a video feature of the video segment matching the text information to be inquired based on a feature extraction network of the timing labeling model; acquiring text information corresponding to the video segment labeled in the video file based on a visual text translation network of the timing labeling model; and outputting the video segment matching the text information to be inquired and the text information corresponding to the video segment labeled in the video file based on the timing labeling model.

A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.

Systems, methods, and devices relating to determining an introduction portion in a video program are described herein. A method may determine first and second hard-matching pairs of video segments in first and second video content such that video fingerprints of the first hard-matching pair match and video fingerprints of the second hard-matching pair also match. The method may classify a third pair of video segments in the first and second video content, sequentially between the first and second hard-matching pairs, as a soft-matching pair of video segments of an introduction portion. The method may use the classification of the third pair of video segments as a soft-matching pair to determine a model configured to determine that a pair of video segments in two video content items are a soft-matching pair of video segments of an introduction portion.

Systems, methods, devices, and computer program products provide social and interactive applications for mass media based on real time ambient-audio and/or video identification. In some implementations, a method includes: receiving descriptors identifying ambient audio associated with a media broadcast; comparing the descriptors to one or more reference descriptors; and determining a rating for the media broadcast based at least in part on the results of the comparison.

A master node in a multimedia content network includes a processor, a content interface coupled to the processor and configured to receive, from a media source, a multimedia stream including a multimedia program, a network interface coupled to the processor and configured to provide an interface to a broadband network, processor executable instructions for performing operations including: identifying a group of subordinate nodes available to analyze a multimedia program, assigning different analysis tasks for the multimedia program to the available subordinate nodes, receiving analysis results from the subordinate nodes; and modifying electronic programming guide information for the multimedia program based on the analysis results.

Methods and apparatus to generate reference signatures are disclosed. An example method includes collecting a first signature for media being presented to a plurality of households; crediting the media when the first signature matches a reference signature in a reference signature database; in response to determining that the first signature does not match a reference signature in the reference signature database and the first signature does not match an unidentified signature in an unknown signature database, storing the first signature in the unknown signature database; in response to determining that a second signature does not match the reference signature in the reference signature database and the second signature matches the unidentified signature in the unknown signature database, and increasing a count associated with the unidentified signature.

This application provides a video labeling method performed by a server, and the method includes: receiving a video extraction instruction transmitted by a terminal, and obtaining a to-be-extracted video according to the video extraction instruction; extracting event information from video frames of the to-be-extracted video; forming at least one event information flow by using the event information; capturing, based on the at least one event information flow, at least one first clip that meets a plot trigger condition from the to-be-extracted video and obtaining a plot labeling tag of the at least one first clip; and transmitting the at least one first clip and the corresponding plot labeling tag to the terminal, wherein the terminal displays the at least one first clip and the corresponding plot labeling tag in a preset display region of a display interface in which the to-be-extracted video is displayed.

Methods, systems, and media for identifying abusive user accounts based on playlists are provided. In accordance with some embodiments of the disclosed subject matter, a method for identifying abusive content is provided, the method comprising: determining at least one feature associated with a playlist created by a user-generated channel; calculating a playlist score associated with the playlist based on a playlist classifier, wherein the playlist classifier comprises a function that maps the at least one feature to the playlist score; calculating a channel score associated with the user-generated channel based at least on the calculated playlist score; determining that one or more content items associated with the user-generated channel is to be demoted based on the calculated channel score, wherein the one or more content items comprises the playlist; and causing the one or more content items to be demoted.