One example method includes generating a searchable video library. Video files are processed to extract text corresponding to the speech and to the images. The extracted text is semantically searched such that specific portions or locations of video files can be identified and returned in response to a query.

A video retrieval method and apparatus, a device and a storage medium are provided. The method comprises the following steps: acquiring a comparison video clip from a video library according to the duration of a to-be-tested video (S110); determining the similarity between the to-be-tested video and the comparison video clip by a target spatio-temporal neural network, a spatio-temporal convolutional layer of the target spatio-temporal neural network being configured to be capable of performing two-dimensional convolution and temporal dimension information processing, respectively (S120); and traversing the video library, and outputting a retrieval result according to the similarity (S130).

A system for integrated analysis and management of video data includes a routing server configured to receive video data from an external input video providing device, a video database configured to store the received video data, a video analyzing server cluster including a plurality of video analyzing servers configured to analyze the video data, a metadata database configured to store metadata of the video data, and a video search server configured to search the metadata database and the video database. As described in various embodiments of the present disclosure, the system can perform integrated analysis of various video data received from a number of channels and provide an analysis result, and can also rapidly provide an accurate search result in response to a user's request for search.

A system for integrated analysis and management of video data includes a routing server configured to receive video data from an external input video providing device, a video database configured to store the received video data, a video analyzing server cluster including a plurality of video analyzing servers configured to analyze the video data, a metadata database configured to store metadata of the video data, and a video search server configured to search the metadata database and the video database. As described in various embodiments of the present disclosure, the system can perform integrated analysis of various video data received from a number of channels and provide an analysis result, and can also rapidly provide an accurate search result in response to a user's request for search.

An electronic device that obtains a set of remote-control commands is described. During operation, the electronic device may receive an image associated with a second electronic device, where a brand and a model of the second electronic device are initially unknown to the electronic device. Then, the electronic device may perform image analysis on the image to determine at least the brand of the second electronic device. Moreover, the electronic device may access, based at least in part on the determined brand, the set of remote-control commands that are associated with the second electronic device. Next, the electronic device may store the set of remote-control commands in memory. Subsequently, when the electronic device receives user-interface activity information associated with a portable electronic device that specifies selection of the second electronic device, the electronic device may provide the set of remote-control commands to the second electronic device.

Systems and methods for searching, identifying, scoring, and providing access to companion media assets for a primary media asset are disclosed. In response to a request for companion content, metadata within a predefined time period of a play position when the request was made, is downloaded. A dynamic search template that contains search parameters based on the downloaded metadata is generated. In response to the search conducted using the search template, a plurality of companion media assets are identified and then verified. A trust score for the companion media asset is accessed. The trust score may be analyzed and modified based on its contextual relationship to the play position of the primary media asset. If the trust score is within a rating range, then a link to access the companion media asset, or a specific segment or play position within the companion media asset, is provided.

Systems and methods for searching, identifying, scoring, and providing access to companion media assets for a primary media asset are disclosed. In response to a request for companion content, metadata within a predefined time period of a play position when the request was made, is downloaded. A dynamic search template that contains search parameters based on the downloaded metadata is generated. In response to the search conducted using the search template, a plurality of companion media assets are identified and then verified. A trust score for the companion media asset is accessed. The trust score may be analyzed and modified based on its contextual relationship to the play position of the primary media asset. If the trust score is within a rating range, then a link to access the companion media asset, or a specific segment or play position within the companion media asset, is provided.

Methods and systems are described for performing video retrieval together with video grounding. A word-based query for a video is and encoded into a query representation using a trained query encoder. One or more similar video representations are identified, from a plurality of video representations that are similar to the query representation. Each similar video representation represents a respective relevant video. A grounding is generated for each relevant video by forward propagating each respective similar video representation together with the query representation through a trained grounding module. The relevant videos or identifiers of the relevant videos are outputted together with the grounding generated for each relevant video.

A method includes detecting control of an active content creation tool of an interactive computing system in response to a user input received at a user interface of the interactive computing system. The method also includes automatically updating a video search query based on the detected control of the active content creation tool to include context information about the active content creation tool. Further, the method includes performing a video search of video captions from a video database using the video search query and providing search results of the video search to the user interface of the interactive computing system.

A method includes detecting control of an active content creation tool of an interactive computing system in response to a user input received at a user interface of the interactive computing system. The method also includes automatically updating a video search query based on the detected control of the active content creation tool to include context information about the active content creation tool. Further, the method includes performing a video search of video captions from a video database using the video search query and providing search results of the video search to the user interface of the interactive computing system.