METHODS AND SYSTEMS FOR RECOMMENDING CONTENT ITEMS
20230224546 · 2023-07-13
Inventors
- Ashish Gupta (Bangalore, IN)
- Vaibhav Gupta (Bangalore, IN)
- Rohit Dhiman (Uttarakhand, IN)
- Senthil Kumar Karuppasamy (Bangalore, IN)
Cpc classification
H04N21/4756
ELECTRICITY
H04N21/4622
ELECTRICITY
H04N21/24
ELECTRICITY
G06F16/435
PHYSICS
H04N21/4826
ELECTRICITY
H04N21/44209
ELECTRICITY
G06F16/9035
PHYSICS
H04N21/4621
ELECTRICITY
International classification
H04N21/462
ELECTRICITY
H04N21/442
ELECTRICITY
Abstract
Systems and methods are described for recommending a content item. A search query for a content item is received. The availability of the content item from more than one source is determined. In response to determining that the content item is available from more than one source, the quality of each of the available content items from respective sources is determined. A recommendation factor is determined. The recommendation factor is based on at least one of the bandwidth available to a user device, the resolution capability of the user device, and the quality of experience of each of the sources from which the content item is available. A list of search results for the available content items is generated. The list is ordered based on the quality of each of the available content items from respective sources and the recommendation factor.
Claims
1-40. (canceled)
41. A method comprising: receiving, at a computing device, input associated with selecting a content item; identifying that the selected content item is available from a plurality of sources; determining, based on metadata associated with the selected content item from the plurality of sources, respective resolutions of the requested content item from each respective source; generating, for output, a list comprising the plurality of sources and the resolutions that are available for the content item from each source; receiving input associated with selecting a respective source and resolution for the content item; identifying that the selected resolution is higher than a resolution capacity of the computing device; and generating, for output, a recommended resolution that is suitable for the computing device.
42. The method of claim 41 further comprising requesting and generating the content item for output at the recommended resolution.
43. The method of claim 41 further comprising: identifying a quality of experience for each identified source; identifying a maximum available resolution for the content item from each respective source; determining, based on a user profile, a preference for prioritising quality of experience over maximum resolution; and ordering the list based on the quality of experience for each respective source.
44. The method of claim 41, further comprising: identifying a quality of experience for each identified source, wherein the quality of experience for each identified source is determined based on user feedback; and ordering the list based on the quality of experience for each respective source.
45. The method of claim 41, further comprising: receiving input associated with selecting a source from the list; determining a recommendation factor, the recommendation factor being based on a maximum available resolution of the content item from a source; and generating, for output, a user interface comprising a pre-selected resolution for the content item from the selected source, wherein the pre-selecting is based on the recommendation factor.
46. The method of claim 41, wherein: the method further comprises: determining the bandwidth available to the computing device; and determining a recommendation factor for each available resolution from each of the plurality of sources, wherein the recommendation factor is based on whether an available resolution is supported by the available bandwidth; and generating the list for output further comprises formatting each available resolution from each of the plurality of sources that has an associated recommendation factor at or above a threshold level in a first format, and formatting each available resolution from each of the plurality of sources that has an associated recommendation factor below a threshold level in a second format.
47. The method of claim 41, further comprising identifying that the content item is available from a plurality of sources via an aggregator database.
48. The method of claim 41, further comprising: requesting and generating for output the content item at the computing device; logging, at the computing device, a playback parameter associated with generating the content item for output at the computing device; and transmitting the logged playback parameter to a server.
49. The method of claim 48, further comprising: identifying, based on the logged playback parameter, a quality of experience for each identified source; and ordering the list based on the quality of experience for each respective source.
50. The method of claim 41, further comprising: identifying, at a first time, a first quality of experience for each identified source; ordering the list based on the first quality of experience for each respective source; identifying, at a second time, an updated quality of experience for each identified source; and reordering the list based on the updated quality of experience for each identified source.
51. A system comprising: input circuitry configured to: receive, at a computing device, input associated with selecting a content item; and control circuitry configured to: identify that the selected content item is available from a plurality of sources; determine, based on metadata associated with the selected content item from the plurality of sources, respective resolutions of the requested content item from each respective source; generate, for output, a list comprising the plurality of sources and the resolutions that are available for the content item from each source; receive input associated with selecting a respective source and resolution for the content item; identify that the selected resolution is higher than a resolution capacity of the computing device; and generate, for output, a recommended resolution that is suitable for the computing device.
52. The system of claim 51 further comprising control circuitry configured to request and generate the content item for output at the recommended resolution.
53. The system of claim 51 further comprising control circuitry configured to: identify a quality of experience for each identified source; identify a maximum available resolution for the content item from each respective source; determine, based on a user profile, a preference for prioritising quality of experience over maximum resolution; and order the list based on the quality of experience for each respective source.
54. The system of claim 51, further comprising control circuitry configured to: identify a quality of experience for each identified source, wherein the quality of experience for each identified source is determined based on user feedback; and order the list based on the quality of experience for each respective source.
55. The system of claim 51, further comprising control circuitry configured to: receive input associated with selecting a source from the list; determine a recommendation factor, the recommendation factor being based on a maximum available resolution of the content item from a source; and generate, for output, a user interface comprising a pre-selected resolution for the content item from the selected source, wherein the pre-selecting is based on the recommendation factor.
56. The system of claim 51, wherein: the control circuitry is further configured to: determine the bandwidth available to the computing device; and determine a recommendation factor for each available resolution from each of the plurality of sources, wherein the recommendation factor is based on whether an available resolution is supported by the available bandwidth; and the control circuitry configured to generate the list for output is configured to generate the list by formatting each available resolution from each of the plurality of sources that has an associated recommendation factor at or above a threshold level in a first format, and formatting each available resolution from each of the plurality of sources that has an associated recommendation factor below a threshold level in a second format.
57. The system of claim 51, further comprising control circuitry configured to identify that the content item is available from a plurality of sources via an aggregator database.
58. The system of claim 51, further comprising control circuitry configured to: request and generate for output the content item at the computing device; log, at the computing device, a playback parameter associated with generating the content item for output at the computing device; and transmit the logged playback parameter to a server.
59. The system of claim 58, further comprising control circuitry configured to: identify, based on the logged playback parameter, a quality of experience for each identified source; and order the list based on the quality of experience for each respective source.
60. The system of claim 51, further comprising control circuitry configured to: identify, at a first time, a first quality of experience for each identified source; order the list based on the first quality of experience for each respective source; identify, at a second time, an updated quality of experience for each identified source; and reorder the list based on the updated quality of experience for each identified source.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The above and other objects and advantages of the disclosure will be apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings, in which like reference characters refer to like parts throughout, and in which:
[0012]
[0013]
[0014]
[0015]
[0016]
DETAILED DESCRIPTION
[0017]
[0018] In some examples, system 100 may comprise an application that provides guidance through an interface, e.g., the graphical user interface, that allows users to efficiently navigate media content selections and easily identify media content that they may desire, such as content on one or more live streams. Such guidance is referred to herein as an interactive content guidance application or, sometimes, a content guidance application, a media guidance application, or a guidance application.
[0019] Interactive media guidance applications may take various forms, depending on the content for which they provide guidance. One typical type of media guidance application is an interactive television program guide. Interactive television program guides (sometimes referred to as electronic program guides) are well-known guidance applications that, among other things, allow users to navigate among and locate many types of content or media assets. Interactive media guidance applications may generate graphical user interface screens that enable a user to navigate among, locate and select content. As referred to herein, the terms “media asset”, “content items” and “content” should each be understood to mean an electronically consumable user asset, such as television programming, as well as pay-per-view programs, on-demand programs (as in video-on-demand (VOD) systems), Internet content (e.g., streaming content, downloadable content, Webcasts, etc.), video clips, audio, content information, pictures, rotating images, documents, playlists, websites, articles, books, electronic books, blogs, chat sessions, social media, applications, games, and/or any other media or multimedia and/or combination of the same. Guidance applications also allow users to navigate amid and locate content. As referred to herein, the term “multimedia” should be understood to mean content that utilizes at least two different content forms described above, for example, text, audio, images, video, or interactivity content forms. Content may be recorded, played, displayed or accessed by user equipment devices, but can also be part of a live performance.
[0020] The media guidance application and/or any instructions for performing any of the examples discussed herein may be encoded on computer-readable media. Computer-readable media includes any media capable of storing data. The computer-readable media may be transitory, including, but not limited to, propagating electrical or electromagnetic signals, or may be non-transitory, including, but not limited to, volatile and non-volatile computer memory or storage devices such as a hard disk, floppy disk, USB drive, DVD, CD, media card, register memory, processor cache, random access memory (RAM), etc.
[0021] With the ever-improving capabilities of the Internet, mobile computing, and high-speed wireless networks, users are accessing media on user equipment devices on which they traditionally did not. As referred to herein, the phrases “user equipment device,” “user equipment,” “user device,” “electronic device,” “electronic equipment,” “media equipment device,” or “media device” should be understood to mean any device for accessing the content described above, such as a television, a Smart TV, a set-top box, an integrated receiver decoder (IRD) for handling satellite television, a digital storage device, a digital media receiver (DMR), a digital media adapter (DMA), a streaming media device, a DVD player, a DVD recorder, a connected DVD, a local media server, a BLU-RAY player, a BLU-RAY recorder, a personal computer (PC), a laptop computer, a tablet computer, a WebTV box, a personal computer television (PC/TV), a PC media server, a PC media center, a hand-held computer, a stationary telephone, a personal digital assistant (PDA), a mobile telephone, a portable video player, a portable music player, a portable gaming machine, a smartphone, or any other television equipment, computing equipment, or wireless device, and/or combination of the same. In some examples, the user equipment device may have a front-facing screen and a rear-facing screen, multiple front screens, or multiple angled screens. In some examples, the user equipment device may have a front-facing camera and/or a rear-facing camera. On these user equipment devices, users may be able to navigate among and locate the same content available through a television. Consequently, media guidance may be available on these devices, as well. The guidance provided may be for content available only through a television, for content available only through one or more of other types of user equipment devices, or for content available through both a television and one or more of the other types of user equipment devices. The media guidance applications may be provided as online applications (i.e., provided on a website), or as stand-alone applications or clients on user equipment devices. Various devices and platforms that may implement media guidance applications are described in more detail below.
[0022] One of the functions of the media guidance application is to provide media guidance data to users. As referred to herein, the phrase “media guidance data” or “guidance data” should be understood to mean any data related to content or data used in operating the guidance application. For example, the guidance data may include program information, guidance application settings, user preferences, user profile information, media listings, media-related information (e.g., broadcast times, broadcast channels, titles, descriptions, ratings information (e.g., parental control ratings, critics’ ratings, etc.), genre or category information, actor information, logo data for broadcasters’ or providers’ logos, etc.), media format (e.g., standard definition, high definition, 3D, etc.), on-demand information, blogs, websites, and any other type of guidance data that is helpful for a user to navigate among and locate desired content selections.
[0023]
[0024] Server 204 includes control circuitry 210 and input/output (hereinafter “I/O”) path 212, and control circuitry 210 includes storage 214 and processing circuitry 216. Computing device 202, which may be a personal computer, a laptop computer, a tablet computer, a smartphone, a smart television, a smart speaker, or any other type of computing device, includes control circuitry 218, I/O path 220, speaker 222, display 224, e.g., touchscreen 102, and user input interface 226, which in some examples includes at least one of voice-user interface configured to receive natural language queries uttered by users in proximity to computing device 202; and a touch/gesture interface configured to receive a touch/gesture input, e.g., a swipe. Control circuitry 218 includes storage 228 and processing circuitry 230. Control circuitry 210 and/or 218 may be based on any suitable processing circuitry such as processing circuitry 216 and/or 230. As referred to herein, processing circuitry should be understood to mean circuitry based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), etc., and may include a multi-core processor (e.g., dual-core, quad-core, hexa-core, or any suitable number of cores). In some examples, processing circuitry may be distributed across multiple separate processors, for example, multiple of the same type of processors (e.g., two Intel Core i9 processors) or multiple different processors (e.g., an Intel Core i7 processor and an Intel Core i9 processor).
[0025] Each of storage 214, storage 228, and/or storages of other components of system 200 (e.g., storages of content database 206, and/or the like) may be an electronic storage device. As referred to herein, the phrase “electronic storage device” or “storage device” should be understood to mean any device for storing electronic data, computer software, or firmware, such as random-access memory, read-only memory, hard drives, optical drives, digital video disc (DVD) recorders, compact disc (CD) recorders, BLU-RAY disc (BD) recorders, BLU-RAY 3D disc recorders, digital video recorders (DVRs, sometimes called personal video recorders, or PVRs), solid state devices, quantum storage devices, gaming consoles, gaming media, or any other suitable fixed or removable storage devices, and/or any combination of the same. Each of storage 214, storage 228, and/or storages of other components of system 200 may be used to store various types of content, metadata, and or other types of data. Non-volatile memory may also be used (e.g., to launch a boot-up routine and other instructions). Cloud-based storage may be used to supplement storages 214, 228 or instead of storages 214, 228. In some examples, control circuitry 210 and/or 218 executes instructions for an application stored in memory (e.g., storage 214 and/or 228). Specifically, control circuitry 214 and/or 228 may be instructed by the application to perform the functions discussed herein. In some implementations, any action performed by control circuitry 214 and/or 228 may be based on instructions received from the application. For example, the application may be implemented as software or a set of executable instructions that may be stored in storage 214 and/or 228 and executed by control circuitry 214 and/or 228. In some examples, the application may be a client/server application where only a client application resides on computing device 202, and a server application resides on server 204.
[0026] The application may be implemented using any suitable architecture. For example, it may be a stand-alone application wholly implemented on computing device 202. In such an approach, instructions for the application are stored locally (e.g., in storage 228), and data for use by the application is downloaded on a periodic basis (e.g., from an out-of-band feed, from an Internet resource, or using another suitable approach). Control circuitry 218 may retrieve instructions for the application from storage 228 and process the instructions to perform the functionality described herein. Based on the processed instructions, control circuitry 218 may determine what action to perform when input is received from user input interface 226.
[0027] In client/server-based examples, control circuitry 218 may include communication circuitry suitable for communicating with an application server (e.g., server 204) or other networks or servers. The instructions for carrying out the functionality described herein may be stored on the application server. Communication circuitry may include a cable modem, an Ethernet card, or a wireless modem for communication with other equipment, or any other suitable communication circuitry. Such communication may involve the Internet or any other suitable communication networks or paths (e.g., communication network 208). In another example of a client/server-based application, control circuitry 218 runs a web browser that interprets web pages provided by a remote server (e.g., server 204). For example, the remote server may store the instructions for the application in a storage device. The remote server may process the stored instructions using circuitry (e.g., control circuitry 210) and/or generate displays. Computing device 202 may receive the displays generated by the remote server and may display the content of the displays locally via display 224. This way, the processing of the instructions is performed remotely (e.g., by server 204) while the resulting displays, such as the display windows described elsewhere herein, are provided locally on computing device 202. Computing device 202 may receive inputs from the user via input interface 226 and transmit those inputs to the remote server for processing and generating the corresponding displays.
[0028] A user may send instructions to control circuitry 210 and/or 218 using user input interface 226. User input interface 226 may be any suitable user interface, such as a remote control, trackball, keypad, keyboard, touchscreen, touchpad, stylus input, joystick, voice recognition interface, gaming controller, or other user input interfaces. User input interface 226 may be integrated with or combined with display 224, which may be a monitor, a television, a liquid crystal display (LCD), an electronic ink display, or any other equipment suitable for displaying visual images.
[0029] Server 204 and computing device 202 may transmit and receive content and data via I/O path 212 and 220, respectively. For instance, I/O path 212 and/or I/O path 220 may include a communication port(s) configured to transmit and/or receive (for instance to and/or from content database 206), via communication network 208, content item identifiers, content metadata, natural language queries, and/or other data. Control circuitry 210, 218 may be used to send and receive commands, requests, and other suitable data using I/O paths 212, 220.
[0030]
[0031] At step 302, user device 104 receives, e.g., at a content guidance application, a search query input 116 from a user 118. In some examples, the user 118 may enter the search query input 116 directly into the device 104, e.g., using a user input interface of the device 104. Additionally or alternatively, the user 118 may enter the search query input 116 into personal device 110, such as a smartphone, of the user 118, from which the search query input 116 is sent to device 104 for processing. For example, the user 118 may enter the search query Mission: Impossible - Fallout into a content discovery application. The intent of the user is to find one or more sources, e.g., service providers and/or content databases, allowing access to the content item Mission: Impossible - Fallout.
[0032] At step 304, control circuitry, e.g., of user device 104, determines if the content item is available from more than one source. For example, a content discovery application installed on user device 104 may be configured to retrieve data from a content listing of respective service providers to determine if the content item requested by the user 118 is available from multiple service providers, such as Netflix®, Amazon Prime®, Disney+® and iTunes®. Using
[0033] At step 306, in response to determining that the content item is available from more than one source, control circuitry, e.g., of user device 104, determines the quality of each of the available content items from its respective source. For example, notwithstanding licensing restrictions, the content discovery application may determine that Mission: Impossible - Fallout is available from each of Netflix, Amazon Prime and Disney+, but not iTunes. A conventional content discovery application may return the same, or similar, results, but display the results to the user in no particular order. It is desirable, therefore, for the content discovery application to order the results in a manner that may aid the user in selecting the most suitable content item to select for playback.
[0034] In some examples, the content discovery application may retrieve metadata associated with each of the content items available from the respective service providers indicating the quality of each of the content items. For example, the content discovery application may determine that Mission: Impossible - Fallout is available from Netflix in 4K quality, from Amazon Prime in HD quality and from Disney+ in SD quality. The content discovery application may, in the first instance, rank the available content items according to their quality. For example, the content discovery application may list the available content items in descending quality, e.g., 4K, HD, SD, etc.
[0035] At step 308, control circuitry, e.g., of user device 104, determines a recommendation factor, the recommendation factor being based on at least one of the bandwidth available to a user device; the resolution capability of the user device; and the QoE of each of the sources from which the content item is available.
[0036] In some examples, control circuitry, e.g., of user device 104, determines the bandwidth available to user device 104. For example, control circuitry may monitor the connection between user device 104 and network 108, e.g., to determine the quality of the connection based on the speed of connection and/or the reliability of connection. In some examples, the quality of the connection may vary over time and/or location. However, control circuitry may determine the bandwidth available to the user device, e.g., at the time, in the lead-up to the time, and/or at the location at which the search query input 116 was received. For example, control circuitry may determine that the bandwidth available to the user device 104 is a certain value, e.g., 15.8 Mbit/s, at the time at which the search query input 116 was received, or averaged a certain value, e.g., 12.6 Mbit/s, over a predetermined period, e.g., one hour, in the lead0-up to the time that search input query was received.
[0037] In some examples, process 300 comprises a step of determining if the quality of the user device 104 connection to network 108 is sufficient to stream each of the available content items from the respective sources. For example, control circuitry of the user device 104 may compare the bit rate required to stream a content item of a certain quality to the determined quality of the connection between the user device 104 and the service provider. For example, control circuitry may access a lookup table to retrieve the bit rate required to adequately stream 4K content (or any other content quality), e.g., at full resolution.
[0038] In some examples, control circuitry, e.g., of user device 104, determines the resolution capability of the user device 104. For example, control circuitry may determine the resolution capability of a display screen of the user device 104, e.g., the maximum resolution capability of the display screen. Additionally or alternatively, control circuitry may determine one or more operational capabilities of a control module of the display screen. For example, control circuitry may determine the capabilities of a graphics processing unit, a processor clock speed, the amount of graphics memory available, and/or any other appropriate operational parameter of the user device 104 that may affect the ability of the user device 104 to display an image. For example, control circuitry may determine that the user device 104 is capable of displaying a maximum resolution of 1080p.
[0039] In some examples, control circuitry, e.g., of user device 104, determines the QoE of each of the sources from which the content item is available. For example, control circuitry may be configured to access data, e.g., stored on server 112, relating to one or more service providers. For example, control circuitry may be configured to access user feedback data for each of the service providers. User feedback data may be based on one or more appropriate rating categories. For example, it is common for users to submit their feedback to service providers relating to various categories, such as content quality, user interface experience, error rates, bit rate, throughput, transmission delay, availability, jitter, trick play experience, etc. For example, a service provider may receive a rating of 3.5 stars out of 5 stars for the quality of content, a rating of 2.5 stars out of 5 stars for the user interface experience, and a rating of 4.5 stars out of 5 stars for the trick play experience. In such a case, the service provider may receive a total overall rating of 3.5 stars out of 5, e.g., 70%. Additionally or alternatively, a rating may be determined from one or more other independent sources. As such, control circuitry of the user device may be able to determine a QoE for each service provider based on, e.g., based only on, data relating to user feedback for respective service providers.
[0040] Additionally or alternatively, control circuitry may be configured to access data recorded on user device 104 relating to historic playback of content items from at least one of the sources. For example, control circuitry, e.g., of user device 104, may be configured to log one or more playback parameters when receiving content from a service provider, e.g., first service provider 114a and/or second service provider 114b.
[0041] Additionally or alternatively, control circuitry, e.g., of user device 104, may be configured to receive data from server 112 relating to historic content item transmission from the respective sources. For example, each of the service providers may log parameters relating to the transmission of content.
[0042] In view of the above, it is understood that the recommendation factor may be based on at least one of the quality of the network connection to the user device, the resolution capability of a screen of the user device and a QoE score based on user ratings, parameters relating to historic content item playback and/or parameters relating to historic content item transmission. In some examples, process 300 may apply a weighting k to at least one of the above optional variables on which the recommendation factor is based. For example, a weighting may be applied based on one or more user preferences, e.g., for highest user-rated service providers. In some examples, the weighting applied to a variable on which the recommendation factor is based may be zero, in which case means that it does not directly form part of the determination of the recommendation factor. As such, the recommendation factor (RF) may be determined using the formula:
[0043] At step 310, control circuitry generates a list of search results for the available content items, wherein the list is ordered based on the quality of each of the available content items from respective sources and the recommendation factor.
[0044] Process 300 may comprise a step of automatically generating for playback the content item presented in position #1of the list. In some examples, list 120 may not be displayed to user 118. In such cases, list 120 may exist in a database accessible by control circuitry of user device 104, so that the highest-ranked content item may be displayed automatically, e.g., without any further input from the user.
[0045] In some examples, process 300 may comprise determining a change in the recommendation factor as a function of time. For example, control circuitry, e.g., of user device 104, may determine a change in the bandwidth available to user device 104, e.g., as a content item is being streamed to user device 104. For example, where user device 104 is connected to a home network, control circuitry may determine at least one of a drop in the speed of the network connection being received by the home hub and/or an increase in the number of devices connected to the home hub. As a result, the recommendation factor may change for a given content item. For example, where a 4K content item had previously been ranked in position 1 owing to a large amount of available bandwidth, said 4K content may be re-ranked to a lower position, e.g., position 3, as a result of the network connection no longer being able to support the streaming of 4K content. Such dynamic re-ranking may result in the automatic switching of the display of content from the 4K content item to a content item having lower quality, e.g., by virtue of the re-ordering of the list.
[0046] The actions or descriptions of
[0047] The processes described above are intended to be illustrative and not limiting. One skilled in the art would appreciate that the steps of the processes discussed herein may be omitted, modified, combined, and/or rearranged, and any additional steps may be performed without departing from the scope of the invention. More generally, the above disclosure is meant to be exemplary and not limiting. Only the claims that follow are meant to set bounds as to what the present invention includes. Furthermore, it should be noted that the features and limitations described in any one example may be applied to any other example herein, and flowcharts or examples relating to one example may be combined with any other example in a suitable manner, done in different orders, or done in parallel. In addition, the systems and methods described herein may be performed in real time. It should also be noted that the systems and/or methods described above may be applied to, or used in accordance with, other systems and/or methods.