SYSTEMS AND METHODS TO PROVIDE ADAPTIVE PLAY SETTINGS

20220312079 · 2022-09-29

    Inventors

    Cpc classification

    International classification

    Abstract

    Systems and methods are provided for applying adaptive play settings to a media asset. One example method includes identifying a media asset selected for playback and retrieving a plurality of user preferences. The user preferences correlate a play function to a type of a segment of a media asset. A plurality of segments in the media asset selected for playback are identified and each of the plurality of segments has a respective type. In response to identifying a plurality of segments in the media asset selected for playback, a respective play function is assigned to each of the respective plurality of segments based on the respective type of each of the plurality of segments.

    Claims

    1. A method for applying adaptive play settings to a media asset, the method comprising: identifying a media asset selected for playback; retrieving a plurality of user preferences, wherein the user preferences correlate a play function to a type of a segment of a media asset; identifying a plurality of segments in the media asset selected for playback, wherein each of the plurality of segments has a respective type; and in response to identifying a plurality of segments in the media asset selected for playback, assigning a respective play function to each of the respective plurality of segments based on the respective type of each of the plurality of segments.

    2. The method of claim 1, further comprising: generating for display a play function map, wherein the play function map shows each of the plurality of segments in the media asset selected for playback and each of the respective play functions assigned to each of the respective plurality of segments.

    3. The method of claim 2, wherein the play function map comprises a selectable interface that allows adjustment of the respective play functions assigned to each of the respective plurality of segments.

    4. The method of claim 1, wherein each of the plurality of segments comprises a scene of the media asset selected for playback.

    5. The method of claim 4, wherein the scene of the media asset selected for playback is defined by a start time stamp and an end time stamp.

    6. The method of claim 5, further comprising: detecting, during playback of the media asset, a first start time stamp of a first scene; in response to detecting the first start time stamp of the first scene, identifying a corresponding play function based on the type of the first scene and the corresponding user preference; determining the media asset has reached the first time stamp of the first scene; and in response to determining the media asset has reached the first time stamp of the first scene, performing the corresponding play function on the first scene.

    7. The method of claim 1, wherein identifying the plurality of segments in the media asset selected for playback comprises identifying a flag in the media asset selected for playback.

    8. The method of claim 1, wherein retrieving a plurality of user preferences comprises: identifying, based on a user authentication, an active stored user profile; and retrieving, from storage, an activity history corresponding to the stored user profile, wherein the activity history comprises a viewing history of at least one media asset and at least one play action corresponding to at least one portion of the at least one media asset.

    9. The method of claim 1, further comprising: receiving an indication that an automated play function option has been enabled by a user preference setting in a stored user profile.

    10. The method of claim 9, further comprising: in response to receiving the indication that the automated play function option has been enabled by a user preference setting in a stored user profile, generating for display a play function map, wherein the play function map shows each of the plurality of segments in the media asset selected for playback and each of the respective play functions assigned to each of the respective plurality of segments.

    11. A system for applying adaptive play settings to a media asset, the system comprising: a communication port; a memory storing instructions; and control circuitry communicably coupled to the memory and the communication port and configured to execute the instructions to: identify a media asset selected for playback; retrieve a plurality of user preferences, wherein the user preferences correlate a play function to a type of a segment of a media asset; identify a plurality of segments in the media asset selected for playback, wherein each of the plurality of segments has a respective type; and in response to identifying a plurality of segments in the media asset selected for playback, assign a respective play function to each of the respective plurality of segments based on the respective type of each of the plurality of segments.

    12. The system of claim 11, wherein the control circuitry is further configured to: generate for display a play function map, wherein the play function map shows each of the plurality of segments in the media asset selected for playback and each of the respective play functions assigned to each of the respective plurality of segments.

    13. The system of claim 12, wherein the control circuitry is further configured to generate the play function map with a selectable interface that allows adjustment of the respective play functions assigned to each of the respective plurality of segments.

    14. The system of claim 11, wherein the control circuitry is further configured to recognize that each of the plurality of segments comprises a scene of the media asset selected for playback.

    15. The system of claim 14, wherein the control circuitry is further configured to determine a start time stamp and an end time stamp of the scene of the media asset selected for playback.

    16. The system of claim 15, wherein the control circuitry is further configured to: detect, during playback of the media asset, a first start time stamp of a first scene; in response to detecting the first start time stamp of the first scene, identify a corresponding play function based on the type of the first scene and the corresponding user preference; determine the media asset has reached the first time stamp of the first scene; and in response to determining the media asset has reached the first time stamp of the first scene, perform the corresponding play function on the first scene.

    17. The system of claim 11, wherein the control circuitry is further configured to identify the plurality of segments in the media asset selected for playback by identifying a flag in the media asset selected for playback.

    18. The system of claim 11, wherein the control circuitry is further configured to retrieve a plurality of user preferences by: identifying, based on a user authentication, an active stored user profile; and retrieving, from storage, an activity history corresponding to the stored user profile, wherein the activity history comprises a viewing history of at least one media asset and at least one play action corresponding to at least one portion of the at least one media asset.

    19. The system of claim 11, wherein the control circuitry is further configured to: receive an indication that an automated play function option has been enabled by a user preference setting in a stored user profile.

    20. The system of claim 19, wherein the control circuitry is further configured to: in response to receiving the indication that the automated play function option has been enabled by a user preference setting in a stored user profile, generate for display a play function map, wherein the play function map shows each of the plurality of segments in the media asset selected for playback and each of the respective play functions assigned to each of the respective plurality of segments.

    21-30. (canceled)

    Description

    BRIEF DESCRIPTIONS OF THE DRAWINGS

    [0014] The present disclosure, in accordance with one or more various embodiments, is described in detail with reference to the following figures. The drawings are provided for purposes of illustration only and merely depict typical or example embodiments. These drawings are provided to facilitate an understanding of the concepts disclosed herein and shall not be considered limiting of the breadth, scope, or applicability of these concepts. It should be noted that for clarity and ease of illustration these drawings are not necessarily made to scale.

    [0015] The above and other objects and advantages of the disclosure may be apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings, in which:

    [0016] FIG. 1 shows an exemplary environment in which adaptive play settings are applied to a media asset, in accordance with some embodiments of the disclosure;

    [0017] FIG. 2A shows another exemplary environment in which adaptive play settings are applied to a media asset, in accordance with some embodiments of the disclosure;

    [0018] FIG. 2B shows another exemplary environment in which adaptive play settings are applied to a media asset, in accordance with some embodiments of the disclosure;

    [0019] FIG. 2C shows another exemplary environment in which adaptive play settings are applied to a media asset, in accordance with some embodiments of the disclosure;

    [0020] FIG. 3A is a diagram representing an exemplary playback-speed map and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure;

    [0021] FIG. 3B is another diagram representing an exemplary playback-speed map and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure;

    [0022] FIG. 3C is another diagram representing an exemplary playback-speed map and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure;

    [0023] FIG. 3D is another diagram representing an exemplary playback-speed map and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure

    [0024] FIG. 4 is a block diagram representing components of a computing device and data flow therebetween for applying adaptive play settings to a media asset, in accordance with some embodiments of the disclosure;

    [0025] FIG. 5 is a flowchart representing a process for applying adaptive play settings to a media asset, in accordance with some embodiments of the disclosure.

    DETAILED DESCRIPTION

    [0026] Systems and methods are described herein for applying adaptive play settings to a media asset. As referred to herein, adaptive play settings are settings, or play functions, that change the playback speed of a section, or segment, of a media asset. For example, the play function may cause a segment of a media asset to be skipped, played back at normal speed, played back at half speed, one and a half speed, double speed, 3× speed, 4× speed, 5.5× speed, 8× speed, 10× speed, 16× speed or any other multiple of playback speed. A media asset is any media content. The media content may be streamed live and/or streamed on demand to a computing device. On-demand content may also be downloaded to a computing device in response to a user request and/or according to a pre-set rule. Content includes audio, video and/or any other media content. Audio includes audio only content, such as songs. Video includes audiovisual content such as movies and/or television programs. The over-the-top content platform may be accessed via a website and/or an app running on a computing device.

    [0027] A segment is a portion of a media asset and a media asset typically comprises many segments. A media asset may be split up into equal segments, and the type may be the dominating action and/or genre of the segment. Alternatively, a media asset may be split up into segments of varying lengths that are based on the type. For example, when there is a comedy scene, the segment may be as long as the scene. Such a scene may be defined by a start time stamp and an end time stamp. Segments are associated with different “types,” which indicate the dominating action and/or genre of the segment. For example, types might include “comedy,” “action,” “drama,” “fantasy,” “horror,” “mystery,” “romance,” “thriller,” “sad,” “emotional,” “scary,” “sport,” “conversation,” “conversation between two people,” “conversation between multiple people,” “music,” “adult,” “G” (for general audiences), “PG” (for parental guidance), “PG-13” (for parents strongly cautioned), “R” (for restricted) and/or “NC-17” (for adults). These segment types may be indicated via metadata and/or flags that are delivered to the computing device at the same time as the media asset.

    [0028] The disclosed methods and systems may be implemented on a computing device. As referred to herein, the computing device can be any device comprising a processor and memory, for example, a television, a Smart TV, a set-top box, an integrated receiver decoder (IRD) for handling satellite television, a digital storage device, a digital media receiver (DMR), a digital media adapter (DMA), a streaming media device, a DVD player, a DVD recorder, a connected DVD, a local media server, a BLU-RAY player, a BLU-RAY recorder, a personal computer (PC), a laptop computer, a tablet computer, a WebTV box, a personal computer television (PC/TV), a PC media server, a PC media center, a handheld computer, a stationary telephone, a personal digital assistant (PDA), a mobile telephone, a portable video player, a portable music player, a portable gaming machine, a smartphone, an augmented reality device, a mixed reality device, a virtual reality device, or any other television equipment, computing equipment, or wireless device, and/or combination of the same.

    [0029] The methods and/or any instructions for performing any of the embodiments discussed herein may be encoded on computer-readable media. Computer-readable media includes any media capable of storing data. The computer-readable media may be transitory, including, but not limited to, propagating electrical or electromagnetic signals, or may be non-transitory, including, but not limited to, volatile and non-volatile computer memory or storage devices such as a hard disk, floppy disk, USB drive, DVD, CD, media cards, register memory, processor caches, random access memory (RAM), etc.

    [0030] FIG. 1 shows an exemplary environment in which adaptive play settings are applied to a media asset, in accordance with some embodiments of the disclosure. A user selects a media asset for playback at smart television 100. The user may also select a “binge” mode setting, which enables different play functions to be applied to different segments of a media asset. The “binge” mode setting may be applied to, for example, a single episode, the remaining episodes in a season, a set period of time such as an hour, and/or a combination of a number of episodes and a time period, such as enabling two episodes to be watched in an hour. In other examples, the “binge” mode may always apply and not be a selectable setting. A plurality of user preferences that correlate a play function to a type of a segment of a media asset are retrieved 102. For example, a segment of a media asset that comprises lots of talking may be correlated with a normal play speed, and a segment of a media asset that comprises sport may be correlated with a faster play speed, such as a 2× play speed. The user preferences may be manually set by a user, may be pre-set user preferences and/or may be automatically adapted based on how a user interacts with different segments of media assets over time. For example, an indication of how a user reacts to different types may be recorded. Over time, this record can be analyzed to identify trends in the user behavior. For example, if a user consistently fast-forwards a “music” type at double speed, then the user preferences may be updated to indicate that “music” type segments should be played at double speed. In addition, the user preferences may be updated based on how other users of, for example, an on-demand platform apply different settings to different segments of a media asset. For example, if a majority of users select a faster play speed, such as 1.5× play speed, for a “music” type of segment, then this setting may be automatically applied to all users of the on-demand platform. In another example, a parent might set settings that prevents a child from watching “adult” type segments, for example by setting “adult” segments to skip. Such a setting may be protected by a password and/or a PIN code. Another feature may be the automatic implementation of thresholds. For example, if a segment includes dialogue, a threshold may be implemented such that the dialogue is still understandable. In another example, a threshold may be implemented for action sequences, such that a user can continue to follow the action, even if the playback speed has been increased. In addition to the user preferences, an active stored user profile may be identified, and an activity history corresponding to the stored user profile may be retrieved at 102. The active user profile may indicate whether the user has enabled the “binge” mode setting.

    [0031] A plurality of segments in the media asset selected for playback are identified 104, wherein each of the plurality of segments has a respective type. For example, the first segment of a media asset may be identified as being the “music” type, the second segment of a media asset may be identified as being the “comedy” type and so forth. The segments may be identified via metadata that is transmitted to the smart television 100, for example via the Program and System Information Protocol (PSIP), via flags transmitted to the smart television and/or via a machine learning algorithm. Where segments are identified via a machine learning algorithm, the identification may be performed by the smart television, or the segments may be identified remotely from the smart television. The media assets may be stored at a location that is remote from the smart television 100, for example at a server of an on-demand provider. Such a provider may run such a machine learning algorithm on any media assets stored at the server and may store the results in a format that is accessible to the smart television 100. For example, for an on-demand platform, a machine learning algorithm may be trained on a dataset comprising settings selected by all, or a subset of, subscribers to the platform. In response to identifying a plurality of segments in the media asset selected for playback, a respective play function is assigned to each of the respective plurality of segments based on the respective type of each of the plurality of segments 106. For example, if a media asset has a first segment that is identified as “music,” and a second segment that is identified as “comedy,” and the user has indicated a preference of 1.5× play speed for the “music” type and “normal” play speed for the “comedy” type, then a 1.5× play function will be assigned to the first segment and a normal play function will be assigned to the second segment.

    [0032] FIG. 2A is a further exemplary environment in which adaptive play settings are applied to a media asset, in accordance with some embodiments of the disclosure. In a similar manner to that shown in FIG. 1, a user selects a media asset for playback at smart television 200. The user may also select a “binge” mode setting, which enables different play functions to be applied to different segments of a media asset. In other examples, the “binge” mode may always apply and not be a selectable setting. A plurality of user preferences that correlate a play function to a type of a segment of a media asset are retrieved 202, via a communications network 208, from a server 210. The communications network 208 may include the internet and/or a local network and may include wired and/or wireless components. In addition to the user preferences, an active stored user profile may be identified and an activity history corresponding to the stored user profile may also be retrieved at 202. The active user profile may indicate whether the user has enabled the “binge” mode setting. Typically, such a setup would enable the user preferences and/or active stored user profile to be stored on a server remote from the smart television 200, such that a user may log in to a platform on an internet-connected device and retrieve their preferences and/or user profile. A plurality of segments in the media asset selected for playback are identified 204, wherein each of the plurality of segments has a respective type. In response to identifying a plurality of segments in the media asset selected for playback, a respective play function is assigned to each of the respective plurality of segments based on the respective type of each of the plurality of segments 206.

    [0033] FIGS. 2B and 2C are further exemplary environments in which adaptive play settings are applied to a media asset, in accordance with some embodiments of the disclosure. FIG. 2B is a variation on the environment shown in FIG. 2A, wherein the identifying the plurality of segments in the media asset 204 and the assigning a respective play function to each segment 206 takes place, via a communications network 208, on a server 210. In a similar manner, the communications network 208 may include the internet and/or a local network and may include wired and/or wireless components. Typically, such a setup would enable a more computationally intensive method of identifying segments to take advantage of the increased computing power that is typically available at a server compared to a smart television, for example via machine learning algorithms. The identified segment types are then transmitted back to the smart television 200 via the network 208.

    [0034] FIG. 2C is another variation on the environment shown in FIG. 2A, wherein the user preferences are retrieved 202 from a server 210 via communication network 208, and the identifying a plurality of segments 204 and the assigning the respective play function 206 takes place on the server 210. Such a system allows, for example, a user to enable a “binge” mode via a thin client accessing an on-demand platform.

    [0035] FIG. 3A is a diagram representing an exemplary playback-speed map (or play-function map) and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure. A playback-speed map is representation of how playback speeds are assigned to different segments of a media asset and indicates which play function will be applied to each segment of a media asset. The playback-speed map 300 comprises the types of segment 302 that are present in a media asset, in this example “high in conversation,” “music,” “low in conversation,” and “emotional and/or sad.” The playback-speed map 300 also indicates whether a user is interested in the type of segment, i.e., the user interests 304. These are obtained via the received plurality of user preferences. The playback-speed map 300 indicates the play function, i.e., the assigned playback speed 306, that will be applied to each segment. The different segments 308, 310, 312, 314 of a media asset are of different types, and playback speeds are applied to each segment according to the identified type and the user preferences, as indicated in the playback-speed map 300.

    [0036] FIG. 3B is another diagram representing an exemplary playback-speed map (or play-function map) and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure. The playback-speed map 300 comprises the types of segment 302 that are present in a media asset, in this example “high in conversation,” “music,” “comedy,” and “emotional and/or sad.” The playback-speed map 300 also indicates whether a user is interested in the type of segment, i.e., the user interests 304. These are obtained via the received plurality of user preferences. The playback-speed map 300 indicates the play function, i.e., the assigned playback speed 306, that will be applied to each segment and the start time and end time 316 of each segment. The different segments 308, 310, 312, 314 of a media asset are of different types, and playback speeds are applied to each segment according to the identified type and the user preferences, as indicated in the playback-speed map 300. In this particular example, the “music” type is not present in the first four segments of the media asset.

    [0037] FIG. 3C is another diagram representing an exemplary playback-speed map (or play-function map) and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure. The playback-speed map 300 comprises the types of segment 302 that are present in a media asset, in this example “sport—football,” “flashing lights” and “comedy.” The playback-speed map 300 also indicates whether a user is interested in the type of segment, i.e., the user interests 304. These are obtained via the received plurality of user preferences. The playback-speed map 300 indicates the play function, i.e., the assigned playback speed 306, that will be applied to each segment. The different segments 308, 310, 312, 314 of a media asset are of different types, and playback speeds are applied to each segment according to the identified type and the user preferences, as indicated in the playback-speed map 300. In this example, a user who is averse to flashing lights may utilize the “binge” mode to skip sections of a media asset that comprise flashing lights.

    [0038] FIG. 3D is another diagram representing an exemplary playback-speed map (or play-function map) and application of playback speeds to segments of a media asset, in accordance with some embodiments of the disclosure. The playback-speed map 300 comprises the types of segment 302 that are present in a media asset, in this example “conversation,” “adult” and “music.” The playback-speed map 300 also indicates whether a user is interested in the type of segment, i.e., the user interests 304. These are obtained via the received plurality of user preferences. The playback-speed map 300 indicates the play function, i.e., the assigned playback speed 306, that will be applied to each segment. The different segments 308, 310, 312, 314 of a media asset are of different types, and playback speeds are applied to each segment according to the identified type and the user preferences, as indicated in the playback-speed map 300. In this example, a parent may utilize the “binge” mode by setting the “adult” type to “skip” in order to prevent a younger member of the household from watching unsuitable content. Such a setting may additionally be protected by a password and/or PIN code.

    [0039] FIG. 4 is a block diagram representing components of a computing device and data flow therebetween for applying adaptive play settings to a media asset, in accordance with some embodiments of the disclosure. Computing device 400 (e.g., a smart television 100, 200 as discussed in connection with FIGS. 1-2) comprises input circuitry 404, control circuitry 407 and an output module 422. Control circuitry 407 may be based on any suitable processing circuitry (not shown) and comprises control circuits and memory circuits, which may be disposed on a single integrated circuit or may be discrete components and processing circuitry. As referred to herein, processing circuitry should be understood to mean circuitry based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), etc., and may include a multi-core processor (e.g., dual-core, quad-core, hexa-core, or any suitable number of cores). In some embodiments, processing circuitry may be distributed across multiple separate processors or processing units, for example, multiple of the same type of processing units (e.g., two Intel Core i9 processors) or multiple different processors (e.g., an Intel Core i5 processor and an Intel Core i7 processor). Some control circuits may be implemented in hardware, firmware, or software.

    [0040] A user provides an input 402 that is received by the input circuitry 404. The input circuitry 404 is configured to receive a user input related to a computing device. For example, this may be via a touchscreen, keyboard, mouse, microphone and/or infra-red controller of the computing device 400. The input circuitry 404 transmits 406 the user input to the control circuitry 407.

    [0041] The control circuitry 407 comprises a media identification module 408, a user preference retrieval module 412, a segment identification module 416 and an output module 422. The user input is transmitted 406 to the media identification module 408. At the media identification module 408, a media asset selected for playback is identified. The identified media asset is transferred 410 to the user preference retrieval module 412, where user preferences are retrieved. The identified media asset and the retrieved user preferences are transferred 414 to the segment identification module 416, wherein segments of the media asset are identified, each segment having a respective type. The identified media asset, retrieved user preferences and identified segments are transmitted 420 to the output module 422, where a play function is assigned to the segments of the identified media asset 424, based on the retrieved user preferences and the identified segments.

    [0042] FIG. 5 is a flowchart representing a process for applying adaptive play settings to a media asset, in accordance with some embodiments of the disclosure. Process 500 may be implemented on an aforementioned computing device 100, 200. In addition, one or more actions of the process 500 may be incorporated into or combined with one or more actions of any other process or embodiments described herein.

    [0043] At 502, a media asset selected for playback is identified. At 504, a plurality of user preferences are retrieved, wherein the user preferences correlate a play function to a type of a segment of a media asset. At 506, a plurality of segments in the media asset selected for playback are identified, wherein each of the plurality of segments has a respective type. At 508, in response to identifying a plurality of segments in the media asset selected for playback, a respective play function is assigned to each of the respective plurality of segments based on the respective type of each of the plurality of segments.

    [0044] The processes described above are intended to be illustrative and not limiting. One skilled in the art would appreciate that the steps of the processes discussed herein may be omitted, modified, combined, and/or rearranged, and any additional steps may be performed without departing from the scope of the disclosure. More generally, the above disclosure is meant to be exemplary and not limiting. Furthermore, it should be noted that the features and limitations described in any one embodiment may be applied to any other embodiment herein, and flowcharts or examples relating to one embodiment may be combined with any other embodiment in a suitable manner, done in different orders, or done in parallel. In addition, the systems and methods described herein may be performed in real time. It should also be noted that the systems and/or methods described above may be applied to, or used in accordance with, other systems and/or methods.