User control of replacement television advertisements inserted by a smart television

Abstract

A method is performed using a smart TV, which receives from a television signal source device a television signal feed encoding primary television content and then presents that content. The smart TV receives data via the computer network, including first data representing a to-be-replaced portion of the primary television content and second data representing secondary television content. Using the second data, the smart TV automatically presents the secondary television content in place of the to-be-replaced television content. The method includes the smart TV: (a) automatically monitoring, during presentation of the secondary television content, the television signal feed and comparing it with the first data; and (b) automatically altering presentation of the secondary television content in accordance with a user-control action with respect to the television signal source device, in response to detecting any difference between the television signal feed and the first data indicative of that user-control action.

Claims

1-11. (canceled)

12. A method of displaying rewound replacement television content comprising: automatically with a computer that is associated with a television display and that is coupled to receive from a television signal source device a television signal feed having encoded therein primary television content and an original secondary television content: (a) using Internet-received electronic indicia of a replacement secondary television content to cause presentation of the replacement secondary television content via the television display, in place of the original secondary television content; (b) after conclusion of the presentation of the replacement secondary television content via the television display, using the television signal feed to cause presentation of a succeeding portion of the primary television content via the television display; (c) during presentation of the succeeding portion of the primary television content, comparing the television signal feed with Internet-received electronic indicia of the succeeding portion of the primary television content and, in response to detecting a difference therebetween, which difference is indicative of a first user-control rewind action with respect to the television signal source device, and without receiving at the computer from the television signal source device a signal representative of the rewind action, causing presentation via the television display of the succeeding portion of the primary television content in reverse; (d) after the reversed presentation of the succeeding portion of the primary television content reaches the beginning of the succeeding portion of primary television content, using the Internet-received electronic indicia of the replacement secondary television content to cause presentation via the television display of the replacement secondary television content, in reverse; and (e) comparing the television signal feed with Internet-received electronic indicia of the original secondary television content and, in response to detecting a difference therebetween, which difference is indicative of a second user-control action with respect to the television signal source device, and without receiving at the computer from the television signal source device a signal representative of the second user-control action, causing presentation via the television display of the replacement secondary television content, altered in accordance with the second user-control action.

13. The method of claim 12 wherein (i) the primary television content comprises a television program, (ii) the original secondary television content comprises a first television advertisement, and (iii) the replacement secondary television content comprises a second television advertisement different from the first television advertisement.

14. The method of claim 12 wherein the first user-control rewind action comprises a rewind command or fast-reverse command.

15. The method of claim 12 wherein the second user-control action comprises a play command.

16. The method of claim 12 wherein (i) the computer and the television display comprise a smart television, and (ii) the television signal source device comprises a cable or satellite set-top box.

17. The method of claim 12 wherein the comparing in part (c) is based on whole frames.

18. The method of claim 12 wherein the comparing in part (c) is based on sample pixels.

19. A smart television apparatus comprising: (a) a television display; (b) an Internet connection; (c) a connection to a television signal source device; and (d) a computer coupled to the television display, coupled to the Internet connection, coupled to the connection to the television signal source device to receive from a television signal source device a television signal feed having encoded therein primary television content and an original secondary television content, which computer is programmed: (i) to, using Internet-received electronic indicia of a replacement secondary television content, automatically cause presentation of the replacement secondary television content via the television display, in place of the original secondary television content; (ii) to, after conclusion of the presentation of the replacement secondary television content via the television display, automatically use the television signal feed to cause presentation of a succeeding portion of the primary television content via the television display; (iii) to, during presentation of the succeeding portion of the primary television content, automatically compare the television signal feed with Internet-received electronic indicia of the succeeding portion of the primary television content and, in response to detecting a difference therebetween, which difference is indicative of a first user-control rewind action with respect to the television signal source device, and without receiving at the computer from the television signal source device a signal representative of the rewind action, to automatically cause presentation via the television display of the succeeding portion of the primary television content in reverse; (iv) to, after the reversed presentation of the succeeding portion of the primary television content reaches the beginning of the succeeding portion of primary television content, use the Internet-received electronic indicia of the replacement secondary television content to automatically cause presentation via the television display of the replacement secondary television content, in reverse; and (v) to automatically compare the television signal feed with Internet-received electronic indicia of the original secondary television content and, in response to detecting a difference therebetween, which difference is indicative of a second user-control action with respect to the television signal source device, and without receiving at the computer from the television signal source device a signal representative of the second user-control action, to automatically cause presentation via the television display of the replacement secondary television content, altered in accordance with the second user-control action.

20. The smart television apparatus of claim 19 wherein (i) the primary television content comprises a television program, (ii) the original secondary television content comprises a first television advertisement, and (iii) the replacement secondary television content comprises a second television advertisement different from the first television advertisement.

21. The smart television apparatus of claim 19 wherein the first user-control rewind action comprises a rewind command or fast-reverse command.

22. The smart television apparatus of claim 19 wherein the second user-control action comprises a play command.

23. The smart television apparatus of claim 19 wherein the television signal source device comprises a cable or satellite set-top box.

24. The smart television apparatus of claim 19 wherein, in part (d)(iii), the computer being programmed to automatically compare the television signal feed with Internet-received electronic indicia of the succeeding portion of the primary television content comprises the computer being programmed to perform such automatic comparison based on whole frames.

25. The smart television apparatus of claim 19 wherein, in part (d)(iii), the computer being programmed to automatically compare the television signal feed with Internet-received electronic indicia of the succeeding portion of the primary television content comprises the computer being programmed to perform such automatic comparison based on sample pixels.

26. An article comprising a tangible computer-readable medium that is not a transitory propagating signal, which medium encodes computer-readable instructions that, when applied to a computer in a smart television apparatus containing a television display, which smart television apparatus is coupled to receive from a television signal source device a television signal feed having encoded therein primary television content and an original secondary television content, instruct the computer to perform a method of automatically: (a) using Internet-received electronic indicia of a replacement secondary television content to cause presentation of the replacement secondary television content via the television display, in place of the original secondary television content; (b) after conclusion of the presentation of the replacement secondary television content via the television display, using the television signal feed to cause presentation of a succeeding portion of the primary television content via the television display; (c) during presentation of the succeeding portion of the primary television content, comparing the television signal feed with Internet-received electronic indicia of the succeeding portion of the primary television content and, in response to detecting a difference therebetween, which difference is indicative of a first user-control rewind action with respect to the television signal source device, and without receiving at the computer from the television signal source device a signal representative of the rewind action, causing presentation via the television display of the succeeding portion of the primary television content in reverse; (d) after the reversed presentation of the succeeding portion of the primary television content reaches the beginning of the succeeding portion of primary television content, using the Internet-received electronic indicia of the replacement secondary television content to cause presentation via the television display of the replacement secondary television content, in reverse; and (e) comparing the television signal feed with Internet-received electronic indicia of the original secondary television content and, in response to detecting a difference therebetween, which difference is indicative of a second user-control action with respect to the television signal source device, and without receiving at the computer from the television signal source device a signal representative of the second user-control action, causing presentation via the television display of the replacement secondary television content, altered in accordance with the second user-control action.

27. The article of claim 26 wherein (i) the primary television content comprises a television program, (ii) the original secondary television content comprises a first television advertisement, and (iii) the replacement secondary television content comprises a second television advertisement different from the first television advertisement.

28. The article of claim 26 wherein the first user-control rewind action comprises a rewind command or fast-reverse command.

29. The article of claim 26 wherein the second user-control action comprises a play command.

30. The article of claim 26 wherein (i) the computer and the television display comprise a smart television, and (ii) the television signal source device comprises a cable or satellite set-top box.

31. The article of claim 26 wherein the comparing in part (c) is based on whole frames.

32. The article of claim 26 wherein the comparing in part (c) is based on sample pixels.

Description

DETAILED DESCRIPTION OF EMBODIMENTS

[0023] In one or more of the illustrative embodiments disclosed herein, various examples of methods for inserting a targeted television advertisement into a stream of primary television content can be performed as follows using various examples of systems that include the computer network connection and the computer of the smart TV. Parts of those methods proceed substantially as described above.

[0024] In a first group of one or more embodiments, using the computer and the first data, the smart TV automatically compares, during presentation of the replacement content via the smart TV, the television signal feed with the first data (representative of the replaced content). Any detected discrepancy between the television signal feed and the first data indicates that a user has performed a user-control action with respect to the television signal source device. For example, if the user attempts a display change (e.g., a trick mode) or a channel change, the first data (indicative of the replaced content at regular viewing speed), would no longer correspond to the television signal feed, because the user-control action would alter the signal feed. If no such discrepancy is detected (indicating no user-control action was attempted) and presentation of the replacement content finishes without any user-control action being taken, then in some embodiments, presentation of television content via the smart TV can, as in the conventional examples, simply revert to presentation of the primary television content. Depending on whether the replaced content is finished when the replacement content finishes, presentation may revert to an end portion of the replaced content or to a portion of the primary content immediately after the replaced content (referred to as the “succeeding content”).

[0025] If the replacement television content ends before the replaced television content, an end portion of the replaced television content might be presented after completion of the replacement content. That may result in a television presentation that may be jarring, confusing, or annoying to viewers due to the abrupt and seemingly mysterious appearance of a fragment of the replaced content. In a second group of one or more embodiments, if the replacement content reaches its end before the end of the replaced content, the smart TV can present a black screen (or a blank screen of a different color, a user-selected color controlled by a user setting in the smart TV, or any other suitable filler material) to fill the gap between the end of the replacement content and the end of the replaced content. A black screen can be used in countries where a black screen identifies the end of one segment of television content and the beginning of a succeeding segment of unrelated television content (e.g., a transition from a television program to a television advertisement, from one television advertisement to another, or from a television advertisement to a television program). In countries where a different type of screen is used to identify the end of one segment of content and the beginning of the next, that corresponding kind of screen will be inserted as filler content by the smart TV to fill the gap from the end of the replacement content to the end of the replaced content. In one example implementation of a black screen, the smart TV inserts the black frames. When the smart TV, using the computer and the first data, detects the end of the replaced content in the television signal feed while presenting such filler content, it can then revert presentation to the primary television content encoded in the television signal feed, providing the viewer with a smooth transition from the replacement content to the succeeding content.

[0026] If, on the other hand, the smart TV does detect a discrepancy between the first data (indicative of the replaced content) and the television signal feed, that indicates that a user-control action was attempted. In a third group of one or more embodiments, in response to detecting such a discrepancy, the smart TV automatically terminates presentation of the replacement content and reverts to presentation of the replaced content. That shift eliminates the misleading appearance that the user-control action did not work, because the smart TV discontinues presentation of the replacement content and the viewer can see the effects of his or her control action on the resumed presentation of the replaced content.

[0027] However, as with the case where the replacement content ends before the replaced content ends, this situation also results in presentation of television content that may appear jarring, confusing, or annoying to viewers due to the sudden switch, upon attempting to execute a user-control action, between different television advertisements. An exception is the case wherein the user-control action is a channel change; in that instance the abrupt appearance of different television content would be expected.

[0028] A fourth group of one or more embodiments help eliminate the presentation problems described in the previous paragraphs. In response to detecting a discrepancy between the first data (representative of the replaced content) and the television signal feed, the smart TV can automatically, using the computer and the first data, determine what type of user-control action has been executed, e.g., fast forward, fast reverse, pause, or channel change. Because the user-control action is done with respect to the television signal source device, and not the smart TV, determination of the type of user-control action cannot typically be done directly. Instead, the smart TV determines the user-control action by comparing the first data and the television signal feed. For example, if the first data includes the video portion of the replaced content, then the smart TV can compare the first data video with the video portion of the television signal feed. A pause action on the signal source device results in the freezing of the video on one particular frame. The smart TV can identify the frozen frame by comparing the first data video frames with the signal feed frozen frame. The comparison can be made between entire frames or between only sample sets of pixels of each frame. A fast forward action on the signal source device results in only selected frames being sent in the television signal feed to the smart TV (the higher the fast forward rate, the fewer and further between are the selected frames sent to the smart TV). The smart TV can compare whole frames or sample pixels in the received signal feed frames with whole frames or sample pixels in the first data to recognize the selected fast-forward rate (e.g., 4×, 8×, or 32× regular viewing speed). A fast reverse action on the signal source device can be identified in a similar way. A channel change can be identified when the smart TV cannot find a match between a frame of the video in the television signal feed and a frame of the video in the first data. The comparison of the television signal feed and the first data typically is based on video for recognizing a display change, including trick mode functionality such as pause, resume, fast forward, rewind, fast reverse, or skip. For recognizing a channel switch or the end of a replaced advertisement, audio or video or both can be used as a basis for comparison. Alternatively, the smart TV can determine the type of user-control action in those cases wherein the television signal source device reports the type of user-control action to the smart TV, for example via a CEC (Consumer Electronics Control) connection over HDMI.

[0029] If the user-control action is a channel change, then the smart TV can simply terminate presentation of the replacement television content and revert to presentation of the replaced television content encoded on the television signal feed (now altered due to the channel change). As noted above, the abrupt appearance of different presented television content would be expected in that instance.

[0030] If the smart TV determines that the user-control action is a display change such as a trick mode, then, using the computer and the second data, the smart TV can alter presentation of the replacement content to substantially match the altered television signal feed. For example, if a fast forward of the replaced content is detected, then the smart TV can adjust presentation of the replacement content by fast-forwarding it in parallel (e.g., by skipping frames). The smart TV can be programmed to mimic in its presentation of the replacement content the effect of various user-control display change actions on the replaced content. The substitution of the replacement content for the replaced content therefore becomes “transparent” to the viewer, who can no longer necessarily discern whether he or she is seeing the original television content (e.g., a non-targeted television advertisement) versus replacement television content (e.g., a targeted television advertisement). User-control actions (channel change or display change) appear to function normally even if replacement content is being presented.

[0031] In a fifth group of one or more embodiments, after the replacement content has been presented and its display completed, the smart TV can again insert the replacement content if, for example, a rewind or fast reverse user-control action is executed beginning from a time after the conclusion of the replacement content. To accomplish this, the sequence of steps described above can be executed again, with the smart TV detecting the succeeding content, presenting the replacement content (possibly altered depending on user-control actions), monitoring the television signal feed during a second presentation of the replacement content, and terminating or altering the repeated presentation of the replacement content in response to a user-control action. A purpose of this technique is to allow the user to review the replacement content after the succeeding television show (for example) resumes. Without this technique, if the user rewinds from a point after the replacement content has been completed, the user would see the replaced content instead of the replacement content, and the user would not be able to find the replacement content. To enable such “rewinding” of the replacement content, the smart TV receives electronic indicia of additional data that represents a portion of the primary television content that immediately follows the replaced content (i.e., the succeeding content) or creates such additional data by itself, for example by fingerprinting the succeeding content or simply recording it. The smart TV automatically monitors the rewound television signal feed it receives from the television signal source and compares it with the additional data to detect or otherwise determine the beginning of the succeeding content.

[0032] In some instances, the same replacement content can be inserted each time the replaced content (or preceding content or succeeding content) is detected by the smart TV. In other instances, different replacement content can be inserted in place of the replaced content; the choice of replacement content is part of the targeting process when the replacement content is a targeted advertisement. Any suitable sequence of replacement content can be employed for insertion in place of a given portion of replaced content upon repeated encounters with that given portion. In one example, the same advertisement can be presented each time the given portion of replaced content is encountered (forward or backward). In another example, one advertisement can be presented a number of times, followed by another advertisement presented a number of times, and so on. In a third example, number of different advertisements can be rotated through one at a time at each encounter with the replaced content. In a fourth example, each replacement advertisement is presented during only one encounter with the given replacement content; at each subsequent encounter a new advertisement is presented that has not been presented before.

[0033] In a sixth group of one or more embodiments, if the television content that includes the preceding and succeeding content is replayed at a later time (e.g., stored on a DVR or retrieved from an “on-demand” system), the same replacement content can be presented each time the primary content is replayed, or different replacement content can be selected than would be selected for the initial or earlier presentations of the content. Subsequent replays can include still other replacement content. Any suitable variation, selection, or rotation of replacement content, including those described in the preceding paragraph, can be employed.

[0034] The systems and methods disclosed herein can be implemented as general or special purpose computers or servers or other programmable hardware devices programmed through software, or as hardware or equipment “programmed” through hard wiring, or a combination of the two. A “computer” (e.g., as in a “smart TV”) can comprise a single processor, processor core, or machine or can comprise multiple interacting processors, processor cores, or machines (located at a single location or at multiple locations remote from one another). A computer memory or computer-readable medium can be encoded with a computer program, so that execution of that program by one or more computers causes the one or more computers to perform one or more of the methods disclosed herein. Suitable media can include temporary or permanent storage or replaceable media, such as network-based or Internet-based or otherwise distributed storage of software modules that operate together, RAM, ROM, CD ROM, CD-R, CD-R/W, DVD ROM, DVD±R, DVD±R/W, hard drives, thumb drives, flash memory, optical media, magnetic media, semiconductor media, or any future storage alternatives. Such encoded media can be preinstalled already encoded in a smart TV during its manufacture, can be encoded after installation into a smart TV during its manufacture, or can be encoded with “client” or “application” software copied or downloaded into the smart TV after its manufacture. For example, client software can be downloaded to the smart TV as part of occasional or periodic software updates received by the smart TV, typically via its network connection.

[0035] In addition to the preceding, the following examples fall within the scope of the present disclosure or appended claims:

[0036] Example 1. A method performed using a computer associated with a television display and connected to a computer network and to a television signal source device, wherein: a television signal feed having encoded thereon primary television content is received from the television signal source device and the primary television content is presented via the television display; the computer is programmed to utilize data received via the computer network, including (i) first data comprising electronic indicia of a to-be-replaced portion of the primary television content and (ii) second data comprising electronic indicia of secondary television content; the computer is programmed to present automatically via the television display, using the second data, at least a portion of the secondary television content in place of the to-be-replaced television content; and the method comprises: (a) during presentation of the secondary television content, automatically monitoring, with the computer, the television signal feed and comparing it with the first data; and (b) in response to detecting any difference, between the television signal feed and the first data, indicative of a user-control action with respect to the television signal source device, automatically altering, with the computer, the presentation of the secondary television content in accordance with the user-control action.

[0037] Example 2. The method of Example 1 further comprising reverting to presentation of the primary television content after presenting the secondary television content.

[0038] Example 3. The method of any preceding Example wherein (i) the user-control action indicated by the detected difference between the television signal feed and the first data is a channel change, and (ii) altering the presentation of the secondary television content comprises terminating presentation of the secondary television content and resuming presentation of the primary television content.

[0039] Example 4. The method of any preceding Example wherein (i) the user-control action indicated by the detected difference between the television signal feed and the first data is a display change, and (ii) altering the presentation of the secondary television content comprises altering presentation of the secondary television content in a manner analogous to the user-control action indicated by the detected difference between the television signal feed and the first data.

[0040] Example 5. The method of any preceding Example wherein (i) the primary television content comprises one or more television programs and one or more associated television advertisements, and (ii) the secondary television content comprises one or more replacement television advertisements.

[0041] Example 6. The method of any preceding Example further comprising, after presenting the secondary television content, automatically presenting filler television content via the television display in place of an end portion of the to-be-replaced television content.

[0042] Example 7. The method of an preceding Example further comprising, after presenting the secondary television content and after a user-control action of rewinding or fast-reversing the primary television content to a point within or before the to-be-replaced television content, again automatically presenting at least a portion of the secondary television content in place of the to-be-replaced television content.

[0043] Example 8. The method of any preceding Example further comprising: (c) after presenting the secondary television content and during later time-shifted or on-demand presentation of the primary television content via the television display, automatically presenting different secondary television content in place of the to-be-replaced television content; (d) during presentation of the different secondary television content, automatically monitoring, with the computer, the television signal feed and comparing it with the first data; and (e) in response to detecting any difference, between the television signal feed and the first data, indicative of a user-control action with respect to the television signal source device, automatically altering, with the computer, the presentation of the different secondary television content in accordance with the user-control action.

[0044] Example 9. A smart TV comprising: a connection to a television signal source device arranged so as to receive from the television signal source a television signal feed having encoded thereon primary television content; a television display structured and connected to present the primary television content; a computer; and a connection to a computer network, wherein the computer is programed to perform the method of any preceding Example.

[0045] Example 10. An article comprising a computer-readable medium in a smart TV or in a storage device controlled by a server connected to a computer network, which medium encodes computer-readable instructions that, when applied to a computer in a smart TV, instruct the computer to perform the method of any preceding Example.

[0046] It is intended that equivalents of the disclosed illustrative embodiments and methods shall fall within the scope of the present disclosure or appended claims. It is intended that the disclosed illustrative embodiments and methods, and equivalents thereof, may be modified while remaining within the scope of the present disclosure or appended claims.

[0047] In the foregoing Detailed Description, various features may be grouped together in several illustrative embodiments for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that any claimed embodiment requires more features than are expressly recited in the corresponding claim. Rather, as the appended claims reflect, inventive subject matter may lie in less than all features of a single disclosed embodiment. Thus, the appended claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate disclosed embodiment. However, the present disclosure shall also be construed as implicitly disclosing any embodiment having any suitable set of one or more disclosed or claimed features (i.e., sets of features that are not incompatible or mutually exclusive) that appear in the present disclosure or the appended claims, including those sets that may not be explicitly disclosed herein. In particular, any embodiment that falls within any one of the six groups of embodiments disclosed above, and any embodiment that falls within any combination of two or more of those six groups of embodiments, shall be regarded as falling within the scope of the present disclosure or appended claims. Further, any embodiment explicitly or implicitly disclosed herein can be implemented using any suitable set of one or more known or future developed features, including but not limited to those disclosed in the Background. It should be further noted that the scope of the appended claims do not necessarily encompass the whole of the subject matter disclosed herein.

[0048] For purposes of the present disclosure and appended claims, the conjunction “or” is to be construed inclusively (e.g., “a dog or a cat” would be interpreted as “a dog, or a cat, or both”; e.g., “a dog, a cat, or a mouse” would be interpreted as “a dog, or a cat, or a mouse, or any two, or all three”), unless: (i) it is explicitly stated otherwise, e.g., by use of “either . . . or,” “only one of,” or similar language; or (ii) two or more of the listed alternatives are mutually exclusive within the particular context, in which case “or” would encompass only those combinations involving non-mutually-exclusive alternatives. For purposes of the present disclosure or appended claims, the words “comprising,” “including,” “having,” and variants thereof, wherever they appear, shall be construed as open ended terminology, with the same meaning as if the phrase “at least” were appended after each instance thereof.

[0049] In the appended claims, if the provisions of 35 USC § 112 ¶6 are desired to be invoked in an apparatus claim, then the word “means” will appear in that apparatus claim. If those provisions are desired to be invoked in a method claim, the words “a step for” will appear in that method claim. Conversely, if the words “means” or “a step for” do not appear in a claim, then the provisions of 35 USC § 112 ¶6 are not intended to be invoked for that claim.

[0050] If any one or more disclosures are incorporated herein by reference and such incorporated disclosures conflict in part or whole with, or differ in scope from, the present disclosure, then to the extent of conflict, broader disclosure, or broader definition of terms, the present disclosure controls. If such incorporated disclosures conflict in part or whole with one another, then to the extent of conflict, the later-dated disclosure controls.

[0051] The Abstract is provided as required as an aid to those searching for specific subject matter within the patent literature. However, the Abstract is not intended to imply that any elements, features, or limitations recited therein are necessarily encompassed by any particular claim. The scope of subject matter encompassed by each claim shall be determined by the recitation of only that claim.