ONE BUTTON ON-DEMAND CLOSED CAPTIONING
20250234058 ยท 2025-07-17
Inventors
Cpc classification
H04N21/4221
ELECTRICITY
H04N21/47217
ELECTRICITY
International classification
H04N21/422
ELECTRICITY
Abstract
A system and method for initiating closed captioning. The system includes a processor that can receive an instruction to add closed captioning. The system may also, upon receiving the instruction, determine a time point at which to begin the closed captioning and determining an amount of closed captioning to include, and output, for display, the closed captioning.
Claims
1. A system comprising: a display device; one or more processors; and one or more memories storing instructions executable by the one or more processors to: cause the display device to display audiovisual content to a user with closed captioning deactivated; while the audiovisual content is being displayed, receive a command from the user to rewind the audiovisual content and to activate the closed captioning; and in response to receiving the command: rewind the audiovisual content by a select amount of time; and cause the display device to display the rewound audiovisual content with closed captioning activated for at least the select amount of time.
2. The system of claim 1, wherein the one or more processors are further configured to: receive a second command to further rewind the audiovisual content; and further rewind the content by a second amount of time that is different from the select amount of time.
3. The system of claim 1, wherein the one or more processors are further configured to determine the select amount of time based on a setting configurable by the user.
4. The system of claim 1, wherein the one or more processors cause the display device to display the rewound audiovisual content by being further configured to: cause the display device to display the rewound audiovisual content at a reduced playback speed relative to an original playback speed of the audiovisual content.
5. The system of claim 1, wherein the one or more processors are further configured to cause the display device to display the rewound audiovisual content with a select number of lines of closed captioning.
6. The system of claim 1, wherein the one or more processors are further configured to: receive a second command; and in response to receiving the second command, deactivate the closed captioning.
7. The system of claim 1, wherein the one or more processors are further configured to: determine a select amount of closed captioning to be displayed; and cause the display device to display the rewound audiovisual content with the select amount of closed captioning.
8. The system of claim 1, wherein the one or more processors are further configured to: receive a second command; and in response to receiving the second command: further rewind the audiovisual content by a second amount of time; and cause the display device to display the further rewound audiovisual content with closed captioning activated for at least the second amount of time.
9. The system of claim 8, wherein the one or more processors are further configured to: determine the second amount of time based on a percentage of the select amount of time.
10. The system of claim 8, wherein the one or more processors are further configured to: determine the second amount of time based on a setting configurable by the user.
11. The system of claim 1, wherein the one or more processors are further configured to: cause a settings menu to be displayed to the user, wherein the settings menu includes at least one of: a first setting that determines the select amount of time; or a second setting that determines an amount of closed captioning to display.
12. A content receiver comprising: one or more processors; and one or more memories storing instructions executable by the one or more processors to: cause audiovisual content to be displayed with closed captioning deactivated; receive a command to rewind the audiovisual content and to activate the closed captioning; and in response to receiving the command, cause a previously displayed portion of the audiovisual content to be displayed with closed captioning activated.
13. The apparatus of claim 12, wherein the previously displayed portion was displayed immediately prior to receiving the command.
14. The apparatus of claim 12, wherein the one or more processors are further configured to: determine the select amount of time based on a configurable setting.
15. The apparatus of claim 12, wherein the one or more processors are further configured to: automatically deactivate the closed captioning after a select amount of time.
16. A method performed by a content receiver, the method comprising: causing audiovisual content to be displayed; receiving a command to rewind the audiovisual content and to display closed captioning; and in response to receiving the command, causing a previously displayed portion of the audiovisual content to be displayed with closed captioning.
17. The method of claim 16, further comprising: determining an amount of audiovisual content to be displayed based on a setting configured by a user before causing the audiovisual content to be displayed.
18. The method of claim 16, further comprising: receiving, while the previously displayed portion of the audiovisual content is being displayed with closed captioning, a second command; and in response to receiving the second command, displaying a second portion of the audiovisual content that was displayed before the previously displayed portion of the audiovisual content.
19. The method of claim 18, wherein a duration of the second portion of the audiovisual content is based on a duration of the previously displayed portion of the audiovisual content.
20. The method of claim 16, further comprising: displaying a number of lines of closed captioning based on a configurable setting.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0009]
[0010]
[0011]
[0012]
[0013]
[0014]
[0015]
[0016]
[0017]
[0018]
DETAILED DESCRIPTION OF EMBODIMENTS
[0019] The various embodiments described herein generally provided apparatuses, systems and methods for initiating closed captioning onto a display screen.
[0020] Watching a content program such as a media content program, on a display device, such as a television screen, laptop screen, tablet screen, cellular phone, or any device capable of receiving and/or displaying content program, is a common occurrence. For a variety of reasons, a user, which may be a content viewer, may not fully understand and/or appreciate all or certain parts of audio during a viewing of the content program. For example, the content viewer may have the viewing of content program interrupted by children, a barking dog, or other disruptions. Further, the content viewer may lose focus during the viewing and fail to fully hear or understand particular lines of dialogue. Still further, the content viewer may have hearing or other disabilities that make it difficult for him to fully understand an entirety of the audio during a content program. Even more, language differences, dialects and accents of those speaking in the content program and the like might cause a content viewer to miss or otherwise fail to fully understand at least some of the audio of the content program.
[0021] Closed captioning is a function of many televisions and other media display devices that allows for lines of text that correspond to audio content to be displayed on a screen, usually toward the bottom of the screen. For closed captioning, spoken words comprising the content program's soundtrack are generally transcribed by a human operator using stenotype machines, and the output of the machines will be instantly translated into text by a computer and displayed on the screen. This method is often used for pre-recorded media content, but could even be used for live broadcasts. In live broadcasts, due to the nature of the broadcast, content viewers often see the closed captioning delayed by several seconds or more. Other methods of closed captioning include automatic computer speech recognition, which can be used to recognize a speaker's voice, transcribe the words, and display the words on the screen.
[0022] In some cases, the transcript of closed captioning is available beforehand, and captions are simply displayed during the program after being edited. The captions will be provided to the display device either via a same or parallel signal as the signal transmitting the content program. In situations where the content program is entirely prerecorded, the captions may be stored and sent to the display concurrently with the content program itself.
[0023] While closed captioning is useful in many instances, it is often distracting or unwanted. Thus, in most display devices, closed captioning is an optional feature, and can be turned on or off by the content viewer. Generally speaking, when the content viewer intends to activate closed captioning, he will select activate the closed captioning by pressing one or more buttons on a television remote. Once activated, closed captioning will begin and the text will correspond to the current audio being spoken on the content program, or slightly delayed in the case of a delayed closed captioning and/or a live television program. In effect, the closed captioning is hidden from view unless and until the content viewer activates it, after which time the closed captioning will be actively displayed on the display screen.
[0024] The closed captioning will remain activated until the content viewer requests to turn the closed captioning off, the program ends, a new program without closed captioning begins, the display device and/or component transmitting the content program to the display device is turned off, or the like.
[0025] For a content viewer to use closed captioning to understand words that have already been spoken, the content viewer will have to rewind the content program (if a rewind function is even available), then activate the closed captioning, and view the missed portion of the content. Then, the content viewer would need to turn off the closed captioning to remove the closed captioning when the content viewer has reached the point in the program where he no longer needs the closed captioning.
[0026] Thus, while having some utility, closed captioning in this case does not have the ability to aid the content viewer in efficiently filling in relatively small gaps of audio where the content viewer has, only briefly, failed to comprehend some lines of dialogue or the like. Also, such an operation is inefficient, clunky, and requires multiple actions to fully control the closed captioning. Still further, in a situation such as a live television program, the closed captioning may not fully match actual audio and thus it may be even more complicated to find the correct and desired closed captioning.
[0027] Improvements to closed captioning allowing for one-button or otherwise efficient temporary activation of the closed captioning, and particularly in a manner in which the closed captioning provides a content viewer with a one-touch operation to allow for a provision of information to address a potential lack of understanding of recently played audio, are desirable.
[0028]
[0029] Other examples of buttons 102 include buttons to control live TV or recorded content, such as rewind, fast forward and pause/play buttons. Volume control buttons may also exist, and may be coordinated with a television unit or other display unit to control the volume on the unit without signaling to a set-top box. The remote control 100 may have other buttons 102, for example as shown in
[0030] Further, as shown in
[0031]
[0032]
[0033] In some implementations, the content viewer will transmit a command for an operation using the remote control 100. This may occur via radiofrequency (RF), infrared (IR) transmission, by internet (wired or wireless) or local network transmission, optionally including Bluetooth or other near field transmission.
[0034] In some implementations, the set-top box 210 will receive the command and then can process and execute the command either using the processor 220 internal thereto, or by communicating with an external processor 220 (which also may be a hardware processor having the same configuration described above). The command may be, for example, a command to activate closed captioning and/or rewind the content program, as described later. This may involve the processor 220 contacting the server 230, which may be a local server in or connected to the set-top box 210, or an external server hosted by, for example, the content provider or the third party. For example, in a case where closed captioning and rewinding is requested, the external server may be contacted to in order to receive the information of the closed captioning and/or stored data allowing for rewinding, or the set-top box 210 or server internal thereto may have a memory capable of storing the closed captioning and/or content to allow for rewinding of the content program.
[0035] Also in some implementations, the operation will be completed by outputting, for display, the closed captioning or the rewound content, which may optionally include transmitting information, for example the closed captioning or the rewound content, to the display device 200.
[0036] In some embodiments, the set-top box 210 may be omitted and, for example, the external server 230 and/or display device may include the appropriate hardware (including a processor 220) to execute the command without a need for a set-top box 210. This may occur, for example, in streaming content where an internet connection is used to download and buffer content directly from the internet.
[0037]
[0038] The content program may be provided by a content provider. The content provider may utilize a set-top box such as set-top box 210 to receive, store and/or transmit content program to a content viewer, via the display device 200 or otherwise. The set-top box 210 may be communicatively coupled to the display device 200 through any type of wired or wireless connection. Exemplary wired connections include coaxial, fiber, composite video and high-definition multimedia interface (HDMI). Exemplary wireless connections include WiFi and Bluetooth. In at least one embodiment, the set-top box 210 may be embodied in a television converter device (e.g., a satellite television receiver). The set-top box 210 may also be incorporated into the display device 200. The set-top box 210 should not be limited and can be any device which is capable of receiving data streams and processing and managing presentation of such data streams on the presentation device, including a computer, server, streaming players (Apple TV, Roku, etc.), or other similar device.
[0039] In some embodiments, the set-top box 210 includes a digital video recorder (DVR) and/or recording capabilities. The set-top box may connect to a storage within a remote server, such as the server 230, hosted or otherwise used by the content provider, so as to acquire recorded content for later playback. The set-top box 210 may also include its own storage that allows for local storage of a content program that has been recorded, which can then be locally prepared for display, which may include being transmitted to the display device 200 upon request.
[0040] As shown in
[0041] In
[0042] Consider the case where the content viewer 500 has heard the words yes I will! 402A from second character 402 but cannot fully appreciate the context from which this phrase has been initiated. That is, the content viewer 500 may have heard the phrase yes I will! 402A but may have missed the content that preceded this response from second character 402. This may be because the content viewer 500 became distracted shortly before the phrase yes I will! 402A was uttered, or because the previous discussion was difficult to understand due to an accent, a language difference, a technical issue, or something that made the previous discussion otherwise unintelligible.
[0043] Thus, in the example shown in
[0044]
[0045] In some embodiments, upon receiving the request from the content viewer 500, the processor 220 sources a memory such as a memory within the set-top box 210 or within the server 230 for the audio transcript and for the previously displayed content program (including video), and transmits the transcribed audio, as closed captioning, to the display device 200 along with the rewound portion of the content program.
[0046] Owing to this feature, a content viewer may be able to, using a one-touch system, activate closed captioning to display text of content (e.g., audio optionally including dialogue) that had already been spoken in the content program, but was missed by the content viewer 500 for some reason, such as a distraction or some other inability to properly hear the content. The content viewer 500 thus, by a simple operation, can review the missed content and see a transcription of the content on the display device 200.
[0047] The predetermined amount of time by which the content program is rewound, either using technology and storage within the display device 200 itself and/or the set-top box 210 and/or connection of either the display device 200 or the set-top box 210 to a server 230 storing the content program, may be about 2 to about 30 seconds, or about 3 to about 20 seconds, or about 5 to about 10 seconds, or about 10 seconds. The predetermined amount of time will be an amount of time sufficient to allow the content viewer 500 to review recently missed data, but may not be excessive so as to avoid forcing the content viewer 500 to review an excessive amount of the already viewed content program, and improve efficiency of viewing the content program by returning to the original position of the content program in a prompt manner. The system may also allow for the content viewer 500 to rewind the program multiple times (e.g., by a first predetermined amount of time, and by a further predetermined amount of time) in the case that the content viewer 500 may have missed a larger than usual amount of the content. The further predetermined amount of time may be the same as the first predetermined about of time, or may be, for example, about 10% longer or about 20% longer or about 50% longer than the first predetermined amount of time.
[0048]
[0049] While the system may allow for closed captioning to be turned off after a predetermined period of time as discussed above, the content viewer 500 may also be able, with a one-button touch operation, to manually turn off the closed captioning before the predetermined period of time or in a case where the closed captioning is programmed to stay on until a content viewer operation. In this case, the content viewer 500 may press a button on the remote control 100, for example one of the programmable buttons 101 or CC button 101A described with reference to
[0050]
[0051] Consider again the case where the content viewer 500 has heard the words yes I will! 402A from second character 402 but cannot fully appreciate the context from which this phrase has been initiated. That is, the content viewer 500 may have heard the phrase yes I will! 402A but may have missed the content that preceded this response from second character 402. This may be because the content viewer 500 became distracted shortly before the phrase yes I will! 402A was uttered, or because the previous discussion was difficult to understand due to an accent, a language difference, a technical issue, or something that made the previous discussion otherwise unintelligible.
[0052] Thus, in the example shown in
[0053]
[0054] As shown in
[0055] Further, the processor 220 may initiate closed captioning 510 in response to the button being pressed on the remote control 100. In the case described in this embodiment, the closed captioning 510 will include lines of previously spoken dialogue or audio content, which in this case are the first character 401 asking will you marry me? and the second character 402 responding yes I will! In this case, because the content program continues to run in real time (e.g., at a same speed, or also at a slower speed without being rewound), the text being shown in the closed captioning 510 is text corresponding to a previously heard dialogue, not the currently spoken dialogue.
[0056] In some embodiments, upon receiving the request from the content viewer, the processor 220 sources a memory such as a memory within the set-top box 210 or within the server 230 for the audio transcript, determines an amount of audio corresponding to a predetermined time or amount of the content program, and outputs and/or transmits the transcribed audio, as closed captioning, to the display device 200.
[0057] Owing to this feature, the content viewer 500 may be able to, using a one-touch system, activate closed captioning to display text of content (e.g., audio optionally including dialogue) that had already been spoken in the content program, but was missed by the content viewer 500 for some reason, such as a distraction or some other inability to properly hear the content. The content viewer 500 thus, by a simple operation, can review the text corresponding to the missed content and see a transcription of the content on the display device 200, without needing to rewind the program and delay viewing of the content program.
[0058] The amount of text that may be shown in closed captioning 510 may be based upon a predetermined criteria. For example, a predetermined number of lines of text may be shown. In some embodiments, the 2 lines, or 3 lines, or 2-5 lines of dialogue or audio content prior to the initiation of the request to activate the closed captioning may be shown as closed captioning 510. In some embodiments, instead of choosing a predetermined number of lines of text to show, the processor 220 will source the memory for transcribed audio data of a predetermined amount of time before the initiation of the request. The predetermined amount of the content program immediately prior to the receipt of the instruction being sourced and ultimately output for display, which may include being transmitted to and ultimately displayed on the display device 200 may be from about 5 to about 30 seconds, or about 5 to about 15 seconds, or about 10 seconds.
[0059] Further, at some point after a predetermined period of time of displaying the closed captioning 510, the closed captioning 510 may be deactivated. For example, the closed captioning 510 may remain on for about 5 seconds to about 1 minute, or about 10 seconds to about 30 seconds, or about 20 seconds, after which time, the closed captioning may deactivate. This will allow the content viewer to have caught up on the missing context, but allow for closed captioning to turn off so that the content viewer does not have to undesirably view closed captioning for the remainder of the program.
[0060] While the system may allow for closed captioning to be turned off after a predetermined period of time as discussed above, the content viewer 500 may also be able, with a one-button touch operation, to manually turn off the closed captioning before the predetermined period of time or in a case where the closed captioning is programmed to stay on until a content viewer's operation. In this case, the content viewer 500 may press a button on the remote control 100, for example one of the programmable buttons 101 or CC button 101A described with reference to
[0061]
[0062]
[0063] Time or playback option 653C allows for the content viewer to choose, if the continue option 652 of live closed captioning (e.g., configuration of
[0064] Thus, by consulting the menu 650 and settings menu 653, the content viewer 500 can preselect which option of closed captioning he would prefer once the closed captioning request is initiated. This can also be modified at any time, with the information being stored within a memory within the set-top box 210, display device 200, or a server 230.
[0065]
[0066] In step 802, the method includes determining the time point at which to begin the closed captioning. This may be based upon a preset setting as selected by a content viewer 500 using the settings of
[0067] In step 803, the method may determine an amount of closed captioning to include. This may also be based upon a preset setting as selected by a content viewer 500 using the settings of
[0068] In step 804, the method may output, for display, display the closed captioning in the amount and/or time determined by steps 802 and 803. As discussed previously, this may involve a processor, either alone or with connection to a server 230, sourcing the content program and/or transcription of audio data and transmitting the appropriate amount and/or time period of audio data to the set-top box 210 and/or display device 200, so that the display device 200 can display the closed captioning on the screen.
[0069]
[0070]
[0071] Although specific embodiments were described herein, the scope of the invention is not limited to those specific embodiments. The scope of the invention is defined by the following claims and any equivalents therein.
[0072] As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, a method or a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
[0073] Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a non-transitory computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the non-transitory computer readable storage medium would include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a non-transitory computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
[0074] Aspects of the present disclosure are described above with reference to flowchart illustrations and block diagrams of methods, apparatuses (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
[0075] The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
[0076] The flowcharts and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the Figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.