System and method for optimized channel switching in digital television broadcasting
10542313 ยท 2020-01-21
Assignee
Inventors
- Seth Haberman (New York, NY, US)
- Gerrit Niemeijer (Maplewood, NJ, US)
- Richard L. Booth (Bensalem, PA, US)
- Alex Jansen (New York, NY, US)
- Michael-Dennis Biemans (New York, NY, US)
Cpc classification
H04N21/42638
ELECTRICITY
H04N21/4382
ELECTRICITY
H04N21/44004
ELECTRICITY
International classification
H04N21/438
ELECTRICITY
H04N21/426
ELECTRICITY
Abstract
A system and method for masking/reducing the switch time from an analog or digital television channel to another digital television channel and back. Various optimizations which may be used individually or in combination to minimize the potential disruption to the viewer. This optimization is especially important when the channel switch is made automatically by the receiver, such as the case where the presentation of one television program is temporarily continued on another channel.
Claims
1. A method comprising: tuning a receiver to a first digital channel via a tuner of the receiver; storing digital encoded media received from said first digital channel in an encoded media buffer; decoding output from the encoded media buffer to produce a decoded media stream; presenting the decoded media stream on a television screen operably coupled to the receiver; responsive to at least one of a trigger and a time-based switching instruction, initiating a switching of said tuner to a second channel while continuing to decode the output from the encoded media buffer until the buffer is empty thereby presenting the decoded media stream on the television during the switch from the first channel to the second channel, the second channel occupying a different frequency band than the first digital channel, wherein output from the tuner is switched off or ignored after initiating the switching of said tuner to the second channel and during the switch from the first channel to the second channel; after a passage of time for said tuner to complete switching to said second channel, storing digital encoded media received from said second channel in the encoded media buffer, wherein said passage of time for said tuner to complete switching to said second channel is a predetermined amount of time and a quantity of digital encoded media in said encoded media buffer is maximized to cover a maximal amount of said predetermined amount of time; and decoding and presenting, from the encoded media buffer, the digital encoded media received from said second channel.
2. The method of claim 1 wherein said second channel is a digital channel, and said step of outputting said second channel from said tuner includes commencing input of digital encoded media from said second channel to said encoded media buffer.
3. The method of claim 1 wherein said second channel is an analog channel, and said step of outputting said second channel from said tuner includes bypassing said encoded media buffer.
4. The method of claim 1 further including: before said step of initiating the switching of said tuner to said second channel, decreasing audio volume for said first channel; and after completing the switching of said tuner to said second channel, increasing audio volume for said second channel.
5. The method of claim 1 further comprising sending at least one control message for said second channel to said receiver at a time before said step of initiating the switching of said tuner to said second channel.
6. The method of claim 1 wherein said media is video, MPEG encoded video, audio, MPEG encoded audio, or AC-3 encoded audio.
7. The method of claim 2 wherein said media is digital video.
8. A receiver, comprising: a tuner configured to select one channel from multiple channels received by said receiver; a digital encoded media buffer operably coupled to said tuner; a decoder operatively coupled to the digital encoded media buffer, and at least one processor operably coupled to the tuner, the digital encoded media buffer and the decoder, the at least one processor being configured to: tune the receiver to a first digital channel via a tuner of the receiver, store digital encoded media received from in the encoded media buffer, decode output from the encoded media buffer to produce a decoded media stream; present output from the decoder on a television screen operably coupled to the receiver, responsive to at least one of a trigger and a time-based switching instruction, initiating a switch of said tuner to a second channel while continuing to decode the output from the encoded media buffer until the buffer is empty, thereby presenting the decoded media stream on the television during the switch from the first channel to the second channel, the second channel occupying a different frequency band than the first digital channel, wherein output from the tuner is switched off or ignored after initiating the switch of said tuner to the second channel and during the switch from the first channel to the second channel, storing digital encoded media received from said second digital channel in the encoded media buffer; and decoding and presenting, from the encoded media buffer, the digital encoded media received from said second channel after a passage of time for said tuner to complete switching to said second channel, wherein said passage of time for said tuner to complete switching to said second channel is a predetermined amount of time and a quantity of digital encoded media in said encoded media buffer is maximized to cover a maximal amount of said predetermined amount of time.
9. The receiver of claim 8 wherein said second channel is an analog channel, and output from said tuner bypasses said digital encoded media buffer.
10. The receiver of claim 8 wherein a quantity of digital encoded media in said encoded media buffer is maximized to cover a maximal amount of switching time required by said tuner.
11. The receiver of claim 8 wherein audio output from said receiver is decreased in volume while said tuner is switching to said second channel.
12. The receiver of claim 8 wherein said media is digital video.
13. The receiver of claim 12 wherein said second channel is an MPEG encoded channel, and said second channel is created such that when said digital encoded buffer receives digital encoded media for said second channel, the first input into said digital encoded buffer is an MPEG I-frame.
14. The receiver of claim 12 wherein said digital video for said second channel is previously encoded such that a VBV-delay of a first video frame in presentation order in said digital encoded buffer is reduced.
15. The receiver of claim 14 wherein said VBV-delay of a first video frame in presentation order is reduced by increasing the video bitrate.
16. The receiver of claim 14 wherein said VBV-delay of a first video frame in presentation order is reduced by reducing a VBV buffer size maximum value for an encoder.
17. The receiver of claim 8 wherein at least one control message for said second channel is sent to said receiver at a time before said tuner has completed switching to said second channel.
18. The receiver of claim 8 wherein said media is video, MPEG encoded video, audio, MPEG encoded audio, or AC-3 encoded audio.
19. A receiver, comprising: a first tuner and a second tuner; and at least one processor operably coupled to the first tuner and the second tuner, the at least one processor being configured to: tune the first tuner to a first channel; cause the output of first media output received from the first tuner to a television screen; tune the second tuner to a second channel while continuing to cause the output of the first media output thereby presenting the first media output on the television screen during a switch from the first channel to the second channel, the second channel occupying a different frequency band than the first channel, wherein output from the second tuner is switched off or ignored after initiating the switch of said tuner to the second channel and during the switch from the first channel to the second channel; monitor for a stable signal of the second channel at the second tuner; and responsive to at least one of a trigger and a time-based switching instruction, cause the output of second media output received from the second tuner on the television screen responsive to the stable signal at the second tuner.
20. The receiver of claim 19, wherein causing the output of the first media output and causing the output of the second media output comprises at least one of: presenting the output of the first media output and the output of the second media output on a television screen operably coupled to the receiver, and storing the output of the first media output and the output of the second media output as digital encoded media in an encoded media buffer.
21. The receiver of claim 19, wherein the first media output and the second media output comprises video, MPEG encoded video, audio, MPEG encoded audio, or AC-3 encoded audio.
22. The receiver of claim 19, wherein the first tuner and the second tuner comprise at least one digital tuner and at least one analog tuner.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The foregoing and other features and advantages of the present invention will be more fully understood from the following detailed description of illustrative embodiments, taken in conjunction with the accompanying drawings in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
DETAILED DESCRIPTION
(14) The present invention finds utility in various data transmission applications including, but not limited to, transmission, reception and decoding of broadcast television signals (whether distributed via cable, terrestrial, satellite, microwave, etc.); encoding, multiplexing, and decoding of MPEG (Moving Pictures Expert Group) and AC-3 (Audio Coding algorithm, third generation) based multimedia streams. The invention is both applicable in distribution of television signals to the consumer homes as well as distribution from a originator to affiliate stations (such as cable headends).
(15) Frequency Maps
(16) Television programming (as well as other content) distributed via a television distribution system, is carried to the consumer's homes via a plurality of frequency-multiplexed channels.
(17) Note that the example is specific to a US Cable network, yet a similar picture could easily be derived for other networks such as Satellite DTH, Terrestrial, Non-US Cable, Distribution Networks for Broadcasters (e.g., to affiliate stations), etc. Some television broadcast systems have return paths, others have not. Some have analog channels, some are only digital.
(18) Common for a single distribution systems is that all (non-OOB) forward channels are carried in frequency bands of a fixed size (6 MHz in
(19) In a system utilizing the present invention at least one of the channels will be digital, and the receiver unit must be capable of receiving and decoding digital television signals. Such a receiver is typically a digital consumer set-top hex (STB) or a digital television set. Alternatively, it can be a commercial receiver as placed in headends of television broadcast networks. Such commercial decoders receive digital signals from their point of origination and manipulate these signals for further distribution down the network.
(20) Digital Television Receivers
(21) The digital signal processing path in a digital receiver is illustrated in
(22) It should be noted that this diagram identifies the logical components that participate in the basic digital signal flow. In real implementations some of these functions may be combined (e.g. tuner and demodulator into one chip) and/or implemented in hardware or software (for example, the video decoder can be a hardware device or a software program, or combination thereof).
(23) Most digital television receivers also support the reception of analog channels. This is specifically true in situations where analog and digital channels co-exist (for instance in a cable network where analog and digital programs are carried on the same cable infrastructure (as depicted in
(24) The signal path for reception of analog channels only is shown in
(25) Note that the processors 301 and 302 might be split-up into multiple smaller physical components. Alternatively they might be integrated into one big unit (e.g., one single chip).
(26)
(27) Channel Switching
(28) Here and in the remainder of this disclosure, channel switch time is defined as the time between presentation of the last video frame/audio sample front one (source) channel and the presentation of the first video frame/audio sample from the channel that is switched to.
(29) In the generic case, when switching from any (analog or digital) channel to an analog channel, the following steps take place in a television receiver: 1. Before actually timing, the receiver switches off the video and audio processors 301 and 302 and thus turns the output signals to black/silence. 2. The tuner selects (re-tunes to) the new frequency. 3. The processors start processing and rendering the audio and video (via processors 301 and 302) as soon as the output signal of the tuner is stable.
(30) The typical amount of time necessary for changing to an analog channel can range between 200 and 1000 msec (or more), mainly depending on the quality of the signal and the tuner hardware/software.
(31) Switching from any (analog or digital) channel to a digital channel involves considerably more steps in the general case: 1. Before actually tuning, the receiver switches off (and resets) the video 204 and audio decoders 208 and thus turns the output signals to black/silence. 2. The tuner 200 selects (re-tunes to) the new frequency and the demodulator 201 synchronizes on the incoming stream (in the Cable case this is called a QAM lock). This step can take anything between 200 msec up to 1000 msec (or more), depending on the tuner/demodulator hardware, the software controlling the tuner/demodulator, and the quality of the incoming signal. 3. The Demux/Descrambler 202 extracts a number of basic control messages from the stream. These control messages describe the contents of the digital stream in terms of program numbers, location of the program audio/video, etc. The messages enable the receiver to find the requested television program in the multiplex. In MPEG-2 systems these would for instance be the PAT (Program Association Table) and PMT (Program Map Table) messages. The typical time needed to find such message is on average around 20 msec, but can be as much as 50 msec since these messages appear in the bitstream at fixed time intervals. 4. Next, the decoders 204, 208 synchronize on the incoming video/audio streams. For instance in an MPEG-2 system the video decoder 204 has to wait for the next I-frame before it can start filling the encoded data buffer 203. All data before that first I-frame must be discarded. Since the interval between two subsequent I-frames can be as much as 18 frames (or more) in typical encoded MPEG video, the average wait time can be as much as 9 frames (300 msec). For the worst case, the wait time can be more than half a second. 5. The buffers 203 and 207 holding encoded (compressed) data will have to be filled to a certain extent before decoding can start, in order to avoid buffer underflows. For instance in an MPEG-2 system, the video buffer 203 will have to be filled according to the initial VBV delay of the first frame. This can be as much as 300-400 msec in conventionally encoded MPEG video, depending on the bitrate chosen. The VBV buffer fillrate 404 at the start of a new stream is illustrated in
(32) As can be seen, the switch time to a digital channel can take a considerable amount of time, and can be as much as 2 seconds or more (especially if SW control overhead is included). Switching to an analog channel typically takes less time since no extensive digital processing steps have to be performed, but can still be up to 1.5 seconds of time as explained above.
(33) Such long delays between changing channels (and having no video/audio present) is disruptive to the experience of the viewer and should be minimized. This holds for the general case of channel zapping, but even more in cases where the programming on the different channels is related.
(34) The present invention discloses methods that can be used to reduce and/or mask the time needed for the switch. The invention focuses on methods that can be applied to today's digital television receivers (set-top boxes, commercial receivers, or other) without hardware modifications.
(35) It should be noted that the methods described in this document work for both directed channel change (e.g. channel change initiated by the system, rather than the local viewer), and for more standard viewer initiated channel change (zapping).
(36) The methods will work for all situations where a digital receiver is deployed, be it a receiver in the home (e.g. set top boxes, digital television sets, etc.) or a receiver in the distribution network (e.g. commercial receiver at cable plant, commercial receiver at local broadcasting station, etc.).
(37) In the general case (basically the normal situation of a viewer, or the box autonomously, zapping between two channel) there are a few opportunities for masking/reducing the switch time as perceived by the viewer.
(38) Method 1 (General): Dual Tuner Receivers
(39) The first method to reduce the switch time works in receivers with two tuners as depicted in
(40) When the switch is from an analog to a digital channel (or vice-versa) and the system has separate tuners for analog and digital channels, the signal paths are essentially separate, and only at the backend of the system it is decided which signal to route to the outputs of the receiver via switches 304 and 305. In this situation the solution to reducing the amount of silence/black when switching from analog to digital or from digital to analog is making the switch in the backend only AFTER the new signal path is producing audio/video, thus essentially reducing the switch time to zero.
(41) Method 2 (General): Using Digital Video Buffer
(42) In a situation where the source channel is digital, and the target channel analog or digital, the buffers in the digital signal path can be used to reduce the perceived switch time. As illustrated by
(43) As shown in
(44) For the switch to digital case, only after the decoders 204, 208 have been switched off, the control software 1003 instructs the tuner/demodulator to retune to the new desired frequency and achieve QAM-lock, as illustrated by label 1002. After the modulator 201 has achieved QAM lock, the demux 202 starts receiving a valid signal, and will be instructed by the control SW to filter required data, video, and audio packets. Subsequently, the control SW will switch on the video and audio decoders 204, 208 which will start producing audio/video (after the buffers 203, 207 are sufficiently full).
(45) For the switch to analog case, the situation is similar, as shown in
(46) The common channel change procedure just described is disadvantageous since the output is set to black/silence while there still is valid video and audio data in the decoder input buffers (whether the switch is from digital to digital or from digital to analog). An illustrative embodiment of the present invention exploits the presence of this data by not resetting the decoders 204 and/or 208 before starting the tune. Essentially, all steps as just described remain the same, except the audio and video decoders will not be switched off (i.e., step 1001 is omitted). This means that the audio/video decoders will keep playing, (potentially as much as half a second, or even more) until their input buffers are empty. At that point the output signals would go to black/silence due to absence of data.
(47) Method 3 (General): Avoiding Video Jump in A/D or D/A Switch
(48) Usually, when switching from a digital channel to an analog one the other way around, the video might jump, caused by losing synchronization, which is disadvantageous to the viewer's experience. This jump is even visible when the video itself is black. In analog video signals, the video sync is taken from the input signal itself. In the digital case, the receiver has to generate the synch itself. These two different synch signals are most likely not exactly aligned, meaning that the end of one frame at one signal is when the other synch signal is in the middle of refreshing a frame, leading to the jump in the screen.
(49) One option is to force the receiver to use its own generated synch signal for the analog video as well. Another option is to only turn on the video backend (renderers) when the synch is in the invisible region (so-called VBIVertical Blanking Interval).
(50) Method 4 (General): Audio Ramp Down/Up
(51) Similarly, when tuning to another signal, audio might cause some audible artifacts due to the sudden switch-off of the signal. This can be masked by a ramp-down just before the desired switch, and a ramp-up just after the switch is complete. The ramp-down/up periods could be as short as 1/10.sup.th of a second as indicated in
(52) System for Personalized Messaging
(53) In situations such as personalized advertising/messaging, one (digital) channel can carry one or more messages, one of which can be used to overlay the message on another (main) analog or digital channel. The exact message to play will be decided by the receiving equipment. This system is disclosed in
(54) To support message replacement by the receiver at the consumer home, the headend contains a cue-tone detector 804 that detects the cue-tones 802 in the source programming. The cue-tone detector passes the incoming stream on virtually unchanged. The only change is that it takes out the cue-tone 802 and optionally replaces it by another trigger message 810 that can be used by the receiver in the consumer's homes to detect the switch moment. Cue-tone 810 might even be identical to 802, in which case nothing is changed in the stream.
(55) In case channel 800 is analog, message 810 is typically encoded as VBI data, audio tones, or other analog encoded data. Another possibility is to use time-based switching, in which case the receivers have a clock and the network will generate time-stamped switching instructions that are sent ahead of time to the receivers. The receivers will receive these instructions, and execute the switch on the exact time specified in the instruction. This approach docs require clock synchronization between central clocks and receiver clocks. There are several (well known) methods of doing this, such as: slaving all receiver clocks to a central master clock (as is done in some Access Control systems), constantly measuring the drift in the various receiver clocks and adjusting the system for it, etc,.
(56) In case channel 800 is digital, message 810 can be encoded in many different ways. In MPEG-2 systems the message can be encoded as private data, an MPEG splice-point message, etc. If the receiver has no capability of decoding any of these messages, there is again the option of using time-based return switching in which the receivers receive time-stamped return-switching instructions.
(57) In personalized messaging it is advantageous to place alternative messages on a separate channel as also depicted in
(58) The cue-tone detector and digital server are synchronized such that the alternative message 811 falls within the time window of message 803 in the main programming. Note that message 811 might be shorter than message 803, to allow for switching by the receiver from the main program to the alternative message, and back (without loosing content). Each switch might be up to 2 sec. as explained before. Also, some extra time might be added to allow for streams 808 and 809 to be drifting, e.g., because they are generated using a slightly different clock. In total, the amount of time the alternative message is shorter than the message that is overlaid in the main program is determined by the worst case situation, that has to be measured in the field with the deployed receivers.
(59) Digital server 806 will insert a separate trigger message 812 in the channel that is used by the receiver to switch back to the main programming channel after the alternative message is finished. Message 812 can be encoded in many different ways since channel 809 is digital. For example, in MPEG it can be encoded as private data or any other type of data that can be detected by the receiver.
(60) All television channels, including the ones just discussed, are subsequently combined and positioned as the right frequency in the frequency spectrum by combiners/upconverters 815. The resulting RF signal 816 is leaving the headend and passed on downstream, eventually reaching the receivers at the consumer's homes. Note that digital channels first pass through a modulator 814 that converts the digital bitstream into an analog signal.
(61) Note that the system that has just been disclosed can be used in any situation where parts of a television program can be replaced by other parts that are located on one or more different channels.
(62) Next, methods will be disclosed that can reduce the switching time by a receiver between streams 808 and 809 by preparing streams 809 ahead of time in the system as just described.
(63) Method 5 (Specific): Sending Control Messages Ahead of Time
(64) The first method consists of providing the basic control messages (such as PMT, PAT) for the new stream ahead of time (i.e., before the switch). This can be done in a number of ways.
(65) One option is to standardize the content of the control messages in the receiver software (for instance in an MPEG-2 environment: always use fixed PIDs (packet Identifiers) for the destination digital stream in personalized messaging.
(66) Another option is to send the content of the control messages to the receiver as part of the analog program, before the switch takes place (e.g. insert the control messages in the VBI data of the analog program).
(67) Yet another option is to send the content of the control messages to the receiver via another link (e.g., in an MPEG-2 cable system via an out-of-band channel, in DTH system via phone modem).
(68) This approach will ensure that the receiver does not have to wait for the messages to appear in the stream that has been switched to, saying up to 50 msec, of time.
(69) Method 6: (Specific) Reduce Time Needed to Find Next I-Frame
(70) The second method is ensuring that the video in the alternative message can be decoded right from the beginning. In an MPEG environment this means that the alternative messages starts with an I-frame. This saves the decoder from waiting for the next I-frame before it can begin its decoding process. This technique can save as much as 500 msec, of time. Since the alternative message can be prepared ahead of time, and insertion of the message is controlled b the trigger messages in the main program, this is readily achieved.
(71) Method 7: (Specific) Reduce Required Buffer Fullness
(72) The third method is ensuring that video presentation starts as soon as possible (low latency). This can be achieved by reducing the initial VBV-delay for the alternative message. This can be done by either (temporarily) increasing the bitrate of the video (so that the buffer is filled quicker), or by encoding the video such that it needs less data in the buffer before encoding (e.g., by forcing a lower-maximum VBV buffer size for the encoder). This invention can save as much as 200 msec. This would mean in
(73) Together, methods 5-7 can lead to a saving of up to 750 msec, which is considerable. Method 2, in addition, can lead to a saving of up 300 msec. Thus, the total time needed for the switch can be reduced with more than a full second by employing methods 2,5,6,7 together. This can be achieved without any hardware modifications of existing receivers.
(74) Method 8: (Specific) Switch Back to a Scramble Program
(75) To descramble a digital stream certain control messages must be received before actual descrambling (and, consequently, video/audio presentation) can start. Examples of such messages are control words such as ECMs and EMMs (Entitlement Control Messages and Entitlement Management Messages).
(76) Descrambling has an impact on Digital-to-Digital Switching, specifically if the original digital channel is scrambled. If a receiver switches to a scrambled stream, in addition to the steps discussed earlier, it will need some time to receive the Broadcast Access Control messages in the stream (which it needs for descrambling). This causes additional switching delay. An example of this occurs when the receiver is playing a scrambled stream, switches over to another stream to play out a personalized message (unscrambled), and then switches back to the original stream (at which point the additional delay will occur).
(77) There are several ways of solving this issue. The preferred solution would be to ensure that the receiver, before switching from a stream A to a scrambled stream B, already has access so the Broadcast Access Control messages for stream B. This can be done by sending these messages via an electronic link (like a modem) to the receiver and storing them there until needed. Another approach is to simply embed (copy) the Broadcast Access Control messages from stream B in the original stream A. This is illustrated in
(78) In a situation where it is desired that the alternative messages are also scrambled, it is a good option to scramble them using the same control words as used in the main program. This way, the receiver can switch back and forth between the channels without delays (since the same scrambling is used).
(79) Each of the described methods provides some optimization of interstream switching. The present invention includes any possible permutation or combination of these methods. An illustrative embodiment of the present invention for optimizing switching from an analog to a digital channel includes the combination of methods 3, 4, 5, 6 and 7. An illustrative embodiment of the present invention for optimizing switching from a digital channel to an analog channel includes the combination of methods 2, 3 and 4. An illustrative embodiment of the present invention for optimizing switching from a digital to another digital channel includes the combination of methods 2, 3, 4, 5, 6 and 7. In case that the digital channel is scrambled, then method 8 may be included to optimize the switching.
(80) Although the invention has been shown and described with respect to illustrative embodiments thereof, various other changes, omissions and additions in the form and detail thereof may be made therein without departing from the spirit and scope of the invention. It will understood that various modifications may be made to the embodiments disclosed herein. Therefore, the above description should not be construed as limiting, but merely as exemplification of the various embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the claims appended hereto.