USER-INTERACTIVE DISPLAYS INCLUDING THEME-BASED DYNAMIC VIDEO MOSAIC ELEMENTS

Abstract

The present invention teaches a method of creating and presenting a user interface comprising a Dynamic Mosaic Extended Electronic Programming Guide (DMXEPG) using video, audio, special applications, and service dynamic metadata. The system enables television or digital radio service subscribers to select and display of various programs including video, interactive TV applications, or any combination of audio or visual components grouped and presented in accordance with the dynamic program/show metadata, business rules and objectives of service providers, broadcasters, and/or personal subscriber choices, collectively referred to as mosaic element presentation criteria.

Claims

1. A method of controlling video display of a user interface (UI) comprising a plurality of displayed non-overlapping mosaic elements (MEs), each of the plurality of non-overlapping MEs having an ME area defined by a length and a width and each having a different corresponding location on the UI, the method comprising: providing, for display in one of the plurality of non-overlapping MEs comprising a first aspect ratio, video from an original video source comprising a second aspect ratio; generating a clipped video source portion comprising the first aspect ratio by removing a region of the original video source adjacent to the clipped video source portion; scaling the clipped video source portion by expanding the clipped video source portion to have an area that is the same as the ME area while maintaining the first aspect ratio; and inserting the scaled clipped video source portion into the one ME for display, wherein the scaled clipped video source portion is displayed in the one ME on the UI.

2. The method of claim 1, wherein the first aspect ratio is different than the second aspect ratio.

3. The method of claim 1, wherein the first aspect ratio and the second aspect ratio are the same.

4. The method of claim 1, wherein the clipped video source portion is a central portion of the original video source.

5. The method of claim 1, wherein the region of the original video source adjacent to the clipped video source portion is less critical than the clipped video source portion.

6. A video processing device for controlling video display of a user interface (UI) comprising a plurality of non-overlapping mosaic elements (MEs), each of the plurality of non-overlapping MEs having an ME area defined by a length and a width and each having a different corresponding location on the UI, the processing device comprising a video processor configured to: provide, for display in one of the plurality of non-overlapping MEs comprising a first aspect ratio, video from an original video source comprising a second aspect ratio; generate a clipped video source portion comprising the first aspect ratio by removing a region of the original video source adjacent to the clipped video source portion; scale the clipped video source portion by expanding the clipped video source portion to have an area that is the same as the ME area while maintaining the first aspect ratio; and insert the scaled clipped video source portion into the one ME for display, wherein the scaled clipped video source portion is displayed in the one ME on the UI.

7. The video processing device of claim 6, wherein the first aspect ratio is different than the second aspect ratio.

8. The video processing device of claim 6, wherein the first aspect ratio and the second aspect ratio are the same.

9. The video processing device of claim 6, wherein the clipped video source portion is a central portion of the original video source.

10. The video processing device of claim 6, wherein the region of the original video source adjacent to the clipped video source portion is less critical than the clipped video source portion.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Various aspects of the present invention are described in the following detailed discussion of an illustrative embodiment of the invention. The embodiment is explained in the figures listed below and in the following detailed discussion.

[0047] FIG. 1 is the screen for the first level of multi-dimensional DMXEPG which, according to the invention, is dynamically generated by assigning to ME programs that match program content, business, and subscriber preference rules.

[0048] FIG. 2 is one of the layouts for the second or other levels of DMXEPG which, according to the invention, is dynamically generated by the DMXEPG service, assigning to the MEs the programs that match program content, business, and subscriber preference rules.

[0049] FIG. 3 is the multi-level DMXEPG for the systems with a multi-tuner set-top box (STB) or VOD system.

[0050] FIG. 4 is an example of tri-level DMXEPG access path to the channel.

[0051] FIG. 5 is an anatomy of the ME components used in DMXEPG.

[0052] FIG. 6 is an example of a DMXEPG page dynamically created in the morning hours.

[0053] FIG. 7 is an example of a DMXEPG page dynamically created in the evening hours.

[0054] FIG. 8 is an example of a DMXEPG page generated by an STB with two or more tuners.

[0055] FIG. 9 is an example of a DMXEPG page generated by the service provider.

[0056] FIG. 10 is an example of a DMXEPG page with video channel(s) assigned to ME(s) by the subscriber and facilitated by multi-tuner STB or VOD system.

[0057] FIG. 11 is a DMXEPG page generated when 16 or more programs for selected content category are available at a given time and where the subscriber has the ability to display video that is selected from an ME within another ME.

[0058] FIG. 12 is a DMXEPG page generated when 9 programs for selected content category are available at a given time.

[0059] FIG. 13 is a DMXEPG page generated when 5 programs for selected content category are available at a given time.

[0060] FIG. 14 is an example of a DMXEPG page simultaneously displaying an interactive application on one or more MEs while displaying assigned video programs on another ME, where each ME can have more than one assigned iTV application assigned.

[0061] FIG. 15 is a DMXEPG page generated when customer does not have rights to access programs with parental rating exceeding maximum allowed limit.

[0062] FIG. 16 is a DMXEPG page generated when the customer does not have rights to access channels assigned to one or more ME.

[0063] FIG. 17 is a DMXEPG generated by the service provider with one or more MEs displaying a channel for which subscriber is not authorized.

[0064] FIG. 18 is an assignment schedule for existing static DMXEPG.

[0065] FIG. 19 is an assignment schedule for DMXEPG that dynamically assigns channels to MEs.

[0066] FIG. 20 is an assignment schedule for DMXEPG that dynamically assigns programs from different channels to MEs.

[0067] FIG. 21 is a DMXEPG page with rotating interactive content assigned to an ME.

[0068] FIG. 22 is a DMXEPG page with rotating interactive applications assigned to an ME.

[0069] FIG. 23 is head-end data flow through the Matrix TV Server Suite (MTVSS).

[0070] FIG. 24 shows logical components of the MTVSS.

[0071] FIG. 25 is an algorithm for avoiding TV screen burnout.

[0072] FIG. 26 shows ways to activate the DMXEPG Client application.

[0073] FIG. 27 shows ways to activate the DMXEPG Client resident application.

[0074] FIG. 28 shows relations between standard MPEG2 transport tables and additional private Interactive Mosaic Tables/descriptors.

[0075] FIG. 29 shows local and national MTVSS configurations.

[0076] FIG. 29A shows MTVSS configurations for DMXEPG screen generation on a client device.

[0077] FIG. 30 is a remote control which, in accordance with the invention, incorporates a rotating element used by subscribers to navigate DMXEPG or iTV applications.

[0078] FIG. 31 is a diagram illustrating how to virtually increase size of the video or visual program in the ME for various aspect ratios.

[0079] FIG. 32 is a diagram illustrating clipping for an original video source having a 43 aspect ratio that is targeted for an ME that has a 169 aspect ratio.

[0080] FIG. 33 is a diagram illustrating clipping for a 43 original video source (i.e., its aspect ratio is 43) to fit into a target ME having a non-standard aspect ratio.

[0081] FIG. 34 is a diagram illustrating clipping for a 169 original video source to fit a 169 ME.

[0082] FIG. 35 is a diagram illustrating clipping for a 169 original video source to fit a 43 ME.

[0083] FIG. 36 is a diagram illustrating clipping for a 169 to fit a non-standard ME.

[0084] FIG. 37 is a diagram illustrating zooming in on an ME that is in focus.

[0085] FIG. 38 is a diagram illustrating zooming in of a 43 original ME to an expanded ME having a 169 aspect ratio.

[0086] FIG. 39 is a diagram illustrating zooming in of a 169 original ME to a 169 enlarged ME.

[0087] FIG. 40 is a diagram illustrating zooming in of a 169 original ME to a 43 enlarged ME.

[0088] FIG. 41 is a diagram illustrating zooming in of a 169 original ME to a non-standard zoomed-in ME (i.e., the ME has a non-standard aspect ratio).

[0089] FIG. 42 is a diagram illustrating zooming in of a 43 original ME to a non-standard zoomed-in ME (i.e., the ME has a non-standard aspect ratio).

[0090] FIG. 43 is a diagram illustrating the in-focus ME having a non-standard aspect ratio, where zooming results in a 43 expanded ME.

[0091] FIG. 44 is a diagram illustrating the in-focus ME in FIG. 33, where zooming results in a 169 expanded ME.

[0092] FIG. 45 is a diagram illustrating expanding the size of a zoomed-in ME to a full-screen video.

[0093] FIG. 46 is a diagram illustrating reversing of a series of zoom-ins by zooming out of an ME.

[0094] FIG. 47 is a diagram illustrating reducing of a full-screen display to its previous state.

[0095] FIG. 48 is a general flow chart showing the subscriber steps zooming in and zooming out of an in-focus ME.

[0096] FIG. 49 is a general flow chart showing an alternative process for zooming in and zooming out of an in-focus ME.

[0097] FIG. 50 shows changing the location of an expanded ME on the screen.

[0098] FIG. 51 shows that DMEPX can comprise MEs generated at the headend or on the subscriber (client) side.

[0099] FIG. 52 shows major system elements which allow connection of additional content from any source that is available to subscriber.

[0100] FIG. 52a shows major system elements which allow DMXEPG screen to be created by subscriber device.

[0101] FIG. 53 shows major system elements which allow connection of additional content from more than one additional content source that is available to subscriber.

[0102] FIG. 54 shows major system elements and their connections to enable subscribers to display expanded ME in the DMXEPG using the same content source.

[0103] FIG. 55 is a table illustrating system elements and their connections to enable subscribers to display expanded ME in the DMXEPG using more than one content source.

[0104] FIG. 56 is a table illustrating combinations of scaling and display of video when the aspect ratio of a DMXEPG is 43.

[0105] FIG. 57 is a table illustrating combinations of scaling and display of video when the aspect ratio of a DMXEPG is 169.

[0106] FIG. 58 is a table illustrating combinations of scaling and display of video when the aspect ratio of a DMXEPG is MN.

[0107] FIG. 59 shows a process of scaling source video to an ME when source and destination aspect ratios are the same or are not the same.

[0108] FIG. 60 is a diagram illustrating different arrangements of MEs in a DMXEPG for different combinations of DMXEPG and ME aspect ratios.

[0109] FIG. 61 illustrates examples of different numbers of MEs, having 169 aspect ratios, used to populate a DMXEPG application screen.

[0110] FIG. 62 illustrates examples of MEs, having different aspect ratios, used to populate a DMXEPG application screen.

[0111] FIG. 63 illustrates examples of different numbers of MEs, having MN aspect ratios, used to populate a DMXEPG application screen.

[0112] FIG. 64 illustrates an example Pay Per View portal created with MEs.

[0113] FIG. 65 illustrates the Pay Per View portal, in which ME3 is in focus and the titles for ME1 to ME4 are shown.

[0114] FIG. 66 illustrates the Pay Per View portal, in which ME7 is in focus and the titles for ME5 to ME8 are shown.

[0115] FIG. 67 illustrates the Pay Per View portal, in which ME15 and the title linked to ME15 are in focus.

[0116] FIG. 68 illustrates the Pay Per View portal, in which ME23 and the title linked to ME23 are in focus.

[0117] FIG. 69 illustrates the Pay Per View portal, in which an in-focus ME can be selected for purchase.

[0118] FIG. 70 is an illustration of an example UI and navigation in a DMXEPG for the specific content categories of GAMES and KIDS.

[0119] FIG. 71 is an illustration of a display in which ME5 is in focus and the main screen is updated with the video currently associated with ME5.

[0120] FIG. 72 is an illustration of the display of additional information for the in-focus ME5.

[0121] FIG. 73 is an illustration of the display in which ME2 is in focus.

[0122] FIG. 74 is an illustration of a first part of a sequence showing the focus changed to the GAMES ME.

[0123] FIG. 75 illustrates the second part of a sequence in which the main screen is replaced with a set of MEs for different games that can be accessed.

[0124] FIG. 76 illustrates user navigation from the GAMES ME to a non-game ME.

[0125] FIG. 77 illustrates the main screen replaced with the scaled video when the SELECT button is pressed for the in-focus ME.

[0126] FIG. 78 illustrates an example of a UI and navigation of a DMXEPG created for a specific content category (Kids).

[0127] FIG. 79 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0128] FIG. 80 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0129] FIG. 81 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0130] FIG. 82 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0131] FIG. 83 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0132] FIG. 84 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0133] FIG. 85 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0134] FIG. 86 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0135] FIG. 87 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0136] FIG. 88 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0137] FIG. 89 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0138] FIG. 90 shows another example of the UI and navigation of the DMXEPG created for the specific content category (Kids).

[0139] FIG. 91A shows a first part of a sequence of a UI and navigation of a DMXEPG portal for a specific content category (Kids).

[0140] FIG. shows a second part of the sequence of the DMXEPG UI navigation within the specific content category (Kids).

[0141] FIG. 91C shows a third part of the sequence of the DMXEPG UI navigation within the specific content category (Kids).

[0142] FIG. 91D shows a fourth part of the sequence of the DMXEPG UI navigation within the specific content category (Kids).

[0143] FIG. 92A shows a first part of a sequence of DMXEPG UI navigation and program information following changes in focus of MEs.

[0144] FIG. 92B shows a second part of the sequence of DMXEPG UI navigation and program information following changes in focus of MEs.

[0145] FIG. 92C shows a third part of the sequence of DMXEPG UI navigation and program information following changes in focus of MEs.

[0146] FIG. 92D shows a fourth part of the sequence of DMXEPG UI navigation and program information following changes in focus of MEs.

[0147] FIG. 93A shows a first part of a sequence of a UI and navigation of a DMXEPG of future (not yet broadcast) programs.

[0148] FIG. 93B shows a second part of the sequence of a UI and navigation of a DMXEPG of future (not yet broadcast) programs.

[0149] FIG. 93C shows a third part of the sequence of a UI and navigation of a DMXEPG of future (not yet broadcast) programs.

[0150] FIG. 93D shows a fourth part of the sequence of a UI and navigation of a DMXEPG of future (not yet broadcast) programs.

[0151] FIG. 94A shows a first part of a sequence of an option for enlarging a selected ME to a larger portion of the screen and the full screen.

[0152] FIG. 94B shows a second part of the sequence of an option for enlarging a selected ME to a larger portion of the screen and the full screen.

[0153] FIG. 94C shows a third part of the sequence of an option for enlarging a selected ME to a larger portion of the screen and the full screen.

[0154] FIG. 94D shows a fourth part of the sequence of an option for enlarging a selected ME to a larger portion of the screen and the full screen.

[0155] FIG. 95A shows a first part of a sequence of a UI and navigation of a DMXEPG in program information display mode.

[0156] FIG. 95B shows a second part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0157] FIG. 95C shows a third part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0158] FIG. 95D shows a fourth part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0159] FIG. 96A shows a fifth part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0160] FIG. 96B shows a sixth part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0161] FIG. 96C shows a seventh part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0162] FIG. 96D shows an eighth part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0163] FIG. 97A shows a first part of a sequence of a UI and navigation of a DMXEPG in program information display mode.

[0164] FIG. 97B shows a second part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0165] FIG. 97C shows a third part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0166] FIG. 97D shows a fourth part of the sequence of a UI and navigation of a DMXEPG in program information display mode.

[0167] FIG. 98A shows a first part of a sequence of a UI and navigation of a DMXEPG in a channel browsing mode.

[0168] FIG. 98B shows a next part of the sequence in the channel browsing mode in response to the Channel Browser ME being selected.

[0169] FIG. 98C shows a next part of the sequence in the channel browsing mode in response to Arrow Right being selected.

[0170] FIG. 98D shows a next part of the sequence in the channel browsing mode in response to the Arrow Down being selected.

[0171] FIG. 99A shows the part of the sequence shown in FIG. 98D.

[0172] FIG. 99B shows a next part of the sequence in the channel browsing mode in response to Info being selected.

[0173] FIG. 99C shows a next part of the sequence in the channel browsing mode in response to Arrow Right being selected.

[0174] FIG. 99D shows a next part of the sequence in the channel browsing mode in response to Arrow Up being selected.

[0175] FIG. 100A shows the part of the sequence shown in FIG. 99B.

[0176] FIG. 100B shows a next part of the sequence in the channel browsing mode in response to Info being selected.

[0177] FIG. 100C shows a next part of the sequence in the channel browsing mode in response to Play being selected.

[0178] FIG. 100D shows a next part of the sequence in the channel browsing mode in response to Arrow Up being selected.

[0179] FIG. 101A shows the part of the sequence shown in FIG. 100C.

[0180] FIG. 101B shows the part of the sequence shown in FIG. 100D as a first optional display in response to selecting Arrow Up.

[0181] FIG. 101C shows a second optional display in response to selecting Arrow Up.

[0182] FIG. 102A shows the part of the sequence shown in FIG. 99B.

[0183] FIG. 102B shows a next part of the sequence as a first optional display in response to selecting Arrow Up.

[0184] FIG. 102C shows a next part of the sequence as a second optional display in response to selecting Arrow Up.

[0185] FIG. 103A shows a first part of a sequence in channel browsing mode.

[0186] FIG. 103B shows a next part of the sequence in response to selecting Arrow Right.

[0187] FIG. 103C shows a second part of a sequence beginning from the display shown in FIG. 103D in response to selecting Arrow Right.

[0188] FIG. 103D shows the first part of the sequence prior to selecting Arrow Right and displaying the second part of the sequence shown in FIG. 103C.

[0189] FIG. 104A shows a first part of a sequence in channel browsing mode.

[0190] FIG. 104B shows a next part of the sequence in response to selecting Play.

[0191] FIG. 104C shows a second part of a sequence beginning from the display shown in FIG. 104D in response to selecting Play.

[0192] FIG. 104D shows the first part of the sequence prior to selecting Play and displaying the second part of the sequence shown in FIG. 104C.

[0193] FIG. 105A shows a first part of a sequence in channel browsing mode.

[0194] FIG. 105B shows a next part of the sequence in response to selecting the Channel 16 Video ME shown in FIG. 105A.

[0195] FIG. 105C shows a second part of a sequence beginning from the display shown in FIG. 105D in response to selecting the Channel 16 Video ME shown in FIG. 105D.

[0196] FIG. 105D shows the first part of the sequence prior to selecting the Channel 16 Video ME and displaying the second part of the sequence shown in FIG. 105C.

[0197] FIG. 106A shows a first part of a sequence in channel browsing mode.

[0198] FIG. 106B shows a next part of the sequence in response to selecting a scaled Channel 16 Video ME shown in FIG. 106A.

[0199] FIG. 106C shows a second part of a sequence beginning from the display shown in FIG. 106D and in response to selecting the scaled Channel 16 Video ME shown in FIG. 106D.

[0200] FIG. 106D shows the first part of the sequence prior to selecting the scaled Channel 16 Video ME and displaying the second part of the sequence shown in FIG. 106C.

[0201] FIG. 107A shows the display in FIG. 106C.

[0202] FIG. 107B shows a next part of the sequence as a first optional display in response to making a selection while viewing the Full Screen Video shown in FIG. 107A.

[0203] FIG. 107C shows a next part of the sequence as a second optional display in response to making a selection while viewing the Full Screen Video shown in FIG. 107A.

[0204] FIG. 108A shows a first part of a sequence in channel browsing mode.

[0205] FIG. 108B shows a next part of the sequence in response to selecting Channel 16 Video ME shown in FIG. 108A.

[0206] FIG. 108C shows a second part of a sequence beginning from the display shown in FIG. 108D and in response to selecting the Channel 16 Video ME shown in FIG. 108D.

[0207] FIG. 108D shows the first part of the sequence prior to selecting the Channel 16 Video ME and displaying the second part of the sequence shown in FIG. 108C.

[0208] FIG. 109A shows a first part of a sequence in channel browsing mode.

[0209] FIG. 109B shows a next part of the sequence in response to selecting a scaled Channel 16 Video ME shown in FIG. 109A.

[0210] FIG. 109C shows a second part of a sequence beginning from the display shown in FIG. 109D and in response to selecting a scaled Channel 16 Video ME shown in FIG. 109D.

[0211] FIG. 109D shows the first part of the sequence prior to selecting the scaled Channel 16 Video ME and displaying the second part of the sequence shown in FIG. 109C.

[0212] FIG. 110A shows a first part of an ME zoom in and zoom out sequence in a show browsing mode.

[0213] FIG. 110B shows a next part of the sequence in the show browsing mode in response to selecting the Program 7 Video ME shown in FIG. 110A.

[0214] FIG. 110C shows a second part of a sequence beginning from the display shown in FIG. 110D and in response to selecting the Program 7 Video ME shown in FIG. 110D.

[0215] FIG. 110D shows the first part of the sequence prior to selecting the Program 7 Video ME shown in FIG. 110D and displaying the second part of the sequence shown in FIG. 110C.

[0216] FIG. 111A shows a first part of a sequence in a show browsing mode.

[0217] FIG. 111B shows a next part of the sequence in which a Full Screen Video is displayed in response to selecting the Program 7 Video ME shown in FIG. 111A.

[0218] FIG. 111C shows a second part of a sequence beginning from the display shown in FIG. 111D and in response to selecting the Program 7 Video ME shown in FIG. 111D.

[0219] FIG. 111D shows the first part of the sequence prior to selecting the Program 7 Video ME and displaying the second part of the sequence shown in FIG. 111C.

[0220] FIG. 112A shows the display in FIG. 111C.

[0221] FIG. 112B shows a next part of the sequence as a first optional display in response to making a selection while viewing the Full Screen Video shown in FIG. 112A.

[0222] FIG. 112C shows a next part of the sequence as a second optional display in response to making a selection while viewing the Full Screen Video shown in FIG. 112A.

[0223] FIG. 113A shows a first part of a sequence of a UI and navigation of DMXEPG in channel browsing mode.

[0224] FIG. 113B shows a next part of the sequence in channel browsing mode in response to selecting Arrow Down.

[0225] FIG. 113C shows a second part of a sequence beginning from the display shown in FIG. 113D and in response to selecting Arrow Down.

[0226] FIG. 113D shows the first part of the sequence prior to selecting Arrow Down and displaying the second part of the sequence shown in FIG. 113C.

[0227] FIG. 114A shows a first part of a sequence of a UI and navigation of DMXEPG in channel browsing mode.

[0228] FIG. 114B shows a next part of the sequence in the channel browsing mode in response to a selection while viewing the display shown in FIG. 114A.

[0229] FIG. 114C shows a next part of the sequence in the channel browsing mode in response to selecting Arrow Down.

[0230] FIG. 114D shows the next part of the sequence in the channel browsing mode in response to selecting INFO.

[0231] FIG. 115A shows a first part of a sequence of a UI and navigation of DMXEPG in channel browsing mode.

[0232] FIG. 115B shows a next part of the sequence in the channel browsing mode in response to selecting INFO.

[0233] FIG. 115C shows a next part of the sequence in the channel browsing mode in response to a selection while viewing the display shown in FIG. 115B.

[0234] FIG. 116A shows a first part of a sequence of a UI and navigation of DMXEPG in channel browsing mode.

[0235] FIG. 116B shows a next part of the sequence in the channel browsing mode in response to a selection while viewing the display shown in FIG. 116A.

[0236] FIG. 117A shows a first part of a sequence of a UI and navigation of DMXEPG in channel browsing mode.

[0237] FIG. 117B shows a next part of the sequence in the channel browsing mode in response to a selection while viewing the display shown in FIG. 117A.

[0238] FIG. 118A shows a first part of a sequence of a DMXEPG prior to entering a PVR content browsing mode.

[0239] FIG. 118B shows a second part of the sequence of entering the content browsing mode in response to selecting the PVR Browser ME shown in FIG. 118A.

[0240] FIG. 119A shows a first part of a sequence of building a VOD portal.

[0241] FIG. 119B shows a next part of the sequence building a VOD portal in response to a selection while viewing the display shown in FIG. 119A.

[0242] FIG. 120A show an example of displaying content via a grid based EPG.

[0243] FIG. 120B shows an example of displaying content in a grid based EPG.

[0244] FIG. 120C shows an example of displaying content on a DMXEPG using an ME.

[0245] FIG. 120D shows another example of displaying content on a DMXEPG using an ME.

[0246] FIG. 121A shows another example of displaying content on a DMXEPG using an ME.

[0247] FIG. 121B shows another example of displaying content on a DMXEPG using an ME.

[0248] FIG. 122 shows a diagram describing process of encapsulation of VOD program metadata into DMXEPG metadata.

[0249] FIG. 123 shows a system that merges metadata for programs supplied by multiple digital TV service providers.

[0250] FIG. 124 shows a system that allows subscribers to select channel auto merge or perform manual channel merge for channels delivered over multiple networks.

[0251] FIG. 125 shows an example display of channels in a user defined channel map list and a display of channels in a default channel map list illustrating manual merging of channels delivered over multiple networks.

[0252] FIG. 126 shows a new channel, from the default channel list, added to the user defined channel map list.

[0253] FIG. 127 shows how a subscriber can tune to the desired channel using channel name (for example CNN, HBO, etc) or its nmemonic representation using telephone keypad-letter association.

[0254] FIG. 128 shows a set top box with the application that can utilize more than one display for video output, graphics output, or their combination.

[0255] FIG. 129 shows a digital TV set with the application that can utilize more than one display for video output, graphics output, or their combination.

[0256] FIG. 130 shows a set top box that runs two applications each of which is using separate display for video output, graphics output, or their combination.

[0257] FIG. 131 shows a digital TV set that runs two applications each of which is using separate display for video output, graphics output, or their combination.

[0258] FIG. 132 shows a set top box that runs two applications each of which is using a portion of multiple displays for video output, graphics output, or their combination.

[0259] FIG. 133 shows a digital TV set that runs two applications each of which is using a portion of multiple displays for video output, graphics output, or their combination.

[0260] FIG. 134 shows an example of a multi-screen application for a set top box where the Mosaic portion is directed by a DMXEPG application to the Video/Data Output 1 (Secondary Display) and the Full screen Video stream is directed by a DMXEPG application to the Video/Data Output 2 (Primary Display).

[0261] FIG. 135 shows an example of a multi-screen application for a digital TV set where the Mosaic portion is directed by a DMXEPG application to the Video/Data Output 1 (Secondary Display) and the Full screen Video stream is directed by a DMXEPG application to the Video/Data Output 2 (Primary Display).

[0262] FIG. 136 shows an example of a multi-screen application for set top box where the EPG is directed to the Video/Data Output 1 (Secondary Display) and the Full screen Video stream is directed by application to the Video/Data Output 2 (Primary Display).

[0263] FIG. 137 shows example of multi screen application for set top box where the EPG is directed to the Video/Data Output 1 (Secondary Display) and the Full screen video clip for future program is directed by application to the Video/Data Output 2 (Primary Display).

[0264] FIG. 138 shows logical structures of a DMXEPG for multiple displays.

[0265] FIG. 139 shows another example of logical structures of a DMXEPG for multiple displays.

[0266] FIG. 140 is a diagram illustrating an example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0267] FIG. 141 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0268] FIG. 142 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0269] FIG. 143 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0270] FIG. 144 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0271] FIG. 145 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0272] FIG. 146 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0273] FIG. 147 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0274] FIG. 148 is a diagram illustrating another example system for a multi-display DMXEPG application implemented with a touch sensitive display.

[0275] FIG. 149 shows a remote control that allows subscribers to change focus from one display to another for multi-display applications.

[0276] FIG. 150 shows a system diagram of a digital TV set or set top box which enable applications with multi-display functionality.

[0277] FIG. 151 shows a system diagram for a touch screen display that can be used with systems that support multi-display DMXEPG.

[0278] FIG. 152 shows system diagram of a digital TV set or set top box utilizing touch screen display for multi-display DMXEPG or other multi-screen applications.

[0279] FIG. 153 shows DMXEPG screen displayed in three dimensions.

[0280] FIG. 154 shows DMXEPG screen displayed in three dimensions.

DETAILED DESCRIPTION OF THE INVENTION

[0281] Following is a lexicography of terminology used in this specification:

[0282] Select buttonSTB remote control button shown on some remote controls as Select, or OK, or Enter, or under other equivalent name

[0283] DMXEPGDynamic Mosaic Extended Electronic Programming Guide

[0284] Focushighlighted or otherwise emphasized screen element

[0285] iTVinteractive television. Any content that involves subscriber input and provides response to that input

[0286] MEMosaic Element

[0287] MECMosaic Element Component

[0288] pressing a buttonthe specification discloses a conventional button-based remote control device. However, any suitable control device is contemplated, and it need not necessarily contain buttons which are pressed. It is understood that all references herein to pressing a button refers to activating an action, whether by actual button press or some other action; e.g., a voice command.

[0289] Programany show or event transmitted over a channel

[0290] Service Providerentity that offers video services over cable, satellite, terrestrial digital, video over internet, IPTV, fiber, or other types of infrastructure.

[0291] STBset top box. When applicable, STB may be used as a substitute for the terms Subscriber Device or Client Device. The STB is a device which allows service subscriber to receive and decode digital stream.

[0292] VODvideo-on-demand. Service that allows a subscriber to start chosen video program stored by the service provider. Term VOD is also used to substitute term COD (content-on-demand). COD may or may not include video in addition to a combination of audio, interactive, graphical, or any other type of transmittable content.

[0293] MTVSSMatrix TV Server Suite

[0294] Tuner-system module that allows to filter desired program stream. For example, program stream can be transmitted over RF network; it can also be transmitted over digital packet delivery network, like Internet.

[0295] Following is a list of the reference numerals used in FIGS. 1-127 of the specification:

TABLE-US-00001 Number Description 1 Full screen video 2 Clipped video source 3 Video processor 4 Mosaic element processed for insertion into DMXEPG 5 Mosaic element inside DMXEPG 6 Headend generated DMXEPG video stream 7 Remote control 7a Arrow Up button 7b Arrow Down button 7c Arrow Left button 7d Arrow Rjght button 7e Zoom in button 7f Zoom out button 7g Select button 7h Info button 8 Display device 9 DMXEPG application screen (video and graphics) displayed on 10 Generic Mosaic Element (Video, Picture, Application, etc. see FIG. 5) that is in focus 11 Video feed scaled by the client device 12 Full screen video on a client device 13 Digital TV headend 14 Client video source (DVD, VCR, Camcorder, etc.) 15 Video input in the client device 16 DVR or PVR video decoder 17 Digital video decoder 18 Video tuner (digital I analog) 19 RF Splitter 20 RF Switch 21 Microprocessor 22 Mosaic Application Memory 23 RF input 24 Video Processor (Scalier) 25 Video Processor Combiner 26 Client device (e.g., STB/Media center, Digital television system module, video processing card in a PC, any portable wireless device such as a PDA or a cell phone, and so on) 27 Graphic component of the DMXEPG application 28 Interactive Application Canvas (Partial Screen) 29 DMXEPG Screen Title 30 Interactive Application Canvas (Full Screen) 31 Original DMXEPG video feed with aspect ratio 4x3 32 Original DMXEPG video feed with aspect ratio 16x9 33 Original DMXEPG video feed with aspect ratio MxN 34 ME with aspect ratio 4x3 35 ME with aspect ratio 16x9 36 ME with aspect ratio MxN 37 Background 38 DMXEPG video stream on display 39 Screen Title (also referred to as Screen name) 40 Current Time 41 Screen branding area 42 ME with the IDLE focus 43 The Show/program title bar 44 The Show/program title bar which is belongs to the focused mosaic 45 Show/program description 46 The sign to show ability to scroll description information 47 Screen title 48-50 (unused) 51 MECHE 52 MEC STB 53 MEC video loop 531 MEC audio loop 54 MEC image 55 MEC Application 56 MEC link to the Application 57 MEC link to the video program chosen by_a subscriber 58-59 (unused) 60 ME video (HE or STB) 61 ME picture 62 ME Application 63 ME Game (may include any combination of 51, 52, 53, 531, 54, 55, 64 ME Entry to the Games or Game Categories list 65 The Game title bar 66 The game title bar belongs to the focused Game Mosaic Element 67 ME Game in PAUSE state 68 ME Game Category (may include any combination of 51, 52, 53, 531, 54, 69 The Game Category screen title, which includes name of the game category and branding area. 70 ME Program/show/event (may include any combination of 51, 52, 53, 531, 71-79 (unused) 80 ME-entry to the Program Browser Mosaic for specific category (may include combination of 51, 52, 53, 531, 54) 81 ME Link to the application 82 ME link to the channel browser 83 ME link to the VOD programs browser 84 ME link to the PVR recorder program browser or to the Programs 85 Creping line 86 ME: headend generated video 87 ME: STB generated scaled video 88 Generic Mosaic Element in the focus in the DESCRIPTION (info) 89 Sign PLAY, which is indicates that user may play scaled/full screen video for this mosaic element (video loop is stored on STB HD or on the VOD server) 90 Non-broadcast program video-on-demand (VOD1 91 Non-broadcast program. Program is recorded by PVR. This program belongs to the selected program category (KIDS) 92 Infomercial title 93 ME: Infomercial 94 The Title of the program, which is belongs to the selected channel 95 The Title of the currently broadcasted program, which is belongs to the selected channel 96 Infomercial description 97 ME, which is in LOST focus, focus on the listings line 98 The title of the program in the focus 99 Program description :ME with the focus on it 100 The Title of the program for specific channel 101 The Title of the program for the focused :ME 102 Programs Grid 103 ME, which is an entry to the specific VOD category 104 Sign on the program title bar, which indicates that this program or similar programs are available on VOD system 105 EPG National Meta Data Server 106 EPG Local Meta Data Server 107 Local VOD Assets server 108 EPG data encapsulator

[0296] Following is a list of the reference numerals used in FIGS. 128-152 of the specification:

TABLE-US-00002 Numbe Description 1 Display device 2 The screen of the display device 3 Generic input for video and/or data Composite AudioNideo Input DVI 1.0 Digital HDTV input with HDCP Copy Protection IEEE 1394 Digital Input with 5C copy protection USB input WIRELESS connection 4 Generic output for video and/or data: Composite AudioNideo output DVI 1.0 Digital HDTV output with HDCP Copy Protection IEEE 1394 Digital output with 5C copy protection USB output WIRELESS connection 5 a client device (e.g., STB/Media center, Digital television system module, video processing card in a PC, any portable wireless device such as a PDA or a cell phone, and so on) 6 Video/Data connection for the wired implementation or video/ data flow for wireless connection 7 Remote control receiver device 8 Remote Control device 9 Interactive Application Canvas (Partial Screen) 10 Generic Mosaic Element in focus 11 Generic Mosaic Element 12 Full Screen Video 13 Program Title bar in focus 14 Program Title bar 15 Program Description 16 Channel Name and channel number indicator 17 The current time indicator 18 Button Display1 on the remote control 19 Button Display2 on the remote control 20 Interactive Application 21 The instance on DMXEPG application. 22 The HScreen instance 23 The HScreenDevice objects, instances of HGraphicsDevice class 24 The HScreenDevice objects, instances of HGraphicsDevice class 25 The HScreenDevice object, instance of HBackgroundDevice class 26 The screen area of the touch screen display device 27 The SCROLL button2 28 RF input/connection to the STB/Digital TV/Media center 29 Screen Title 30 Touch screen video device 31 CLEAR button 32 MOVE/REMOVE button 33 Arrow UP button (PAGE) 34 HOME button 35 Arrow DOWN (PAGE) button 36 INFO button 37 MUTE button 38 Microprocessor 39 Application memory 40 Tuner 41 Combiner of the Video Processor 42 RF Splitter 43 Tuner 44 Video decoder 45 Video Processor-video scale 46 DVR's Hard Drive 47 Cable, Satellite, IPTV, Terrestrial, or other digital TV Headend 48 Generic video processor 49 Touch screen display 50 Touch screen user input analyzer device 51 Graphics Processor

[0297] Aspects of a user interface in accordance with the present invention are explained in detail in the illustrative embodiment of the present invention disclosed below relating to electronic program guides for accessing broadcast content. It will be appreciated by one of ordinary skill that any type of content can be accessed using a user interface that incorporates the various elements disclosed hereinbelow.

[0298] FIG. 1 is a DMXEPG main page (an EPG screen) which, in accordance with the invention, displays multi-dimensional UI with dynamically assigned programs, iTV applications, video loops, icons, sound, pictures or any other content components to each ME taking into consideration service provider infrastructure and subscriber STB capabilities, business rules of service provider; business rules of a broadcaster; customer profile: geographic location, time of the day in the location, past personal preferences; channel metadata, program properties, and other program or subscriber relevant data. Subscriber can observer multiple video streams displayed on the screen and navigate the screen by changing the focus from any one displayed object to another displayed object. For the subscriber, a change in focus is indicated by visual or audio elements; for example, a beeping noise can be emitted, and visual cues such as blinking or highlighted outlines can be presented. Once in focus, ME enables audio for the corresponding program and gives the ability to the subscriber to trigger predefined response once the subscriber presses Enter on the remote control or STB.

[0299] Returning to FIG. 1, the DMXEPG main page can accommodate various numbers and sizes of displayed MEs. Program types that are assigned to the MEs can be added, removed, or relocated. The number of programs assigned to one ME and their rotation schedule. Changes to the DMXEPG main page can be triggered by time of the day, day of the week, week of the month, etc., special events, or other program or business criteria.

[0300] FIG. 1 shows the MEs as rectangle-shaped elements. However, it is possible to use other shapes for the MEs; e.g., circular MEs, elliptical, other polygonal shapes, combinations of various shaped MEs, and so on. However, for the specification, rectangle-shaped MEs will be discussed.

[0301] FIG. 2 is DMXEPG second or lower level screen which, in accordance with the invention, comprises dynamically assigned MEs. This means that each ME is assigned to a program that matches predefined content category while taking into consideration criteria such as program properties, business rules of the service provider, business rules of a broadcaster, customer profile, and preferences. Similarly to DMXEPG main screen, a subscriber can navigate the page, change focus from any to any screen elements and by pressing Enter on the remote control or STB, thus triggering predefined response. Such response includes display of a lower level DMXEPG screen; launch of iTV application; tuning to a channel; switch of audio channel; display of the text synchronized with audio track (closed captioned or subtitles); information for the current or the next program, or other predefined action.

[0302] FIG. 3 is multi-dimensional DMXEPG which, in accordance with the invention, enables a subscriber to view and select ongoing programs which are grouped, among other criteria, by content category, thus simplifying and expediting a task of identifying, viewing, comparing, and selecting one of desired programs. The system is capable of dynamically generating necessary number of DMXEPG levels to expose to subscribers some or all programs in a content category and satisfy business and technical objectives of broadcaster and service provider.

[0303] FIG. 4 is DMXEPG arranged in two levels DMXEPG screen of the first level displays content categories and matched video feeds. Subscribers by moving focus on the screen switch corresponding audio and by pressing Enter view larger number of video feeds that match content category in the DMXEPG second level screen. There, by pressing Enter on focused ME subscribers may leave DMXEPG and trigger STB to tune to a channel which is carrying currently displayed program.

[0304] FIG. 5 shows the composition of an ME. Each ME can include any number of the following components (each component being referred to as media content, or simply content): video program selected by the service provider; video channel chosen by a subscriber; video program chosen by a subscriber; video loop from broadcast stream, RAM, or hard drive; image; service provider or subscriber chosen iTV application as well as a link to iTV application. When applicable, an ME can includechannel number, program name, program status bar which displays program remaining time. When permitted by STB or service provider infrastructure (for example dual tuner STB or VOD system) subscriber can select channel assigned to the ME.

[0305] FIG. 6 shows a DMXEPG that was generated in the morning hours. The figure shows that the DMXEPG matches most common subscriber program preferences or service provider or broadcaster business objectives. On the other hand, FIG. 7 shows a DMXEPG generated in the evening hours which matches most common subscriber program preferences or service provider or broadcaster business objectives. As can be seen between FIGS. 6 and 7, the same level DMXEPG screen has different program composition in the morning and evening hours.

[0306] FIG. 8 shows a DMXEPG screen configured with peripheral MEs of different sizes. A subscriber moves the focus to a desired peripheral ME, presses Select or its equivalent button on the remote control or STB and a larger ME in the center of the display switches its video program and its audio to the program that matches the in-focus ME. This capability is possible on STBs with two or more tuners or on an infrastructure that supports a VOD System.

[0307] FIG. 9 is a DMXEPG screen similar to the screen in FIG. 8, but for a configuration where the STB has only one tuner and where there is no VOD system. In this configuration, the service provider assigns a program to the center ME. When the focus is changed from one peripheral ME to another, only the audio can be switched. The Select button allows subscriber to switch to the next DMXEPG level or to tune to desired program.

[0308] FIG. 10 is a DMXEPG screen comprising some MEs which display programs assigned by the service provider and other MEs which display channels or iTV applications selected by the subscriber. This functionality can be provided by an STB with multiple tuners or by a VOD system.

[0309] FIG. 11 is a DMXEPG screen which is generated with 16 peripheral MEs. The number of displayed MEs and their location was generated by the system which takes into account number of available programs that match selected content category, iTV applications and favorite channels selected by subscriber, TV screen size and resolution.

[0310] FIG. 12 is a DMXEPG screen which is generated with 9 peripheral MEs. The number of displayed MEs and their location was generated by the system which takes into account number of available programs that match selected content category, iTV applications and favorite channels selected by subscriber, TV screen size and resolution.

[0311] FIG. 13 is a DMXEPG screen which is generated with 5 peripheral MEs. The number of displayed MEs and their location was generated by the system which takes into account number of available programs that match selected content category, iTV applications and favorite channels selected by subscriber, TV screen size and resolution.

[0312] FIG. 14 is a DMXEPG screen with some MEs having association to more than one iTV application. Pointer to iTV applications can be assigned by the service provider and by subscriber. Multiple iTV applications assigned to an ME are displayed one at a time and can rotate at preset or default time interval. Subscriber can link any accessible iTV application to desired ME.

[0313] FIG. 15 is a DMXEPG screen showing the case when some MEs are set to display programs that match screen content criteria but fail subscriber parental rating limit. In such a case, subscriber has an option to enter PIN code to let a DMXEPG client application remove overlay and display programs that fail parental rating limit. If subscriber does not enter correct PIN code, programs that exceed parental rating limit will continue to be blocked. MEs with blocked programs can be overlaid with static on-screen display (OSD) image. The DMXEPG client application allows the user to navigate the DMXEPG hierarchy (e.g., as shown in FIG. 3) on the client device.

[0314] FIG. 16 is a DMXEPG screen showing the case when video or audio content that is removed from some MEs; for example as a result of blackout properties using head end's conditional access information (sports events can be blacked out). The Matrix SuperSplit server discussed below can dynamically replace a program marked as blackout by another program. Alternatively, Interactive Mosaic Client Application may use static OSD image or text to indicate cells with blackout properties or mark ME and disallow subscriber to set focus to that cell.

[0315] FIG. 17 is a DMXEPG screen showing the case when video or audio content is removed by the DMXEPG client application from the MEs because subscriber has not been authorized to access that channel. Service provider can choose to disallow subscriber to set focus to the ME for the duration of program on non-authorized channel, or corresponding audio.

[0316] FIG. 18 is a conventional DMXEPG with channels statically assigned to its MEs. The channels assigned to the DMXEPG are shown below, illustrated in a conventional programming guide format. Each ME represents a channel and not a program. ME association to the channel does not change for the extended period of time. Each DMXEPG screen displays semi-permanent group of channels.

[0317] FIG. 19 is an example of a schedule for a DMXEPG screen composition according to an aspect of the present invention with its MEs being assigned and reassigned to different channels to match service provider or broadcaster business rules. For explanatory purposes, the schedule of channels that are assigned to this DMXEPG screen are illustrated below the DMXEPG screen in conventional programming guide format.

[0318] FIG. 20 is an example of schedule for DMXEPG screen composition according to an aspect of the present invention with its MEs being assigned and reassigned to different channels with programs that match pre-defined content category for that ME. For explanatory purposes, the schedule of channels that are assigned to this DMXEPG screen are illustrated below the DMXEPG screen in conventional programming guide format.

[0319] FIG. 21 is an example of a DMXEPG that incorporates an iTV application in one ME. To prevent screen's burnout, iTV data is rotated, and it positioning is continuously changed. If a subscriber selects an ME to which an iTV application is assigned, additional information related to that iTV application can appear on a creeping line. Also, to prevent screen burnout information in the creeping line is rotated among application or disappears after timeout.

[0320] FIG. 22 is a DMXEPG page with one of its ME allocated to a group of iTV applications. iTV applications share an ME's space and rotate, appearing one at a time for pre-set time interval.

[0321] FIG. 23 is a head-end data flow through MTVSS. MTVSS gets raw EPG data from an EPG listings data provider (e.g. Tribune Media Services, TV Guide, or TV-Anytime). Available data delivery mechanisms include downloading from an FTP site, a Virtual Private Network, or a Data Broadcast Carousel. MTVSS imports raw EPG data into the MTVSS database. In most cases, EPG listings data provider supplies accurate data, which includes local programming, for 14 days.

[0322] MTVSS filters all programs by program category, subcategory, and genre. The figure depicts filtering by program subcategory CARTOONS. As a result of this data processing, system creates record set of all programs during the next 14 days across multiple channels (uniquely identified by source_id) and multiple head-ends (cable, satellite, or other) with the subcategory CARTOONS.

[0323] MTVSS will process data set made during step 233 and generate Interactive Mosaic channel insertion schedule for all channels that includes CARTOONS programs across multiple head-ends. MTVSS will generate schedule for short period (e.g. 1 day), because EPG schedule might dynamically change even inside 14 days windows.

[0324] On the local head-end MTVSS will apply (step 235) the local channel lineup, local business rules (e g channel priorities, non-video interactive mosaic element components), local conditional access rules (e.g. program rating, blackout), last-minute listings update data.

[0325] After step 235, MTVSS will generate real-time insertion schedule 236 for CARTOON programs which are broadcasted on this local head-end.

[0326] FIG. 24 shows logical components of the MTVSS. EPG listings data aggregator server 241 provides data to the Matrix Meta Data Server (MMDS). Daily, EPG data server refreshes data set and provides listings data for the next 14 days. The daily data set is the most accurate for the next day. There are two ways to retrieve the data: data push and data pull. For example Tribune Media Services (TMS) provides the pull method using their secure FTP site. To get data from TMS, MMDS uses a secure ftp connection to retrieve EPG listings data.

[0327] Matrix Remote Monitoring Terminal (MRMT) 242 is a web based interface that allows a system operator to access MTVSS. Once authenticated, the system operator accesses tasks and processes enabled by his security level. The system operator can perform a number of functions including: retrieval of Matrix Meta Data Server status, retrieval of Matrix Scheduler status, retrieval of Matrix SuperSplit status, and retrieval of logs, traces, and statistics for all MTVSS components. Matrix remote management portion of MRMT is a web based interface that allows the system operator to access MTVSS. Depending on granted permissions, the system operator can manage specific tasks and processes. The system operator can perform the following functions: start and stop any process on any MTVSS component, update configuration parameters for any MTVSS component.

[0328] Matrix Meta Data Server 243 comprises four components: Data Delivery Manager, Data Translation Manager, Data Cache Manager, and Matrix National resolution EPG database. [0329] Data Delivery Manager (DDM) is designed to retrieve EPG data from data aggregator server and store data in the local database. Data Delivery Manager can be customized with configuration file which includes data delivery schedule and secure connection login parameters (e.g. secure ftp connection). DDM can deliver data from multiple data sources (e.g. Tribune Media Services, TV Guide, TV-Anytime). [0330] Data Translation Manager (DTM) translates and converts original EPG data using Data Translation Plug-ins (DTP). DTM may support multiple DTPs for different EPG data providers (e.g. one for TMS, one for TV Guide, etc.). [0331] Data Cache Manager provides database interface for all MMDS tasks. [0332] Matrix National resolution EPG database stores original EPG data (retrieved from EPG aggregation server) and data translated to the Matrix Meta Data database. This database stores the channel lineup for all service providers in a region.

[0333] Matrix Scheduler (MS) 244 receives and retrieves the following data: [0334] Matrix Local resolution EPG database data (for specific head-end, or set of head-ends) from Matrix Meta Data Server. [0335] Additional conditional access data (e.g. program rating, program blackout, etc.) fromlocal digital access controller (e.g. DAC 6000Motorola head-end, DNCSScientific Atlanta head-end, DCAS server). [0336] Last minute program update data from EPG listings update terminal 245 [0337] Enhanced data and Interactive Application insertion Terminal (EIAT) 247. EIAT provides data for all mosaic element components except video program selected by service provider e.g.: [0338] Images [0339] Video loops [0340] Audio loops [0341] Interactive applications [0342] Still images [0343] Texts [0344] Interactive advertisement [0345] Content Filtering Criteria received from either service provider or third party.

[0346] Matrix scheduler comprises five major components: Local Headend Configuration Manager, STB Mosaic Gill Configuration Manager, DMXEPG Application Configuration Manager, Mosaic Meta Data generator, and Matrix Local resolution EPG database importer. Local Headend Configuration Manager is designed to apply local technical (e g channel lineup, MPEG2/DCII SI/PSIP tables configuration) and business rules (e g channel assignment priority) to the final program mosaic video stream and mosaic meta data. STB Mosaic Gill Configuration Manager allows a service provider to configure the graphical user interface and provides navigation for the DMXEPG Client application.

[0347] Mosaic meta data generator builds Interactive Mosaic descriptor, Interactive Mosaic Master Table, control and scheduling data for the Matrix SuperSplit, and additional mosaic meta data discussed in more detail below. Matrix Local resolution EPG database importer stores EPG listings data in the local database.

[0348] Real time or manual EPG listings update terminal 245 is a web based interface that allows system operator to update EPG listings data on local and national head-end before broadcasting.

[0349] Matrix Scheduler Configuration terminal 246 is a web based interface that allows system operator to configure program mosaic video stream, DMXEPG Client Application, insert local technical information, insert local business rules, and assign mosaic element components (FIG. 5) to the different mosaic elements.

[0350] Enhanced data and Interactive application Insertion terminal 247 is a web based interface that allows system operator to insert/assign mosaic element components (FIG. 5) to the Interactive mosaic. Matrix SuperSplit (MSS) 248 is a real time digital video processor which can: [0351] Tune to the scheduled channel and program using Matrix Scheduler control information [0352] Compose mosaic video stream [0353] Compose mosaic audio stream [0354] Encapsulate Interactive Mosaic private data [0355] Encapsulate modified Service Information tables

[0356] The MSS receives: [0357] private interactive mosaic tables descriptors, mosaic element components scheduling data (for example, which broadcasted video program should be inserted in the final mosaic video stream) from Matrix Scheduler [0358] additional mosaic element components content (e.g., video/audio loops) from Enhanced data and Interactive application Insertion terminal 247 [0359] video feed which includes all channels sent by service provider

[0360] The MSS composes the fmal mosaic digital stream which comprises: [0361] Mosaic video stream [0362] Multiple audio streams, if applicable [0363] DMXEPG Client Application, if applicable [0364] Modified Service Information Data (E.g. PMT, SDT, CVT), if applicable [0365] Private Interactive Mosaic tables and descriptors [0366] QAM/upconverter 249 (or its IPTV equivalent) modulates Matrix SuperSplit output [0367] RF combiner 2410 (or its IPTV equivalent) combines original video feed with the Interactive Mosaic Virtual channel.

[0368] FIG. 25 is an algorithm to minimize or eliminate TV screen burnout caused by an interactive mosaic which may comprise a number of static graphics elements like non-video mosaic element components, mosaic screen background, and mosaic screen creeping line. To prevent TV screen burnout, system uses any combination of following rules and actions: [0369] For non-video mosaic components (e.g. image, text, application): [0370] Dynamically change position of the mosaic element with the non-video mosaic component. In this case we have to regenerate mosaic video feed by MSS 248 and interactive mosaic private tables/descriptors by MS 244. [0371] Dynamically rotate multiple non-video mosaic components, using transition effects (e.g. rotate weather application and market stock application) [0372] Dynamically change text/images positioning inside static mosaic element [0373] For Mosaic screen background: [0374] try do not use gaps between video cells [0375] Dynamically change mosaic screen background [0376] Use transition effects during background image update [0377] Use intelligent timeout for mosaic creeping line

[0378] FIG. 26 and FIG. 27 show ways to activate the DMXEPG Client application (DMXEPG-C). The DMXEPG-C can be downloaded to the STB RAM memory via any available transport mechanisms: [0379] In band data carousel (e.g. DSMCC) [0380] In band private tables or message (MPEG2private section, DCIItext message) [0381] VBI data [0382] Return path interactive channel [0383] Out of band data carouse [0384] Out of band private messaging

[0385] DMXEPG-C also can be stored in the available medium such as flash memory, hard drive, or another STB's persistent storage as STB's resident application. There are two scenarios to activate DMXEPG-C, depending on its location. FIG. 26 shows activation process when DMXEPG-C is downloaded to the box after subscriber tunes to the mosaic channel. FIG. 27 shows activation process when DMXEPG-C is stored in the STB persistence storage.

[0386] FIG. 28 shows a relation between standard MPEG2 transport tables and additional private Interactive Mosaic Tables and descriptors. Following is a discussion of the descriptors and tables showing an example of the syntax for Interactive Mosaic Descriptor and Interactive Mosaic Master Table.

Interactive Mosaic Private Tables and Descriptor MPEG 2 Private Section)

[0387] The interactive mosaic descriptor can be located in the following MPEG 2/ATSC SIIPSIP/DVB SI tables: [0388] ATSC PSIP: [0389] Virtual Channel Table (VCT) [0390] Satellite_virtual_channel( )descriptors loop [0391] SMATV_virtual_channel( )descriptors loop [0392] Broadcast_virtual_channel(}descriptors loop [0393] Virtual_channel( )descriptor loop [0394] DVB SI [0395] Service Description Table (SDT)-descriptors loop [0396] MPEG2 [0397] Program Map Table (PMT) [0398] TS_program_map_secition( )program_info descriptor loop

[0399] A digital program which carries interactive mosaic can include the interactive mosaic descriptor inside its Program Map section in the program information descriptors loop.

TABLE-US-00003 TABLE 1 Syntax of private Interactive Mosaic Descriptor Syntax Bits Bytes Mnemonic Interactive mosaic descriptor( ){ Descriptor tag 8 uimsbf Descriptor length 8 1 uimsbf For G=O; j<N table ids; j++){ MatrixTV table id 8 uimsbf } }

TABLE-US-00004 TABLE 2 MatrixTV table id values MatrixTV Matrix TV data stream OxDO Interactive Mosaic Master Table OxD1 Interactive Mosaic Resources Table OxD2 Interactive Mosaic Applications Table OxD3 Reserved OxD4 Reserved

TABLE-US-00005 TABLE 3 Syntax of Interactive Mosaic Master Table (IMMT) Syntax Bits Bytes Mnemonic Interactive mosaic master table( ){ Table id (see table 1) 8 1 Uimsbf Section syntax indicator 1 bslbf Reserved future use 1 Bslbf Reserved 2 Bslbf Section length 12 2 Uimsbf Table id extension 16 2 Uimsbf Reserved 2 Bslbf Version number 5 Uimsbf Current next indicator 1 2 Bslbf Section number 8 1 Uimsbf Last section number 8 1 Uimsbf Interactive mosaic entry_level 1 Bslbf Reserved 7 2 For(i=O:i<N:i++)f mosaic element id 8 Uimsbf mosaic element type 4 Uimsbf Mosaic cell record length 12 2 Uimsbf On left key_press mosaic element id 8 1 Uimsbf On right key press mosaic element id 8 1 Uimsbf On up key press mosaic element id 8 1 Uimsbf On down key press mosaic element id 8 1 Uimsbf Horizontal offset 14 Uimsbf Horizontal size 14 Uimsbf Vertical offset 14 Uimsbf Vertical size 14 7 Uimsbf Mosaic element components count 8 1 Uimsbf ForG=O;j<mosaic component components If( mosaic component components Repeat fla 1 Bslbf If(repeat flag =O){ Start time 32 4 Uimsbf } Duration in seconds 15 2 Uimsbf } mosaic element component * ((*)) } }

TABLE-US-00006 TABLE 4 Syntax of mosaic element component descriptor Syntax Bits Bytes Mnemonic mosaic element component Descriptor tal!; 8 1 uimsbf If(descriptor tag == 0x01){ Video steam locatorO * CA descriptorO * } If(descriptor tag == Ox02){ Audio stream locatorO * CA descriptorO * } If(descriptor tag= Ox03){ Video loop_ locatorO * CA descriptorO * } If(descriptor tag= 0x04)_{ Audio loop_ locatorO * CA descriptorO * } If(descriptor tag == Ox05){ Still picture locatorO * } If(descriptor tag= Ox06){ Ima ?;e locatorO * J If(descriptor tag= Ox07){ Application locatorO * } If(descriptor tag= Ox08){ Private data locatorO * } }

[0400] The resource locators' descriptors and Interactive Mosaic Resources Table and Interactive Mosaic Application Table are protocol/transport depended (may be one for DVB SI, one for ATSC PSIP, one for OCAP, one for DSMCC).

[0401] FIG. 29 shows local and national MTVSS configurations. MTVSS have three configuration options: National-1 (MTVSS-N1), National-2 (MTVSS-N2), and Local (MTVSS-L).

[0402] a) MTVSS-Nl 291 generates local real-time program insertion schedule in the national network operation centre (NNOC) and delivers the data to the local Matrix SuperSplit server(s), which generates DMXEPG screens.

[0403] b) MTVSS-Nl 292: local video stream generates by the Matrix SuperSplit server(s) located in NNOC. This option has better scalability because it does not require any changes on a local head-end where DMXEPG screens are delivers over existing digital TV infrastructure.

[0404] c) MTVSS-L 293 generates local real-time program insertion schedule using local Matrix Scheduler Server(s) and delivers the data to the local Matrix SuperSplit server(s), which generates DMXEPG screens.

[0405] FIG. 29a shows MTVSS configurations for DMXEPG screen implementation on client device. MTVSS implementation in 294 comprises a Matrix Scheduler as part of service provider backend. That configuration allows service provider to control ME mosaic element presentation criteria.

[0406] The MTVSS implementation in 295 consists of Matrix Scheduler as part of subscriber device. That configuration allows subscriber or third party to control ME mosaic element presentation criteria. The criteria service provider can be any third party that provides mosaic element presentation criteria that is used by the Matrix Scheduler. The criteria service provider can be the manufacturer of the client subscriber device. The criteria service provider can be the subscriber. In the general case, the mosaic element presentation criteria may comprise criteria from any combination of third party providers, the manufacturer, and/or the subscriber.

[0407] Mosaic element presentation criteria can be delivered using any suitable delivery medium including an Internet connection, a dial-up service, over the airwaves, satellite link, cable link, and so on. The subscriber can be provided with criteria on a CD that can be installed in the subscriber device.

[0408] FIG. 30 shows remote control which, in accordance with the invention, incorporates rotating element which can be used by subscriber to simplify navigation of DMXEPG or any iTV application. Subscriber can manipulate the rotating element by rotating it up or down, as well as pushing it toward or away from himself, or depressing it into the remote control, or finally releasing it after it has been depressed into the remote control. STB maps movements of the rotating element with the DMXEPG or iTV application functions.

[0409] FIG. 31 shows how to virtually increase the size of the video or visual program displayed in an ME since the ME size can be too small to show the entire video in a discernable manner. To solve the problem, the video or visual program can be virtually expanded by clipping less critical area around the center of the video and stretching the remaining video to fill in a ME. The figure shows clipping to extract a central portion of the video. The user can clip other regions of the video to extract portions of the video other than the central portion.

[0410] Numerous combinations of aspect ratios of video sources and aspect ratios of the display area are possible. Typical combinations include: [0411] a 169 video source converted to a 43 ME [0412] a 43 video source converted to a 169 ME [0413] a 169 or a 43 video source converted to an ME of non standard aspect ratio.

[0414] To virtually increase the size of the video, it is necessary to clip a percentage of the original video feed (which is usually lost because of TV overscan) and scale it to the size and aspect ratio of the target ME. As shown in FIG. 31, the video is clipped to produce a clipped video source. The clipped video source is then expanded (scaled up, sized up, etc.) and incorporated into the target ME. The figure shows the original video has a 43 aspect ratio and the target ME has a 43 aspect ratio. The clipped video source therefore has a 43 video source.

[0415] FIG. 32 shows clipping for an original video source having a 43 aspect ratio that is targeted for an ME that has a 169 aspect ratio. The clipping is performed with a rectangle having an aspect ratio of 169 s the video can be scaled up to fit the target ME without distorting the original video.

[0416] To further illustrate this clipping aspect of the present invention, FIG. 33 shows clipping for a 43 original video source (i.e., its aspect ratio is 43) to fit into a target ME having a non-standard aspect ratio. FIG. 34 clipping for a 169 original video source to fit a 169 ME (i.e., its aspect ratio is 169). FIG. 35 clipping for a 169 original video source to fit a 43 ME. FIG. 36 shows clipping for a 169 to fit a non-standard ME.

[0417] FIGS. 37-44 show that a subscriber can zoom in on an ME that is in focus. FIG. 37 shows how a subscriber can expand the size of a 43 ME (i.e., its aspect ratio is 43) that is in focus including the video displayed in it to a larger (zoomed in) 43 ME. This operation is done by a second tuner connected directly or indirectly to the display, and is performed when the user activates a control to perform zooming. For example, the figures shows zoom in button on a remote control that can be used to activate zooming in. The original aspect ratio of ME may or may not be preserved in the expanded ME. For example, FIG. 37 illustrates an example where the aspect ratio is preserved when zooming is performed on the ME in focus.

[0418] Other aspect ratios can be accommodated. FIG. 38 shows zooming in of a 43 original ME to an expanded ME having a 169 aspect ratio. FIG. 39 shows zooming in of a 169 original ME to a 169 enlarged ME. FIG. 40 shows zooming in of a 169 original ME to a 43 enlarged ME. FIG. 41 shows zooming in of a 169 original ME to a non-standard zoomed-in ME (i.e., the ME has a non-standard aspect ratio). FIG. 42 shows zooming in of a 43 original ME to a non-standard zoomed-in ME (i.e., the ME has a non-standard aspect ratio). FIG. 43 illustrates a configuration where the in-focus ME has a non-standard aspect ratio where zooming results in a 43 expanded ME, while FIG. 44 shows an 169 expanded ME.

[0419] FIG. 45 illustrates that the subscriber can further expand the size of the zoomed-in ME to a full-screen video. This action can be activated by an additional press of the zoom-in button on the remote control. The full-screen video may take on the aspect ratio of the display, or take on its original aspect ratio as broadcast.

[0420] FIGS. 46 and 47 show that the subscriber can reverse the series of zoom-ids by zooming out. This action is activated by pressing the zoom-out button on the remote control. FIG. 46 shows that a full-screen display can be reduces to its previous state (size) which is the expanded ME. A further activation of the zoom-out button will cause the expanded ME to return to its original size, as illustrated in FIG. 47.

[0421] FIG. 48 shows the use of the SELECT button to expand the size of ME and bring it back to it original state. By repeated activation of the SELECT button, the in-focus ME can cycle from original size, then to expanded size, then to full-screen size as shown in the figure. Further activation of the SELECT button may restore the video in reverse order. Thus, the full-screen size is reduced to the expanded ME, then to the original-sized ME with another press of the SELECT button.

[0422] FIG. 49 shows an alternative embodiment of FIG. 48. When the video is displayed in full-screen mode, the press of the SELECT button returns the video to the original-sized ME. This may be preferable over the sequence shown in FIG. 48 in that the user who is viewing the full-screen video may simply want to return to the display of MEs without having to traverse through the intermediate step of the expanded ME.

[0423] FIG. 50 shows that the subscriber can change location of an expanded ME on the screen by using the arrow keys on the remote control (or by a voice command in the case of a voice-based control device). The expanded ME can move about the screen in pixel-sized increments, or on other increments of distance. Keeping an arrow key depressed can cause the expanded ME to accelerate from a small increments in movement to larger increments improvement. These and other motion dynamics can be provided.

[0424] FIG. 51 shows that DMXEPG can comprise MEs which are generated on the headend MEs which are generated on the subscriber (client) side. The notation HE refers to those MEs that were generated at the headend, while the notation STB indicates MEs generated on the subscriber side; e.g., by the subscriber's STB.

[0425] FIG. 52 shows major system elements and their connections to enable subscribers to display DMXEPG with some of the MEs selected by subscriber from an additional content any source available to subscriber. The components of the client device according to the present invention are enclosed by the phantom lines. The figure shows that the subscriber subscribes on one content provider; e.g., a cable company, a satellite dish, and so on. Additional content sources, identified in the figure as client video sources 1 and 2, can be connected to the client device.

[0426] FIG. 52a shows major system elements which allow entire DMXEPG screen to be created by subscriber device with multi-tuner capability. As an example, when input signal is transmitted over RF, subscriber device can include input module that splits incoming signal to feed subscriber device tuners.

[0427] FIG. 53 is similar to FIG. 52, but for a configuration where the subscriber has access to more than one content provider. The configuration of FIG. 53 shows a switch for switching among the multiple content providers.

[0428] FIG. 54 shows major system elements and their connections to enable subscribers to display expanded ME in the DMXEPG using the same content source.

[0429] FIG. 55 shows major system elements and their connections to enable subscribers to display expanded ME in the DMXEPG using more than one content source.

[0430] FIGS. 56-58 are tables that illustrate combinations of scaling and displaying video for different combinations of aspect ratios among the DMXEPG application screen 9 (FIG. 37, for example), an in-focus ME, the original video stream, and the display. The DMXEPG application screen contains an array of MEs.

[0431] FIG. 59 shows a process of scaling source video to an ME when source and destination aspect ratios are the same or are not the same.

[0432] FIG. 60 shows examples of different arrangements of MEs in a DMXEPG application screen (e.g., element 9 in FIG. 37), for different combinations of aspect ratios of the DMXEPG application screen and the MEs. Thus, for example, a 43 DMXEPG application screen (i.e., having an aspect ratio of 43) can accommodate a 33 array of MEs having an aspect ratio of 43. A 169 DJ\1XEPG application screen can fit a 43 array of MEs having an aspect ratio of 43. More generally, an MN DMXEPG application screen can fit an array of 43 MEs leaving some unused space which can be filled with a suitable background pattern. Table 4 in FIG. 60 lists examples of various combinations of DMXEPG application screen and ME arrangement. FIGS. 61-63 illustrate examples where MEs of different aspect ratios can be used to populate a DMXEPG application screen.

[0433] FIG. 64 illustrates an example of a Pay Per View portal created with MEs. A screen name area identifies that this screen is a pay per view portal. A screen branding area allows for a sponsor's logo; e.g., STARCOM.

[0434] FIGS. 64 and 65 illustrate that the title bar corresponding to the in-focus ME is highlighted in addition to the in-focus ME. In addition, the titles for the row of MEs that includes the in-focus ME are displayed in an area below the array of MEs. Thus, in FIG. 65, ME3 is in focus and the titles for ME1 to ME4 are shown. In FIG. 66, the in-focus ME is ME7, and so the titles for ME5 to ME8 are shown. Further examples are shown in FIGS. 67-69. FIG. 69 shows that an in-focus ME can be purchased for viewing by pressing the SELECT button on the remote control.

[0435] FIG. 66 shows Pay Per View portal created with MEs.

[0436] FIG. 67 shows Pay Per View portal created with MEs.

[0437] FIG. 68 shows Pay Per View portal created with MEs.

[0438] FIG. 69 shows Pay Per View portal created with MEs.

[0439] FIG. 70 shows example of UI and navigation in the DMXEPG in accordance with the present invention. The example is a DMXEPG for the specific content category of GAMES for content category of KIDS. The main screen defaults to an ME that is selected to be the default ME. In this case the default ME is MEG.

[0440] FIG. 71 shows that the ME5 is in focus. The main screen is updated with the video currently associated with ME5 when the user presses the SELECT button on the remote control.

[0441] FIG. 72 shows the display of additional information for the in-focus ME when the user requests additional information. The video is scaled to allow for room to display the additional information.

[0442] FIG. 73 shows that the display including scaled video and additional information will change when the user changes the focus from one ME to another ME. Here, ME5 was in focus as shown in FIG. 72, and in FIG. 73 ME2 becomes focused.

[0443] FIGS. 74 and 75 show a sequence when the focus is changed to the GAMES ME. As can be seen in FIG. 75 the main screen is replaced with a set of MEs for different games that can be accessed.

[0444] FIG. 76 shows that the user can navigate from a game ME to a non-game ME. For example, FIG. 75 shows that the game ME for Game 1 was in focus. In FIG. 76, the user can navigate to ME3 by using the arrows keys on the remote.

[0445] FIG. 77 shows that the main screen can be once again replaced with the scaled video when the SELECT button is pressed for the in-focus ME.

[0446] FIG. 78 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0447] FIG. 79 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0448] FIG. 80 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0449] FIG. 81 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0450] FIG. 82 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0451] FIG. 83 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0452] FIG. 84 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0453] FIG. 85 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0454] FIG. 86 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0455] FIG. 87 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0456] FIG. 88 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0457] FIG. 89 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0458] FIG. 90 shows example of UI and navigation of DMXEPG created for specific content category (Kids)

[0459] FIG. 91a shows example of UI and navigation of DMXEPG portal

[0460] FIG. 91b, 91c, 91d show DMXEPG UI navigation within specific content category

[0461] FIG. 92a, 92b, 92c, 92d show DMXEPG UI navigation and program information following changes in focus of IVIEs.

[0462] FIG. 93 shows UI and navigation of DMXEPG of future programs

[0463] FIG. 94 shows option of enlarging selected ME to larger portion of the screen and the full screen

[0464] FIG. 95, 96 shows UI and navigation of DMXEPG in program information display mode when some ME display trailers one ME is in focus and optionally continue to play trailers when focus moves to another ME.

[0465] FIG. 97 shows UI and navigation of DMXEPG in program information display mode.

[0466] FIG. 98-109 show UI and navigation of DMXEPG in channel browsing mode

[0467] FIG. 110-112 show zoom in and zoom out of ME in DMXEPG in show browsing mode

[0468] FIG. 113-117 show UI and navigation of DMXEPG in channel browsing mode

[0469] FIG. 118 shows DMXEPG ability to enter PVR content browsing mode

[0470] FIG. 119 shows how VOD portal is built with ME

[0471] FIG. 120-121 shows how availability of the same or similar content on VOD system can be indicated and DMXEPG MW as well as grid based EPG

[0472] FIG. 122 shows a diagram describing process of encapsulation of VOD program metadata into DMXEPG metadata

[0473] FIG. 123 shows a system that merges metadata for programs supplied by multiple digital TV service providers

[0474] FIG. 124 shows a system that allows subscribers to select channel auto merge or perform manual channel merge for channels delivered over multiple networks

[0475] FIG. 125, 126 show UI subscriber can access to perform manual merge of channels delivered over multiple networks

[0476] FIG. 127 shows how subscriber can tune to the desired channel using channel name (for example CNN, HBO, etc) or its mnemonic representation using telephone keypadletter association.

[0477] FIG. 128 shows set top box with the application that can utilize more than one display for video output, graphics output, or their combination.

[0478] FIG. 129 shows digital TV set with the application that can utilize more than one display for video output, graphics output, or their combination.

[0479] FIG. 130 shows set top box that runs two applications each of which is using separate display for video output, graphics output, or their combination.

[0480] FIG. 131 shows digital TV set that runs two applications each of which is using separate display for video output, graphics output, or their combination.

[0481] FIG. 132 shows set top box that runs two applications each of which is using a portion of multiple displays for video output, graphics output, or their combination.

[0482] FIG. 133 shows digital TV set that runs two applications each of which is using a portion of multiple displays for video output, graphics output, or their combination.

[0483] FIG. 134 shows example of multi screen application for set top box where the Mosaic portion is directed by D:MXEPG application to the Video/Data Output 1 (Secondary Display) and the Full screen Video stream is directed by D:MXEPG application to the Video/Data Output 2 (Primary Display)

[0484] FIG. 135 shows example of multi screen application for digital TV set where the Mosaic portion is directed by D:MXEPG application to the Video/Data Output 1 (Secondary Display) and the Full screen Video stream is directed by D:MXEPG application to the Video/Data Output 2 (Primary Display)

[0485] FIG. 136 shows example of multi screen application for set top box where the EPG is directed to the Video/Data Output 1 (Secondary Display) and the Full screen Video stream is directed by application to the Video/Data Output 2 (Primary Display)

[0486] FIG. 137 shows example of multi screen application for set top box where the EPG is directed to the Video/Data Output 1 (Secondary Display) and the Full screen video clip for future program is directed by application to the Video/Data Output 2 (Primary Display)

[0487] FIG. 138 shows logical structure of DMXEPG for multiple displays where 21: The instance on DMXEPG application.

[0488] 22a: The HScreen instance (HScreen class which is defined by HAVi I OCAP IMHP) represents a physical primary display device.

[0489] 22b: The HScreen instance (HScreen class which is defined by HAVi I OCAP I MHP) represents a physical secondary display device.

[0490] 23a,23b,23c: The HScreenDevice objects, instances of HGraphicsDevice class (HGraphicsDevice class which is defined by HAVi I OCAP I MHP), represents the graphics layers that belong to the primary display device.

[0491] 23d,23e,23f: The HScreenDevice objects, instances of HGraphicsDevice Class (HGraphicsDevice class which is defined by HAVi I OCAP I MHP), represents the graphics layers that belong to the secondary display device.

[0492] 24a,24b,24c: The HScreenDevice objects, instances of HVideoDevice class (HVideoDevice class which is defined by HAVi I OCAP I MHP), represents the video layers that belong to the primary display device.

[0493] 24d,24e,24f: The HScreenDevice objects, instances of HVideoDevice class (HVideoDevice class which is defined by HAVi I OCAP I MHP), represents the video layers that belong to the secondary display device.

[0494] 25a: The HScreenDevice object, instance of HBackgroundDevice class (HBackgroundDevice class which is defined by HAVi I OCAP I MHP), represents the background layer that belongs to the primary display device.

[0495] 25b: The HScreenDevice object, instance of HBackgroundDevice class (HBackgroundDevice class which is defined by HAVi I OCAP I MHP), represents the background layer that belongs to the secondary display device.

[0496] FIG. 139 also shows logical structures, but for any application including DMXEPG.

[0497] FIG. 140-148 shows system diagram and UI for multi-display DMXEPG application implemented with touch sensitive display.

[0498] FIG. 149 shows remote control that allows subscribers to change focus from one display to another for multi-display applications.

[0499] FIG. 150 shows system diagram of a digital TV set or set top box which enable applications with multi-display functionality.

[0500] FIG. 151 shows system diagram for touch screen display that can be used with systems that support multi-display DMXEPG.

[0501] FIG. 152 shows system diagram of a digital TV set or set top box utilizing touch screen display for multi-display DMXEPG or other multi-screen applications.

[0502] FIG. 153 shows DMXEPG screen displayed in three dimensions either on display with two or three dimensional rendering capabilities.

[0503] FIG. 154 shows DMXEPG screen displayed in three dimensions either on display with two or three dimensional rendering capabilities. DMXEPG can be shown using different perspectives.

Operation

[0504] A subscriber, in accordance with the invention, accesses DMXEPG main page which displays content categories grouped by genre, language, broadcaster name, geographical location of the broadcaster, or other pre-set criteria. For example, content can be grouped by genre in News, Movies, Sitcoms, Cartoons, Sports, and Favorite categories FIG. 7. Subscriber can observe displayed content and switch to the corresponding audio track by navigating to the desired mosaic element using remote control's available buttonsin most cases UP, DOWN, LEFT, RIGHT or, proposed in the invention, optional rotating element FIG. 30 which allows to move focus from one mosaic element to the next in one continuous motion in accordance with the direction of the turn which moves the focus with every pre-defined degree of the rotation.

[0505] If subscriber wants to observe more choices in a particular content category, he can press ENTER button on the remote control or depress optional rotating element 301 which brings subscriber to another DMXEPG page FIG. 2 that displays mosaic of real time video feeds for the corresponding content category. Similarly to the previous screen, subscriber can switch audio tracks, or select desired program to view it in the full screen mode. Also, service providers might choose to display DMXEPG page with incongruent mosaic elements, allocating more space for one or more ME, while still allowing subscribers to switch audio tracks by navigating to the corresponding ME. Furthermore, service providers might choose to create DMXEPG pages that reflect user content preferences associated with the different time of the day, day of the week, age, sex, income, geographical location, and other subscriber demographic data and use conditional access system to match user profile to specific DMXEPG pages. FIG. 6 shows DMXEPG page generated for the morning hours to match viewing preferences subscribers in selected ZIP codes.

[0506] With the set-top box with 2 or more tuners, in accordance with the invention, subscriber, after accessing mosaic DMXEPG landing page, selecting content category, and viewing corresponding DMXEPG page is given the option of selecting any video stream, including video from other sources like DVD player, on one ME while observing DMXEPG elements on the rest of the screen FIG. 10. Similarly to other DMXEPG pages, subscriber can switch corresponding audio track by navigating to the corresponding mosaic element. Subscriber can also move position of mosaic element displaying subscriber selected video stream including video from other sources (e.g. VCR, DVD player, video camera, digital camera, etc.) to uncover hidden DMXEPG elements. This setup can be applied to any predefined content category or DMXEPG page.

[0507] With the set-top box with 2 or more tuners, in accordance with the invention, subscriber, after accessing DMXEPG screen, can optionally select size of ME in focus by pressing ENTER or any other button assigned to that function. In case of subscriber device capable of three dimensional rendering, subscriber can also choose Z coordinate of ME.

[0508] Service Provider, in accordance with the invention, can dynamically change rules responsible for dynamic association of channels with the mosaic DMXEPG elements. For the main landing page, service providers can choose to change displayed content categories, advertisement, or other visual or audio data depending on the time of the day, day of the week, customer demographic data, capabilities of customer premises equipment, and capabilities of the head-end equipment, as well as its business needs.