Provided is an electronic device that captures a first image of a user. The electronic device determines a position of eye gaze of the user on a first UI element of a plurality of UI elements displayed on a first display screen of the electronic device, based on the first image. The electronic device selects the first UI element based on a determination of the position of the eye gaze on the first UI element for a time interval. The electronic device transmits a first control signal to a media display device, based on the selection of the first UI element. The electronic device receives a feedback image from the media display device. The feedback image indicates control of the media display device based on the first control signal. The electronic device controls the first display screen to display the feedback image with the plurality of UI elements.

A method for controlling a terminal by voice includes: querying, by a first terminal installed with a first client, a second client on a second terminal about scene information. The scene information includes information of at least one operable object in at least one display interface of the second client. The method also includes: displaying, on the first client, a prompt message about voice recording, the prompt message being a reference for a user to issue a voice operation; recording voice to obtain first audio data in response to an operation on a voice recording control of the first client; transmitting the scene information and the first audio data to a server, the server being a back-end server of the second client; and transmitting, after a control instruction is returned by the server, the control instruction to the second client, the control instruction carrying information of a to-be-performed operable object.

An electronic device according to the disclosure includes an infrared signal receiver, an infrared signal transmitter, a memory that stores computer instruction code, which, when executed by a processor, causes the processor to: receive a first infrared signal output from a remote control device according to a user input for controlling an external device connected with the electronic device through the infrared signal receiver, identify a second infrared signal corresponding to one of control commands for controlling the operation of the external device based on control information included in the received first infrared signal, identify the output timing of the second infrared signal based on the type of the first infrared signal, and control the infrared signal transmitter to output the determined second infrared signal based on the identified output timing.

An electronic apparatus and a controlling method thereof are provided. The electronic apparatus includes a processor configured to train a UI provided by an external device through an input/output interface and store information on the UI provided by the external device in a memory, based on an image being received from the external device through the input/output interface, identify whether a UI is included in the received image, based on a UI being included in the received image, compare the UI included in the received image with the UI provided by the external device stored in the memory and identify whether the UI provided by the external device is changed, and based on identification that the UI provided by the external device being changed, retrain the UI included in the received image and store information on the UI included in the received image in the memory.

Methods, systems, and apparatuses are described for automatically navigating a graphical user interface (GUI) of a media device. In embodiments, objects (e.g. selectable items) in device GUI menu screens may be located, identified, and selected by another device (e.g., a switch) using several types of image processing, image recognition, and automated screen navigation techniques. For instance, a device may receive an operation request, for example from a user, receive a video signal from the connected media device, extract a video frame, process the video frame using one or more algorithms, and automatically navigate the GUI of the device by transmitting one more navigation commands for application to the GUI. In this manner, multi-step, time-consuming manual GUI navigation to achieve a desired result may be reduced to an automated technique, allowing users to save time and frustration in navigating a GUI using a remote control to find a particular resource.

A set-top box with enhanced functionality and system and method for use of the same are disclosed. In one embodiment of the set-top box system, first and second set-top boxes each include a housing securing a television input, a television output, a processor, a wireless transceiver, memory, and storage communicatively interconnected by a busing architecture. Each of the set-top boxes is connected to a display, such as a television. A syndication profile associated with the set-top boxes enables a proximate wireless-enabled interactive programmable device to control both displays via each of the set-top boxes.

A control device is provided. The control device includes a first communication interface unit which transmits a control command in a first communication mode which uses a bi-directional wireless communication, a second communication interface unit which transmits a control command in a second communication mode which uses a unidirectional wireless communication, a state determination unit which determines a communication mode of the control device, a user interface unit which displays a user interface window which corresponds to a determined communication mode and receives the control command with respect to a broadcast receiver and a control unit which transmits the received control command according to the determined communication mode.

A display system includes an imaging section, a display section, a selection section, an operation section, and a display control section. The imaging section is configured to image toward a rear and a side of a vehicle. The display section is configured to display an image captured by the imaging section. The selection section is configured to allow selection of a standard mode or a wide-angle mode. The operation section is configured to enable operation of one out of forward driving or reverse driving of the vehicle. The display control section includes RAM, and switches to whichever mode has been set out of the standard mode or the wide-angle mode immediately prior to the vehicle being driven in reverse in cases in which an operation to switch from reverse driving to forward driving of the vehicle has been performed using the operation section while in a reverse driving mode.

A system and method whereby an user interface editing device is used to create a user interface for a controlling device, the created user interface including user interface elements that are associated with functional operations of a virtual equivalent of an appliance. After the created user interface is transferred to the controlling device, the virtual equivalent of an appliance is caused to be linked to an intended target appliance whereupon activation of those user interface elements of the graphical user interface that were associated with functional operations of the virtual equivalent of an appliance will cause the controlling device to transmit commands to control corresponding functional operations of the intended target appliance.

In one embodiment, a method includes receiving program content and data describing program content from a content source, and automatically identifying, based on user preferences of a first user, one or more relevant products or services displayed in the program content. Product-related metadata associated with the program content is identified. The product-related metadata including data relating to the one or more relevant products or services displayed in the program content. The program content is communicated to a display device for presentation to a first user in a first portion of the display device, and the product-related metadata is communicated to a second display device for presentation to a second user substantially simultaneously with the presentation of the program content in the first display device. A user commentary is received from the second device, the user commentary generated by the second user and associated with the program content or product-related metadata.