A multi-functional human interface device includes a control unit and a first multi-functional input button. The first multi-functional input button includes a cover unit configured to receive a touch input of a user's finger, an electrode unit including a transmitter and a receiver to form an electric field, an elastic unit configured to move from a first height to a second height when a first pressure is applied from the cover unit and configured to move back to the first height when the first pressure from the cover unit is released, and a switch unit configured to generate an electric signal representing an input of a predetermined letter.

Provided is a control system applied to a screen projection scenario. The system includes: a mobile phone and a display device, receiving first screen content and a target navigation function identifier sent by the mobile phone; generating, according to the target navigation function identifier, a collaboration window including a screen projection area and a navigation bar, where the navigation bar includes three virtual navigation keys; displaying the first screen content in the screen projection area; receiving a keyboard and mouse operation acting on the virtual navigation keys; generating a key instruction according to the keyboard and mouse operation, and sending the key instruction to the mobile phone, so that the mobile phone executes a navigation function according to the key instruction, and the mobile phone can adjust the first screen content to second screen content; and displaying, by the display device, the second screen content in the screen projection area.

Systems and methods for displaying a cursor and a focus indicator associated with real or virtual objects in a virtual, augmented, or mixed reality environment by a wearable display device are disclosed. The system can determine a spatial relationship between a user-movable cursor and a target object within the environment. The system may render a focus indicator (e.g., a halo, shading, or highlighting) around or adjacent objects that are near the cursor. The focus indicator may be emphasized in directions closer to the cursor and deemphasized in directions farther from the cursor. When the cursor overlaps with a target object, the system can render the object in front of the cursor (or not render the cursor at all), so the object is not occluded by the cursor. The cursor and focus indicator can provide the user with positional feedback and help the user navigate among objects in the environment.

Systems and methods for displaying a cursor and a focus indicator associated with real or virtual objects in a virtual, augmented, or mixed reality environment by a wearable display device are disclosed. The system can determine a spatial relationship between a user-movable cursor and a target object within the environment. The system may render a focus indicator (e.g., a halo, shading, or highlighting) around or adjacent objects that are near the cursor. The focus indicator may be emphasized in directions closer to the cursor and deemphasized in directions farther from the cursor. When the cursor overlaps with a target object, the system can render the object in front of the cursor (or not render the cursor at all), so the object is not occluded by the cursor. The cursor and focus indicator can provide the user with positional feedback and help the user navigate among objects in the environment.

An image processing apparatus includes: a display controller configured to cause a display to display an image including a first pointer having a predetermined shape superimposed thereon and move a position of the first pointer within the image in accordance with an input position that is input from an input device; a region-of-interest setting circuit configured to set a region corresponding to the position of the first pointer within the image as a region of interest when a confirmation operation for confirming the input position is input to the input device; and a distance determining circuit configured to determine a distance between a first representative position of the first pointer and a second representative position of the region of interest within the image.

An image processing apparatus includes: a display controller configured to cause a display to display an image including a first pointer having a predetermined shape superimposed thereon and move a position of the first pointer within the image in accordance with an input position that is input from an input device; a region-of-interest setting circuit configured to set a region corresponding to the position of the first pointer within the image as a region of interest when a confirmation operation for confirming the input position is input to the input device; and a distance determining circuit configured to determine a distance between a first representative position of the first pointer and a second representative position of the region of interest within the image.

Provided are an image processing apparatus, a program and an image processing method capable of avoiding interference with the function of another program. An image processing apparatus includes a position information detection unit configured to detect position information indicating a position on a display, a region position setting unit configured to set the position of the region of interest on the display based on the position information, and an image processing unit configured to perform image process on at least one image among an image inside of the region of interest and an image outside of the region of interest. The region position setting unit, when the position information is changed with the image process, sets the position of the region of interest based on the position information immediately before the change.

Provided are an image processing apparatus, a program and an image processing method capable of avoiding interference with the function of another program. An image processing apparatus includes a position information detection unit configured to detect position information indicating a position on a display, a region position setting unit configured to set the position of the region of interest on the display based on the position information, and an image processing unit configured to perform image process on at least one image among an image inside of the region of interest and an image outside of the region of interest. The region position setting unit, when the position information is changed with the image process, sets the position of the region of interest based on the position information immediately before the change.

Provided is a control system applied to a screen projection scenario. The system includes: a mobile phone and a display device, receiving first screen content and a target navigation function identifier sent by the mobile phone; generating, according to the target navigation function identifier, a collaboration window including a screen projection area and a navigation bar, where the navigation bar includes three virtual navigation keys; displaying the first screen content in the screen projection area; receiving a keyboard and mouse operation acting on the virtual navigation keys; generating a key instruction according to the keyboard and mouse operation, and sending the key instruction to the mobile phone, so that the mobile phone executes a navigation function according to the key instruction, and the mobile phone can adjust the first screen content to second screen content and displaying, by the display device, the second screen content in the screen projection area.

A display device including a display; and a controller configured to control the display to display an image on a screen of the display, determine if a user interface (UI) exists on the screen of the display, in response to the UI not existing on the screen of the display, control the display not to display a pointer on the screen of the display, and in response to the UI existing on the screen of the display, control the display to display the pointer on the screen of the display.