The invention relates to an augmented reality system with a headset and a control element, as well as a method for operating such an augmented reality system. The invention moreover relates to a control element of an augmented reality system.

A display system including an information processing device, a projector (a first projector), and a projector (a second projector) includes a first sensing unit sensing a first event which occurs by an operation of an indicator with respect to an image projected from the first projector; a second sensing unit sensing a second event which occurs by the operation of the indicator with respect to an image projected from the second projector; a replacement unit replacing a set of first event information representing the first event and second event information representing the second event with third event information representing a predetermined third event, in a case where the first event and the second event satisfy predetermined conditions; and a processing unit performing processing corresponding to the third event information.

Each projector specifies coordinates of a position which is indicated by an indicator, and outputs coordinate information representing the coordinates which are specified, and identification information identifying a display position of the image. An information processing device includes a conversion unit converting the coordinate information into coordinate information representing coordinates in a coordinate system of the information processing device on the basis of the identification information.

An operation target device projects a display video onto a projection surface, which is captured by a camera. An operation detectable region specifying unit specifies respective regions where an operation is detectable and is undetectable based on image data captured by the camera. Finger and pen contact position detection units detect the operation to the operation object based on the image data captured by the camera. The operation target device displays the display video so that the region where the operation to the operation object is detectable, which is specified by the operation detectable region specifying unit, is distinguished from the region where the operation to the operation object is undetectable. In addition, the operation target device changes a display position of the operation object so that the operation object is displayed within a range of the region where the operation to the operation object is detectable.

A mobile terminal including a touch screen; a stylus pen including a pressure sensor and an optical sensor; a wireless communication unit configured to wirelessly communicate with the stylus pen; and a controller configured to drive the stylus pen in a first operation mode in which the pressure sensor provided in the stylus pen is activated and the optical sensor is deactivated, when sensing information sensed by the pressure sensor indicates the stylus pen is in contact with the touch screen, and drive the stylus pen in a second operation mode in which both the pressure sensor and the optical sensor provided in the stylus pen are activated, when the sensing information sensed by the pressure sensor indicates the stylus pen is not in contact with the touch screen.

A pointer includes: a pointer tip having a tip configured to point a position; a transmitter configured to emit a signal from the pointer tip; and a main body connected to the pointer tip. The main body includes: an exterior housing forming an exterior; a detector configured to detect displacement of the exterior housing and output a detection signal; and a controller configured to change an operation state of the pointer in accordance with the detection signal. The detector includes: a detection device provided on an inner surface of the exterior housing and configured to detect the displacement; and a signal outputter configured to output the detection signal in the case where the detection device detects the displacement.

Display control systems, methods, and programs obtain an indicated location indicated by a pointer, based on an output from a pointing device, and display, on a display, a user interface screen that displays icons at predetermined locations and displays the pointer indicating the indicated location. The systems methods, and programs draw, when the indicated location is present in a draw-in region including one of the icons, the indicated location into the icon. The systems methods, and programs set, when a first icon and a second icon for performing operations related to a same function are arranged side by side on the display, a first draw-in region including the first icon and a second draw-in region including the second icon such that the first draw-in region and the second draw-in region are present in a region between the first icon and the second icon and adjacent to each other.

An optical touch-sensitive device detects touch events caused by instruments (e.g., pens, styluses) and distinguishes these events from touch events caused by fingers. In some embodiments, different instruments can also be distinguished. The optical touch-sensitive device includes multiple emitters and detectors. Each emitter produces optical beams which are received by the detectors. The optical beams preferably are multiplexed in a manner so that many optical beams can be received by a detector simultaneously. Touch events disturb the optical beams, for example due to frustrated total internal reflection. Information indicating which optical beams have been disturbed is analyzed to detect one or more touch events. The analysis also distinguishes instrument touch events from finger touch events.

A method for controlling a display apparatus, the method comprising, displaying, in a first mode, a first image based on received image data having first resolution on a display surface at a first display size corresponding to the first resolution, displaying, in a second mode, a second image based on the image data having second resolution smaller than the first resolution on the display surface at a second display size corresponding to the second resolution, converting, when the display apparatus accepts the operation of increasing the second display size in the second mode, the first resolution of image data to third resolution corresponding to the operation, displaying a third image based on the image data having the third resolution on the display surface.

Apparatuses, methods, systems, and program products are disclosed for measuring light using a digital pen. An apparatus includes a processor and a memory that stores code executable by the processor. In one embodiment, the processor determines whether a digital pen that is configured to communicate with an information handling device is in a docked position. The processor receives a light measurement sensed by the digital pen and performs an adjustment to an output parameter of a display for the information handling device in response to receiving the light measurement. A method, system, and computer program product may perform the functions of the apparatus.