A surface navigation device for a computer or similar graphical display and methods for implementing its operation. The device moves sensitively and precisely over a surface such as a desktop and operator generated changes in its position relative to targetable objects on that desktop arranged about the circumference of a pseudo-circle are described in terms of a lumped motion vector. The motion vector is decomposed into a translational and rotational part by metrical and topological methods. The device communicates each part of the decomposed motion quickly and accurately to a computer screen or other display where it may implement the motion of a cursor or it may be used to manipulate objects having a 3D character by providing them with translational and rotational motions. The rotational parameter generated by the device may also be used independently to trigger some computer action.

The invention relates to an augmented reality system with a headset and a control element, as well as a method for operating such an augmented reality system. The invention moreover relates to a control element of an augmented reality system.

Data is captured by an image capture device of an input object that has a first retroreflective pattern and a second, different retroreflective pattern on a surface of the input object. A position of the input object in three dimensions is determined based on the received data.

This disclosure relates to detecting hand gesture input using an electronic device, such as a wearable device strapped to a wrist. The device can have multiple photodiodes, each sensing light at a different position on a surface of the device that faces skin of a user. Examples of the disclosure detect hand gestures by recognizing patterns in sensor data that are characteristic of each hand gesture, as the tissue expands and contracts and anatomical features in the tissue move during the gesture.

An inertial head-tracking system includes light emitting diodes (LEDs) and photoreceptors. The LEDs and photoreceptors are positioned around the environment and helmet respectively. A processor periodically receives measurements from the photoreceptors and resets inertial drift based on those measurements. Either the LEDs or the photoreceptors are constrained to a specified range to allow for more accurate drift estimation.

A head-worn computer includes a camera system positioned to capture a surrounding environment in front of a user, a processor that identifies a position of a plurality of light emitters mounted on a hand-held controller from images captured by the camera system and tracks the position of the plurality of light emitters as the hand-held controller moves in the surrounding environment and interprets the tracked position as positional changes of the hand-held controller. The processor uses the position of the plurality of light emitters as markers in three dimensional space, the markers used as an anchor for virtual content presented in a see-through display of the head-worn computer.

A modular interactive visual display platform including interconnecting modules including tile modules forming a visual display sensing surface which generates graphical images and senses object proximate to the surface. Tile connector interfaces use tricoupling mechanisms including a mechanical connector, a power connector and a communication connector to connect modules together. The visual display sensing surface may include integrated addressable LEDs, proximity sensors and pressure sensors.

A method of deriving data of a user's body pose in an enhanced reality system includes, with at least one camera coupled to a body-mounted housing, capturing at least one image in three-dimensional (3D) space of at least one extremity of a body of a user on which the body-mounted housing is mounted, and with a processor executing a body pose module, deriving data of a user's body pose based on the at least one image captured by the camera.

An input device includes a tracking target section having an outer surface on which a plurality of light emitting sections are provided; a housing constituting the outer surface of the tracking target section; a first substrate which is a rigid substrate disposed inside the housing; at least one light source mounted on a first surface of the first substrate; and a first light guide member that guides light from the at least one light source to positions of the plurality of light emitting sections on the outer surface of the housing.

A reference position setting method includes: a process of displaying at least three markers on an operation surface; a process of acquiring coordinate values of a sensor coordinate system; a process of transforming the acquired coordinate value into coordinate values of a temporary coordinate system; and a process of transforming the transformed coordinate values into coordinate values of a screen coordinate system. At least one of parallel movement and rotation is performed with respect to the sensor coordinate system to transform the sensor coordinate system into the temporary coordinate system. Movement of the temporary coordinate system in a direction parallel to a plane including a second X-axis and a second Y-axis, and enlargement or reduction of the temporary coordinate system are performed to transform the temporary coordinate system into the screen coordinate system.