A method for creating an augmented reality experience. The method includes receiving a value to associate with a stored value token, searching a database for one of products and services that are sold close to the value, matching at least one of a product and a service which is sold close to the value, and creating a record comprising a token identifier and a graphical item representing one of the product and service that is found during matching, receiving a request to initiate the augmented reality experience. The method further includes, in response to the request, preparing data comprising augmented reality information including a video file and the record. The method further includes sending the data over a computer network.

A head-mounted display wearable on the head of a user includes: a display device disposed on an inner surface of the head-mounted display worn by the user on the head; a touch pad disposed on an outer surface of the head-mounted display worn by the user on the head, the touch pad being able to detect contact with or proximity of a body part of the user; and a display controlling unit acquiring data of an image generated on the basis of input information indicative of the touch pad detecting the contact with or the proximity of the body part of the user, the display controlling unit further causing a display device to display the acquired image data.

An event driven sensor (EDS) is used for simultaneous localization and mapping (SLAM) and in particular is used in conjunction with a constellation of light emitting diodes (LED) to simultaneously localize all LEDs and track EDS pose in space. The EDS may be stationary or moveable and can track moveable LED constellations as rigid bodies. Each individual LED is distinguished at a high rate using minimal computational resources (no image processing). Thus, instead of a camera and image processing, rapidly pulsing LEDs detected by the EDS are used for feature points such that EDS events are related to only one LED at a time.

A head-mounted display device includes a display element with a two-dimensional array of pixels, and an enclosure at least partially enclosing the display element. The head-mounted display device also includes a plurality of light sources located on the enclosure for determining a position of the head-mounted display device. Each light source of the plurality of light sources is uniquely identifiable based at least in part on light emitted by the light source.

Disclosed herein are a method and apparatus for deriving information about an input device using a marker thereof. Multiple cameras create multiple images by capturing the input device. A position recognition device derives the 3D positions of the markers of the input device using the multiple images and corrects information about the positions and angles of the multiple cameras based on the 3D positions of the markers. Also, the position recognition device derives the position and angle of the input device. The input device may comprise multiple input devices, and the multiple markers of the multiple input devices may be used to correct the information about the positions and angles of the multiple cameras depending on the coupling of the multiple input devices.

Example embodiments of disclosed configurations include a liquid crystal display with segmented backlight units that can be controlled individually. In one or more embodiments, the liquid crystal display includes a liquid crystal layer including a plurality of liquid crystals grouped into a plurality of liquid crystal portions, and a backlight coupled to the liquid crystal layer. The backlight includes a plurality of backlight units, where each backlight unit faces a corresponding liquid crystal portion and is configured to project light towards the corresponding liquid crystal portion.

Disclosed are an electronic device and a method of controlling the same. An electronic device includes: a camera; a sensor module; and a processor, wherein the processor is configured to determine at least one of a movement of the electronic device and a movement of an object in images acquired by the camera, determine, based on the movement of the electronic device or the movement of the object, an output period for light outputted by the sensor module, and determine depth information of the images based on reflected light corresponding to the outputted light received by the camera.

A system comprising an input device includes a detector coupled to a processor. The detector detects an orientation of the input device. The input device has multiple modal orientations corresponding to the orientation. The modal orientations correspond to multiple input modes of a gestural control system. The detector is coupled to the gestural control system and automatically controls selection of an input mode in response to the orientation.

Systems and methods for detecting, representing, and interpreting three-space input are described. Embodiments of the system, in the context of an SOE, process low-level data from a plurality of sources of spatial tracking data and analyze these semantically uncorrelated spatiotemporal data and generate high-level gestural events according to dynamically configurable implicit and explicit gesture descriptions. The events produced are suitable for consumption by interactive systems, and the embodiments provide one or more mechanisms for controlling and effecting event distribution to these consumers. The embodiments further provide to the consumers of its events a facility for transforming gestural events among arbitrary spatial and semantic frames of reference.

Systems and methods are described for gesture-based control using three-dimensional information extracted over an extended depth of field. The system comprises a plurality of optical detectors coupled to at least one processor. The optical detectors image a body. At least two optical detectors of the plurality of optical detectors comprise wavefront coding cameras. The processor automatically detects a gesture of the body, wherein the gesture comprises an instantaneous state of the body. The detecting comprises aggregating gesture data of the gesture at an instant in time. The gesture data includes focus-resolved data of the body within a depth of field of the imaging system. The processor translates the gesture to a gesture signal, and uses the gesture signal to control a component coupled to the processor.