A method for providing a user interface through a head mounted display using eye recognition and bio-signals comprises the steps of: (a) moving a cursor to a particular location at which a user gazes by referencing the eye information obtained from a first eyeball that is one of the eyeballs of the user through a camera module when the user gazes at a particular location on an output screen; and (b) supporting in order to provide detailed selection items corresponding to an entity when a certain entity exists in the certain position by referencing the movement information obtained from the eyelid corresponding to a second eyeball that is one of the eyeballs of the user through a bio-signal acquisition module.

In embodiments of augmenting a moveable entity with a hologram, an alternate reality device includes a tracking system that can recognize an entity in an environment and track movement of the entity in the environment. The alternate reality device can also include a detection algorithm implemented to identify the entity recognized by the tracking system based on identifiable characteristics of the entity. A hologram positioning application is implemented to receive motion data from the tracking system, receive entity characteristic data from the detection algorithm, and determine a position and an orientation of the entity in the environment based on the motion data and the entity characteristic data. The hologram positioning application can then generate a hologram that appears associated with the entity as the entity moves in the environment.

Method for providing image of HMD user to a non-HMD user includes, receiving a first image of a user including the user's facial features captured by an external camera when the user is not wearing a head mounted display (HMD). A second image capturing a portion of the facial features of the user when the user is wearing the HMD is received. An image overlay data is generated by mapping contours of facial features captured in the second image with contours of corresponding facial features captured in the first image. The image overlay data is forwarded to the HMD for rendering on a second display screen that is mounted on a front face of the HMD.

Methods and systems for presenting an image of a user interacting with a video game includes providing images of a virtual reality (VR) scene of the video game for rendering on a display screen of a head mounted display (HMD). The images of the VR scene are generated as part of game play of the video game. An input provided at a user interface on the HMD received during game play is used to initiate a signal to pause the video game and to generate an activation signal to activate an image capturing device. The activation signal causes the image capturing device to capture an image of the user interacting in a physical space. The image of the user captured by the image capturing device during game play is associated with a portion of the video game that corresponds with a time when the image of the user was captured. The association causes the image of the user to be transmitted to the HMD for rendering on the display screen of the HMD.

A near-to-eye display device includes a spatial light modulator, a rotatable reflective optical element and a pupil-tracking device. The pupil-tracking device tracks the eye pupil position of the user. Based on the data provided by the pupil-tracking device, the reflective optical element is rotated such that the light modulated by the spatial light modulator is directed towards the user's eye pupil.

The various embodiments set forth a method for displaying information on one or more surfaces of a vehicle, the method comprising acquiring position data associated with a driver of the vehicle, calculating a current field-of-view of the driver based on the position data, determining a suitable surface for displaying visual information within the vehicle based on the current field-of-view of the driver, and projecting an element of visual information on the suitable surface.

An information processing method includes defining a virtual space for immersing a user wearing a head mounted display (HMD). The virtual space includes a viewpoint of the user, a sound collecting object separated from the viewpoint of the user, and a sound source object. The method includes processing sound data based on a relative positional relationship between the sound collecting object and the sound source object. The method includes instructing a sound outputting unit to output a sound based on the processed sound data. The method includes determining whether or not the viewpoint of the user is moved without synchronization with the movement of the HMD. In response to a determination that the viewpoint of the user is moved without synchronization with movement of the HMD, moving the sound collecting object so that the distance between the moved viewpoint of the user and the sound collecting object is decreased.

Systems and methods are provided for discerning the intent of a device wearer primarily based on movements of the eyes. The system may be included within unobtrusive headwear that performs eye tracking and controls screen display. The system may also utilize remote eye tracking camera(s), remote displays and/or other ancillary inputs. Screen layout is optimized to facilitate the formation and reliable detection of rapid eye signals. The detection of eye signals is based on tracking physiological movements of the eye that are under voluntary control by the device wearer. The detection of eye signals results in actions that are compatible with wearable computing and a wide range of display devices.

A display device includes a directional illuminator providing a light beam, a display panel downstream of a directional illuminator, for receiving and spatially modulating the light beam, and a beam redirecting module downstream of the display panel, for variably redirecting the spatially modulated light beam. Steering the illuminating light by the beam redirecting module enables one to steer the exit pupil of the display device to match the user's eye location(s).

A system or method for measuring human ocular performance can be implemented using an eye sensor, a head orientation sensor, an electronic circuit and a display that presents one of virtual reality information, augmented reality information, or synthetic computer-generated 3-dimensional information. The device is configured for measuring saccades, pursuit tracking during visual pursuit, nystagmus, vergence, eyelid closure, or focused position of the eyes. The eye sensor comprises a video camera that senses vertical movement and horizontal movement of at least one eye. The head orientation sensor senses pitch and yaw in the range of frequencies between 0.01 Hertz and 15 Hertz. The system uses a Fourier transform to generate a vertical gain signal and a horizontal gain signal.