Provided is an image display device used by being mounted to a head or a face of a user, including a first display unit that displays an internal image seen from a side of the user, a second display unit that displays an external image seen from outside the image display device, and a control unit that controls display of the internal image and the external image.

An HMD device is configured to vertically adjust the ground plane of a rendered virtual reality environment that has varying elevations to match the flat real world floor so that the device user can move around to navigate and explore the environment and always be properly located on the virtual ground and not be above it or underneath it. Rather than continuously adjust the virtual reality ground plane, which can introduce cognitive dissonance discomfort to the user, when the user is not engaged in some form of locomotion (e.g., walking), the HMD device establishes a threshold radius around the user within which virtual ground plane adjustment is not performed. The user can make movements within the threshold radius without the HMD device shifting the virtual terrain. When the user moves past the threshold radius, the device will perform an adjustment as needed to match the ground plane of the virtual reality environment to the real world floor.

Motion and/or rotation of an input mechanism can be tracked and/or analyzed to determine limits on a user's range of motion and/or a user's range of rotation in three-dimensional space. The user's range of motion and/or the user's range of rotation in three-dimensional space may be limited by a personal restriction for the user (e.g., a broken arm). The user's range of motion and/or the user's range of rotation in three-dimensional space may additionally or alternatively be limited by an environmental restriction (e.g., a physical object in a room). Accordingly, the techniques described herein can take steps to accommodate the personal restriction and/or the environmental restriction thereby optimizing user interactions involving the input mechanism and a virtual object.

Method for providing image of HMD user to a non-HMD user includes, receiving a first image of a user including the user's facial features captured by an external camera when the user is not wearing a head mounted display (HMD). A second image capturing a portion of the facial features of the user when the user is wearing the HMD is received. An image overlay data is generated by mapping contours of facial features captured in the second image with contours of corresponding facial features captured in the first image. The image overlay data is forwarded to the HMD for rendering on a second display screen that is mounted on a front face of the HMD.

This disclosure relates to systems and methods for augmenting an appearance of a hilt to simulate a bladed weapon. A hilt may be augmented with a blade of a bladed weapon by detecting a landmark associated with the hilt, determining a position and/or an orientation of the hilt, determining an overlay image comprising the blade of the bladed weapon, wherein the blade is placed within the overlay image according to the determined position and/or the determined orientation of the hilt, and displaying the overlay image so that the blade of the bladed weapon appears to be attached to the hilt.

Methods, devices, and computer programs for augmenting a virtual reality scene with real world content are provided. One example method includes an operation for obtaining sensor data from an HMD of a user to determine that a criteria is met to overlay one or more real world objects into the virtual reality scene to provide an augmented virtual reality scene. In certain examples, the criteria corresponds to predetermined indicators suggestive of disorientation of a user when wearing the HMD and being presented a virtual reality scene. In certain other examples, the one or more real world objects are selected based on their effectiveness at reorienting a disoriented user.

Systems and methods for processing operations for head mounted display (HMD) users to join virtual reality (VR) scenes are provided. A computer-implemented method includes providing a first perspective of a VR scene to a first HMD of a first user and receiving an indication that a second user is requesting to join the VR scene provided to the first HMD. The method further includes obtaining real-world position and orientation data of the second HMD relative to the first HMD and then providing, based on said data, a second perspective of the VR scene. The method also provides that the first and second perspectives are each controlled by respective position and orientation changes while viewing the VR scene.

A method for controlling movement of a computer display cursor based on a point-of-aim of a pointing device within an interaction region includes projecting an image of a computer display to create the interaction region. At least one calibration point having a predetermined relation to said interaction region is established. A pointing line is directed to substantially pass through the calibration point while measuring a position of and an orientation of the pointing device. The pointing line has a predetermined relationship to said pointing device. Movement of the cursor is controlled within the interaction region using measurements of the position of and the orientation of the pointing device.

Systems, methods, and computer-readable media are provided for generating computer-mediated reality display data based on user instantaneous motion data. A system includes at least one sensor, a mediated reality data source, and a mediated reality display generator that generates displayable mediated reality scene data based on (a) current reality data of the system from the at least one sensor; (b) mediated reality data from the mediated reality data source; and (c) instantaneous motion data of the system from the at least one sensor. In one example the mediated reality display generator generates the displayable mediated reality scene data by generating displayable mediated reality frame data based on the current reality data and the mediated reality data. The operations further include selecting a portion of the displayable mediated reality frame data as the displayable mediated reality scene data based on the instantaneous motion data. The portion that is selected is offset from a center of the displayable mediated reality frame data and is less than a frame size of the displayable mediated reality frame data and the offset is selected based on said instantaneous motion.

The present application discloses various methods and apparatuses for determining a head movement, wherein a method for determining a head movement disclosed comprises: acquiring, in response to a head movement of a human body, brain electricity detection information of a human body; and determining the head movement corresponding to the brain electricity detection information. The present application provides a new solution for head movement recognition, by which accuracy of head movement recognition is improved.