Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures.

A virtual prop control method includes: displaying a crosshair of a virtual shooting prop in a game scene of a virtual shooting game; detecting whether an aiming ray of the virtual shooting prop is in contact with adhesion boxes of other virtual operation objects in response to an input operation of the target virtual operation object, the aiming ray representing a direction aimed by the crosshair, the input operation including a target touch operation on a display screen that displays the game scene; and determining, from the non-target virtual operation objects corresponding to the contacted adhesion boxes, an adhesion target of the virtual shooting prop during shooting of the virtual shooting prop.

Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures.

A design for a cooperative live action virtual reality experience is described. A client makes use of a 360-degree display unit to play a 360-degree video file, a corresponding audio file, and an annotation requesting the user to make a selection that will dictate the progression of the virtual reality experience. The user input is processed in view of a script tree to determine the subsequent 360-degree video, audio, and annotation to send to the client. In some embodiments, progression of the virtual reality experience is dictated by annotation selections made by a second user or by both users who are cooperatively participating in the virtual reality experience.

A system and method for mixing a scene with a virtual scenario. An image capturing unit is arranged to capture at least one image so as to cover the scene from a first viewpoint. An image representation generation unit is arranged to generate at least one image representation based on the captured image. A game engine unit is arranged to generate a virtual scenario. An image processing unit is arranged to adapt the at least one image representation based on the generated virtual scenario so as to provide a virtual video sequence.

A virtual prop control method includes: displaying a crosshair of a virtual shooting prop in a game scene of a virtual shooting game; detecting whether an aiming ray of the virtual shooting prop is in contact with adhesion boxes of other virtual operation objects in response to an input operation of the target virtual operation object, the aiming ray representing a direction aimed by the crosshair, the input operation including a target touch operation on a display screen that displays the game scene; and determining, from the non-target virtual operation objects corresponding to the contacted adhesion boxes, an adhesion target of the virtual shooting prop during shooting of the virtual shooting prop.

An example position calculation system calculates a position in a three-dimensional virtual space based on an operation on a controller device. In the position calculation system, the position in the virtual space is calculated based on an attitude of the controller device and an input position on a predetermined input surface of the controller device. More specifically, the position calculation system may calculate, as the position in the virtual space, a position on a surface which is determined in accordance with the attitude of the controller device in the virtual space, based on the input position.

A method comprising: detecting a position of a portable device, the portable device including a camera that captures a real-world scene, and identifying an anchor within the real-world scene; generating an augmented reality scene formed by inserting a virtual character into the real-world scene, the virtual character configured to perform an action indicating awareness of the position or activity of the portable device; displaying the augmented reality scene on a display; wherein the action indicating awareness comprises adjusting a view direction, in the augmented reality scene, of the virtual character towards the portable device, and wherein the adjustment of the view direction of the virtual character changes a relationship of the view direction to the anchor, wherein the adjustment of the view direction of the virtual character includes adjustment of a head of the virtual character so as to look in the direction of the portable device.

A system for generating a virtual gaming environment based on features identified within a real-world environment, and adapting the virtual gaming environment over time as the features identified within the real-world environment change is described. Utilizing the technology described, a person wearing a head-mounted display device (HMD) may walk around a real-world environment and play a virtual game that is adapted to that real-world environment. For example, the HMD may identify environmental features within a real-world environment such as five grassy areas and two cars, and then spawn virtual monsters based on the location and type of the environmental features identified. The location and type of the environmental features identified may vary depending on the particular real-world environment in which the HMD exists and therefore each virtual game may look different depending on the particular real-world environment.

A method comprising: detecting a position of a portable device, the portable device including a camera that captures a real-world scene, and identifying an anchor within the real-world scene; generating an augmented reality scene formed by inserting a virtual character into the real-world scene, the virtual character configured to perform an action indicating awareness of the position or activity of the portable device; displaying the augmented reality scene on a display; wherein the action indicating awareness comprises adjusting a view direction, in the augmented reality scene, of the virtual character towards the portable device, and wherein the adjustment of the view direction of the virtual character changes a relationship of the view direction to the anchor, wherein the adjustment of the view direction of the virtual character includes adjustment of a head of the virtual character so as to look in the direction of the portable device.