An attitude of an object arranged in a virtual world is controlled based on attitude data outputted from a portable display device. Further, the object is caused to move in the virtual world, based on data based on a load applied to a load detection device. Then, a first image showing the virtual world including at least the object is displayed on the portable display device.

In an exemplary image generation system, a virtual camera is set in accordance with a position and an orientation of an object in a virtual space. While a predetermined operation is being performed, an orientation of a display device is detected by using an angular velocity sensor provided in the display device, and an orientation of the virtual camera is changed based on the detected orientation. When the predetermined operation is not performed, the virtual camera is positioned based on an original orientation which is determined in accordance with the position and the orientation of the object.

There is provided a display control program for a computer. The display control program includes: by an image generation block, setting a viewpoint position and a sightline direction in accordance with one of a position and an attitude of a head mounted display worn on the head of a user and rendering an object arranged in a virtual three-dimensional space so as to generate an image to be displayed on the head mounted display; and by a rotation control block, upon acquiring an instruction for rotating a game field arranged in the virtual three-dimensional space, rotating the game field around an axis perpendicular to the game field.

Methods and systems for enabling an augmented reality character to maintain and exhibit awareness of an observer are provided. A portable device held by a user is utilized to capture an image stream of a real environment, and generate an augmented reality image stream which includes a virtual character. The augmented reality image stream is displayed on the portable device to the user. As the user maneuvers the portable device, its position and movement are continuously tracked. The virtual character is configured to demonstrate awareness of the user by, for example, adjusting its gaze so as to look in the direction of the portable device.

A design for a cooperative live action virtual reality experience is described. A client makes use of a 360-degree display unit to play a 360-degree video file, a corresponding audio file, and an annotation requesting the user to make a selection that will dictate the progression of the virtual reality experience. The user input is processed in view of a script tree to determine the subsequent 360-degree video, audio, and annotation to send to the client. In some embodiments, progression of the virtual reality experience is dictated by annotation selections made by a second user or by both users who are cooperatively participating in the virtual reality experience.

A human-machine interface involves plural spatially-coherent visual presentation surfaces at least some of which are movable by a person. Plural windows or portholes into a virtual space, at least some of which are handheld and movable, are provided by using handheld and other display devices. Aspects of multi-dimensional spatiality of the moveable window (e.g., relative to another window) are determined and used to generate images. As one example, the moveable window can present a first person perspective porthole view into the virtual space, this porthole view changing based on aspects of the moveable window's spatiality in multi-dimensional space relative to a stationary window. A display can present an image of a virtual space, and an additional, moveable display can present an additional image of the same virtual space.

A coordinate calculation apparatus calculates a coordinate point representing a position on a display screen based on an orientation of an input device. The coordinate calculation apparatus includes direction acquisition means, orientation calculation means, first coordinate calculation means, and correction means. The direction acquisition means acquires information representing a direction of the input device viewed from a predetermined position in a predetermined space. The orientation calculation means calculates the orientation of the input device in the predetermined space. The first coordinate calculation means calculates a first coordinate point for determining the position on the display screen based on the orientation of the input device. The correction means corrects the first coordinate point such that the first coordinate point calculated when the input device is directed in a predetermined direction takes a predetermined reference value.

First, movement information that allows calculation of a movement of a first input device is sequentially obtained. During a time period in which at least one operation key is in a predetermined input state, a display image is enlarged or reduced in accordance with a change of the movement information. When it is determined that the predetermined input state is canceled, the enlarged or reduced display image is caused to return to its original magnification and an action of at least one first object in the display image is controlled.

This disclosure relates to a system and method for facilitating interaction with a virtual space via a touch sensitive surface. The user may interact with the virtual space via a touch sensitive surface in a wireless client device. The user may interact with the virtual space by providing control inputs to the touch sensitive surface. The control inputs may be reflected in one or more views of the virtual space. In some implementations, the system may be configured such that the one or more views of the virtual space include one or more views of a shooter game. The system may be configured such that the user may interact with the game primarily with fingers from one hand via the touch sensitive surface. The user may enter various command inputs into the touch sensitive surface that correspond to actions in the virtual space presented to the user.

A video game device calculates a difference vector extending from a predetermined reference position on the screen to an input position. Moreover, the video game device calculates movement parameter data used for moving, with respect to a fixed point in the virtual space uniquely determined based on a position of the controlled object, the point of sight to a position that is determined by a direction in the virtual space based on a direction of the difference vector and a distance in the virtual space based on a magnitude of the difference vector. The point of sight is moved based on the movement parameter data. The video game device produces an image based on a virtual camera, which has been moved according to the movement of the point of sight, and displays the image on the screen of a display device.