A game operating device (controller) includes a longitudinal housing, and a holding portion held by hand to be wrapped by its palm it is formed in the housing. A direction switch is provided on an upper surface at a position where it can be operated by thumb of the hand holding the holding portion, and a start switch and a select switch are provided backward thereof. An X button 46 and a Y button are further arranged in line on the upper surface of the housing. An imaging information arithmetic unit is provided at a front end of the housing in a longitudinal direction in such a manner that an imaging device thereof is exposed from a front-end surface. A concave portion is formed on a lower surface at a position corresponding to the direction switch. The concave portion includes a valley and two inclined surfaces. An A button capable of being operated by index finger of the hand holding the holding portion is provided on the backward inclined surface. By processing an image signal obtained by imaging an infrared ray from LED modules by the imaging device, it is possible to obtain an operation signal varying according to a position and/or attitude of the controller.

An interactive environment image may be projected onto one or more surfaces, and interaction with the projected environment image may be detected within a three-dimensional space over the one or more surfaces. The interactive environment image may be a three dimensional image, or it may be two dimensional. An image is projected onto a surface to provide a visual representation of a virtual space including one or more of the virtual objects, which may be spatially positioned. User interaction with the projected visualized representation of the virtual space may be detected and, in response to user interaction, the projected visualized representation may be changed.

A method and apparatus for controlling a virtual object, a terminal, and a storage medium are disclosed. The method includes: acquiring a plurality of images of a user; determining, according to the plurality of images acquired, a gesture change parameter of a gesture change of the user; and controlling, according to the gesture change parameter, a virtual object corresponding to the user.

Methods, systems, and computer-storage media having computer-usable instructions embodied thereon, for controlling objects in a virtual environment are provided. Real-world objects may be received into a virtual environment. The real-world objects may be any non-human object. An object skeleton may be identified and mapped to the object. A user skeleton of the real-world user may also be identified and mapped to the object skeleton. By mapping the user skeleton to the object skeleton, movements of the user control the movements of the object in the virtual environment.

A video acquirer acquires video obtained by imaging, by an imaging element that moves in association with motion of a head of a user, an area including reflected light of each of light beams irradiated to either one eyeball of the user from two light sources of a first light source that moves in association with the motion of the head of the user and a second light source whose relative position is invariable with respect to a video presenter as an observation target for the user. A head movement estimator estimates the motion of the head of the user based on a relative position of the reflected light of the second light source with respect to the reflected light of the first light source in the video acquired by the video acquirer.

The present invention relates to training equipment for improving the ability of memory and cognition, and muscle power, and a training method using the training equipment. In particular, the present invention relates to training equipment for improving the ability of memory and cognition, and muscle power (upper and lower limb muscle power), the training equipment including: a lower limb muscle power exercise module that includes pedals for strengthening the muscle power of user's lower limbs and/or a handle for steering; a display that implements traveling in a virtual space for memory ability training of the user; and a training unit that improves cognition ability and/or muscle power of the user on the basis of driving data of the lower limb muscle power exercise module, thereby being able to complexly support memory ability training, lower limb muscle power exercise, and upper limb muscle power exercise of rehabilitation patients, patients with dementia, and/or patients with cognitive impairment.

An image is placed, based on a predetermined designation input, on a predetermined placement position in relation to a display area, and displayed. The image is enlarged and reduced in accordance with an enlargement ratio of the image, and an area within which the placement position can be set is changed in relation to the display area in accordance with the enlargement ratio. Then, based on an obtained designation input, a position within the area, which position corresponds to the designation input, is calculated as a placement position, and the image having been enlarged and reduced is placed on the placement position. The image is then displayed on a display device.

Embodiments of the present invention split game processing and rendering between a client and a game server. A rendered video game image is received from a game server and combined with a rendered image generated by the game client to form a single video game image that is presented to a user. Game play may be controlled using a rich sensory input, such as three-dimensional image data and audio data. The three-dimensional image data describes the shape, size and orientation of objects present in a play space. The rich sensory input is communicated to a game server, potentially with some preprocessing, and is also consumed locally on the client, at least in part. In one embodiment, latency sensitive features are the only features processed on the client and rendered on the client.

A sensor generates signals representing whether a computer game headset is being worn properly so that the wearer may be advised. The sensor may be a pressure sensor or motion sensor or stretch sensor on the headset, or it may be a camera that images the wearer and uses image recognition to determine if the headset is on correctly.

A virtual reality tracking system accurately determines one or more controller orientations using data from tracking cameras and/or an inertial measurement unit (IMU) embedded in each controller. Each controller has two or more distinctive light-emitting tracking markers. The tracking system determines the locations of the tracking markers based on the location of tracking markers in tracking camera's images. The tracking system determines the controller orientation using the locations of the tracking markers and orientation data from the IMU. When the camera views of the markers are obstructed the tracking system relies solely on the less-accurate orientation data from the IMU.