A processing device, server, and method are provided. According to some illustrative embodiments, the device and method are implemented by detecting a face region of an image, setting at least one action region according to the position of the face region, comparing image data corresponding to the at least one action region to detection information for purposes of determining whether or not a predetermined action has been performed, and executing predetermined processing based on cooperation control information when it is determined that the predetermined action has been performed and the cooperation control information is received.

A rhythm-based video game (game) is disclosed. In the game, a player slashes blocks representing musical beats using a pair of energy blades resembling a lightsaber. A gaming console renders multiple digital objects, e.g., digital blocks, digital mines and digital obstacles, that are approaching a player in a virtual space. The gaming console also renders a digital representation of an instrument, e.g., a lightsaber (digital saber), using which the player slashes, cuts or otherwise interacts with the digital blocks to cause a digital collision between the digital saber and the digital blocks. The player can score by slashing the digital blocks, not hitting the digital mines and avoiding the digital obstacles. The game presents the player with a stream of approaching digital objects in synchronization with music, e.g., a song's beats, being played in the game. The pace at which the digital blocks approach the player increases with the beats.

A device for interfacing with an interactive program, including: a housing, including, an IR projector for projecting an IR pattern into an interactive environment; a camera for capturing images of the projected IR pattern; an image processor configured to process the captured images for identification of the projected IR pattern; a transceiver configured to communicate with a computing device that executes the interactive program, the transceiver configured to transmit data generated by the image processor to the computing device, such that a position of the device in the interactive environment is determined based on the captured images of the IR pattern, the determined position of the device being utilized to update a state of the executing interactive program at the computing device.

A system and method for analyzing and improving the performance of a body motion of an animal or human subject requires instrumenting a subject with inertial sensors, monitoring a body motion of interest, converting sensor data into motion data and animation, comparing the motion data with existing data for motion related performance parameters, providing a real-time, information rich, animation and data display of the results in color coded displays; and based on the results prescribing a training regime with exercises selected from a library of standardized exercises using standardized tools and training aids.

A system and method for analyzing and improving the performance of a body motion of an animal or human subject requires instrumenting a subject with inertial sensors, monitoring a body motion of interest, converting sensor data into motion data and animation, comparing the motion data with existing data for motion related performance parameters, providing a real-time, information rich, animation and data display of the results in color coded displays; and based on the results prescribing a training regime with exercises selected from a library of standardized exercises using standardized tools and training aids.

A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

Disclosed herein is an information processing system including an imaging section, an identification section, a setup section, and a display control section. The imaging section captures an image of a user-designated body and outputs multispectral data regarding a subject. The multispectral data indicates light intensity in four or more wavelength bands. The identification section identifies the type of the subject in accordance with the multispectral data regarding the subject. The setup section sets, based on the type of the subject, an object corresponding to the subject appearing in a game. The display control section causes the object to be displayed in the game in a manner based on the type of the subject.

One embodiment is directed to a system for enabling two or more users to interact within a virtual world comprising virtual world data, comprising a computer network comprising one or more computing devices, the one or more computing devices comprising memory, processing circuitry, and software stored at least in part in the memory and executable by the processing circuitry to process at least a portion of the virtual world data; wherein at least a first portion of the virtual world data originates from a first user virtual world local to a first user, and wherein the computer network is operable to transmit the first portion to a user device for presentation to a second user, such that the second user may experience the first portion from the location of the second user, such that aspects of the first user virtual world are effectively passed to the second user.

A rhythm-based video game (game) is disclosed. In the game, a player slashes blocks representing musical beats using a pair of energy blades resembling a lightsaber. A gaming console renders multiple digital objects, e.g., digital blocks, digital mines and digital obstacles, that are approaching a player in a virtual space. The gaming console also renders a digital representation of an instrument, e.g., a lightsaber (digital saber), using which the player slashes, cuts or otherwise interacts with the digital blocks to cause a digital collision between the digital saber and the digital blocks. The player can score by slashing the digital blocks, not hitting the digital mines and avoiding the digital obstacles. The game presents the player with a stream of approaching digital objects in synchronization with music, e.g., a song's beats, being played in the game. The pace at which the digital blocks approach the player increases with the beats.

A rhythm-based video game (game) is disclosed. In the game, a player slashes blocks representing musical beats using a pair of energy blades resembling a lightsaber. A gaming console renders multiple digital objects, e.g., digital blocks, digital mines and digital obstacles, that are approaching a player in a virtual space. The gaming console also renders a digital representation of an instrument, e.g., a lightsaber (digital saber), using which the player slashes, cuts or otherwise interacts with the digital blocks to cause a digital collision between the digital saber and the digital blocks. The player can score by slashing the digital blocks, not hitting the digital mines and avoiding the digital obstacles. The game presents the player with a stream of approaching digital objects in synchronization with music, e.g., a song's beats, being played in the game. The pace at which the digital blocks approach the player increases with the beats.