Aspects of this disclosure relate to rewarding users of an electronic game for real-world physical activity. Further aspects relate to altering virtual items based upon physical activity. An electronic game may comprise or otherwise relate to an online world (such as a “Virtual World”). Users may be represented through customized graphical representations, such as avatars. An account of a user (or entity) may be associated a “virtual region.” A threshold level of real-world physical activity may result in obtaining a reward that may be associated with a virtual item. A reward may be configured to result in: (1) altering visual appearance of a virtual item within a virtual region; (2) altering a virtual characteristic of a virtual item, such that the first user may engage in at least one additional virtual activity using that virtual item; and/or (3) acquiring a new virtual item for a virtual region.

Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

An information processing device obtains information regarding the position of each fingertip of a user in a real space, and determines contact between a virtual object set within a virtual space and a finger of the user. The information processing device sets the virtual object in a partly deformed state such that a part of the virtual object, the part corresponding to the position of the finger determined to be in contact with the object among the fingers of the user, is located more to a far side from a user side than the finger, and displays the virtual object having the shape set thereto as an image in the virtual space on a display device.

An operation determination device that determines a change in the facing direction of a user's face as a contact-free operation on a display image includes an image acquisition unit that acquires a captured image that is captured of the user's face and an image processing unit that performs image processing on the captured image and detects the direction of the user's face. The image processing unit includes a first processing unit that detects a portion of the user's face in the captured image and a second processing unit that determines the direction of the user's face in relation to a display surface that displays the display image, on the basis of the portion of the user's face detected in the captured image. The first processing unit includes hardware that executes specific detection processes, and the second processing unit includes one or more processors executing software that execute processes according to output from the first processing unit.

Disclosed herein is a program for controlling an information processing device that receives an operation on an object to be possessed disposed in a virtual space from a user, the program causing the information processing device to execute rendering a spatial image that depicts an aspect of an interior of the virtual space on a basis of a position and a direction of a given viewpoint, receiving a housing operation of adding the object to be possessed to user's personal belongings from the user, and controlling so as to dispose a list of personal belongings to which the object to be possessed has been added at a position in the virtual space determined depending on the position and the direction of the viewpoint at a time of receiving the housing operation.

A game-agnostic event detector can be used to automatically identify game events. Event data for detected events can be written to an event log in a form that is both human- and process-readable. Descriptive text for the event data can come from a common event dictionary that is hierarchical in nature, such that events of the same type can be correlated across different games even though the precise nature or appearance of those events may be different. The event data can be used for various purposes, such as to generate highlight videos or provide player performance feedback.

An interactive environment image may be displayed in a virtual environment space, and interaction with the interactive environment image may be detected within a three-dimensional space that corresponds to the virtual environment space. The interactive environment image may be a three-dimensional image, or it may be two-dimensional. An image is displayed to provide a visual representation of an interactive environment image including one or more virtual objects, which may be spatially positioned. User interaction with the visualized representation in the virtual environment space may be detected and, in response to user interaction, the interactive environment image may be changed.

A tracking system uses a dynamic vision sensor (DVS) operably coupled to the processor. The DVS has an array of light-sensitive elements in a known configuration. The DVS outputs signals corresponding to two or more events at two or more corresponding light-sensitive elements in the array in response to changes in light output from two or more light sources mounted in a known configuration with respect to each other and with respect to a controller. The output signals indicate times of the events and locations of the corresponding light-sensitive elements. The processor determines an association between each event and two or more corresponding light sources and fits a position and orientation of the controller using the determined association, the known configuration of the light sources and the locations of the corresponding light-sensitive elements in the array.

A DVS has an array of light-sensitive elements in a known configuration and outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light output from two or more light sources in a known configuration with respect to each other and with respect to a controller body. The signals indicate times of the events and array locations of the corresponding light-sensitive elements. Filters selectively transmit light from the light sources to light-sensitive elements in the array and selectively block other light from reaching those elements and vice versa. A processor determines a position and orientation of the controller from times of the events, array locations of corresponding light-sensitive elements, and the known light source configuration and determines a position and orientation of one or more objects from signals generated by two or more light-sensitive elements resulting from other light.

A tracking system includes a processor, a controller, two or more light sources and a dynamic vision sensor (DVS). The light sources are of known configuration with respect to each other the controller and turn on and off in a predetermined sequence. The DVS includes an array of light-sensitive elements of known configuration. The DVS outputs signals corresponding to events at corresponding light-sensitive elements in the array in response to changes in light from the light sources. The signals indicate times of the events and locations of the corresponding light-sensitive elements. The processor determines an association between each event and one or more of the light sources and, from that association, determines an occlusion of one or more of the light sources. The processor estimates a location of an object using the determined occlusion, the known light source configuration, and the locations of the corresponding light-sensitive elements in the array.