A system and method for providing a virtual reality game controller with improved functionality by providing capacitive touch and proximity sensors on the controller to enable additional feedback to the user such that interaction with a physical object such as a game controller may be translated into interaction with a virtual tool in a virtual environment such as providing a visual indication in the virtual environment that a finger or thumb is approaching a button of a physical game controller.

Methods and systems are provided for fetching graphics data for rendering a scene presented on a display device. The method includes receiving gaze information for eyes of a user while the user is interacting with the scene. The method includes tracking gestures of the user while the user is interacting with the scene. The method includes identifying a content item in the scene as being a potential focus of interactivity by the user. The method includes processing the gaze information and the gestures of the user to generate a prediction of interaction with the content item by the user. The method includes processing a pre-fetching operation to access and load the graphics data into system memory in anticipation of the user interacting with the content item. In this way, when a prediction of interaction with a content item in the scene is determined based on the game actions (e.g., eye gaze, gestures, etc.) of the user, graphics data associated with the content item can be loaded into the system memory and can be used for further rendering of the content item which can help eliminate delays when the user interacts with the content item in the game scene.

A device may be configured to provide a user interface that supports sequential selection of objects displayed on a screen. As configured, the device may display a presentation of multiple objects, and the device may receive a user input that defines a path within the presentation of displayed objects. The device may then determine the sequential order of a selected subset of the displayed objects. Based on this sequential order, the device may select, initiate, and perform an action that is targeted at the selected subset of the objects. In the context of an action game, the user may trace the path through various enemies, and the device may select and perform the action based on the number of enemies, the type of enemies, or the order in which the enemies were selected. Selection and initiation of the action may begin while the user input is still being received.

The present disclosure discloses a virtual prop control method performed by an electronic device. The method includes: displaying an aiming point of a virtual shooting prop, the virtual shooting prop being controlled by a first virtual operation object associated with the electronic device; when a second virtual operation object is determined as an attachment target of the virtual shooting prop, determining, according to an angle between a position of an aiming point of a virtual shooting prop and a target position of a target virtual operation object, that is, a target rotation angle, a rotation manner of a direction aimed at by the aiming point; and when the rotation manner is a time-based rotation manner, automatically rotating, by the target rotation angle according to a predetermined time duration, the direction aimed at by the aiming point, to align with a target position on a second virtual operation object.

The present disclosure discloses a virtual prop control method performed by an electronic device. The method includes: displaying an aiming point of a virtual shooting prop, the virtual shooting prop being controlled by a first virtual operation object associated with the electronic device; when a second virtual operation object is determined as an attachment target of the virtual shooting prop, determining, according to an angle between a position of an aiming point of a virtual shooting prop and a target position of a target virtual operation object, that is, a target rotation angle, a rotation manner of a direction aimed at by the aiming point; and when the rotation manner is a time-based rotation manner, automatically rotating, by the target rotation angle according to a predetermined time duration, the direction aimed at by the aiming point, to align with a target position on a second virtual operation object.

Methods and systems for processing input by a computing device are presented. One method includes operations for receiving images of a control device that includes an object section, and for determining a location of the control device utilizing image analysis for each captured image. Additionally, the movement of the control device is tracked based on the determined locations, where the tracking of the movement includes receiving inertial sensor information obtained by sensors in the control device, and determining an orientation of the control device based on the sensor information. Additionally, the method includes an operation for translating the movement and orientation of the control device into input for a game executing in the computing device, where the input is translated into a motion and orientation of an object in the game based on the movement of the control device.

Methods and systems for processing input by a computing device are presented. One method includes operations for receiving images of a control device that includes an object section, and for determining a location of the control device utilizing image analysis for each captured image. Additionally, the movement of the control device is tracked based on the determined locations, where the tracking of the movement includes receiving inertial sensor information obtained by sensors in the control device, and determining an orientation of the control device based on the sensor information. Additionally, the method includes an operation for translating the movement and orientation of the control device into input for a game executing in the computing device, where the input is translated into a motion and orientation of an object in the game based on the movement of the control device.

A computer graphics display system such as a video game system provides virtual camera 3-D viewpoint panning control based on a pointer. When the pointer is displayed within a virtual camera panning control region, the system automatically pans the virtual camera toward the pointer. When the pointer is displayed within a different region, panning is deactivated and the user can freely move the cursor (e.g., to control the direction a weapon is pointed) without panning the virtual camera viewpoint. Flexible viewpoint control and other animated features are provided based on a pointing device such as a handheld video game optical pointing control. Useful applications include but are not limited to first person shooter type video games.

A computer graphics display system such as a video game system provides virtual camera 3-D viewpoint panning control based on a pointer. When the pointer is displayed within a virtual camera panning control region, the system automatically pans the virtual camera toward the pointer. When the pointer is displayed within a different region, panning is deactivated and the user can freely move the cursor (e.g., to control the direction a weapon is pointed) without panning the virtual camera viewpoint. Flexible viewpoint control and other animated features are provided based on a pointing device such as a handheld video game optical pointing control. Useful applications include but are not limited to first person shooter type video games.

A method, apparatus and non-transitory computer readable medium that, in one embodiment, interprets a user motion sequence comprises beginning a session, capturing the user motion sequence via a motion capturing device during the session, processing, via a processor, the user motion sequence into a predetermined data format, comparing the processed user motion sequence to at least one predetermined motion sequence stored in a database and determining whether to perform at least one of interpreting the user motion sequence as a universal command and registering the user motion sequence as a new command.