A method of communicating data between a game console unit and at least one wireless mobile game controller is disclosed. The method includes establishing an uplink from the at least one mobile game controller to the game console unit via a first millimeter-wave wireless link, and establishing a downlink from the game console unit to the at least one wireless mobile game controller via a second millimeter wave wireless link.

An improved controller for a game console that is intended to be held by a user in both hands in the same manner as a conventional controller, which has controls on the front operable by the thumbs, and has two additional controls located on the back In positions to be operated by the middle fingers of a user.

A music based video game provides a user directed sound generation feature. In some embodiments, the user is provided a video game controller simulating a musical instrument, which the user may operate similarly to its real musical instrument counterpart. A free play feature is provided for users to operate the video game controller, where a processor of a video game console receives input signals from the video game controller and outputs audio samples based on the received input signals. During the free play feature, multiple suggestions as to how to operate the video game controller are simultaneously provided to give users some guidance as to what to play using the video game controller.

A system and controller are provided. In one example, the system includes a controller for playing a video game. The controller includes input buttons for controlling interaction during play of the video game. The controller includes an inertial sensor for detecting translational or rotational movement of the controller and a vibrational device. A voice input device is associated with the controller. A wireless communication circuit of the controller is provided for communicating data between the controller and a local computing device. The local computing device is connectable to a network. The data includes control responsive to presses of said input buttons or control received from said voice input device.

Methods and apparatus are provided for 6DoF inside-out tracking game control. In one novel aspect, a multi-processor architecture is used for VI-SLAM. In one embodiment, the apparatus obtains overlapping image frames and sensor inputs of an apparatus, wherein the sensor inputs comprise gyrometer data, accelerometer data and magnetometer data, splits computation work onto a plurality of vector processors to obtain six degree of freedom (6DoF) outputs of the apparatus based on a splitting algorithm, and performs a localization process to generate 6DoF estimations, and a mapping process to generate a cloud of three-dimensional points associated to the descriptors of the map. In one embodiment, the localization process and mapping process are configured to run sequentially. In another embodiment, the localization process and mapping process are configured to run in parallel.

A first sensor detects a movement of a first apparatus attached to a lower body of a user, and a second sensor detects a movement of a second apparatus attached to an upper body of the user or held by a hand of the user. Then, a virtual object is caused to continue a first action in a virtual space while received outputs from the first sensor and the second sensor both satisfy a condition.

An improved controller for a game console that is intended to be held by a user in both hands in the same manner as a conventional controller, which has controls on the front operable by the thumbs, and has two additional controls located on the back in positions to be operated by the middle fingers of a user.

A first sensor detects a movement of a first apparatus attached to a lower body of a user, and a second sensor detects a movement of a second apparatus attached to an upper body of the user or held by a hand of the user. Then, a virtual object is caused to continue a first action in a virtual space while received outputs from the first sensor and the second sensor both satisfy a condition.

An improved controller for a game console that is intended to be held by a user in both hands in the same manner as a conventional controller, which has controls on the front operable by the thumbs, and has two additional controls located on the back in positions to be operated by the middle fingers of a user.

A gaming system comprises a handheld user input device, a processor for receiving input data from the handheld user input device and a gaming application for receiving data from the processor based on the received input data from the handheld user input device. The handheld user input device emulates one of a plurality of different devices associated with the gaming application. Each of the plurality of different devices have a set of input commands associated therewith. The set of input commands associated with the one of a plurality of different devices includes a command based on one of motion and orientation of the handheld device.