An information processing system includes an information processing device, at least one wireless controller which can wirelessly be connected to the information processing device, and at least one portable terminal which can execute any application and display a result of execution thereof and has a wireless communication function. The wireless controller establishes wireless connection to the information processing device in accordance with a first procedure and transmits first operation information representing an input operation onto the wireless controller to the information processing device. The portable terminal establishes wireless connection to the information processing device in accordance with a second procedure different from the first procedure and transmits second operation information representing an input operation onto the portable terminal to the information processing device.

An information processing system includes an information processing device, at least one wireless controller which can wirelessly be connected to the information processing device, and at least one portable terminal which can execute any application and display a result of execution thereof and has a wireless communication function. The wireless controller establishes wireless connection to the information processing device in accordance with a first procedure and transmits first operation information representing an input operation onto the wireless controller to the information processing device. The portable terminal establishes wireless connection to the information processing device in accordance with a second procedure different from the first procedure and transmits second operation information representing an input operation onto the portable terminal to the information processing device.

A controller system is disclosed. The controller system contains a controller system housing, at least one user input device located on the controller system housing, and a radio frequency circuitry located at least partially within the controller system housing, wherein activating the at least one user input device causes the controller system to transmit one or more output signals to a portable electronic device using the radio frequency circuitry.

A controller system is disclosed. The controller system contains a controller system housing, at least one user input device located on the controller system housing, and a radio frequency circuitry located at least partially within the controller system housing, wherein activating the at least one user input device causes the controller system to transmit one or more output signals to a portable electronic device using the radio frequency circuitry.

A human-machine interface system comprises a sensor configured to generate data associated with a human movement, such as measured electrical signals or data from an accelerometer. A measurement unit of the human-machine interface measures user movement over time to generate a sequence of measured user movement data. A processor processes the data associated with a human movement from the sensor using a trained neural network to determine one or more predicted user actions. A comparison unit compares the one or more predicted user actions with one or more user actions obtained from the sequence of measured user movement data. A control unit uses the predicted user actions to control a process in an information processing apparatus in dependence upon the comparison performed by the comparison unit.

A game apparatus includes a CPU, the CPU judges a motion of a player on the basis of a cycle of a load value input from a load controller, and selectively displays an animation of a player object according to the motion. Furthermore, the CPU controls a moving amount or a moving velocity of the player object on the basis of the load value input from the load controller, and controls a moving direction of the player object according to a barycentric position of the player detected by the load controller.

A system that mirrors motion of a physical object by displaying a virtual object moving in a virtual environment. The mirroring display may be used for example for feedback, coaching, or for playing virtual games. Motion of the physical object is measured by motion sensors that may for example include an accelerometer, a gyroscope, and a magnetometer. Sensor data is transmitted to a computer that calculates the position and orientation of the physical object and generates a corresponding position and orientation of the virtual object. The computer may correct or adjust the calculations using sensor data redundancies. The virtual environment may include constraints on the position, orientation, or motion of the virtual object. These constraints may be used to compensate for accumulating errors in position and orientation. The system may for example use proportional error feedback to adjust position and orientation based on sensor redundancies and virtual environment constraints.

A system that mirrors motion of a physical object by displaying a virtual object moving in a virtual environment. The mirroring display may be used for example for feedback, coaching, or for playing virtual games. Motion of the physical object is measured by motion sensors that may for example include an accelerometer, a gyroscope, and a magnetometer. Sensor data is transmitted to a computer that calculates the position and orientation of the physical object and generates a corresponding position and orientation of the virtual object. The computer may correct or adjust the calculations using sensor data redundancies. The virtual environment may include constraints on the position, orientation, or motion of the virtual object. These constraints may be used to compensate for accumulating errors in position and orientation. The system may for example use proportional error feedback to adjust position and orientation based on sensor redundancies and virtual environment constraints.

In an aspect, a first controller module of a mobile device controller can be engaged with a first side of a mobile device of a user. A second controller module of the mobile device controller can be engaged with a second side of the mobile device. One or more mobile device controller characteristics associated with characteristics of the mobile device controller can be transmitted from the mobile device controller to the mobile device. A client application on the mobile device can be modified by a first data processor based on the one or more mobile device controller characteristics. The modified client application can be provided by the first data processor to the user in the mobile device, and the user can interact with the modified client application using the mobile device controller. Related systems, apparatus, techniques, and articles are also described.

In certain implementations, a presentation of a virtual counterpart of an action figure may be provided based on action figure state information obtained via wireless communication with the action figure. As an example, an action figure may be detected within a short wireless communication range of a computer system. A wireless connection between the computer system and the action figure may be established based on the detection. Action figure state information identifying a position of a moveable part of the action figure relative to another part of the action figure may be received at the computer system from the action figure via the wireless connection. The relative position may be related to a pose exhibited by the action figure. A virtual counterpart of the action figure may be presented based on the relative position such that the virtual counterpart exhibits the same pose as the action figure.