Aspects of the present invention allow a touch screen device to operate as a gamepad for a video game running on a separate gaming device. Aspects of the present invention provide a virtual control interface through the touch screen that includes virtual game controls that perform the same function as a directional pad, buttons, triggers, and sticks found on a gamepad or other game controller. In one aspect, the virtual control interface provides an output that is substantially similar to an output generated by a gamepad able to interact with the gaming device. Substantially similar outputs allow a gaming device to respond to a functional control from a gamepad and an equivalent functional control from the virtual control interface the same way and without translation. Aspects of the present invention can provide different virtual control interfaces for different video game titles, different genres, and based on user customization.

Aspects of the present invention allow a touch screen device to operate as a gamepad for a video game running on a separate gaming device. Aspects of the present invention provide a virtual control interface through the touch screen that includes virtual game controls that perform the same function as a directional pad, buttons, triggers, and sticks found on a gamepad or other game controller. In one aspect, the virtual control interface provides an output that is substantially similar to an output generated by a gamepad able to interact with the gaming device. Substantially similar outputs allow a gaming device to respond to a functional control from a gamepad and an equivalent functional control from the virtual control interface the same way and without translation. Aspects of the present invention can provide different virtual control interfaces for different video game titles, different genres, and based on user customization.

A system that incorporates the subject disclosure may include, for example, device may perform operations for receiving a signal from an operational space associated with an accessory device, determining hand feature information according to the signal, accessing device location information associated with the computing accessory device, generating hand-device interaction information according to the hand feature information and device location information associated with the accessory device, and transmitting the hand-device interaction information to a virtual reality system, wherein the virtual reality system generates, according to the hand-device interaction information, a virtual hand and a virtual accessory device in a virtual reality image. Additional embodiments are disclosed.

A system that incorporates the subject disclosure may include, for example, device may perform operations for receiving a signal from an operational space associated with an accessory device, determining hand feature information according to the signal, accessing device location information associated with the computing accessory device, generating hand-device interaction information according to the hand feature information and device location information associated with the accessory device, and transmitting the hand-device interaction information to a virtual reality system, wherein the virtual reality system generates, according to the hand-device interaction information, a virtual hand and a virtual accessory device in a virtual reality image. Additional embodiments are disclosed.

An operation system includes an operation device and an information terminal connected to the operation device. The operation device has an operation section including a plurality of operating elements. The information terminal includes an operation registration section configured to register an operation involving use of at least one of the plurality of operating elements to a target operating element constituted by at least one of the plurality of operating elements, an operation determination section configured to determine whether or not the target operating element is operated, and an information generation section configured to generate, when the target operating element is determined to be operated, operation information corresponding to the operation registered to the target operating element by the operation registration section. Either the operation device or the information terminal includes an information transmission section configured to transmit the operation information generated by the information generation section.

An operation system includes an operation device and an information terminal connected to the operation device. The operation device has an operation section including a plurality of operating elements. The information terminal includes an operation registration section configured to register an operation involving use of at least one of the plurality of operating elements to a target operating element constituted by at least one of the plurality of operating elements, an operation determination section configured to determine whether or not the target operating element is operated, and an information generation section configured to generate, when the target operating element is determined to be operated, operation information corresponding to the operation registered to the target operating element by the operation registration section. Either the operation device or the information terminal includes an information transmission section configured to transmit the operation information generated by the information generation section.

There is provided a computer system including a mouse device and a host. The mouse device receives a command script from the host to determine output data to be transmitted to the host. The output data includes, for example, at least one pressed key signal and/or a movement signal. The command script is previously recorded in the host or is determined according to raw data detected by the mouse device. The present disclosure further provides a gaming mouse.

There is provided a computer system including a mouse device and a host. The mouse device receives a command script from the host to determine output data to be transmitted to the host. The output data includes, for example, at least one pressed key signal and/or a movement signal. The command script is previously recorded in the host or is determined according to raw data detected by the mouse device. The present disclosure further provides a gaming mouse.

A computing system includes an input driver and a virtual input controller. The input driver is configured to receive input data from a first controller of a recognized data protocol and to provide the input data to an API of an application to control actions of a first participant in the gaming application. The virtual input controller is, in contrast, configured to receive input data from a second controller of a protocol incompatible with the input driver, translate the input data to the recognized data protocol; request a broadcast application identifier for a currently-broadcasting application from the broadcasting agent, and provide the translated input data to the input driver in association with the broadcast application identifier for controlling actions of a second participant in the application via the API of the gaming application.

A computing system includes an input driver and a virtual input controller. The input driver is configured to receive input data from a first controller of a recognized data protocol and to provide the input data to an API of an application to control actions of a first participant in the gaming application. The virtual input controller is, in contrast, configured to receive input data from a second controller of a protocol incompatible with the input driver, translate the input data to the recognized data protocol; request a broadcast application identifier for a currently-broadcasting application from the broadcasting agent, and provide the translated input data to the input driver in association with the broadcast application identifier for controlling actions of a second participant in the application via the API of the gaming application.