A virtual reality (VR) system includes a VR display and a VR movement apparatus that includes hand user interfaces (UIs) and foot UIs that can support the hands, feet, seat, and total weight of a user. The VR movement apparatus allow the user's hands and feet to move in 3-dimensional space that include vertical, lateral, and fore-aft direction movements. A computer running VR software coordinate and synchronizes the VR movement apparatus and the VR display to provide system users with simulated activities in a VR environment.

Described herein are controllers with sensor-rich controls for enhanced controller functionality. An example control may include a pressure sensor that is configured to detect an amount of a force of a press on a cover of the control based at least in part on a proximity of a metal layer to the pressure sensor. This control may further include a touch sensor for detecting an object contacting the cover of the control. Additional embodiments disclose, among other things, integrated trackpads and D-pads, as well as backlighting features that indicate a functional state of the controller.

Described herein are controllers with sensor-rich controls for enhanced controller functionality. An example control may include a pressure sensor that is configured to detect an amount of a force of a press on a cover of the control based at least in part on a proximity of a metal layer to the pressure sensor. This control may further include a touch sensor for detecting an object contacting the cover of the control. Additional embodiments disclose, among other things, integrated trackpads and D-pads, as well as backlighting features that indicate a functional state of the controller.

A non-transitory computer-readable recording medium has recorded therein a program for causing a processor to function as: a touch information acquirer configured to acquire touch information regarding at least one of an area and a shape of a touch area on a touch panel with which an object comes in contact; and a determiner configured to determine, when the touch information acquired by the touch information acquirer indicates that a contact between the object and the touch panel is present, whether input of an instruction regarding a direction in the touch panel is present, based on the touch information.

In a method and a system for improving a user's experience with a graphical user interface corresponding to a gaming or simulation environment on an electronic device, the interface renders multiple graphical objects and user selectable options corresponding to the graphical object. The user selects one or more selectable option, and performs a touching or a swiping operation through multiple points on the display screen. The touching or swiping operation leads to deploying of multiple resources corresponding to the selected option, at different locations on the interface. For controlling the different deployed resources, the user can swipe through different regions of the display screen. The number of resources deployed at the different locations on the screen depends on certain parameters, including the pressure applied by the user on the screen. Results of the simulation can be employed to control real technical systems, for example for food production.

Haptic simulation device that allows a user, by means of natural body movements, to move through a virtual environment displayed by a VR control system (1) and display means (2), using a treadmill with a unidirectional (5) movable miming deck (6). The detection means comprise a control member (7) with a shape such, that the control member extends in front of and/or at least partly to the side of the user, during use of the device when the user is on the treadmill. The control member is coupled to a rotational pressure sensor (8) and one or more transverse pressure sensors (10). The rotational and transverse pressure sensors are coupled to the VR control system and the treadmill control system such that (a) if the user exerts forward or rearward pressure to the control member, the running deck moves rearward and forward, respectively, and (b) if the user additionally exerts a rotational pressure and/or a transverse pressure on the control member, the VR control system moves the virtual environment displayed in the VR display

An interaction method and apparatus for locking a target in a game is provided. The method includes that: when detecting a preset touch operation of a touch medium within an effective operation range of a first operation icon, a first position is determined in a game interface, a sliding touch operation of the touch medium is detected, and the first position is updated according to a sliding trace of the touch medium; an optional virtual character is determined from the at least one optional virtual character as a preselected virtual character; visual marking is performed on the preselected virtual character so as to distinct from other optional virtual characters; and when detecting the touch medium leaves a touch screen, the present preselected virtual character is locked as a target virtual character of the first operation.

Exemplary arrangements relate to a system that includes at least one wireless dance mat and a base device, as well as a method of operation and communication which provides for rapid and accurate signals indicative of the state of a plurality of pressure sensors in the dance mat. Each pressure sensor is configured to sense pressure resulting from person contact with the dance mat. Transmission controller circuitry is in operative connection with the pressure sensors and a wireless transceiver. The wireless transceiver is operative to transmit wireless signals on a uniform periodic basis and in a sequential order. The exemplary signals each include data corresponding to pressure sensed by each of the pressure sensors at a time of signal transmission, and a position of the respective signal in the sequential order. Data included in the signals received by the base device is usable to determine conditions in which signals are not received and/or signal data has not been accurately received.

Exemplary arrangements relate to a system that includes at least one wireless dance mat and a base device, as well as a method of operation and communication which provides for rapid and accurate signals indicative of the state of a plurality of pressure sensors in the dance mat. Each pressure sensor is configured to sense pressure resulting from person contact with the dance mat. Transmission controller circuitry is in operative connection with the pressure sensors and a wireless transceiver. The wireless transceiver is operative to transmit wireless signals on a uniform periodic basis and in a sequential order. The exemplary signals each include data corresponding to pressure sensed by each of the pressure sensors at a time of signal transmission, and a position of the respective signal in the sequential order. Data included in the signals received by the base device is usable to determine conditions in which signals are not received and/or signal data has not been accurately received.

During execution of a video game or other interactive virtual content, a magnitude and/or amount of force applied to a touch-enabled surface may be used as input to the video game to take at least one action related to the video game's execution.