Operation data is acquired from either a first type of controller having a plurality of operation sections or a second type of controller having fewer operation sections, and a game process is performed. When the first type of controller is used for game operation, a selection item is switched in a forward direction for a plurality of items arranged in a predetermined order, in accordance with an operation on a first operation section, and the selection item is switched in a reverse direction in accordance with an operation on a second operation section. In addition, when the second type of controller is used for game operation, the selection item is switched in the forward direction in accordance with an operation on a third operation section of the second type of controller. Then, a UI image including these items is generated.

A device for multi-modal user input includes a processor configured to process first data received from a first input device. The first data indicates a first input from a user based on a first input mode. The first input corresponds to a command. The processor is configured to send a feedback message to an output device based on processing the first data. The feedback message instructs the user to provide, based on a second input mode that is different from the first input mode, a second input that identifies a command associated with the first input. The processor is configured to receive second data from a second input device, the second data indicating the second input, and to update a mapping to associate the first input to the command identified by the second input.

An input device comprising: a printed circuit board (PCB) comprising non-linear circuitry; resistive circuitry including a force-sensitive resistor (FSR) coupled to the PCB in parallel with the non-linear circuitry; and a hinge coupled to the PCB and the FSR configured to strain the FSR in response to a force applied to a tip of the input device. A stylus comprising: a housing; and stylus circuitry at least partially positioned within the housing, wherein the stylus circuitry comprises: body circuitry; a front tip interface; and front tip stylus circuitry positioned between and electrically coupled to the body circuitry and the front tip interface, wherein the front tip stylus circuitry comprises non-linear circuitry in parallel with physical interaction characteristic (PIC) circuitry; wherein the front tip stylus circuitry is operative to provide a non-linear load between the body circuitry and the front tip interface when the stylus is stimulated by an external stimulation; wherein the non-linear load is operative to provide a stylus electric field that is detectable by an electronic device when the front tip interface of the stylus is positioned adjacent an input surface of the electronic device; and wherein a resistance of the PIC circuitry is adjustable based on a force applied to the tip interface or based on a tilt angle of the stylus. An electronic device comprising: a plurality of first electrodes; a plurality of second electrodes; stimulation and sensing circuitry configured to transmit signals on the plurality of first electrodes and sense receive signals on the plurality of second electrodes; and processing circuitry configured to: extract, from the sensed receive signals, data indicative of a non-linear response to the transmit signals; estimate a position of an accessory on a surface of the electronic device based on the extracted data; and estimate a force applied to the accessory in contact with the surface of the electronic device or a tilt angle of the accessory relative to the surface of the electronic device based on the extracted data.

Allocation of slots to different styluses is flexibly changed in units of the slot that is shorter than a frame. A stylus bi-directionally transmits and receives signals to and from a sensor controller connected to a sensor via capacitive coupling. The stylus includes a memory that temporarily stores a value of a local ID. The stylus includes a controller that determines whether or not a detected uplink signal includes the value of the local ID stored in the memory every time the uplink signal transmitted by the sensor controller is detected. The controller, in response to determining the detected uplink signal includes the value of the local ID stored in the memory, generates a downlink signal that is based on an operation state and transmits the downlink signal to the sensor controller.

A multi-screen display system and a mouse switching control method are disclosed. The mouse switching control method is applied to a multi-screen display system comprising a main display screen and at least one extended display screen, and comprises: obtaining user images collected by cameras installed on the main display screen and the extended display screen respectively; inputting the user images into a neural network model, and predicting a screen that a user is currently paying attention to using the neural network model to obtain a prediction result; and controlling to switch a mouse to the screen that a user is currently paying attention to according to the prediction result. The system and mouse switching control method are based on self-learning of visual attention, predict the current screen operated by the user, automatically switch the mouse to the corresponding screen position, and improve the user experience.

A method and system for controlling an electronic device using gesture and/or a device is provided. The method includes capturing, in a 3D sensor space, an image including a user manipulable hand-held input device and a body part of a user, finding an entry in a database of multiple user manipulable hand-held input devices that matches the image of the user manipulable hand-held input device, wherein each user manipulable hand-held input device, having an entry in the database, respectively generates signals in response to performing one or more specific control manipulations, determining a primary control mode of primarily controlling the electronic device using 3D gestures or using control manipulations directly from the user manipulable hand-held input device, the primary control mode being determined based on a predetermined priority level associated with the user manipulable hand-held input device and controlling the electronic device using the determined primary control mode.

A digital-pointer interaction system is provided, which includes a display apparatus, a host, a wireless receiving device, and a plurality of wireless pointer devices. The host plays a display screen on the display apparatus, and executes a digital-pointer application. The digital-pointer application renders a plurality of pointer cursors on the display screen according to a number of wireless pointer devices connected to the wireless receiving device, and each wireless pointer device corresponds to each pointer cursor. Each wireless pointer device periodically emits an indication signal to the wireless receiving device, and the wireless receiving device transmits the indication signal to the host. The indication signal includes displacement information of each wireless pointer device. The digital-pointer application controls movement of each pointer cursor on the display screen according to the displacement information of each wireless pointer device.

A projector includes an imaging section for generating imaging data obtained by taking an image of first light emitted by a first pointing member, second light emitted by a second pointing member, and a target range, and a position detection section for detecting a first position and a second position with respect to the target range based on the imaging data so as to be distinguished from each other, and the imaging section includes a sensor for outputting detection values of first colored light, second colored light, and third colored light to detect first infrared light and light with a first wavelength included in the first light, and second infrared light and light with a second wavelength different from the first wavelength included in the second light with the sensor.

Provided is a display apparatus for displaying an operation menu associated with a data processing performed on handwritten data, wherein the operation menu includes information related to the data processing according to a display position of the operation menu.

Systems, devices, media, and methods are presented for selectively activating and suspending control of a graphical user interface by two or more electronic devices. A portable eyewear device includes a display projected onto at least one lens assembly and a primary touchpad through which the user may access a graphical user interface (GUI) on the display. A handheld accessory device, such as a ring, includes an auxiliary touchpad that is configured to emulate the primary touchpad. The eyewear processor temporarily suspends inputs from one touchpad when it detects an activation signal from the other touchpad.