A display apparatus which is connected to a controller and capable of precisely and quickly shifting the display position of a pointer to the position of a desired object in a three-dimensional display area. When a two-dimensional directional command has not been issued on the controller by an operator, the display apparatus shifts into a first operation state in which a display position of the pointer is shifted according to the tilt and/or displacement of the controller. When a two-dimensional directional command has been issued on the controller by the operator, the display apparatus shifts into a second operation state in which the display position of the pointer is shifted based on two coordinate axes in the display area according to the directional command issued on the controller. In the second operation state, the two coordinate axes are varied according to the tilt of the external control apparatus.

An augmented reality or virtual reality (AR/VR) system can include a virtual input device that can be rendered by an HMD, and a wearable impact detection device, such as a ring, smart watch, wristband, etc. with an inertial measurement unit (IMU), that can be used in conjunction with the HMD to track a location of the user's hands relative to the perceived location of the rendered virtual keyboard using, e.g., vision-based tracking via the HMD and determine when an intended input (e.g., button press) is entered by the user by detecting an impact of the user's finger(s) on a physical surface. The AR/VR system can then determine which key is pressed based on the physical location of the user's hands (e.g., using the vision-based tracking) and, more precisely, the user's finger(s) causing the detected impact and the closest key of the virtual input device to the detected point of impact.

A handheld controller is suitable for controlling a virtual reality system. The handheld controller has a pointer direction corresponding to the virtual reality system. The handheld controller includes a holding portion, a knob, and a positioning module. The holding portion is suitable to be held by a hand of a user. The knob is pivotally connected to the holding portion on a rotation axis. The rotation axis is coaxial with or parallel to the pointer direction. The positioning module is connected to the holding portion and is configured to provide a position of the holding portion in a three-dimensional space. In addition, a control method is also provided here.

Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.

In a handwriting recognition system, a fingertip-motion sensing device has first and second body parts respectively wearable on a distal phalanx and a proximal phalanx of a finger, and a bendable bridge connecting the two body parts. An accelerometer module in the first body part generates acceleration data of the fingertip motion whereas a battery module powering the accelerometer module is in the second body part, avoiding the first body part to be loaded with the battery module so as to reduce hindrance to a user in handwriting. The bridge is wavily shaped, enabling it to be extensible and retractable to avoid spurious interference generation due to unintended movement between the first body part and the distal phalanx. The sensing device wirelessly transmits the acceleration data to a computing device, which analyzes the acceleration data to determine handwritten characters by using a machine-learning classifier, preferably a convolutional neural network.

Provided are a computer program, a method, and a server in which a possibility that a load on display control increases is reduced, compared to the related art. According to an exemplary embodiment of such a configuration, first data relevant to a first position in a virtual space in which a first avatar manipulated by using a first terminal of a first user exists is acquired, whether or not a first condition is satisfied is determined, second data is received in a case where it is determined that the first condition is satisfied, control data for controlling a display unit of the first terminal such that at least the virtual object is displayed on the display unit of the first terminal is decided on the basis of the second data, and the display unit is controlled on the basis of the control data.

A virtual image display device and an object selection method for virtual image thereof are provided. The object selection method for virtual image includes the following: a virtual image display is enabled to capture image information of a hand of a user; whether an image of an auxiliary tool is present in the image information is determined; position information of the auxiliary tool is generated according to the image of the auxiliary tool when the image of the auxiliary tool is present in the image information; the virtual image display is enabled to generate the position information of the auxiliary tool according to inertial measurement information of the auxiliary tool when the image of the auxiliary tool is not present in the image information; and the virtual image display is enabled to display an auxiliary indicator for selecting object according to the position information.

The invention discloses a glasses waistband-type computer device, comprising a waistband body, wherein the middle of the front of the waistband body or other parts of the waistband body is detachably installed with a smartphone, and the front of the waistband body is further provided with a left keyboard located on the left side of the waistband wearer's navel and a right keyboard located on the right side of the waistband wearer's navel; the left and right keyboards are connected to the smartphone in a wired manner or a wireless including a Bluetooth manner. During man-machine interaction, the user wears a waistband so that the left keyboard is located to the left of the navel and the right keyboard is located to the right, to form a waistband keyboard. The invention is novel in structure, convenient to use, easy to carry, and can provide a good man-machine interaction mode.

A finger mounted computer input device is provided. The device includes a housing adapted to be worn on a finger, a pressure response unit configured to convert pressure into movement, and a movement sensing unit comprising a motion sensor capable of measuring the movement of the pressure response unit in response to the pressure. The device allows a user to control a cursor on a computer screen and input command without the restrictive requirement of a rigid flat space, and is particularly suited the anatomy of fingers, thus ergonomic to a user's hand.

A finger-mounted device may include finger-mounted units. The finger-mounted units may each have a body that serves as a support structure for components such as force sensors, accelerometers, and other sensors and for haptic output devices. The body may have sidewall portions coupled by a portion that rests adjacent to a user's fingernail. The body may be formed from deformable material such as metal or may be formed from adjustable structures such as sliding body portions that are coupled to each other using magnetic attraction, springs, or other structures. The body of each finger-mounted unit may have a U-shaped cross-sectional profile that leaves the finger pad of each finger exposed when the body is coupled to a fingertip of a user's finger. Control circuitry may gather finger press input, lateral finger movement input, and finger tap input using the sensors and may provide haptic output using the haptic output device.