Systems, methods, and non-transitory media are provided for tracking operations using data received from a wearable device. An example method can include determining a first position of a wearable device in a physical space; receiving, from the wearable device, position information associated with the wearable device; determining a second position of the wearable device based on the received position information; and tracking, based on the first position and the second position, a movement of the wearable device relative to an electronic device.

Wearable electronic systems having varying interactions based on device orientations are described herein. The systems include a first wearable electronic device and a second wearable electronic device having an input device and a device orientation sensor. The device orientation sensor detects a device orientation of the second wearable electronic device and generates a device orientation signal. The systems have a first mapping orientation mode that performs a first mapping between inputs from the input device and functions of a user interface displayed on the first wearable electronic device when the second wearable electronic device has a first device orientation and a second mapping orientation mode that performs a second mapping between inputs from the input device and functions of the user interface displayed on the first wearable electronic device when the device orientation of the second wearable electronic device detected by the device orientation sensor is a second device orientation.

A tracking method, for tracking an object based on a computer vision, includes following steps. A series of images is captured by a tracking camera. A first position of a trackable device is tracked within the images. An object is recognized around the first position in the images. In response to the object being recognized, a second position of the object is tracked in the images.

A wearable Haptic Human Machine Interface (HHMI) receives electrical activity from muscles and nerves of a user. An electrical signal is determined having characteristics based on the received electrical activity. The electrical signal is generated and applied to an object to cause an action dependent on the received electrical activity. The object can be a biological component of the user, such as a muscle, another user, or a remotely located machine such as a drone. Exemplary uses include mitigating tremor, accelerated learning, cognitive therapy, remote robotic, drone and probe control and sensing, virtual and augmented reality, stroke, brain and spinal cord rehabilitation, gaming, education, pain relief, entertainment, remote surgery, remote participation in and/or observation of an event such as a sporting event, biofeedback and remotality. Remotality is the perception of a reality occurring remote from the user. The reality may be remote in time, location and/or physical form. The reality may be consistent with the natural world, comprised of an alternative, fictional world or a mixture of natural and fictional constituents.

A finger device may be worn on a user's finger and may serve as a controller for a head-mounted device or other electronic device. The finger device may have a housing having an upper housing portion that extends across a top of the finger and first and second side housing portions that extend down respective first and second sides of the finger. Sensors in the side housing portions may measure movements of the sides of the finger as the finger contacts an external surface. To ensure that the sensors are appropriately positioned relative to the sides of the finger, the housing may include one or more adjustable structures such as an elastomeric band, a drawstring, a ratchet mechanism, a scissor mechanism, and/or other adjustable structures for adjusting the position of the first and second side housing portions and associated sensors relative to the upper housing portion.

A system may include one or more finger-mounted devices such as finger devices with U-shaped housings configured to be mounted on a user's fingers while gathering sensor input and supplying haptic output. The sensors may include strain gauge circuitry mounted on elongated arms of the housing. When the arms move due to finger forces, the strain gauge circuitry can measure the arm movement. The sensors may also include ultrasonic sensors. An ultrasonic sensor may have an ultrasonic signal emitter and a corresponding ultrasonic signal detector configured to detect the ultrasonic signals after passing through a user's finger. A two-dimensional ultrasonic sensor may capture ultrasonic images of a user's finger pad. Ultrasonic proximity sensors may be used to measure distances between finger devices and external surfaces. Optical sensors and other sensors may also be used in the finger devices.

A finger device may be worn on a user's finger and may serve as a controller for a head-mounted device or other electronic device. The finger device may have a housing having an upper housing portion that extends across a top of the finger and first and second side housing portions that extend down respective first and second sides of the finger. Sensors in the side housing portions may measure movements of the sides of the finger as the finger contacts an external surface. To ensure that the sensors are appropriately positioned relative to the sides of the finger, the housing may include one or more adjustable structures such as an elastomeric band, a drawstring, a ratchet mechanism, a scissor mechanism, and/or other adjustable structures for adjusting the position of the first and second side housing portions and associated sensors relative to the upper housing portion.

A system for promoting user manipulation of pointing device while operating keyboard is provided. The system comprises a computer, a USB device coupled to the computer, and a handheld wireless pointing device with a first surface positioned against a palm of a user's hand. The device receives tactile contact from a thumb of the hand on a touchpad on a second surface, the second surface opposite the first surface and facing away from the palm. The device also measures movement of the thumb on the second surface and transmits messaging to the USB regarding the measured movement. The USB, based on the received messaging, directs movement of a cursor on a display of the computer. The movement of the cursor is aligned with the movement of the thumb. The device receives attachment to the hand via loops attached to user index and middle fingers.

A wearable electronic Human Machine Interface (HHMI) receives electrical activity from muscles and nerves of a user. An electrical signal is determined having characteristics based on the received electrical activity. The electrical signal is generated and applied to an object to cause an action dependent on the received electrical activity. The object can be a biological component of the user, such as a muscle, another user, or a remotely located machine such as a drone. Exemplary uses include mitigating tremor, accelerated learning, cognitive therapy, remote robotic, drone and probe control and sensing, virtual and augmented reality, stroke, brain and spinal cord rehabilitation, gaming, education, pain relief, entertainment, remote surgery, remote participation in and/or observation of an event such as a sporting event, biofeedback and remotality. Remotality is the perception of a reality occurring remote from the user. The reality may be remote in time, location and/or physical form. The reality may be consistent with the natural world, comprised of an alternative, fictional world or a mixture of natural and fictional constituents.

An information processing apparatus according to an embodiment includes: an acquisition unit (100) that acquires motion information indicating a motion of a user, and a display control unit (100) that performs display control on a display unit capable of superimposing and displaying a virtual space on a real space. The display control unit specifies a real surface that is a surface in the real space based on the motion information, and displays a region image indicating a region for arranging a virtual object or a real object on a virtual surface that is a surface in the virtual space corresponding to the real surface according to an azimuth extracted based on the real surface.