Systems and methods are provided for planning a procedure. A display device is configured to display a first virtual element. A controller device having a processor is configured to be in communication with the display device, and the controller device is further configured to direct the display device to display the first virtual element. A physical control element is in communication with the controller device, and is configured to correspond to the first virtual element such that an actual manipulation of the control element is displayed, via the processor of the controller device and on the display device, as a corresponding response of the first virtual element to the actual manipulation of the control element. Associated systems, methods, and computer program products are also provided.

A method of a wearable device displaying icons is provided. The method includes displaying a plurality of circular icons comprising a first circular icon located in a center area of a touch display in a first size and a second circular icon located outside of the center area of the touch display in a second size smaller than the first size, and based on a direction of a touch input received on the touch display, moving the plurality of circular icons such that the first circular icon is moved to a first position located outside of the center area of the touch display and the second circular icon is moved from a second position located outside the center area of the touch display to the center area of the touch display and enlarged in size from the second size to the first size.

A system for transmitting signals between a body of a living being and a virtual reality space includes a mount and a base configured to be affixed to respective first and second bony members of the body on a distal side and a proximal side, respectively, of a joint. An elongate, flexible strip is affixed at a first end to the mount and at a second end to the base. A sensor disposed on the base is configured to generate a displacement signal indicative of displacement of the strip in response to movement of the first bony member relative to the second bony member. The system further includes a display and a controller configured to receive the displacement signal and to control movement of a virtual representation of the body on the display responsive to the displacement signal and feedback of interaction in the virtual space to the living being.

A system may include one or more finger-mounted devices such as finger devices with U-shaped housings configured to be mounted on a user's fingers while gathering sensor input and supplying haptic output. The sensors may include strain gauge circuitry mounted on elongated arms of the housing. When the arms move due to finger forces, the strain gauge circuitry can measure the arm movement. The sensors may also include ultrasonic sensors. An ultrasonic sensor may have an ultrasonic signal emitter and a corresponding ultrasonic signal detector configured to detect the ultrasonic signals after passing through a user's finger. A two-dimensional ultrasonic sensor may capture ultrasonic images of a user's finger pad. Ultrasonic proximity sensors may be used to measure distances between finger devices and external surfaces. Optical sensors and other sensors may also be used in the finger devices.

The arrangement is provided for monitoring state and sequence of movement in an aseptic work chamber of a containment standing in an installation room. At least one work glove projects into the work chamber, wherein the respective work glove is able to stretch up to a maximum grasping range in the three spatial axes in the work chamber. The arrangement comprises a tracking system, the recordings of which serve to continuously localize the at least one work glove in three dimensions and are stored in a computer unit. At least one three-dimensional or two-dimensional prohibited region, which may be adjoined by a warning region, is defined in the work chamber. Individual surface sections or the entire floor of the containment can be defined as a prohibited region. A prohibited region and possibly a warning region in front of this can be set up around machines which are installed in the work chamber and which constitute a danger for the operator. The coordinates of prohibited region and warning region are stored in the computer unit. The at least one work glove must not be used to intervene in the prohibited region and should not be used to intervene in the warning region.

A system for haptic stimulation includes: an actuation subsystem having a set of actuators, a support subsystem, a rigid housing, a sensor subsystem, a control module, and an electrical subsystem. A method for manufacturing a system for haptic stimulation includes performing a set of injection molding processes to form the support subsystem and/or the rigid housing; integrating the actuation subsystem within the support subsystem; and coupling the rigid housing to the support subsystem.

A computer-implemented method includes obtaining first data, including telemetry data and beatmap synchronization data from a user device such as a virtual reality (VR) headset. The telemetry data relates to actions and/or movements of a person wearing the user device in a real-world environment. The telemetry data and beatmap synchronization data are used to produce one more video segments of a virtual person in a virtual world environment. The video production may take place in the cloud, away from the user device. The video production may include post-production and visual effects. The video production may be higher quality and/or resolution than images displayed in real-time on the user device.

A sport training method and system and a head-mounted VR device are disclosed. The method is performed by a head-mounted VR device. The head-mounted VR device is wirelessly connected to a hand-motion tracker and a foot-motion tracker. The method comprises: displaying a virtual demonstrative action; acquiring 6DOF head-motion data, 6DOF hand-motion data and 6DOF foot-motion data of the user; fusing the 6DOF hand-motion data and the 6DOF foot-motion data with the 6DOF head-motion data; calculating motion data of different parts of a human body according to the data that have been fused; and comparing the motion data of the different parts of the human body obtained by the calculation with standard sport training data of the virtual demonstrative action, and if a degree of similarity is greater than a threshold, determining that an action of a human-body part meets a training standard, and if not, displaying a corresponding prompting message in a virtual reality scene to prompt a human-body part whose action is not standard.

Methods and systems for providing input to an augmented reality system or an extended reality system based, at least in part, on neuromuscular signals. The methods and systems comprise detecting, using one or more neuromuscular sensors arranged on one or more wearable devices, neuromuscular signals from a user; determining that a computerized system is in a mode configured to provide input including text to the augmented reality system; identifying based, at least in part, on the neuromuscular signals and/or information based on the neuromuscular signals, the input, wherein the input is further identified based, at least in part, on the mode; and providing the identified input to the augmented reality system.

A teleoperation assist device includes: a motion acquiring unit configured to acquire information on a motion of an operator who operates an end effector; an intention estimating unit configured to estimate a target object which is a target operated by the end effector and a task which is an operation method of the target object using the information acquired by the motion acquiring unit; an environmental status determining unit configured to acquire environment information of an environment in which the end effector is operated; a parameter setting unit configured to acquire information from the intention estimating unit and the environmental status determining unit and to set parameters of an operation type of the end effector from the acquired information; and an end effector operation determining unit configured to determine an amount of operation of the end effector on the basis of taxonomy which is the set parameters and the information acquired by the motion acquiring unit.