Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for integrating a moveable input device with a virtual display projected via a wearable extended reality appliance. In one implementation, the processor is configured to perform operations comprising receiving motion signals associated with the moveable input device, the motion signals reflecting physical movement; outputting during a first time period, first display signals to the reality appliance, the first display signals being configured to cause the wearable extended reality appliance to virtually present content in a first orientation; outputting during a second time period, second display signals to the wearable extended reality appliance, the second display signals being configured to cause the wearable extended reality appliance to virtually present the content in a second orientation; and switching between the output of the first display signals and the output of the second display signals.

The vehicle includes a display, a dial input device configured to receive a first input from a user, and a controller configured to control the display based on the first input, wherein the controller is configured to control the display to display a plurality of characters, a first indicator indicating one character among the plurality of characters, and a second indicator indicating at least one character not indicated by the first indicator among the plurality of characters, controls the display to change the characters indicated by the first indicator and the second indicator based on the first input, and determines the character indicated by the first indicator as the character selected by the user based on the second input.

A keyboard detection system, that includes a processor that operates to detect at least one anomaly in input data and determine a correlation between the at least one anomaly and a characteristic of an inconsistent keyboard type. The processor may operate to determine the correlation between the at least one anomaly and the characteristic of the inconsistent keyboard type based on a lookup table or algorithm.

A sensor manager for virtual reality, augmented reality, mixed reality, or extended reality, configured to: communicate with a plurality of input modules attached to different parts of a user; communicate, with an application that generates a virtual reality content presented to the user; determine a context of the application, including geometry data of objects in the virtual reality content with which the user is allowed to interact with, commands to operate the objects, and gestures usable to invoke the respective commands; process input data received from the input modules to recognize gestures performed by the user; and communicate with the application to invoke commands identified based on the context of the application and the gestures recognized from the input data.

Embodiments of the present disclosure provide a method, a device, and a program product for keystroke pattern analysis. The method includes: acquiring keystroke information of a user on an electronic device, wherein the keystroke information indicates a sequence of characters that are typed sequentially and time information related to the typing of corresponding characters in the sequence of characters; encoding corresponding characters in the sequence of characters respectively into vectorized representations to obtain a sequence of vectorized representations, wherein different characters are encoded into different vectorized representations; superimposing the time information related to the typing of corresponding characters in the sequence of characters respectively to corresponding vectorized representations in the sequence of vectorized representations to obtain a sequence of time-based vectorized representations; and verifying a keystroke pattern of the user by extracting keystroke behavior features from the sequence of time-based vectorized representations.

Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for determining a display configuration for presenting virtual content are provided. In one implementation, the processor is configured for receiving image data from an image sensor associated with a wearable extended reality appliance; analyzing the image data to detect a particular input device placed on a surface; determining a value of at least one use parameter for the particular input device; retrieving from memory default display settings associated with the particular input device; determining a display configuration for presenting virtual content based on the value of the at least one use parameter and the retrieved default display settings; and causing a presentation of the virtual content via the wearable extended reality appliance according to the determined display configuration.

Consistent with disclosed embodiments, systems, methods, and computer readable media including instructions for implementing hybrid virtual keys in an extended reality environment are disclosed. Embodiments may include a processor to receive signals from a touch-sensitive surface, wherein a wearable extended reality appliance may virtually project a plurality of virtual activatable elements on the touch-sensitive surface. The plurality of virtual activatable elements virtually projected on the touch-sensitive surface may be a proper sub-set of a group of virtual activatable elements, based on the action of a user. The processor may receive touch inputs from the user via the touch-sensitive surface and identify one of the plurality of virtual activatable elements. The processor may cause a change in virtual content based on the identified virtual activatable element.

Conventional input mechanisms available are built considering majority users but face usability and security challenge when used by special users or when used in challenging environments. Embodiments herein provide a method and device for multimodal input mechanism. The device is preconfigured for a plurality of modalities and provides an option to a user to select an input modality pair for entering a sequence of characters into the device. A first modality among the pair enables selection of a character set among a plurality of character sets and the second modality enables selecting a character from the selected character set. The plurality of modalities comprise a touch mode defined by a set of touch based gestures, a motion keyboard mode defined by a set of device tilt based gestures, an air gesture mode defined by a set of virtual gestures and a voice mode defined by a set of voice commands. The input modality pair from among the plurality of input modalities is selected by the user based on physical constraints of the user and environmental constraints posed by an environment around the device.

An electronic device, while displaying a first user interface that includes a plurality of activatable user interface objects, detects an input by a contact on the touch-sensitive surface that corresponds to a first activatable user interface object, which is associated with a first control function having a first value as a current value of the control function. In response to an input that meets toggle criteria, the device toggles the first control function between a first state based on the first value for the control function and a second state. In response to an input that meets control adjustment criteria, the device replaces the first user interface with a second user interface for selecting among a set of available values for the control function. In response to movement of the contact across the touch-sensitive surface, a current value for the control function is changed.

Aspects of the present disclosure are directed to creating and administering artificial reality collaborative working environments and providing interaction modes for them. An XR work system can provide and control such artificial reality collaborative working environments to enable, for example, A) links between real-world surfaces and XR surfaces; B) links between multiple real-world areas to XR areas with dedicated functionality; C) maintaining access, while inside the artificial reality working environment, to real-world work tools such as the user's computer screen and keyboard; D) various hand and controller modes for different interaction and collaboration modalities; E) use-based, multi-desk collaborative room configurations; and F) context-based auto population of users and content items into the artificial reality working environment.