Patent classifications
G06F2203/04801
Virtual display changes based on positions of viewers
Systems, methods, and non-transitory computer readable media configured for enabling content sharing between users of wearable extended reality appliances are provided. In one implementation, the computer readable medium may be configured to contain instructions to cause at least one processor to establish a link between a first wearable extended reality appliance and a second wearable extended reality appliance. The first wearable extended reality appliance may display first virtual content. The second wearable extended reality appliance may obtain a command to display first virtual content via the second wearable extended reality appliance, and in response, this content may be transmitted and displayed via the second extended reality appliance. Additionally, the first wearable extended reality appliance may receive second virtual content from the second wearable extended reality appliance, and display said second virtual content via the first wearable extended reality appliance.
Location-based virtual content placement restrictions
Systems, methods, and non-transitory computer readable media configured for managing content placement in extended reality environments are provided. In one implementation, at least one processor associated with the non-transitory computer readable medium may receive a request from an entity to place virtual content at a specific geographic location in at least one shared extended reality environment that includes a plurality of virtual objects, wherein the virtual objects are viewable by a plurality of users. Different content placement rules may define where content may be placed. Based on the obtained information, the processor may determine that the request meets or does not meet the specific content placement rule. The at least one processor may implement the specific content placement rule to prevent content from being displayed when the specific content placement rule is not met and may enable content to be displayed when the specific content placement rule is met.
Environmentally adaptive extended reality display system
A method for facilitating an environmentally adaptive extended reality display in a physical environment includes virtually displaying content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter. Image data is obtained from the wearable extended reality appliance and a specific environmental change unrelated to the virtually displayed content is detected in the image data. A group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter is accessed and a specific rule of the group of rules is determined, the specific rule corresponding to the specific environmental change. The specific rule is implemented to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.
Holographic palm raycasting for targeting virtual objects
A head-mounted display comprises a display device and an outward-facing depth camera. A storage machine comprises instructions executable by a logic machine to present one or more virtual objects on the display device, to receive information from the depth camera about an environment, and to determine a position of the head-mounted display within the environment. Based on the position of the head-mounted display, a position of a joint of a user's arm is inferred. Based on the information received from the depth camera, a position of a user's hand is determined. A ray is cast from a portion of the user's hand based on the position of the joint of the user's arm and the position of the user's hand. Responsive to the ray intersecting with one or more control points of a virtual object, the user is provided with an indication that the virtual object is being targeted.
GAME SYSTEM, GAME SYSTEM CONTROL METHOD, COMPUTER-READABLE NON-TRANSITORY STORAGE MEDIUM HAVING GAME PROGRAM STORED THEREIN, AND GAME APPARATUS
Operation data is acquired from either a first type of controller having a plurality of operation sections or a second type of controller having fewer operation sections, and a game process is performed. When the first type of controller is used for game operation, a selection item is switched in a forward direction for a plurality of items arranged in a predetermined order, in accordance with an operation on a first operation section, and the selection item is switched in a reverse direction in accordance with an operation on a second operation section. In addition, when the second type of controller is used for game operation, the selection item is switched in the forward direction in accordance with an operation on a third operation section of the second type of controller. Then, a UI image including these items is generated.
Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions
User interaction concepts, principles and algorithms for gestures involving facial expressions, motion or orientation of body parts, eye gaze, tightening muscles, mental activity, and other user actions are disclosed. User interaction concepts, principles and algorithms for enabling hands-free and voice-free interaction with electronic devices are disclosed. Apparatuses, systems, computer implementable methods, and non-transient computer storage media storing instructions, implementing the disclosed concepts, principles and algorithms are disclosed. Gestures for systems using eye gaze and head tracking that can be used with augmented, mixed or virtual reality, mobile or desktop computing are disclosed. Use of periods of limited activity and consecutive user actions in orthogonal axes is disclosed. Generation of command signals based on start and end triggers is disclosed. Methods for coarse as well as fine modification of objects are disclosed.
Vehicle controlling apparatus and vehicle having the same
Disclosed is a vehicle controlling apparatus for controlling a vehicle having a display. The vehicle controlling apparatus includes: a communication unit configured to communicate with the display; and a processor configured to set at least one region among an entire region of the display as a display region, based on a sight line range changed according to a position of a passenger who got on the vehicle, and configured to control the communication unit so that visual information is displayed on the display region.
CONTROLLING 3D POSITIONS IN RELATION TO MULTIPLE VIRTUAL PLANES
Systems, methods, and non-transitory computer readable media containing instructions for moving virtual content between virtual planes in three-dimensional space are provided. In one implementation, the wearable extended reality appliance may present a virtual object at a first location on a first virtual plane; intraplanar input signals may be received for causing the virtual object to move to a second location on the first virtual plane, and in response the wearable extended reality appliance may virtually display an intraplanar movement of the virtual object from the first location to the second location; and interplanar input signals may be received for causing the virtual object to move to a third location on a second virtual plane, while the virtual object is in the second location, and in response the wearable extended reality appliance may virtually display an interplanar movement of the virtual object from the second location to the third location.
GESTURE INTERACTION WITH INVISIBLE VIRTUAL OBJECTS (AS AMENDED)
Methods, systems, apparatuses, and non-transitory computer-readable media are provided for enabling gesture interaction with invisible virtual objects. In one implementation, the computer-readable medium includes instructions to cause a processor to receive image data captured by at least one image sensor of a wearable extended reality appliance in a field of view; display a plurality of virtual objects in a portion of the field of view; receive a selection of a specific physical object; receive a selection of a specific virtual object; dock the specific virtual object with the specific physical object; when the specific physical object and the specific virtual object are outside the portion of the field of view such that the specific virtual object is invisible to a user of the wearable extended reality appliance, receive a gesture input indicating interaction with the specific virtual object; and cause an output associated with the specific virtual object.
SYSTEMS AND METHODS FOR CONTROLLING VIRTUAL SCENE PERSPECTIVE VIA PHYSICAL TOUCH INPUT
Systems, methods, and non-transitory computer readable media for controlling perspective in an extended reality environment are disclosed. In one embodiment, a non-transitory computer readable medium contains instructions to cause a processor to perform the steps of: outputting for presentation via a wearable extended reality appliance (WER-appliance), first display signals reflective of a first perspective of a scene; receiving first input signals caused by a first multi-finger interaction with the touch sensor; in response, outputting for presentation via the WER-appliance second display signals to modify the first perspective of the scene, causing a second perspective of the scene to be presented via the WER-appliance; receiving second input signals caused by a second multi-finger interaction with the touch sensor; and in response, outputting for presentation via the WER-appliance third display signals to modify the second perspective of the scene, causing a third perspective of the scene to be presented via the WER-appliance.