Patent classifications
G06F3/017
Floating biopotential samplings
The disclosed biopotential measurement device may include a front end comprising a biopotential measurement sensor and a back end comprising a processor programmed to process biopotential signals detected by the biopotential measurement sensor. The biopotential measurement device may also include an isolation circuit that, during at least a sampling phase of the biopotential measurement sensor, electrically isolates the front end from the back end. Various other methods, systems, and computer-readable media are also disclosed.
System and Method for Authoring Freehand Interactive Augmented Reality Applications
An augmented reality (AR) application authoring system is disclosed. The AR application authoring system enables the real-time creation of freehand interactive AR applications with freehand inputs. The AR application authoring system enables intuitive authoring of customized freehand gesture inputs through embodied demonstration while using the surrounding environment as a contextual reference. A visual programming interface is provided with which users can define freehand interactions by matching the freehand gestures with reactions of virtual AR assets. Thus, users can create personalized freehand interactions through simple trigger-action programming logic. Further, with the support of a real-time hand gesture detection algorithm, users can seamlessly test and iterate on the authored AR experience.
System for gaze interaction
The present invention provides improved methods and systems for assisting a user when interacting with a graphical user interface by combining gaze based input with gesture based user commands. The present invention provide systems, devices and method that enable a user of a computer system without a traditional touch-screen to interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. Furthermore, the present invention offers a solution for touch-screen like interaction using gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen, such as for instance in situations where interaction with the regular touch-screen is cumbersome or ergonomically challenging. Further, the present invention provides systems, devices and methods for combined gaze and gesture based interaction with graphical user interfaces to achieve a touchscreen like environment in computer systems without a traditional touchscreen or in computer systems having a touchscreen arranged ergonomically unfavourable for the user or a touchscreen arranged such that it is more comfortable for the user to use gesture and gaze for the interaction than the touchscreen.
IMAGE SENSOR WITH INTEGRATED EFFICIENT MULTIRESOLUTION HIERARCHICAL DEEP NEURAL NETWORK (DNN)
An image sensor, electronic device and method thereof that performs on-sensor multiresolution deep neural network (DNN) processing, such as for gesture recognition. The image data is transformed into first resolution type image data and second resolution type image data. Based on detecting the first resolution type image data includes a predetermined object, processing the second resolution type image data using the second resolution type image data as input into the second DNN.
Activity-dependent audio feedback themes for touch gesture inputs
Systems and methods that provide audio feedback in response to gesture validity can provide a more intuitive interface that can train users to correctly complete gestures. Moreover, systems and methods that provide line-specific audio feedback can provide more specific feedback that can allow a user to better understand what sensing line is being contacted. The systems and methods can further include basing the audio feedback based at least in part on obtained activity data, such that invalid and valid feedbacks can provide different sounds dependent on the determined activity state.
Face mask for accurate location of sensors relative to a users face, a communication enabling face mask and a communication system including the face mask
Face mask communication system 100 includes face mask 10 worn by user 14 and signal receiving hand glove 16 worn by user 18. Glove 16 includes data receiver 66 for data communication with mask 10 and includes multiple vibrotactile devices for generating haptic signals. Mask 10 includes an elastic element of flexible material, and a plurality of EMG sensors 12 fixed to the element, for sensing electrical activity of face regions of the user's 14 face. Mask 10 includes a processor 60; decoding algorithm 110 and transmitter 62 for, respectively, processing signals from the sensors 12; generating command instructions based on the signals; and wirelessly transmitting the signals to receiver 66 of glove 16. Mask 10 includes thread elements connected to the elastic element of mask 10 enabling tensioning of the element to provide for fitment of mask 10 to users of different sizes, for optimal location sensors 12.
Button activation within an eye-controlled user interface
Systems and methods for activating a button within a display are described. Embodiments of the invention provide a multi-step activation process using user eye movement within the display. The multi-step activation process comprises displaying an confirmation element in response to a first user gaze at a button. The button is subsequently activated in response to a second user gaze at the confirmation element.
Sliced encoding and decoding for remote rendering
Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.
Using an image sensor for always-on application within a mobile device
A mobile device includes an application processor and an image sensor. The application processor includes an imaging subsystem configured to process high resolution image data through a first interface and a sensor hub configured to process sensor data through a second interface. The image sensor operates in one of first and second modes. The image sensor is configured to capture the high resolution image data in response to a request from the imaging subsystem and the imaging subsystem is configured to access the high resolution image data using the first interface for performing a first operation, during the first mode. The image sensor is configured to capture low resolution image data and the sensor hub is configured to access the low resolution image data using the second bus for performing a second operation, during the second mode.
Methods and apparatuses for providing procedure guidance
Apparatuses and methods of operating the same are described. An apparatus including a display, an input device, and a processing device coupled to the display and the input device. The processing device may send an output to the display. The output may include a graphical object associated with a first step of a user-implemented procedure. The processing device may receive an input from the input device. The input may indicate a progress on an execution of the first step by an operator. The processing device may determine whether the input indicates that the operator has completed the first step. The processing device may determine whether the first step is a final step in the user-implemented procedure. The processing device may identify a second step in the user-implemented procedure when the input indicates that the operator has completed the first step and the first step is not a final step.