Patent classifications
G06F3/012
Wearable speech input-based vision to audio interpreter
An eyewear device with camera-based compensation that improves the user experience for user's having partial blindness or complete blindness. The camera-based compensation determines features, such as objects, and then converts the determined objects to audio that is indicative of the objects and that is perceptible to the eyewear user. The camera-based compensation may use a region-based convolutional neural network (RCNN) to generate a feature map including text that is indicative of objects in images captured by a camera. The feature map is then processed through a speech to audio algorithm featuring a natural language processor to generate audio indicative of the objects in the processed images.
VIRTUAL REALITY ACTIVITIES FOR VARIOUS IMPAIRMENTS
Systems and methods are provided for identifying a therapeutic VR activity or exercise for a subject/patient based on the subject's impairments, dynamically adjusting a VR activity for a patient, and identifying potential impairments based on a patient's performance in a VR activity. Patients may each have various physical, neurological, cognitive, and/or sensory impairments to be treated. Not all therapeutic activities may be appropriate for some patients and their impairments. A VR therapeutic activity platform may increase patient engagement and challenge patients at more appropriate times by better matching activities corresponding to a patient's impairments and dynamically adjusting each VR activity based on performance to offer a challenging and rewarding therapeutic experience.
Floating biopotential samplings
The disclosed biopotential measurement device may include a front end comprising a biopotential measurement sensor and a back end comprising a processor programmed to process biopotential signals detected by the biopotential measurement sensor. The biopotential measurement device may also include an isolation circuit that, during at least a sampling phase of the biopotential measurement sensor, electrically isolates the front end from the back end. Various other methods, systems, and computer-readable media are also disclosed.
Optimizing 360-degree video streaming with video content analysis
Aspects of the subject disclosure may include, for example, a method performed by a processing system of determining a present orientation of a display region presented at a first time on a display of a video viewer, predicting a future orientation of the display region occurring at a second time based on data collected, to obtain a predicted orientation of the display region to be presented at the second time on the display of the video viewer, identifying, based on the predicted orientation of the display region, a first group of tiles from a video frame of a panoramic video being displayed by the video viewer, wherein the first group of tiles covers the display region in the video frame at the predicted orientation, and a plurality of objects moving in the video frame from the first time to the second time, wherein each object of the plurality of objects is located in a separate spatial region of the video frame at the second time, wherein a second group of tiles collectively covers the separate spatial regions, wherein tiles in the first group of tiles and tiles in the second group of tiles are different, and facilitating wireless transmission of the first group of tiles and a second tile from the second group of tiles, for presentation at the video viewer at the second time. Other embodiments are disclosed.
Face mask for accurate location of sensors relative to a users face, a communication enabling face mask and a communication system including the face mask
Face mask communication system 100 includes face mask 10 worn by user 14 and signal receiving hand glove 16 worn by user 18. Glove 16 includes data receiver 66 for data communication with mask 10 and includes multiple vibrotactile devices for generating haptic signals. Mask 10 includes an elastic element of flexible material, and a plurality of EMG sensors 12 fixed to the element, for sensing electrical activity of face regions of the user's 14 face. Mask 10 includes a processor 60; decoding algorithm 110 and transmitter 62 for, respectively, processing signals from the sensors 12; generating command instructions based on the signals; and wirelessly transmitting the signals to receiver 66 of glove 16. Mask 10 includes thread elements connected to the elastic element of mask 10 enabling tensioning of the element to provide for fitment of mask 10 to users of different sizes, for optimal location sensors 12.
Wearable electronic haptic feedback system for VR/AR and gaming
A wearable Haptic Human Machine Interface (HHMI) receives electrical activity from muscles and nerves of a user. An electrical signal is determined having characteristics based on the received electrical activity. The electrical signal is generated and applied to an object to cause an action dependent on the received electrical activity. The object can be a biological component of the user, such as a muscle, another user, or a remotely located machine such as a drone. Exemplary uses include mitigating tremor, accelerated learning, cognitive therapy, remote robotic, drone and probe control and sensing, virtual and augmented reality, stroke, brain and spinal cord rehabilitation, gaming, education, pain relief, entertainment, remote surgery, remote participation in and/or observation of an event such as a sporting event, biofeedback and remotality. Remotality is the perception of a reality occurring remote from the user. The reality may be remote in time, location and/or physical form. The reality may be consistent with the natural world, comprised of an alternative, fictional world or a mixture of natural and fictional constituents.
Sliced encoding and decoding for remote rendering
Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.
Method and a display device with pixel repartition optimization
A method for presenting an image on a display device (100) includes modifying the image by applying a geometric transformation to the image so that an area of the image on the display device is presented to a viewer with higher density of pixels than that in the rest of the image (S18).
Image generation apparatus and image generation method using frequency lower than display frame rate
Methods and apparatus provide for generating an image by way of acquiring information relating to at least one of a position and a rotation of a camera operated by a user. The image is generated for display on a display unit viewed by the user. A rate at which the image is generated is at a first frequency, which is lower than a second frequency corresponding to a frame rate of the display unit.
System and method for capturing a spatial orientation of a wearable device
A system and method capture a spatial orientation of a wearable device. The system has at least one capturing unit and at least one processor unit. The at least one capturing unit is designed to capture at least one first position parameter in relation to the wearable device and to capture at least one second position parameter in relation to a body part of a person on which the wearable device is arranged. The at least one processor unit is designed to determine a spatial orientation of the wearable device on the basis of the at least one first position parameter and the at least one second position parameter.