Aspects of the disclosure relate to methods, apparatus, and systems for tracking a presence of a body part via a theremin-based sensor and outputting a usable signal. For example, a tracking system includes a signal processor and a theremin circuit including at least one antenna. The theremin circuit detects a varying position of a body part relative to the at least one antenna and outputs an analog signal to the signal processor having a varying frequency or amplitude based on the varying position of the body part relative to the at least one antenna. The digital processor determines a rate of change of the varying frequency or amplitude of the analog signal, determines at least a velocity of the body part based on the rate of change, and outputs a digital signal corresponding to at least the velocity to a system or device coupled to the theremin-based tracking system.

A system and method for integration of body movement computer gaming control and brainwave entrainment comprising an attachment device configured to be attached to a portion of a user's body, a sensor attached to or integrated into the attachment device for detecting movement, a stimulation transducer for providing brainwave entrainment therapy, and a tether and actuator for providing feedback to the user about interactions with the virtual or mixed-reality machines or software applications.

A system and method for integration of body movement computer gaming control and brainwave entrainment comprising an attachment device configured to be attached to a portion of a user's body, a sensor attached to or integrated into the attachment device for detecting movement, a stimulation transducer for providing brainwave entrainment therapy, and a tether and actuator for providing feedback to the user about interactions with the virtual or mixed-reality machines or software applications.

Context-sensitive remote controls for use with electronic devices (e.g., eyewear device). The electronic device is configured to perform activities (e.g., email, painting, navigation, gaming). The context-sensitive remote control includes a display having a display area, a display driver coupled to the display, and a transceiver. The remote control additionally includes memory that stores controller layout configurations for display in the display area of the display by the display driver. A processor in the context-sensitive remote control is configured to establish, via the transceiver, communication with an electronic device, detect an activity currently being performed by the electronic device, select one of the controller layout configurations responsive to the detected activity, and present, via the display driver, the selected controller layout configuration in the display area of the display.

Context-sensitive remote controls for use with electronic devices (e.g., eyewear device). The electronic device is configured to perform activities (e.g., email, painting, navigation, gaming). The context-sensitive remote control includes a display having a display area, a display driver coupled to the display, and a transceiver. The remote control additionally includes memory that stores controller layout configurations for display in the display area of the display by the display driver. A processor in the context-sensitive remote control is configured to establish, via the transceiver, communication with an electronic device, detect an activity currently being performed by the electronic device, select one of the controller layout configurations responsive to the detected activity, and present, via the display driver, the selected controller layout configuration in the display area of the display.

A system may enable a plurality of users to engage a plurality of different devices, which operate on a respective platform of a plurality of different platforms, in a time dependent manner. The system may include a data management apparatus (DMA). The DMA may include a local DMA associated with the plurality of different devices. The DMA may include a remote DMA configured to receive and collate a plurality of data inputs from the plurality of devices in a synchronized manner, generate and relay a merged standardized data output to the plurality of devices. When demerged, the merged standardized data output may provide the plurality of devices access to the plurality of experiences for which each of the plurality of devices is enabled. The DMA may be configured to take a time dependent frame from each of the plurality of users and merge them to form a merged frame.

A system may enable a plurality of users to engage a plurality of different devices, which operate on a respective platform of a plurality of different platforms, in a time dependent manner. The system may include a data management apparatus (DMA). The DMA may include a local DMA associated with the plurality of different devices. The DMA may include a remote DMA configured to receive and collate a plurality of data inputs from the plurality of devices in a synchronized manner, generate and relay a merged standardized data output to the plurality of devices. When demerged, the merged standardized data output may provide the plurality of devices access to the plurality of experiences for which each of the plurality of devices is enabled. The DMA may be configured to take a time dependent frame from each of the plurality of users and merge them to form a merged frame.

A display control apparatus includes: a head mounted display information acquisition block configured to acquire information indicative of a position of a head mounted display worn on a head of a user; an input apparatus information acquisition block configured to acquire information indicative of a position of an input apparatus for use by the user; an instruction input acquisition block configured to acquire information indicative of an instruction entered in the input apparatus; and an image generation block configured to generate an image to be displayed on the head mounted display on a basis of an instruction acquired by the instruction input acquisition block. The image generation block displays an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus.

A display control apparatus includes: a head mounted display information acquisition block configured to acquire information indicative of a position of a head mounted display worn on a head of a user; an input apparatus information acquisition block configured to acquire information indicative of a position of an input apparatus for use by the user; an instruction input acquisition block configured to acquire information indicative of an instruction entered in the input apparatus; and an image generation block configured to generate an image to be displayed on the head mounted display on a basis of an instruction acquired by the instruction input acquisition block. The image generation block displays an image of the input apparatus at a position in the image determined on a basis of a relative position with the head mounted display of the input apparatus.

Systems and methods for reducing latency through motion estimation and compensation techniques are disclosed. The systems and methods include a client device that uses transmitted lookup tables from a remote server to match user input to motion vectors, and tag and sum those motion vectors. When a remote server transmits encoded video frames to the client, the client decodes those video frames and applies the summed motion vectors to the decoded frames to estimate motion in those frames. In certain embodiments, the systems and methods generate motion vectors at a server based on predetermined criteria and transmit the generated motion vectors and one or more invalidators to a client, which caches those motion vectors and invalidators. The server instructs the client to receive input from a user, and use that input to match to cached motion vectors or invalidators. Based on that comparison, the client then applies the matched motion vectors or invalidators to effect motion compensation in a graphic interface. In other embodiments, the systems and methods cache repetitive motion vectors at a server, which transmits a previously generated motion vector library to a client. The client stores the motion vector library, and monitors for user input data. The server instructs the client to calculate a motion estimate from the input data and instructs the client to update the stored motion vector library based on the input data, so that the client applies the stored motion vector library to initiate motion in a graphic interface prior to receiving actual motion vector data from the server. In this manner, latency in video data streams is reduced.