A method includes determining a first location, within a first viewing window, of a first eye of a user based on image data from an image sensor. The first viewing window corresponds to a first projector of a plurality of projectors. The method further includes determining a second location, within a second viewing window, of a second eye of the user based on the image data. The second viewing window corresponds to a second projector of the plurality of projectors. The method further includes initiating projection, via the first projector, of a first image depicting a first view of a three-dimensional scene. The first image is selected based on the first location. The method further includes initiating projection, via the second projector, of a second image depicting a second view of the three-dimensional scene. The second image is selected based on the second location.

An apparatus includes an image sensor, a linear actuator, a projector coupled to the linear actuator, and a controller coupled to the image sensor and to the linear actuator. The controller is configured to determine a location of an eye of a user based on image data from the image sensor. The controller is further configured to activate the linear actuator to drive the projector to a position associated with projecting to the eye at the location. The controller is further configured to initiate projection, via the projector, of an image depicting a view of a three-dimensional scene, the image selected based on the location.

Eyewear including a sensor integrated into frame of eyewear. In one example, the sensor comprises a strain gauge, such as a metallic foil gauge, that is configured to sense and measure distortion of the frame when worn by a user and under different force profiles, by measuring a strain in the frame when bent. The measured strain by strain gauge is sensed by a processor, and the processor performs dynamic calibration of image processing based on the measured strain. The distortion measured by the strain gauge is used by the processor to correct calibration of the cameras, and the displays.

A stereoscopic six-degree of freedom viewing experience with a monoscopic 360-degree video is provided. A monoscopic 360-degree video of a subject scene can be processed by analyzing each frame to recover a three-dimensional geometric representation, and recover a camera motion path. Utilizing the recovered three-dimensional geometric representation and camera motion path, a dense three-dimensional geometric representation of the subject scene is generated. The processed video can be provided for stereoscopic display via a device. As motion of the device is detected, novel viewpoints can be stereoscopically synthesized for presentation in real time, so as to provide an immersive virtual reality experience based on the original monoscopic 360-degree video and the detected motion of the device.

A stereoscopic six-degree of freedom viewing experience with a monoscopic 360-degree video is provided. A monoscopic 360-degree video of a subject scene can be processed by analyzing each frame to recover a three-dimensional geometric representation, and recover a camera motion path. Utilizing the recovered three-dimensional geometric representation and camera motion path, a dense three-dimensional geometric representation of the subject scene is generated. The processed video can be provided for stereoscopic display via a device. As motion of the device is detected, novel viewpoints can be stereoscopically synthesized for presentation in real time, so as to provide an immersive virtual reality experience based on the original monoscopic 360-degree video and the detected motion of the device.

A Predictive, Foveated Virtual Reality System may capture views of the world around a user using multiple resolutions. The Predictive, Foveated Virtual Reality System may include one or more cameras configured to capture lower resolution image data for a peripheral field of view while capturing higher resolution image data for a narrow field of view corresponding to a user's line of sight. Additionally, the Predictive, Foveated Virtual Reality System may also include one or more sensors or other mechanisms, such as gaze tracking modules or accelerometers, to detect or track motion. A Predictive, Foveated Virtual Reality System may also predict, based on a user's head and eye motion, the user's future line of sight and may capture image data corresponding to a predicted line of sight. When the user subsequently looks in that direction the system may display the previously captured (and augmented) view.

A Predictive, Foveated Virtual Reality System may capture views of the world around a user using multiple resolutions. The Predictive, Foveated Virtual Reality System may include one or more cameras configured to capture lower resolution image data for a peripheral field of view while capturing higher resolution image data for a narrow field of view corresponding to a user's line of sight. Additionally, the Predictive, Foveated Virtual Reality System may also include one or more sensors or other mechanisms, such as gaze tracking modules or accelerometers, to detect or track motion. A Predictive, Foveated Virtual Reality System may also predict, based on a user's head and eye motion, the user's future line of sight and may capture image data corresponding to a predicted line of sight. When the user subsequently looks in that direction the system may display the previously captured (and augmented) view.

Disclosed is a light guiding valve apparatus including an imaging directional backlight, an illuminator array and an observer tracking system arranged to achieve control of an array of illuminators which may provide a directional display to an observer over a wide lateral and longitudinal viewing range, wherein the number of optical windows presented to the observer as viewing windows is controlled dependent on the lateral and longitudinal position or speed of an observer.

A transmitting virtual reality (VR) content method is disclosed that includes receive, by a network element, VR content packets transmitted by a VR content server for a single VR content scene and quality of service (QoS) transmission priorities for the VR content packets, wherein the QoS transmission priorities comprise a first QoS transmission priority corresponding to a first plurality of the VR content packets and a second QoS transmission priority corresponding to a second plurality of the VR content packets. In this embodiment, the method also includes transmitting, by the network element, the first plurality of the VR content packets based on the first QoS transmission priority and the second plurality of the VR content packets based on the second transmission priority, wherein the second QoS transmission priority is different from the first QoS transmission priority.

A portable system providing augmented vision of surroundings. In one embodiment the system includes a helmet, a plurality of camera units and circuitry to generate a composite field of view from channels of video data. The helmet permits a user to receive a first field of view in the surroundings based on optical information received directly from the surroundings with the user's natural vision. The camera units are mounted about the helmet to generate the multiple channels of video data. Each camera channel captures a different field of view of a scene in a region surrounding the helmet.