A portable system providing augmented vision of surroundings. In one embodiment the system includes a helmet, a plurality of camera units and circuitry to generate a composite field of view from channels of video data. The helmet permits a user to receive a first field of view in the surroundings based on optical information received directly from the surroundings with the user's natural vision. The camera units are mounted about the helmet to generate the multiple channels of video data. Each camera channel captures a different field of view of a scene in a region surrounding the helmet.

A transmitting virtual reality (VR) content method is disclosed that includes receive, by a network element, VR content packets transmitted by a VR content server for a single VR content scene and quality of service (QoS) transmission priorities for the VR content packets, wherein the QoS transmission priorities comprise a first QoS transmission priority corresponding to a first plurality of the VR content packets and a second QoS transmission priority corresponding to a second plurality of the VR content packets. In this embodiment, the method also includes transmitting, by the network element, the first plurality of the VR content packets based on the first QoS transmission priority and the second plurality of the VR content packets based on the second transmission priority, wherein the second QoS transmission priority is different from the first QoS transmission priority.

There is disclosed a system and method for streaming of volumetric three-dimensional video content. The system includes a separate rendering server and display device such that the rendering server receives pose and motion data from the mobile device and generates completed frames of video for the mobile device. The frames of video are transmitted to the mobile device for display. Predictive algorithms enable the rendering server to predict display device pose from frame-to-frame to thereby reduce overall latency in communications between the rendering server and display device.

There is disclosed a system and method for streaming of volumetric three-dimensional video content. The system includes a separate rendering server and display device such that the rendering server receives pose and motion data from the mobile device and generates completed frames of video for the mobile device. The frames of video are transmitted to the mobile device for display. Predictive algorithms enable the rendering server to predict display device pose from frame-to-frame to thereby reduce overall latency in communications between the rendering server and display device.

A system and/or method that uses a body posture of a user to determine and modulate a content mode of a virtual reality system. The content mode may define the manner in which virtual reality content is presented to the user and/or the manner in which the user interacts with the virtual reality content. The user's body posture and/or a change in body posture may cause the content mode and/or the virtual reality content to change accordingly. In some implementations, primary content may be presented to the user according to a first content mode in response to the user sitting. Secondary virtual reality content may be presented to the user according to the second content mode in response to the user standing. As such, a user may initiate a change in the virtual reality content and/or the content mode by standing from a sitting posture and/or sitting from a standing posture.

A combined video of a scene may be generated for applications such as virtual reality or augmented reality. In one method, a data store may store video data with a first portion having a first importance metric, and a second portion having a second importance metric, denoting that viewing of the first portion is more likely and/or preferential to viewing of the second portion. The subset may be retrieved and used to generate viewpoint video from a virtual viewpoint corresponding to a viewer's viewpoint. The viewpoint video may be displayed on a display device. One of storing the video data, retrieving the subset, and using the subset to generate the viewpoint video may include, based on the difference between the first and second importance metrics, expediting and/or enhancing performance of the step for the first portion, relative to the second portion.

A combined video of a scene may be generated for applications such as virtual reality or augmented reality. In one method, a data store may store video data with a first portion having a first importance metric, and a second portion having a second importance metric, denoting that viewing of the first portion is more likely and/or preferential to viewing of the second portion. The subset may be retrieved and used to generate viewpoint video from a virtual viewpoint corresponding to a viewer's viewpoint. The viewpoint video may be displayed on a display device. One of storing the video data, retrieving the subset, and using the subset to generate the viewpoint video may include, based on the difference between the first and second importance metrics, expediting and/or enhancing performance of the step for the first portion, relative to the second portion.

A panoramic image system with parallax mitigation includes image sensors, a head tracker, a display, and a processor. Each image sensor is fixedly mounted a predetermined linear distance from a first reference axis and is disposed adjacent to at least one other image sensor and to point in a direction that is offset from its adjacent image sensor by a predetermined angle. The head tracker is configured to sense at least the angular position and movement direction of a viewer's head about a second reference axis and to supply an azimuth position signal representative thereof. The display is configured to selectively display images sensed by each of the image sensors. The processor is in operable communication with the image sensors, head tracker, and display. The processor is configured, based at least on the azimuth position signal, to command the display to display images sensed by only one image sensor.

A panoramic image system with parallax mitigation includes image sensors, a head tracker, a display, and a processor. Each image sensor is fixedly mounted a predetermined linear distance from a first reference axis and is disposed adjacent to at least one other image sensor and to point in a direction that is offset from its adjacent image sensor by a predetermined angle. The head tracker is configured to sense at least the angular position and movement direction of a viewer's head about a second reference axis and to supply an azimuth position signal representative thereof. The display is configured to selectively display images sensed by each of the image sensors. The processor is in operable communication with the image sensors, head tracker, and display. The processor is configured, based at least on the azimuth position signal, to command the display to display images sensed by only one image sensor.

A portable CAVE automatic virtual environment system. The system uses a light weight collapsible frame with an overhead beam that is raised and lowered via a winch and cable. Ultra-short throw projectors are attached to the overhead beam at its lowest position and are raised to their functional position where they are automatically configured to aim at one of the included screens. The projectors display imagery on the screens that form a space around the user. The system auto-calibrates to align the projected imagery to the screens to form a seamless display across all screens. The invention significantly decreases the time and labor to set up and calibrate a CAVE system and collapses into folded parts for easy transport and storage.