Methods and systems for processing video data are provided. For example, a video bitstream can be obtained that includes a video frame of a spherical representation of 360-degree video data. The video frame can include a planar surface of a geometry, and the planar surface can include a plurality of pixels. Three-dimensional coordinates of a target point of the spherical representation can be determined. A planar surface of the geometry to which the target point is to be mapped can also be determined. The planar surface can be determined based on the three-dimensional coordinates of the target point. Two-dimensional coordinates of a mapping location on the planar surface to which the target point is to be mapped can be determined based on the three-dimensional coordinates of the target point and an adaptation parameter. A pixel value can then be generated based on one or more pixels associated with the mapping location. The pixel value can be assigned to the target point.

A video edit of first video content and second video content may be generated based on the fields of view of the first video content and the second video content. Based on the fields of view of the first video content and the second video content, a first viewing window for the first video content and a second viewing window for the second video content may be determined. The viewing windows may define one or more extents of the corresponding visual content. The video edit may include a punchout of the first video content based on the first viewing window and a punchout of the second video content based on the second viewing window.

The present invention provides a method for providing with at least a portion of content having six degrees-of-freedom in a virtual environment, comprising: receiving, by at least one processor, the portion of content for the virtual environment; associating, by the at least one processor, at least one of a first geometric shape and a second geometric shape with the portion of content; projecting, by the at least one processor, the portion of content onto a first point of a surface of the first geometric shape; determining, by the at least one processor, based on the projecting of the portion of content onto the first point, a first outcome relating to the portion of content at the first position; projecting, by the at least one processor, the portion of content onto a second point of the surface of the first geometric shape or of a surface of the second geometric shape, the second point being different than the first point; determining, by the at least one processor, based on the projecting of the portion of content onto the second point, a second outcome relating to the portion of content at a second position in the virtual environment, the second position being different than the first position; and reformatting, by the at least one processor and based on the first outcome and the second outcome, the portion of content to have six degrees-of-freedom providing rotational motion and positional motion in the virtual environment.

Rectilinear viewport extraction from a region of a wide field of view is described using messaging in the video transmission field. Some embodiments pertain to a method that includes receiving a wide field of view video, receiving position data from a remote coupled user device, selecting a region of interest in the video based on the received position data, extracting the region of interest from the video, generating region metadata describing the extracted region of interest, encoding the extracted region of interest of the video, and transmitting the encoded video with the region metadata to the user device.

Systems and methods provide for editing of spherical video data. In one example, a computing device can receive a spherical video (or a video associated with an angular field of view greater than an angular field of view associated with a display screen of the computing device), such as by a built-in spherical video capturing system or acquiring the video data from another device. The computing device can display the spherical video data. While the spherical video data is displayed, the computing device can track the movement of an object (e.g., the computing device, a user, a real or virtual object represented in the spherical video data, etc.) to change the position of the viewport into the spherical video. The computing device can generate a new video from the new positions of the viewport.

A video providing device for providing video content having a plurality of viewpoints, the device includes: a video storage unit operable to store a plurality of versions of a video for each of a plurality of the viewpoints in the video content, the videos being encoded such that each video includes a region of high resolution corresponding to that viewpoint, where a plurality of the videos each include the same region of high resolution, and each video having the same region of high resolution is encoded with a temporal offset of the group of pictures relative to those other videos with the same region of high resolution, the group of pictures offsets defining video switching times for each video, a viewpoint determining unit operable to determine a requested viewpoint in the video content, a timing identification unit operable to identify a next suitable video switching time from amongst the plurality of video switching times, a video selection unit operable to select a video with a high resolution region corresponding to the requested viewpoint and the identified video switching time, and a video transmitting unit operable to transmit the selected video to a video receiving device.

A system, method, and/or instrumentality may be provided for coding a 360-degree video. A picture of the 360-degree video may be received. The picture may include one or more faces associated with one or more projection formats. A first projection format indication may be received that indicates a first projection format may be associated with a first face. A second projection format indication may be received that indicates a second projection format may be associated with a second face. Based on the first projection format, a first transform function associated with the first face may be determined. Based on the second projection format, a second transform function associated with the second face may be determined. At least one decoding process may be performed on the first face using the first transform function and/or at least one decoding process may be performed on the second face using the second transform function.

Systems, methods, and non-transitory computer-readable media can determine at least one salient point of interest in a frame of a content item based at least in part on a saliency prediction model, the saliency prediction model being trained to identify salient points of interest that appear in content items; determine a barrel projection representation for the frame; and apply a view-based projection to the barrel projection representation for the frame, wherein the view-based projection enhances a quality in which a region corresponding to the at least one salient point of interest is presented.

A method displays images of a scene with restrictions. The method includes measuring a first plurality of 3D coordinates and a second plurality of 3D coordinates with a 3D measuring instrument at a first position and a second position. The first plurality of 3D coordinates and the second plurality of 3D coordinates are registered together in a common frame of reference. A trajectory is defined within the scene that includes a plurality of trajectory points, the plurality of trajectory points including a first trajectory point and a second trajectory point. At least one restriction is defined at the first trajectory point. A plurality of 2D images are generated at each trajectory point, a first 2D image is associated with the first trajectory point. The first 2D image is changed based on the at least one restriction. The first 2D image is displayed on a display device.

Rectilinear viewport extraction from a region of a wide field of view is described using messaging in the video transmission field. Some embodiments pertain to a method that includes receiving a wide field of view video, receiving position data from a remote coupled user device, selecting a region of interest in the video based on the received position data, extracting the region of interest from the video, generating region metadata describing the extracted region of interest, encoding the extracted region of interest of the video, and transmitting the encoded video with the region metadata to the user device.