Methods, apparatus, and systems that provide flexible encapsulation of volumetric video data in media files are disclosed. In one example aspect, a method for video processing includes receiving three-dimensional (3D) volumetric video data and encoding the three-dimensional volumetric video data into a media file. The 3D volumetric video data corresponds to one or more atlases, each comprising atlas data and one or more two-dimensional (2D) components. The atlas data and the one or more 2D components are stored in one or more media tracks in the media file.

Systems and methods of the invention merge information from multiple image sensors to provide a high dynamic range (HDR) video. The present invention provides for real-time HDR video production using multiple sensors and pipeline processing techniques. According to the invention, multiple sensors with different exposures each produces an ordered stream of frame-independent pixel values. The pixel values are streamed through a pipeline on a processing device. The pipeline includes a kernel operation that identifies saturated ones of the pixel values. The streams of pixel values are merged to produce an HDR video.

Systems and methods of the invention merge information from multiple image sensors to provide a high dynamic range (HDR) video. The present invention provides for real-time HDR video production using multiple sensors and pipeline processing techniques. According to the invention, multiple sensors with different exposures each produces an ordered stream of frame-independent pixel values. The pixel values are streamed through a pipeline on a processing device. The pipeline includes a kernel operation that identifies saturated ones of the pixel values. The streams of pixel values are merged to produce an HDR video.

Systems and methods create and distribute addressable virtual content with interactivity. The virtual content may depict a live event and may be customized for each individual user based on dynamic characteristics (e.g., habits, preferences, etc.) of the user that are captured during user interaction with the virtual content. The virtual content is generated with low latency between the actual event and the live content that allows the user to interactively participate in actions related to the live event. The virtual content may represent a studio with multiple display screens that each show different live content (of the same or different live events), and may also include graphic displays that include related data such as statistics corresponding to the live event, athletes at the event, and so on. The content of the display screens and graphics may be automatically selected based on the dynamic characteristics of the user.

A computer implemented method for controlling a transmission of a video stream is provided. The method comprises estimating a number of bits for a group of pictures, GOP, of the video stream to be transmitted, setting a latency requirement for the transmission of the video stream, determining an average minimum video bitrate across the GOP based on the estimated number of bits and a time corresponding to a time period represented by a duration of the GOP, for video frames in the GOP setting an output bitrate for transmission of a video frame based on the latency requirement and the average minimum video bitrate, and transmitting the video frame using the output bitrate.

Network device, system, method and computer readable medium for video content processing. The network device includes a memory having instructions stored thereon, and a processor configured to execute the instructions to cause the network device: to acquire a main video and a plurality of video stream segments, wherein the plurality of video stream segments are generated by preprocessing a video bullet screen by a server, and the preprocessing comprises jointly dividing the video bullet screen in time and space so that the plurality of video stream segments continuously translate in space by frame with time, the area of the screen used for playing the plurality of video stream segments is divided into continuous N picture units in the horizontal direction, each picture unit is used for playing the corresponding video stream segments, and the time from the left edge of the first frame of the corresponding video stream segment entering the picture unit from the right side of the picture unit to the left edge of the kth frame leaving the picture unit from the left side of the picture unit is T; decoding the main video by a main decoder of the network device; decoding video stream segments corresponding to odd-numbered picture units by a first sub-decoder of the network device, and decoding video stream segments corresponding to even-numbered picture units by a second sub-decoder of the network device; and playing the main video and the plurality of video stream segments.

Network device, system, method and computer readable medium for video content processing. The network device includes a memory having instructions stored thereon, and a processor configured to execute the instructions to cause the network device: to acquire a main video and a plurality of video stream segments, wherein the plurality of video stream segments are generated by preprocessing a video bullet screen by a server, and the preprocessing comprises jointly dividing the video bullet screen in time and space so that the plurality of video stream segments continuously translate in space by frame with time, the area of the screen used for playing the plurality of video stream segments is divided into continuous N picture units in the horizontal direction, each picture unit is used for playing the corresponding video stream segments, and the time from the left edge of the first frame of the corresponding video stream segment entering the picture unit from the right side of the picture unit to the left edge of the kth frame leaving the picture unit from the left side of the picture unit is T; decoding the main video by a main decoder of the network device; decoding video stream segments corresponding to odd-numbered picture units by a first sub-decoder of the network device, and decoding video stream segments corresponding to even-numbered picture units by a second sub-decoder of the network device; and playing the main video and the plurality of video stream segments.

A device for retrieving media includes a memory configured to store media data of a media presentation; and one or more processors implemented in circuitry and configured to: retrieve a manifest file for a media presentation indicating that container parsing of media data of a bitstream can be started at a resync point of a segment of a representation of the media presentation, the resync point being at a position other than a start of the segment and representing a point at which the container parsing of the media data of the bitstream can be started; use the manifest file to form a request to retrieve the media data of the representation starting at the resync point; send the request to initiate retrieval of the media data of the media presentation starting at the resync point; and present the retrieved media data.

A device for retrieving media includes a memory configured to store media data of a media presentation; and one or more processors implemented in circuitry and configured to: retrieve a manifest file for a media presentation indicating that container parsing of media data of a bitstream can be started at a resync point of a segment of a representation of the media presentation, the resync point being at a position other than a start of the segment and representing a point at which the container parsing of the media data of the bitstream can be started; use the manifest file to form a request to retrieve the media data of the representation starting at the resync point; send the request to initiate retrieval of the media data of the media presentation starting at the resync point; and present the retrieved media data.

The present disclosure relates to a method of providing a video stream from a system comprising a main unit and a plurality of sensors, wherein the main unit is configured to receive data from the plurality of sensors, the method comprising the steps of: transmitting a multi-view video stream from the main unit to a client, wherein the multi-view video stream represents a multi-view composed of sensor data views from the plurality of sensors in the system; receiving, in the main unit, a command from the client representing a zoom-in operation; computing an updated multi-view according to the received command; evaluating if the updated multi-view includes an area outside a dominating sensor data view in the updated multi-view that is greater than a predetermined threshold; if the area outside the dominating sensor data view is greater than the predetermined threshold, transmitting a multi-view video stream representing the updated multi-view; if the area outside the dominating sensor data view is less than, or equal to, the predetermined threshold, transmitting a single-view video stream representing the dominating sensor data view. The present disclosure further relates to a system for providing a video stream comprising sensor data views.