H04N21/816

TIME SHIFTING EXTENDED REALITY MEDIA

In one example, a method includes presenting an extended reality (XR) experience to a plurality of user devices, wherein the presenting includes presenting a time control along with an XR stream, receiving a first signal from a first user device of the plurality of user devices via the time control, wherein the first signal indicates that a user of the first user device wishes to shift the XR stream to a first point in time that is different from a time that is currently being rendered in the XR stream, and presenting a personal XR environment to the first user device in response to the first signal, wherein the personal XR environment presents the first point in time in the XR stream to the first user device without changing a time point of the XR stream that is currently being presented to other user devices of the plurality of user devices.

Overlay processing method in 360 video system, and device thereof

A 360 image data processing method performed by a 360 video receiving device, according to the present invention, comprises the steps of: receiving 360 image data; acquiring information and metadata on an encoded picture from the 360 image data; decoding the picture on the basis of the information on the encoded picture; and rendering the decoded picture and an overlay on the basis of the metadata, wherein the metadata includes overlay-related metadata, the overlay is rendered on the basis of the overlay-related metadata, and the overlay-related metadata includes information on a region of the overlay.

VIDEO QUALITY ESTIMATION APPARATUS, VIDEO QUALITY ESTIMATION METHOD AND PROGRAM
20230099593 · 2023-03-30 ·

A video quality estimation device for estimating quality to be experienced by a user during viewing of a video includes a video quality estimation unit that calculates a video quality estimation value based on a parameter related to video quality of a high image quality region in the video, a parameter related to video quality of a low image quality region in the video, and a parameter related to a time for switching from a low image quality display state to a high image quality display state.

Omnidirectional video streaming
11575976 · 2023-02-07 · ·

A method and system for streaming video is disclosed. The method and system can include sharing and playing an omnidirectional multi-2D-panel video stream wherein field of view data is obtained from a viewer, and the omnidirectional multi-2D-panel video stream is updated when the field of view data indicates a change in a field of view of the viewer.

POINT CLOUD DATA TRANSMISSION DEVICE, POINT CLOUD DATA TRANSMISSION METHOD, POINT CLOUD DATA RECEPTION DEVICE, AND POINT CLOUD DATA RECEPTION METHOD
20230103016 · 2023-03-30 ·

A point cloud data transmission method, according to embodiments, may comprise the steps of: encoding point cloud data; and/or transmitting the point cloud data. A point cloud data reception method, according to embodiments, may comprise the steps of: receiving point cloud data; decoding the point cloud data; and/or rendering the point cloud data.

CONTENT SERVER AND METHOD SUPPORTING LOW-LATENCY CONTENT STREAMING

A content server and method supporting low-latency content streaming are proposed. The content server may include a communication unit and a controller. The communication unit may perform communication with a user terminal. The controller may calculate coordinates for a current user's location and camera pose and create a three-dimensional (3D) space by using terminal data including an image received from the user terminal upon detecting access of the user terminal. Also, the controller may position an object in the created 3D space, render a video reproduced from a user's viewpoint as a two-dimensional (2D) video, generate server data by segmenting the rendered 2D video, and transmit the generated server data to the user terminal.

Method and apparatus for streaming multi-view 360 degree video

Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.

GEOMETRY MATCHING IN VIRTUAL REALITY AND AUGMENTED REALITY
20230035084 · 2023-02-02 ·

Methods, apparatus and systems for geometric matching of virtual reality (VR) or augmented reality (AR) output contemporaneously with video output formatted for display on a 2D screen include a determination of value sets that when used in image processing cause an off-screen angular field of view of the at least one of the AR output object or the VR output object to have a fixed relationship to at least one of the angular field of view of the onscreen object or of the 2D screen. The AR/VR output object is outputted to an AR/VR display device and the user experience is improved by the geometric matching between objects observed on the AR/VR display device and corresponding objects appearing on the 2D screen.

VIDEO CLIENT OPTIMIZATION DURING PAUSE
20230036383 · 2023-02-02 ·

A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

CONSISTENCE OF ACOUSTIC AND VISUAL SCENES
20230098577 · 2023-03-30 · ·

Media content data of an object is received. Whether a first parameter indicated by a first description of the object in an acoustic scene and a second parameter indicated by a second description of the object in a visual scene are inconsistent is determined. Based on the first parameter indicated by the first description of the object in the acoustic scene and the second parameter indicated by the second description of the object in the visual scene being inconsistent, one of the first description of the object in the acoustic scene and the second description of the object in the visual scene is modified based on another one of the first description and the second description that is not modified, wherein the modified one of the first description and the second description is consistent with the other one of the first description and the second description that is not modified.