Methods and apparatus for allowing a user to switch viewing positions and/or perspective while viewing an environment, e.g., as part of a 3D playback/viewing experience, are described. In various embodiments images of the environment are captured using cameras placed at multiple camera positions. During viewing a user can select which camera position he/she would like to experience the environment from. While experiencing the environment from the perspective of a first camera position the user may switch from the first to a second camera position by looking at the second position. A visual indication is provided to the user to indicate that the user can select the other camera position as his/her viewing position. If a user input indicates a desired viewing position change, a switch to the alternate viewing position is made and the user is presented with images captured from the perspective of the user selected alternative viewing position.

A video communication system uses a light field display to present a holographic image of a remote scene (e.g., a hologram of a remote participant). The system may include a local light field display assembly and a controller. The controller generates display instructions based on visual data corresponding to a remote scene received from a remote image capture system (e.g., a remote light field display system). The display instructions cause the local light field display assembly to generate a holographic image of the remote scene.

A video communication system uses a light field display to present a holographic image of a remote scene (e.g., a hologram of a remote participant). The system may include a local light field display assembly and a controller. The controller generates display instructions based on visual data corresponding to a remote scene received from a remote image capture system (e.g., a remote light field display system). The display instructions cause the local light field display assembly to generate a holographic image of the remote scene.

In a computing device for adjusting audio output during playback of 360 video, a 360 video bitstream is received, and the 360 video bitstream separated into video content and audio content. The audio content corresponding to a plurality of audio sources is decoded, wherein a number of audio sources is represented by N. The video content is displayed and the audio content is output through a plurality of output devices, wherein a number of output devices is represented by M. In response to detecting a change in a viewing angle for the video content, a determination is made, for each of the plurality of output devices, of a distribution ratio for each of the plurality of audio sources based on the viewing angle such that N×M distribution ratios are determined; and the audio content is output through each of the plurality of output devices based on the determined N×M distribution ratios.

In one example, a method performed by a processing system including at least one processor includes acquiring a first item of media content from a user, where the first item of media content depicts a subject, acquiring a second item of media content, where the second item of media content depicts the subject, compositing the first item of media content and the second item of media content to create, within a metaverse of immersive content, an item of immersive content that depicts the subject, presenting the item of immersive content on a device operated by the user, and adapting the presenting of the item of immersive content in response to a choice made by the user.

In one example, a method performed by a processing system including at least one processor includes acquiring a first item of media content from a user, where the first item of media content depicts a subject, acquiring a second item of media content, where the second item of media content depicts the subject, compositing the first item of media content and the second item of media content to create, within a metaverse of immersive content, an item of immersive content that depicts the subject, presenting the item of immersive content on a device operated by the user, and adapting the presenting of the item of immersive content in response to a choice made by the user.

In a stereoscopic image recording method (34), it is provided to transform depth information (13) with respect to an image pair (40) of a stereoscopic image (24) based on an alignment angle (23) in order to generate an aligned stereoscopic image (29), the transformed depth information (26) being used in order to generate a complementary image (27) of the stereoscopic image (40) in a computer-aided manner.

In a stereoscopic image recording method (34), it is provided to transform depth information (13) with respect to an image pair (40) of a stereoscopic image (24) based on an alignment angle (23) in order to generate an aligned stereoscopic image (29), the transformed depth information (26) being used in order to generate a complementary image (27) of the stereoscopic image (40) in a computer-aided manner.

Various embodiments are provided which relate to the field of image signal processing, specifically relating to the generation of a depth-view image of a scene from a set of input images of a scene taken at different cameras of a multi-view imaging system. A method comprises obtaining a frame of an image of a scene and a frame of a depth map regarding the frame of the image. A minimum depth and a maximum depth of the scene and a number of depth layers for the depth map are determined. Pixels of the image are projected to the depth layers to obtain projected pixels on the depth layers; and cost values for the projected pixels are determined. The cost values are filtered and a filtered cost value is selected from a layer to obtain a depth value of a pixel of an estimated depth map.

There is provided a video reproduction apparatus, a reproduction method, and a program that can suppress a decline in the degree of immersion of a viewer. A video generation apparatus of the present disclosure acquires a first 3D shape video generated from a plurality of viewpoint videos obtained by capturing images of a subject from different viewpoints, and a second 3D shape video being a video different from the first 3D shape video, and switches a frame to be reproduced, from a frame of the first 3D shape video to a frame of the second 3D shape video on the basis of a state of a viewer viewing the first 3D shape video. The present disclosure may be applied, for example, to a video generation apparatus, a video processing apparatus, a video reproduction apparatus, or the like.