Systems, methods, and non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations to display a three-dimensional (3D) space. The methods may include, with an imaging device, capturing a first series of frames as the imaging device travels from a first location to a second location within a space, and capturing a second series of frames as the imaging device travels from the second location to the first location. The method may also include determining a first segment in the first series of frames that matches a second segment in the second series of frames to create a segmentation dataset, generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips, and displaying the series of video clips.

A communication apparatus for transmitting a virtual viewpoint video receives an acquisition request for a virtual viewpoint video, acquires viewpoint position information indicating a viewpoint position for the virtual viewpoint video from an apparatus that made the acquisition request, and transmits a virtual viewpoint video segment corresponding to the viewpoint position information to the apparatus that made the acquisition request. The virtual viewpoint video is video data in a format in which a video from any viewpoint position in a three-dimensional space can be rendered, and the virtual viewpoint video segment is generated by encoding the virtual viewpoint video as a two-dimensional video based on the viewpoint position information.

A communication apparatus for transmitting a virtual viewpoint video receives an acquisition request for a virtual viewpoint video, acquires viewpoint position information indicating a viewpoint position for the virtual viewpoint video from an apparatus that made the acquisition request, and transmits a virtual viewpoint video segment corresponding to the viewpoint position information to the apparatus that made the acquisition request. The virtual viewpoint video is video data in a format in which a video from any viewpoint position in a three-dimensional space can be rendered, and the virtual viewpoint video segment is generated by encoding the virtual viewpoint video as a two-dimensional video based on the viewpoint position information.

Implementations of the subject technology provide systems and methods for recording an extended reality experience in a way that allows the experience to be played back at a later time from a different viewpoint or perspective. This allows computer-generated content that was rendered for display to a user during the recording, to be re-rendered during playback at the correct time and location in the recording, but from a different perspective. In order to facilitate this type of viewer-centric playback, the recording includes a computer-generated content track that references resources for re-rendering the computer-generated content at each point in time in the recording.

The present technology relates to an information processing apparatus, an information processing method, and a program that enable a configuration of a head mounted display (HMD) to be simplified. There is provided a generation unit configured to generate: first location data regarding a location of self with respect to a real space; second location data regarding a location of another device with respect to self; and third location data regarding a location of the another device with respect to the real space on the basis of the first location data and the second location data. On the basis of the third location data, image data of an image localized in the real space and to be displayed by the another device is generated. The present technology can be applied to, for example, an information processing apparatus that supplies location data representing a location of an HMD to the HMD.

The present technology relates to an information processing apparatus, an information processing method, and a program that enable a configuration of a head mounted display (HMD) to be simplified. There is provided a generation unit configured to generate: first location data regarding a location of self with respect to a real space; second location data regarding a location of another device with respect to self; and third location data regarding a location of the another device with respect to the real space on the basis of the first location data and the second location data. On the basis of the third location data, image data of an image localized in the real space and to be displayed by the another device is generated. The present technology can be applied to, for example, an information processing apparatus that supplies location data representing a location of an HMD to the HMD.

A system and method for generating a depth map from image data in a surgical robotic system that employs a robotic subsystem having a camera assembly with first and second cameras for generating image data. The system and method generates based on the image data a plurality of depth maps, and then converts the plurality of depth maps into a single combined depth map having distance data associated therewith. The system and method can then control the camera assembly based on the distance data in the single combined depth map.

An information processing apparatus according to one embodiment of the present disclosure obtains image capturing information including information representing a position and an orientation of an image capturing device and movement information representing specific movement of the image capturing device; and generates viewpoint information representing a position of a virtual viewpoint and a view direction from the virtual viewpoint for generating a virtual viewpoint video based on the obtained image capturing information and the obtained movement information in a case where a captured image obtained by the image capturing device and the virtual viewpoint video generated based on a plurality of images are switched.

Described are various embodiments of process, system and device to automatically adjust user perception of an input, whereby and adjusted image perception value is variably defined for different input locations to create at least one of a multi-focal effect, a progressive perception adjustment, or the like.

An image processing apparatus obtains information that on a first video and a second video at least one of which is a captured video obtained by an image capturing apparatus, the information related to the first and second videos includes information on first and second viewpoints corresponding to the first and second videos of a same timing. The image processing apparatus, in a case where switching a video to be outputted from the first video to the second video, generates information on a virtual viewpoint corresponding to a period from an end of output of the first video until a start of output of the second video, based on the obtained information on the first viewpoint corresponding to the period and the obtained information on the second viewpoint corresponding to the period.