A system to perform stereo stitching of image frames comprises a stereo camera system and a hardware encoder. The hardware encoder receives a left image stream and a right image stream from the stereo camera system simultaneously and processes the left and right image stream to generate a single stitched encoded frame. The apparatus can also comprise a processor and a memory having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising receiving the left image stream and the right image stream, processing the left and right image streams and generating a single stitched encoded frame.

A system to perform stereo stitching of image frames comprises a stereo camera system and a hardware encoder. The hardware encoder receives a left image stream and a right image stream from the stereo camera system simultaneously and processes the left and right image stream to generate a single stitched encoded frame. The apparatus can also comprise a processor and a memory having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising receiving the left image stream and the right image stream, processing the left and right image streams and generating a single stitched encoded frame.

A point cloud data processing method according to embodiments may comprise a step of encoding and transmitting point cloud data, wherein said encoding comprises encoding a geometry indicating the positions of one or more points of the point cloud data, the step of encoding a geometry further comprises a step of generating an octree of the geometry, and a step of encoding attributes of the one or more points comprises the steps of: generating Morton codes of the one or more points; and rearranging the one or more points on the basis of the octree to generate one or more levels of detail (LOD). The point cloud data processing method according to embodiments may comprise receiving and decoding point cloud data.

A volumetric content enhancement system (“the system”) can annotate at least a portion of a plurality of voxels from a volumetric video with contextual data. The system can determine at least one actionable position within the volumetric video. The system can create an annotated volumetric video that includes the volumetric video, an annotation with the contextual data, and the at least one actionable position. The system can provide the annotated volumetric video to a volumetric content playback system. The system can obtain viewer feedback associated with the viewer and can determine an emotional state of the viewer based, at least in part, upon the viewer feedback. The system can receive viewer position information that identifies a specific actionable position of the viewer. The system can generate manipulation instructions to instruct the volumetric content playback system to manipulate the annotated volumetric content to achieve a desired emotional state of the viewer.

A volumetric content enhancement system (“the system”) can annotate at least a portion of a plurality of voxels from a volumetric video with contextual data. The system can determine at least one actionable position within the volumetric video. The system can create an annotated volumetric video that includes the volumetric video, an annotation with the contextual data, and the at least one actionable position. The system can provide the annotated volumetric video to a volumetric content playback system. The system can obtain viewer feedback associated with the viewer and can determine an emotional state of the viewer based, at least in part, upon the viewer feedback. The system can receive viewer position information that identifies a specific actionable position of the viewer. The system can generate manipulation instructions to instruct the volumetric content playback system to manipulate the annotated volumetric content to achieve a desired emotional state of the viewer.

The information processing apparatus of the present invention is an information processing apparatus that outputs viewpoint information for generation of a virtual viewpoint image based on image data obtained by performing image capturing from directions different from one another by a plurality of image capturing apparatuses and comprises: an acquisition unit configured to acquire viewpoint information having a plurality of virtual viewpoint parameter sets respectively indicating positions and orientations of a virtual viewpoint at a plurality of points in time; a change unit configured to change a virtual viewpoint parameter set included in the viewpoint information based on a user operation during playback of a virtual viewpoint image in accordance with viewpoint information acquired by the acquisition unit; and an output unit configured to output viewpoint information having a virtual viewpoint parameter set changed by the change unit.

The information processing apparatus of the present invention is an information processing apparatus that outputs viewpoint information for generation of a virtual viewpoint image based on image data obtained by performing image capturing from directions different from one another by a plurality of image capturing apparatuses and comprises: an acquisition unit configured to acquire viewpoint information having a plurality of virtual viewpoint parameter sets respectively indicating positions and orientations of a virtual viewpoint at a plurality of points in time; a change unit configured to change a virtual viewpoint parameter set included in the viewpoint information based on a user operation during playback of a virtual viewpoint image in accordance with viewpoint information acquired by the acquisition unit; and an output unit configured to output viewpoint information having a virtual viewpoint parameter set changed by the change unit.

A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

An adjustment device includes a wearable electronic device and a case in which the wearable electronic device is disposed (e.g., seated). The wearable electronic device includes displays (e.g., display apparatuses) which display virtual images for a left eye and a right eye of a user, screen display portions which transmit light sources generated by the displays to the left eye and the right eye, and eye tracking cameras for the left eye and the right eye. The case includes a stator which fixes the wearable electronic device, and a focal lens which is disposed within an eye relief of the fixed wearable electronic device and forms each of images of the virtual images output from the screen display portions of the wearable electronic device on a portion of the case.

An adjustment device includes a wearable electronic device and a case in which the wearable electronic device is disposed (e.g., seated). The wearable electronic device includes displays (e.g., display apparatuses) which display virtual images for a left eye and a right eye of a user, screen display portions which transmit light sources generated by the displays to the left eye and the right eye, and eye tracking cameras for the left eye and the right eye. The case includes a stator which fixes the wearable electronic device, and a focal lens which is disposed within an eye relief of the fixed wearable electronic device and forms each of images of the virtual images output from the screen display portions of the wearable electronic device on a portion of the case.