H04N13/172

Methods and systems for decoding and rendering a haptic effect associated with a 3D environment

In aspects, methods and apparatus are provided for generating a haptic effect for a three-dimensional (3D) environment that is experienced virtually by a user. The methods may be performed by a processor, and includes receiving media data that describes the 3D environment, wherein the media data includes haptic data which describes a haptic characteristic associated with at least one object, structure, or event in the 3D environment. The method further includes performing a haptic decoding operation and a haptic rendering operation. The decoding operation may include extracting the haptic data from the media data. The haptic rendering operation may include generating a drive signal and communicating the drive signal to a haptic output device to cause the haptic output device to generate a haptic effect at a user peripheral device. Numerous other aspects are provided.

Methods and systems for decoding and rendering a haptic effect associated with a 3D environment

In aspects, methods and apparatus are provided for generating a haptic effect for a three-dimensional (3D) environment that is experienced virtually by a user. The methods may be performed by a processor, and includes receiving media data that describes the 3D environment, wherein the media data includes haptic data which describes a haptic characteristic associated with at least one object, structure, or event in the 3D environment. The method further includes performing a haptic decoding operation and a haptic rendering operation. The decoding operation may include extracting the haptic data from the media data. The haptic rendering operation may include generating a drive signal and communicating the drive signal to a haptic output device to cause the haptic output device to generate a haptic effect at a user peripheral device. Numerous other aspects are provided.

Apparatus, a method and a computer program for viewing volume signalling for volumetric video

There are disclosed various methods, apparatuses and computer program products for viewing volume signalling of volumetric video. In accordance with an embodiment of a method information of a viewing volume appropriate for viewing a volumetric video is obtained. The viewing volume is examined to determine what geometrical shapes describe the viewing volume. One or more geometrical shapes determined for describing the viewing volume are selected, wherein signalling information for the selected one or more geometrical shapes is constructed.

Method for transmitting video, apparatus for transmitting video, method for receiving video, and apparatus for receiving video
11509879 · 2022-11-22 · ·

In accordance with embodiments, a method of transmitting a video includes inter-view redundancy removing pictures for multiple viewing positions; packing inter-view redundancy removed pictures; and/or encoding the packed pictures and/or signaling information including center view generation information, pre-generation information, view synthesis recommendation information and/or reference view information. In accordance with embodiments, a method of receiving a video includes decoding a bitstream of the video based on viewing position and/or viewport information, unpacking pictures in the decoded bitstream; view regenerating the unpacked pictures; and/or view synthesizing the view regenerated pictures.

Enhanced Emotive Engagement with Volumetric Content

A volumetric content enhancement system (“the system”) can annotate at least a portion of a plurality of voxels from a volumetric video with contextual data. The system can determine at least one actionable position within the volumetric video. The system can create an annotated volumetric video that includes the volumetric video, an annotation with the contextual data, and the at least one actionable position. The system can provide the annotated volumetric video to a volumetric content playback system. The system can obtain viewer feedback associated with the viewer and can determine an emotional state of the viewer based, at least in part, upon the viewer feedback. The system can receive viewer position information that identifies a specific actionable position of the viewer. The system can generate manipulation instructions to instruct the volumetric content playback system to manipulate the annotated volumetric content to achieve a desired emotional state of the viewer.

Enhanced Emotive Engagement with Volumetric Content

A volumetric content enhancement system (“the system”) can annotate at least a portion of a plurality of voxels from a volumetric video with contextual data. The system can determine at least one actionable position within the volumetric video. The system can create an annotated volumetric video that includes the volumetric video, an annotation with the contextual data, and the at least one actionable position. The system can provide the annotated volumetric video to a volumetric content playback system. The system can obtain viewer feedback associated with the viewer and can determine an emotional state of the viewer based, at least in part, upon the viewer feedback. The system can receive viewer position information that identifies a specific actionable position of the viewer. The system can generate manipulation instructions to instruct the volumetric content playback system to manipulate the annotated volumetric content to achieve a desired emotional state of the viewer.

Method and device for transmitting video content and method and device for receiving video content

The present disclosure relates to a method and device for transmitting and receiving video content including three-dimensional (3D) data. The method of transmitting video content through a plurality of assets includes identifying whether content transmitted through an asset is a sub-picture; when the content transmitted through the asset is the sub-picture, generating sub-picture asset information comprising information about other sub-pictures constituting a composition picture together with the sub-picture; and transmitting the sub-picture asset information and the content.

POINT CLOUD DATA TRANSMISSION DEVICE, POINT CLOUD DATA TRANSMISSION METHOD, POINT CLOUD DATA RECEPTION DEVICE, AND POINT CLOUD DATA RECEPTION METHOD
20230103016 · 2023-03-30 ·

A point cloud data transmission method, according to embodiments, may comprise the steps of: encoding point cloud data; and/or transmitting the point cloud data. A point cloud data reception method, according to embodiments, may comprise the steps of: receiving point cloud data; decoding the point cloud data; and/or rendering the point cloud data.

METHOD AND APPARATUS FOR PROCESSING MULTI-VIEW VIDEO, DEVICE AND STORAGE MEDIUM
20230086988 · 2023-03-23 ·

A computer device acquires multi-view video data that includes video data of multiple views. The computer device performs view group division on the multi-view video data based on the multiple views to obtain at least one view group. The computer device determines first spatial region information of the at least one view group. The first spatial region information includes information of a three-dimensional spatial region where the at least one view group is located. The computer device encapsulates the multi-view video data and the first spatial region information.

METHOD AND APPARATUS FOR PROCESSING MULTI-VIEW VIDEO, DEVICE AND STORAGE MEDIUM
20230086988 · 2023-03-23 ·

A computer device acquires multi-view video data that includes video data of multiple views. The computer device performs view group division on the multi-view video data based on the multiple views to obtain at least one view group. The computer device determines first spatial region information of the at least one view group. The first spatial region information includes information of a three-dimensional spatial region where the at least one view group is located. The computer device encapsulates the multi-view video data and the first spatial region information.