H04N13/161

Generating composite video stream for display in VR

A processor system and computer-implemented method may be provided for generating a composite video stream which may combine a background video and a foreground video stream into one stream. For that purpose, a spatially segmented encoding of the background video may be obtained, for example in the form of a tiled stream. The foreground video stream may be received, for example, from a(nother) client device. The foreground video stream may be a real-time stream, e.g., when being used in real-time communication. The image data of the foreground video stream may be inserted into the background video by decoding select segments of the background video, inserting the foreground image data into the decoded background image data of these segments, and by encoding the resulting composite image data to obtain composite segments which, together with the non-processed segments of the background video, form a spatially segmented encoding of a composite video.

Generating composite video stream for display in VR

A processor system and computer-implemented method may be provided for generating a composite video stream which may combine a background video and a foreground video stream into one stream. For that purpose, a spatially segmented encoding of the background video may be obtained, for example in the form of a tiled stream. The foreground video stream may be received, for example, from a(nother) client device. The foreground video stream may be a real-time stream, e.g., when being used in real-time communication. The image data of the foreground video stream may be inserted into the background video by decoding select segments of the background video, inserting the foreground image data into the decoded background image data of these segments, and by encoding the resulting composite image data to obtain composite segments which, together with the non-processed segments of the background video, form a spatially segmented encoding of a composite video.

A METHOD AND APPARATUS FOR CODING AND DECODING VOLUMETRIC VIDEO WITH VIEW-DRIVEN SPECULARITY
20220377302 · 2022-11-24 ·

Methods and devices are provided for encoding, transmitting and decoding 3DoF+ volumetric video. At the encoding stage one input view (among all the input ones) is selected to convey the viewport dependent light effect and its id is transmitted to the decoder as an extra metadata. On the decoder side, when patches coming from this selected view are available for the rendering of the viewport, they are preferentially used regarding the other candidates whatever the view to synthesize position.

A METHOD AND APPARATUS FOR CODING AND DECODING VOLUMETRIC VIDEO WITH VIEW-DRIVEN SPECULARITY
20220377302 · 2022-11-24 ·

Methods and devices are provided for encoding, transmitting and decoding 3DoF+ volumetric video. At the encoding stage one input view (among all the input ones) is selected to convey the viewport dependent light effect and its id is transmitted to the decoder as an extra metadata. On the decoder side, when patches coming from this selected view are available for the rendering of the viewport, they are preferentially used regarding the other candidates whatever the view to synthesize position.

HARDWARE ENCODER FOR STEREO STITCHING
20220377309 · 2022-11-24 ·

A system to perform stereo stitching of image frames comprises a stereo camera system and a hardware encoder. The hardware encoder receives a left image stream and a right image stream from the stereo camera system simultaneously and processes the left and right image stream to generate a single stitched encoded frame. The apparatus can also comprise a processor and a memory having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising receiving the left image stream and the right image stream, processing the left and right image streams and generating a single stitched encoded frame.

HARDWARE ENCODER FOR STEREO STITCHING
20220377309 · 2022-11-24 ·

A system to perform stereo stitching of image frames comprises a stereo camera system and a hardware encoder. The hardware encoder receives a left image stream and a right image stream from the stereo camera system simultaneously and processes the left and right image stream to generate a single stitched encoded frame. The apparatus can also comprise a processor and a memory having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising receiving the left image stream and the right image stream, processing the left and right image streams and generating a single stitched encoded frame.

Hand-held turbine cleaner
11509876 · 2022-11-22 · ·

A hand-held turbine cleaning tool includes front and rear housings coupled to each other, an outlet at one end of the tool, and a top of the tool at an opposed end. The outlet is directed in a first direction away from the top. An inlet is disposed between the outlet and the top and is also directed in the first direction. A diverter valve at the inlet is moveable between on and off positions. The on position directs water flowing into the inlet from the inlet, up to the top in a second direction opposite the first direction, and then down to the outlet in the first direction. A turbine at the top has a turbine shaft that extends outside the tool. An abrasive member is connected to the turbine shaft and is configured to rotate when water flows from the inlet to the outlet.

Methods and apparatus for using track derivations for network based media processing
11509878 · 2022-11-22 · ·

The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing. A media processing entity includes at least one processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the at least one processor, cause the at least one processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and metadata associated with a second track at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the metadata associated with the second track to generate second media data for the second track.

Methods and apparatus for using track derivations for network based media processing
11509878 · 2022-11-22 · ·

The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing. A media processing entity includes at least one processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the at least one processor, cause the at least one processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and metadata associated with a second track at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the metadata associated with the second track to generate second media data for the second track.

Method for transmitting video, apparatus for transmitting video, method for receiving video, and apparatus for receiving video
11509879 · 2022-11-22 · ·

In accordance with embodiments, a method of transmitting a video includes inter-view redundancy removing pictures for multiple viewing positions; packing inter-view redundancy removed pictures; and/or encoding the packed pictures and/or signaling information including center view generation information, pre-generation information, view synthesis recommendation information and/or reference view information. In accordance with embodiments, a method of receiving a video includes decoding a bitstream of the video based on viewing position and/or viewport information, unpacking pictures in the decoded bitstream; view regenerating the unpacked pictures; and/or view synthesizing the view regenerated pictures.