H04N13/167

Video client optimization during pause

A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

APPARATUS AND METHOD FOR PROVIDING SPLIT-RENDERED VIRTUAL REALITY IMAGE

An edge server for providing a virtual reality (VR) image is proposed. The server may include a rendering synchronization unit synchronizing a visual field and a margin with a virtual reality device. The server may also include a rendering unit generating a rendered image by rendering a visual field area corresponding to the visual field and a margin area corresponding to the margin based on a rotation center in an entire virtual reality image. The server may further include an encoding unit generating a reduced margin area by dividing a resolution of the margin area by a scaling factor, and encoding the visual field area and the reduced margin area to generate a split virtual reality image including the encoded visual field area and the encoded reduced margin area. The server may further include a streaming transmission unit transmitting the split virtual reality image to the virtual reality device.

THREE DIMENSIONAL STROBO-STEREOSCOPIC IMAGING SYSTEMS AND ASSOCIATED METHODS
20230082607 · 2023-03-16 · ·

A 3D strobo-stereoscopic imaging system includes a rotary drive configured to couple to a sample to be imaged by the system, wherein the rotary drive is configured to rotate the sample about a rotational axis when coupled to the rotary drive, a stroboscopic illuminator, a stroboscopic control module coupled to the rotary drive and the stroboscopic illuminator, wherein the stroboscopic control module is configured to repeatedly activate the stroboscopic illuminator at a frequency that is based on a rotational speed of the sample about the rotational axis, a stereoscopic imaging unit including a pair of laterally spaced cameras orientable in the direction of the sample, and an image reconstruction module coupled to the stereoscopic imaging unit and configured to reconstruct a 3D image of the sample from images produced by the pair of cameras of the stereoscopic imaging unit.

THREE DIMENSIONAL STROBO-STEREOSCOPIC IMAGING SYSTEMS AND ASSOCIATED METHODS
20230082607 · 2023-03-16 · ·

A 3D strobo-stereoscopic imaging system includes a rotary drive configured to couple to a sample to be imaged by the system, wherein the rotary drive is configured to rotate the sample about a rotational axis when coupled to the rotary drive, a stroboscopic illuminator, a stroboscopic control module coupled to the rotary drive and the stroboscopic illuminator, wherein the stroboscopic control module is configured to repeatedly activate the stroboscopic illuminator at a frequency that is based on a rotational speed of the sample about the rotational axis, a stereoscopic imaging unit including a pair of laterally spaced cameras orientable in the direction of the sample, and an image reconstruction module coupled to the stereoscopic imaging unit and configured to reconstruct a 3D image of the sample from images produced by the pair of cameras of the stereoscopic imaging unit.

Multifocal plane based method to produce stereoscopic viewpoints in a DIBR system (MFP-DIBR)
11477434 · 2022-10-18 · ·

Some embodiments of an example method may include receiving an input image with depth information; mapping the input image to a set of focal plane images; orienting the set of focal plane images using head orientation information to provide stereo disparity between left and right eyes; and displaying the oriented set of focal plane images. Some embodiments of another example method may include: receiving a description of three-dimensional (3D) content; receiving, from a tracker, information indicating motion of a viewer relative to a real-world environment; responsive to receiving the information indicating motion of the viewer, synthesizing motion parallax by altering multi-focal planes of the 3D content; and rendering an image to the multi-focal plane display using the altered multi-focal plane rendering.

Multifocal plane based method to produce stereoscopic viewpoints in a DIBR system (MFP-DIBR)
11477434 · 2022-10-18 · ·

Some embodiments of an example method may include receiving an input image with depth information; mapping the input image to a set of focal plane images; orienting the set of focal plane images using head orientation information to provide stereo disparity between left and right eyes; and displaying the oriented set of focal plane images. Some embodiments of another example method may include: receiving a description of three-dimensional (3D) content; receiving, from a tracker, information indicating motion of a viewer relative to a real-world environment; responsive to receiving the information indicating motion of the viewer, synthesizing motion parallax by altering multi-focal planes of the 3D content; and rendering an image to the multi-focal plane display using the altered multi-focal plane rendering.

Signal generating systems for three-dimensional imaging systems and methods thereof

Methods and systems for generating illumination modulation signals, image intensifier gain modulation signals, and image sensor shutter control signals in a three-dimensional image-capturing system with one or more frequency synthesizers is disclosed. The illumination modulation signals, image intensifier gain modulation signals, and image sensor shutter signal are all coherent with one another, being derived from a common clock source. The use of frequency synthesizer concepts allow for the use of rapid modulation phase changes for homodyne operation, and further allow the use of rapid modulation frequency changes to mitigate the effects of inter-camera interference.

Signal generating systems for three-dimensional imaging systems and methods thereof

Methods and systems for generating illumination modulation signals, image intensifier gain modulation signals, and image sensor shutter control signals in a three-dimensional image-capturing system with one or more frequency synthesizers is disclosed. The illumination modulation signals, image intensifier gain modulation signals, and image sensor shutter signal are all coherent with one another, being derived from a common clock source. The use of frequency synthesizer concepts allow for the use of rapid modulation phase changes for homodyne operation, and further allow the use of rapid modulation frequency changes to mitigate the effects of inter-camera interference.

IMAGE PROCESSING APPARATUS, IMAGE DISPLAY SYSTEM, IMAGE DATA TRANSFER APPARATUS, AND IMAGE PROCESSING METHOD
20220329772 · 2022-10-13 · ·

A compression coding section compression-codes an image formed by an image forming section of a server in units of a partial image smaller than one frame, and transmits the compression-coded image to an image processing apparatus via a communication section together with its formation time. An image data acquisition section of the image processing apparatus acquires the transmitted image data, and a decoding decompression section decoding-decompresses the image data for each partial image. An image processing section performs necessary processing for each of the partial images. A display control section outputs data of the partial images to a display device while changing an output target or controlling an output order according to an acquisition status of the data of the partial images.

IMAGE PROCESSING APPARATUS, IMAGE DISPLAY SYSTEM, IMAGE DATA TRANSFER APPARATUS, AND IMAGE PROCESSING METHOD
20220329772 · 2022-10-13 · ·

A compression coding section compression-codes an image formed by an image forming section of a server in units of a partial image smaller than one frame, and transmits the compression-coded image to an image processing apparatus via a communication section together with its formation time. An image data acquisition section of the image processing apparatus acquires the transmitted image data, and a decoding decompression section decoding-decompresses the image data for each partial image. An image processing section performs necessary processing for each of the partial images. A display control section outputs data of the partial images to a display device while changing an output target or controlling an output order according to an acquisition status of the data of the partial images.