The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises receiving, by a system comprising a processor, a panoramic image, and employing, by the system, a three-dimensional data from two-dimensional data (3D-from-2D) convolutional neural network model to derive three-dimensional data from the panoramic image, wherein the 3D-from-2D convolutional neural network model employs convolutional layers that wrap around the panoramic image as projected on a two-dimensional plane to facilitate deriving the three-dimensional data.

An aircraft display control system is disclosed. The system comprises one or more displays configured to present a video stream of a surrounding environment to a user of the aircraft, image sensors configured to generate images of the surrounding environment, and a controller configured to execute an enhanced vision system (EVS) module, a synthetic vision system (SVS) module, a combined vision system (CVS) module and a brightness equalization module. The brightness equalization module measures an apparent brightness of a first frame of the video stream and applies a sigmoid transform function to equalize grayscale levels of a second frame of the video stream based on the apparent brightness of the first frame.

An apparatus including a stereo camera and a processor. The stereo camera may comprise a first capture device and a second capture device in a vertical orientation. The first capture device may be configured to generate first pixel data and the second capture device may be configured to generate second pixel data. The processor may be configured to receive the first pixel data and the second pixel data, generate a vertical disparity image in response to the first pixel data and the second pixel data, generate a virtual horizontal disparity image in response to the first pixel data and the vertical disparity image and detect objects by analyzing the vertical disparity image and the virtual horizontal disparity image. An analysis of the virtual horizontal disparity image may enable the processor to detect the objects not detected in the vertical disparity image alone.

Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.

Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.

A motion detection section 30 detects the posture of an HMD worn on the head of a user. A status determination section 32 determines a user's gaze direction and a binocular inclination angle in accordance with the detected posture of the HMD. The binocular inclination angle is the angle between a horizontal plane and a line connecting the left and right eyes of the user. An image identification section 34 determines two images for use in the generation of left- and right-eye parallax images from a plurality of viewpoint images stored in an image storage device 16 in accordance with the user's gaze direction and the binocular inclination angle. An image generation section 36 generates left- and right-eye parallax images from the two identified images. An image supply section 38 supplies the generated parallax images to the HMD.

A motion detection section 30 detects the posture of an HMD worn on the head of a user. A status determination section 32 determines a user's gaze direction and a binocular inclination angle in accordance with the detected posture of the HMD. The binocular inclination angle is the angle between a horizontal plane and a line connecting the left and right eyes of the user. An image identification section 34 determines two images for use in the generation of left- and right-eye parallax images from a plurality of viewpoint images stored in an image storage device 16 in accordance with the user's gaze direction and the binocular inclination angle. An image generation section 36 generates left- and right-eye parallax images from the two identified images. An image supply section 38 supplies the generated parallax images to the HMD.

Disclosed is a data processing method, comprising: receiving M channels of encoded audio data; decoding the M channels of encoded audio data, to acquire space information of an audio corresponding to the M channels of audio data, wherein M is a positive integer; determining Q speaker devices corresponding to the M channels of audio data according to the acquired space information of the audio and position information of the speaker devices, wherein Q is a positive integer; and rendering the M channels of audio data with the determined Q speaker devices. Embodiments of the present invention further provide an acquisition device, a data processing device, and a storage medium.

An image processing system includes an image obtaining unit that obtains images based on capturing from plural directions by plural cameras, an information obtaining unit that obtains viewpoint information indicating a virtual viewpoint, and a generation unit configured to generate virtual viewpoint images on a basis of the obtained images and viewpoint information. The generation unit generates a first virtual viewpoint image outputted to a display apparatus that displays an image for a user to specify a virtual viewpoint and a second virtual viewpoint image outputted to an output destination different from the display apparatus by using at least one of data generated in a process for generating the first virtual viewpoint image by image processing using the plural images obtained by the image obtaining unit and the first virtual viewpoint image, the second virtual viewpoint image having a higher image quality than that of the first virtual viewpoint image.

An image processing system includes an image obtaining unit that obtains images based on capturing from plural directions by plural cameras, an information obtaining unit that obtains viewpoint information indicating a virtual viewpoint, and a generation unit configured to generate virtual viewpoint images on a basis of the obtained images and viewpoint information. The generation unit generates a first virtual viewpoint image outputted to a display apparatus that displays an image for a user to specify a virtual viewpoint and a second virtual viewpoint image outputted to an output destination different from the display apparatus by using at least one of data generated in a process for generating the first virtual viewpoint image by image processing using the plural images obtained by the image obtaining unit and the first virtual viewpoint image, the second virtual viewpoint image having a higher image quality than that of the first virtual viewpoint image.