A method for presenting a mapping pseudo-hologram using individual video signal output of a real-time engine according to an embodiment of the present disclosure includes: (a) creating a partial viewpoint video including a character of a virtual reality content corresponding to a first user through a camera positioned at any one point in the virtual reality content; (b) creating a hologram video including at least one of objects around the character in the partial viewpoint video; and (c) projecting the hologram video onto a hologram screen placed between the first user and a second user different from the first user, and in the process (c), the hologram video is projected to be overlaid on the first user when the second user sees the first user.

A light field image processing method, a light field image encoder and decoder, and a storage medium are provided. The light field image processing method includes: a light field image decoder parsing a code stream, so as to obtain an initial sub-aperture image; inputting the initial sub-aperture image into a super-resolution reconstruction network, and outputting a reconstructed sub-aperture image, wherein the spatial resolution and the angular resolution of the reconstructed sub-aperture image are both greater than the spatial resolution and the angular resolution of the initial sub-aperture image; and inputting the reconstructed sub-aperture image into a quality enhancement network, and outputting a target sub-aperture image.

The present invention provides an image processing method, including: obtaining a first image using a camera under a display screen; processing the first image using a processor; obtaining a second image using the camera under the display screen; processing the second image using the processor; and generating a superimposed image after superimposing the first sub-image and the second sub-image.

Certain aspects relate to systems and techniques for efficiently recording captured plenoptic image data and for rendering images from the captured plenoptic data. The plenoptic image data can be captured by a plenoptic or other light field camera. In some implementations, four dimensional radiance data can be transformed into three dimensional data by performing a Radon transform to define the image by planes instead of rays. A resulting Radon image can represent the summed values of energy over each plane. The original three-dimensional luminous density of the scene can be recovered, for example, by performing an inverse Radon transform. Images from different views and/or having different focus can be rendered from the luminous density.

This disclosure relates to various implementations that dynamically adjust one or more shallow depth of field (SDOF) parameters based on a designated, artificial aperture value. The implementations obtain a designated, artificial aperture value that modifies an initial aperture value for an image frame. The designated, artificial aperture value generates a determined amount of synthetically-produced blur within the image frame. The implementations determine an aperture adjustment factor based on the designated, artificial aperture value in relation to a default so-called “tuning aperture value” (for which the camera's operations may have been optimized). The implementations may then modify, based on the aperture adjustment factor, one or more SDOF parameters for an SDOF operation, which may, e.g., be configured to render a determined amount of synthetic bokeh within the image frame. In response the modified SDOF parameters, the implementations may render an updated image frame that corresponds to the designated, artificial aperture value.

The present invention relates to improved systems and methods of image processing and more particularly to improved systems and method of image processing using modified image data to produce enhanced data and images using fewer processing cycles and lower system power.

An HMD device identifies a pose of the device and identifies a subset of a plurality of camera viewpoints of a light-field based on the pose. The HMD device interpolates image data of the light-field based on the pose and the subset of the plurality of camera viewpoints to generate an interpolated view; and displays at the HMD device an image based on the interpolated view. By interpolating based on the subset of camera viewpoints, the HMD device can reduce processing overhead and improve the user experience.

A system for establishing a baseline of a stereoscopic imaging device having a microlens array and methods for making and using the same. The system acquires an object distance between the microlens array and an object of interest and selects first and second lenses from the microlens array based upon the acquired object distance. The system likewise can perform simultaneous localization and mapping (SLAM) with the imaging device. In one embodiment, the system can acquire first and second stereoscopic frames with the microlens array. The system thereby can measure rotations of the second stereoscopic frame with an Inertial Measurement Unit (IMU) and match the first and second stereoscopic frames by combining the rotation data with the first and second stereoscopic frames. The system thereby can enable SLAM systems to perform more accurately and more practically in various indoor and/or outdoor environments.

Iris recognition can be accomplished for a wide variety of eye images by using plenoptic imaging. Using plenoptic technology, it is possible to correct focus after image acquisition. One example technology reconstructs images having different focus depths and stitches them together, resulting in a fully focused image, even in an off-angle gaze scenario. Another example technology determines three-dimensional data for an eye and incorporates it into an eye model used for iris recognition processing. Another example technology detects contact lenses. Application of the technologies can result in improved iris recognition under a wide variety of scenarios.

The disclosure relates to an image processing apparatus for determining a depth of a pixel of a reference image of a plurality of images representing a visual scene relative to a plurality of locations, wherein the plurality of locations define a two-dimensional grid with rows and columns and wherein the location of the reference image is associated with a reference row and a reference column of the grid. The image processing apparatus comprises a depth determiner configured to determine a first depth estimate on the basis of the reference image and a first subset of the plurality of images for determining the depth of the pixel of the reference image, wherein the images of the first subset are associated with locations being associated with a row of the grid different than the reference row and with a column of the grid different than the reference column.