Systems and methods related to simulated light-in-flight imaging are described. A computing device may execute a light-in-flight engine to process an optical image and a corresponding depth map to produce a light-in-flight image or video that simulates propagation of a wavefront across a scene. The light-in-flight engine may generate an optical simulation output by transforming a depth map to a three-dimensional lift domain to produce a three-dimensional data structure, then convolving the three-dimensional data structure with a convolutional operator, which may define a Gaussian sphere, to produce a filtered three-dimensional data structure. The light-in-flight engine then affine transforms the optical image with an identified slice of the filtered three-dimensional data structure to produce a light-in-flight image.

This disclosure relates to various implementations that dynamically adjust one or more shallow depth of field (SDOF) parameters based on a designated, artificial aperture value. The implementations obtain a designated, artificial aperture value that modifies an initial aperture value for an image frame. The designated, artificial aperture value generates a determined amount of synthetically-produced blur within the image frame. The implementations determine an aperture adjustment factor based on the designated, artificial aperture value in relation to a default so-called “tuning aperture value” (for which the camera's operations may have been optimized). The implementations may then modify, based on the aperture adjustment factor, one or more SDOF parameters for an SDOF operation, which may, e.g., be configured to render a determined amount of synthetic bokeh within the image frame. In response the modified SDOF parameters, the implementations may render an updated image frame that corresponds to the designated, artificial aperture value.

A method and device for processing a light field video is described. The light field video includes a set of image views per unit of time, the light field video being associated with a scene without cuts. In the method a first super-rays representation of reference image views at a given time is determined based on centroids. A second super-rays representation associated with corresponding views of a subsequent set of image views is next determined based on de-projection and re-projection of centroids. The displacement of centroids between the first and second super-rays is determined and then the determined displacement is applied to centroids of the second super-rays representation.

A method to compute a variable number of image planes, which are selected to better represent the scene while reducing the artifacts on produced novel views. This method analyses the structure of the scene by means of a depth map and selects the position in the Z-axis to split the original image into individual layers. The method also determines the number of layers in an adaptive way.

A method and system for calibrating a lens. The method includes defining a plurality of omni-symmetrical regions within the lens, determining one or more localized lens parameters associated with each of the plurality of omni-symmetrical regions, and defining a localized set of calibration parameters for each of the plurality of omni-symmetrical region. The localized set of calibration parameters may then be employed in a computational image application.

An imaging device includes an optical system having a lens stack having at least one lens element, an image sensor, and at least one controller. The at least one lens element is configured to transition between a minimum focus distance and a maximum focus distance. The image sensor is positionally fixed a distance from the lens stack. The imaging device is configured to capture multiple images as the at least one lens element transitions between the minimum focus distance and the maximum focus distance to generate composite, stacked image.

Example embodiments are directed to a system of image enhancement. An interface device is configured to receive as input one or more input images. The one or more input images have one or more exposure values. A processing device is configured to execute an exposure value (EV) resampling module to generate one or more resampled images having exposure values different from the one or more exposure values of the one or more input images. The resampled images have a range of exposure values. The processing device is configured to execute a filtering module to filter the resampled images, and output a set of filtered images. The processing device is configured to execute a blending module to sequentially blend the set of filtered images, and output a merged image.

A method for rendering a non-photorealistic (NPR) content from a set (SI) of at least one image of a same scene is provided. The set of images (SI) is associated with a depth image comprising a set of regions. Each region corresponds to a region of a given depth. The method for rendering a non-photorealistic content includes generation of a segmented image having at least one segmented region generated with a given segmentation scale. The at least one segmented region corresponds to at least one region of the set of regions. A binary edge image is generated in which at least one binary edge region is generated with a given edge extraction scale, the at least one binary edge region corresponding to at least one region of the set of regions. The non-photorealistic content is rendered by combining the segmented image and the binary edge image.

The present invention provides a method for performing high dynamic range low inter-pixel spatial and wavelength crosstalk optical image detection in a camera comprising an Optical Array Device (OAD), a point Photo Detector (PD) and a Photo Detector Array (PDA) sensor. The method comprises imaging incident light from an object onto an image plane of the Optical Array Device (OAD) to form an incident image map; selecting by the OAD and the Point Photo Detector and by the OAD and the Photo Detector Array a plurality of pixels on the incident image map for time-frequency coding; time-frequency coding the selected pixels by the OAD; detecting by the point PD the optical irradiance values of the time-frequency coded pixels output from the OAD; and performing signal processing on the detected optical irradiance values to determine the light intensity of each of the selected pixels.

A system for adjusting the pose of a camera relative to a subject in a scene is provided. The system comprises a camera operable to capture images of a scene; an identification unit configured to identify an object of interest in images of the scene; a pose processor configured to obtain a pose of the object of interest in the scene relative to the camera; a scene analyser operable to determine, based on at least one of the obtained pose of the object of interest and images captured by the camera, a scene quality associated with images captured by the camera. A controller is configured to cause the pose of the camera to be adjusted based on a determination that the scene quality of an image captured at a current pose is less than a threshold value. A corresponding device is also provided.