A method and system are provided for processing image content. In one embodiment the method comprises receiving a plurality of captured contents showing same scene as captured by one or more cameras having a different focal length and depth maps and generating a consensus cube by obtaining depth map estimations from said received contents. The visibility of different objects in then analysed to create a soft visibility cube that provides visibility information about each content. A color cube is then generated by using information from the consensus and soft visibility cube. The color cube is then used to combine different received contents and generate a single image for the plurality of contents received.

Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.

A light field image processing method, a light field image encoder and decoder, and a storage medium are provided. The light field image processing method includes: a light field image decoder parsing a code stream, so as to obtain an initial sub-aperture image; inputting the initial sub-aperture image into a super-resolution reconstruction network, and outputting a reconstructed sub-aperture image, wherein the spatial resolution and the angular resolution of the reconstructed sub-aperture image are both greater than the spatial resolution and the angular resolution of the initial sub-aperture image; and inputting the reconstructed sub-aperture image into a quality enhancement network, and outputting a target sub-aperture image.

Systems and methods for three-dimensional imaging, modeling, mapping, and/or control capabilities in compact size suitable for integration with and/or augmentation of robotic, laparoscopic, and endoscopic surgical systems. The systems including at least one optical source configured to project onto a surgical or endoscopic environment, and at least one camera positioned to capture at least one image of the surgical or endoscopic environment.

The present disclosure relates to the technical field of computer vision and digital image processing, and more particularly to a light field encoded imaging method and apparatus for a scattering scene. The method includes: obtaining scattering light field data, and extracting a refocusing focal stack corresponding to different offset pixels between views from the scattering light field data; transforming an image in the refocusing focal stack into a saturation domain to form a processed focal stack; comparing boundary sharpness degrees of each region in the processed focal stack when refocusing by different offset pixels, and extracting offset pixels corresponding to the sharpest boundary of each region by using a 1-norm operator; and converting the offset pixels into a depth map of a target based on data parameters of the light field.

An image restoration device obtains input data including input image information for each viewpoint, and generates an output image from warped image information generated by warping the input image information using a global transformation information of each viewpoint and disparity information of each viewpoint, using an image restoration model.

Aspects of the present disclosure relate to methods and apparatus for correcting lithography systems. In one implementation, a method of operating a lithography system includes directing first light beams toward a reflective surface of a first substrate using an optical module. The method includes directing the first light beams collected through at least an objective lens toward a camera, and taking a plurality of first images of the first light beams. The method includes directing second light beams at an oblique angle toward a patterned surface of a second substrate using an illumination source disposed below the objective lens. The method includes directing the second light beams collected through at least an objective lens toward a camera, and taking a plurality of second images of the second light beams. The method includes determining a tip correction, a tilt correction, and an optimal vertical position for the optical module.

A method for creating a pair of stereoscopic images is described. The method includes using at least one lightfield camera which receives respective required camera parameters for a left view and a right view. The required camera parameters define a theoretical stereo image pair to acquire respective actual camera parameters for respective sub aperture images that are generated based on the captured image by the lightfield cameras, to determine a best matching sub aperture image for the left view by comparing the required camera parameter for the left view with the actual camera parameters for the respective sub aperture images, to determine a best matching sub aperture image for right view by comparing the required camera parameter for right view with the actual camera parameters for the respective sub aperture images, and to associate the best matching sub aperture image for left view and the best matching sub aperture image for right view as a pair of stereoscopic images.

There is provided an image processing apparatus. A line segment detecting unit detects line segments from an image. An obtainment unit obtains distance information indicating a distance in a depth direction of the image. A selecting unit selects a line segment for vanishing point detection from the line segments detected by the line segment detecting unit. A vanishing point detecting unit detects a vanishing point of the image on a basis of the line segment for vanishing point detection. For each line segment detected by the line segment detecting unit, the selecting unit selects the line segment in a case where the distance indicated by the distance information is in a monotonically changing trend along the line segment.

The invention relates to multicore fiber imaging, such as used in endoscopy. Methods are described for processing images captured with such systems to achieve an improved depth of field image or extract 3D information concerning the images, without requiring the addition of additional optical components. One method for generating an image from light received by an imager via a multiplicity of waveguides includes receiving a digital image containing a plurality of pixels, the digital image including a plurality of regions within it wherein each of said regions corresponds to a waveguide core. Each region includes a plurality of pixels, and a first subset of pixels within each region is defined which at least partly correlates with light having been received at a corresponding core in a first spatial arrangement, the subset including less than all of the pixels within a region. A first image is generated from the first subset of pixels from said regions, combined to form an image over the whole waveguide array. The first spatial arrangement may correspond to a measure of angular dimension of the incident light for that region. In addition to increased depth of field, the modified images provided by the invention allow 3D visualisation of objects, eg. using stereographs or depth mapping techniques.