Systems and methods are described for enabling a lensless camera having an image sensor and a mask to be positioned behind a display screen of a device, which allows for the device to have an increased screen-to-body ratio. The image sensor captures an image based on the light that travels through the display screen and the mask. The display screen may include portions between pixel elements that allow light to pass through. The mask may include a pattern, such as an opaque material with portions that allow light to pass through from the portions of the display layer to the image sensor. The image captured by the image sensor may be indiscernible to humans. The system may utilize a trained machine learning model to reconstruct the image, using data about the pattern of the mask, so humans may visually recognize features in the image.

Systems and methods are described for enabling a lensless camera having an image sensor and a mask to be positioned behind a display screen of a device, which allows for the device to have an increased screen-to-body ratio. The image sensor captures an image based on the light that travels through the display screen and the mask. The display screen may include portions between pixel elements that allow light to pass through. The mask may include a pattern, such as an opaque material with portions that allow light to pass through from the portions of the display layer to the image sensor. The image captured by the image sensor may be indiscernible to humans. The system may utilize a trained machine learning model to reconstruct the image, using data about the pattern of the mask, so humans may visually recognize features in the image.

An imaging device includes: a modulator with a first pattern, which is configured to modulate light intensity; an image sensor configured to convert light passing through the modulator to image data, and output the image data; and an image processing unit configured to restore an image on the basis of cross-correlation operation with the image data and pattern data that represents a second pattern.

A lens-free imaging system for generating an image of a scene includes an electromagnetic (EM) radiation sensor; a mask disposed between the EM radiation sensor and the scene; an image processor that obtains signals from the EM radiation sensor while the EM radiation sensor is exposed to the scene; and estimates the image of the scene based on, at least in part, the signals and a transfer function between the scene and the EM radiation sensor.

An interval between a pinhole and a pinhole is set to a first interval at which a degree of superimposition of subject images captured through the corresponding pinholes falls within a predetermined range when an image of a subject located at a distance less than a predetermined distance from the multi-pinhole camera is captured. An interval between the pinhole and a pinhole is set to a second interval narrower than the first interval at which a degree of superimposition of subject images captured through the corresponding pinholes falls within a predetermined range when an image of the subject located at a distance equal to or more than the predetermined distance from the multi-pinhole camera is captured.

An interval between a pinhole and a pinhole is set to a first interval at which a degree of superimposition of subject images captured through the corresponding pinholes falls within a predetermined range when an image of a subject located at a distance less than a predetermined distance from the multi-pinhole camera is captured. An interval between the pinhole and a pinhole is set to a second interval narrower than the first interval at which a degree of superimposition of subject images captured through the corresponding pinholes falls within a predetermined range when an image of the subject located at a distance equal to or more than the predetermined distance from the multi-pinhole camera is captured.

An image processing device includes a noise adder that obtains a captured image from an image capturing device including a mask having at least one aperture, an MPH information obtainer that obtains aperture pattern information corresponding to the pattern of the at least one aperture, the noise adder that adds, to the captured image, noise determined according to the aperture pattern information, and a transmitter that outputs the noise added captured image.

An image processing device includes a noise adder that obtains a captured image from an image capturing device including a mask having at least one aperture, an MPH information obtainer that obtains aperture pattern information corresponding to the pattern of the at least one aperture, the noise adder that adds, to the captured image, noise determined according to the aperture pattern information, and a transmitter that outputs the noise added captured image.

There is provided an adjustment device and an operation method of the adjustment device that enable a positional relationship between a mask and an imaging element in a lensless camera to be adjusted with high accuracy and in a simple manner. When white light as incident light passes through a mask including a transmissive region including a plurality of condenser elements and a light-shielding region and provided at a preceding stage of an imaging element, the mask is adjusted to establish an appropriate positional relationship between the mask and the imaging element on the basis of a color of light corresponding to a wavelength of an image captured by the imaging element. The present disclosure is applicable to a calibration device for a mask and an imaging element in a lensless camera.

There is provided an adjustment device and an operation method of the adjustment device that enable a positional relationship between a mask and an imaging element in a lensless camera to be adjusted with high accuracy and in a simple manner. When white light as incident light passes through a mask including a transmissive region including a plurality of condenser elements and a light-shielding region and provided at a preceding stage of an imaging element, the mask is adjusted to establish an appropriate positional relationship between the mask and the imaging element on the basis of a color of light corresponding to a wavelength of an image captured by the imaging element. The present disclosure is applicable to a calibration device for a mask and an imaging element in a lensless camera.