H04N23/957

Imaging device

An imaging device may generate a zoom image corresponding to a plurality of magnifications by adjusting an effective focal length through a multi-layer optical system including an active imaging array having an active imaging lens.

LIGHTWEIGHT CROSS REALITY DEVICE WITH PASSIVE DEPTH EXTRACTION

A wearable display system including multiple cameras and a processor is disclosed. A greyscale camera and a color camera can be arranged to provide a central view field associated with both cameras and a peripheral view field associated with one of the two cameras. One or more of the two cameras may be a plenoptic camera. The wearable display system may acquire light field information using the at least one plenoptic camera and create a world model using the first light field information and first depth information stereoscopically determined from images acquired by the greyscale camera and the color camera. The wearable display system can track head pose using the at least one plenoptic camera and the world model. The wearable display system can track objects in the central view field and the peripheral view fields using the one or two plenoptic cameras, when the objects satisfy a depth criterion.

IMAGING DEVICE

An imaging device may generate a zoom image corresponding to a plurality of magnifications by adjusting an effective focal length through a multi-layer optical system including an active imaging array having an active imaging lens.

Low latency networking of plenoptic data
11722655 · 2023-08-08 · ·

One embodiment provides a method, including: obtaining, using at least one image obtaining sensor of an image capture device, image data; tracking, using a gaze detection sensor, a user's gaze on a display of the image capture device, wherein a plurality of lens tiles are disposed on the display and wherein each of the plurality of lens tiles cover a portion of the display; predicting, using a processor and based on the tracking, a subsequent gaze location on the display that the user's gaze is expected to be directed toward; transmitting, using a processor, additional image data to the display associated with the portion of the plurality of lens tiles the user is currently viewing and the another portion of the display associated with the new set of the plurality of lens tiles; and updating, responsive to identifying that the user's gaze has transitioned to the subsequent gaze location and using the additional image data, the image data associated with the another portion of the display corresponding to the new set of the plurality of lens tiles. Other embodiments are described herein.

Low latency networking of plenoptic data
11722655 · 2023-08-08 · ·

One embodiment provides a method, including: obtaining, using at least one image obtaining sensor of an image capture device, image data; tracking, using a gaze detection sensor, a user's gaze on a display of the image capture device, wherein a plurality of lens tiles are disposed on the display and wherein each of the plurality of lens tiles cover a portion of the display; predicting, using a processor and based on the tracking, a subsequent gaze location on the display that the user's gaze is expected to be directed toward; transmitting, using a processor, additional image data to the display associated with the portion of the plurality of lens tiles the user is currently viewing and the another portion of the display associated with the new set of the plurality of lens tiles; and updating, responsive to identifying that the user's gaze has transitioned to the subsequent gaze location and using the additional image data, the image data associated with the another portion of the display corresponding to the new set of the plurality of lens tiles. Other embodiments are described herein.

FREQUENCY DOMAIN-BASED METHOD FOR REMOVING PERIODIC NOISE FROM RECONSTRUCTED LIGHT FIELD IMAGE
20230306558 · 2023-09-28 ·

A method for removing periodic noise from a reconstructed light field image includes the steps of: acquiring a light field image of a sample; acquiring an optical center position map without the sample; calibrating the imaging centers of the microlenses and performing reconstruction on the light field image; transforming a reconstructed light field image to the frequency domain and generating an image frequency spectrum; preprocessing the image frequency spectrum; generating a low-pass filter; multiplying the low-pass filter with the preprocessed image frequency spectrum, and then setting the frequency spectrum value of the low-frequency component to zero; performing binarization on the reconstructed light field image frequency spectrum to obtain an image mask; removing the high-frequency periodic noise component from the original frequency spectrum of the reconstructed light field image; and transforming the filtered reconstructed light field image frequency spectrum back to the spatial domain to obtain the reconstructed light field image.

FREQUENCY DOMAIN-BASED METHOD FOR REMOVING PERIODIC NOISE FROM RECONSTRUCTED LIGHT FIELD IMAGE
20230306558 · 2023-09-28 ·

A method for removing periodic noise from a reconstructed light field image includes the steps of: acquiring a light field image of a sample; acquiring an optical center position map without the sample; calibrating the imaging centers of the microlenses and performing reconstruction on the light field image; transforming a reconstructed light field image to the frequency domain and generating an image frequency spectrum; preprocessing the image frequency spectrum; generating a low-pass filter; multiplying the low-pass filter with the preprocessed image frequency spectrum, and then setting the frequency spectrum value of the low-frequency component to zero; performing binarization on the reconstructed light field image frequency spectrum to obtain an image mask; removing the high-frequency periodic noise component from the original frequency spectrum of the reconstructed light field image; and transforming the filtered reconstructed light field image frequency spectrum back to the spatial domain to obtain the reconstructed light field image.

Multi-processor support for array imagers

Using the techniques discussed herein, a set of images is captured by one or more array imagers (106). Each array imager includes multiple imagers configured in various manners. Each array imager captures multiple images of substantially a same scene at substantially a same time. The images captured by each array image are encoded by multiple processors (112, 114). Each processor can encode sets of images captured by a different array imager, or each processor can encode different sets of images captured by the same array imager. The encoding of the images is performed using various image-compression techniques so that the information that results from the encoding is smaller, in terms of storage size, than the uncompressed images.

Multi-processor support for array imagers

Using the techniques discussed herein, a set of images is captured by one or more array imagers (106). Each array imager includes multiple imagers configured in various manners. Each array imager captures multiple images of substantially a same scene at substantially a same time. The images captured by each array image are encoded by multiple processors (112, 114). Each processor can encode sets of images captured by a different array imager, or each processor can encode different sets of images captured by the same array imager. The encoding of the images is performed using various image-compression techniques so that the information that results from the encoding is smaller, in terms of storage size, than the uncompressed images.

Optical Foveation for Integral Imaging

A system includes an image sensor coupled to a first optical distortion element, a processing unit, and an electronic display coupled to a second optical distortion element. The image sensor is configured to receive, using a plurality of sensor pixels, a portion of an incoming light field through the first optical distortion element and generate a distorted digitized image from the received portion of the incoming light field. The processing unit is configured to generate a distorted virtual image and to generate a processed distorted image by mixing the distorted virtual image and the distorted digitized image. The electronic display is configured to display, using a plurality of display pixels, the processed distorted image through the second optical distortion element. The second optical distortion element is configured to undistort the processed distorted image in order to produce a portion of an emitted light field.