Some embodiments provide a mobile device configured to guide a user, via an augmented reality (AR) interface generated by the mobile device, to capture images of the physical object using a camera of the mobile device. The mobile device may be configured to obtain boundary information indicative of a boundary enclosing the physical object (e.g., a box enclosing the physical object). The mobile device may be configured to use the boundary information to determine positions from which the user is to capture images of the physical object. The mobile device may be configured to guide the user to capture the images using the AR interface by guiding the user to each of the positions in the AR interface (e.g., by generating on or more GUI elements in the AR interface that indicate a position from which the user is to capture an image).

Some embodiments provide a mobile device configured to guide a user, via an augmented reality (AR) interface generated by the mobile device, to capture images of the physical object using a camera of the mobile device. The mobile device may be configured to obtain boundary information indicative of a boundary enclosing the physical object (e.g., a box enclosing the physical object). The mobile device may be configured to use the boundary information to determine positions from which the user is to capture images of the physical object. The mobile device may be configured to guide the user to capture the images using the AR interface by guiding the user to each of the positions in the AR interface (e.g., by generating on or more GUI elements in the AR interface that indicate a position from which the user is to capture an image).

An apparatus includes an interface circuit and a control circuit. The interface circuit may be configured to receive pixel data corresponding to a field of view of a camera. The control circuit may be configured to process the pixel data arranged as video frames and control an exposure time for capturing the pixel data and a turn on time of a structured light pattern to obtain a sequence of images comprising at least one image including the structured light pattern and at least one image where the structured light pattern is absent. The control circuit may be further configured to perform a depth analysis to generate depth information using the at least one image including the structured light pattern. The control circuit may store and execute an artificial neural network trained to (i) discern whether a face is at least one of a real face and a fake face, and (ii) make a liveness determination utilizing the depth information.

Provided are an image processing apparatus, an image processing method, and a program that can highly efficiently execute a generation process of a color image based on an image including a plurality of pixel sets each including a plurality of single-color pixels arranged in a predetermined color pattern, in which the pixel sets are vertically and horizontally arranged side by side. An intermediate image generation unit (64) generates, based on a basic image, an intermediate image in which pixel values of a plurality of basic pixels included in the pixel set are set as values of intermediate pixel data of one intermediate pixel associated with the pixel set. A pixel value determination unit (70) determines pixel values of a plurality of colors of at least one final pixel associated with a target intermediate pixel based on values of the intermediate pixel data of the target intermediate pixel and values of the intermediate pixel data of the intermediate pixel adjacent to the target intermediate pixel. A final image generation unit (72) generates a final image based on pixel values of a plurality of colors of a plurality of final pixels.

A system and method may include capturing a multi-channel polarimetric image and a multi-channel RGB image of a scene by a color polarimetric imaging camera. A multi-channel hyperspectral image may be synthesized from the multi-channel RGB image and concatenated with the multi-channel polarimetric image to create an integrated polarimetric-hyperspectral image. Scene properties within the integrated polarimetric-hyperspectral image may be disentangled.

A three-dimensional shape measuring method includes: projecting a first grid pattern based on a first light and a first full pattern based on a second light onto a target object, the first light and the second light being lights of two colors included in three primary colors of light; picking up, by a three-color camera, an image of the first grid pattern and the first full pattern projected on the target object, and acquiring a first picked-up image based on the first light and a second picked-up image based on the second light; and calculating height information of the target object, using the first picked-up image, and calculating position information of the target object, using the second picked-up image.

An apparatus includes an RGB-IR image sensor, a structured light projector, and a control circuit. The control circuit may be configured to control a shutter exposure time of the RGB-IR image sensor and a turn on time of the structured light projector to obtain a sequence of images captured by the RGB-IR image sensor, wherein the sequence of images comprises at least one image including a structured light pattern and at least one image where the structured light pattern is absent.

In an example embodiment, an image processing device includes a pixel array including pixels two-dimensionally arranged and configured to capture an image, each of the pixels including a plurality of photoelectric conversion elements and an image data processing circuit configured to generate image data from pixel signals output from the pixels. The image processing device further includes a color data processing circuit configured to extract color data from the image data and output extracted color data. The image processing device further includes a depth data extraction circuit configured to extract depth data from the image data and output extracted depth data. The image processing device further includes an output control circuit configured to control the output of the color data and the depth data.

In an example embodiment, an image processing device includes a pixel array including pixels two-dimensionally arranged and configured to capture an image, each of the pixels including a plurality of photoelectric conversion elements and an image data processing circuit configured to generate image data from pixel signals output from the pixels. The image processing device further includes a color data processing circuit configured to extract color data from the image data and output extracted color data. The image processing device further includes a depth data extraction circuit configured to extract depth data from the image data and output extracted depth data. The image processing device further includes an output control circuit configured to control the output of the color data and the depth data.

There are several types of plenoptic devices and camera arrays available on the market, and all these light field acquisition devices have their proprietary file format. However, there is no standard supporting the acquisition and transmission of multi-dimensional information. It is interesting to obtain information related to a correspondence between pixels of a sensor of said optical acquisition system and an object space of said optical acquisition system. Indeed, knowing which portion of the object space of an optical acquisition system a pixel belonging to the sensor of said optical acquisition system is sensing enables the improvement of signal processing operations. The notion of pixel beam, which represents a volume occupied by a set of rays of light in an object space of an optical system of a camera along with a compact format for storing such information is thus introduce.