A unified imaging device used for detecting and classifying objects in a scene including motion and micro-vibrations by receiving a plurality of images of the scene captured by an imaging sensor of the unified imaging device comprising a light source adapted to project on the scene a predefined structured light pattern constructed of a plurality of diffused light elements, classifying object(s) present in the scene by visually analyzing the image(s), extracting depth data of the object(s) by analyzing position of diffused light element(s) reflected from the object(s), identifying micro-vibration(s) of the object(s) by analyzing a change in a speckle pattern of the reflected diffused light element(s) in at least some consecutive images and outputting the classification, the depth data and data of the one or more micro-vibrations which are derived from the analyses of images captured by the imaging sensor and are hence inherently registered in a common coordinate system.

Amplitude-only Fourier optical processors is capable of processing large-scale matrices in a single time-step and microsecond-short latency. The processors may have a 4f optical system architecture and may employ reprogrammable high-resolution amplitude-only spatial modulators, such as Digital Micromirror Devices (DMD). In addition, methods are provided for obtaining amplitude-only electro-optical convolutions between large matrices displayed by the DMDs. The large matrices on which convolution is performed may be feature maps corresponding to images and kernel matrices used in neural networks classification systems. Analog optical convolutional neural networks are also provided that perform accurate classification tasks on large matrices. In addition, methods are provided for off-chip training the analog optical convolutional neural networks. The training includes building an accurate physical model for the analog optical processor and performing computer simulations of the optical processor according to the physical model. The methods do not need to employ any interferometric scheme.

Amplitude-only Fourier optical processors is capable of processing large-scale matrices in a single time-step and microsecond-short latency. The processors may have a 4f optical system architecture and may employ reprogrammable high-resolution amplitude-only spatial modulators, such as Digital Micromirror Devices (DMD). In addition, methods are provided for obtaining amplitude-only electro-optical convolutions between large matrices displayed by the DMDs. The large matrices on which convolution is performed may be feature maps corresponding to images and kernel matrices used in neural networks classification systems. Analog optical convolutional neural networks are also provided that perform accurate classification tasks on large matrices. In addition, methods are provided for off-chip training the analog optical convolutional neural networks. The training includes building an accurate physical model for the analog optical processor and performing computer simulations of the optical processor according to the physical model. The methods do not need to employ any interferometric scheme.

A display panel and a display device are provided, the display panel has a texture touch surface, and includes a driving circuit layer, a light source array, an image sensor array, and a black matrix layer. The light source array includes a plurality of light sources, the image sensor array includes a plurality of image sensors, the black matrix layer includes a plurality of first light-transmitting openings and a plurality of second light-transmitting openings. The driving circuit layer includes a plurality of light-transmitting portions, and each of the plurality of first light-transmitting openings is arranged corresponding to at least one of the plurality of light-transmitting portions, and in a first light-transmitting opening and a light-transmitting portion that are arranged correspondingly, a plane size of the first light-transmitting opening in a direction parallel to the surface of the display panel is smaller than a plane size of the light-transmitting portion.

A display panel and a display device are provided, the display panel has a texture touch surface, and includes a driving circuit layer, a light source array, an image sensor array, and a black matrix layer. The light source array includes a plurality of light sources, the image sensor array includes a plurality of image sensors, the black matrix layer includes a plurality of first light-transmitting openings and a plurality of second light-transmitting openings. The driving circuit layer includes a plurality of light-transmitting portions, and each of the plurality of first light-transmitting openings is arranged corresponding to at least one of the plurality of light-transmitting portions, and in a first light-transmitting opening and a light-transmitting portion that are arranged correspondingly, a plane size of the first light-transmitting opening in a direction parallel to the surface of the display panel is smaller than a plane size of the light-transmitting portion.

A biometric determination system includes: a face detection unit that detects a position of a face from an image including the face; a temperature acquisition unit that obtains temperatures at a plurality of points of the face; and a biometric determination unit that determines whether or not the face belongs to a living body on the basis of the temperatures at the plurality of points. According to such a biometric determination system, it is possible to properly detect whether or not the face included in the image belongs to a living body.

There is provided a system and method for self-assessment of dental problems that can help in monitoring and improving dental hygiene. The system comprises a camera adapted to capture a plurality of images and/or videos of teeth of a user from multiple angles; a user interface to receive one or more inputs related to a medical condition and habits of the user affecting the teeth; and a processing module connected with the camera and the user interface. The proposed system and method provide a handy solution to the people to keep a check on their dental health themselves.

Methods for operating a motion recognition apparatus are disclosed. In some implementations, a method for recognizing a motion or gesture of an object may include operating an optical sensor device to capture light reflected from the object under illumination by light emitted toward the object, generating, by comparing the emitted light to the reflected light, a depth image including distance information indicating a distance between the optical sensor device and the object, generating, based on the light reflected from the object, an infrared image including infrared image information associated with the object, and determining the motion of the object based on at least one of the depth image and the infrared image.

Various aspects of a systems and method for place recognition based on a 3D point cloud are disclosed herein. A computer-implemented method for place recognition based on a 3D point cloud, comprising: capturing a 3D point cloud of an area in which the mobile agent is traveling; extracting local features of each point in the captured 3D point cloud; generating a global descriptor of each point of the 3D point cloud using a deep neural network, based on the extracted local features; constructing a place descriptor map of the area based on the generated global descriptors; and recognizing the area by using the generated place descriptor map.

In a number of aspects, the invention discloses a device (100) comprising one or more infrared light sources (40, 41); one or more visible light sources (50, 51); an image sensor (10); a processing unit (20) configured to analyze a series of images of a region of interest output by the image sensor; a control unit (30) configured to generate one or more of an activation of the one or more visible light sources or an alarm based on a command received from the processing unit; wherein the analyze comprises detecting a moving foreground in the series of images of the region of interest, tracking one or more characterizing features in the moving foreground and classifying the one or more characterizing features into two of more types of objects of interest, a type of an object of interest determining a command sent by the processing unit to the control unit.