System, methods, and other embodiments described herein relate to estimating depth using a machine learning (ML) model. In one embodiment, a method includes acquiring image data according to criteria from a detector that uses a lens to resolve multiple angles of light per section of the detector. The method also includes mapping a kernel to the image data according to a view associated with the section and a size of the kernel. The method also includes processing the image data using the ML model to produce the depth according to the size of the kernel.

System, methods, and other embodiments described herein relate to an improved camera system including directional optics to estimate the depth of grayscale and color images. In one embodiment, a camera system includes a graded lens to receive light associated with a scene and resolve multiple angles of the light according to parameters of the graded lens. The camera system also includes a detector that senses the light from the graded lens per pixel to integrate multiple views of the scene into a single image to estimate depth associated with objects and the single image includes data for views of the objects that overlap having resolved angles in association with the parameters.

The present disclosure relates to an image processing apparatus, an image processing method, and a program for performing lens emulation more easily.

An aberration table is generated as a table including converging ray vectors derived from aberrations of a lens selected through a user interface and targeted for emulation. A. light focusing process is performed to generate a virtual captured image taken of an object through the selected lens, by use of the aberration table and a multi-view image. The present disclosure may be applied, for example, to image processing apparatuses, information processing apparatuses, imaging apparatuses, electronic devices, information processing methods, or programs.

An optical sensor device may include an optical sensor that includes a set of sensor elements; an optical filter that includes one or more channels; a phase mask configured to distribute a plurality of light beams associated with a subject in an encoded pattern on an input surface of the optical filter; and one or more processors. The one or more processors may be configured to obtain, from the optical sensor, sensor data associated with the subject and may determine a distance of the subject from the optical sensor device. The one or more processors may select, based on the distance, a processing technique to process the sensor data, wherein the processing technique is an imaging processing technique or a spectroscopic processing technique. The one or more processors may process, using the selected processing technique, the sensor data to generate output data and may provide the output data.

An optical sensor device may include an optical sensor that includes a set of sensor elements; an optical filter that includes one or more channels; a phase mask configured to distribute a plurality of light beams associated with a subject in an encoded pattern on an input surface of the optical filter; and one or more processors. The one or more processors may be configured to obtain, from the optical sensor, sensor data associated with the subject and may determine a distance of the subject from the optical sensor device. The one or more processors may select, based on the distance, a processing technique to process the sensor data, wherein the processing technique is an imaging processing technique or a spectroscopic processing technique. The one or more processors may process, using the selected processing technique, the sensor data to generate output data and may provide the output data.

A camera system comprises: a main control chip, wherein the main control chip includes at least one main control unit; at least one group of cameras, wherein each camera in each group of cameras includes an image acquisition control chip; and at least one pair of bidirectional differential data lines, wherein each pair of bidirectional differential data lines is connected to a single main control unit and all image acquisition control chips in a single group of cameras.

A camera system comprises: a main control chip, wherein the main control chip includes at least one main control unit; at least one group of cameras, wherein each camera in each group of cameras includes an image acquisition control chip; and at least one pair of bidirectional differential data lines, wherein each pair of bidirectional differential data lines is connected to a single main control unit and all image acquisition control chips in a single group of cameras.

Systems and methods for three-dimensional imaging, modeling, mapping, and/or control capabilities in compact size suitable for integration with and/or augmentation of robotic, laparoscopic, and endoscopic surgical systems. The systems including at least one optical source configured to project onto a surgical or endoscopic environment, and at least one camera positioned to capture at least one image of the surgical or endoscopic environment.

A method and system are provided for generating an image from each camera array in a camera array matrix. In one embodiment, the method comprises increasing redundancy between to be captured images from the camera matrix by rotating direction of any cameras disposed in upper and lower rows of said matrix by a 90 degree angle around the roll axis. Then any cameras disposed at the corners of the matrix are rotated in an angle that is less than 90 degrees around the roll axis. Subsequently, the location of central cameras are determined and analysed so that they can be rotated and disposed in a manner that provides both horizontal and vertical compensation for any redundancies.

A sensor assembly is provided. The sensor assembly includes a housing including an opening, a circuit substrate disposed in the inside of the housing, an image sensor electrically connected to the circuit substrate, a light-control member configured to change light transmittance from a light transmission state capable of transmitting external light to a light reflection state capable of reflecting light according to application of power, and a contact member disposed adjacent to the opening and allowing light to pass therethrough. wherein, when viewed from a lateral side, the light-control member is disposed such that a longitudinal extension line of the light-control member and a longitudinal extension line of the contact member may form a predetermined angle therebetween, when the light-control member is in the light transmission state, the image sensor is disposed to obtain an image over the light-control member, and when the light-control member is in the light reflection state, the image sensor is disposed to receive light reflected by the light-control member and light directly incident through the contact member.