Various implementations disclosed herein include devices, systems, and methods that are capable of executing an application on a head-mounted device (HMD) having a first image sensor in a first image sensor configuration. In some implementations, the application is configured for execution on a device including a second image sensor in a second image sensor configuration different than the first image sensor configuration. In some implementations, a request is received from the executing application for image data from the second image sensor. Responsive to the request at the HMD, a pose of a virtual image sensor is determined, image data is generated based on the pose of the virtual image sensor, and the generated image data is provided to the executing application.

An imaging device includes a first optical sensor, and a second optical sensor disposed on the side opposite to the light incidence side with respect to the first optical sensor and bonded to the first optical sensor. The first optical sensor includes a plurality of first pixels disposed two-dimensionally. The second optical sensor includes a plurality of second pixels disposed two-dimensionally. Each of the plurality of first pixels includes an embedded photodiode that generates charge in response to incidence of light in a first wavelength band. Each of the plurality of second pixels includes a charge generation region that generates charge in response to incidence of the light in a second wavelength band, a charge collection region to which the charge is transferred, a photogate electrode that attracts the charge, and a transfer gate electrode that transfers the charge to the charge collection region.

An imaging device includes a first optical sensor, and a second optical sensor disposed on the side opposite to the light incidence side with respect to the first optical sensor and bonded to the first optical sensor. The first optical sensor includes a plurality of first pixels disposed two-dimensionally. The second optical sensor includes a plurality of second pixels disposed two-dimensionally. Each of the plurality of first pixels includes an embedded photodiode that generates charge in response to incidence of light in a first wavelength band. Each of the plurality of second pixels includes a charge generation region that generates charge in response to incidence of the light in a second wavelength band, a charge collection region to which the charge is transferred, a photogate electrode that attracts the charge, and a transfer gate electrode that transfers the charge to the charge collection region.

A dual camera module including a hyperspectral camera module, an apparatus including the same, and a method of operating the apparatus are provided. The dual camera module includes a hyperspectral camera module configured to provide a hyperspectral image of a subject; and an RGB camera module configured to provide an image of the subject, and obtain an RGB correction value applied to correction of the hyperspectral image.

A dual camera module including a hyperspectral camera module, an apparatus including the same, and a method of operating the apparatus are provided. The dual camera module includes a hyperspectral camera module configured to provide a hyperspectral image of a subject; and an RGB camera module configured to provide an image of the subject, and obtain an RGB correction value applied to correction of the hyperspectral image.

Systems and methods for dynamic radiometric thermal imaging compensation. The method includes analyzing a visible light image to determine an emissivity value for each of a plurality of visible light pixels making up the visible light image. The method includes associating each of the plurality of thermal pixels making up a thermal image corresponding to the visible light image with at least one of the plurality of visible light pixels making up the visible light image. The method includes generating a second thermal image by, for each of the plurality of thermal pixels making up the thermal image, determining a temperature value based on the thermal pixel value of the thermal pixel and the emissivity value of the at least one of the plurality of visible light pixels associated with the thermal pixel.

Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.

Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.

To reduce power consumption in an image pickup apparatus that captures a plurality of pieces of image data. An image pickup apparatus includes a signal processing unit and a control unit. The signal processing unit executes, in accordance with a predetermined control signal, either compound-eye processing for synthesizing a plurality of pieces of image data by carrying out signal processing on each of the plurality of pieces of image data or monocular processing for carrying out the signal processing on any one of the plurality of pieces of image data. The control unit supplies the predetermined control signal to the signal processing unit and causes one of the compound-eye processing and the monocular processing to be switched to the other one of the compound-eye processing and the monocular processing, on a basis of a result of a comparison between a measured predetermined physical amount and a predetermined threshold value.

An embodiment of an autofocus system (100, 400) is configured to receive a first signal (102a, 402a) corresponding to a first wavelength range and to receive a second signal (102b, 402b) corresponding to a second wavelength range. The autofocus system (100, 400) is further con-5 figured to determine an output signal (106, 406) comprising a focus setting information using the first signal (102a, 402a) and the second signal (102b, 402b).