Embodiments of the invention provide a method and system that allows parameters of a desired target image to be determined from hyperspectral imagery of scene. The parameters may be representative of various aspects of the scene being imaged, particularly representative of physical properties of the scene. For example, in some medical imaging contexts, the property being imaged may be blood perfusion or oxygenation saturation level information per pixel. In one embodiment the parameters are obtained by collecting lower temporal and spatial resolution hyperspectral imagery, and then building a virtual hypercube of the information having a higher spatial resolution using a spatiospectral aware demosaicking process, the virtual hypercube then being used for estimation of the desired parameters at the higher spatial resolution. Alternatively, in another embodiment, instead of building the virtual hypercube and then performing the estimation, a joint demosaicking and parameter estimation operation is performed to obtain the parameters. Various white level and spectral calibration operations may also be performed to improve the results obtained. While establishing functional and technical requirements of an intraoperative system for surgery, we present iHSI system embodiments that allows for real-time wide-field HSI and responsive surgical guidance in a highly constrained operating theatre. Two exemplar embodiments exploiting state-of-the-art industrial HSI cameras, respectively using linescan and snapshot imaging technology, were investigated by performing assessments against established design criteria and ex vivo tissue experiments. We further report the use of one real-time iHSI embodiment during an ethically-approved in-patient clinical feasibility case study as part of a spinal fusion surgery therefore successfully validating our assumptions that our invention can be seamlessly integrated into the operating theatre without interrupting the surgical workflow.

In some examples, a computing device can include a processor resource and a non-transitory memory resource storing machine-readable instructions stored thereon that, when executed, cause the processor resource to: instruct an imaging device to capture an input image, determine image properties of the input image, activate a portion of a plurality of light sources based on a physical location of the plurality of light sources and the determined image properties of the input image, and instruct the imaging device to capture an output image when the portion of the plurality of light sources are activated.

In some examples, a computing device can include a processor resource and a non-transitory memory resource storing machine-readable instructions stored thereon that, when executed, cause the processor resource to: instruct an imaging device to capture an input image, determine image properties of the input image, activate a portion of a plurality of light sources based on a physical location of the plurality of light sources and the determined image properties of the input image, and instruct the imaging device to capture an output image when the portion of the plurality of light sources are activated.

An electrical device includes: a camera assembly that includes an image sensor configured to capture an image of an object and to generate color image data, wherein the image sensor has the green element blocks, the blue element blocks, and the red element blocks arranged in an array of the Bayer format at each pixel position in order to generate color image data, the green element blocks, the blue element blocks, and the red element blocks includes Multiple physical pixel elements respectively, the green element block includes two green physical pixel elements and two white physical pixel elements, the blue element block includes two blue physical pixel elements and two white physical pixel elements, and the red element block includes two red physical pixel elements and two white physical pixel elements; and a main processor that performs image process.

An electrical device includes: a camera assembly that includes an image sensor configured to capture an image of an object and to generate color image data, wherein the image sensor has the green element blocks, the blue element blocks, and the red element blocks arranged in an array of the Bayer format at each pixel position in order to generate color image data, the green element blocks, the blue element blocks, and the red element blocks includes Multiple physical pixel elements respectively, the green element block includes two green physical pixel elements and two white physical pixel elements, the blue element block includes two blue physical pixel elements and two white physical pixel elements, and the red element block includes two red physical pixel elements and two white physical pixel elements; and a main processor that performs image process.

An image capturing device includes: an image capturing element having a first image capturing region that captures an image of a photographic subject and outputs a first signal, and a second image capturing region that captures an image of the photographic subject and outputs a second signal; a setting unit that sets an image capture condition for the first image capturing region to an image capture condition that is different from an image capture condition for the second image capturing region; a correction unit that performs correction upon the second signal, for employment in interpolation of the first signal; and a generation unit that generates an image of the photographic subject that has been captured by the first image capturing region by employing a signal generated by interpolating the first signal according to the second signal as corrected by the correction unit.

Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.

A color correction method is applied to an image correction apparatus having an image sensor, and includes searching a color deviation area within a detection image, analyzing the detection image to estimate a correction color value of the color deviation area, and calibrating the color deviation area by the correction color value to generate a calibrated detection image without color deviation.

In some examples, a sensor apparatus comprises: an array of pixel cells each including one or more photodiodes configured to generate a charge in response to light, and a charge storage device to convert the charge to output a voltage of an array of voltages, one or more an analog-to-digital converter (ADC) configured the convert the array of voltages to first pixel data, and an on-sensor controller configured to input the first pixel data into a machine-learning model to generate output data comprising prediction data associated with one or more features of the first pixel data, generate, based on the prediction data, second pixel data, the second pixel data associated with one or more transformed features of the first pixel data, and send, from the sensor apparatus to a separate receiving apparatus, the second pixel data.

In some examples, a sensor apparatus comprises: an array of pixel cells each including one or more photodiodes configured to generate a charge in response to light, and a charge storage device to convert the charge to output a voltage of an array of voltages, one or more an analog-to-digital converter (ADC) configured the convert the array of voltages to first pixel data, and an on-sensor controller configured to input the first pixel data into a machine-learning model to generate output data comprising prediction data associated with one or more features of the first pixel data, generate, based on the prediction data, second pixel data, the second pixel data associated with one or more transformed features of the first pixel data, and send, from the sensor apparatus to a separate receiving apparatus, the second pixel data.