A method and apparatus may be used for performing a scene-based automatic white balance correction. The method may include obtaining an input image. The method may include obtaining a raw image thumbnail. The method may include obtaining an augmented image thumbnail. The method may include computing a histogram from an image thumbnail. The method may include determining a scene classification. The method may include learning a filter. The filter may be learned from one or several different instances of the raw image thumbnail, the augmented image thumbnail, the scene classification, or any combination thereof. The method may include applying the filter to the histogram to determine white balance correction coefficients and obtain a processed image.

One embodiment provides a method comprising receiving an input content, and receiving ambient contextual data indicative of one or more ambient lighting conditions of an environment including a display device. The input content has corresponding metadata that at least partially represents a creative intent indicative of how the input content is intended to be viewed. The method further comprises adaptively correcting the input content based on the ambient contextual data to preserve the creative intent, and providing the corrected input content to the display device for presentation. The adaptively correcting comprises applying automatic white balancing to the input content to correct color tone of the input content.

One embodiment provides a method comprising receiving an input content, and receiving ambient contextual data indicative of one or more ambient lighting conditions of an environment including a display device. The input content has corresponding metadata that at least partially represents a creative intent indicative of how the input content is intended to be viewed. The method further comprises adaptively correcting the input content based on the ambient contextual data to preserve the creative intent, and providing the corrected input content to the display device for presentation. The adaptively correcting comprises applying automatic white balancing to the input content to correct color tone of the input content.

A scanning observation apparatus (10) deflects illumination light with an actuator (25) through an illumination optical system (26) to scan an object (32), subjects light from the object (32) to photoelectric conversion with an optical detector (44), performs processing with an image processor (46), and displays an image of the object (32) on a display (60). A memory (35) stores information on optical characteristics related to chromatic aberration of magnification of the illumination optical system (26) relative to light of predetermined colors. A scanning pattern calculator (45) calculates a scanning pattern, on the object (32), of light of each color using the information. Using the scanning pattern, the image processor (46) calibrates a plot position yielded by a photoelectric conversion signal from the optical detector (44) for light of each color and generates an image of the object (32), thereby more easily correcting the chromatic aberration of magnification.

A scanning observation apparatus (10) deflects illumination light with an actuator (25) through an illumination optical system (26) to scan an object (32), subjects light from the object (32) to photoelectric conversion with an optical detector (44), performs processing with an image processor (46), and displays an image of the object (32) on a display (60). A memory (35) stores information on optical characteristics related to chromatic aberration of magnification of the illumination optical system (26) relative to light of predetermined colors. A scanning pattern calculator (45) calculates a scanning pattern, on the object (32), of light of each color using the information. Using the scanning pattern, the image processor (46) calibrates a plot position yielded by a photoelectric conversion signal from the optical detector (44) for light of each color and generates an image of the object (32), thereby more easily correcting the chromatic aberration of magnification.

A computing device may obtain an input image. The input image may have a white point represented by chrominance values that define white color in the input image. Possibly based on colors of the input image, the computing device may generate a two-dimensional chrominance histogram of the input image. The computing device may convolve the two-dimensional chrominance histogram with a filter to create a two-dimensional heat map. Entries in the two-dimensional heat map may represent respective estimates of how close respective tints corresponding to the respective entries are to the white point of the input image. The computing device may select an entry in the two-dimensional heat map that represents a particular value that is within a threshold of a maximum value in the heat map, and based on the selected entry, tint the input image to form an output image.

Embodiments of the invention provide a method and system that allows parameters of a desired target image to be determined from hyperspectral imagery of scene. The parameters may be representative of various aspects of the scene being imaged, particularly representative of physical properties of the scene. For example, in some medical imaging contexts, the property being imaged may be blood perfusion or oxygenation saturation level information per pixel. In one embodiment the parameters are obtained by collecting lower temporal and spatial resolution hyperspectral imagery, and then building a virtual hypercube of the information having a higher spatial resolution using a spatiospectral aware demosaicking process, the virtual hypercube then being used for estimation of the desired parameters at the higher spatial resolution. Alternatively, in another embodiment, instead of building the virtual hypercube and then performing the estimation, a joint demosaicking and parameter estimation operation is performed to obtain the parameters. Various white level and spectral calibration operations may also be performed to improve the results obtained. While establishing functional and technical requirements of an intraoperative system for surgery, we present iHSI system embodiments that allows for real-time wide-field HSI and responsive surgical guidance in a highly constrained operating theatre. Two exemplar embodiments exploiting state-of-the-art industrial HSI cameras, respectively using linescan and snapshot imaging technology, were investigated by performing assessments against established design criteria and ex vivo tissue experiments. We further report the use of one real-time iHSI embodiment during an ethically-approved in-patient clinical feasibility case study as part of a spinal fusion surgery therefore successfully validating our assumptions that our invention can be seamlessly integrated into the operating theatre without interrupting the surgical workflow.

Embodiments of the invention provide a method and system that allows parameters of a desired target image to be determined from hyperspectral imagery of scene. The parameters may be representative of various aspects of the scene being imaged, particularly representative of physical properties of the scene. For example, in some medical imaging contexts, the property being imaged may be blood perfusion or oxygenation saturation level information per pixel. In one embodiment the parameters are obtained by collecting lower temporal and spatial resolution hyperspectral imagery, and then building a virtual hypercube of the information having a higher spatial resolution using a spatiospectral aware demosaicking process, the virtual hypercube then being used for estimation of the desired parameters at the higher spatial resolution. Alternatively, in another embodiment, instead of building the virtual hypercube and then performing the estimation, a joint demosaicking and parameter estimation operation is performed to obtain the parameters. Various white level and spectral calibration operations may also be performed to improve the results obtained. While establishing functional and technical requirements of an intraoperative system for surgery, we present iHSI system embodiments that allows for real-time wide-field HSI and responsive surgical guidance in a highly constrained operating theatre. Two exemplar embodiments exploiting state-of-the-art industrial HSI cameras, respectively using linescan and snapshot imaging technology, were investigated by performing assessments against established design criteria and ex vivo tissue experiments. We further report the use of one real-time iHSI embodiment during an ethically-approved in-patient clinical feasibility case study as part of a spinal fusion surgery therefore successfully validating our assumptions that our invention can be seamlessly integrated into the operating theatre without interrupting the surgical workflow.

Apparatuses, systems, and methods related to an image processor formed in an array of memory cells are described. An image processor as described herein is configured to reduce complexity and power consumption and/or increase data access bandwidth by performing image processing in the array of memory cells relative to image processing by a host processor external to the memory array. For instance, one apparatus described herein includes sensor circuitry configured to provide an input vector, as a plurality of bits that corresponds to a plurality of color components for an image pixel, and an image processor formed in an array of memory cells. The image processor is coupled to the sensor circuitry to receive the plurality of bits of the input vector. The image processor is configured to perform a color correction operation in the array by performing matrix multiplication on the input vector and a parameter matrix to determine an output vector that is color corrected.

Provided are an image sensor, an imaging apparatus, and a signal processing method. The image sensor includes a filter array, a pixel array, and a processing circuit. The filter array includes a plurality of filter regions each including a plurality of filter units. The processing circuit is configured to: combine the electrical signals generated by the pixels corresponding to each filter unit for outputting as a combined luminance value and forming a first intermediate image; generate a first color signal, a second color signal, and a third color signal based on the electrical signals generated by the pixels corresponding to each filter region; and process the first color signal, the second color signal, and the third color signal to obtain a plurality of second intermediate images representing chrominance values of the filter region, and fuse the first intermediate image and the second intermediate images to obtain a first target image.