H04N23/11

METHOD AND SYSTEM FOR JOINT DEMOSAICKING AND SPECTRAL SIGNATURE ESTIMATION
20230239583 · 2023-07-27 ·

Embodiments of the invention provide a method and system that allows parameters of a desired target image to be determined from hyperspectral imagery of scene. The parameters may be representative of various aspects of the scene being imaged, particularly representative of physical properties of the scene. For example, in some medical imaging contexts, the property being imaged may be blood perfusion or oxygenation saturation level information per pixel. In one embodiment the parameters are obtained by collecting lower temporal and spatial resolution hyperspectral imagery, and then building a virtual hypercube of the information having a higher spatial resolution using a spatiospectral aware demosaicking process, the virtual hypercube then being used for estimation of the desired parameters at the higher spatial resolution. Alternatively, in another embodiment, instead of building the virtual hypercube and then performing the estimation, a joint demosaicking and parameter estimation operation is performed to obtain the parameters. Various white level and spectral calibration operations may also be performed to improve the results obtained. While establishing functional and technical requirements of an intraoperative system for surgery, we present iHSI system embodiments that allows for real-time wide-field HSI and responsive surgical guidance in a highly constrained operating theatre. Two exemplar embodiments exploiting state-of-the-art industrial HSI cameras, respectively using linescan and snapshot imaging technology, were investigated by performing assessments against established design criteria and ex vivo tissue experiments. We further report the use of one real-time iHSI embodiment during an ethically-approved in-patient clinical feasibility case study as part of a spinal fusion surgery therefore successfully validating our assumptions that our invention can be seamlessly integrated into the operating theatre without interrupting the surgical workflow.

EVENT-BASED COMPUTATIONAL PIXEL IMAGERS

A computational pixel imaging device that includes an array of pixel integrated circuits for event-based detection and imaging. Each pixel may include a digital counter that accumulates a digital number, which indicates whether a change is detected by the pixel. The counter may count in one direction for a portion of an exposure and count in an opposite direction for another portion of the exposure. The imaging device may be configured to collect and transmit key frames at a lower rate, and collect and transmit delta or event frames at a higher rate. The key frames may include a full image of a scene, captured by the pixel array. The delta frames may include sparse data, captured by pixels that have detected meaningful changes in received light intensity. High speed, low transmission bandwidth motion image video can be reconstructed using the key frames and the delta frames.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
20230003585 · 2023-01-05 ·

An information processing apparatus includes: an information receiver configured to receive imaging data output from an imaging device; and a processing unit configured to generate a color image based on the received imaging data and control a display device to display the generated color image. The processing unit generates a detection frame constituted as plural regions based on the imaging data, controls the display device to display the generated detection frame as being superimposed on the color image, and displays a temperature for each of the plural regions.

MULTI-SENSOR IMAGING COLOR CORRECTION
20230239553 · 2023-07-27 ·

Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

Imaging apparatus, imaging method, and program
11570371 · 2023-01-31 · ·

The present technology relates to an imaging apparatus, an imaging method, and a program that perform appropriate exposure control, to thereby enable a desired object to be appropriately imaged. The present technology includes: an imaging unit including a plurality of pixels having different spectral characteristics; and an exposure control unit setting information associated with exposure control on the plurality of pixels depending on specification information for specifying a kind of a measurement target. Alternatively, the present technology includes: an imaging unit including a plurality of pixels having different spectral characteristics; and an exposure control unit setting information associated with exposure control on the plurality of pixels on the basis of a predicted output value of each of the plurality of pixels based on a spectral characteristic related to a measurement target. The present technology is applicable to an imaging apparatus which senses vegetation, for example.

Electric shaver with imaging capability
11716523 · 2023-08-01 · ·

System and method for improving the shaving experience by providing improved visibility of the skin shaving area. A digital camera is integrated with the electric shaver for close image capturing of shaving area, and displaying it on a display unit. The display unit can be integral part of the electric shaver casing, or housed in a separated device which receives the image via a communication channel. The communication channel can be wireless (using radio, audio or light) or wired, such as dedicated cabling or using powerline communication. A light source is used to better illuminate the shaving area. Video compression and digital image processing techniques are used for providing for improved shaving results. The wired communication medium can simultaneously be used also for carrying power from the electric shaver assembly to the display unit, or from the display unit to the electric shaver.

Electric shaver with imaging capability
11716523 · 2023-08-01 · ·

System and method for improving the shaving experience by providing improved visibility of the skin shaving area. A digital camera is integrated with the electric shaver for close image capturing of shaving area, and displaying it on a display unit. The display unit can be integral part of the electric shaver casing, or housed in a separated device which receives the image via a communication channel. The communication channel can be wireless (using radio, audio or light) or wired, such as dedicated cabling or using powerline communication. A light source is used to better illuminate the shaving area. Video compression and digital image processing techniques are used for providing for improved shaving results. The wired communication medium can simultaneously be used also for carrying power from the electric shaver assembly to the display unit, or from the display unit to the electric shaver.

METHOD AND APPARATUS FOR DETERMINING A REFLECTANCE OF A TARGET OBJECT
20230028946 · 2023-01-26 ·

A method and apparatus for determining a reflectance, of at least a portion of a target object, in at least one selected wavelength range of electromagnetic (EM) radiation are disclosed. The method comprises, for each selected wavelength range, providing a digital image including at least one target object and a plurality of reference objects, each reference object having respective non-identical predetermined reflectance characteristics, with a digital camera arrangement that provides output image data that comprises digital numbers that are responsive to radiation, in only a selected wavelength range, incident at a sensing plane of the digital camera arrangement. A relationship between a first set of the digital numbers is determined and a first set of the respective predetermined reflectance characteristics of the reference objects. Responsive to the relationship, a further set of digital numbers is transformed to allocate a value of reflectance for each of the digital numbers in the further set. For at least a portion of the target object, a corresponding first group of allocated values of reflectance is determined and responsive to the first group of allocated values, determining a reflectance of the portion of the target object.

IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD
20230025022 · 2023-01-26 · ·

An image processing device according to one embodiment comprises a processing unit which receives first Bayer data from an image sensor, receives gyro data from a gyro sensor, and generates, from the first Bayer data, by using the received gyro data, second Bayer data compensated for camera movement.

AUTOMATED DETECTION OF CHEMICAL COMPONENT OF MOVING OBJECT

Image data is obtained that indicates an extent to which one or more objects reflect, scatter, or absorb light at each of multiple wavelength bands, where the image data was collected while a conveyor belt was moving the object(s). The image data is preprocessed by performing an analysis across frequencies and/or performing an analysis across a representation of a spatial dimension. A set of feature values is generated using the image preprocessed image data. A machine-learning model generates an output using to the feature values. A prediction of an identity of a chemical in the one or more objects or a level of one or more chemicals in the object(s) is generated using the output. Data is output indicating the prediction of the identity of the chemical in the object(s) or the level of the one or more chemicals in at least one of the one or more objects.