G01J2003/1217

METHOD AND SYSTEM FOR JOINT DEMOSAICKING AND SPECTRAL SIGNATURE ESTIMATION
20230239583 · 2023-07-27 ·

Embodiments of the invention provide a method and system that allows parameters of a desired target image to be determined from hyperspectral imagery of scene. The parameters may be representative of various aspects of the scene being imaged, particularly representative of physical properties of the scene. For example, in some medical imaging contexts, the property being imaged may be blood perfusion or oxygenation saturation level information per pixel. In one embodiment the parameters are obtained by collecting lower temporal and spatial resolution hyperspectral imagery, and then building a virtual hypercube of the information having a higher spatial resolution using a spatiospectral aware demosaicking process, the virtual hypercube then being used for estimation of the desired parameters at the higher spatial resolution. Alternatively, in another embodiment, instead of building the virtual hypercube and then performing the estimation, a joint demosaicking and parameter estimation operation is performed to obtain the parameters. Various white level and spectral calibration operations may also be performed to improve the results obtained. While establishing functional and technical requirements of an intraoperative system for surgery, we present iHSI system embodiments that allows for real-time wide-field HSI and responsive surgical guidance in a highly constrained operating theatre. Two exemplar embodiments exploiting state-of-the-art industrial HSI cameras, respectively using linescan and snapshot imaging technology, were investigated by performing assessments against established design criteria and ex vivo tissue experiments. We further report the use of one real-time iHSI embodiment during an ethically-approved in-patient clinical feasibility case study as part of a spinal fusion surgery therefore successfully validating our assumptions that our invention can be seamlessly integrated into the operating theatre without interrupting the surgical workflow.

IMAGING DEVICE WITH SPECTROMETER AND METHODS FOR USE THEREWITH
20230213386 · 2023-07-06 · ·

A user device for imaging a scene includes a first plurality of optical sensors coupled to a substrate for collecting an image of a scene and a second plurality of optical sensors coupled to the substrate for collecting spectral information from the image. A plurality of sets of interference filters are associated with the second plurality of optical sensors, where each interference filter of a set of interference filters is configured to pass light in one of a plurality of wavelength ranges to one or more optical sensors of the second plurality of optical sensors and each optical sensor of the plurality of optical sensors is associated with a spatial area of the image. A processor is adapted to receive an output from the first plurality of optical sensors and the second plurality of optical sensors and determine, based on the spectral information, a target area within the scene. The processor is further adapted to retrieve focus data for the scene, determine a focus distance for the target area and output user-perceptible information to an output display.

SPECTRAL FILTER, AND IMAGE SENSOR AND ELECTRONIC DEVICE INCLUDING THE SPECTRAL FILTER

A spectral filter may include a plurality of filter arrays each including a plurality of unit filters having different center wavelengths from each other. Each of the plurality of unit filters may include a first metal reflection layer and a second metal reflection layer which are disposed to be apart from each other; a cavity including a first pattern and being arranged between the first metal reflection layer and the second metal reflection layer; and a lower pattern film being disposed under the first metal reflection layer and including a second pattern. In unit filters having a same center wavelength in each of the plurality of unit filters corresponding to the plurality of filter arrays, the first pattern of the cavity and the second pattern of the lower pattern film may vary according to a position of the unit filters.

Imaging apparatus

An imaging apparatus includes an image sensor, a filter array disposed on an optical path from a target object to the image sensor and including two-dimensionally-arranged optical filters, and a processing circuit that generates at least four pieces of spectral image data based on an image acquired by the image sensor. The optical filters include various types of optical filters with different spectral transmittance. Each of the at least four pieces of spectral image data indicates an image corresponding to one of at least four wavelength bands. The filter array includes at least one characteristic section. The processing circuit detects a relative position between the filter array and the image sensor based on the at least one characteristic section in the image acquired by the image sensor, and compensates for deviation between the relative position and a preliminarily-set relative position when the processing circuit detects the deviation.

SPECTRAL IMAGING AND ANALYSIS FOR REMOTE AND NONINVASIVE DETECTION OF PLANT RESPONSES TO HERBICIDE TREATMENTS
20220397517 · 2022-12-15 ·

An approach to remotely and noninvasively detect and evaluate the response of a plant or plant population to a man-made or natural treatment regime (e.g., herbicide, fungicide or fertilizer treatment) via spectral imaging methods and systems comprising the capture of a plurality of spectral images for a common plant scene, each associated with a selected wavelength region of the electromagnetic spectrum, the formulation of an index function from the spectral information indicative of the plant response over time, and the assessment of mathematical parameters quantifying the time-varying plant response to the treatment regime. The plant response to a treatment regime may be quantified in illustrative embodiments in a fraction of the time previously required by many conventional approaches. Applying varying herbicide dosages to segments of the same plant population enables easy determination of a dose-response curve.

Optical filter, optical filter system, spectrometer and method of fabrication thereof

A nano-structured optical wavelength transmission filter is provided. The optical filter includes a patterned substrate on which a high refractive index dielectric waveguide is arranged. A low index dielectric layer is arranged on the high refractive index dielectric waveguide, on which an array of metallic nanostructures is arranged. The layers of the optical filter have conformal shapes defined by a patterned surface of the substrate. An optical filter system includes the optical transmission filter and a detector array fixed to the substrate. A spectrometer includes at least one optical transmission filter and/or at least one said optical transmission filter system, and has a spectral resolution of lower than 30 nm for incident light having a wavelength between 300 nm and 790 nm. A method of fabrication of an optical filter, an optical filter system and a spectrometer is also described.

IMAGING APPARATUS
20220368865 · 2022-11-17 ·

An imaging apparatus includes an image sensor, a filter array disposed on an optical path from a target object to the image sensor and including two-dimensionally-arranged optical filters, and a processing circuit that generates at least four pieces of spectral image data based on an image acquired by the image sensor. The optical filters include various types of optical filters with different spectral transmittance. Each of the at least four pieces of spectral image data indicates an image corresponding to one of at least four wavelength bands. The filter array includes at least one characteristic section. The processing circuit detects a relative position between the filter array and the image sensor based on the at least one characteristic section in the image acquired by the image sensor, and compensates for deviation between the relative position and a preliminarily-set relative position when the processing circuit detects the deviation.

Method and apparatus for imaging circadiometer
11503195 · 2022-11-15 ·

A system and method for an imaging circadiometer that measures the spatial distribution of eye-mediated, non-image-forming optical radiation within the visible spectrum.

MODULATOR, IMAGING APPARATUS, AND DESIGN METHOD
20230090261 · 2023-03-23 ·

A modulator (300) according to the embodiment is a modulator provided between a diffraction grating (944) and an image sensor (946), receives a light ray directed to the image sensor (946) from the diffraction grating (944), and changes a travel direction of the light ray emitted toward the image sensor (946) so as to bend a recording direction of a diffraction image for each wavelength of the light ray on a light receiving surface of the image sensor (946).

Spectral sensor system with spatially modified center wavelengths

A sensor system comprises a plurality of sets optical sensors arranged on an integrated circuit, the plurality of sets optical sensors having a respective top surface. The sensor system further comprising an interface between the plurality of optical sensors and a processing device configured to transmit information there between and an array of optical filters having a respective bottom surface and a respective top surface, where the bottom surface of the optical filter array is located proximal to the top surface of the plurality of sets optical sensors and each optical filter of the optical filter array is configured to pass a target wavelength range of light to a set of optical sensors. The processor is configured to receive an output from each optical sensor in a set of optical sensors and determine a corrected filter response for the set of optical sensors using crosstalk from light transmitted through optical filters adjacent to the set of optical sensors.