An information processing device according to the present invention includes a memory; and at least one processor coupled to the memory. The processor performing operations. The operations includes: receiving first multiple-images; and generating, based on a first image in the first multiple-images, a third image relating to a second image in a second wavelength band different from a first wavelength band of the first image.

Systems and methods are provided for image scaling with enhanced compression. One embodiment is a processor that receives an instruction to scale an input image to create an output image that is higher in resolution, and analyzes rows of the input image in sections according to a run length of a predetermined number of consecutive pels. For each run length of consecutive pels, the processor determines a cluster of adjacent pels within the run length having a color intensity value within a threshold range, and determines a replacement intensity value for the cluster based on at least one color intensity value of a pel in the cluster. The processor creates the output image by: upscaling the cluster by the scale factor to multiply a number of pels in the cluster, and changing an intensity value of all pels in the cluster to the replacement intensity value.

A display apparatus is provided. The display apparatus includes an input interface, a first storage, a display, and a processor. Pixel values corresponding to a predetermined number of lines in an image input through the input interface are stored in the first storage,. The processor acquires a first patch of a predetermined size by sampling a number of pixel values located in an outer region of a matrix centering about a specific pixel value from among the pixel values stored in the first storage, acquires a high-frequency component for the specific pixel value based on the acquired first patch, and processes the input image based on the high-frequency component. The display displays the processed image.

Systems, methods and apparatus for image processing for reconstructing a super resolution (SR) image from multispectral (MS) images. A processor to iteratively, fuse a MS image with an associated PAN image of the scene. Each iteration includes using a gradient descent (GD) approach with a learned forward operator, to generate an intermediate high-resolution multispectral (IHRMS) image with an increased spatial resolution and a smaller error to the DSRMS image compared to the stored MS image. Project the IHRMS image using a trained convolutional neural network (CNN) to obtain an estimated synthesized high-resolution multispectral (ESHRMS) image, for a first iteration. Use the ESHRMS image and the PAN image, as an input to the GD approach for following iterations. The updated IHRMS image is an input to another trained CNN for the following iterations. After predetermined number of iterations, output the fused high-spatial and high-spectral resolution MS image.

In implementations of super-resolution with reference images, a super-resolution image is generated based on reference images. Reference images are not constrained to have same or similar content as a low-resolution image being super-resolved. Texture features indicating high-frequency content are extracted into texture feature maps, and patches of texture feature maps of reference images are determined based on texture feature similarity. A content feature map indicating low-frequency content of an image is adaptively fused with a swapped texture feature map including patches of reference images with a neural network based on similarity of texture features. A user interfaces allows a user to select regions of multiple reference images to use for super-resolution. Hence, a super-resolution image can be generated with rich texture details incorporated from multiple reference images, even in the absence of reference images having similar content to an image being upscaled.

Systems, methods, and devices for super resolution and color motion artifact correction in a pulsed fluorescence imaging system are disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor to generate a plurality of exposure frames. The method includes detecting motion across two or more sequential exposure frames of the plurality of exposure frames, compensating for the detected motion, and combining the two or more sequential exposure frames to generate an image frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 770 nm to about 790 nm.

Systems, methods, and devices for super resolution and color motion artifact correction in a pulsed fluorescence imaging system are disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor to generate a plurality of exposure frames. The method includes detecting motion across two or more sequential exposure frames of the plurality of exposure frames, compensating for the detected motion, and combining the two or more sequential exposure frames to generate an image frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 770 nm to about 790 nm or from about 795 nm to about 815 nm.

Super resolution and color motion artifact correction in a pulsed hyperspectral, fluorescence, and laser mapping imaging system. A method includes actuating an emitter to emit pulses of electromagnetic radiation and sensing reflected electromagnetic radiation with a pixel array of an image sensor. The method includes detecting motion across two or more sequential exposure frames, compensating for the detected motion, and combining the two or more sequential exposure frames to generate an image frame. The method is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm, from about 565 nm to about 585 nm, from about 900 nm to about 1000 nm, an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce, or a laser mapping pattern.

Systems, methods, and devices for super resolution and color motion artifact correction in a pulsed fluorescence imaging system are disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor to generate a plurality of exposure frames. The method includes detecting motion across two or more sequential exposure frames of the plurality of exposure frames, compensating for the detected motion, and combining the two or more sequential exposure frames to generate an image frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 795 nm to about 815 nm.

Systems, methods, and devices for super resolution and color motion artifact correction in a pulsed fluorescence imaging system are disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor to generate a plurality of exposure frames. The method includes detecting motion across two or more sequential exposure frames of the plurality of exposure frames, compensating for the detected motion, and combining the two or more sequential exposure frames to generate an image frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises a laser mapping pattern.