H04N23/85

METHOD AND APPARATUS WITH HIGH-RESOLUTION IMAGE ZOOMING

A method and apparatus for generating a high-resolution digital zoom image may obtain a raw image captured by an image sensor from the image sensor, obtain an RGB image corresponding to the raw image, separate a luminance component and a chrominance component from the RGB image, extract a first feature of the RGB image, of which color information is enhanced, by applying the chrominance component to a first neural network, extract a second feature of the RGB image, of which texture information is enhanced, by applying the raw image and the luminance component to a second neural network, and generate the high-resolution digital zoom image, which corresponds to the RGB image, by upscaling the color information and the texture information based on the first feature or the second feature.

METHOD AND APPARATUS WITH HIGH-RESOLUTION IMAGE ZOOMING

A method and apparatus for generating a high-resolution digital zoom image may obtain a raw image captured by an image sensor from the image sensor, obtain an RGB image corresponding to the raw image, separate a luminance component and a chrominance component from the RGB image, extract a first feature of the RGB image, of which color information is enhanced, by applying the chrominance component to a first neural network, extract a second feature of the RGB image, of which texture information is enhanced, by applying the raw image and the luminance component to a second neural network, and generate the high-resolution digital zoom image, which corresponds to the RGB image, by upscaling the color information and the texture information based on the first feature or the second feature.

Display-side adaptive video processing

Adaptive video processing for a target display panel may be implemented in or by a decoding/display pipeline associated with the target display panel. The adaptive video processing methods may take into account video content, display characteristics, and environmental conditions including but not limited to ambient lighting and viewer location when processing and rendering video content for a target display panel in an ambient setting or environment. The display-side adaptive video processing methods may use this information to adjust one or more video processing functions as applied to the video data to render video for the target display panel that is adapted to the display panel according to the ambient viewing conditions.

Color Correction Integrations for Global Tone Mapping
20190114750 · 2019-04-18 ·

Color correction is integrated within global tone mapping operations to modify an image captured using an image capture device. New luminance values are determined for the pixels of the image by performing global tone mapping against those pixels using one or more sets of color correction values, which are applied against respective luminance values and color components of those pixels. The sets of color correction values are identified within 3?3 color correction matrices. A gain curve for modifying contrast values of the image is determined based on at least one of the new luminance values. A modified image is then generated by modifying the contrast values according to the gain curve, for example, by applying a gamma curve against the contrast values using data stored in a three-dimensional lookup table.

Encoding, decoding, and representing high dynamic range images

Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.

Non-linear display brightness adjustment
10264266 · 2019-04-16 · ·

Display brightness adjustment apparatus and methods are described in which the average brightness of a display may be scaled up or down using a non-linear function. When applying the non-linear function to scale down brightness, the contrast of the output signal may not be reduced so that the dynamic range and highlights are preserved. The non-linear brightness adjustment may be performed automatically, for example in response to ambient light level as detected by sensor(s), but may also be applied in response to a user adjustment to a brightness control knob or slider. The non-linear brightness adjustment may be performed globally, or alternatively may be performed on local regions of an image or display panel. The non-linear function may be a piecewise linear function, or some other non-linear function.

Image processing device and image processing method
10264223 · 2019-04-16 · ·

An image processing device according to the present invention includes: a color space conversion unit that calculates brightness signals and color difference signals from RGB signals of two images of a single subject acquired under different image acquisition conditions; a color difference determination unit that determines whether or not the absolute value of the difference between the color difference signals of the two images calculated by the color space conversion unit is smaller than a predetermined threshold value; and a color averaging unit that, if the color difference determination unit determines that the absolute value of the difference between the color difference signals of the two images is smaller than the threshold value, averages the color difference signals of the two images and calculates average color difference signals.

Devices and methods for high dynamic range video

Systems and methods of the invention merge information from multiple image sensors to provide a high dynamic range (HDR) video. The present invention provides for real-time HDR video production using multiple sensors and pipeline processing techniques. According to the invention, multiple sensors with different exposures each produces an ordered stream of frame-independent pixel values. The pixel values are streamed through a pipeline on a processing device. The pipeline includes a kernel operation that identifies saturated ones of the pixel values. The streams of pixel values are merged to produce an HDR video.

Combined HDR/LDR video streaming

The invention provides methods for broadcasting video in a dual HDR/LDR format such that the video can be displayed in real time by both LDR and HDR display devices. Methods and devices of the invention process streams of pixels from multiple sensors in a frame-independent manner to produce an HDR video signal in real time. That HDR video signal is then tone-mapped to produce an LDR video signal, the LDR signal is subtracted from the HDR signal to calculate a residual signal, and the LDR signal and the residual signal are merged into a combined signal that is broadcast via a communications network.

IMAGE PROCESSING METHOD AND ELECTRONIC DEVICE
20240251180 · 2024-07-25 ·

Disclosed are an image processing method and an electronic device, applied to the field of image processing technologies. The method includes: turning on a camera; obtaining a zoom ratio and an environmental illuminance in a current photographing environment; and performing photographing in a first mode when the zoom ratio is greater than or equal to a first ratio and the environmental illuminance is greater than or equal to a first luminance threshold, where in the first mode, the camera is configured to: process an acquired image signal in a non-binning mode and in a cropping manner, to output first image data, where a first image format is used for the first image data.