Image processing using various video and still flows is described. The resolution and bit depth at each stage of the image processing are described. In some examples, image scalers are used to resize image resolution. In some examples, a warp engine is used to distort per frame images to apply image stabilization, zoom, or a user digital lens. An image processing pipeline includes a double data rate (DDR) memory buffer that supports lossy compression with a constant 50% compression. In some examples, the image processing pipeline includes a DDR memory buffer that is uncompressed.

Image processing using various video and still flows is described. The resolution and bit depth at each stage of the image processing are described. In some examples, image scalers are used to resize image resolution. In some examples, a warp engine is used to distort per frame images to apply image stabilization, zoom, or a user digital lens. An image processing pipeline includes a double data rate (DDR) memory buffer that supports lossy compression with a constant 50% compression. In some examples, the image processing pipeline includes a DDR memory buffer that is uncompressed.

This application discloses an image processing method and a related apparatus, to support display of an HDR image, display more dynamic ranges and image details, provide richer colors, and improve user experience. The image processing method includes: obtaining a first RGB image, where the first RGB image is an RGB image sensed by a photographing apparatus; converting the first RGB image into a second RGB image, where the second RGB image is an image meeting a BT2020 color gamut range; determining a first luminance value corresponding to the second RGB image, where the first luminance value indicates maximum luminance of each frame of image in the second RGB image; determining a target image based on the first luminance value and the second RGB image; and sending the target image to a display apparatus, so that the display apparatus displays the target image.

In a general aspect, a camera can include a dynamic memory, and a software driver configured to store, in the dynamic memory, a plurality of predetermined lookup tables (LUTs), and to issue an interpolation command indicating a value of a quantitative image factor corresponding with an image frame received by the ISP. The camera can also include a LUT processing circuit configured to receive the interpolation command, and in response to receiving the interpolation command: read a first predetermined LUT and a second predetermined LUT from the dynamic memory; and perform at least one interpolation operation to generate an interpolated LUT. The camera can further include an image signal processor (ISP) including a configuration register, and the LUT processing circuit can be configured to write the interpolated LUT to the configuration register.

In a general aspect, a camera can include a dynamic memory, and a software driver configured to store, in the dynamic memory, a plurality of predetermined lookup tables (LUTs), and to issue an interpolation command indicating a value of a quantitative image factor corresponding with an image frame received by the ISP. The camera can also include a LUT processing circuit configured to receive the interpolation command, and in response to receiving the interpolation command: read a first predetermined LUT and a second predetermined LUT from the dynamic memory; and perform at least one interpolation operation to generate an interpolated LUT. The camera can further include an image signal processor (ISP) including a configuration register, and the LUT processing circuit can be configured to write the interpolated LUT to the configuration register.

A real-world view display method applied to a video pass-through system, wherein the video pass-through system includes at least one grayscale camera, a color camera and at least one processor. The real-world view display method includes: by the at least one grayscale camera, capturing at least one grayscale image of a physical environment for generating a grayscale pass-through view corresponding to the physical environment; by the color camera, capturing at least one color image of the physical environment; and by the at least one processor, processing the grayscale pass-through view according to the at least one color image to render a color pass-through view in an immersive content, wherein the color pass-through view is corresponding to the physical environment.

An electronic device includes an image sensor including a color filter having a plurality of color channels, a memory storing a plurality of color conversion matrices and instructions, and a processor. The processor is configured to obtain noise information of a color image captured by the image sensor, select a target matrix from among the plurality of the color conversion matrices based on the obtained noise information, and generate a color converted image by applying the selected target matrix to the color image.

An image processing method of converting spectral image data of a plurality of spectral wavelengths imaged by a spectral camera into a color image by using a processor, wherein the processor acquires a plurality of pieces of the spectral image data from a storage unit, calculates a correction value by multiplying a optical spectrum of each pixel of a corresponding one of the plurality of spectral image data by a correction constant set for each wavelength, calculates a color conversion value by summing the correction values of the same pixel positions, and generates a color composite image based on the color conversion value. Then, the correction constant is set such that a sum spectrum obtained by summing characteristic spectra obtained by multiplying a sensitivity characteristic with respect to each spectral wavelength of the spectral camera by the correction constant corresponding to each wavelength matches a target spectrum of any color filter.

Devices, methods, and non-transitory program storage devices (NPSDs) are disclosed to compensate for the predicted color changes experienced by camera modules after certain amounts of time of real world use. Such color changes may be caused by prolonged exposure of optical components of the camera module to one or more of: solar radiation, high temperature conditions, or high humidity conditions, each of which may, over time, induce deviation in the color response of optical components of the camera module. The techniques disclosed herein may first characterize such predicted optical change to components over time based on particular environmental conditions, and then implement one or more time-varying color models to compensate for predicted changes to the camera module's color calibration values due to the characterized optical change. In some embodiments, optical changes in other types of components, e.g., display devices, caused by prolonged environmental stresses may also be modeled and compensated.

There are provided an information processing system, an information processing apparatus, an information processing method, an information processing program, an imaging apparatus, a method of controlling the imaging apparatus, and a control program capable of easily performing color matching in a plurality of imaging apparatuses. The information processing system includes: an imaging apparatus that operates in a master mode; at least one imaging apparatus that operates in a slave mode; and an information processing apparatus. Each of the imaging apparatus in the master mode and the imaging apparatus in the slave mode sends a chart image generated by capturing an image of a specific chart to the information processing apparatus, and the information processing apparatus calculates a color conversion coefficient in the imaging apparatus in the slave mode on the basis of the chart image generated by the imaging apparatus in the master mode, and sends the color conversion coefficient to the imaging apparatus corresponding to the color conversion coefficient.