A fault tolerant display displays safety information on a display shared with an infotainment system even if the processor or software of the infotainment system is unresponsive. The display can be a streaming video from a rear view camera mounted on a vehicle. The safety displayed can be triggered by placing the vehicle in reverse. Failure of the infotainment software and/or processor can be detected by a policy enforcing module that switches to a backup display that streams video directly from the camera in the event of failure of the infotainment processor.

A method for processing data in a video sequence comprising impulse noise (“salt-and-pepper”, “snow”, or other type), comprising, for filtering the noise, an application of a recursive filter (S2), given by:

z(n)=z(n−1)+Δ if y(n)>z(n−1)

z(n)=z(n−1)−Δ if y(n)<z(n−1)

and z(n)=z(n−1) if y(n)=z(n−1)

where: y(n) designates an element in the n.sup.th image of the succession, not processed by application of the sign filter; z(n−1) designates an element having a position corresponding to y(n), in the (n−1).sup.th image of the succession, and processed by application of the sign filter; z(n) designates an element having a position corresponding to y(n), in the n.sup.th image of the succession, and processed by application of said sign filter, and Δ is a strictly positive coefficient.

A method for processing data in a video sequence comprising impulse noise (“salt-and-pepper”, “snow”, or other type), comprising, for filtering the noise, an application of a recursive filter (S2), given by:

z(n)=z(n−1)+Δ if y(n)>z(n−1)

z(n)=z(n−1)−Δ if y(n)<z(n−1)

and z(n)=z(n−1) if y(n)=z(n−1)

where: y(n) designates an element in the n.sup.th image of the succession, not processed by application of the sign filter; z(n−1) designates an element having a position corresponding to y(n), in the (n−1).sup.th image of the succession, and processed by application of the sign filter; z(n) designates an element having a position corresponding to y(n), in the n.sup.th image of the succession, and processed by application of said sign filter, and Δ is a strictly positive coefficient.

To generate a favorable image that suppresses the occurrence of pattern noise in a method of performing patch-based noise reduction for a RAW image. In order to attain this object, the image processing apparatus of the present invention includes a pixel setting unit; a patch setting unit; and a noise reduction unit. Then, the pixel setting unit sets, for one pixel of interest, at least two kinds of pixel whose positions are different in a minimum unit of the color filter array as the plurality of reference pixels. Further, the patch setting unit sets, for one pixel of interest, at least two kinds of reference patch whose shapes are different.

Embodiments of the present disclosure provide methods and apparatuses for removing video jitter. The method can include: determining position information of feature point pairs in each pair of raw images according to position information of feature point pairs in each pair of compressed images, wherein one feature point pair is composed of two corresponding feature points on two consecutive images in each pair of images, and the raw images are uncompressed images; determining position change information of a subsequent image relative to a preceding image in each pair of raw images according to the position information of the feature point pairs in each pair of raw images; acquiring deformation information corresponding to the preceding image in a m-th pair of raw images according to the position change information of the subsequent image relative to the preceding image inn pairs of raw images, wherein n and m are positive integers, and m is not greater than n; and deforming the preceding image in the m-th pair of raw images according to the deformation information corresponding to the preceding image in the m-th pair of raw images for removing jitter in the preceding image in the m-th pair of raw images.

Embodiments of the present disclosure provide methods and apparatuses for removing video jitter. The method can include: determining position information of feature point pairs in each pair of raw images according to position information of feature point pairs in each pair of compressed images, wherein one feature point pair is composed of two corresponding feature points on two consecutive images in each pair of images, and the raw images are uncompressed images; determining position change information of a subsequent image relative to a preceding image in each pair of raw images according to the position information of the feature point pairs in each pair of raw images; acquiring deformation information corresponding to the preceding image in a m-th pair of raw images according to the position change information of the subsequent image relative to the preceding image inn pairs of raw images, wherein n and m are positive integers, and m is not greater than n; and deforming the preceding image in the m-th pair of raw images according to the deformation information corresponding to the preceding image in the m-th pair of raw images for removing jitter in the preceding image in the m-th pair of raw images.

Devices, methods, and non-transitory program storage devices for spatiotemporal image noise reduction are disclosed, comprising: maintaining an accumulated image in memory; and obtaining a first plurality of multispectral images (e.g., RGB-IR images). For each image in the first plurality of multispectral images, the method may: calculate a multispectral guide image for the current image; calculate blending weights for the current image; apply the calculated blending weights to each channel of the current image to generate a denoised current image; and update the accumulated image based on pixel differences between the denoised current image and the accumulated image. In some embodiments, additional images (e.g., the accumulated image and/or other images captured prior to or after a given current image) may also be included in the denoising operations for a given current image. Finally, the method may generate a denoised output image for each input image, based on the updated accumulated image.

A method and system for generating a sympathetic assistive mutation of a live camera image stream. A cameral captures a digital video including a series of root images, at least one processor generates a series of mutated images, and a display device displays the series of mutated images as a preview of at least a portion of the series of root images. Each mutated image in the series of mutated images is generated by (a) obtaining the corresponding root image, which includes root pixels, (b) applying at least one of a function and a shader to the corresponding root image to obtain an assistive color for each of a portion of the root pixels, and (c) blending the assistive color with at least one color value of each root pixel in the portion of root pixels to thereby create the mutated image.

A mechanism is described for facilitating automatic tuning of image signal processors using reference images in image processing environments, according to one embodiment. A method of embodiments, as described herein, includes one or more processors to: receive images associated with one or more scenes captured by one or more cameras; access tuning parameters associated with functionalities within an image signal processor (ISP) pipeline; generate reference images based on the tuning parameters, wherein a reference image is associated with an image for each functionality within the ISP pipeline; and automatically tune the ISP pipeline based on selection of one or more of the reference images for one or more of the images for one or more of the functionalities.

A mechanism is described for facilitating automatic tuning of image signal processors using reference images in image processing environments, according to one embodiment. A method of embodiments, as described herein, includes one or more processors to: receive images associated with one or more scenes captured by one or more cameras; access tuning parameters associated with functionalities within an image signal processor (ISP) pipeline; generate reference images based on the tuning parameters, wherein a reference image is associated with an image for each functionality within the ISP pipeline; and automatically tune the ISP pipeline based on selection of one or more of the reference images for one or more of the images for one or more of the functionalities.