H04N9/74

Enhanced video shot matching using generative adversarial networks

This disclosure involves training generative adversarial networks to shot-match two unmatched images in a context-sensitive manner. For example, aspects of the present disclosure include accessing a trained generative adversarial network including a trained generator model and a trained discriminator model. A source image and a reference image may be inputted into the generator model to generate a modified source image. The modified source image and the reference image may be inputted into the discriminator model to determine a likelihood that the modified source image is color-matched with the reference image. The modified source image may be outputted as a shot-match with the reference image in response to determining, using the discriminator model, that the modified source image and the reference image are color-matched.

Plate reconstruction of obscured views of captured imagery using arbitrary captured inputs

An imagery processing system obtains capture inputs from capture devices that might have capture parameters and characteristics that differ from those of a main imagery capture device. By normalizing outputs of those capture devices, potentially arbitrary capture devices could be used for reconstructing portions of a scene captured by the main imagery capture device when reconstructing a plate of the scene to replace an object in the scene with what the object obscured in the scene. Reconstruction could be of one main image, a stereo pair of images, or some number, N, of images where N>2.

Plate reconstruction of obscured views of captured imagery using arbitrary captured inputs

An imagery processing system obtains capture inputs from capture devices that might have capture parameters and characteristics that differ from those of a main imagery capture device. By normalizing outputs of those capture devices, potentially arbitrary capture devices could be used for reconstructing portions of a scene captured by the main imagery capture device when reconstructing a plate of the scene to replace an object in the scene with what the object obscured in the scene. Reconstruction could be of one main image, a stereo pair of images, or some number, N, of images where N>2.

Systems and methods for providing warnings of imminent hazards

A system and method for alerting a driver of a motor vehicle or a person walking along a road or hiking on a trail of potentially dangerous hazards in their path. Hazards may be deep water, ice, oil slicks or other hazards. In the case of a motor vehicle, the system uses cameras mounted on or within the vehicle to detect potential hazards and then analyzes the images combined with the known topography of the location to evaluate the ability of the vehicle to safely traverse the hazard. In the case of a person walking or hiking, the person may use the camera on a personal mobile device to capture images of the hazard and to combine the images with the known topography at the location to evaluate the danger presented by the hazard.

VIDEO GENERATION DEVICE, VIDEO GENERATION METHOD, AND PROGRAM

The color and the brightness of a transparent material perception to be given to an image are independently operated using simple image processing techniques. Using a plurality of different deformation maps that have elements corresponding to respective pixels deriving from an original image and have low-spatial frequency components, the elements indicating a moving direction and a moving amount of the corresponding pixels, the pixels deriving from the original image are moved in a moving direction by a moving amount, the moving direction and the moving amount being specified by the elements corresponding to the respective pixels, to obtain a plurality of modulated images. The plurality of modulated images are separated into brightness components and color components to obtain a plurality of brightness component images and color component images, brightness of the plurality of brightness component images and/or color of the plurality of color component images is modulated to obtain brightness-modulated image and/or color-modulated image, and a video is obtained, the video being configured by arranging a plurality of integrated images obtained by integrating the obtained brightness-modulated images and/or color-modulated images.

VIDEO GENERATION DEVICE, VIDEO GENERATION METHOD, AND PROGRAM

The color and the brightness of a transparent material perception to be given to an image are independently operated using simple image processing techniques. Using a plurality of different deformation maps that have elements corresponding to respective pixels deriving from an original image and have low-spatial frequency components, the elements indicating a moving direction and a moving amount of the corresponding pixels, the pixels deriving from the original image are moved in a moving direction by a moving amount, the moving direction and the moving amount being specified by the elements corresponding to the respective pixels, to obtain a plurality of modulated images. The plurality of modulated images are separated into brightness components and color components to obtain a plurality of brightness component images and color component images, brightness of the plurality of brightness component images and/or color of the plurality of color component images is modulated to obtain brightness-modulated image and/or color-modulated image, and a video is obtained, the video being configured by arranging a plurality of integrated images obtained by integrating the obtained brightness-modulated images and/or color-modulated images.

Image processing apparatus and image processing method, and image capturing apparatus
11089236 · 2021-08-10 · ·

An image processing apparatus comprises: an acquisition unit that acquires a first image obtained through shooting and distance information of the first image; a detection unit that detects a main subject from the first image; an extraction unit that extracts another subject from the first image based on the distance information of the main subject; a setting unit that sets parameters of one or more virtual light sources that emit virtual light to the main subject and the extracted other subject; and a processing unit that generates from the first image a second image in which the main subject and the other subject are illuminated with the virtual light using the parameters set by the setting unit.

Electronic apparatus and control method thereof

An electronic apparatus includes a communicator, a camera, and a processor configured to obtain an image including a display apparatus through the camera, identify the display apparatus from the image, analyze at least one pattern of the remaining areas excluding an area corresponding to the display apparatus in the image, and obtain a pattern corresponding to the image based on patterns included in the image by ratios equal to or greater than a predetermined ratio among the at least one pattern, cluster the colors of the remaining areas into at least one color, and control the communicator such that an image generated by applying the at least one clustered color to the obtained pattern is output at the display apparatus.

Multi-screen display adjusting system and multi-screen display adjusting method
11106419 · 2021-08-31 · ·

A multi-screen display adjusting system including: a first signal path to which a first video input signal is input and a second signal path to which a second video input signal is input that are independent from each other; a display panel configured to display a first image based on the first video input signal and a second image based on the second video input signal; a screen composing unit configured to determine an arrangement of the first screen and an arrangement of the second screen on the display panel on the basis of an output from the first signal path and an output from the second signal path; a frame memory unit configured to store data of the arrangement of the first screen and data of the arrangement of the second screen; a video output processing unit configured to read the data of the arrangement of the first screen from the frame memory unit and generate a first signal timing for displaying the first screen and read the data of the arrangement of the second screen from the frame memory unit and generate a second signal timing for displaying the second screen; and a control unit.

Image processing apparatus, image capturing apparatus, image processing method, and storage medium
11115637 · 2021-09-07 · ·

There is provided an image processing apparatus comprising. An identification unit identifies a target color that a pixel of a shot image corresponding to an object having a specific color is to have as a result of white balance processing performed on the shot image. A determination unit determines a target region of a virtual light source in the shot image. An image processing unit performs image processing for adding an effect of virtual light irradiation by the virtual light source to the target region. A control unit controls a color of the virtual light source such that a color close to the target color approaches the target color in the target region.