A system and, related method, is disclosed for enabling Chroma key compositing using a smart device, wherein an image/video of a subject situated in front of a portable monochromatic background is captured, and simultaneously layered upon a different desired background replacement that will replace only the monochromatic background captured. The portable monochromatic background structure can be an inflatable structure affixed with a plurality of lighting modules configured to ensure a uniform light distribution across the monochromatic background and separately ensure a uniform light distribution on the subject during the image/video capture. Moreover, a software application on a smart device can act as a system platform that enables for automatic light adjustment of the lighting modules on a portable monochromatic background to correct any light imperfections that impede color neutrality on the background, which would otherwise result in the inability to create broadcast quality background replacement content with a smart device using the monochromatic lighting platform disclosed herein.

A system and, related method, is disclosed for enabling Chroma key compositing using a smart device, wherein an image/video of a subject situated in front of a portable monochromatic background is captured, and simultaneously layered upon a different desired background replacement that will replace only the monochromatic background captured. The portable monochromatic background structure can be an inflatable structure affixed with a plurality of lighting modules configured to ensure a uniform light distribution across the monochromatic background and separately ensure a uniform light distribution on the subject during the image/video capture. Moreover, a software application on a smart device can act as a system platform that enables for automatic light adjustment of the lighting modules on a portable monochromatic background to correct any light imperfections that impede color neutrality on the background, which would otherwise result in the inability to create broadcast quality background replacement content with a smart device using the monochromatic lighting platform disclosed herein.

A system for capturing a scene with a simultaneous use of an IR light and a VIS light to create at least one of an alpha channel mask or a relighting effect in a movie post-production transmission. The system includes a lighting system that includes an NIR light source and a VIS light source. The system also includes an electro-optical system configured to simultaneously acquire a video in a NIR spectrum and in a VIS spectrum based on the NIR light source and the VIS light source. The system further includes a post-processing converter configured to generate an alpha channel mask from the video based on the NIR spectrum to distinguish between a foreground object and a background over which the foreground object is positioned. The foreground object is illuminated via the NIR light source.

A system for capturing a scene with a simultaneous use of an IR light and a VIS light to create at least one of an alpha channel mask or a relighting effect in a movie post-production transmission. The system includes a lighting system that includes an NIR light source and a VIS light source. The system also includes an electro-optical system configured to simultaneously acquire a video in a NIR spectrum and in a VIS spectrum based on the NIR light source and the VIS light source. The system further includes a post-processing converter configured to generate an alpha channel mask from the video based on the NIR spectrum to distinguish between a foreground object and a background over which the foreground object is positioned. The foreground object is illuminated via the NIR light source.

The disclosure provides an approach for image segmentation from an uncalibrated camera array. In one aspect, a segmentation application computes a pseudo depth map for each frame of a video sequence recorded with a camera array based on dense correspondences between cameras in the array. The segmentation application then fuses such pseudo depth maps computed for satellite cameras of the camera array to obtain a pseudo depth map at a central camera. Further, the segmentation application interpolates virtual green screen positions for an entire frame based on user input which provides control points and pseudo depth thresholds at the control points. The segmentation application then computes an initial segmentation based on a thresholding using the virtual green screen positions, and refines the initial segmentation by solving a binary labeling problem in a Markov random field to better align the segmentation with image edges and provide temporal coherency for the segmentation.

A computer system may identify a first position of a physical camera corresponding to a first time period. The computer system may render a first virtual scene for the first time period. The system may project the first scene onto a display surface to determine a first rendered image for the first time period. The computer system may receive a first camera image of the display surface from the camera during the first time period. The system may determine a first corrected position of the camera by comparing the first rendered image to the first camera image. The system may predict a second position of the camera corresponding to a second time period. The computer system may render a second virtual scene for the second time period. The system may project the second virtual scene onto the display surface to determine a second rendered image for the second time period.

A computer system may identify a first position of a physical camera corresponding to a first time period. The computer system may render a first virtual scene for the first time period. The system may project the first scene onto a display surface to determine a first rendered image for the first time period. The computer system may receive a first camera image of the display surface from the camera during the first time period. The system may determine a first corrected position of the camera by comparing the first rendered image to the first camera image. The system may predict a second position of the camera corresponding to a second time period. The computer system may render a second virtual scene for the second time period. The system may project the second virtual scene onto the display surface to determine a second rendered image for the second time period.

A system and, related method, is disclosed for enabling Chroma key compositing using a smart device, wherein an image/video of a subject situated in front of a portable monochromatic background is captured, and simultaneously layered upon a different desired background replacement that will replace only the monochromatic background captured. The portable monochromatic background structure can be an inflatable structure affixed with a plurality of lighting modules configured to ensure a uniform light distribution across the monochromatic background and separately ensure a uniform light distribution on the subject during the image/video capture. Moreover, a software application on a smart device can act as a system platform that enables for automatic light adjustment of the lighting modules on a portable monochromatic background to correct any light imperfections that impede color neutrality on the background, which would otherwise result in the inability to create broadcast quality background replacement content with a smart device using the monochromatic lighting platform disclosed herein.

A system and, related method, is disclosed for enabling Chroma key compositing using a smart device, wherein an image/video of a subject situated in front of a portable monochromatic background is captured, and simultaneously layered upon a different desired background replacement that will replace only the monochromatic background captured. The portable monochromatic background structure can be an inflatable structure affixed with a plurality of lighting modules configured to ensure a uniform light distribution across the monochromatic background and separately ensure a uniform light distribution on the subject during the image/video capture. Moreover, a software application on a smart device can act as a system platform that enables for automatic light adjustment of the lighting modules on a portable monochromatic background to correct any light imperfections that impede color neutrality on the background, which would otherwise result in the inability to create broadcast quality background replacement content with a smart device using the monochromatic lighting platform disclosed herein.

Systems and methods for creating and distributing professional quality pictorial souvenirs giving the illusion that guests of a facility were imaged at other locations, including making initial arrangements with guests, showing selections of background scene images at video displays and flashing chrome key images interspersed with frames of the scene images, taking key guest images in synch with the flashed key images, extracting guest image content from the key guest images and merging into selecting scene images, showing preview merges images for guest selection and providing souvenir portfolios that include merged images to guests or designees after making financial arrangements, including for payment to third parties for copyright content included in the souvenirs and with advertisers for promotional material included in the souvenirs.