A chroma key and presentation system, a presentation method, and a presentation kit all for simultaneous use in the presence of an in-person audience and remote audience. The system comprising: a chroma key light source, configured in use to emit chroma key light; a display surface which may be used as a projector screen for displaying projected media for viewing by the in-person audience from a projector, the display surface being at least partially transparent to the chroma key light; a camera disposed on an opposing side of the display surface to the chroma key light source, wherein the camera is configured to receive chroma key light for use in generating a composite image for the remote audience; and a directional light control filter, configured to reduce chroma key light transmission in a direction away from the camera.

The present invention refers to the field of video processing, and, in particular, to a system and a method for achieving high quality foreground segmentation using an active background.

The present invention is embodied in a system and a method capable of achieving high quality foreground segmentation using an active background, wherein foreground is any object or person located between a camera and a background. The system is comprising an active background, one or several multispectral cameras, a hardware synchronizer, an invisible light driver and a main computer.

The main features of the system consist of one or several of the following: a. A sub-system acquiring reference images of the active background. b. A sub-system acquiring each video frame images. c. A sub-system performing real-time frame processing d. A sub-system performing noise reduction.

The present invention refers to the field of video processing, and, in particular, to a system and a method for achieving high quality foreground segmentation using an active background.

The present invention is embodied in a system and a method capable of achieving high quality foreground segmentation using an active background, wherein foreground is any object or person located between a camera and a background. The system is comprising an active background, one or several multispectral cameras, a hardware synchronizer, an invisible light driver and a main computer.

The main features of the system consist of one or several of the following: a. A sub-system acquiring reference images of the active background. b. A sub-system acquiring each video frame images. c. A sub-system performing real-time frame processing d. A sub-system performing noise reduction.

A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.

A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.

A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.

The present invention relates to a method for differentiating between background and foreground in images or films of scenery recorded by an electronic camera. The invention relates in addition to a method for replacing the background in recorded images or films of scenery whilst maintaining the foreground.

The present invention relates to a method for differentiating between background and foreground in images or films of scenery recorded by an electronic camera. The invention relates in addition to a method for replacing the background in recorded images or films of scenery whilst maintaining the foreground.

An imagery processing system obtains capture inputs from capture devices that might have capture parameters and characteristics that differ from those of a main imagery capture device. By normalizing outputs of those capture devices, potentially arbitrary capture devices could be used for reconstructing portions of a scene captured by the main imagery capture device when reconstructing a plate of the scene to replace an object in the scene with what the object obscured in the scene. Reconstruction could be of one main image, a stereo pair of images, or some number, N, of images where N>2.

An imagery processing system obtains capture inputs from capture devices that might have capture parameters and characteristics that differ from those of a main imagery capture device. By normalizing outputs of those capture devices, potentially arbitrary capture devices could be used for reconstructing portions of a scene captured by the main imagery capture device when reconstructing a plate of the scene to replace an object in the scene with what the object obscured in the scene. Reconstruction could be of one main image, a stereo pair of images, or some number, N, of images where N>2.