The present invention relates to a method for differentiating between background and foreground in images or films of scenery recorded by an electronic camera. The invention relates in addition to a method for replacing the background in recorded images or films of scenery whilst maintaining the foreground.

A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.

A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.

A virtual local presence display apparatus, system and method is disclosed. Included are an extraction engine capable of automatically disassociating the virtual local presence from its production background; a first data feed of an actual background in which the displaying device resides; a background data feed of a plurality of optional backgrounds including at least the production background of the virtual local presence; a stream subject data feed of an extracted one of the virtual local presence extracted from the production background; an integrated data feed in which the virtual local presence and a background are integrated; a first processing having a receiver capable of receiving the data feeds and assessing a plurality of focal lengths to focal planes for the virtual presence in the production background, and in a selected one of the other backgrounds; and a second processing for causing displaying, on the display device, the virtual presence at a suitable location with regard to the focal planes in a selected one of the other backgrounds.

Systems and methods for production and presentation of video content are provided. The system can include a transparent panel and a camera positioned adjacent to the transparent panel. The camera can generate a camera signal indicative of image data of a user positioned on a side of the transparent panel opposing the camera. The system can further include a memory storing instructions and a processor configured to or programmed to read the instructions stored in the memory. The processor can be configured to or programmed to: receive the camera signal; receive an overlay signal having at least one visual element; overlay the at least one visual element of the overlay signal on the transparent panel; and control a display of the at least one visual element on the transparent panel such that the at least one visual element is visible to the user and not visible to the camera.

Systems and methods for production and presentation of video content are provided. The system receives a camera signal indicative of image data of a scene that includes a transparent panel and receives an overlay signal having at least one visual element. The system generates a first signal based on the processed camera and overlay signals and displays, on a first display, a processed image of the first signal indicative of the at least one visual element overlaid on the image data. The system displays an application window of a second signal on a second display and, based on a user input, relocates the application window from the second display to the overlay signal. The system displays the application window on the first display by transforming the application window utilizing a keying function and overlaying the transformed application window in the processed image of the first signal.

A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.

A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.

Systems and methods are described for generating an AR image are described herein. A physical camera is used to capture a video of a physical object in front of a physical background. The system then accesses data defining a virtual environment and selects a first position of a virtual camera in the virtual environment. While capturing the video, the system displays captured video of the physical object, such that the physical background is replaced with a view of the virtual environment from the first position of the virtual camera. In response to detecting a movement of the physical camera, the system selects a second position of the virtual camera in the virtual environment based on the detected movement. The system then displays the captured video of the physical object, wherein the view of the physical background is replaced with a view of the virtual environment from the second position of the virtual camera.

Systems and methods are described for generating an AR image are described herein. A physical camera is used to capture a video of a physical object in front of a physical background. The system then accesses data defining a virtual environment and selects a first position of a virtual camera in the virtual environment. While capturing the video, the system displays captured video of the physical object, such that the physical background is replaced with a view of the virtual environment from the first position of the virtual camera. In response to detecting a movement of the physical camera, the system selects a second position of the virtual camera in the virtual environment based on the detected movement. The system then displays the captured video of the physical object, wherein the view of the physical background is replaced with a view of the virtual environment from the second position of the virtual camera.