A method for of encoding an application screen comprises partitioning graphic data into a plurality of graphic layers and classifying each of the plurality of graphic layers as either a screen content (SC) or a non-screen content (non-SC) layer. The method further comprises classifying each of the plurality of graphic layers as either a screen content (SC) or a non-screen content (non-SC) layer. Further, the method comprises rendering and encoding the one or more SC layers using a first codec and the one or more non-SC layers using a second codec.

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining video data, detecting at least one face from at least one frame of the video data, determining a set of facial landmark features of the at least one face from the at least one frame of the video data, and coding the video data at least partly by a neural network based on the determined set of facial landmark features.

A method for of encoding an application screen comprises partitioning graphic data into a plurality of graphic layers and classifying each of the plurality of graphic layers as either a screen content (SC) or a non-screen content (non-SC) layer. The method further comprises classifying each of the plurality of graphic layers as either a screen content (SC) or a non-screen content (non-SC) layer. Further, the method comprises rendering and encoding the one or more SC layers using a first codec and the one or more non-SC layers using a second codec.

Techniques are described for adaptive encoding of different visual elements in a video frame. Characteristics of visual elements can be determined and used to set encoding parameters for the visual elements. The visual elements can be encoded such that one visual element is encoded differently than another visual element if they have different characteristics.

Embodiments of the present invention provide a system for generating and displaying tailored advertisements in a mixed reality environment. The system is configured for continuously identifying one or more objects in a mixed reality environment, identifying the one or more objects match advertising targets, generating a tailored advertisement, transmitting the tailored advertisement to the user device, causing the user device to display the tailored advertisement, determining that the user is interacting with the tailored advertisement, and capturing one or more metrics associated with the interaction of the user with the tailored advertisement.

A method for of encoding an application screen comprises partitioning graphic data into a plurality of graphic layers and classifying each of the plurality of graphic layers as either a screen content (SC) or a non-screen content (non-SC) layer. The method further comprises classifying each of the plurality of graphic layers as either a screen content (SC) or a non-screen content (non-SC) layer. Further, the method comprises rendering and encoding the one or more SC layers using a first codec and the one or more non-SC layers using a second codec.

An example non-transitory computer-readable medium includes instructions. When executed by a processor, the instructions cause the processor to split a video frame into a first frame including blocks classified as natural and a second frame including blocks classified as artificial. The instructions also cause the processor to compress the first frame with a first compression technique. The instructions also cause the processor to compress the second frame with a second compression technique.

An example non-transitory computer-readable medium includes instructions. When executed by a processor, the instructions cause the processor to split a video frame into a first frame including blocks classified as natural and a second frame including blocks classified as artificial. The instructions also cause the processor to compress the first frame with a first compression technique. The instructions also cause the processor to compress the second frame with a second compression technique.

Encoding video data comprises receiving an image sequence comprising first and second input image frames, adding an overlay, thereby generating first and second generated image frames, and encoding a video stream containing output image frames with and without overlay. The first input image frame is encoded as an intra-frame to form a first output image frame. The second input image frame is encoded as an inter-frame with reference to the first output image frame to form a second output image frame. The generated image frames are encoded as inter-frames with reference to the first and second output image frames to form first and second overlaid output image frames. A first part of the second generated image frame is encoded with reference to the first overlaid output image frame, and a second part of the second generated image frame is encoded with reference to the second output image frame.

Provided are techniques for providing animation in electronic communications. An image is generated by capturing multiple photographs from a camera or video camera. The first photograph is called the key photo/. Using a graphics program, photos subsequent to the key photo are edited to cut an element common to the subsequent photos. The cut images are pasted into the key photo as layers. The modified key photo, including the layers, is stored as a web-enabled graphics file, which is then transmitted in conjunction with electronic communication. When the electronic communication is received, the key photo is displayed and each of the layers is displayed and removed in the order that each was taken with a short delay between photos. In this manner, a movie is generated with much smaller files than is currently possible.