A projection metadata system and method are provided for providing projection metadata to a rendering system for use in rendering a panoramic scene. A rendering system and method are provided for rendering the panoramic scene using the projection metadata. The projection metadata may comprise machine readable data which may directly provide the coordinate mapping to be used in by the rendering system to render the panoramic scene. For example, an executable script may be provided which, when executed, carries out the coordinate mapping. Compared to known ways of signalling a rendering system which projection to use, which may conventionally involve selecting a projection from a number of predefined projections and signalling the selection, the use of projection metadata may provide a high degree of flexibility, as different projections may be defined for, e.g., different spatial and/or temporal parts of the panoramic scene, different rendering techniques, etc.

Systems, methods, and non-transitory computer-readable media can obtain a spherical media content item that captures at least one scene from a plurality of different positions. A three-dimensional object with a plurality of faces that converge at a point is determined. At least a first portion of the spherical media content item is mapped to at least a first face in the plurality of faces.

An image processing method determines a geometric transform of a suspect image by efficiently evaluating a large number of geometric transform candidates in environments with limited processing resources. Processing resources are conserved by using complementary methods for determining a geometric transform of an embedded signal. One method excels at higher geometric distortion, and specifically, distortion caused by greater tilt angle of a camera. Another method excels at lower geometric distortion, for weaker signals. Together, the methods provide a more reliable detector of an embedded data signal in image across a larger range of distortion while making efficient use of limited processing resources in mobile devices.

A method for self-supervised depth and ego-motion estimation is described. The method includes determining a multi-camera photometric loss associated with a multi-camera rig of an ego vehicle. The method also includes generating a self-occlusion mask by manually segmenting self-occluded areas of images captured by the multi-camera rig of the ego vehicle. The method further includes multiplying the multi-camera photometric loss with the self-occlusion mask to form a self-occlusion masked photometric loss. The method also includes training a depth estimation model and an ego-motion estimation model according to the self-occlusion masked photometric loss. The method further includes predicting a 360 point cloud of a scene surrounding the ego vehicle according to the depth estimation model and the ego-motion estimation model.

According to implementations of the subject matter, a solution is provided for visual style transfer of images. In this solution, first and second sets of feature maps are extracted for first and second source images, respectively, a feature map in the first or second set of feature maps representing at least a part of a visual style of the first or second source image. A first mapping from the first source image to the second source image is determined based on the first and second sets of feature maps. The first source image is transferred based on the first mapping and the second source image to generate a first target image at least partially having the second visual style. Through this solution, a visual style of a source image can be effectively applied to a further source image in feature space.

Techniques are described for identifying a plurality of objects associated with a clipping mask and available for display in a user interface of a digital media editor, identifying, for each of the plurality of objects, a bounding box surrounding a respective object in the plurality of objects, each bounding box defining a plurality of anchor points configured to generate alignment guides for the respective object. The techniques may also includes determining, for each object, visible portions that are within a boundary defined by the clipping mask, determining a plurality of locations in which at least one bounding box intersects with the clipping mask within the visible portions, and triggering, in the user interface, modification of the at least one bounding box in at least one of the plurality of locations to reduce the at least one bounding box to terminate on at least one of the plurality of locations.

Techniques are described for identifying a plurality of objects associated with a clipping mask and available for display in a user interface of a digital media editor, identifying, for each of the plurality of objects, a bounding box surrounding a respective object in the plurality of objects, each bounding box defining a plurality of anchor points configured to generate alignment guides for the respective object. The techniques may also includes determining, for each object, visible portions that are within a boundary defined by the clipping mask, determining a plurality of locations in which at least one bounding box intersects with the clipping mask within the visible portions, and triggering, in the user interface, modification of the at least one bounding box in at least one of the plurality of locations to reduce the at least one bounding box to terminate on at least one of the plurality of locations.

Environmental map generation techniques and systems are described. A digital image is scaled to achieve a target aspect ratio using a content aware scaling technique. A canvas is generated that is dimensionally larger than the scaled digital image and the scaled digital image is inserted within the canvas thereby resulting in an unfilled portion of the canvas. An initially filled canvas is then generated by filling the unfilled portion using a content aware fill technique based on the inserted digital image. A plurality of polar coordinate canvases is formed by transforming original coordinates of the canvas into polar coordinates. The unfilled portions of the polar coordinate canvases are filled using a content-aware fill technique that is initialized based on the initially filled canvas. An environmental map of the digital image is generated by combining a plurality of original coordinate canvas portions formed from the polar coordinate canvases.

Techniques are described for identifying a plurality of objects associated with a clipping mask and available for display in a user interface of a digital media editor, identifying, for each of the plurality of objects, a bounding box surrounding a respective object in the plurality of objects, each bounding box defining a plurality of anchor points configured to generate alignment guides for the respective object. The techniques may also includes determining, for each object, visible portions that are within a boundary defined by the clipping mask, determining a plurality of locations in which at least one bounding box intersects with the clipping mask within the visible portions, and triggering, in the user interface, modification of the at least one bounding box in at least one of the plurality of locations to reduce the at least one bounding box to terminate on at least one of the plurality of locations.

Techniques are described for identifying a plurality of objects associated with a clipping mask and available for display in a user interface of a digital media editor, identifying, for each of the plurality of objects, a bounding box surrounding a respective object in the plurality of objects, each bounding box defining a plurality of anchor points configured to generate alignment guides for the respective object. The techniques may also includes determining, for each object, visible portions that are within a boundary defined by the clipping mask, determining a plurality of locations in which at least one bounding box intersects with the clipping mask within the visible portions, and triggering, in the user interface, modification of the at least one bounding box in at least one of the plurality of locations to reduce the at least one bounding box to terminate on at least one of the plurality of locations.