The techniques described herein relate to methods, apparatus, and computer readable media configured to perform media processing tasks. A media processing entity includes a processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the processor, cause the processor to perform receiving, from a remote computing device, multi-view multimedia data comprising a hierarchical track structure comprising at least a first track comprising first media data at a first level of the hierarchical track structure, and a second track comprising task instruction data at a second level in the hierarchical track structure that is different than the first level of the first track. The instructions further cause the processor to perform processing the first media data of the first track based on the task instruction data of the second track to generate modified media data and an output track that includes the modified media data.

An imaging system including visible-light camera(s), depth sensor(s), pose-tracking means, and server(s) configured to: control visible-light camera(s) and depth sensor(s) to capture visible-light images and depth images of real-world environment, respectively, whilst processing pose-tracking data to determine poses of visible-light camera(s) and depth sensor(s); reconstruct three-dimensional lighting model of real-world environment representative of lighting in different regions of real-world environment; receive, from client application, request message comprising information indicative of location in real-world environment where virtual object(s) is to be placed; utilise three-dimensional lighting model to create sample lighting data for said location, wherein sample lighting data is representative of lighting at given location in real-world environment; and provide client application with sample lighting data.

An imaging system including visible-light camera(s), depth sensor(s), pose-tracking means, and server(s) configured to: control visible-light camera(s) and depth sensor(s) to capture visible-light images and depth images of real-world environment, respectively, whilst processing pose-tracking data to determine poses of visible-light camera(s) and depth sensor(s); reconstruct three-dimensional lighting model of real-world environment representative of lighting in different regions of real-world environment; receive, from client application, request message comprising information indicative of location in real-world environment where virtual object(s) is to be placed; utilise three-dimensional lighting model to create sample lighting data for said location, wherein sample lighting data is representative of lighting at given location in real-world environment; and provide client application with sample lighting data.

A camera monitoring system for a bore based medical apparatus is described, wherein the camera monitoring system comprises a first and a second image sensor mounted on opposing surfaces of a circuit board. The first image sensor is arranged to view an object from a first viewpoint via a first lens arrangement and a first mirror and the second image sensor is arranged to view the object from a second viewpoint via a second lens arrangement and a second mirror. By having the image sensors view an object via the mirrors, via the lens arrangements, the lens arrangements contribute to the effective separation of the first and second viewpoints enabling the size of the housing of the camera to be reduced. Furthermore, a method for calibrating a camera monitoring system in a bore based setup is described and also a configuration of arranging a camera monitoring system in connection with a bore based medical apparatus.

A camera monitoring system for a bore based medical apparatus is described, wherein the camera monitoring system comprises a first and a second image sensor mounted on opposing surfaces of a circuit board. The first image sensor is arranged to view an object from a first viewpoint via a first lens arrangement and a first mirror and the second image sensor is arranged to view the object from a second viewpoint via a second lens arrangement and a second mirror. By having the image sensors view an object via the mirrors, via the lens arrangements, the lens arrangements contribute to the effective separation of the first and second viewpoints enabling the size of the housing of the camera to be reduced. Furthermore, a method for calibrating a camera monitoring system in a bore based setup is described and also a configuration of arranging a camera monitoring system in connection with a bore based medical apparatus.

Generating a representation of a scene includes detecting an indication to capture sensor data to generate a virtual representation of a scene in a physical environment at a first time, in response to the indication obtaining first sensor data from a first capture device at the first time, obtaining second sensor data from a second capture device at the first time, and combining the first sensor data and the second sensor data to generate the virtual representation of the scene.

Generating a representation of a scene includes detecting an indication to capture sensor data to generate a virtual representation of a scene in a physical environment at a first time, in response to the indication obtaining first sensor data from a first capture device at the first time, obtaining second sensor data from a second capture device at the first time, and combining the first sensor data and the second sensor data to generate the virtual representation of the scene.

Enhanced methods and systems for generating both a geometry model and an optical-reflectance model (an object reconstruction model) for a physical object, based on a sparse set of images of the object under a sparse set of viewpoints. The geometry model is a mesh model that includes a set of vertices representing the object's surface. The reflectance model is SVBRDF that is parameterized via multiple channels (e.g., diffuse albedo, surface-roughness, specular albedo, and surface-normals). For each vertex of the geometry model, the reflectance model includes a value for each of the multiple channels. The object reconstruction model is employed to render graphical representations of a virtualized object (a VO based on the physical object) within a computation-based (e.g., a virtual or immersive) environment. Via the reconstruction model, the VO may be rendered from arbitrary viewpoints and under arbitrary lighting conditions.

There is disclosed a method and corresponding systems for generating one or more video-based models of a target. The method understood providing video streams from at least two moving or movable vehicles equipped with cameras for simultaneously imaging the target from different viewpoints. Position synchronization of the moving or movable vehicles is provided to create a stable image base, which represents the distance between the moving or movable vehicles. Pointing synchronization of the cameras is provided to cover the same object and/or dynamic event. Time synchronization of the video frames of the video streams is provided to obtain, for at least one point in time, a set of simultaneously registered video frames. The method further included generating, for the at least one point in time, at least one three-dimensional, 3D.

There is disclosed a method and corresponding systems for generating one or more video-based models of a target. The method understood providing video streams from at least two moving or movable vehicles equipped with cameras for simultaneously imaging the target from different viewpoints. Position synchronization of the moving or movable vehicles is provided to create a stable image base, which represents the distance between the moving or movable vehicles. Pointing synchronization of the cameras is provided to cover the same object and/or dynamic event. Time synchronization of the video frames of the video streams is provided to obtain, for at least one point in time, a set of simultaneously registered video frames. The method further included generating, for the at least one point in time, at least one three-dimensional, 3D.