A communication system captures writing surface content in a physical space for transmittal to remote client devices participating in a communication session. During a communication session with one or more remote client devices, a communication system captures image data and depth data describing objects in a physical space of the communication system. Based on the captured data, the communication system identifies a writing surface in the physical space and captures content on the writing surface. The communication system may also identify objects occluding content on the writing surface based on the captured data and may modify image data to make an object occluding the content at least partially transparent. The communication system transmits the content to at least one of the remote client devices participating in the communication session.

A method of mapping a virtual environment comprises obtaining a first sequence of video images output by a videogame title; obtaining a corresponding sequence of in-game virtual camera positions at which the video images were created; obtaining a corresponding sequence of depth buffer values for a depth buffer used by the videogame whilst creating the video images; and for each of a plurality of video images and corresponding depth buffer values of the obtained sequences, obtain mapping points corresponding to a sampling distribution of points over the area of a respective video image and their associated depth values; wherein respective mapping points are obtained by projecting co-ordinated derived from the sample points from the video image and associated depth values back into a 3D game world co-ordinate system of the videogame title; thereby obtaining a point cloud dataset of mapping points corresponding to the first sequence of video images.

A method of mapping a virtual environment comprises obtaining a first sequence of video images output by a videogame title; obtaining a corresponding sequence of in-game virtual camera positions at which the video images were created; obtaining a corresponding sequence of depth buffer values for a depth buffer used by the videogame whilst creating the video images; and for each of a plurality of video images and corresponding depth buffer values of the obtained sequences, obtain mapping points corresponding to a sampling distribution of points over the area of a respective video image and their associated depth values; wherein respective mapping points are obtained by projecting co-ordinated derived from the sample points from the video image and associated depth values back into a 3D game world co-ordinate system of the videogame title; thereby obtaining a point cloud dataset of mapping points corresponding to the first sequence of video images.

System and method for rendering virtual objects onto an image.

System and method for rendering virtual objects onto an image.

A video recording method includes recording a sequence of video images output by a videogame, recording a sequence of depth buffer values for a depth buffer used by the videogame, recording a sequence of in-game virtual camera positions used to generate the video images, recording one or more in-game events and their respective in-game positions, associating the depth buffer value sequence, the in-game virtual camera position sequence, and an identifier for the videogame, with the video image sequence, and associating the one or more in-game events and their respective in-game positions with the identifier for the videogame. A video playback method includes obtaining a video recording of a videogame playing session, comprising a sequence of video images, obtaining a depth buffer value sequence, an in-game virtual camera position sequence, and an identifier for the videogame that are associated with the video recording, obtaining data indicative of a statistically significant in-game event and an in-game event position, calculating a position within the current video image corresponding to the in-game event position, in dependence upon the associated in-game virtual camera position and depth buffer values, and augmenting the current video image with a graphical representation of the statistically significant in-game event, responsive to the calculated position.

A video recording method includes recording a sequence of video images output by a videogame, recording a sequence of depth buffer values for a depth buffer used by the videogame, recording a sequence of in-game virtual camera positions used to generate the video images, recording one or more in-game events and their respective in-game positions, associating the depth buffer value sequence, the in-game virtual camera position sequence, and an identifier for the videogame, with the video image sequence, and associating the one or more in-game events and their respective in-game positions with the identifier for the videogame. A video playback method includes obtaining a video recording of a videogame playing session, comprising a sequence of video images, obtaining a depth buffer value sequence, an in-game virtual camera position sequence, and an identifier for the videogame that are associated with the video recording, obtaining data indicative of a statistically significant in-game event and an in-game event position, calculating a position within the current video image corresponding to the in-game event position, in dependence upon the associated in-game virtual camera position and depth buffer values, and augmenting the current video image with a graphical representation of the statistically significant in-game event, responsive to the calculated position.

Example detecting methods and apparatus are described. One example method includes: acquiring a two-dimensional image; and constructing, for each of one or more objects under detection in the two-dimensional image, a structured polygon corresponding to the object under detection based on the acquired two-dimensional image, wherein for each object under detection, a structured polygon corresponding to the object represents projection of a three-dimensional bounding box corresponding to the object in the two-dimensional image; for each object under detection, calculating depth information of vertices in the structured polygon based on height information of the object and height information of vertical sides of the structured polygon corresponding to the object; and determining three-dimensional spatial information of the object under detection based on the depth information of the vertices in the structured polygon and two-dimensional coordinate information of the vertices of the structured polygon in the two-dimensional image.

Example detecting methods and apparatus are described. One example method includes: acquiring a two-dimensional image; and constructing, for each of one or more objects under detection in the two-dimensional image, a structured polygon corresponding to the object under detection based on the acquired two-dimensional image, wherein for each object under detection, a structured polygon corresponding to the object represents projection of a three-dimensional bounding box corresponding to the object in the two-dimensional image; for each object under detection, calculating depth information of vertices in the structured polygon based on height information of the object and height information of vertical sides of the structured polygon corresponding to the object; and determining three-dimensional spatial information of the object under detection based on the depth information of the vertices in the structured polygon and two-dimensional coordinate information of the vertices of the structured polygon in the two-dimensional image.

Provided is a non-transitory recording medium storing a computer readable program for screen sharing, the program causing one or more processors to perform: acquiring a drawing command issued by an application to an operating system (OS); and transmitting the drawing command to a terminal on a receiving side.