A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.

A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.

A communication management system includes: a storage unit configured to store destination information of a first communication terminal that establishes a first session with a relay device that relays communication data, destination information of a conversion system that performs mutual conversion between communication schemes of communication data transmitted from the first communication terminal and a second communication terminal and establishes a second session with the relay device, and destination information of the second communication terminal that establishes a third session with the conversion system; a receiving unit configured to receive start request information to start communication between the communication terminals from the first communication terminal; an extracting unit configured to extract destination information of each communication terminal and the conversion system stored in the storage unit, based on the received start request information; and a transmitting unit configured to transmit the extracted destination information to the relay device.

A communication management system manages a session in which a plurality of terminal apparatuses shares a stroke image. The communication management system includes circuitry configured to: manage stroke information including a plurality of pieces of stroke data representing the stroke image; receive, from a first terminal apparatus, group operation information for designating one or more pieces of stroke data, which are operation targets, from among the plurality of pieces of stroke data; and restrict, based on the group operation information, an operation regarding the one or more pieces of stroke data by a second terminal apparatus, which is different from the first terminal apparatus.

Described herein is a methods and systems for providing a digital interactive experience. Interactive experiences include, but not limited to, synchronized video playback, video and text chat between two or more participants, and interactive live event participation combining synchronized video, text and video chatting. The system comprises persistent and non-persistent components to which a plurality of participants in the interactive experience may connect.

Systems and methods for superimposing the human elements of video generated by computing devices, wherein a first user device and second user device capture and transmit video to a central server which analyzes the video to identify and extract human elements, superimpose these human elements upon one another, adds in at least one augmented reality element, and then transmits the newly created superimposed video back to at least one of the user devices.

Systems and methods are described to enable a device of a user to automatically join an ongoing conference, where the device is not currently joined to the conference. A first audio signature is generated based on voices of users already in the conference, and a second audio signature is generated based on an audio signal captured by a microphone of the device associated with the first user when the device associated with the first user was not joined to the conference. The first audio signature and the second audio signature are compared, and in response to determining that first audio signature matches the second audio signature, the device associated with the first user is joined to the conference.

Visual content from different camera systems is concurrently routed to different applications during video call. A first application (e.g., a video call application) receives visual content from a first camera system while in a video call. The user can request to activate a second application, such as a photography application that allows the user to capture and display, store, or otherwise process visual content. A visual content routing system routes visual content captured by a second camera system (e.g., a rear facing camera system) to the second application concurrently with routing visual content captured by the first camera system (e.g., a front facing camera system) to the first application.

A conferencing system that is connected to multiple information processing devices over a network and provides each of the multiple information processing devices with a conference screen, comprises: a first participant information obtaining unit that obtains first participant information corresponding to a first participant who participates in a video conference by using each of the multiple information processing devices; a second participant information obtaining unit that obtains second participant information related to a second participant who indirectly participates in the video conference together with the first participant; and a display controller that: displays the first participant information obtained by the first participant information obtaining unit in a predetermined display area on the conference screen; and displays the second participant information obtained by the second participant information obtaining unit in the predetermined display area on the conference screen.

Provided is an information processing apparatus that includes an acquisition unit and a generation control unit. The acquisition unit acquires input information including at least one of an image or audio of a first user. The generation control unit controls, on the basis of request information including a request to output information including at least one of an image or audio and the acquired input information, generation of output information related to the first user to be output by a terminal of a second user who is a communication partner of the first user.