A background image is also generated, e.g., by filling portions of a captured image where a foreground object was extracted and communicated to the playback device, Foreground objects are identified and point cloud representations of the foreground objects are generated and communicated to a playback device so that they can be used in generating images including the background which is communicated separately. In the case of a point cloud representation a number of points in an environment, e.g., 3D space, are communicated to the playback device along with color information. Thus in some embodiments a foreground object is represented as a set of points with corresponding color information on a per point basis. Foreground object information is communicated and processed in some embodiments at a different rate, e.g., faster rate, then the background textures. The playback device renders images which are sent to the display by first rendering a background layer using the communicated background information, e.g., background texture(s), UV map and environmental geometry, e.g., mesh, to which the background textures are applied.

Image data relating to real-world objects or persons is collected from a scene while collecting audio data relating to the real-world objects or persons from the same scene. The audio data is used to derive sound objects corresponding to the real-world objects or persons. The image data is used to derive video objects corresponding to the real-world objects or persons. Based on the sound objects and the video objects, candidate salient objects are generated. A salient object is selected from among the candidate salient objects. Perceptual enhancement operations are performed on the selected salient object.

A video display system includes a source device for reproducing and outputting contents; and a display device for displaying contents which is output from the source device. Upon receiving a message for requesting display of a 3D video from the source device in a state of unreadiness to display the 3D video, the display device transmits a message for stopping reproduction of 3D contents to the source device. Upon receiving the message for stopping reproduction of 3D contents, the source device stops reproduction of the 3D contents. Upon completing preparations for displaying the 3D video, the display device transmits a message for reproducing the 3D contents to the source device. Upon receiving the message for reproducing the 3D contents, the source device reproduces and outputs the 3D contents.

An apparatus for obtaining a plurality of images of a sample includes a sample device suitable for holding a liquid sample; a first optical detection assembly including a first image acquisition device, the first optical detection assembly having an optical axis and an object plane, the object plane including an image acquisition area from which electromagnetic waves can be detected as an image by the first image acquisition device; one translation unit arranged to move the sample device and the first optical detection assembly relative to each other; and an image illumination device, wherein the apparatus is arranged to move the sample device and the first optical detection assembly relative to each other along a scanning path, which defines an angle theta relative to the optical axis, wherein theta is in the range of about 0.3 to about 89.7 degrees.

The present disclosure relates to imaging systems and methods that include a plurality of cameras configured to capture video image data based on respective fields of view of an environment. Each camera of the plurality of cameras is communicatively coupled to neighbor cameras of the plurality of cameras via a communication interface. Each camera may carry out operations include capturing video image data of the respective field of view and determining an overlay region. The overlay region includes an overlapping portion of video image data captured by the respective camera and at least one of the neighbor cameras. The operations also include cropping and warping the captured video image data of the respective field of view based on the overlay region to form respective processed video image data. The processed video image data may be uploaded to a cloud server and provided, via multiple trunk links, to a client device.

A system and method for tracking the movement of a recording device to form a composite image is provided. The system has a user device with a sensor array capturing motion data and velocity vector data of the recording device when the recording device is in motion, an attachment member for coupling the user device to the motion capturing device, and a server with program modules. The program modules described are a calibration module for calibrating a position of the user device relative to a position of a lens of the recording device, a recorder module for receiving the motion data and velocity vector data from the sensor array; and a conversion module for combining the position of the user device relative to the lens of the recording device, and the motion data and velocity vector data and transforming the data into a file that is usable by a compositing suite, a three-dimensional application, or both.

A system and method for tracking the movement of a recording device to form a composite image is provided. The system has a user device with a sensor array capturing motion data and velocity vector data of the recording device when the recording device is in motion, an attachment member for coupling the user device to the motion capturing device, and a server with program modules. The program modules described are a calibration module for calibrating a position of the user device relative to a position of a lens of the recording device, a recorder module for receiving the motion data and velocity vector data from the sensor array; and a conversion module for combining the position of the user device relative to the lens of the recording device, and the motion data and velocity vector data and transforming the data into a file that is usable by a compositing suite, a three-dimensional application, or both.

A captured scene captured of a live action scene while a display wall is positioned to be part of the live action scene may be processed. To perform the processing, image data of the live action scene having a live actor and the display wall displaying a first rendering of a precursor image is received. Further, precursor metadata for the precursor image displayed on the display wall and display wall metadata for the display wall is determined. An image matte is accessed, where the image matte indicates a first portion associated with the live actor and a second portion associated with the precursor image on the display wall Image quality levels for display wall portions of the display wall in the image data is determined, and pixels associated with the display wall in the image data are adjusted to the image quality levels.

A method implemented by computer means for determining a visual effect of an ophthalmic lens, the method comprising: —an optical data receiving step (S1), during which optical data relating to the optical function of an ophthalmic lens is received, —an acquisition step (S2), during which at least one image of the visual environment of a user is acquired, —a depth map determining step (S3), during which a depth map of the acquired image of the visual environment of the user is determined, —a visual effect determining step (S4), during which based on the depth map and the optical data, a visual effect that would be introduced by the ophthalmic lens if the visual environment was seen through the ophthalmic lens is determined.

In the present invention, the following are provided: a 3D information generating unit (3) for generating 3D information as the data of a group of a plurality of points formed by projecting the values of respective pixels of a moving object in accordance with depth information detected from an image pickup image; an overlooking image generating unit (4) for generating an overlooking image by synthesizing the 3D information of the moving object with a space image of an image pickup target region; and a display control unit (5) for displaying the overlooking image. The present invention is configured so that, even in a case where there are multiple image pickup target regions in a large-scale building in which the floor configuration is complicated, it is unnecessary to display multiple image pickup images using split screen display, and by displaying one overlooking image formed by synthesizing the 3D information of the moving objects formed from the groups of a plurality of points with each of a plurality of image pickup target regions which are included in the entire space of the building, the overall state of the building can be ascertained in one glance by confirming the overlooking image.