A camera assembly for determining depth information for a local area includes a light source assembly, a camera assembly, and a controller. The light source assembly projects pulses of light into the local area. The camera assembly images a portion of the local area illuminated with the pulses. The camera assembly includes augmented pixels, each augmented pixel having a plurality of gates and at least some of the gates have a respective local storage location. An exposure interval of each augmented pixel is divided into intervals associated with the gates, and each local storage location stores image data during a respective interval. The controller reads out, after the exposure interval of each augmented pixel, the image data stored in the respective local storage locations of each augmented pixel to generate image data frames. The controller determines depth information for the local area based in part on the image data frames.

A sequential image photographing device for photographing sequential images of an object to be observed includes: an illuminating unit configured to sequentially irradiate a plurality of light having different wavelength bands to the object; a digital camera configured to photograph the object illuminated by the plurality of the light emitted from the illuminating unit; a controller controlling the illuminating unit and the digital camera; and an image processing unit configured to extract a plurality of channel images corresponding to the respective wavelength band from the image photographed by the digital camera and to obtain the sequential images of the object.

An image processing apparatus acquires first shape information representing a three-dimensional shape about an object located within an image capturing region based on one or more images obtained by one or more imaging apparatuses for performing image capturing of the image capturing region from a plurality of directions, acquires second shape information representing a three-dimensional shape about an object located within the image capturing region based on one or more images obtained by one or more imaging apparatuses, acquires viewpoint information indicating a position and direction of a viewpoint, and generates a virtual viewpoint image corresponding to the position and direction of the viewpoint indicated by the acquired viewpoint information based on the acquired first shape information and the acquired second shape information, such that at least a part of the object corresponding to the second shape information is displayed in a translucent way within the virtual viewpoint image.

A method of inspection or maintenance of a curved ferromagnetic surface using an unmanned aerial vehicle (UAV) having a releasable crawler is provided. The method includes: flying the UAV from an initial position to a pre-perching position in a vicinity of the ferromagnetic surface; autonomously perching the UAV on the ferromagnetic surface; maintaining magnetic attachment of the perched UAV to the ferromagnetic surface; releasing the crawler from the magnetically attached UAV onto the ferromagnetic surface; moving the crawler over the curved ferromagnetic surface while maintaining magnetic attachment of the released crawler to the ferromagnetic surface; inspecting or maintaining the ferromagnetic surface using the magnetically attached crawler; and re-docking the released crawler with the perched UAV.

A system of properly displaying chroma key content is presented. The system obtains a digital representation of a 3D environment, for example a digital photo, and gathers data from that digital representation. The system renders the digital representation in an environmental model and displays that digital representation upon an output device. Depending upon the context, content anchors of the environmental model are selected which will be altered by suitable chroma key content. The chroma key content takes into consideration the position and orientation of the chroma key content relative to the content anchor and relative to the point of view that the environmental model is displayed from in order to accurately display chroma key content in a realistic manner.

Methods, apparatus and systems related to automated production of multimedia contents are described. In one example aspect, an automated production system includes a directing server configured to store production-stage information in a machine-readable script and manage production of a multimedia content according to the script. The system also includes a device management server configured to coordinate one or more shooting locations for the production of the multimedia content. The device management server is configured to receive a portion of the production-stage information extracted from the script based on its location. The system further includes end devices connected to the device management server. The device management server is configured to track activities of the end devices and to provide status of the end devices at a production time to the directing server to enable the directing server to dynamically update the script for subsequent shooting activities at the production time.

A material generation apparatus includes an acquisition unit configured to acquire a plurality of camera images, and a material data generation unit configured to generate, based on a camera image selected from among the camera images, at least one of a foreground image and a background image as material data to be used for generation of an image corresponding to a designated viewpoint.

An image capture apparatus detects a subject in a captured image. The image capture apparatus further recognizes its user based on an eyeball image of the user. The image capture apparatus then selects a main subject area from among the detected subject areas, based on information regarding subjects captured in the past and stored being associated with the recognized user.

An image capture apparatus detects a subject in a captured image. The image capture apparatus further recognizes its user based on an eyeball image of the user. The image capture apparatus then selects a main subject area from among the detected subject areas, based on information regarding subjects captured in the past and stored being associated with the recognized user.

Embodiments provide for a handheld device with a unified desktop for integrating the functionality of the handheld device with a larger computer system. When connected to a peripheral display and/or a display of the larger computer system, the handheld device provides a unified desktop displayed across the screen(s) of the handheld device and the peripheral display. The unified desktop unifies the functionality provided by the larger computer system and the handheld functionality, e.g., communication applications (e.g., phone, SMS, MMS). A user can seamlessly interact with applications, e.g., open, move, close, receive notifications, on the unified desktop whether the applications are displayed on the screens of the handheld device, or the peripheral display of the larger computer system.