An image pickup apparatus includes an image sensor, a detection sensor, a memory, and a processor. The image sensor is configured to repeatedly perform an image pickup operation to generate a set of a plurality of images with different exposures in one image pickup operation. The detection sensor is configured to perform a first detection to detect a motion of the image sensor. The processor is configured to execute instructions in the memory to perform a second detection to detect a motion vector, to select an image used to detect the motion vector in the second detection based on the motion of the image sensor from the set of the plurality of images with different exposures among the images, and to generate a combined image by performing alignment and combining processing on at least some of the images generated by the image sensor based on the motion vector.

The disclosure relates to a method for setting and visualizing parameters of an objective lens of a camera, in particular for focusing on a moving object, and to a system for per-forming the method. The camera is, for example, embodied as a film camera, in particular as a film camera used in cinematography. The method includes the following steps: calcu-lating a relative position and an alignment of a depth of field of the objective lens in the 3D space, observing the 3D space and/or the object with an AR display and observation de-vice, displaying the relative position and the alignment of the depth of field of the objective lens as an image in the AR display and observation device and/or displaying a focal plane as an image in the AR display and observation device, and setting the objective lens to ob-tain a desired depth of field of the objective lens.

Systems and methods for tracking objects in a field of view are disclosed. In one embodiment a method may include capturing, via a camera, a real-world object in the field of view; generating a first object data associating the real-world object with a first position of the real-world object in a real-world environment at a first time; generating a virtual object representative of the real-world object depicting the real-world object in the first position at the first time; generating a second object data associating the real-world object with a second position of the real-world object in the real-world environment at a second time, determining a displacement value of the real-world object between the first position and the second position, modifying the virtual object to include an indication that the real-world object has been displaced when the displacement value is greater than a threshold value.

A multi-robotic live production and webcast videographic system includes at least one videographic robot operating automatically and performing videography on spot through specific rules or by its own ability after learning; a main controller being a remote control device for receiving video or voice messages from at least one videographic robot; the receiving messages and production data of the main controller being stored in an videographic database; and at least one operation mode unit for determining operation modes of the videographic robot so that the videographic robot acts according to the operation mode; the operation mode unit including an operation mode database which stores various specific operation modes including a logic mode, an AI mode and a scenario mode so that the videographic robot may move to a desire position and adjust the shooting angle according to a selected operation mode.

A systems and methods for compositing real-world video with a virtual object are disclosed. In one embodiment the system includes a processor; and a computer-readable non-transitory storage medium, the medium encoded with instructions that when executed cause the processor to perform operations including receiving video of a video capture region from a camera coupled to an unmanned vehicle; obtaining a map representation of the video capture region; placing the virtual object into the map representation; rendering the video with the virtual object to generate a rendered video; displaying the rendered video; and based on an elevation of the unmanned vehicle, updating the virtual object to transition between a top view of the virtual object and an elevation view or perspective view of the virtual object.

An imaging apparatus and an imaging method that further facilitate recording of a video within an extraction range while moving the extraction range within an angle of view are provided.

An imaging apparatus according to an aspect of the present invention includes an image sensor that captures a reference video which is a motion picture, a housing that accommodates the image sensor, a detection portion for detecting a motion of the housing, and a processor. The processor is configured to execute setting processing of setting an extraction range smaller than an angle of view within the angle of view in a case of capturing the reference video, extraction processing of extracting an extraction video within the extraction range from the reference video, movement processing of moving the extraction range within the angle of view over time in accordance with the motion detected by the detection portion, and recording processing of recording the extraction video during movement of the extraction range in the movement processing on a recording medium.

An apparatus acquires update information indicating a predetermined frame update interval on a moving image at a virtual viewpoint reproduced by updating a virtual viewpoint image at the interval, the virtual viewpoint image being generated using multi-viewpoint images and viewpoint information; acquires frame information of the multi-viewpoint images for use in generating the moving image, the frame information including information of a plurality of frames corresponding to different imaging times; and generates the viewpoint information based on the update information and the frame information, such that the viewpoint information indicating a position of a virtual viewpoint and a direction from the virtual viewpoint updated at an interval longer than the predetermined frame update interval is generated as the viewpoint information for the moving image generated using a smaller number of frames of multi-viewpoint images than frames of virtual viewpoint images forming the moving image.

Methods, apparatus and systems related to production of a movie, a TV show or a multimedia content are described. In one example aspect, a system for producing a movie includes a pre-production subsystem configured to receive information about a storyline, cameras, cast, and other assets for the movie from a user. The pre-production subsystem is configured to generate one or more machine-readable scripts corresponding to one or more scenes. The system includes a production subsystem configured to receive the scripts from the pre-production system to determine constraints among the scenes. The production subsystem is further configured to determine actions for the cameras and the cast for obtaining footages according to the storyline. The system includes a device management subsystem configured to control the cameras and the cast based on the determined actions by the production system and a post-production editing system configured to receive the footages from the production subsystem for performing video and audio editing.

A background display system for a virtual image recording studio comprises a background display device which is configured to display, behind or above a real subject, a representation of a virtual background for a recording by means of an associated camera, and a control device which is configured to control the background display device. The control device comprises a data input for receiving lens data from the associated camera and is configured to adjust the representation of the virtual background in dependence of the received lens data.

Methods, apparatus and systems related to automated production of multimedia contents are described. In one example aspect, an automated production system includes a directing server configured to store production-stage information in a machine-readable script and manage production of a multimedia content according to the script. The system also includes a device management server configured to coordinate one or more shooting locations for the production of the multimedia content. The device management server is configured to receive a portion of the production-stage information extracted from the script based on its location. The system further includes end devices connected to the device management server. The device management server is configured to track activities of the end devices and to provide status of the end devices at a production time to the directing server to enable the directing server to dynamically update the script for subsequent shooting activities at the production time.