A sending-side image converting apparatus sends a transmission image to a network. An image processing server performs image processing on the transmission image and sends the image generated by the image processing to the network. A receiving-side image converting apparatus outputs display images converted from the transmission image and the image generated by the image processing, to a display apparatus. Further, a controlled delay time based on a difference between a delay time in a first transmission path without via the image processing server and a delay time in a second transmission path via the image processing server is obtained on the basis of a characteristic of the display apparatus, and a timing at which the images are output to the display apparatus is controlled. The present technology is applicable to, for example, a medical-use image transmission system.

Systems, methods, and computer-readable media for context-aware synthesis for video frame interpolation are provided. Bidirectional flow may be used in combination with flexible frame synthesis neural network to handle occlusions and the like, and to accommodate inaccuracies in motion estimation. Contextual information may be used to enable frame synthesis neural network to perform informative interpolation. Optical flow may be used to provide initialization for interpolation. Other embodiments may be described and/or claimed.

The present disclosure relates to an image processing apparatus and method that enable suppression of a reduction in subjective image quality. Image processing is performed on each of a plurality of frame images before projection. The image processing suppresses an influence of superimposition of the plurality of frame images in a projection image in projecting each of the plurality of frame images cyclically using a corresponding one of a plurality of projection sections. The plurality of frame images is included in a moving image. The present disclosure can be applied to, for example, an image processing apparatus, an image projection apparatus, a control apparatus, an information processing apparatus, an image projection system, an image processing method, a program, or the like.

A method for forming an image sequence that is an output sequence, from an input image sequence, is provided. The input image sequence has an input spatial resolution and an input temporal resolution. The output sequence has an output temporal resolution equal to the input temporal resolution and an output spatial resolution equal to a predetermined fraction 1/N of the input spatial resolution by an integer number N higher than or equal to 2. The method, implemented for a sub-sequence of the input frame sequence that is a current input sub-sequence and including a preset number of images, includes: obtaining a temporal frequency that is an image frequency, associated with the current input sub-sequence; processing the current input sub-sequence to obtain an output sub-sequence; and inserting the output sub-sequence and the associated image frequency into an output container.

The disclosure provides a method and an apparatus for interpolating a frame to a video. A first deep-level feature of a first frame is obtained and a second deep-level feature of a second frame is obtained. Forward optical flow information and inverse optical flow information between the first frame and the second frame are obtained based on first deep-level feature and the second deep-level feature. An interpolated frame between the first frame and the second frame is generated based on the forward optical flow information and the inverse optical flow information, and the interpolated frame is inserted between the first frame and the second frame.

Various implementations disclosed herein include devices, systems, and methods that create additional depth frames where a depth camera runs at a lower frame rate than a light intensity camera. Rather than upconverting the depth frames by simply repeating a previous depth camera frame, additional depth frames are created by adjusting some of the depth values of a prior frame based on the RGB camera data (e.g., by “dragging” depths from their positions in the prior depth frame to new positions for a new frame). Specifically, a contour image is generated, and changes in the contour image are used to determine how to adjust (e.g., drag) the depth values for the additional depth frames. The contour image may be based on a mask (e.g., occlusions masks identifying where the hand occludes the virtual cube).

A networked system includes an application that produces application frames at a first application frame rate, a graphics processing system that processes the application frames to produce graphics frames at a first graphics frame rate, a VDI system that processes the graphics frames to produce VDI frames at a first VDI frame rate, and an endpoint device that processes the VDI frames to produce endpoint frames at an endpoint frame rate. A frame rate optimization system monitors the application processing, the graphics processing, the VDI processing, and the endpoint processing and, based on the endpoint frame rate, reconfigures at least one of: the application to produce the application frames at a second application frame rate, the graphics processing system to produce the graphics frames at a second graphics frame rate, or the VDI system to produce the VDI frames at a second VDI frame rate.

The invention performs a processing for improving an image quality of a camera in a state where a sufficient link rate cannot be ensured. A controlling method for a camera includes an imaging sensor configured to acquire an imaging data, a signal processing unit configured to perform an image processing on the imaging data, a buffer into which data subjected to the image processing is written, and a format conversion unit configured to convert a format of data read from the buffer and transmit the data to a transmission path, wherein the controlling method includes a status prediction step of predicting a status of the buffer based on a readout rate of the imaging sensor and a link rate of the transmission path and generating a status prediction information, and an adjustment step of adjusting a content of the image processing according to the status prediction information.

Systems, methods, and computer-readable media for context-aware synthesis for video frame interpolation are provided. A convolutional neural network (ConvNet) may, given two input video or image frames, interpolate a frame temporarily in the middle of the two input frames by combining motion estimation and pixel synthesis into a single step and formulating pixel interpolation as a local convolution over patches in the input images. The ConvNet may estimate a convolution kernel based on a first receptive field patch of a first input image frame and a second receptive field patch of a second input image frame. The ConvNet may then convolve the convolutional kernel over a first pixel patch of the first input image frame and a second pixel patch of the second input image frame to obtain color data of an output pixel of the interpolation frame. Other embodiments may be described and/or claimed.

Positions of an image capture device may be used to determine a position-based time-lapse video frame factor. Apparent motion between pairs of images may be used to determine a visual-based time-lapse video frame rate factor. A time-lapse video frame rate for a time-lapse video may be determined based on the position-based time-lapse video frame factor and the visual-based time-lapse video frame rate factor.