Patent classifications
H04N21/440281
METHOD AND DEVICE FOR LATENCY REDUCTION OF AN IMAGE PROCESSING PIPELINE
In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
Panorama video editing method,apparatus,device and storage medium
The present invention is applicable to the technical field of panoramic videos. Provided are a panoramic video clip method, apparatus and device, and a storage medium. The method comprises acquiring a panoramic video photographed by means of a panoramic camera, and recording an advancing-direction viewing angle of the panoramic camera during moving photographing; carrying out a frame extraction operation on the acquired panoramic video to obtain a corresponding panoramic video frame, carrying out significant target detection on the panoramic video frame, tracking a detected significant target by using a preset target tracking algorithm, and acquiring a viewing angle at which the tracked significant target is located; and clipping the panoramic video according to the advancing-direction viewing angle and the viewing angle at which the significant target is located, so as to generate a target video corresponding to the panoramic video. A panoramic video is automatically clipped, and the fluency of transitions, and the effectiveness and the degree to which content in a target video is interesting are also ensured.
Pipelined video interface for remote controlled aerial vehicle with camera
Disclosed is a system and method for reducing the total latency for transferring a frame from the low latency camera system mounted on an aerial vehicle to the display of the remote controller. The method includes reducing the latency through each of the modules of the system, i.e. through a camera module, an encoder module, a wireless interface transmission, wireless interface receiver module, a decoder module and a display module. To reduce the latency across the modules, methods such as overclocking the image processor, pipelining the frame, squashing the processed frame, using a fast hardware encoder that can perform slice based encoding, tuning the wireless medium using queue sizing, queue flushing, bitrate feedback, physical medium rate feedback, dynamic encoder parameter tuning and wireless radio parameter adjustment, using a fast hardware decoder that can perform slice based decoding and overclocking the display module are used.
Video stream processing method, device, terminal device, and computer-readable storage medium
A video stream processing method, a device, a terminal device, and a computer-readable storage medium are provided, including steps for acquiring a first video stream through a first camera and acquiring a second video stream through a second camera in response to receiving a slow-motion shooting instruction, the slow-motion shooting instruction carrying a frame rate of a slow-motion video stream; encoding the first video stream and the second video stream into a third video stream with a third frame rate, the third frame rate being greater than the first frame rate, and the third frame rate being greater than the second frame rate; and acquiring a fourth video stream with a fourth frame rate through performing a frame interpolation algorithm on the third video stream, the fourth frame rate being the same as the frame rate of the slow-motion video stream.
VIDEO CONTENT CREATION TOOL AND METHOD
A content-creation tool includes a processor and a memory. The processor is configured to receive a first video clip and a second video clip, a respective first and second metadata-item thereof being set to a respective first and second metadata-value. The memory stores video-editing software that includes a timeline interface and instructions that, when executed by the processor, control the processor to: add the first video clip to the timeline interface as a first timeline-track that retains the first metadata-value; add the second video clip to the timeline interface as a second timeline-track that retains the second metadata-value; and generate a frame sequence that includes a plurality of video frames. Each video frame is a frame of, or a frame derived from, one of (i) the first timeline-track, (ii) the second timeline-track, and (iii) a composited time-line-track composited from at least one of the first and second timeline-tracks.
Data Caching Method and Electronic Device
A method includes: running the target application, and caching data of the target application based on a first cache policy, where the first cache policy may include downloading the data of the target application at a first download rate. The target application receives first indication information sent by the control component, where the first indication information is used to indicate that an abnormal area exists in a forward direction of the electronic device. After receiving the first indication information, the target application caches data of the target application based on a second cache policy, where the second cache policy may include downloading the data of the target application at a second download rate, where the second download rate is greater than the first download rate.
Video processing method, electronic device and computer-readable medium
A video-processing method includes: obtaining a video frame rate of received video data; determining whether the video frame rate is less than the refreshing frame rate of a screen; and if yes, modifying at least one of the video frame rate of the video data or the refreshing frequency, so that the video frame rate of the video data is greater than or equal to the refreshing frame rate after modification. According to the present application, the effect that the video frame rate of a video file is greater than or equal to the refreshing frequency of the screen can be guaranteed, thus images corresponding to the video file can be displayed when the screen is refreshed, thereby avoiding standstill phenomena of video playback.
Method and device for latency reduction of an image processing pipeline
In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
Transmission device, transmitting method, reception device, and receiving method
In the case where image data of a super-high definition service is transmitted without scalable coding, image data suitable to own display capability in a receiver not supporting the super-high definition service can be easily obtained. A container in a predetermined format having a video stream including encoded image data is transmitted. Auxiliary information for downscaling a spatial and/or temporal resolution of the image data is inserted into the video stream. For example, the auxiliary information indicates a limit of accuracy for a motion vector included in the encoded image data. Further, for example, the auxiliary information identifies a picture to be selected at the time of downscaling the temporal resolution at a predetermined ratio.
Transmission of reconstruction data in a tiered signal quality hierarchy
One configuration as discussed herein includes a data processor acting as streaming server for providing streaming media from a repository to a decoder. The data processor retrieves reconstruction data and corresponding stream metadata from a repository, the reconstruction data encoded in accordance with a tiered hierarchy including multiple levels of quality. The data processor transmits selected portions of the reconstruction data to one or more decoder resources. The decoder resources reconstruct renditions of portions of a signal such as images/frames based on the transmitted portions of reconstruction data. During the transmission step, the data processor may vary a level of quality of the reconstruction data retrieved and transmitted to the decoder resource. The decoder resources decode the received reconstruction data to play back the signal at different levels of quality.