H04N21/42653

Reducing the number of scaling engines used in a display controller to display a plurality of images on a screen
09773477 · 2017-09-26 · ·

Methods and apparatuses to reduce the number of scaling engines used in a display controller that displays image content associated with a plurality of image sources on a screen are provided. A first multiplexer may receive image content from a plurality of storage devices, and select first image content from one of the plurality of image sources. A first scaling engine may process the selected first image content, wherein a plurality of multiplexers can receives an output of the first scaling engine and the image content from the plurality of storage devices, respectively. Each one of the plurality of multiplexers may output either the image content input to the multiplexer or the output of the first scaling engine depending on which image content was scaled by the first scaling engine. Additionally, a plurality of post-processors may perform additional post-processing on the output of the plurality of multiplexer, respectively.

Rendering content on computing systems
09772980 · 2017-09-26 · ·

A system and method for rendering video content is disclosed. Video content is retrieved from a network and rendered by a graphics processing unit (GPU). The retrieved video content is rendered when a display of the video content is in an application foreground, and stopped when the display of the video content is moved from the application foreground to an application background. The rendering of the video content is then resumed when the display of the video content is returned from the application background to the application foreground.

Display apparatus and control method thereof
09774821 · 2017-09-26 · ·

A display apparatus is disclosed. The display apparatus includes an image processor configured to convert a frame rate of an image signal to a frame rate converted image signal, a display configured to display an image based on the frame rate converted image signal, and a controller configured to control the image processor to add an object to at least one of the image signal and the frame rate converted image signal depending on a characteristic of the object.

Method and apparatus for targeting of interactive virtual objects

A method and an apparatus are used to target interactive virtual objects to subscribers in a television delivery system. Programs are selected and virtual object locations are defined in the selected programs. The virtual objects available for targeting are categorized and the categories are correlated to subscriber information to determine the optimum targeting of the virtual objects. The virtual objects may be targeted based on individual subscriber information or on information related to groups of subscribers. When a frame of a program includes a virtual object location, a default or an alternate virtual object is displayed. The virtual object location may change over space or time. The virtual object may be interactive, and may be used to link a subscriber to a remote location, such as an Internet web site. An operations center or a cable headend may generate a group assignment plan that assigns the subscribers' television terminals to groups, based on factors such as area of dominant influence and household income. A retrieval plan is then generated that instructs the television terminals to select the desired virtual object for display. The television terminals record which virtual objects were displayed, and report this information to the cable headends and the operations center. The reported information is used to generate billing for commercial advertisers, and to analyze viewer watching habits. Interactive virtual objects are received by the television terminal with directions on actions to be taken upon selection of the interactive virtual object. Actions may result in the initiation of processes locally at the television terminal, or communication with a remote site for the initiation of processes to be performed remotely. The invention uses upstream data reception hardware, databases and processing hardware and software, and corresponding features in the televisions to accomplish these functions.

Regrouping of video data in host memory

Apparatus for data communications includes a host interface, which is configured to be connected to a bus of a host computer having a processor and a memory. Processing circuitry, which is coupled to the host interface, is configured to receive video data with respect to a sequence of pixels, the video data including data words of more than eight bits per pixel for at least one pixel component of the pixels, and to write the video data, via the host interface, to at least one buffer in the memory while justifying the video data in the memory so that the successive pixels in the sequence are byte-aligned in the at least one buffer.

SEPARATION OF GRAPHICS FROM NATURAL VIDEO IN STREAMING VIDEO CONTENT
20210409734 · 2021-12-30 · ·

Aspects of the subject disclosure may include, for example, a method that includes obtaining, by a processing system including a processor, video frames over a network; the processing system uses a machine learning algorithm to identify in each frame a first region comprising a natural image and a second region comprising a synthetic graphic image. The processing system separates the natural image from the synthetic graphic image to generate a natural video and a graphics video, encodes the natural video, and processes the graphics video to generate instructions for rendering graphic images at a client system. The client system performs a decoding procedure for the encoded video, a rendering procedure for client-side graphics in accordance with the instructions, and a compositing procedure to obtain a presentable video stream including the natural image and a client-side graphic corresponding to the synthetic graphic image. Other embodiments are disclosed.

AUGMENTED REALITY EFFECT RESOURCE SHARING

An augmented reality (AR) effect system can improve application of AR effects by sharing resources between AR effects. The AR effect system can employ manifests for AR effects that define which resources are required to render each AR effect. The AR effect system can organize rendering operations used by selected AR effects into a pipeline and can use the manifests of the AR effects to determine when each resource will be needed. Based on this pipeline, the AR effect system can create a cache order defining a resource schedule which specifies, when a resource is freed, conditions for whether to save the resource to a local cache or unload the resource. As rendering of the video with the AR effects progresses, the resource schedule can control whether resources not currently being used to render an AR effect should be unloaded or cached for fast access for future render operations.

Solution for generating virtual reality representation

The present invention relates to a method for generating virtual reality representation for a plurality of terminal devices. The method comprises: generating location-based data from two sources, a first location-based data representing a terminal device specific local pose coordinates and a second location-based data representing photogrammetric coordinates; constructing a terminal device specific coordinate conversion between coordinates; receiving virtual content; and generating terminal device specific virtual reality representation by applying the constructed terminal device specific coordinate conversion to the received virtual content. The invention also relates to a system and to a computer program product.

Information processing apparatus, control method thereof, and non-transitory computer-readable storage medium
11210762 · 2021-12-28 · ·

This invention provides an apparatus that carries out a playback process on a RAW moving-image, where the apparatus comprises an image processing unit for generating a processed moving image by carrying out image processing, including a developing process, on the RAW moving-image; a memory for storing the processed moving image; and a display control unit for carrying out control so that a bar corresponding to the length of a time axis of the RAW moving-image is displayed, wherein the display control unit displays a processable range, which is a range for which, of the RAW moving-image, the moving image subject to the image processing by the image processing unit can be temporarily stored in the memory, along with the bar, before the image processing on the RAW moving-image in that processable range ends.

Changing Resource Utilization Associated with a Media Object Based on an Engagement Score

In accordance with some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a representation of a first portion of a media object, wherein the first portion of the media object is associated with a first resource utilization value. The first resource utilization value characterizes a utilization of a respective resource by the electronic device. The method includes determining an engagement score that characterizes a level of user engagement with respect to the representation of the first portion of the media object. The method includes changing the utilization of the respective resource from the first resource utilization value to a second resource utilization value based on a function of the engagement score. The second resource utilization value is associated with a second portion of the media object.