Patent classifications
G06T3/606
Matrix transpose hardware acceleration
In one example, an apparatus comprises: a buffer memory; and a memory access circuit configured to: fetch, from a first memory, a set of first groups of data elements of a first matrix, each first group of data elements being stored at consecutive memory addresses at the first memory; based on a first configuration, store the set of first groups of data elements at consecutive memory addresses or at non-consecutive memory addresses at the buffer memory; based on a second configuration that defines a memory address offset, fetch a set of second groups of the data elements from the buffer memory, each second group of the data elements being stored at consecutive memory addresses of the buffer memory, each second group being separated by the memory address offset in the buffer memory; and store each fetched second group at consecutive addresses of a destination memory to form a second matrix.
NOVEL VIEW SYNTHESIS WITH SPATIAL AND ROTATIONAL CONSISTENCY
Methods, system, and computer storage media are provided for novel view synthesis. An input image depicting an object is received and utilized to generate, via a neural network, a target view image. In exemplary aspects, additional view images are also generated within the same pass of the neural network. A loss is determined based on the target view image and additional view images and is used to modify the neural network to reduce errors. In some aspects, a rotated view image is generated by warping a ground truth image from an initial angle to a rotated view angle that matches a view angle of an image synthesized via the neural network, such as a target view image. The rotated view image and the synthesized image matching the rotated view angle (e.g., a target view image) are utilized to compute a rotational loss.
Systems, methods, and media for adjusting one or more images displayed to a viewer
Systems, methods, and media for adjusting one or more images displayed to a viewer are provided. In some implementations, the system comprises: at least one processing circuit configured to: detect an orientation of a viewer based on at least two points associated with the viewer; determine, based on the orientation, a rotational position of a first image to be displayed on a display; and generate a display image for display on the display, wherein the display image includes at least a portion of the first image rotated based on the rotational position.
Image signal processor for generating a converted image, method of operating the image signal processor, and application processor including the image signal processor
An image signal processor for generating a converted image based on a raw image includes processing circuitry configured to store data corresponding to a plurality of lines of a received image in a line buffer, perform an image processing operation by filtering the data stored in the line buffer based on at least one filter, and divide the raw image into a plurality of sub-images and request the plurality of sub-images from a memory in which the raw image is stored, such that the plurality of sub-images are sequentially received by the line buffer, a width of each of the plurality of sub-images being less than a width of the line buffer, and the plurality of sub-images being parallel to each other.
PROCESSING APPARATUS
There is provided with a processing apparatus. A data holder holds at least some of data of a plurality of channels in a target layer among a plurality of layers. Each of a plurality of processors performs, in parallel, a product-sum operation using the data of one channel of the target layer and a coefficient corresponding to the target layer. A selector selects whether to perform first processing or second processing on the basis of information specifying processing in the target layer. The first processing includes inputting the data of one channel of the target layer into one of the plurality of processors. The second processing includes inputting the data of one channel of the target layer to the plurality of processors in parallel.
VEHICLE NAVIGATION IMAGE SYNTHESIS METHOD AND DEVICE, AND STORAGE MEDIUM
A vehicle navigation image synthesis method includes: acquiring M sampling images; storing N sampling images, a value of N being determined according to a speed of a target vehicle, a position of the target vehicle, and a following distance of the target vehicle; determining a plurality of sampling points of each sampling image of the N sampling images; determining first coordinates of each sampling point of the plurality of sampling points of each sampling image; mapping the first coordinates of each to the reference coordinate system to determine a second coordinate of each sampling point; and synthesizing sampling points of the N sampling images according to second coordinates of the sampling points of the N sampling images to determine a target image.
SYSTEMS, METHODS, AND MEDIA FOR ADJUSTING ONE OR MORE IMAGES DISPLAYED TO A VIEWER
Systems, methods, and media for adjusting one or more images displayed to a viewer are provided. In some implementations, the system comprises: at least one processing circuit configured to: detect an orientation of a viewer based on at least two points associated with the viewer; determine, based on the orientation, a rotational position of a first image to be displayed on a display; and generate a display image for display on the display, wherein the display image includes at least a portion of the first image rotated based on the rotational position.
IMAGE SIGNAL PROCESSOR, METHOD OF OPERATING THE IMAGE SIGNAL PROCESSOR, AND APPLICATION PROCESSOR INCLUDING THE IMAGE SIGNAL PROCESSOR
An image signal processor for generating a converted image based on a raw image includes processing circuitry configured to store data corresponding to a plurality of lines of a received image in a line buffer, perform an image processing operation by filtering the data stored in the line buffer based on at least one filter, and divide the raw image into a plurality of sub-images and request the plurality of sub-images from a memory in which the raw image is stored, such that the plurality of sub-images are sequentially received by the line buffer, a width of each of the plurality of sub-images being less than a width of the line buffer, and the plurality of sub-images being parallel to each other.
ELECTRONIC DEROTATION OF PICTURE-IN-PICTURE IMAGERY
Electronically derotating a picture-in-picture video source can be used to independently derotate a secondary video source separate a primary video source. A method of electronically derotating a picture-in-picture image are described herein, the method comprising processing a first image having a first image primary axis; processing a second image having a second image primary axis; derotating the second image around the second image primary axis to align the second image primary axis substantially parallel with the first image primary axis; and displaying the first image and the second image on a display.
System, method and apparatus for data manipulation
A system, apparatus and method for utilizing a transpose function to generate a two-dimensional array from three-dimensional input data. The use of the transpose function reduces redundant elements in the resultant two-dimensional array thereby increasing efficiency and decreasing power consumption.