Patent classifications
G06T3/4046
Neural network processor and neural network computation method
The present disclosure provides a neural network processor and neural network computation method that deploy a memory and a cache to perform a neural network computation, where the memory may be configured to store data and instructions of the neural network computation, the cache may be connected to the memory via a memory bus, thereby, the actual compute ability of hardware may be fully utilized, the cost and power consumption overhead may be reduced, parallelism of the network may be fully utilized, and the efficiency of the neural network computation may be improved.
System and method for deep learning image super resolution
In a method for super resolution imaging, the method includes: receiving, by a processor, a low resolution image; generating, by the processor, an intermediate high resolution image having an improved resolution compared to the low resolution image; generating, by the processor, a final high resolution image based on the intermediate high resolution image and the low resolution image; and transmitting, by the processor, the final high resolution image to a display device for display thereby.
Electronic apparatus and controlling method thereof
An electronic apparatus may include a memory that stores first information regarding a plurality of first artificial intelligence models trained to perform image processing differently from each other and second information regarding a second artificial intelligence model trained to identify a type of an image by predicting a processing result of the image by each of the plurality of first artificial intelligence models. The electronic apparatus may further include a processor configured to identify a type of an input image by inputting the input image to the second artificial intelligence model stored in the memory, and process the input image by inputting the input image to one of the plurality of first intelligence models stored in the memory based on the identified type.
Jointly learning visual motion and confidence from local patches in event cameras
A method may include obtaining a set of events, of a set of pixels of a dynamic vision sensor, associated with an object; determining a set of voltages of the set of pixels, based on the set of events; generating a set of images, based on the set of voltages of the set of pixels; inputting the set of images into a first neural network configured to output a visual motion estimation of the object; inputting the set of images into a second neural network configured to output a confidence score of the visual motion estimation output by the first neural network; obtaining the visual motion estimation of the object and the confidence score of the visual motion estimation of the object, based on inputting the set of images into the first neural network and the second neural network; and providing the visual motion estimation of the object and the confidence score.
Image processing apparatus and method of operating the same
An image processing apparatus for performing image quality processing on an image includes a feature extraction network and an image quality processing network including one or more modulation blocks, wherein each of the one or more modulation blocks includes a convolution layer, a modulation layer, and an activation layer for processing the image.
Electronic apparatus and controlling method thereof
Disclosed is an electronic apparatus. The electronic apparatus includes a processor configured to obtain first upscaling information of an input image using an artificial intelligence (AI) model that is trained to obtain upscaling information of an image. The processor is also configured to downscale the input image based on the obtained first upscaling information, and obtain an output image by upscaling the downscaled image based on an output resolution.
Gaming super resolution
A processing device is provided which includes memory and a processor. The processor is configured to receive an input image having a first resolution, generate linear down-sampled versions of the input image by down-sampling the input image via a linear upscaling network and generate non-linear down-sampled versions of the input image by down-sampling the input image via a non-linear upscaling network. The processor is also configured to convert the down-sampled versions of the input image into pixels of an output image having a second resolution higher than the first resolution and provide the output image for display.
Method and data processing system for lossy image or video encoding, transmission and decoding
A method for lossy image or video encoding, transmission and decoding, the method comprising the steps of: receiving an input image at a first computer system; encoding the first input training image using a first trained neural network to produce a latent representation; performing a quantization process on the latent representation to produce a quantized latent; entropy encoding the quantized latent using a probability distribution, wherein the probability distribution is defined using a tensor network; transmitting the entropy encoded quantized latent to a second computer system; entropy decoding the entropy encoded quantized latent using the probability distribution to retrieve the quantized latent; and decoding the quantized latent using a second trained neural network to produce an output image, wherein the output image is an approximation of the input training image.
Generating modified digital images utilizing a global and spatial autoencoder
The present disclosure relates to systems, methods, and non-transitory computer readable media for generating a modified digital image from extracted spatial and global codes. For example, the disclosed systems can utilize a global and spatial autoencoder to extract spatial codes and global codes from digital images. The disclosed systems can further utilize the global and spatial autoencoder to generate a modified digital image by combining extracted spatial and global codes in various ways for various applications such as style swapping, style blending, and attribute editing.
Shared Training of Neural Networks to Reduce Data and for the Object Detection of Image Data
A method for configuring an object detection system includes providing annotated training data comprising image data with defined assignments to at least one object, and training a neural network with a first neural sub-network, which is provided to compress the image data. The first neural sub-network is connected to at least one further neural sub-network. The at least one further neural sub-network is configured to detect an object from the compressed training data. The first neural sub-network is parameterized in such a manner that the object is detected using the at least one further sub-network in a defined quality. The neural sub-networks are trained jointly.