G06T3/18

Mixed reality system with virtual content warping and method of generating virtual content using same
10861130 · 2020-12-08 · ·

A computer implemented method for warping virtual content includes generating warped virtual content by transforming source virtual content. The method also includes determining whether a memory location corresponding to an X, Y location of the warped virtual content in an output frame of reference is occupied by pre-existing virtual content. The method further includes storing the warped virtual content in the memory location if the memory location is not occupied. Moreover, the method includes comparing respective Z locations of the warped virtual content and the pre-existing virtual content to identify virtual content with a Z location closer to a viewing location if the memory location is occupied. The method also includes storing the warped virtual content in the memory location corresponding to the X, Y location if a Z location of warped virtual content is closer to the viewing location than a pre-existing Z location of pre-existing virtual content.

Mixed reality system with multi-source virtual content compositing and method of generating virtual content using same
10861237 · 2020-12-08 · ·

A computer implemented method for warping virtual content from two sources includes a first source generating first virtual content based on a first pose. The method also includes a second source generating second virtual content based on a second pose. The method further includes a compositor processing the first and second virtual content in a single pass. Processing the first and second virtual content includes generating warped first virtual content by warping the first virtual content based on a third pose, generating warped second virtual content by warping the second virtual content based on the third pose, and generating output content by compositing the warped first and second virtual content.

Age modelling method

A method for modelling age-related traits of a face, from a picture of the face is provided, wherein the age-related traits are either wrinkles or age spots, the method including: for each age-related trait of the face of the same nature, generating a vector including parameters of shape and appearance of the trait; and generating, from the generated vectors, a single representation vector modeling the age-related traits of the same nature in the face. The single representation vector stores information regarding the number of traits in the face and joint probabilities, over the face, of the shape and appearance features of the traits.

Graphics rendering method and apparatus of virtual reality
10859840 · 2020-12-08 · ·

Provided are graphics rendering method and apparatus of virtual reality, which include according to an acquired spatial position information and direction information of a head-mounted virtual reality device, rendering in accordance with a first angular resolution to generate a first image corresponding to the spatial position information and the direction information; according to an acquired position information of a human eye fixation point on the display screen, rendering in accordance with a second angular resolution to generate a second image corresponding to the position information of the human eye fixation point; and synthesizing the first image and the second image into a third image. Since the first angular resolution and the second angular resolution adopted in the present disclosure are lower angular resolutions, when rendering a virtual reality image, the calculating amount of the GPU may be effectively reduced, and the image rendering efficiency may be improved.

Gesture Mapping For Image Filter Input Parameters

This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both relative gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and absolute gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

IMAGE PROCESSING METHOD AND APPARATUS, AND COMPUTER STORAGE MEDIUM
20200380250 · 2020-12-03 ·

An image processing method and apparatus, and a computer storage medium are provided. The method includes: obtaining a first image, recognizing a target object in the first image, acquiring a first target area of the target object, and acquiring a second target area associated with the first target area; and performing image deformation processing on the first target area and simultaneously performing image deformation processing on the second target area, to generate a second image.

IMAGE DISPLAY APPARATUS AND NON-TRANSITORY COMPUTER READABLE MEDIUM STORING IMAGE DISPLAY PROGRAM
20200380637 · 2020-12-03 · ·

An image display apparatus includes a display screen that displays an image indicative of an object as a display target, and a control unit that performs control to change content of deforming the display target according to the number of contacts with respect to the display screen and a vector in which contact positions based on the contacts are moved.

ATLAS REGISTRATION FOR RESTING STATE NETWORK MAPPING IN PATIENTS WITH BRAIN TUMORS

A method for mapping brain function of a subject includes generating a lesion mask using a search light algorithm based on a plurality of anatomical images of the subject. The plurality of anatomical images are registered with atlas images by nonlinear atlas registration using the generated lesion mask to generate a warping map. A plurality of functional images of the subject are resampled using the warping map to generate a functional map, functional connectivity is computed using the functional map and a multi-layer perceptron.

Method and apparatus for dynamic block partition of an image

A method for geometrically correcting a distorted input frame and generating an undistorted output frame includes capturing and storing an input frame in an external memory, allocating an output frame with an output frame size and dividing the output frame into output blocks, computing a size of the input blocks in the input image corresponding to each output blocks, checking if the size of the input blocks is less than the size of the internal memory and if not dividing until the required input block size of divided sub blocks is less than the size of the internal memory, programming an apparatus with input parameters, fetching the input blocks into an internal memory, processing each of the divided sub blocks sequentially and processing the next output block in step until all the output blocks are processed; and composing the output frame for each of the blocks in the output frame.

View interpolation of multi-camera array images with flow estimation and image super resolution using deep learning

Techniques related to interpolating an intermediate view image from multi-view images are discussed. Such techniques include downsampling first and second images that represent a view of a scene, generating a disparity map based on applying a first CNN to the downscaled first and second images, translating the downscaled first and second images using the disparity map, applying a second CNN to the translated downscaled first and second images and the disparity map to generate a downscaled intermediate image, and upscaling the downscaled intermediate image to an intermediate image at the resolution of the first and second images using an image super-resolution convolutional neural network.