Patent classifications
G06T3/18
Image stitching
A computing device is described which has a memory holding at least two input images depicting different parts of a panoramic scene, the images having been captured by a user moving the camera by hand to capture the panorama. The computing device has an image stitching component configured to identify, at a processor, a region of overlap between the at least two images and to calculate a displacement vector for each of a plurality of warp points in the region of overlap. The image stitching component is arranged to warp a second one of the at least two images using the warp points; and to join the warped second image to the first image.
Generating a stylized image or stylized animation by matching semantic features via an appearance guide, a segmentation guide, and/or a temporal guide
Certain embodiments involve generating one or more of appearance guide and a positional guide and using one or more of the guides to synthesize a stylized image or animation. For example, a system obtains data indicating a target image and a style exemplar image. The system generates an appearance guide, a positional guide, or both from the target image and the style exemplar image. The system uses one or more of the guides to transfer a texture or style from the style exemplar image to the target image.
METHOD AND APPARATUS FOR VIDEO SUPER RESOLUTION USING CONVOLUTIONAL NEURAL NETWORK WITH TWO-STAGE MOTION COMPENSATION
A method and an apparatus are provided. The method includes receiving a video with a first plurality of frames having a first resolution; generating a plurality of warped frames from the first plurality of frames based on a first type of motion compensation; generating a second plurality of frames having a second resolution, wherein the second resolution is of higher resolution than the first resolution, wherein each of the second plurality of frames having the second resolution is derived from a subset of the plurality of warped frames using a convolutional network; and generating a third plurality of frames having the second resolution based on a second type of motion compensation, wherein each of the third plurality of frames having the second resolution is derived from a fusing a subset of the second plurality of frames.
INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, RECORDING MEDIUM STORING PROGRAM CODE, AND INFORMATION PROCESSING SYSTEM
An information processing device, an information processing method, a non-transitory recording medium storing a program for causing a computer to execute the information processing method, and an information processing system. The information processing device includes circuitry to specify a pixel value used for a result image indicating a result of analysis on a live subject, based on a pixel value of a live-subject image of the live subject, and superimpose the result image with the specified pixel value on the live-subject image. The information processing method includes specifying a pixel value used for a result image indicating a result of analysis on a live subject, based on a pixel value of a live-subject image of the live subject, and superimposing the result image with the specified pixel value on the live-subject image. The information processing system includes a measurement device to measure a biomedical signal, and the information processing device.
Method and apparatus for real-time virtual reality acceleration
A real-time virtual reality (VR) acceleration method, includes: obtaining an input image (101); partitioning an output image buffer into M rows and N columns of rectangular grid blocks (103); calculating, according to an algorithm integrating anti-distortion, anti-dispersion, and asynchronous time warping (ATW), vertex coordinates of input image grid blocks corresponding to the output image buffer grid blocks (105); calculating two-dimensional mapping coefficients of each pair of grid blocks in the output image buffer and the input image (107); calculating, according to the two-dimensional mapping coefficients, coordinates of an output image pixel corresponding to an input image pixel (109); selecting at least four pixels adjacent to the coordinates of the input image pixel, to calculate the output image pixel value (111); and outputting an image after anti-distortion, anti-dispersion, and ATW (113). VR experience effect of reducing GPU load, reducing bandwidth consumption, decreasing delay, and no dizziness is achieved.
Systems and methods for stitching sequential images of an object
A system may comprise a transport device for moving at least one object, wherein at least one substantially planar surface of the object is moved in a known plane locally around a viewing area, wherein the substantially planar surface of the object is occluded except when the at least one substantially planar surface passes by the viewing area, at least one 2D digital optical sensor configured to capture at least two sequential 2D digital images of the at least one substantially planar surface of the at least one object that is moved in the known plane around the viewing area, and a controller operatively coupled to the 2D digital optical sensor, the controller performing the steps of: a) receiving a first digital image, b) receiving a second digital image, and c) stitching the first digital image and the second digital image using a stitching algorithm to generate a stitched image.
Vanishing point computation for single vanishing point images
Certain embodiments involve calculating a vanishing point location of an image to realistically blend multiple images. For example, a method for modifying image content based on a vanishing point location computed for a background image includes receiving the background image and classifying a set of planes in the background image. The method also includes identifying, using plane boundaries, a first set of line segments that define first convergence points. Additionally, the method includes identifying a second set of line segments that are positioned within individual planes and that define second convergence points. Further, the method includes grouping the first convergence points and the second convergence points into a cluster and computing the vanishing point location from an average of point locations in the cluster. Furthermore, the method includes manipulating a feature image overlaid on the background image to generate a blended image based on the vanishing point location.
Asynchronous time warp with depth data
A wearable display device is described that is connected to a host device. The wearable display device includes one or more sensors configured to generate eye pose data indicating a user's field of view, one or more displays, and one or more processors. The one or more processors are configured to output a representation of the eye pose data to the host device and extract one or more depth values for a rendered frame from depth data output by the host device. The rendered frame is generated using the eye pose data. The one or more processors are further configured to modify one or more pixel values of the rendered frame using the one or more depth values to generate a warped rendered frame and output, for display at the one or more displays, the warped rendered frame.
Media effects using predicted facial feature locations
An effects application receives a video of a face and detects a bounding box for each frame indicating the location and size of the face in each frame. In one or more reference frames. The application uses an algorithm to determine locations of facial features in the frame. The application then normalizes the feature locations relative to the bounding box and saves the normalized feature locations. In other frames (e.g., target frames), the application obtains the bounding box and then predicts the locations of the facial features based on the size and location of the bounding box and the normalized feature locations calculated in the reference frame. The predicted locations can be made available to an augmented reality function that overlays graphics in a video stream based on face tracking in order to apply a desired effect to the video.
Creating shockwaves in three-dimensional depth videos and images
A virtual shockwave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual shockwave creation system to generate, for each of multiple initial depth images, a respective shockwave image by applying a transformation function to the initial three-dimensional coordinates. The virtual shockwave creation system creates a warped shockwave video including a sequence of the generated warped shockwave images. The virtual shockwave creation system presents, via an image display, the warped shockwave video.