An electronic device and method for 3D modeling based on 2D warping is disclosed. The electronic device acquires a color image of a face of a user, depth information corresponding to the color image, and a point cloud of the face. A 3D mean-shape model of a reference 3D face is acquired, and rigid aligned with the point cloud. A 2D projection of the aligned 3D mean-shape model is generated. The 2D projection includes a set of landmark points associated with the aligned 3D mean-shape model. The 2D projection is warped such that the set of landmark points in the 2D projection is aligned with a corresponding set of feature points in the color image. A 3D correspondence between the aligned 3D mean-shape model and the point cloud is determined for a non-rigid alignment of the aligned 3D mean-shape model, based on the warped 2D projection and the depth information.

Systems, methods, and non-transitory computer-readable media can obtain data associated with a computer-based experience. The computer-based experience can be based on interactive real-time technology. At least one virtual camera can be configured within the computer-based experience in a real-time engine. Data associated with an edit cut of the computer-based experience can be obtained based on content captured by the at least one virtual camera. A plurality of shots that correspond to two-dimensional content can be generated from the edit cut of the computer-based experience in the real-time engine. Data associated with a two-dimensional version of the computer-based experience can be generated with the real-time engine based on the plurality of shots. The two-dimensional version can be rendered based on the generated data.

Systems and methods relate to processing optical tomography coherence (OCT) images to predict characteristics of a treatment to be administered to effectively treat age-related macular degeneration. The processing can include pre-processing the image by flattening and/or cropping the image and processing the pre-processed image using a neural network. The neural network can include a deep convolutional neural network. An output of the neural network can indicate a predicted frequency and/or interval at which a treatment (e.g., anti-vascular endothelial growth factor therapy) is to be administered so as to prevent leakage of vasculature in the eye.

In an aspect, an image processing apparatus includes a processor and a memory in which a plurality of images obtained by capturing images of a building and a three-dimensional model of the building are stored in association with each other. The processor is configured to perform a development process to perform development of the three-dimensional model into a two-dimensional image, an extraction process to extract defect information of the building on the basis of the plurality of images, a mapping process to perform mapping of the defect information to the two-dimensional image, and an output process to output the two-dimensional image to which the mapping is performed.

An improved method for coding video is provided that includes Virtual Reality (VR) sequences that enables more efficient encoding by organizing the VR sequence as a single 2D block structure. In the method, reference picture and subpicture lists are created and extended to account for coding of the VR sequence. To further improve coding efficiency, reference indexing can be provided for the temporal and spatial difference between a current VR picture block and the reference pictures and subpictures for the VR sequence. Further, because the reference subpictures for the VR sequence may not have the proper orientation once the VR sequence subpictures are organized into the VR sequence, reorientation of the reference subpictures is made so that the reference subpicture orientations match the current VR subpicture orientations.

Examples include techniques for a fast clear of a 3-dimensional (3D) surface. Examples include re-describing 3D surface to a 2D surface using various dimension of the 3D surface as inputs in an algorithm to output a 2-dimensional (2D) surface as a re-description of the 3D surface. The algorithm to also includes additional inputs associated with a tiling mode used to read or write the 3D surface to a graphics display and a bit per pixel format to output the 2D surface. 2D surface width and height associated with the outputted 2D surface is included in a clear command to cause the 3D surface to be cleared.

A method of detecting a protrusion in an intestinal tract in a computer according to an embodiment of the present disclosure includes acquiring a three-dimensional model of the intestinal tract scanned by a scanning device, the three-dimensional model comprising three-dimensional data of the intestinal tract; mapping, in the computer, the three-dimensional model to a two-dimensional plane in an area-preserving manner; and detecting an area of the protrusion in the two-dimensional plane. The method can replace traditional modes such as enteroscopy, and the protrusion in the intestinal tract is detected in a painless and low-cost mode.

The disclosure relates to method and system for localizing an autonomous ground vehicle (AGV). In an example, the method includes receiving a line drawing corresponding to a two-dimensional (2D) camera scene captured by a camera mounted on the AGV, determining a plurality of ground-touching corner edges based on a plurality of horizontal edges and a plurality of vertical edges in the line drawing, determining a plurality of three-dimensional (3D) points corresponding to a plurality of 2D points in each of the plurality of ground-touching corner edges based on a mapping relationship between an angular orientation of a ground touching edge of an object in real-world and in camera scene and a set of intrinsic parameters of the camera, generating 2D occupancy data by plotting the plurality of 3D points in a 2D plane, and determining a location of the AGV based on the 2D occupancy data and the mapping relationship.

Methods and apparatus to facilitate 3D object visualization and manipulation across multiple devices are disclosed. Example apparatus disclosed herein include a viewpoint determiner, a visible shard determiner, and a laminate assembler. The viewpoint determiner determines a viewpoint location of a viewpoint corresponding to a viewing device, the viewpoint location being in a reference frame of a three-dimensional (3D) model. The visible shard determiner determines a visible shard set of the 3D model based on the viewpoint location. The laminate assembler generates a two-dimensional (2D) image of the visible shard set.

Methods and systems are provided for improving model robustness and generalizability. The method may comprise: acquiring, using a medical imaging apparatus, a medical image of a subject; reformatting the medical image of the subject in multiple scanning orientations; applying a deep network model to the medical image to improve the quality of the medical image; and outputting an improved quality image of the subject for analysis by a physician.