This application provides a three-dimensionalization method and apparatus for a two-dimensional image, an electronic device, and a computer-readable storage medium. The method includes performing depth perception processing on a two-dimensional image, to obtain a depth value of each pixel in the two-dimensional image; performing migration processing on the two-dimensional image from multiple perspectives, to obtain a migration result of the two-dimensional image corresponding to each perspective; determining a color value of each pixel in a migration image corresponding to each perspective, based on the depth value of each pixel in the two-dimensional image and the migration result of the two-dimensional image corresponding to each perspective; generating, based on the color value of each pixel in the migration image of each perspective, the migration image corresponding to the perspective; and encapsulating the migration images of the multiple perspectives in an order, to obtain a three-dimensional video.

An example operation of depth map generation includes one or more of, simultaneously capturing a main-off camera image and an auxiliary-off camera image with an unpowered flash, sparse depth mapping an object based on the main-off camera image and the auxiliary-off camera image, capturing a main-on camera image with a powered flash, foreground probability mapping the object based on the main-off camera image and the main-on camera image and dense depth mapping the object based on the sparse depth map and the foreground probability map.

A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.

A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.

An optical system comprises an imaging lens for imaging an object to an image and a sensing pixel array for detecting lights from the object toward the image. The sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a one-dimensional series of photodiodes having n photodiodes. A photodiode at an end of the one-dimensional series of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite end of the one-dimensional series of photodiodes of the second sensing pixel detects a second light from the object toward the image, where the first light and the second light pass opposite parts of the imaging lens.

An optical system comprises an imaging lens for imaging an object to an image and a sensing pixel array for detecting lights from the object toward the image. The sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a one-dimensional series of photodiodes having n photodiodes. A photodiode at an end of the one-dimensional series of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite end of the one-dimensional series of photodiodes of the second sensing pixel detects a second light from the object toward the image, where the first light and the second light pass opposite parts of the imaging lens.

Methods, systems, and media for generating and rendering immersive video content are provided. In some embodiments, the method comprises: receiving information indicating positions of cameras in a plurality of cameras; generating a mesh on which video content is to be projected based on the positions of the cameras in the plurality of cameras, wherein the mesh is comprised of a portion of a faceted cylinder, and wherein the faceted cylinder has a plurality of facets each corresponding to a projection from a camera in the plurality of cameras; receiving video content corresponding to the plurality of cameras; and transmitting the video content and the generated mesh to a user device in response to receiving a request for the video content from the user device.

An apparatus and method for calculating a cost volume by controlling an intensity so as to receive relatively less influence from a condition of intensity when capturing a stereo image and changing a parameter for each level according to distance is provided. The apparatus includes an illuminator controller, a pixel expected ratio calculator, and a cost volume calculator, and controls intensity using the illuminator when capturing an object, and calculates a cost volume value so as to receive relatively less influence from distance and intensity when performing stereo matching by changing a parameter used for calculating the cost volume value according to distance to the object and intensity.

A system includes a three-dimensional (3D) scanner, a camera with a viewpoint that is different from a viewpoint of the 3D scanner, and one or more processors coupled with the 3D scanner and the camera. The processors access a point cloud from the 3D scanner and one or more images from the camera, the point cloud comprises a plurality of 3D scan-points, a 3D scan-point represents a distance of a point in a surrounding environment from the 3D scanner, and an image comprises a plurality of pixels, a pixel represents a color of a point in the surrounding environment. The processors generate, using the point cloud and the one or more images, an artificial image that represents a portion of the surrounding environment viewed from an arbitrary position in an arbitrary direction, wherein generating the artificial image comprises colorizing each pixel in the artificial image.

A system includes a three-dimensional (3D) scanner, a camera with a viewpoint that is different from a viewpoint of the 3D scanner, and one or more processors coupled with the 3D scanner and the camera. The processors access a point cloud from the 3D scanner and one or more images from the camera, the point cloud comprises a plurality of 3D scan-points, a 3D scan-point represents a distance of a point in a surrounding environment from the 3D scanner, and an image comprises a plurality of pixels, a pixel represents a color of a point in the surrounding environment. The processors generate, using the point cloud and the one or more images, an artificial image that represents a portion of the surrounding environment viewed from an arbitrary position in an arbitrary direction, wherein generating the artificial image comprises colorizing each pixel in the artificial image.