G06T3/067

Animated seek preview for panoramic videos
10521468 · 2019-12-31 · ·

Generating animated seek previews for panoramic videos is described. In one or more implementations, a video frame associated with a seek point of a panoramic video is received. The video frame is reverse projected to generate a 3D projection. Portions of the 3D projection are then formed that are centered on and span an equatorial axis, and each portion is projected to a 2D plane to generate 2D projections of the portions. Animation frames are generated based on the projected portions, and the animation frames are compiled into an animation for consumption by a user as an animated seek preview of the video frame corresponding to the seek point.

CODEC FOR PROCESSING SCENES OF ALMOST UNLIMITED DETAIL

Methods and apparatus for systems using a scene codec are described, where systems are either providers or consumers of multi-way, just-in-time, only-as-needed scene data including subscenes and subscene increments. An example system using a scene codec includes a plenoptic scene database containing one or more digital models of scenes, where representations and organization of representations are distributable across multiple systems such that collectively the multiplicity of systems can represent scenes of almost unlimited detail. The system may further include highly efficient means for the processing of these representation and organizations of representation providing the just-in-time, only-as-needed subscenes and scene increments necessary for ensuring a maximally continuous user experience enabled by a minimal amount of newly provided scene information, where the highly efficient means include a spatial processing unit.

Human face data processing method and device, and computer-readable storage medium

A human face data processing method according to an embodiment of the present disclosure includes acquiring a picture of a human face by means of a scanning apparatus, obtaining point cloud information by means of a structured light stripe, and further obtaining a three-dimensional model of the human face, and mapping the three-dimensional model onto a circular plane in an area-preserving manner so as to form a two-dimensional human face image. Three-dimensional data is converted into two-dimensional data, thereby facilitating data storage. In addition, the three-dimensional data uses the area-preserving manner, such that the restoration quality is better when the two-dimensional data is restored to the three-dimension data, thereby facilitating the re-utilization of a three-dimensional image.

Systems and methods for creating a 2D film from immersive content

Systems, methods, and non-transitory computer-readable media can obtain data associated with a computer-based experience. The computer-based experience can be based on interactive real-time technology. At least one virtual camera can be configured within the computer-based experience in a real-time engine. Data associated with an edit cut of the computer-based experience can be obtained based on content captured by the at least one virtual camera. A plurality of shots that correspond to two-dimensional content can be generated from the edit cut of the computer-based experience in the real-time engine. Data associated with a two-dimensional version of the computer-based experience can be generated with the real-time engine based on the plurality of shots. The two-dimensional version can be rendered based on the generated data.

Managing infrastructure data

Embodiments may be used to evaluate completed inspection jobs using updated pipe segment data obtained by inspecting a rehabilitated pipe after completion of a project. One embodiment provides a method of generating an infrastructure project summary, including: collecting, using one or more sensors of an inspection robot, pipe segment data relating to the one or more pipe segments; the second pipe segment data comprising one or more of laser condition assessment data and sonar condition assessment data; generating infrastructure summary data for at least a part of the network using the pipe segment data, comparing, using a processor, first and second infrastructure summary data; generating, using the processor, a parameter of the infrastructure project summary based on the comparing; and including the parameter of the infrastructure project summary in a project summary report. Other embodiments are disclosed and claimed.

METHODS AND DEVICES FOR IMMERSING A USER IN AN IMMERSIVE SCENE AND FOR PROCESSING 3D OBJECTS
20240046559 · 2024-02-08 ·

A device for immersing a user in an immersive scene is described. The device sends, to a device for processing 3D objects, a request comprising a position and an orientation of an eye of an avatar of the user in the immersive scene and display parameters for displaying a 3D object in the scene. The device for processing 3D objects determines a two-dimensional image representing a point of view of the eye of the avatar on the 3D object and a position of this image in the scene. This two-dimensional image is displayed in the immersive scene in order to represent the object.

Converting multi-dimensional data for image analysis

Multi-dimensional data can be mapped to a projection shape and converted for image analysis. In some examples, the multi-dimensional data may include data captured by a LIDAR system for use in conjunction with a perception system for an autonomous vehicle. Converting operations can include converting three-dimensional LIDAR data to multi-channel two-dimensional data. Data points of the multi-dimensional data can be mapped to a projection shape, such as a sphere. Characteristics of the projection shape may include a shape, a field of view, a resolution, and a projection type. After data is mapped to the projection shape, the projection shape can be converted to a multi-channel, two-dimensional image. Image segmentation and classification may be performed on the two-dimensional data. Further, segmentation information may be used to segment the three-dimensional LIDAR data, while a rendering plane may be positioned relative to the segmented data to perform classification on a per-object basis.

METHOD AND APPARATUS FOR 2D REGULARIZED PLANAR PROJECTION OF POINT CLOUD
20240112300 · 2024-04-04 ·

The present invention discloses a method and an apparatus for 2D regularized planar projection of a point cloud. The method includes: obtaining original point cloud data; initializing a planar structure of 2D projection of the point cloud; calculating horizontal azimuth information of the point cloud based on the original point cloud data; and determining a mapping relationship between the original point cloud data and the planar structure of 2D projection based on the horizontal azimuth information, to obtain a planar structure of 2D regularized projection of the point cloud. In the present invention, a large-scale point cloud may be projected to a 2D regularized planar structure without 2D local search. Therefore, complexity of an algorithm can be reduced, time spent on 2D regularized planar projection of the point cloud can be reduced, and algorithm performance can be improved.

GENERATION DEVICE, IDENTIFICATION INFORMATION GENERATION METHOD, REPRODUCTION DEVICE, AND IMAGE GENERATION METHOD

There is provided a generation device, an identification information generation method, a reproduction device, and an image generation method capable of easily acquiring a region with a margin and a region with no margin. An identification information generation unit generates margin identification information for identifying that a celestial sphere image includes a region with a margin. A client that uses a margin can easily acquire a region including the margin and a client that does not use a margin can easily acquire a region including no margin. The present technology can be applied to a case in which a celestial sphere image is transmitted from a server and is received and reproduced on a client side.

Three-dimentional plane panorama creation through hough-based line detection
10475232 · 2019-11-12 · ·

A method for creating a plane panorama from point cloud data using Hough transformations is disclosed. The method involves converting the three-dimensional point cloud into a two-dimensional histogram with bins grouping neighboring points, and performing a Hough transformation on the histogram. The resulting transformed data is segmented and the method searches the segments iteratively for a major line, followed by lines that are orthogonal, diagonal, or parallel to the major line, and discards outlying data in each bin as lines are identified. The detected lines are connected to form planes, and the planes are assembled into a hole- and gap-filled panorama. The method may also use an algorithm such as a Random Sample Consensus (RANSAC) algorithm to detect a ground plane.