G06T3/0037

Projection device, projection system and image correction method
11323674 · 2022-05-03 · ·

A projection device including a processor circuit is provided. The processor circuit generates multiple warped feature points according to multiple first feature points and multiple second feature points. The processor circuit transforms a first mapping table into a second mapping table according to the warped feature points. The projection device projects a correction pattern to a projection screen. The correction pattern includes the first feature points. The processor circuit receives an image of the correction pattern projected to the projection screen that is captured by a 3D image capturing device, so as to obtain coordinate positions of the second feature points. The processor circuit calculates a viewer position according to the coordinate positions of the second feature points. The processor circuit generates an antiwarp image according to an input image and the second mapping table. The projection device projects the antiwarp image to the projection screen.

Flattened view for intra-lumenal navigation

Methods for creation and use (e.g., for navigation) of displays of flattened (e.g., curvature-straightened) 3-D reconstructions of tissue surfaces, optionally including reconstructions of the interior surfaces of hollow organs. In some embodiments, data comprising a 3-D representation of a tissue surface (for example an interior heart chamber surface) are subject to a geometrical transformation allowing the tissue surface to be presented substantially within a single view of a flattened reconstruction. In some embodiments, a catheter probe in use near the tissue surface is shown in positions that correspond to positions in 3-D space sufficiently to permit navigation; e.g., the probe is shown in flattened reconstruction views nearby view regions corresponding to regions it actually approaches. In some embodiments, automatic and/or easily triggered manual view switching between flattened reconstruction and source reconstruction views is implemented.

Extended scene view
11716540 · 2023-08-01 · ·

The disclosure provide methods and content consumption devices that enable a scene, for example a 360° scene, that is larger (i.e. has more pixels in at least one dimension) than a display format of the content consumption device to be displayed. Constituent scene views are received individually by the content consumption device, for example as broadcasts, and are combined, for example stitched together, at the content consumption device to output a part of the scene that fits in the display format. The part of the scene (and hence the required constituent streams) to be displayed are determined by a signal, for example a navigational input from a user, enabling the user to navigate in the scene.

Systems and methods for image processing

An image processing method is provided, including: obtaining image data of a cavity wall of an organ; unfolding the cavity wall; and generating an image of the unfolded cavity wall. The unfolding of the cavity wall may include: obtaining a mask and a centerline of the organ; obtaining a connected region of the mask; dividing the connected region into at least one equidistant block; determining an orientation of the equidistant block in a three-dimensional coordinate system including a first direction, a second direction and a third direction; determining an initial normal vector and an initial tangent vector of a center point of the centerline; assigning a projection of the initial normal vector to a normal vector of a light direction of the center point; assigning the third direction or an reverse direction of the third direction to a tangent vector of the light direction of the center point.

Extraction of standardized images from a single view or multi-view capture

According to various embodiments, component information may be identified for each input image of an object. The component information may indicate a portion of the input image in which a particular component of the object is depicted. A viewpoint may be determined for each input image that indicates a camera pose for the input image relative to the object. A three-dimensional skeleton of the object may be determined based on the viewpoints and the component information. A multi-view panel corresponding to the designated component of the object that is navigable in three dimensions and that the portions of the input images in which the designated component of the object is depicted may be stored on a storage device.

METHODS AND APPARATUS TO FACILITATE 3D OBJECT VISUALIZATION AND MANIPULATION ACROSS MULTIPLE DEVICES
20230022985 · 2023-01-26 ·

Methods and apparatus to facilitate 3D object visualization and manipulation across multiple devices are disclosed. Example apparatus disclosed herein include a viewpoint determiner, a visible shard determiner, and a laminate assembler. The viewpoint determiner determines a viewpoint location of a viewpoint corresponding to a viewing device, the viewpoint location being in a reference frame of a three-dimensional (3D) model. The visible shard determiner determines a visible shard set of the 3D model based on the viewpoint location. The laminate assembler generates a two-dimensional (2D) image of the visible shard set.

HUMAN FACE DATA PROCESSING METHOD AND DEVICE, AND COMPUTER-READABLE STORAGE MEDIUM
20220392015 · 2022-12-08 ·

A human face data processing method according to an embodiment of the present disclosure includes acquiring a picture of a human face by means of a scanning apparatus, obtaining point cloud information by means of a structured light stripe, and further obtaining a three-dimensional model of the human face, and mapping the three-dimensional model onto a circular plane in an area-preserving manner so as to form a two-dimensional human face image. Three-dimensional data is converted into two-dimensional data, thereby facilitating data storage. In addition, the three-dimensional data uses the area-preserving manner, such that the restoration quality is better when the two-dimensional data is restored to the three-dimension data, thereby facilitating the re-utilization of a three-dimensional image.

SINGLE IMAGE-BASED REAL-TIME BODY ANIMATION

Systems and methods for single image-based body animation are provided. An example method includes receiving an input image including an image of a body of a person, fitting a model to the image of the body of the person, where the model is configured to receive a set of pose parameters corresponding to a pose of the body and generate, based on the set of pose parameters, an output image including an image of the body adopting the pose, receiving a further set of pose parameters corresponding to a further pose of the body, providing the further set of pose parameters to the model to generate the output image of the body adopting the further pose, and generating, based on the output image, a frame of an output video including the output image.

Method and device for planarizing three-dimensional data of brain, and computer-readable storage medium

A method of planarizing three dimensional data of a brain implemented by a computer according to an embodiment of the present disclosure includes acquiring a three-dimensional model of the brain scanned by a scanning device, the three-dimensional model including the three-dimensional data of the brain, and mapping, in the computer, the three-dimensional model onto a circle in an area-preserving manner to form an area-preserving map. The method can convert a three-dimensional brain model into a circle or unit disc on a two-dimensional plane so that the brain model can be compared with a reference brain model, and a doctor can judge the position and degree of a brain lesion more accurately.

METHOD AND DEVICE FOR PLANARIZING THREE-DIMENSIONAL DATA OF BRAIN, AND COMPUTER-READABLE STORAGE MEDIUM
20220366528 · 2022-11-17 ·

A method of planarizing three dimensional data of a brain implemented by a computer according to an embodiment of the present disclosure includes acquiring a three-dimensional model of the brain scanned by a scanning device, the three-dimensional model including the three-dimensional data of the brain, and mapping, in the computer, the three-dimensional model onto a circle in an area-preserving manner to form an area-preserving map. The method can convert a three-dimensional brain model into a circle or unit disc on a two-dimensional plane so that the brain model can be compared with a reference brain model, and a doctor can judge the position and degree of a brain lesion more accurately.