Patent classifications
G06T3/0037
EXTENDED SCENE VIEW
The disclosure provide methods and content consumption devices that enable a scene, for example a 360° scene, that is larger (i.e. has more pixels in at least one dimension) than a display format of the content consumption device to be displayed. Constituent scene views are received individually by the content consumption device, for example as broadcasts, and are combined, for example stitched together, at the content consumption device to output a part of the scene that fits in the display format. The part of the scene (and hence the required constituent streams) to be displayed are determined by a signal, for example a navigational input from a user, enabling the user to navigate in the scene.
Multi-User Application System Environment Engine
A multi-user application system environment engine has an application system that, in turn, includes a simulation engine and a virtualized software environment. The simulation engine runs on top of the virtualized software environment and includes a declaration processor, a scene tree object manager, a persistence processor in communication with the scene tree object manager, a visual editor, an editor broadcaster, an editor listener, and a rendering processor, coupled to the virtualized software environment, to requisition hardware resources to cause physical manifestation of an instantiated scene tree of objects.
JOINT IMAGE UNFOLDING APPARATUS, JOINT IMAGE UNFOLDING METHOD, AND JOINT IMAGE UNFOLDING PROGRAM
A joint image unfolding apparatus, a joint image unfolding method, and a non-transitory computer readable recording medium storing a joint image unfolding program are provided to make it possible to check information regarding the entire cartilage in a joint with high accuracy. An image obtaining unit (21) obtains a three-dimensional image of a joint having cartilage. An unfolding unit (23) unfolds the cartilage included in the three-dimensional image with reference to a specific reference axis in the joint to generate an unfolded image.
Method for image data processing
A method is for image data processing. In an embodiment, the method includes providing a 3D medical image data record, which relates to an elongated anatomical structure, a center line of the elongated anatomical structure being defined in the 3D medical image data record; defining at least one curved slice in the 3D medical image data record, the at least one curved slice winding around the center line; scanning at least one part of the 3D medical image data record into the at least one curved slice; and unrolling the at least one curved slice, into which the at least one part of the 3D medical image data record was scanned, at least one unrolled flat slice being determined. An image data processing unit is also for image data processing and a medical imaging apparatus includes the image data processing unit.
360-degree video encoding with block-based extension of the boundary of projected parts
The invention relates to the encoding of spherical 360-degree videos using 2D block-based encoders. The encoding requires a spherical 360-degree image to be projected onto a projection subpart of a 2D image, using for instance CMP, OHP, ISP, TSP, SSP or RSP techniques. The boundary of the projected image may then be extended, within the 2D image, into an extended block-based boundary portion based on the block structure used by the 2D encoder to then encode the 2D image. The boundary extension may be set along block edges in the vicinity of the projected image. The extended pixels added to the projected image may be padding pixels with values set based on continuing 360-degree image projection or based on neighboring pixels. More homogenous blocks can be obtained for better compression by the encoder, while the seam artefacts resulting from discontinuity between projected subparts of the 360-degree image are reduced.
TRAINING DATA GENERATOR, TRAINING DATA GENERATING METHOD, AND TRAINING DATA GENERATING PROGRAM
A three-dimensional space generating unit 81 generates a three-dimensional space modeling a three-dimensional model with associated attributes and a first background in a virtual space. A two-dimensional object drawing unit 82 draws a two-dimensional object by projecting the three-dimensional model in the three-dimensional space onto a two-dimensional plane. A label generating unit 83 generates a label from the attributes associated with the three-dimensional model from which the two-dimensional object is projected. A background synthesizing unit 84 generates a two-dimensional image by synthesizing the two-dimensional object and a second background. A training data generating unit 85 generates training data that associates the two-dimensional image in which the second background and the two-dimensional object are synthesized with the generated label.
FLATTENED VIEW FOR INTRA-LUMENAL NAVIGATION
Methods for creation and use (e.g., for navigation) of displays of flattened (e.g., curvature-straightened) 3-D reconstructions of tissue surfaces, optionally including reconstructions of the interior surfaces of hollow organs. In some embodiments, data comprising a 3-D representation of a tissue surface (for example an interior heart chamber surface) are subject to a geometrical transformation allowing the tissue surface to be presented substantially within a single view of a flattened reconstruction. In some embodiments, a catheter probe in use near the tissue surface is shown in positions that correspond to positions in 3-D space sufficiently to permit navigation; e.g., the probe is shown in flattened reconstruction views nearby view regions corresponding to regions it actually approaches. In some embodiments, automatic and/or easily triggered manual view switching between flattened reconstruction and source reconstruction views is implemented.
SYSTEM AND METHOD FOR EXTRACTING AND MEASURING SHAPES OF OBJECTS HAVING CURVED SURFACES WITH A VISION SYSTEM
This invention provides a system and method that efficiently detects objects imaged using a 3D camera arrangement by referencing a cylindrical or spherical surface represented by a point cloud, and measures variant features of an extracted object including volume, height, and center of mass, bounding box, and other relevant metrics. The system and method, advantageously, operates directly on unorganized and un-ordered points, requiring neither a mesh/surface reconstruction nor voxel grid representation of object surfaces in a point cloud. Based upon a cylinder/sphere reference model, an acquired 3D point cloud is flattened. Object (blob) detection is carried out in the flattened 3D space, and objects are converted back to the 3D space to compute the features, which can include regions that differ from the regular shape of the cylinder/sphere. Downstream utilization devices and/or processes, such as part reject mechanism and/or robot manipulators can act on the identified feature data.
SYSTEM, INFORMATION PROCESSING APPARATUS, AND METHOD
A system includes a first information processing apparatus and a second information processing apparatus capable of communicating with each other. The first information processing apparatus is configured to acquire three-dimensional point cloud data including multiple vertices each having three parameters of x-, y-, and z-coordinates. A combination of the x- and y-coordinates is different from vertex to vertex. The first or second information processing apparatus is configured to convert the three-dimensional point cloud data into two-dimensional point cloud data in which each of the multiple vertices has two parameters of a parameter m with a different value for each combination of the x- and y-coordinates and the z-coordinate. The second information processing apparatus is configured to generate mesh data, using the two-dimensional point cloud data and information indicating correspondence between the combination of the x- and y-coordinates and the parameter m.
Single image-based real-time body animation
Disclosed are systems and methods for single image-based body animation. An example method includes receiving an input image, the input image including a body image of a person, extracting the body image of the person from the input image, fitting a generic model to the body image, where the generic model is configured to receive a set of pose parameters corresponding to a pose of the person and generate a generic body shape adopting the pose, generating a three-dimensional (3D) model, where the 3D model is configured to receive a set of further pose parameters corresponding to the pose of the person and generate an output image of the person adopting the pose, the output image including a feature of the body image being omitted from the generic body shape, and providing a further set of further pose parameters to generate a frame of an output video.