G06T2219/2016

SYSTEMS AND METHODS OF CONTRASTIVE POINT COMPLETION WITH FINE-TO-COARSE REFINEMENT
20230019972 · 2023-01-19 ·

An electronic apparatus performs a method of recovering a complete and dense point cloud from a partial point cloud. The method includes: constructing a sparse but complete point cloud from the partial point cloud through a contrastive teacher-student neural network; and transforming the sparse but complete point cloud to the complete and dense point cloud. In some embodiments, the contrastive teacher-student neural network has a dual network structure comprising a teacher network and a student network both sharing the same architecture. The teacher network is a point cloud self-reconstruction network, and the student network is a point cloud completion network.

ARRANGEMENT FOR PRODUCING HEAD RELATED TRANSFER FUNCTION FILTERS
20230222819 · 2023-07-13 ·

When three-dimensional audio is produced by using headphones, particular HRTF-filters are used to modify sound for the left and right channels of the headphone. As the morphology of every ear is different, it is beneficial to have HRTF-filters particularly designed for the user of headphones. Such filters may be produced by deriving ear geometry from a plurality of images taken with an ordinary camera, detecting necessary features from images and fitting said features to a model that has been produced from accurately scanned ears comprising representative values for different sizes and shapes. Taken images are sent to a server (52) that performs the necessary computations and submits the data further or produces the requested filter.

MEDICAL IMAGE PROCESSING SYSTEM, SURGICAL IMAGE CONTROL DEVICE, AND SURGICAL IMAGE CONTROL METHOD
20230222740 · 2023-07-13 ·

[Problem] An aspect of the present disclosure provides a medical image processing system that facilitates the recognition of the position of a 3D model image in a medical image.

[Solution] A medical image processing system includes: an acquisition unit that acquires a real-time 3D surgical image of an operation site stereoscopically viewable by a surgeon and a 3D model image that is a stereoscopic CG image associated with the 3D surgical image; and a superimposition unit that performs enhancement such that the location of the 3D model image at predetermined spatial positions is enhanced with respect to the 3D surgical image or the 3D model image at the start of superimposition of the 3D model image at the predetermined spatial positions when the 3D surgical image is stereoscopically viewed on the basis of information set for the 3D model image.

3D DISPLAY AND IMAGE PROCESSING METHOD AND ASSOCIATED 3D DISPLAY
20230222752 · 2023-07-13 ·

An image processing method suitable for 3D display is provided. The image processing method includes: determining, by a processor in a display-processing element, a current display mode of the 3D display according to a detected user command for activating on-screen display (OSD) menu; in response to the current display mode not being a specific 3D display mode, the processor outputting the OSD menu at a preset position, and outputting an input image; and in response to the current display mode being the specific 3D display mode, the processor outputting the OSD menu at an adjusted position, and outputting the input image, wherein the adjusted position is different from the preset position.

SURGICAL SYSTEM
20230218144 · 2023-07-13 · ·

A surgical system including a surgical instrument having a shaft, an image sensor positioned at a distal end of the shaft, the image sensor being configured to capture images of a target object of a living object, and a control grip is arranged at a proximal end of the shaft. The surgical system further including a monitor for displaying the images and a controller configured to display a virtual target object model image of the target object on the monitor. Where the control grip is configured to position the virtual target object model image displayed on the monitor at a determined position and rotate the virtual target object model image displayed on the monitor at the determined position.

Image processing apparatus and method

The present disclosure relates to an image processing apparatus and method that can prevent an increase in the load of a decoding process for encoded data in a point cloud video-based approach. The parameters related to a plurality of point cloud models of a point cloud are transformed, a two-dimensional plane image onto which the plurality of point cloud models having the transformed parameters is projected is encoded, and a bitstream containing encoded data of the two-dimensional image and transform information that is information regarding the transform of the parameters is generated. The present disclosure can be applied to an information processing device, an image processing apparatus, an electronic apparatus, an information processing method, a program, or the like, for example.

Techniques for placement of extended reality objects relative to physical objects in an extended reality environment

An extended reality (XR) system includes an extended reality application executing on a processor within the XR system. The XR system receives, via a client device, a selection of an extended reality (XR) object located within an XR environment. The XR system receives, via the client device, a request to move the selected XR object within the XR environment. The XR system calculates a first distance between a first feature of the XR object and a first plane associated with a first physical object within the XR environment. The XR system determines that the first distance is within a particular distance. In response to determining that the first distance is within the particular distance, the XR system positions the first feature within the XR environment such that the first feature is coplanar with the first plane.

Providing enhanced functionality in an interactive electronic technical manual

Embodiments of the present disclosure provide methods, apparatus, systems, computer program products for transferring a performance of a procedure found in technical documentation for an item via an interactive electronic technical manual system (IETM) configured to provide electronic and credentialed access to the technical documentation. In one embodiment, a method is provided comprising: providing the steps of the procedure in an order in which the steps are to be carried out; and while a user is participating in the performance of the procedure: causing a particular step that is being carried out to be highlighted; receiving input of a selection of a transfer mechanism and in response: causing an indication to be displayed between the particular step and a next step to be carried out identifying where the performance has been suspended; providing a transfer window displaying transfer information; and recording the transfer information and an identifier for the indication.

ANALYSIS APPARATUS, COMMUNICATION SYSTEM, NON-TRANSITORY COMPUTER READABLE MEDIUM
20230009413 · 2023-01-12 · ·

The analysis apparatus includes a calculation unit configured to calculate a transformation parameter used to transform a reference model indicating a three-dimensional shape of a target object into a three-dimensional shape indicated by three-dimensional sensing data indicating a result of sensing a target object after an elapse of a predetermined period of time since the reference model is generated; an update unit configured to update the reference model using the transformation parameter and three-dimensional sensing data; and a communication unit configured to transmit difference data between vertices of a reference model after the update and vertices of a reference model before the update, difference data between a representative point of the reference model after the update having the transformation parameter and a representative point of the reference model after the update, and a transformation parameter to a terminal device that shares a reference model.

ANIMATED CHAT PRESENCE
20230216901 · 2023-07-06 ·

The present invention relates to a method for generating and causing display of a communication interface that facilitates the sharing of emotions through the creation of 3D avatars, and more particularly with the creation of such interfaces for displaying 3D avatars for use with mobile devices, cloud based systems and the like.