G06T2219/2016

ANALYSIS APPARATUS, DATA GENERATION METHOD, AND NON-TRANSITORY COMPUTER READABLE MEDIUM
20230008227 · 2023-01-12 · ·

An analysis apparatus includes: a communication unit configured to receive first three-dimensional sensing data from a first sensor and receive second three-dimensional sensing data from a second sensor provided in a position different from a position where the first sensor is provided; a calculation unit configured to calculate a transformation parameter used to transform a reference model indicating the three-dimensional shape of the target object into a three-dimensional shape of the target object indicated by the first and second three-dimensional sensing data; a correction unit configured to correct a transformation parameter in such a way that the reference model is transformed into a three-dimensional shape of the target object at the first timing based on a difference between the first timing and the second timing; and a generation unit configured to generate three-dimensional data obtained by transforming the reference model using the transformation parameter after the correction.

AUGMENTED REALITY VISUALIZER FOR SWIMMING POOLS
20230215115 · 2023-07-06 ·

An augmented reality visualizer for swimming pools is described herein. In one example, a system can receive images of a target area for a swimming pool from a camera. The system can generate an augmented reality environment by analyzing the images. The augmented reality environment can include a virtual swimming pool overlaying at least one image of the target area. The system can then output the augmented reality environment on a display for viewing by a user.

Dynamic and interactive navigation in a surgical environment

A system and method for converting medical images of a particular patient into high resolution, 3D dynamic and interactive images interacting with medical tools including medical devices by coupling a model of tissue dynamics and tool characteristics to the patient specific imagery for simulating a medical procedure in an accurate and dynamic manner. The method includes a tool to add and/or to adjust the dynamic image of tissues and ability to draw and add geometric shapes on the dynamic image of tissues. The system imports the 3D surgery plan (craniotomy, head position, approach etc.). The surgeon establishes multiple views, rotates and interacts with the navigation image to see behind pathology and vital structures. The surgeon can make structures such as tumors, vessels and tissue transparent to improve visualization and to be able to see behind the pathology. The System can warn on proximity of tools to specific anatomical structure.

INFORMATION PROCESSING APPARATUS, METHOD, PROGRAM, AND INFORMATION PROCESSING SYSTEM
20230214005 · 2023-07-06 · ·

An information processing apparatus of the present invention includes an acquisition unit that acquires space information indicative of a position of a physical object in a first space around a first user, a space construction unit that constructs, on the basis of the space information, a shared space that is shared by the first user and a second user who exists in a second space different from the first space and in which the position of the physical object in the first space is reflected, and a determination unit that determines a position of the second user in the shared space.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD AND NON-TRANSITORY STORAGE MEDIUM STORING PROGRAM
20230215123 · 2023-07-06 · ·

An information processing apparatus forms a virtual space that is viewable by a user by using a display device, and includes an information acquirer configured to acquire information that causes at least one of movement of a position of the user and a change in an orientation of the user in the virtual space. The information processing apparatus includes a control circuit configured to output, to the display device, based on the information that is acquired, an image in which a scene being viewed by the user in the virtual space is changed in a predetermined time range.

Augmented reality system for teaching patient care

An augmented reality system including: a physical anatomic model; a display unit via which a user is adapted to receive first and second optic feedbacks, the first optic feedback emanating from the physical anatomic model and passing through the display unit, and the second optic feedback emanating from the display unit and including a virtual anatomic model; a tracking system adapted to track a position and orientation of the display unit; and a computing device adapted to: receive a first signal from the tracking system relating to the position and orientation of the display unit, and send a second signal to cause the display unit to overlay the second optic feedback on the first optic feedback, the second signal being based on the first signal. In some embodiments, the second optic feedback further includes ancillary virtual graphics such as medical data, instructional steps, expert demonstrations, didactic content, and exigent circumstances.

METHOD AND SYSTEM FOR CREATING AND STORING MAP TARGET
20230215098 · 2023-07-06 ·

A method of creating and storing a map target according to one embodiment of the present disclosure, which creates and stores the map target through a map target application executed by at least one processor of a mobile terminal, includes: creating a 3D map based on an image obtained by photographing a 3D space; determining an authoring space in which a virtual object authoring work is to be performed based on the created 3D map; setting reference coordinates based on a target object in the determined authoring space; providing a virtual object authoring interface for performing the virtual object authoring work based on the set reference coordinates; and mapping a virtual object authored through the provided virtual object authoring interface to the target object and storing the virtual object mapped to the target object.

METHOD AND SYSTEM FOR DETERMINING A CURRENT GAZE DIRECTION
20230214011 · 2023-07-06 ·

Method for determining a current gaze direction of a user in relation to a three-dimensional (“3D”) scene, the 3D scene being sampled by a rendering function to produce at least one projection image of the 3D scene, wherein the method comprises the steps: determining, by a reprojection means, a reprojection transformation to be applied to the projection image before being displayed so as to be visible to the user at a gaze time point; determining, by a gaze direction detection means, a physical gaze direction of the user at said gaze time point; and determining a modified gaze direction of the user at said gaze time point, the modified gaze direction being determined in relation to the 3D scene based on both the physical gaze direction and the reprojection transformation. The disclosure also relates to a system and to a computer software function.

AR POSITION AND ORIENTATION ALONG A PLANE

Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.

AR POSITION INDICATOR

Aspects of the present disclosure involve a system for presenting augmented reality (AR) items. The system performs operations including receiving a video that includes a depiction of a real-world environment and generating a 3D model of the real-world environment based on the video. The operations include determining, based on the 3D model of the real-world environment, that an AR item has been placed in the video at a particular 3D position and identifying a portion of the 3D model corresponding to the real-world environment currently being displayed on a screen. The operations include determining that the 3D position of the AR item is excluded from the portion of the 3D model currently being displayed on the screen and in response, displaying an indicator that identifies the 3D position of the AR item in the 3D model relative to the portion of the 3D model currently being displayed on a screen.