G06T2219/028

Method and apparatus for generation or editing of layer delineations
11615591 · 2023-03-28 · ·

Methods are disclosed for the generation and editing of layer delineations within three-dimensional tomography scans. Cross sections of a subject are generated and presented to an operator, who has the ability to edit layer delineations within the cross section, or determine parameters used to generate new cross sections. By guiding an operator through a set of displayed cross sections, the methods can allow for a more rapid, efficient, and error-free segmentation of the subject. The cross sections can be nonplanar in shape or planar and non-axis-aligned. The cross sections can be restricted to exclude one or more user-defined regions of the subject, or to include only one or more user-defined regions of the subject. The cross sections can be localized to a point-of-interest. Iterative implementations of the methods can be used to arrive at a segmentation deemed satisfactory by the user.

Navigation system and method for medical operation by a robotic system using a tool

A navigation method for a medical operation and implemented by a robotic system is provided. The method includes the steps of: receiving, at a processor of the robotic system, at least one set of navigation data; receiving or generating at least one three-dimensional model of the virtual object in the navigation data; calculating the navigation data to generate a virtual environment and at least one navigation instruction; and presenting, at a user interface associated with the robotic system, the virtual environment and/or the navigation instruction to a user of the robotic system for the user to refer to during the medical operation.

User interface for image-based rendering of virtual tours

Under an embodiment of the invention, a computer system includes a user interface (UI) for virtual tours of modeled real estate. The UI includes three ways to navigate the modeled real estate. The first navigation element is a 3D UI element that provides a 3D view of the property and enables the user to freely navigate in the XY plane of the virtual model. The second navigation element is a 2D map of the real property overlaid on a portion of the 3D UI element. The 2D map overlay enables navigation in the XY plane of the virtual model. The third navigation element is a 1D text element of the real property overlaid on a portion of the 3D UI element. The 1D text overlay enables navigation along the Z axis or the XY plane of the virtual model.

METHOD AND ELECTRONIC DEVICE FOR SELECTIVE MAGNIFICATION IN THREE DIMENSIONAL RENDERING SYSTEMS

A method for selective magnification in a 3D rendering system includes: displaying, by an electronic device, a first view including at least one real world object and at least one virtual object; displaying, by the electronic device, a second view comprising a region of interest (ROI) in the first view, while displaying the first view; receiving, by the electronic device, a user interaction on the second view; and generating, by the electronic device, interaction on the first view corresponding to the user interaction received on the second view.

Rendering depth-based three-dimensional model with integrated image frames

A system aligns a 3D model of an environment with image frames of the environment and generates a visualization interface that displays a portion of the 3D model and a corresponding image frame. The system receives LIDAR data collected in the environment and generates a 3D model based on the LIDAR data. For each image frame, the system aligns the image frame with the 3D model. After aligning the image frames with the 3D model, when the system presents a portion of the 3D model in an interface, it also presents an image frame that corresponds to the portion of the 3D model.

Image processing apparatus, display system image processing method, and storage medium that processes an image of dentition including a plurality of teeth in an oral cavity
11602259 · 2023-03-14 · ·

An image processing apparatus includes an acquisition unit that acquires three-dimensional data of dentition including a plurality of teeth in an oral cavity, a generator that generates multi-image data of a plurality of images different in point of view toward the dentition based on the three-dimensional data acquired by the acquisition unit, and an output unit that outputs the multi-image data generated by the generator to a display.

Digital Content View Control System
20230127460 · 2023-04-27 · ·

Digital content view control is described as leveraging a hierarchical structure of objects defined within the digital content to control how those objects are rendered in a user interface. In one example, a user input is received to display a view of objects within digital content displayed in a user interface. In response, a data query module is configured to fetch data describing a hierarchical structure of the digital content. From this, a z-order determination module determines a z-order of objects included with the digital content. An object view generation module is also configured to generate object views depicting the objects included in the digital content. The object views, once rendered, support an ability to view positioning of objects within the hierarchy.

IMAGE INFORMATION GENERATING APPARATUS AND METHOD, AND COMPUTER-READABLE STORAGE MEDIUM
20230131239 · 2023-04-27 · ·

Image information appropriately representing the state of changes in the three-dimensional space is generated. According to one embodiment, a server device (SV) stores, in an omnidirectional image storage unit (21), omnidirectional images of a three-dimensional space photographed at a plurality of positions, for each floor of a facility. Where two images of the same floor photographed at different dates and times are displayed for comparison, an omnidirectional image whose photography position coordinates are closest to the photography position coordinates of a comparison reference image is selected from among all omnidirectional images to be compared. The angle of the selected omnidirectional image to be compared is adjusted such that it corresponds to the angle of a comparison reference image. Comparison display image data is generated in which the adjusted comparison image and the comparison reference image are arranged side by side and is transmitted to the user terminal (UT1).

VIRTUAL THREE DIMENSIONAL SHOWROOM SYSTEM AND METHOD
20230063885 · 2023-03-02 ·

Aspects presented herein provide a virtual showroom system and method that facilitates users to arrange showcase items of interest in different virtual environments and settings. In one aspect, an online virtual showroom system provides a first interface including a first virtual 3D environment, the first virtual 3D environment including multiple objects that are selectable through the first interface for placement into a list. The online virtual showroom system provides a second interface including a second virtual 3D environment that is separate from the first virtual 3D environment, the second interface configured to receive a selection of ones of the multiple objects placed into the list for rendering in the second virtual 3D environment and receive an input to manipulate one or more objects from the selected and rendered ones of the multiple objects placed into the list in the second virtual 3D environment.

METHOD FOR GENERATING A 3D PHYSICAL MODEL OF A PATIENT SPECIFIC ANATOMIC FEATURE FROM 2D MEDICAL IMAGES

There is provided a method for generating a 3D physical model of a patient specific anatomic feature from 2D medical images. The 2D medical images are uploaded by an end-user via a Web Application and sent to a server. The server processes the 2D medical images and automatically generates a 3D printable model of a patient specific anatomic feature from the 2D medical images using a segmentation technique. The 3D printable model is 3D printed as a 3D physical model such that it represents a 1:1 scale of the patient specific anatomic feature. The method includes the step of automatically identifying the patient specific anatomic feature.