Computer-implemented digital image analysis methods, apparatuses, and systems for robotic installation of surgical implants are disclosed. A disclosed apparatus plans a route within an anatomy of a patient from an incision site to a surgical implant site for robotic installation of a surgical implant. The apparatus uses digital imaging data to identify less-invasive installation paths and determine the dimensions of the surgical implant components being used. The apparatus segments the surgical implant into surgical implant subcomponents and modifies the surgical implant subcomponents, such that they can be inserted using the identified less-invasive installation paths.

A system and a method using a system for planning a use includes at least one marking, a control and evaluation unit, a database, a display unit, at least one time of flight sensor for a spatial scanning of a real environment, and at least one camera for imaging the real environment. The real environment in a spatial model can be displayed as a virtual environment on the display unit. The marking in the real environment is arranged at a position and has an orientation. The position and the orientation of the marking can be detected at least by the time of flight sensor and the position and orientation of the marking are linked by a virtual sensor model. The virtual sensor model in the spatial model of the virtual environment can be displayed on the display unit at the position and having the orientation of the marking.

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

A remote control device is a remote control device for an operator to remotely control a real machine, and includes: a limitation unit that sets a movable range of the real machine on the basis of limitation information from the operator; a control unit that generates first command information that is input information for operating the real machine on the basis of control information from the operator and the movable range; and a video display unit that displays a real machine video that is a video of the real machine and a movable information video that is a video of the movable range corresponding to the real machine.

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Systems and a method are provided for programming a cobot for a plurality of cells of an industrial environment. A physical cobot is provided within a lab cell comprising physical lab objects. A virtual simulation system receives information inputs on a virtual cobot representing the physical cobot, regarding a virtual lab cell comprising virtual lab objects, and on a plurality of virtual industrial cells comprising virtual industrial objects. Inputs are received from the physical cobot's movement during teaching whereby the physical cobot is moved in the lab cell to the desired position(s) while providing, via a user interface, a visualization of the virtual cobot's movement within a meta cell generated by superimposing the plurality of virtual industrial cells with the virtual lab cell, so that collisions with any object are minimized. A robotic program is generated based on the received inputs of the physical cobot's movement.

A system and method enabling two-way interactive operations of real-time 3D virtual replicas and real objects are described. The system includes a persistent virtual world system comprising a data structure in which at least one real-time 3D virtual replica of a real object is represented, which is stored and computed on a server; at least one corresponding real objects connected to the real-time 3D virtual replica via a network through the persistent virtual world system stored and computed on the server: and at least one user device connected to the real object via the network through the virtual world system stored and computed on the server. Virtually selecting and thereafter effecting changes on the real-time 3D virtual replica results in a real-time corresponding effect on the real object. Likewise, effecting one or more changes on the real object results in a real-time corresponding effect on the real-time 3D virtual replica.

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.

Systems and a method for programming for a plurality of cells of an industrial environment. A physical cobot is provided within a lab cell comprising lab physical objects. A virtual simulation system with a user interface is provided. The virtual simulation system receives information inputs on the virtual cobot, on the virtual lab cell comprising lab virtual objects, and on a plurality of virtual industrial cells comprising virtual industrial objects. The virtual cobot and the physical cobot are connected together. A superimposed meta-cell is generated by superimposing the plurality of virtual cells and the virtual lab cell so as to obtain a single superimposed meta cell including a set of superimposed virtual objects. The virtual cobot is positioned in the superimposed meta cell. Inputs are received from the physical cobot's movement during teaching whereby the physical cobot is moved in the lab cell to the desired position(s) while providing, via the user interface, a visualization of the virtual cobot's movement within the superimposed meta cell so that collisions with any object are minimized. A robotic program is generated based on the received inputs of the physical cobot's movement.

A surgical method is provided for use with a teleoperated surgical system (surgical system), the method comprising: recording surgical instrument kinematic information indicative of surgical instrument motion produced within the surgical system during the occurrence of the surgical procedure; determining respective kinematic signatures associated with respective surgical instrument motions; producing an information structure in a computer readable storage device that associates respective kinematic signatures with respective control signals; comparing, during a performance of the surgical procedure surgical instrument kinematic information during the performance with at least one respective kinematic signature; launching, during a performance of the surgical procedure an associated respective control signal in response to a match between surgical instrument kinematics during the performance and a respective kinematic signature.